LLM-Optimizations-QLoRA-AWQ

中文nlp解决方案(大模型、数据、模型、训练、推理)

Label, clean and enrich text datasets with LLMs.

Simple UI for LLM Model Finetuning

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

[CVPR 2025] Official PyTorch Implementation of MambaVision: A Hybrid Mamba-Transformer Vision Backbone

Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

Fast Inference Solutions for BLOOM

Exact structure out of any language model completion.