Popular GitHub Repositories for Bloom

BELLE: Be Everyone's Large Language model Engine（开源中文对话大模型）

雅意大模型：为客户打造安全可靠的专属大模型，基于大规模中英文多领域指令数据训练的 LlaMA 2 & BLOOM 系列模型，由中科闻歌算法团队研发。(Repo for YaYi Chinese LLMs based on LlaMA2 & BLOOM)

?Editing large language models within 10 seconds?

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

C++ implementation for BLOOM

Fast Inference Solutions for BLOOM

Crosslingual Generalization through Multitask Finetuning

Firefly中文LLaMA-2大模型，支持增量预训练Baichuan2、Llama2、Llama、Falcon、Qwen、Baichuan、InternLM、Bloom等大模型

? Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

Inferflow is an efficient and highly configurable inference engine for large language models (LLMs).

一个基于HuggingFace开发的大语言模型训练、测试工具。支持各模型的webui、终端预测，低参数量及全参数模型训练(预训练、SFT、RM、PPO、DPO)和融合、量化。

LLMs4OL:? Large Language Models for Ontology Learning

Large language Model fintuning bloom , opt , gpt, gpt2 ,llama,llama-2,cpmant and so on

Train llm (bloom, llama, baichuan2-7b, chatglm3-6b) with deepspeed pipeline mode. Faster than zero/zero++/fsdp.

Two sample projects built for the FourthBrain Generative AI Workshop

Finetune BLOOM

一套代码指令微调大模型

Code for the paper "Larger and more instructable language models become less reliable"

Generate README.md with GPT-3 few-shot learning

Easy-to-use framework for evaluating cross-lingual consistency of factual knowledge (Supported LLaMA, BLOOM, mT5, RoBERTa, etc.) Paper here: https://aclanthology.org/2023.emnlp-main.658/