beta-DPO

Flexible and powerful data analysis / manipulation library for Python, providing labeled data structures similar to R data.frame objects, statistical functions, and much more

MedicalGPT: Training Your Own Medical GPT Model with ChatGPT Training Pipeline. 训练医疗大模型，实现了包括增量预训练(PT)、有监督微调(SFT)、RLHF、DPO、ORPO、GRPO。

Align Anything: Training All-modality Model with Feedback

The official PyTorch implementation of Towards Fast, Accurate and Stable 3D Dense Face Alignment, ECCV 2020.

aeneas is a Python/C library and a set of tools to automagically synchronize audio and text (aka forced alignment)

Secrets of RLHF in Large Language Models Part I: PPO

Official PyTorch Implementation of "GAN-Supervised Dense Visual Alignment" (CVPR 2022 Oral, Best Paper Finalist)

This repository collects papers for "A Survey on Knowledge Distillation of Large Language Models". We break down KD into Knowledge Elicitation and Distillation Algorithms, and explore the Skill & Vertical Distillation of LLMs.

FaceXlib aims at providing ready-to-use face-related functions based on current STOA open-source methods.

[NeurIPS 2024] SimPO: Simple Preference Optimization with a Reference-Free Reward