papagei-foundation-model

Making large AI models cheaper, faster and more accessible

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Reading list for research topics in multimodal machine learning

The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.

DeepSeek-VL: Towards Real-World Vision-Language Understanding

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

A python library for self-supervised learning on images.

? Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.