CoOp

Making large AI models cheaper, faster and more accessible

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Reading list for research topics in multimodal machine learning

Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%

Must-read papers on prompt-based tuning for pre-trained language models.

An open-source framework for training large multimodal models.

DeepSeek-VL: Towards Real-World Vision-Language Understanding

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

? Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.