MMGL

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun

? Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

A distributed graph deep learning framework.

InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactions

High performance, easy-to-use, and scalable package for learning large-scale knowledge graph embeddings.

Training neural models with structured signals.

Algorithms and Publications on 3D Object Tracking

[SIGIR'2024] "GraphGPT: Graph Instruction Tuning for Large Language Models"