LLM2CLIP

Generating Robotic Simulation Tasks via Large Language Models

中文nlp解决方案(大模型、数据、模型、训练、推理)

Image to prompt with BLIP and CLIP

Collection of AWESOME vision-language models for vision tasks

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

Easily compute clip embeddings and build a clip retrieval system with them

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Must-have resource for anyone who wants to experiment with and build on the OpenAI vision API ?

Collecting awesome papers of RAG for AIGC. We propose a taxonomy of RAG foundations, enhancements, and applications in paper "Retrieval-Augmented Generation for AI-Generated Content: A Survey".

[ACL 2024 ?] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.