Popular GitHub Repositories for Clip

Generating Robotic Simulation Tasks via Large Language Models

中文nlp解决方案(大模型、数据、模型、训练、推理)

Image to prompt with BLIP and CLIP

Collection of AWESOME vision-language models for vision tasks

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

Must-have resource for anyone who wants to experiment with and build on the OpenAI vision API ?

[ACL 2024 ?] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted for spatiotemporal video representation. We also introduce a rigorous 'Quantitative Evaluation Benchmarking' for video-based conversational models.

Search photos on Unsplash using natural language

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

Search inside YouTube videos using natural language

Official Pytorch Implementation for "Text2LIVE: Text-Driven Layered Image and Video Editing" (ECCV 2022 Oral)

[ICCV 2021- Oral] Official PyTorch implementation for Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers, a novel method to visualize any Transformer-based network. Including examples for DETR, VQA.

CLIP + FFT/DWT/RGB = text to image/video

Famous Vision Language Models and Their Architectures

基于Stable Diffusion优化的AI绘画模型。支持输入中英文文本，可生成多种现代艺术风格的高质量图像。| An optimized text-to-image model based on Stable Diffusion. Both Chinese and English text inputs are available to generate images. The model can generate high-quality images in several modern art styles.

Supervision Exists Everywhere: A Data Efficient Contrastive Language-Image Pre-training Paradigm

Keras beit,caformer,CMT,CoAtNet,convnext,davit,dino,efficientdet,edgenext,efficientformer,efficientnet,eva,fasternet,fastervit,fastvit,flexivit,gcvit,ghostnet,gpvit,hornet,hiera,iformer,inceptionnext,lcnet,levit,maxvit,mobilevit,moganet,nat,nfnets,pvt,swin,tinynet,tinyvit,uniformer,volo,vanillanet,yolor,yolov7,yolov8,yolox,gpt2,llama2, alias kecam

?? + ? + ? = ? Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]

LLM2CLIP makes SOTA pretrained CLIP model more SOTA ever.

CLIPort: What and Where Pathways for Robotic Manipulation