Popular GitHub Repositories for Foundation Model

Adding guardrails to large language models.

InternGPT (iGPT) is an open source demo platform where you can easily showcase your AI models. Now it supports DragGAN, ChatGPT, ImageBind, multimodal chat like GPT-4, SAM, interactive image editing, etc. Try it at igpt.opengvlab.com (支持DragGAN、ChatGPT、ImageBind、SAM的在线Demo系统)

[CVPR 2024 Highlight] GenAD: Generalized Predictive Model for Autonomous Driving & Foundation Models in Autonomous System

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

The Clay Foundation Model - An open source AI model and interface for Earth

Visual Med-Alpaca is an open-source, multi-modal foundation model designed specifically for the biomedical domain, built on the LLaMa-7B.

3D Occupancy Prediction Benchmark in Autonomous Driving

Code for the paper "LLark: A Multimodal Instruction-Following Language Model for Music" by Josh Gardner, Simon Durand, Daniel Stoller, and Rachel Bittner.

A curated list of awesome leaderboard-oriented resources for foundation models

A comprehensive survey of forging vision foundation models for autonomous driving, including challenges, methodologies, and opportunities.

? A Collection of Awesome Large Weather Models (LWMs) | AI for Earth (AI4Earth) | AI for Science (AI4Science)

Multi-modal Molecule Structure-text Model for Text-based Editing and Retrieval, Nat Mach Intell 2023 (https://www.nature.com/articles/s42256-023-00759-6)

[MICCAI'23] Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-train

Foundation models based medical image analysis

Text classification with Foundation Language Model LLaMA

Pytorch implementation of paper Ladder Fine-tuning approach for SAM integrating complementary network.

RiboNucleic Acid (RNA) Language Model

Explore this repository for GenAI samples on SAP Business Technology Platform (SAP BTP). We provide examples for single and multitenant versions, showcasing integration of LLMs via SAP AI Core, LangChain in SAP CAP, and advanced techniques like Retrieval Augmented Generation (RAG).

RETFound - A foundation model for retinal image