Popular GitHub Repositories for World Model

Collect some World Models for Autonomous Driving (and Robotic) papers.

Code for "TD-MPC2: Scalable, Robust World Models for Continuous Control"

[CVPR 2024 Highlight] Visual Point Cloud Forecasting

A skill-based platform for ROS v.2 with knowledge representating, planning and reasoning

Code for "Hierarchical World Models as Visual Whole-Body Humanoid Controllers"

Official repository for "iVideoGPT: Interactive VideoGPTs are Scalable World Models" (NeurIPS 2024), https://arxiv.org/abs/2405.15223

[NeurIPS 2024] Agent Planning with World Knowledge Model

A general AI agent framework that can be adapted to various tasks and environments.

A comprehensive list of papers for the definition of World Models and using World Models for General Video Generation, Embodied AI, and Autonomous Driving, including papers, codes, and related websites.

[ICLR 2025 Oral] PyTorch code for the paper "Open-World Reinforcement Learning over Long Short-Term Imagination"

Official Implementation of DINO-Foresight: Looking into the Future with DINO

The PyTorch implementation of paper: "AdaWorld: Learning Adaptable World Models with Latent Actions".

An implementation of the Genie world model for learning from trained agent exploration of RL environments.

ACT-Bench – We Evaluate Action-Fidelity of World Models for Autonomous Driving

I GAVE GPT-4 EYES!

A real-time, high-frequency, real-world desktop environment that is suitable for desktop-based ML development (agents, world models, etc.)

[NeurIPS 2024] PyTorch code for the paper "Making Offline RL Online: Collaborative World Models for Offline Visual Reinforcement Learning"