Popular GitHub Repositories for Perception

Visual SLAM/odometry package based on NVIDIA-accelerated cuVSLAM

Perception toolkit for sim2real training and validation in Unity

Python sample codes and documents about Autonomous vehicle control algorithm. This project can be used as a technical guide book to study the algorithms and the software architectures for beginners.

OpenEMMA, a permissively licensed open source "reproduction" of Waymo’s EMMA model.

LSD (LiDAR SLAM & Detection) is an open source perception architecture for autonomous vehicle/robotic

An OpenAI gym wrapper for CARLA simulator

Platform for Situated Intelligence

(CVPR 2022) A minimalist, mapless, end-to-end self-driving stack for joint perception, prediction, planning and control.

Platform for General Robot Intelligence Development

Artificial Intelligence for Kinematics, Dynamics, and Optimization

PillarNeXt: Rethinking Network Designs for 3D Object Detection in LiDAR Point Clouds (CVPR 2023)

Research platform for 3D object detection in PyTorch.

CVPR 2020, "MotionNet: Joint Perception and Motion Prediction for Autonomous Driving Based on Bird's Eye View Maps"

[ICRA2023] CoAlign: Robust Collaborative 3D Object Detection in Presence of Pose Errors

[CoRL 24 Oral] D^3Fields: Dynamic 3D Descriptor Fields for Zero-Shot Generalizable Rearrangement

[NeurIPS 2023] FreeMask: Synthetic Images with Dense Annotations Make Stronger Segmentation Models

LV-DOT: LiDAR-Visual Dynamic Obstacle Detection and Tracking (C++/Python/ROS)

This repo contains evaluation code for the paper "BLINK: Multimodal Large Language Models Can See but Not Perceive". https://arxiv.org/abs/2404.12390 [ECCV 2024]

Steps to reproduce training results for the paper Driving in the Matrix: Can Virtual Worlds Replace Human-Generated Annotations for Real World Tasks?

End to End Autopilot Perception Playbook