Popular GitHub Repositories for Virtual Reality

A project for processing neural networks and rendering to gain insights on the architecture and parameters of a model through a decluttered representation.

Autonomous car simulator (based on JavaScript & WebGL) implemented by fuzzy control system, genetic algorithm and particle swarm optimization.

Official Code for ECCV 2022 paper "AvatarPoser: Articulated Full-Body Pose Tracking from Sparse Motion Sensing"

Virtual walks in Google Street View using PoseNet and applying Deep Learning models to recognize actions.

[ICCV 2021] PixelSynth: Generating a 3D-Consistent Experience from a Single Image

Official codebase for TRILL (Teleoperation and Imitation Learning for Loco-manipulation)

Building generative VR worlds

[ICCV 2023] Realistic Full-Body Tracking from Sparse Observations via Joint-Level Modeling

ALICE and its prior work, Voice2Action: Language Models as Agent for Efficient Real-Time Interaction in Virtual Reality

Running speech-to-text in a Meta Quest headset using OpenAI's Whisper tiny model

Contains my solutions for various Nanodegree Programs (Robotics, Artificial Intelligence, Machine Learning, Deep Reinforcement Learning, Computer Vision, Sensor Fusion, Flying Cars).

[ECCV 2024] PanoFree: Tuning-Free Holistic Multi-view Image Generation with Cross-view Self-Guidance

Ubiq-Genie is an open-source framework for integrating generative AI capabilities into social VR platforms. It offers a modular approach for server-assisted VR applications, enabling new types of collaborative VR experiences such as conversational agents driven by large language models and voice-driven diffusion-based texture generation.

Create and run interactive behavioral experiments on the web, including VR studies, for free!

Implementation of the paper "Human-like Planning for Reaching in Cluttered Environments" (ICRA 2020)

VR prototype developed in Unity where the user can talk to an AI-driven NPC (ChatGPT API).

Network Designed to Eventually Yield Sentience and Sapience

???? ProfGPT: AI-powered VR professor with electrical circuits lab table ?? Built with Unity ? GPT and Whisper APIs ? and AWS Polly ???

??? Improving wildfire smoke detection models by creating virtual fine-tuning data in Unreal Engine.

Neural network approach to adaptive beam forming for future ITS