Popular GitHub Repositories for Human Computer Interaction

Awesome work on hand pose estimation/tracking

? Use machine learning in JavaScript to detect eye movements and build gaze-controlled experiences.

A curated list of awesome affective computing ??? papers, software, open-source projects, and resources

Toolkits to create a human-in-the-loop approval layer to monitor and guide AI agents workflow in real-time.

The official implementation for ICMI 2020 Best Paper Award "Gesticulator: A framework for semantically-aware speech-driven gesture generation"

Official PyTorch implementation of TriHorn-Net

Basketball coaches often sketch plays on a whiteboard to help players get the ball through the net. A new AI model predicts how opponents would respond to these tactics.

The python code detects different landmarks on the face and predicts the emotions such as smile based on it. It automatically takes a photo of that person when he smiles. Also when the two eyebrows are lifted up, the system plays a music automatically and the music stops when you blink your right eye.

Cutting-edge Python software utilizing neural networks and machine learning for precise hand movement tracking

Tianbot Rosecho (Tianecho)，中文语音人机交互模块，支持ROS即插即用

Code for the paper "MARL-iDR: Multi-Agent Reinforcement Learning for Incentive-based Residential Demand Response"

This HCI (Human-Computer Interaction) application in Python(3.6) will allow you to control your mouse cursor with your facial movements, works with just your regular webcam. Its hands-free, no wearable hardware or sensors needed.

The official repository of "SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World".

A package for simple, expressive, and customizable text-to-speech with an animated face.

Official repo of Instantaneous Transformers for Video based Physiology estimation (Accepted to AAAI workshop and Springer Studies in Computational Intelligence)

HRI Papers for Industry

Automatic attendance system using facial recognition

?? Applying LLM-powered Personal AI Assistant to Enhance Support for Physical Rehabilitation & Telerehabilitation Therapists, Students, and Patients. Ask your (medical EBSCO) dataset using LLMs and Embeddings. Optionally you can use local LLMs (Vicuna, Orca-mini, Falcon, etc.), OpenAI GPT models or other SaaS solutions via LangChain.

A simple human interface for human-in-the-loop machine learning research, which allows: 1. annote image on webpage, 2. collect human feedback through keyboard input, 3. direct interaction with agents on remote server

本项目旨在通过直观的主动学习界面，将领域知识与贝叶斯深度学习相结合。