Popular GitHub Repositories for Hardware Acceleration

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Brevitas: neural network quantization in PyTorch

A lightweight, portable pure C99 onnx inference engine for embedded devices with hardware acceleration support.

QKeras: a quantization deep learning library for Tensorflow Keras

Algebraic enhancements for GEMM & AI accelerators

High-performance, optimized pre-trained template AI application pipelines for systems using Hailo devices

An open source light-weight and high performance inference framework for Hailo devices

[HPCA'21] SpAtten: Efficient Sparse Attention Architecture with Cascade Token and Head Pruning

Hardware accelerator for convolutional neural networks

Hardware accelerated OpenCV, Torch & Tensorrt Ubuntu 20.04 docker images for Jetson Nano containing any python version you need up until the latest 3.12 with ultralytics yolov10 tensorrt support

A bipedal humanoid control system using a Physics-Informed Neural Network (PINN) and Reinforcement Learning (RL) for stability and manipulation tasks. Integrated with ROS for real-time control and FPGA for hardware acceleration, it offers advanced robotic control, ideal for research, education, and practical applications in dynamic environments.

Train neural networks with hardware acceleration in Swift

?Code for paper Parallelizable Complex Neural Dynamics Models for Temperature Estimation with Hardware Acceleration.

Hardware Accelerator for ML

Scalable linear regression for multi-GPU, TPU training with PyTorch

PoC for the acceleration of the core Math functions in Llama2.c to run on GPUs with Shared Memory