useful-whisper-server

Tengine is a lite, high performance, modular inference engine for embedded device

??An Easy-to-use and Fast Deep Learning Model Deployment Toolkit for ??Cloud ?Mobile and ?Edge. Including Image, Video, Text and Audio 20+ main stream scenarios and 150+ SOTA models with end-to-end optimization, multi-platform and multi-framework support.

an edge-real-time anchor-free object detector with decent performance

Efficient Inference of Transformer models

Free TPU for FPGA with compiler supporting Pytorch/Caffe/Darknet/NCNN. An AI processor for using Xilinx FPGA to solve image classification, detection, and segmentation problem.

Samples code for world class Artificial Intelligence SoCs for computer vision applications.

TinyVision - A Tiny Linux Board / IPC / Server / Router / And so on...

ncnn benchmark on various single board computers

A high performance, high expansion, easy to use framework for AI application. 为AI应用的开发者提供一套统一的高性能、易用的编程框架，快速基于AI全栈服务、开发跨端边云的AI行业应用，支持GPU，NPU加速。

Easy usage of Rockchip's NPUs found in RK3588 and similar chips