unilm

OpenMMLab Self-Supervised Learning Toolbox and Benchmark

PyTorch implementation of "data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language" from Meta AI

Running Microsoft's BitNet inference framework via FastAPI, Uvicorn and Docker.

Distily: Language Model Distillation Toolkit and Library

Rust bindings for bitnet.cpp based on llama-cpp-4

Long term project about a custom AI architecture. Consist of cutting-edge technique in machine learning such as Flash-Attention, Group-Query-Attention, ZeRO-Infinity, BitNet, etc.

This is the repo for the MixKABRN Neural Network (Mixture of Kolmogorov-Arnold Bit Retentive Networks), and an attempt at first adapting it for training on text, and later adjust it for other modalities.

Transformer Bitnet en Verilog

Fine-Tuning of BEiT for Alzheimers Disease Classification

DepthLens: This is a demo for DPT Beit-Large-512 used to estimate the depth of objects in images.