Popular GitHub Repositories for Distilbert

Turkish BERT/DistilBERT, ELECTRA, ConvBERT and T5 models

An all-in-one AI audio playground using Cloudflare AI Workers to transcribe, analyze, summarize, and translate any audio file.

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

Build and train state-of-the-art natural language processing models using BERT

Pytorch-Named-Entity-Recognition-with-transformers

Multi-Class Text Classification for products based on their description with Machine Learning algorithms and Neural Networks (MLP, CNN, Distilbert).

Distillation of BERT model with catalyst framework

FoodBERT: Food Extraction with DistilBERT

Topic clustering library built on Transformer embeddings and cosine similarity metrics.Compatible with all BERT base transformers from huggingface.

Compares the DistilBERT and MobileBERT architectures for mobile deployments.

Distilling Task-Specific Knowledge from Teacher Model into BiLSTM

NLP model that predicts subreddit based on the title of a post

Fine-tuned BERT on SQuAd 2.0 Dataset. Applied Knowledge Distillation (KD) and fine-tuned DistilBERT (student) using BERT as the teacher model. Reduced the size of the original BERT by 40%.

A python library to classify dialogue tag.

The Codebase for Causal Distillation for Language Models (NAACL '22)

Task Complexity Classifier using Transformer-based NLP model based on Bloom's Taxonomy

Pre-Trained NER models for Persian ?

Question Answering model based on DistilBERT, trained and evaluated on the SQUAD dataset

NLP model that determines whether a plot is anime enough

An automated solution for fact-checking using available claims and fake-news datasets to fine-tune state-of-the-art language models published recently for NLP tasks (BERT, RoBERTa, XLNet, ConvBERT...) in order to classify unseen claims.