Popular GitHub Repositories for Glue

Language Understanding Evaluation benchmark for Chinese: datasets, baselines, pre-trained models,corpus and leaderboard

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

??The official PyTorch implementation for "BERT-of-Theseus: Compressing BERT by Progressive Module Replacing" (EMNLP 2020).

Semantics-aware BERT for Language Understanding (AAAI 2020)

ALBERT model Pretraining and Fine Tuning using TF2.0

pytorch implementation for Patient Knowledge Distillation for BERT Model Compression

Implementation of XLNet that can load pretrained checkpoints

This is the implementation of the paper AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuning (https://arxiv.org/abs/2205.12410).

IndoLEM is a comprehensive Indonesian NLU benchmark, comprising three pillars NLP task: morpho-syntax, semantic, and discourse. Presented in COLING 2020.

CLUE baseline pytorch CLUE的pytorch版本基线

MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

基于bert4keras的GLUE基准代码

Code for the paper "PALBERT: Teaching ALBERT to Ponder", NeurIPS 2022 Spotlight

In MT-BERT we reproduce a neural language understanding model which implements a Multi-Task Deep Neural Network (MT-DNN) for learning representations across multiple NLU tasks.

JGLUE: Japanese General Language Understanding Evaluation for huggingface datasets

[CCL 2023] Revisiting k-NN for Fine-tuning Pre-trained Language Models

KANs for text classification on GLUE tasks

Fine-tuning and deploying BERT through FastAPI

Code and notebook for text summarization with BERT along with a simple baseline model. Includes a research-backed treatment on the state of transfer learning, pretrained models, NLP metrics, and summarization dataset resources.

This repository contains my code solution to DeepLearning.AIs Practical Data Science On AWS Cloud Specialization.