Popular GitHub Repositories for Electra

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Pre-trained Chinese ELECTRA（中文ELECTRA预训练模型）

Pre-trained Transformers for Arabic Language Understanding and Generation (Arabic BERT, Arabic GPT2, Arabic ELECTRA)

Pretrained ELECTRA Model for Korean

Turkish BERT/DistilBERT, ELECTRA, ConvBERT and T5 models

Pretrain and finetune ELECTRA with fastai and huggingface. (Results of the paper replicated !)

? Korean Comments ELECTRA: ??? ??? ??? ELECTRA ??

Build and train state-of-the-art natural language processing models using BERT

AI and Memory Wall

Pytorch-Named-Entity-Recognition-with-transformers

DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models

Baseline code for Korean open domain question answering(ODQA)

Electra pre-trained model using Vietnamese corpus

基于bert4keras的GLUE基准代码

Open-source benchmark datasets and pretrained transformer models in the Filipino language.

基于tensorflow1.x的预训练模型调用，支持单机多卡、梯度累积，XLA加速，混合精度。可灵活训练、验证、预测。

Character-level Korean ELECTRA Model (?? ?? ??? ELECTRA)

Pytorch ????? ??? ????(BERT MLM, ELECTRA), ???? ???.

BioELECTRA

Pre-training Language Models for Japanese