Popular GitHub Repositories for Bigbird

Google's BigBird (Jax/Flax & PyTorch) @ ?Transformers

? Pretrained BigBird Model for Korean (up to 4096 tokens)

Persian Bert For Long-Range Sequences

An automated solution for fact-checking using available claims and fake-news datasets to fine-tune state-of-the-art language models published recently for NLP tasks (BERT, RoBERTa, XLNet, ConvBERT...) in order to classify unseen claims.

Analyzing psychedelic trip reports for predictive modeling and harm reduction and creating a trip report generator

Model fine tuned with BigBird is included

BigBird for bio-medical domain