Popular GitHub Repositories for Xlm

Python library & examples for Masked Language Model Scoring (ACL 2020)

Pytorch-Named-Entity-Recognition-with-transformers

Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023

Exploring the Limits of Low-Resource Neural Machine Translation

Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models could inherit these properties by making it an Efficient Transformer (s.a. the Longformer architecture).

Cross-lingual Visual Pre-training for Multimodal Machine Translation

[EACL 2021] Self-training Pretrained LMs for Zero- and Few-shot Arabic Sequence Labeling

ZeroShot XNLI

XLM implementation with utilities to process and train on large multi-lingual datasets, with not enough RAM.

Generate abstractive summarisation from input text using transformer models