Popular GitHub Repositories for Multilingual Models

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

PaddleOCR inference in PyTorch. Converted from [PaddleOCR](https://github.com/PaddlePaddle/PaddleOCR)

Official PyTorch implementation of LiLT: A Simple yet Effective Language-Independent Layout Transformer for Structured Document Understanding (ACL 2022)

Indic-BERT-v1: BERT-based Multilingual Model for 11 Indic Languages and Indian-English. For latest Indic-BERT v2, check: https://github.com/AI4Bharat/IndicBERT

Backprop makes it simple to use, finetune, and deploy state-of-the-art ML models.

Multilingual Generative Pretrained Model

Glot500: Scaling Multilingual Corpora and Language Models to 500 Languages -- ACL 2023

WangChanGLM ? -?The Multilingual Instruction-Following Model

? Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs

Toxic Language Detection in Social Media for Brazilian Portuguese: New Dataset and Multilingual Analysis

Do Multilingual Language Models Think Better in English?

[LREC-COLING'24] HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization

Master thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models could inherit these properties by making it an Efficient Transformer (s.a. the Longformer architecture).

The multilingual language model XLM-R fine-tuned for metaphor detection on a token-level using Huggingface

Official Repository for the paper titled "Meta-Learning for Effective Multi-task and Multilingual Modelling" accepted at EACL 2021

Multilingual Speech to Speech (STS) Translator is the First Ever Code-mixed English-Arabic speech to Bangla-Arabic Speech Translator

PicQ: Demo for MiniCPM-o 2.6 to answer questions about images using natural language.

This repository offers an evaluation of machine translation models for healthcare, focusing on languages like Telugu, Hindi, Arabic, and Swahili. It emphasizes accuracy and medical terminology, aiming to enhance medical communication across diverse languages. The dataset used in evaluation is provided.

Evaluating the Efficacy of Summarization Evaluation across Languages. In Findings of ACL 2021.

VidiQA: Demo for MiniCPM-V 2.6 to answer questions about videos using natural language.