Master-Thesis-Multilingual-Longformer
PublicMaster thesis with code investigating methods for incorporating long-context reasoning in low-resource languages, without the need to pre-train from scratch. We investigated if multilingual models could inherit these properties by making it an Efficient Transformer (s.a. the Longformer architecture).
efficient-transformershuggingfacehuggingface-transformerslanguage-modelslongformerlongformer-modelsmultilingualmultilingual-modelsrobertaxlm
Creat：2021-02-17T05:05:45
Update：2025-01-19T17:15:33
33
Stars
0
Stars Increase