Finetuning-LLMs

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Kashgari is a production-level NLP Transfer learning framework built on top of tf.keras for text-labeling and text-classification, includes Word2Vec, BERT, and GPT2 Language Embedding.

[CVPR 2021] Official PyTorch implementation for Transformer Interpretability Beyond Attention Visualization, a novel method to visualize classifications by Transformer based networks.

Entity and Relation Extraction Based on TensorFlow and BERT. 基于TensorFlow和BERT的管道式实体及关系抽取，2019语言与智能技术竞赛信息抽取任务解决方案。Schema based Knowledge Extraction, SKE 2019

Portuguese pre-trained BERT models

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models

BlueBERT, pre-trained on PubMed abstracts and clinical notes (MIMIC-III).

Turkish BERT/DistilBERT, ELECTRA, ConvBERT and T5 models

A Model for Natural Language Attack on Text Classification and Inference

BETO - Spanish version of the BERT model