Popular GitHub Repositories for Ngram

Four word embedding models implemented in Python. Supporting arbitrary context features

A Lite Bert For Self-Supervised Learning Language Representations

Python implementation of an N-gram language model with Laplace smoothing and sentence generation.

利用传统方法（N-gram，HMM等）、神经网络方法（CNN，LSTM等）和预训练方法（Bert等）的中文分词任务实现【The word segmentation task is realized by using traditional methods (n-gram, HMM, etc.), neural network methods (CNN, LSTM, etc.) and pre training methods (Bert, etc.)】

multiprocess unsupervised chinese_detect_words ngram_combination

Accurate, fast, lightweight, multilingual, free and open-source next word prediction library

Neural ngram language model in PyTorch.

A Go n-gram indexer for natural language processing with modular tokenizers and data stores

This repository contains implementation of different n-gram models as well as a lightweight implementation of a GPT styled transformer model for next token generation. This is inspired from Andrej Karpathy's video on GPT from Scratch