Popular GitHub Repositories for Dense Retrieval

? RocketQA, dense retrieval for information retrieval and question answering, including both Chinese and English state-of-the-art models.

Tevatron - A flexible toolkit for neural retrieval research and development.

A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).

EMNLP 2021 - Pre-training architectures for dense retrieval

SimXNS is a research project for information retrieval. This repo contains official implementations by MSRA NLC team.

[EMNLP 2022] This is the code repo for our EMNLP‘22 paper "COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning".

揣摩研习社关注自然语言和信息检索前沿技术，解读热门科技论文，分享实用科研工具，挖掘人工智能冰山之下的学术和应用价值！

Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by Prithivi Da, For PRs and Collaboration checkout the readme.

Code for COLING22 paper, DPTDR: Deep Prompt Tuning for Dense Passage Retrieval

?? A graph-augmented dense statute retriever. (EACL 2023)

Explore from keyword search to dense retrieval and reranking, which injects the intelligence of LLMs into your search system, making it faster and more effective.

Multilingual Semantic Search with Reranking on a prepared large vectorized dataset comprising 10 million Wikipedia documents. It supports dense retrieval, keyword search, and hybrid search.

CONVERSER: Few-Shot Conversational Dense Retrieval with Synthetic Data Generation, SIGDIAL 2023

A library to calculate similarity scores between two collections of text sequences encoded using transformer models for bitext mining, dense retrieval, retrieval-based classification, and retrieval-augmented generation (RAG).

Source code of our paper "Unsupervised Multilingual Dense Retrieval via Generative Pseudo Labeling", Findings of EACL 2024.

Experimental code for our paper on informative and diverse sampling of negative examples for dense retrieval

Code for the paper: "Say Less, Mean More: Leveraging Pragmatics in Retrieval-Augmented Generation"