Popular GitHub Repositories for Data Retrieval

LLM powered retrieval engine designed to process a ton of sources to collect a comprehensive list of entities.

PyTorch library for Active Fine-Tuning

Use data from MongoDB in LangChain, Llama and OpenAI

This repository contains exemplary workflow using programming tools and libraries for data rescue of historical biodiversity data. These tools combine OCR and text mining approaches to retrieve valuable information like species, functional traits and environments.

ClearCouncil: Automated tools for collecting, organizing, and embedding publicly available local state county council documents (minutes, agendas) into LLMs. Python, JS, and wget scripts included for easy data retrieval and integration.

This project uses a Retrieval-Augmented Generation (RAG) pipeline to extract relevant information from PDFs. Users can upload PDFs, submit queries, and get accurate responses based on the document content. It combines a retriever model and generative model for intelligent, real-time query handling.