Popular GitHub Repositories for Structured Generation

Structured Text Generation

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

Resource list for generating JSON using LLMs via function calling, tools, CFG. Libraries, Models, Notebooks, etc.

Fast, Flexible and Portable Structured Generation

Faster structured generation

Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models

TensorRT-LLM server with Structured Outputs (JSON) built with Rust

Extract structured data from local or remote LLM models

NLP tasks with zero- and few-shot models.

Structured Generation Evals

A guide to structured generation using constrained decoding

A comprehensive toolkit for streamlining and simplifying the offline inference process for LLMs across various models and libraries.

A gentle tutorial on structured generation using Anthropic and Pydantic

Mistral AI Fine-tuning Hackathon