Popular GitHub Repositories for Validation

structured outputs for llms

Python library for the instruction and reliable validation of structured outputs (JSON) of Large Language Models (LLMs) with Ollama and Pydantic. -> Deterministic work with LLMs.

Model Validation Toolkit is a collection of tools to assist with validating machine learning models prior to deploying them to production and monitoring them after deployment to production.

Open-source test generation SDK for LLM applications. Access curated test sets. Build context-specific test sets and collaborate with subject matter experts.

ojjson is a library designed to facilitate JSON interactions with Ollama, a large language api (LLM). It leverages the power of Zod for schema validation, ensuring that the JSON input and output conform to specified structures.

A CLI tool to perform syntactic and semantic validation of YAML files.

Pydantic support for parsing, validation, and serialization of tensors

Adversarial RL agents for exploiting weaknesses in autonomous vehicles

The Customer Support Ticket Classification and Response System combines advance AI models with RAG to automate and elevate ticket categorisation and response generation. By leveraging multi-model integration, sentiment analysis, urgency detection, and vector-based retrieval, it delivers precise, context-aware responses and actionable insights.

MLflow in Google Colab to train and validate YOLO models in their various versions, taking advantage of Colab's integration with machine learning and deep learning tools, as well as experiment tracking with MLflow.