Popular GitHub Repositories for Testing

Qodo-Cover: An AI-Powered Tool for Automated Test Generation and Code Coverage Enhancement! ????

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

The production toolkit for LLMs. Observability, prompt management and evaluations.

ML/AI meta-model, used in MLRun/Iguazio/Nuclio, see qgate-sln-<MLRun | solution>

MLRun/Iguazio/Nuclio quality gate solution. The solution checks a quality of MLRun implementation/delivery.

??Fuzz4All: Universal Fuzzing with Large Language Models

AI Agent for testing Android, iOS, and Web apps. Get Started in 5 Minutes. Arbigent's intuitive UI and powerful code interface make it accessible to everyone, while its scenario breakdown feature ensures scalability for even the most complex tasks.

AUITestAgent is the first automatic, natural language-driven GUI testing tool for mobile apps, capable of fully automating the entire process of GUI interaction and function verification.

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

AI based fuzzer based on imitation learning

YOLOv8 implementation using PyTorch

Your AI testing companion that writes tests on your behalf, automated to get you to build and ship faster without sacrificing unit tests.

BotSIM - a data-efficient end-to-end Bot SIMulation toolkit for evaluation, diagnosis, and improvement of commercial chatbots

Documentation for langsmith

YOLOv8 re-implementation for human detection using PyTorch

Rank LLMs, RAG systems, and prompts using automated head-to-head evaluation

Learn how to create reliable ML systems by testing code, data and models.

EvoEval: Evolving Coding Benchmarks via LLM

Automatic AI-powered test suite generator

Intelligent AI automation examples using Bito CLI and tools