Popular GitHub Repositories for Metrics

High-level library to help with training and evaluating neural networks in PyTorch flexibly and transparently.

Machine learning metrics for distributed, scalable PyTorch applications.

Basic Utilities for PyTorch Natural Language Processing (NLP)

Avalanche: an End-to-End Library for Continual Learning based on PyTorch.

Measures and metrics for image2image tasks. PyTorch.

一款多语言的API，满足您所有可观测性需求。轻量、快速，可替代LGTM :rocket: 独立的OpenTelemetry、Loki、Prometheus、Tempo、Pyroscope兼容 :star:

Powerful Analytics Solution. Setup in 30 seconds. Display all your data on a Simple, AI-powered dashboard. Fully self-hostable and GDPR compliant. Alternative to Google Analytics, MixPanel, Plausible, Umami & Matomo.

Object Detection Metrics. 14 object detection metrics: mean Average Precision (mAP), Average Recall (AR), Spatio-Temporal Tube Average Precision (STT-AP). This project supports different bounding box formats as in COCO, PASCAL, Imagenet, etc.

High-fidelity performance metrics for generative models in PyTorch

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

Deep Learning for Vision-based Prediction

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

Uncertainty Quantification 360 (UQ360) is an extensible open-source toolkit that can help you estimate, communicate and use uncertainty in machine learning model predictions.

The pytorch code of the paper "Intrinsic Image Popularity Assessment"

Metrics to evaluate quality and efficacy of synthetic datasets.

A package to read and convert object detection datasets (COCO, YOLO, PascalVOC, LabelMe, CVAT, OpenImage, ...) and evaluate them with COCO and PascalVOC metrics.

Comprehensive NLP Evaluation System

? Modular VAE disentanglement framework for python built with PyTorch Lightning ▸ Including metrics and datasets ▸ With strongly supervised, weakly supervised and unsupervised methods ▸ Easily configured and run with Hydra config ▸ Inspired by disentanglement_lib

Conversational Toolkit. An Open-Source Toolkit for Fast Development and Fair Evaluation of Text Generation

Open source RAG evaluation package