factual-confidence-of-llms

Loki: Open-source solution designed to automate the process of verifying factuality

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

Learn fast, scalable, and calibrated measures of uncertainty using neural networks!

RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

[ML4H 2022] This is the code for our paper `Counterfactual and Factual Reasoning over Hypergraphs for Interpretable Clinical Predictions on EHR'.

Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"

[IJCAI 2024] FactCHD: Benchmarking Fact-Conflicting Hallucination Detection

Code for the arXiv paper: "LLMs as Factual Reasoners: Insights from Existing Benchmarks and Beyond"