ICSFSurvey

A deep dive into the internal consistency and self-feedback of large language models.

CommonProductProgrammingInternal ConsistencySelf-Feedback

ICSFSurvey is a research study investigating the internal consistency and self-feedback of large language models. It offers a cohesive perspective on the self-assessment and self-updating mechanisms of LLMs, encompassing theoretical frameworks, systematic classifications, evaluation methods, and future research directions.

Provide a theoretical framework for internal consistency
explaining reasoning deficits and hallucination phenomena in LLMs.
Explore self-feedback mechanisms
including self-assessment and self-updating to enhance model responses or the models themselves.
Conduct systematic classification research based on tasks and workflows related to self-feedback mechanisms.
Summarize evaluation methods and benchmarks for assessing the effectiveness of self-feedback.
Investigate key considerations
such as the true efficacy of self-feedback
proposing hypotheses like the sandglass evolution of internal consistency.
Outline future research directions for internal consistency and self-feedback in LLMs.

This product is suitable for researchers
developers
and professionals interested in the self-assessment and self-updating mechanisms of large language models (LLMs). It provides in-depth insights and resources for understanding and improving LLMs.

Researchers use ICSFSurvey to understand the internal mechanisms of LLMs and design improvement strategies.
Developers leverage the code and data from this survey to create new assessment tools for LLMs.
Educators can utilize ICSFSurvey as a teaching material to help students grasp advanced concepts of LLMs.

Visit the GitHub page to explore an overview and resources related to ICSFSurvey.
Read the README.md file for guidance on usage and contributions.
Browse the code/
data/
figures/

Visit

ICSFSurvey Visit Over Time

Monthly Visits

499904316

Bounce Rate

37.31%

Page per Visit

5.8

Visit Duration

00:06:52

ICSFSurvey Visit Trend

ICSFSurvey Visit Geography

ICSFSurvey Traffic Sources

ICSFSurvey Alternatives

OneGen — An efficient single-pass unified generation and retrieval framework suitable for large language models.

Programming•Natural Language Processing•Large Language Models

Open Source LLM Tools — A collection of open-source large language model tools.

Productivity•AI Tools•Open Source

PresentationGen — A SpringBoot Web application that utilizes large language models to generate PPT files.

Productivity•Automation•Presentation

Shire — An AI programming agent language that facilitates communication between large language models (LLMs) and integrated development environments (IDEs) for automated programming.

Programming•AI Programming•Automation

PromptChainer — A free and fast prompt chain generator

Productivity•Artificial Intelligence•Automation

LongCite — Generates fine-grained citations for large language models in long text question answering.

Programming•Long Text Question Answering•Citation Generation

LongLLaVA — Efficiently extending multimodal large language models to 1,000 images.

Image•Multimodal Learning•Image Processing

iText2KG — Incrementally build knowledge graphs using large language models.

Productivity•Knowledge Graph•Natural Language Processing

ChatMLX — A high-performance MacOS chat application based on large language models.

chatting•Chat•Large Language Models

EAGLE — Exploration of the design space for multimodal large language models

Programming•Multimodal Learning•Large Language Models

252

Seed-ASR — Speech recognition technology based on large language models.

Others•Speech Recognition•Large Language Models

264

parsera — A lightweight Python library for web scraping using large language models.

Programming•Python•Data Scraping

Data-Juicer — A one-stop data processing system that provides high-quality data for large language models.

Productivity•Machine Learning•Data Science

174

MindSearch — An open-source AI search engine framework with performance comparable to Perplexity.ai Pro.

Programming•Search•Transformer

2094

Benchmarking API Performance of Large Language Models — In-depth analysis of key metrics like TTFT and TPS

Others•Performance Comparison•API Service

390

Jockey — A conversational video agent combining large language models with video processing APIs.

Video•Conversational Agent•Video Processing

Expert Specialized Fine-Tuning — A professional fine-tuning tool for customizing large language models.

Programming•Large Language Models•Fine-Tuning

xLAM — Research on intelligent agents based on large language models

Programming•Artificial Intelligence•Large Language Models

114

LLM101n — Build an AI-powered large language model that can tell stories.

Programming•Deep Learning•Large Language Models

306

prism-alignment — Explore the preferences and value alignment of large language models.

Others•Large Language Models•Value Alignment

The Prompt Report — Systematic Survey of Prompting Techniques in Generative AI

Productivity•Generative AI•Prompting Techniques

180

Translation Agent — An agent translation model utilizing a reflective workflow

Programming•Machine Translation•Large Language Models

342

Buffer of Thoughts — Improves the accuracy and efficiency of large language models in reasoning

Productivity•Large Language Models•Reasoning Enhancement

Open LLM Leaderboard — A publicly accessible leaderboard of large language models.

Others•Large Language Models•Performance Comparison

318

Cantor — Innovative multimodal chain-of-thought framework that enhances visual reasoning capabilities

Productivity•Multimodal•Visual Reasoning

156

Best AI Websites & Tools