Anthropic has announced the launch of a new 'Prompt Caching' feature in its Claude series of large language models, aimed at significantly reducing AI costs for enterprises and enhancing performance. This feature allows users to store and reuse specific context information without incurring additional costs or delays. In public testing, the Claude 3.5 Sonnet and Claude 3 Haiku models will implement this feature, expected to achieve up to 90% cost reduction and double the response speed in certain scenarios. This feature is particularly suited for use cases that require...

The Anthropic API introduces a new prompt caching feature aimed at optimizing the user experience with the Claude model. This feature allows users to cache frequently used contextual information between API calls, significantly reducing the costs and latency of long prompts by up to 90% and 85%, respectively. Currently, it supports the public beta versions of Claude 3.5 Sonnet and Claude 3 Haiku, with plans to expand to Claude 3 Opus in the future. It is suitable for use cases such as conversational agents, coding assistants, handling large documents, and agent searches.