AI2 Releases Open Dataset Dolma: Breaking Down Data Barriers for AI Language Models

站长之家

Published inAI News · 2 min read · Aug 21, 2023

The Allen Institute for AI (AI2) has released an open-source text dataset named Dolma, designed to enhance the transparency and innovation of AI language models. As a centerpiece of AI2's Open Language Model (OLMo) initiative, Dolma will provide researchers and developers with free access to data resources, supporting a broader range of AI research. Not only is Dolma a vast open dataset with 3 billion tokens, but it also features straightforward usage and licensing terms. AI2 has adopted the "ImpACT License for Moderate-Risk Work" and encourages users to provide contact information and usage details. The openness of this dataset offers researchers and developers more resources, propelling the AI field towards a more transparent and collaborative future.

ZhiYuan and Tencent Launch Long Text Understanding Benchmark Model LongBench v2

On December 19, 2024, at a press conference, ZhiYuan Research Institute and Tencent announced the launch of LongBench v2, a benchmark designed to evaluate the deep understanding and reasoning capabilities of large language models (LLMs) in real-world long text multi-task scenarios. The platform aims to advance long text models in understanding and reasoning, addressing the current challenges faced by large language models in practical applications.

AI Unicorn Cohere Deeply Collaborates with Palantir: Enterprise-level AI Applications Emerge

As one of the most watched AI startups outside of OpenAI and Anthropic, Cohere was valued at $5.5 billion in July. One of the company's co-founders is an author of the paper 'Attention Is All You Need,' which is considered critical to sparking the revolution of large language models (LLMs). Headquartered in Toronto and San Francisco, Cohere focuses on providing AI solutions for enterprise clients, rather than pursuing a similar path as other companies.

Nexa AI Launches OmniAudio-2.6B: A Fast Audio Language Model for Edge Deployment

Nexa AI recently unveiled its new OmniAudio-2.6B audio language model, designed to meet the efficient deployment demands of edge devices. Unlike traditional architectures that separate automatic speech recognition (ASR) and language models, OmniAudio-2.6B integrates Gemma-2-2b, Whisper Turbo, and a custom projector into a unified framework. This design eliminates the inefficiencies and delays associated with linking various components in traditional systems, making it especially suitable for resource-constrained computing.

AI News

AI2 Releases Open Dataset Dolma: Breaking Down Data Barriers for AI Language Models

站长之家

AI News Recommendations

The new generation language model ModernBERT is released, with a processing speed four times faster and lower cost for tasks like RAG.

ZhiYuan and Tencent Launch Long Text Understanding Benchmark Model LongBench v2

AI Unicorn Cohere Deeply Collaborates with Palantir: Enterprise-level AI Applications Emerge

Nexa AI Launches OmniAudio-2.6B: A Fast Audio Language Model for Edge Deployment