ZhiYuan Research Institute Releases Emu2: A New Generation Generative Multimodal Foundation Model

站长之家

Published inAI News · 2 min read · Dec 22, 2023

142

The Beijing Academy of Artificial Intelligence (BAAI) has released Emu2, a new generation of multi-modal foundational models. Through extensive autoregressive generative multi-modal pre-training, Emu2 has significantly advanced the breakthroughs in multi-modal contextual learning capabilities. Emu2 excels in few-shot multi-modal understanding tasks, surpassing mainstream multi-modal pre-training models like Flamingo-80B and IDEFICS-80B. It has achieved optimal performance in multiple few-shot understanding, visual question answering, and image generation tasks. Emu2-Chat can accurately comprehend text-image instructions, enabling better information perception, intent understanding, and decision planning. Emu2-Gen can accept sequences of interleaved images, text, and locations as input, achieving flexible, controllable, and high-quality image and video generation. Emu2 adopts a simpler modeling framework and scales the model up to 37 billion parameters. For more details, please refer to the project link released by BAAI.

ZhiYuan Research Institute and Tencent Reach Strategic Cooperation to Promote the Implementation of Large Models and AI Applications

On December 18, 2024, ZhiYuan Research Institute signed a strategic cooperation agreement with Tencent Group, aiming for in-depth collaboration in several areas, including large model research and development, exploration of cutting-edge artificial intelligence technologies, and open-source ecosystem construction. According to the cooperation agreement, ZhiYuan Research Institute and Tencent will leverage their respective strengths to promote the deep integration of large model technology and industrial scenarios, and explore technological solutions for large model training and inference optimization in diverse computing environments. Both parties are also committed to building an open and innovative hardware and software ecosystem to foster the development and application of technologies.

Baidu and Zhiyuan Research Institute Reach Strategic Agreement to Collaborate in Large Model and Other Fields

Beijing Baidu Network Technology Co., Ltd. and Beijing Zhiyuan Artificial Intelligence Research Institute announced today the formal signing of a strategic cooperation agreement, under which the two sides will engage in deep collaboration in large model and other fields, jointly constructing an AI industry-research collaborative ecosystem. Baidu has been comprehensively laying out its artificial intelligence strategy since 2010 and is one of the few companies globally that has fully integrated its AI efforts, from Kunlun chips, PaddlePaddle deep learning platform, Wenxin large model to applications.

ZhiYuan Research Institute Launches FlagEval Large Model Arena Featuring Text-to-Video Model Combat Evaluation Service

On September 4, 2024, the Beijing ZhiYuan Artificial Intelligence Research Institute (BAAI) announced the launch of the world's first model combat evaluation service featuring text-to-video, called FlagEval Large Model Arena. This service is open to users and covers approximately 40 large models from both domestic and international sources, supporting customizable online or offline evaluations for four major tasks: language Q&A, multimodal image and text understanding, text-to-image, and text-to-video.

Zhiyuan Releases Three New BGE Models, Setting New Best Standards in Vector Retrieval

The Zhiyuan Research Institute recently released three new vector models that excel in vector retrieval tasks and have set new best standards across multiple evaluation benchmarks. The three models are: BGE-EN-ICL: an English vector model that enhances the model's semantic expression capabilities by introducing task-related query-document examples as few-shot examples.