Alibaba Tongyi Lab has open-sourced ViDoRAG, a novel visual document retrieval and question answering system. ViDoRAG boasts impressive accuracy, achieving a remarkable 79.4% in benchmark tests. This system represents a significant advancement in the field of computer vision and information retrieval.

The Alibaba Tongyi Laboratory voice team announced that its open-source voice generation model CosyVoice has been upgraded to version 2.0. This upgrade marks significant progress in voice generation technology in terms of accuracy, stability, and natural experience. CosyVoice 2.0 achieves bidirectional streaming voice synthesis through the integration of offline and streaming modeling techniques, allowing for a first-package synthesis delay of up to 150ms, thereby significantly improving the responsiveness of voice synthesis.

On November 15, Alibaba Tongyi Lab launched the Code Mode, a feature that enables users to generate various applications through simple everyday language instructions, including mini games, data charts, websites, and resumes. Users can experience this new interactive method by visiting the Tongyi web version (tongyi.ai) and clicking on 'Code Mode' in the input box.

Alibaba's Tongyi Laboratory has released an AI animation project called Animate Anyone, which generates animated videos of characters using just a static image and skeletal animation. Cats dancing to 'Tie Shan Kao' have become a viral sensation online.

The Alibaba Tongyi Laboratory open sources the AI image generation fine-tuning framework SCEdit. The SCEdit framework supports fine-tuning for image generation tasks and demonstrates high efficiency in generation tasks. It achieves precise control in controllable generation tasks while saving training memory costs.