On September 4, 2024, the Beijing ZhiYuan Artificial Intelligence Research Institute (BAAI) announced the launch of the world's first model combat evaluation service featuring text-to-video, called FlagEval Large Model Arena. This service is open to users and covers approximately 40 large models from both domestic and international sources, supporting customizable online or offline evaluations for four major tasks: language Q&A, multimodal image and text understanding, text-to-image, and text-to-video.

In the field of digital content creation, the technology that can generate videos based on text descriptions has always been a hot research topic. Imagine how exciting it would be if we could clone actions from reference videos and seamlessly apply them to new text descriptions, creating entirely new video content. This is the magic that MotionClone technology achieves.Although existing Text-to-Video (T2V) generation models have made some progress, challenges remain in the area of motion synthes

Breaking News! Gen-3 Alpha Text to Video is now open to everyone for use! This is a brand new field that can generate videos with high fidelity, speed, and control. Visit the official website http://runwayml.com right now to experience it! This news has sparked widespread attention, and many are eagerly waiting for the arrival of this new feature.Official VideoAccording to AIbase, the Gen-3 Alpha Text to Video service is currently available only to paid users, with an annual subscription price o

Sora has several fatal flaws and cannot perfectly generate video content. Sora's training data comes from Shutterstock, with a data collaboration agreement with OpenAI. Sora has immense computational demands and will not be released to the market yet, aiming to reduce these requirements. Ultimately, Sora will generate videos with sound, with safety being a key focus area.

The emergence of the Sora model is driving a transformation in the text-to-video field. The development of the Sora model took nearly a year and involved multiple explorations in different directions. The Sora model utilizes the DiT technical framework, overcoming the limitations of diffusion models. Seven Volcanoes has established cooperative relationships with ByteDance, Xiaomi, and Kuaishou through the Lava platform, promoting both local and international content development. Supercom Communications has strategically invested in Seven Volcanoes, becoming its largest single shareholder with a 30% stake.

Sora's entry into TikTok marks the arrival of the AI short video marketing era. The emergence of Sora will significantly reduce video advertising production costs and could disrupt the advertising industry. The videos generated by Sora are more realistic, avoiding the 'uncanny valley' effect associated with traditional AI-generated videos. Sora will change the way videos are produced and enhance the efficiency of brand storytelling. Although Sora introduces automated advertising creativity, human creativity remains irreplaceable.

Baidu founder Robin Li emphasizes the importance of multi-modal fusion. Baidu has invested in areas such as text-to-video. Baidu is investing in AGI development. The reasoning cost of Baidu's Wenxin large model has been reduced to 1%. Baidu has reached cooperation agreements with Samsung, Honor, and others. Honor will launch its first small foldable phone. Wenxin Yiyan is expected to contribute billions in incremental revenue in 2024. Baidu's investment in text-to-video has made 5G-A a hot topic at the World Mobile Communications Conference.

'Qianqiu Shisong', the first text-to-video AI animated film, has garnered an enthusiastic response with a premiere viewership share of 4.22%. The successful integration of cutting-edge AI technology with the transmission of excellent Chinese traditional culture has been recognized. The president of the China Animation Association believes that 'Qianqiu Shisong' has pioneering significance, and People's Education Press commented that it offers a new perspective for cultural transmission. The topic '#QianqiuShisong#' has received over 7.91 million views online.

The first original AI series animation from China, 'A Thousand Autumn Poems,' premiered on CCTV-1, signaling a potential acceleration in the application of text-to-video technology and reshaping production processes in the film industry. With rapid advancements in AI-generated video technology, it's possible that longer films may be created without the need for actors. Tsinghua University professor in Shenyang stated that the explosion of AI video technology will drive growth in the film and animation production industry.

What impact does the AI technology Sora have on video content creation? Content creators are facing new opportunities and challenges. AI may change the landscape of video content production, emphasizing the importance of topical sensitivity and content tone. The influence of AI on the transformation of the creator's role.

Midjourney has announced plans to launch a text-to-video model in the coming months. The company will begin training the video model in January, with the CEO stating that this is a natural evolution for the platform as it introduces competitive dynamics. The latest v6 update focuses on improving image quality and user experience, highlighting the fierce competition in the AI video generation space. Entering the video domain follows the release of similar products by competitors, intensifying the competition. Midjourney is known for prioritizing quality and user experience, with the latest v6 update aimed at maintaining its competitive edge.

The three most important innovations in the field of artificial intelligence in 2023 are Multimodal AI, Constitutional AI, and Text-to-Video Technology. Multimodal AI refers to the ability of AI to process various types of data, including text, images, videos, and audio. Constitutional AI aims to align AI with human values by drafting a constitution of values and employing reinforcement learning methods to control AI behavior. Text-to-Video Technology is a significant achievement with investments of billions of dollars, allowing the generation of videos based on text and changing video styles. These innovations will have a profound impact on the field of AI and alter the way people interact with technology.

Ludo.ai has launched a video generator tool that helps game developers rapidly create game concept videos. Through text prompts, users can easily produce engaging video content featuring game scenes and animations. The video generator enhances productivity and creativity in game development, simplifying the process of turning game concepts into reality. The tool can generate gameplay video imagery for games that have not yet been created, assisting executives in easily approving game projects. Ludo.ai aims to become the preferred platform for small and medium-sized studios seeking AI tools.

Pika is on fire, but AI video has yet to reach the 'GPT moment'. There are two technical approaches to AI video: based on Transformer and diffusion models. AI video still has a way to go before it achieves a true GPT moment. The commercialization of AI video applications still needs improvement. The competitive thresholds in the field of AI video vary; who will reap the benefits?

🤩 Progress in Multimodal AI: The AI video generation tool Pika is at the forefront of the industry. Multimodal AI is moving towards scenario-based, practical, and commercial applications. 💡 Competition in the Multimodal AI Market: Companies like Runway, Stability AI, and Midjourney are also entering the AI video generation arena. 🔍 Future of Multimodal AI: Large multimodal models are expected to bridge the gap between the physical and digital worlds.

{"Point 1":"Baidu Wenxin Yiyan has launched five major plugins including Baidu Search, Browse Documents, E Yi Tu, Image Interpretation, and One Mirror Streaming.","Point 2":"The plugins of Baidu Wenxin Yiyan enable the model to generate real-time accurate information, long text summaries, Q&A, data insights and chart creation, image-based creation and Q&A, and text-to-video capabilities.","Point 3":"Baidu stated that it will collaborate with developers to build a plugin ecosystem and share technological innovation achievements."}