Robot startup 1X Technologies has developed a new generative model that enhances the efficiency of training robotic systems in simulations. The company announced this model in a new blog post, addressing one of the significant challenges in robotics, which is learning the 'World Model (1X World Model)' that predicts how the world responds to the actions of robots. When robots start from the same sequence of initial images, this world model can envision multiple possibilities based on different action proposals.

Multimodal generative models are leading a new trend in artificial intelligence, focusing on the integration of visual and textual data to create multifunctional AI systems that perform various tasks, from image generation to understanding and reasoning across different data types. A key challenge is to enhance the capabilities of autoregressive (AR) models so they can generate high-detail images based on textual descriptions. While diffusion models excel in generating high-quality images, AR models lag behind in image quality, resolution flexibility, and multitasking capabilities. Researchers from Shanghai AI Lab and The Chinese University of Hong Kong have introduced Lum

Recently, Stability AI announced the release of a revolutionary video processing technology—Stable Video 4D. This technology can convert a single-view video into a new view video from 8 different angles, providing creators with unprecedented flexibility and creativity. Stable Video 4D is built on the foundation of the previously released Stable Video Diffusion model. Unlike converting images into videos, the new model can take video input and generate...

Tokyo-based startup Sakana AI has introduced two new image generation models — Evo-Ukiyoe and Evo-Nishikie. Image from Sakana AI official These models can be found on the Hugging Face platform, with the main purpose of generating Ukiyo-e style art through text or image prompts. As is known, Ukiyo-e is a traditional Japanese art form popular from the 17th to the 19th century, depicting themes such as historical scenes, natural landscapes, and sumo wrestlers. Sakana AI aims to use AI to bring thi

Apple Inc. recently unveiled the core technology behind its artificial intelligence platform, Apple Intelligence—a device-side model with approximately 3 billion parameters and a server-based language model. In a series of evaluations, Apple Intelligence outperformed open-source models including Phi-3, Gemma, Mistral, DBRX, as well as commercial models like GPT-3.5-Turbo and GPT-4-Turbo, often being rated higher than human evaluations.

Recently, scientists published a study on protein-ligand complex structure prediction in the journal 'Nature Machine Intelligence'. The new method, NeuralPLexer, predicts structures using deep generative models with only the protein sequence and ligand molecule graph as input. NeuralPLexer leverages a multiscale deep learning system to enhance prediction success rates and is expected to play a significant role in drug discovery. This research provides insights for exploring the field of protein-ligand complex structure prediction.

The global generative artificial intelligence market size is expected to grow from $10.5 billion in 2022 to $208.8 billion by 2032, with a compound annual growth rate (CAGR) of 35.1%. The North American market currently dominates, but significant growth is expected in the Asia-Pacific region, particularly in China, over the coming years. Generative AI technology has vast application prospects and is poised to fundamentally change the future of content production. Despite the enormous growth potential in the market, challenges such as high implementation costs and talent shortages remain in the technology application process.

UK startup Wayve released GAIA-1 in June 2023, a generative AI model designed for training data for autonomous vehicles. GAIA-1 uses text, images, videos, and action data to generate synthetic videos of various traffic scenarios, filling a data gap in autonomous driving training. The model now boasts 9 billion parameters and can efficiently generate high-resolution videos, making it a powerful tool for the training and validation of autonomous driving systems. Wayve is also developing Lingo-1, a combination of machine vision.