Recently, State Grid Corporation announced the launch of China's first trillion-parameter artificial intelligence large model in the power industry - the 'Bright Power Large Model'. They have signed a strategic cooperation framework agreement with Baidu and Alibaba. The officials stated that they will work together with the signing parties to build the Bright Power Large Model and promote the integrated development of energy and power technological innovation and industrial innovation.

Recently, Jiyue Xingchen announced the launch of a new member in the Step series model matrix—the Step-1o end-to-end speech model, claimed to be the first trillion-parameter end-to-end speech model in China. The release of this new model marks a significant advancement in the field of speech technology. By utilizing an end-to-end speech solution, it integrates speech understanding and generation, thereby enhancing the IQ and EQ limits of the model and providing a supernatural, high-quality communication experience.

In the arena of artificial intelligence, China is steadily advancing with a posture of independent innovation. On November 26, the world's first multimodal large model with 100 billion parameters, 'Zidong Taichu' 3.0, was officially unveiled in Wuhan, adding a significant chapter to domestic AI technology. This is not just a technological iteration, but an important milestone in China's AI ecosystem. Jointly developed by the Institute of Automation, Chinese Academy of Sciences, Huawei, and the Wuhan East Lake High-Tech Zone, 'Zidong Taichu' has successfully built the world's first pre-trained model covering image, text, and audio modalities.

During the 2024 World Internet Conference held today in Wuzhen, Honor CEO Zhao Ming shared his vision for the future development of mobile phones. He stated that by 2027, phones are expected to be able to incorporate large AI models with 100 billion parameters. This advancement will enable phones to learn, understand, and predict user behaviors and intentions, thereby providing users with more personalized arrangements for their lives and work. Image source note: Image generated by AI, image authorized by service provider Midjourney. Currently, several phones on the market are equipped with models of similar scale.

Recently, a startup in Seattle named Moondream launched a compact visual language model called moondream2. Despite its small size, the model has shown outstanding performance in various benchmark tests and has garnered significant attention. As an open-source model, moondream2 is expected to enable local image recognition capabilities on smartphones. Moondream2 was officially released in March and can process both text and image inputs, possessing functions such as answering questions, text extraction (OCR), object counting, and item classification.

At the recent Gemma Developer Day held in Tokyo, Google officially launched its new Japanese version of the Gemma AI model. This model's performance rivals that of GPT-3.5, but it has a parameter count of only 2 billion, making it very compact and suitable for operation on mobile devices. The newly released Gemma model excels in Japanese processing while also maintaining its capabilities in English. This is particularly important for small models, as they may face 'catastrophic forgetting' when fine-tuning for new languages.

Last night, Stability AI unveiled its most powerful model - Stable Diffusion 3.5, which is not just a single model, but a package containing three versions, designed to meet the diverse needs of researchers, business enthusiasts, startups, and enterprises. The three versions are Stable Diffusion 3.5 Large, Stable Diffusion 3.5 Large Turbo, and one that will be available on October 29.

Recently, a research team jointly launched an open-source AI image generation model named Meissonic. Surprisingly, this model uses only one billion parameters while being able to generate high-quality images. This compact design gives Meissonic the potential to enable localized text-to-image applications on mobile devices. The technology behind this model involves a research team that includes Alibaba, Skywork AI, and researchers from various universities. They employed a unique transformer architecture and innovative training methods, which allow

Shenzhen Yuanxiang Information Technology Co., Ltd. recently announced the successful release of China’s largest Mixture of Experts (MoE) open source large model — XVERSE-MoE-A36B. The launch of this model marks a significant advancement in China’s AI field, elevating domestic open source technology to an internationally leading level.

Nvidia's research team has successfully launched Llama-3.1-Minitron4B using model pruning and distillation techniques. This is a compressed version of the Llama3 model, aimed at implementing artificial intelligence on devices. The model reduces the parameter count of the original 8B model through deep and width pruning techniques while maintaining performance close to larger models. Despite a significant reduction in training data (by 40 times), the model achieved a 16% performance improvement on the MMLU benchmark.

LG's AI research department has launched Exaone 3.0, South Korea's first open-source AI model, which features 7.8 billion parameters. The model aims to accelerate AI research and build a robust AI ecosystem. It performs exceptionally well in Korean and English tasks. Through its open-source strategy, LG demonstrates its technological prowess and may create new revenue streams in cloud computing and AI services. To compete in the global AI landscape, LG is similar to companies like Alibaba, driving cloud business growth through open-source AI models.

CatVTON is a lightweight AI virtual dressing model designed for fashion enthusiasts, with a total parameter count of 899.06M and only 49.57M trainable parameters needed during training. It requires less than 8G of GPU memory for inference and supports 1024x768 high resolution, making it suitable for personal computers. The model can be quickly deployed on ComfyUI and Gradio applications, supporting inference on VITON-HD and DressCode datasets wit....

Mistral AI has launched its flagship model Mistral Large2 today, which boasts 123 billion parameters and a 128k context window. It supports multiple languages, including French, German, and Spanish, as well as programming languages. Mistral Large2 is designed for single-node inference, suitable for long context applications, and performs exceptionally well, achieving an accuracy of 84.0% in the MMLU benchmark test. Additionally, Mistral Large2 has multi-language processing capabilities.

In the realm of artificial intelligence, the competition between open-source and closed-source models has never ceased. The recent release of Meta AI's Llama 3.1 model, however, seems to have drawn a watershed line in this contest. This is not merely the launch of a new model; it is a sign of the maturation of open-source AI, heralding the arrival of a new era.Llama 3.1, developed by Meta AI's team, is a new generation of large-scale language models. In over 150 benchmark tests, its 405B paramet

In the realm of artificial intelligence, Large Language Models (LLMs) are renowned for their exceptional natural language processing capabilities. However, deploying these models in practical applications faces significant challenges due to their high computational costs and memory footprint during the inference phase. To address this issue, researchers have been exploring ways to enhance the efficiency of LLMs. Recently, a method called Q-Sparse has garnered widespread attention.Q-Sparse is a s

Recently, Hugging Face introduced a brand-new AI tool—SmolLM. These are a series of high-performance small language models with parameters ranging from 135M to 1.7B, specifically designed for various devices and applications. Imagine these compact models running efficiently on smartphones and laptops—it's pretty cool!The standout feature of SmolLM models is their small yet powerful nature. They perform exceptionally well with fewer computational resources, helping users protect their privacy.