Today, ByteDance's Volcano Engine announced that the Doubao Large Model will release a video generation model on September 24, bringing upgrades to more capabilities in the model family. It is understood that the Doubao Large Model was officially launched at the Volcano Engine Original Power Conference on May 15, 2024.

Recently, foreign media reported that ByteDance is accelerating its efforts to self-develop and manufacture AI chips to reduce dependence on expensive chips from NVIDIA. The report claims that ByteDance plans to collaborate with TSMC and expects to mass-produce two self-developed AI chips by 2026, having already reserved the production of hundreds of thousands of chips. More notably, the report pointed out that ByteDance aims for its self-developed chip clusters to achieve four times the computing performance of a single H100 chip at a similar cost. In response, ByteDance quickly addressed this report.

Recently, the foreign media outlet The Information reported that ByteDance is accelerating the development of its own AI chips and plans to collaborate with TSMC, aiming for mass production by 2026. The report also stated that this move by ByteDance is intended to reduce dependence on NVIDIA chips and lower the costs of developing and operating AI models. Source note: The image is generated by AI and provided by the image licensing service Midjourney, according to reports from the Sci-tech Innovation Board Daily regarding today's media coverage of ByteDance's plans to collaborate with TSMC on AI chips.

Recently, Doubao, the educational application from ByteDance's AI smart assistant brand, completed a major upgrade. This app aims to be a smart partner for learners and a valuable assistant for family education, providing support for the new term's studies. 'Doubao Aixue' has introduced multiple auxiliary learning features, including answering questions, homework correction, knowledge Q&A, essay guidance, and mental calculation practice, to meet the diverse needs of family education.

ByteDance's open-source FLUX Dev's Hyper SD Lora has revolutionized AI drawing speed with its efficient image generation capabilities, shortening the traditional, lengthy process to just 8 or 16 steps. This move not only provides a fast track for creative realization but also establishes a demonstration space on Hugging Face, allowing users to directly experience the drawing effects of the 8-step Lora. Although there is some degradation in image quality, it has minimal impact for most users. Comparison examples show that the degradation is not significant when not enlarged.

ByteDance is secretly preparing to establish a Large Model Research Institute to strengthen its position in AI large models. The institute has attracted top talents from the industry, including Qin Yujia and Huang Wenhao, who will manage technology projects and report directly to founder Zhang Yiming. This move indicates ByteDance's long-term plans and proactive strategies in AI model R&D, aiming to leverage external expertise for technological a....

The third edition report of 'Top 100 Consumer Generative AI Applications' released by Andreessen Horowitz reveals popular AI applications and their usage trends. The report shows that content generation tools, particularly in image, video, and music, dominate web applications, with 52% of web products focusing on this area. The music generation tool Suno has notably improved its ranking. In the mobile application sector, image and video editing tools are favored by users, and ChatGPT remains...

The Seed-ASR engine launched by ByteDance achieves high-precision recognition of Mandarin, 13 Chinese dialects, and 7 foreign languages through massive training data, significantly enhancing the convenience of cross-language communication. Its key advantage lies in its excellent contextual awareness, accurately recognizing proper nouns, place names, and keywords by incorporating historical information, especially performing exceptionally well in specific scenarios, thereby improving recognition accuracy. Whether in daily conversations, complex meetings, or interactions among multiple people in noisy environments, Seed-ASR can transcribe accurately. It can also recognize various professional terms.

ByteDance and a research team from Shanghai University of Science and Technology have developed an innovative technology called 'HeadGAP' that can quickly generate highly realistic and animatable 3D virtual head models using just three photos taken from different angles, enabling facial expression synchronization. During the research process, the team first extracted 3D head prior information from a large multi-view dynamic dataset to customize the virtual avatar for the target individual. By utilizing a Gaussian point cloud-based self-decoding network and partial dynamic modeling, in conjunction with inversion and fine-tuning strategies, they efficiently achieved high-quality and diverse...

Today, ByteDance announced a new feature for the Doubao model that supports real-time voice calls. It is reported that the conversational AI real-time interaction solution provided by Volcano Engine combines the Volcano Ark large model service platform and Doubao's speech recognition and synthesis models, streamlining the conversion process between speech and text. This solution achieves efficient voice data collection, processing, and transmission, offering outstanding intelligent dialogue and natural language processing capabilities.

The LSLM full-duplex language model developed in collaboration between Shanghai Jiao Tong University and ByteDance revolutionizes traditional AI assistant interaction by enabling real-time conversation where users can listen while speaking. The core advantage of LSLM lies in its ability to simultaneously process speech input and generate output, significantly enhancing the natural flow of dialogue. By integrating streaming self-supervised learning with a token-based decoder, this model supports real-time speech interaction and performs exceptionally well even in noisy environments. LSLM's mid-term fusion strategy strikes the optimal balance between speech generation and real-time interaction, demonstrating impressive noise resistance.

The Doubao AI Assistant under ByteDance has recently launched a new feature—music generation. Users can simply click on 'Music Generation' in the Doubao app or PC version, enter keywords or custom lyrics, and select the corresponding music style, atmosphere, and vocal type to generate a unique song. This feature aims to help users realize their dreams of music creation and express their emotions and stories through music.

In the digital world, the growth of artificial intelligence relies on checkpoints, which can restore the training status to the last safe state during training large language models (LLMs) if issues like sudden power outages or hardware failures occur. However, traditional checkpoint systems are inefficient when dealing with large models. To address this, ByteDance and the research team from Hong Kong University have proposed ByteCheckpoint, an innovative checkpoint system that improves data and metadata handling.

The one-stop AI creation platform 'DreamAI' developed by the JinYing team under ByteDance is now available on the Apple App Store and various Android app markets such as Xiaomi. The platform offers features for AI image creation and video creation.

ByteDance's latest CLASI system is a powerful tool for cross-language communication, designed for real-time translation. Its core technology includes a robust language model and an information retrieval system, enabling near real-time, accurate, and fluent translations that understand professional terminology and maintain contextual memory for coherence. CLASI also features self-learning capabilities to handle unclear audio or vague expressions e....

The Button Platform is a tool that enables the rapid conversion of AI ideas into enterprise-level AI applications. It offers a rich set of tools including plugins, workflows, image streams, knowledge bases, and databases, allowing users to easily transform AI concepts into "expert-level Bots" capable of solving complex tasks. Key features of the Button Platform include:Abundant Plugins: Integrates nearly a hundred different types of plugins such as news reading, travel, efficiency office, and im

According to reports from Titanium Media, the ByteDance team plans to unveil significant advancements in their latest artificial intelligence model technology on July 19th (this Friday) for the first time on a large scale. The content to be disclosed includes new AI models such as text-to-image and Sora-like video generation, with particular emphasis on innovative technologies in long videos and high-dynamic directions, which are expected to directly compete with OpenAI's Sora text-to-video mode

ByteDance's large model team has achieved another success with their Depth Anything V2 model being incorporated into Apple's Core ML model library. This achievement not only represents a technical breakthrough but is also remarkable because the project leader is actually an intern. Depth Anything V2 is a monocular depth estimation model capable of estimating scene depth from a single image. This model has expanded from a 25M parameter size in its V1 version at the beginning of 2024 to 1.3B in th

Developed jointly by researchers from the University of Hong Kong and Bytedance, LlamaGen is an image generation method based on the autoregressive model Llama, which has shown the potential to surpass traditional diffusion models in the field of image generation. The open-source release of LlamaGen quickly garnered nearly 900 stars on GitHub, acknowledging this achievement. This result not only proves the competitiveness of autoregressive models in image generation but also brings new vitality