Today, OpenAI officially announced that it will roll out a brand new Advanced Voice Mode to all ChatGPT Plus and Team users within this week. According to the official introduction, the new feature not only adds custom instructions, memory, five new voice styles, and improved accents, but also introduces five different voices and over fifty language options, making interactions with ChatGPT smoother and more personalized. If you are a Plus or Team user, you will have access to Advanced Voice once it's available.

Recently, OpenAI launched a groundbreaking multilingual dataset designed to evaluate AI performance across 14 languages, including Arabic, German, Swahili, Bengali, and Yoruba. This dataset, named 'Multilingual Massive Multitask Language Understanding' (MMMLU), has been published on the open data platform Hugging Face, marking another significant advancement for OpenAI in the global AI landscape. Dataset link: https://huggingface

The release of Fish Speech 1.4 marks a significant breakthrough in multilingual support and performance for this open-source text-to-speech (TTS) model. As an innovative solution committed to providing high-quality and natural-sounding speech synthesis experiences, Fish Speech demonstrates its strong technical capabilities and broad application prospects in this update. The most notable feature of Fish Speech 1.4 is its powerful multilingual support capability: the training data volume has doubled, enhancing the model's

On August 30, 2024, Alibaba Damo Academy's Tongyi Qianwen team announced a significant update to its latest achievement—the Qwen2-VL model. The Qwen2-VL model has achieved remarkable improvements in image understanding, video processing, and multilingual support, setting new benchmarks for key performance indicators.

Beijing Zhipu Huazhang Technology Co., Ltd. recently announced that it will provide the API interface for its GLM-4-Flash large language model free to the public to promote the popularization and application of large model technology. The GLM-4-Flash model shows significant advantages in speed and performance, particularly in inference speed, by employing adaptive weight quantization and parallel processing technologies.

Moore Threads has announced the open-source release of its audio understanding model, MooER, making it the first large-scale open-source speech model based on domestically produced full-feature GPUs. MooER supports Chinese and English speech recognition and translation, utilizing a three-part model structure that demonstrates robust multilingual processing capabilities. The inference code and a model trained on 5000 hours of data have been released as open source, with plans to further open-source training code and an enhanced version trained on 80,000 hours of data. In comparative testing, MooER-5K has shown outstanding performance, achieving a Chinese CER of 4.21% and an English WER of 17.98%, particularly.

Microsoft has released three new AI models aimed at enhancing its leadership in the multilingual and multimodal fields. The Phi-3.5 Mini Instruct is a lightweight model suitable for task execution, code generation, and logical reasoning, excelling particularly in multilingual and multi-turn conversations. The Phi-3.5 MoE (Mixture of Experts) model is rich in parameters and supports various inference tasks, especially outperforming peers in code, mathematics, and multilingual understanding. The Phi-3.5 Vision Instruct integrates text and image processing capabilities.

Linly-Dubbing is an open-source AI tool designed specifically for multilingual dubbing and translation of videos, simplifying the video localization process. Users just need to upload their videos, and the tool will automatically download, translate, dub, and generate subtitles in multiple languages. Its powerful AI recognition and translation capabilities, in collaboration with models like GPT, ensure high quality and natural-sounding translations. Notably, its voice cloning technology can generate voices that closely resemble the original dubbing, ensuring lip-syncing and enhancing the viewing experience. This tool is ideal for international education and global entertainment.

Eleven Labs has launched a fully managed AI voiceover service that helps content creators and businesses overcome cross-language communication challenges. The service supports automatic translation and voiceover in multiple languages, including Spanish, Hindi, French, Portuguese, German, Arabic, and Polish, while maintaining the original tone, timbre, and speaking style, enhancing content authenticity and relatability. A professional voice actor verification process is in place to ensure translation quality. The service supports up to 10 speakers, with an average completion time of 7 days, and can provide same-day service in urgent cases.

The Zhiyuan Research Institute recently released three new vector models that excel in vector retrieval tasks and have set new best standards across multiple evaluation benchmarks. The three models are: BGE-EN-ICL: an English vector model that enhances the model's semantic expression capabilities by introducing task-related query-document examples as few-shot examples.

Google has conducted a significant upgrade to the AI chatbot Gemini to enhance performance, expand language support, and increase its reach. The Gemini 1.5 Flash version supports 40 languages across 230 countries and regions, with notable improvements in quality and response speed, particularly in reasoning and image understanding. This upgrade includes a 32,000-token context window expansion, support for file uploads, and the display of relevant webpage links below generated answers to improve transparency. Gemini's functionalities will expand into more application areas.

Amazon Web Services has launched the Llama3.1 model on its Amazon Bedrock platform, developed by Meta. This advanced AI model series includes 8B, 70B, and 405B parameters, showcasing exceptional performance across eight languages, including English and German. The models cater to various applications: Llama3.1405B for enterprise and research, Llama3.170B for content creation and conversational AI, and Llama3.18B for resource-limited scenarios. Th....

Cloudflare recently announced that as one of Meta's first partners, they have launched the latest Meta-released Llama3.18B model on the Workers AI platform. This move allows developers to start using this advanced AI tool on the very first day of its release.Llama3.1 is the latest member of Meta's Llama series models, renowned for its outstanding performance in general knowledge, controllability, mathematical operations, tool usage, and multilingual translation. The highlights of this update inc

Another significant step has been taken in the field of code generation as the Knowledge Engineering Group (KEG) at Tsinghua University and the Data Mining team have launched their latest innovative achievement: CodeGeeX4-ALL-9B. This model is part of the renowned CodeGeeX series and represents the pinnacle of multilingual code generation, setting new performance and efficiency standards for automated coding. The CodeGeeX4-ALL-9B model is a product of extensive training on the GLM-4-9B framework

Google plans to invest $4 million in the Indian startup CoRover.ai to support the development of BharatGPT, which supports over 130 languages and has the capability to handle diverse data formats. Google is confident in the development of the AI sector in India.

Moonshot AI's Kimi Chat is now fully open for service and no longer requires beta testing qualifications. Kimi Chat possesses strong multilingual capabilities, supporting context of approximately 200,000 Chinese characters. It achieves lossless long-range attention mechanisms through innovative network structures and engineering optimizations. Kimi Chat has significant advantages in Chinese and represents an innovation among large models trained primarily in English on the market. The open service of Kimi Chat will provide users with

📢 Ethical controversy in multilingual phone outreach: The New York City mayor uses AI tools for multilingual phone campaigning, sparking widespread discussion. 🗣 The mayor claims to speak several languages but actually uses AI-generated voices, leading to intense ethical debates. 📞 Thousands of calls cover Spanish, Yiddish, Mandarin, and more, raising concerns about ethics. 🤖 The mayor states this is to communicate with multilingual residents, but faces significant criticism.

1. Meta has launched the AI translation model SeamlessM4T, which supports speech-to-text, speech-to-speech, text-to-text, and text-to-speech for nearly 100 languages. 2. SeamlessM4T's speech recognition capabilities have reached human-level performance, significantly improving its ability to handle background noise and varied speech. 3. Meta has not only open-sourced the SeamlessM4T model but also made the key training dataset SeamlessAlign publicly available.