Nexa AI recently unveiled its new OmniAudio-2.6B audio language model, designed to meet the efficient deployment demands of edge devices. Unlike traditional architectures that separate automatic speech recognition (ASR) and language models, OmniAudio-2.6B integrates Gemma-2-2b, Whisper Turbo, and a custom projector into a unified framework. This design eliminates the inefficiencies and delays associated with linking various components in traditional systems, making it especially suitable for resource-constrained computing.

The Kimi AI assistant under The Dark Side of the Moon has launched a new feature - the Visual Thinking Edition. This update enables Kimi to perform detailed observations and in-depth analysis of images sent by users, revealing the secrets behind the pictures. Users can now directly ask Kimi questions, utilizing its visual thinking capability to resolve their doubts.

In the age of AI, large language models (LLMs) are akin to martial arts secrets; their training processes consume massive computing power and data, much like martial arts experts who have spent years in secluded training. The release of open-source models is like these experts sharing their secrets with the public, but they come with certain licenses (such as Apache 2.0 and LLaMA 2 Community License) to protect their intellectual property (IP). However, the world can be treacherous, and incidents of 'shelling' are bound to occur. Some developers claim they have trained new LLMs when, in fact, they are using other foundational models (like Lla

Google recently launched its next-generation artificial intelligence model, PaliGemma2, which can analyze images and generate captions while answering questions about the emotions and actions of people in the photos. Built on Google's Gemma open model series, PaliGemma2 offers more profound image descriptions than traditional object recognition, enabling it to identify emotions and generate contextually relevant detailed descriptions. However, despite this technology appearing to be a groundbreaking innovation, experts have raised serious warnings about its potential ethical and societal implications. Emotion recognition is not...

At today's Rokid Jungle 2024 partner conference and product launch, Rokid officially unveiled its next-generation AR glasses - Rokid Glasses. These glasses not only support customized myopic and astigmatism lenses based on user needs, but also feature a convenient detachable buckle design, providing more personalized options for users with different vision requirements. The biggest highlight of Rokid Glasses is its integration with Alibaba's Tongyi Qianwen multimodal large model, enabling phone calls, Q&A searches, and object recognition.

Recently, a startup in Seattle named Moondream launched a compact visual language model called moondream2. Despite its small size, the model has shown outstanding performance in various benchmark tests and has garnered significant attention. As an open-source model, moondream2 is expected to enable local image recognition capabilities on smartphones. Moondream2 was officially released in March and can process both text and image inputs, possessing functions such as answering questions, text extraction (OCR), object counting, and item classification.

The American startup Useful Sensors has launched an open-source speech recognition model called Moonshine. Moonshine is designed to process audio data more efficiently, using computational resources more economically and achieving processing speeds five times faster than OpenAI's Whisper. This new model is specifically built for real-time applications on resource-constrained hardware and features a flexible architecture. Unlike Whisper, which processes audio in fixed 30-second segments, Moonshine offers a different approach.

When creating engaging videos, audio plays a crucial role alongside visuals. However, finding or producing the right sound effects can often be a time-consuming task. At Adobe's annual MAX conference, they showcased an experimental prototype called Project Super Sonic, a technology that can generate sound effects from text, recognize objects in videos, and even utilize your voice to quickly produce background sounds and effects for video projects. While the feature of generating sound effects from text prompts sounds promising,

Title: OCR 2.0: A New Generation Optical Character Recognition Model for Easy Image Text Conversion. Recently, researchers have developed a new universal Optical Character Recognition (OCR) model called GOT (Universal OCR Theory). In their paper, they introduced the concept of 'OCR 2.0' for the first time. This new model aims to combine the advantages of traditional OCR systems with the powerful capabilities of large language models. The architecture of GOT is quite advanced, featuring an image encoder with approximately 80 million parameters and 500...

In the digital age, quickly converting text content from images into editable text is a common and important need. Now, the emergence of a new optical character recognition (OCR) model called GOT (General Optical Character Recognition Theory) marks the advancement of OCR technology into the 2.0 era. This innovative model combines the advantages of traditional OCR systems with large language models, aiming to create a more efficient and intelligent text recognition tool. The GOT model employs an innovative end-to-end architecture, a design that not only saves resources but also greatly enhances performance.