In today's technology landscape, CLIP (Contrastive Language-Image Pre-training) is an important multimodal foundational model. It combines visual signals and text signals into a shared feature space using contrastive learning loss on a large-scale dataset of image-text pairs. As a retriever, CLIP supports various tasks such as zero-shot classification, detection, segmentation, and image-text retrieval. Meanwhile, as a feature extractor, it performs well in nearly all...

At a recent press conference, Alibaba International's AI team unveiled its latest development, the multimodal large model Ovis. This innovative AI technology undoubtedly brings new opportunities across various industries. Ovis boasts powerful image understanding and data processing capabilities that are refreshing. Ovis's multimodal ability is exceptionally strong, allowing it to handle various data types such as text and images, showcasing excellent comprehensive strength. Compared to traditional large language models, Ovis not only understands text but also conducts in-depth analysis of non-text information such as images.

On August 30, 2024, Alibaba Damo Academy's Tongyi Qianwen team announced a significant update to its latest achievement—the Qwen2-VL model. The Qwen2-VL model has achieved remarkable improvements in image understanding, video processing, and multilingual support, setting new benchmarks for key performance indicators.

Microsoft has released Phi-3.5-vision, a lightweight, multimodal open source AI model designed for processing textual and visual inputs, supporting a context length of 128K. This model is suitable for resource-constrained environments and features capabilities such as image understanding, OCR, chart parsing, and multi-image summarization, showcasing excellent performance and low latency. Comprised of 4.2 billion parameters, it is trained with high-quality data to ensure performance and privacy. It includes three models: lightweight AI, expert mix, and multimodal model, all demonstrating outstanding performance in image and video processing benchmarks.