During the 2024 World Internet Conference in Wuzhen, Alibaba Group CEO Wu Yongming delivered a keynote speech at the Internet Entrepreneurs Forum on November 21, emphasizing the profound impact of artificial intelligence (AI) on the internet industry. He pointed out that the biggest change in the internet industry this year is still the rapid development of AI technology. Wu Yongming stated that the greatest value of AI is not merely the development of one or two super apps on mobile phones, but in driving productivity transformation across various industries. The development of AI requires a prosperous ecosystem of technology, products, and market.
AI startup Moondream has officially announced the completion of $4.5 million in seed funding and presents a disruptive viewpoint: in the world of AI models, smaller models may hold advantages. The company is backed by Felicis Ventures, Microsoft's M12 GitHub Fund, and Ascend, launching a visual language model with only 1.6 billion parameters that can compete with models four times its size in terms of performance.
The Allen Institute for Artificial Intelligence (AI2) has released an open-source large language model OLMoE, aimed at providing high performance and low-cost solutions. This model employs a Sparse Mixture of Experts (MoE) architecture with 7 billion parameters, but through an intelligent routing mechanism, only 1 billion parameters are used per input token, achieving efficient computation. OLMoE includes both general and instruction-tuned versions, supporting a context window of 4096 tokens. Its training data is sourced from a wide range, including Common Crawl, Dolma CC, and Wikipedia.