en
每月不到10元,就可以无限制地访问最好的AIbase。立即成为会员
Home
News
Daily Brief
Income Guide
Tutorial
Tools Directory
Product Library
en
Search AI Products and News
Explore worldwide AI information, discover new AI opportunities
AI News
AI Tools
AI Cases
AI Tutorial
Type :
AI News
AI Tools
AI Cases
AI Tutorial
2024-10-08 09:09:58
.
AIbase
.
12.2k
Korean VESSL AI Secures $12 Million Funding to Reduce Enterprise GPU Costs by Up to 80%
As artificial intelligence increasingly integrates into enterprise workflows and products, the demand for Machine Learning Operations (MLOps) platforms is rising. These platforms assist companies in creating, testing, and deploying machine learning models more easily. However, despite the presence of several competitors in the market, such as startups like InfuseAIComet and major companies like Google Cloud, Azure, and AWS, South Korea's VESSL AI aims to carve out its niche by focusing on optimizing GPU costs.
2024-08-13 13:47:55
.
AIbase
.
11.0k
New Breakthrough in GPU Optimization! 'Tree Attention' Accelerates Inference of 5 Million Long Texts by 8 Times
The Transformer architecture, a star in the field of artificial intelligence, has led a revolution in natural language processing with its self-attention mechanism at its core. However, when handling long contexts, the resource consumption of self-attention calculations becomes a bottleneck. To address this issue, researchers have proposed the Tree Attention method, which decomposes the calculation tasks through tree reduction to improve efficiency. This method not only reduces communication overhead and memory usage but is also 8 times faster than existing methods in a multi-GPU environment. The introduction of Tree Attention not only enhances performance.