en
AI Ranking
每月不到10元,就可以无限制地访问最好的AIbase。立即成为会员
Home
News
Daily Brief
Income Guide
Tutorial
Tools Directory
Product Library
en
AI Ranking
Search AI Products and News
Explore worldwide AI information, discover new AI opportunities
AI News
AI Tools
AI Cases
AI Tutorial
Type :
AI News
AI Tools
AI Cases
AI Tutorial
2023-11-21 16:52:08
.
AIbase
.
3.4k
GPT-4's Accuracy on Graphic Reasoning Tasks is Only 33%, Sparking Concern
Research from the Santa Fe Institute shows that GPT-4 has only a 33% accuracy rate on graphic reasoning tasks. The multimodal version, GPT-4v, performs even worse with only a 25% accuracy rate, raising concerns about its graphic processing capabilities. Testing with the ConceptARC dataset reveals that the average accuracy of humans on graphic reasoning tasks reaches 91%, significantly higher than GPT-4. Researchers raised questions about the input methods used for participants and GPT-4, including sample randomness and how image transformations could alter concepts. The study highlights the limitations of large