en
AI Ranking
每月不到10元,就可以无限制地访问最好的AIbase。立即成为会员
Home
News
Daily Brief
Income Guide
Tutorial
Tools Directory
Product Library
en
AI Ranking
Search AI Products and News
Explore worldwide AI information, discover new AI opportunities
AI News
AI Tools
AI Cases
AI Tutorial
Type :
AI News
AI Tools
AI Cases
AI Tutorial
2024-08-01 12:02:28
.
AIbase
.
10.7k
The Claude Team Sparks Outrage Over Data Scraping Issues, Resorting to Unethical Means to Bypass Rules
The Claude team has caused a major uproar due to their large-scale, unauthorized data scraping activities. Their crawler accessed the iFixit servers one million times within 24 hours, scraping a significant amount of website content, leading to severe resource strain on the servers, which triggered strong dissatisfaction from both the affected company and the public. iFixit explicitly prohibits data scraping on their website, yet the Claude team's actions disregarded these rules, resulting in months of illegal access to the site. This incident not only disrupted iFixit's normal operations but also impacted other entities reliant on website content.
2024-07-26 14:20:10
.
AIbase
.
10.6k
Anthropic's crawler bot criticized for ignoring website anti-AI scraping policies
Anthropic's ClaudeBot web crawler frequently accessed the iFixit website within 24 hours, allegedly violating terms of use by unauthorized content usage and consuming development resources. iFixit has added a crawl-delay extension in robots.txt to limit crawler access. This incident also affected other websites, such as Read the Docs and Freelancer.com. AI companies like OpenAI refuse crawler access through robots.txt.