Search AI Products and News

Bug fixing is a persistent challenge in software development. ByteDance's Doubao large model team has exciting news: they've launched Multi-SWE-bench, the first multi-lingual software engineering (SWE) dataset. This new dataset aims to evaluate and improve the ability of large models to automatically fix code errors. Multi-SWE-bench significantly expands the scope compared to previous single-language datasets. It covers not only Python, but also...

OpenAI has released SWE-bench Verified, aiming to more accurately assess AI performance in software engineering tasks and address the limitations of the original SWE-bench, such as overly strict unit tests, ambiguous problem descriptions, and challenging development environment setups. The new benchmark improves assessment consistency and reliability by introducing a containerized Docker environment, significantly enhancing the performance scoring of AI models. GPT-4o solved 33.2% of the samples under the new benchmark, while the best open-source agent framework has...

AI startup Cognition has launched the AI programmer 'Genie', scoring 30.08% on the authoritative testing platform SWE-Bench, far surpassing Devin and GPT-4, and becoming the world's strongest AI programming assistant. Co-founder Alistair Pullen showcased the project in 2022, aiming to create an AI that can automatically code, debug, and optimize like a human. After over a year of development, Genie utilizes special data that incorporates the reasoning processes of human programmers.