Factorio Learning Environment
A testing and learning environment for large language models based on the game Factorio
CommonProductProductivityLanguage Model EvaluationFactorio Game
Factorio Learning Environment (FLE) is a novel framework built on the game Factorio, used to evaluate the capabilities of large language models (LLMs) in long-term planning, program synthesis, and resource optimization. As LLMs gradually saturate existing benchmark tests, FLE provides a new open-ended evaluation approach. Its importance lies in enabling researchers to gain a more comprehensive and in-depth understanding of the strengths and weaknesses of LLMs. Key advantages include open-ended challenges with exponentially increasing difficulty, and two evaluation protocols: structured tasks and open-ended tasks. This project was developed by Jack Hopkins et al., released as open source, free to use, and aims to promote research by AI researchers on the capabilities of agents in complex, open-ended domains.
Factorio Learning Environment Visit Over Time
Monthly Visits
No Data
Bounce Rate
No Data
Page per Visit
No Data
Visit Duration
No Data
Factorio Learning Environment Visit Trend
No Visits Data
Factorio Learning Environment Visit Geography
No Geography Data
Factorio Learning Environment Traffic Sources
No Traffic Sources Data
