What Factorio Learning Environment is
The framework is an open-ended evaluation environment built on the game Factorio for testing LLM planning, program synthesis and resource optimisation.
What you can do with it
- Run open-ended challenges from basic automation to complex factories
- Choose between Lab-play and Open-play protocols
What to watch out for
- Evaluation is built around one game environment
- The Python API is the stated interaction path
Pros & cons
✓ What we like
- Open source and free to use
- Production scores and milestones measure planning
! What to watch out for
- Evaluation is built around one game environment
- The Python API is the stated interaction path
FAQ
What does it evaluate?
Long-term planning, program synthesis and resource optimisation in LLMs.
How many structured tasks?
The material states 24 structured tasks in Lab-play.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform