Category AI models
What ARC-AGI is
The dataset is described as a way to test abstraction and reasoning in AI systems. It contains 400 training tasks and 400 evaluation tasks stored as JSON pairs.
What you can do with it
- Train a model to solve abstract reasoning tasks
- Use the task set as a teaching tool about AI
- Benchmark an AI product on the evaluation tasks
Getting started
- Download the dataset from the GitHub page
- Pick a task JSON file and read its input-output pairs
- Open the test interface in a browser and load the task
What to watch out for
- Each test output grid allows three attempts
- Grid cells are visualized with integers from 0 to 9
Pros & cons
✓ What we like
- Three attempts are allowed per output grid
- Grid cells use integers 0 to 9 for colors
! What to watch out for
- Tasks are stored as JSON files to be loaded
- Only three attempts are allowed per test output grid
FAQ
How many tasks are there?
400 training tasks and 400 evaluation tasks.
What format are tasks in?
JSON files with train and test input-output pairs.
Last reviewed: 2026-11-15
More LLM API platform tools
View all →-
302.AI Aggregated cloud platform that hosts hundreds of large models behind one API Developer tools API integration Multi model platform Model deployment LLM API platform -
360智脑开放平台 360 model API platform API integration Multi model platform Knowledge base Q&A Enterprise automation LLM API platform -
4o Image API Image generation API gateway Free tools Freemium tools Developer tools API integration LLM API platform -
AI-Flow No-code multi-model workflows Workflow automation Developer tools API integration Knowledge base Q&A LLM API platform -
AI/ML API Single gateway to many models Developer tools API integration Multimodal Multi model platform LLM API platform -
Amazon Bedrock AWS code suggestions with security scans Free tools Code assistant IDE App builder LLM API platform