Skip to content

Data-Juicer

A one-stop multimodal data processing system

Visit official site

What Data-Juicer is

Data-Juicer is a one-stop multimodal data processing system built to give language models better data. It provides a reusable library, a sandbox lab and multi-dimensional evaluation.

What you can do with it

  • Combine operators into a processing flow
  • Iterate with data and model feedback
  • Use recipes for pretraining or fine tuning

Getting started

  • Install from source or as a package
  • Prepare a dataset in a supported format
  • Configure operators and run the process

Pros & cons

✓ What we like

  • Custom operators can be combined freely
  • A sandbox lab supports fast iteration

! What to watch out for

  • Datasets must match supported formats
  • Processing needs an operator configuration step

FAQ

How is it installed?

From source or through a package install.

What runs the process?

A processing script or command line tool.

Last reviewed: 2026-11-15

More AI coding tools tools

View all →

How we review