Skip to content

Kolosal AI

Train and run language models locally

Visit official site

What Kolosal AI is

The tool is described as a cross-platform desktop app for training, optimising and running language models locally with personalised training options.

What you can do with it

  • Generate training data by synthesis
  • Fine-tune and align a model
  • Switch between LoRA models without merging
  • Query user documents with RAG

Getting started

  • Install the package for your system
  • Create personalised training data
  • Pick a quantisation format for speed

Pros & cons

✓ What we like

  • Local inference keeps data on the device
  • The tool is open source

! What to watch out for

  • Work runs on local hardware
  • Quantisation is chosen by the user

FAQ

Which systems are named?

The material lists Windows, Linux and macOS.

Is it open source?

The material states the tool is open source.

Last reviewed: 2026-11-15

More AI coding tools tools

View all →

How we review