Qwen2.5-Coder-3B-Instruct-GPTQ-Int8
A 3B code model tuned for generation, reasoning and repair
What Qwen2.5-Coder-3B-Instruct-GPTQ-Int8 is
The model is described as an instruction-tuned GPTQ Int8 release of the Qwen2.5-Coder series, trained for code generation, reasoning and repair.
What you can do with it
- Generate source code from a prompt
- Reason about code logic before editing
- Detect and fix errors in code
Getting started
- Install transformers at version 4.37.0 or newer
- Load the model and tokenizer from the Hub
- Apply the chat template and generate output
Pros & cons
✓ What we like
- Code repair is listed alongside generation
- Math and general abilities are stated as retained
! What to watch out for
- Loading asks for transformers at version 4.37.0 or newer
- Inputs go through the chat template before generation
FAQ
What quantisation is used?
The material states GPTQ 8-bit quantisation.
How long is the context?
The material lists a context length of 32768 tokens.
Last reviewed: 2026-11-15
More AI coding tools tools
View all →-
100 Vibe Coding Learn vibe coding by building Free tools Enterprise tools Developer tools API integration Coding -
10Web Prompt to WordPress site with hosting Free tools Developer tools No code development Coding Website builder -
16x Prompt Context management for AI coding Free tools Workflow automation Developer tools API integration Coding -
a0.dev Chat-built mobile apps to store Free tools Developer tools No code development Coding App builder -
Adalo No-code apps with a visual canvas Free tools Developer tools No code development Coding App builder -
AgentQL Natural language web data extraction Freemium tools Developer tools Browser extension Data extraction Coding