Local AI · historical measurements (legacy, read-only)
Find a local AI model for your GPU
Pick a task, your GPU, and a context length. Speeds are earlier Bench-Agent measurements on that exact GPU, model file, and context — not a UOS index and not used in upgrade decisions. Model quality and license are separate questions.
Measured on real hardware
Choose your GPU above to see models measured on it. Measurements are never assigned to a different or unknown GPU.
Model candidates for coding at 32K
A shortlist, not a ranking. Model quality, GPU fit, context, local speed and license are separate — there is no single AI score.
| Model | Primary use | Quality evidence | GPU fit | Context | Local speed | License | Details |
|---|---|---|---|---|---|---|---|
| DeepSeek R1 Distill · 14B | Reasoning, Math | 2 reported | Not verified | Up to 128K documented | Not measured | Needs review | Details for DeepSeek R1 Distill |
| Gemma 4 · 11.95B | Coding, Reasoning | 1 reported | Not verified | Up to 256K documented | Not measured | Needs review | Details for Gemma 4 |
| Mistral Small 3.2 · 24B | Coding, Reasoning | 2 reported | Not verified | Up to 128K documented | Not measured | Needs review | Details for Mistral Small 3.2 |
| Llama 3.1 · 8B | Coding, Reasoning | 2 reported | Not verified | Up to 128K documented | Not measured | Needs review | Details for Llama 3.1 |
DeepSeek R1 Distill · 14B
- Quality
- 2 reported
- GPU fit
- Not verified
- Local speed
- Not measured
- License
- Needs review
Gemma 4 · 11.95B
- Quality
- 1 reported
- GPU fit
- Not verified
- Local speed
- Not measured
- License
- Needs review
Mistral Small 3.2 · 24B
- Quality
- 2 reported
- GPU fit
- Not verified
- Local speed
- Not measured
- License
- Needs review
Llama 3.1 · 8B
- Quality
- 2 reported
- GPU fit
- Not verified
- Local speed
- Not measured
- License
- Needs review
Model details
DeepSeek R1 Distill · 14B
Category-specific provider quality facts exist, but this GPU/context has no reviewed runtime fit evidence.
Context: up to 128K documented, not verified on your GPU.
- Coding · LiveCodeBench: 53.1
- Coding · Codeforces rating: 1481
Gemma 4 · 11.95B
Category-specific provider quality facts exist, but this GPU/context has no reviewed runtime fit evidence.
Context: up to 256K documented, not verified on your GPU.
- Coding · LiveCodeBench v6 · Gemma 4 12B Unified: 72
Mistral Small 3.2 · 24B
Category-specific provider quality facts exist, but this GPU/context has no reviewed runtime fit evidence.
Context: up to 128K documented, not verified on your GPU.
- Coding · HumanEval Plus · Pass@5 · Small 3.2 24B Instruct: 92.9
- Coding · MBPP Plus · Pass@5 · Small 3.2 24B Instruct: 78.33
Llama 3.1 · 8B
Category-specific provider quality facts exist, but this GPU/context has no reviewed runtime fit evidence.
Context: up to 128K documented, not verified on your GPU.
- Coding · HumanEval · zero-shot pass@1 · Llama 3.1 8B Instruct: 72.6
- Coding · MBPP ++ base version · zero-shot pass@1 · Llama 3.1 8B Instruct: 72.8
Measured fit can narrow a shortlist. Model quality and your own preferences still decide which model is best for you.