BENCHMARKS
Every run, with its config
6 runs across 3 engines. Click a tag to filter.
all 6 posts
Qwen3.6-35B-A3B · GPTQ-Int4 · vLLM XPU
105.8 t/s warm
TTFT 1.50 s · VRAM 31.4 GB peak
2026-10-16baseline
Qwen3.8-27B · EXL3 4.00bpw · exl3xpu
57.0 t/s warm
TTFT 1.43 s · VRAM 30.7 GB peak
2026-10-16baseline
Qwen3.8-27B · EXL3 · batch 4096→8192
56.6 t/s warm
TTFT 1.40 s · VRAM 31.4 GB peak
2026-10-17▼ −0.4 vs prev
Qwen3.8-27B · GGUF IQ3_S · llama.cpp
44.9 t/s warm
TTFT 23.45 s · VRAM 20.9 GB peak
2026-10-17baseline
Qwen3.8-27B · GGUF · ubatch 4096 + KV q8_0
56.8 t/s warm
TTFT 16.00 s · VRAM 29.8 GB peak
2026-10-17▲ +11.9 vs prev
Qwen3.8-27B · GGUF · KV q8_0
56.1 t/s warm
TTFT 16.65 s · VRAM 23.4 GB peak
2026-10-17▼ −0.7 vs prev