Coding
DeepSeek R1 Distill 14B specs, VRAM requirements, and which GPUs can run it. Reasoning-focused model that punches above its weight.
deepseek-coder-33b-base specs, VRAM requirements, and which GPUs can run it.
deepseek-coder-33b-instruct specs, VRAM requirements, and which GPUs can run it.
deepseek-coder-6.7b-base specs, VRAM requirements, and which GPUs can run it.
deepseek-coder-6.7b-instruct specs, VRAM requirements, and which GPUs can run it.
deepseek-coder-7b-base-v1.5 specs, VRAM requirements, and which GPUs can run it.
deepseek-coder-7b-instruct-v1.5 specs, VRAM requirements, and which GPUs can run it.
DeepSeek-Coder-V2-Instruct specs, VRAM requirements, and which GPUs can run it.
DeepSeek-Coder-V2-Instruct-0724 specs, VRAM requirements, and which GPUs can run it.
DeepSeek-Coder-V2-Lite-Base specs, VRAM requirements, and which GPUs can run it.
Llama 3.1 70B specs, VRAM requirements, and which GPUs can run it. The sweet spot for local reasoning.
Llama 3.1 8B specs, VRAM requirements, and which GPUs can run it. The go-to small model for local inference.
Qwen2.5-Coder-0.5B-Instruct specs, VRAM requirements, and which GPUs can run it.
Qwen2.5-Coder-1.5B-Instruct specs, VRAM requirements, and which GPUs can run it.
Qwen2.5-Coder-14B-Instruct specs, VRAM requirements, and which GPUs can run it.
Qwen2.5-Coder-32B-Instruct specs, VRAM requirements, and which GPUs can run it.
Qwen2.5-Coder-32B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.
Qwen2.5-Coder-7B-Instruct specs, VRAM requirements, and which GPUs can run it.
Qwen2.5-Coder-7B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.
Qwen2.5-Coder-7B-Instruct-GPTQ-Int4 specs, VRAM requirements, and which GPUs can run it.
Qwen3-Coder-30B-A3B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.
Qwen3-Coder-Next specs, VRAM requirements, and which GPUs can run it.
Qwen3-Coder-Next-8bit specs, VRAM requirements, and which GPUs can run it.
Qwen3-Coder-Next-AWQ-4bit specs, VRAM requirements, and which GPUs can run it.
Qwen3-Coder-Next-Base specs, VRAM requirements, and which GPUs can run it.
Qwen3-Coder-Next-FP8 specs, VRAM requirements, and which GPUs can run it.
Strand-Rust-Coder-14B-v1 specs, VRAM requirements, and which GPUs can run it.
Yi-Coder-9B specs, VRAM requirements, and which GPUs can run it.
Yi-Coder-9B-Chat specs, VRAM requirements, and which GPUs can run it.