Chat

AceReason-Nemotron-14B specs, VRAM requirements, and which GPUs can run it.

Agents-A1 specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba-Large-1.5 specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba-Large-1.6 specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba-Mini-1.5 specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba-Mini-1.6 specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba-Reasoning-3B specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba2-3B specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba2-Mini specs, VRAM requirements, and which GPUs can run it.

AI21-Jamba2-Mini-FP8 specs, VRAM requirements, and which GPUs can run it.

Apertus-8B-Instruct-2509 specs, VRAM requirements, and which GPUs can run it.

Athene-70B specs, VRAM requirements, and which GPUs can run it.

Athene-V2-Chat specs, VRAM requirements, and which GPUs can run it.

Bielik-11B-v3.0-Instruct specs, VRAM requirements, and which GPUs can run it.

bitnet-b1.58-2B-4T specs, VRAM requirements, and which GPUs can run it.

bitnet-b1.58-2B-4T-bf16 specs, VRAM requirements, and which GPUs can run it.

Bonsai-27B-mlx-1bit specs, VRAM requirements, and which GPUs can run it.

Bonsai-8B-mlx-1bit specs, VRAM requirements, and which GPUs can run it.

CD-ROM ChatGPT Thinking-Q4_0 specs, VRAM requirements, and which GPUs can run it.

codegemma-7b-it specs, VRAM requirements, and which GPUs can run it.

CodeLlama-13b-Instruct-hf specs, VRAM requirements, and which GPUs can run it.

CodeLlama-34b-Instruct-hf specs, VRAM requirements, and which GPUs can run it.

CodeLlama-7b-Instruct-hf specs, VRAM requirements, and which GPUs can run it.

Darwin-9B-NEG specs, VRAM requirements, and which GPUs can run it.

datagemma-rag-27b-it specs, VRAM requirements, and which GPUs can run it.

datagemma-rig-27b-it specs, VRAM requirements, and which GPUs can run it.

DeepHermes-3-Llama-3-8B-Preview specs, VRAM requirements, and which GPUs can run it.

DeepHermes-3-Mistral-24B-Preview specs, VRAM requirements, and which GPUs can run it.

deepseek-coder-1.3b-instruct specs, VRAM requirements, and which GPUs can run it.

deepseek-coder-33b-instruct specs, VRAM requirements, and which GPUs can run it.

deepseek-coder-6.7b-instruct specs, VRAM requirements, and which GPUs can run it.

deepseek-coder-7b-instruct-v1.5 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-Coder-V2-Base specs, VRAM requirements, and which GPUs can run it.

DeepSeek-Coder-V2-Instruct specs, VRAM requirements, and which GPUs can run it.

DeepSeek-Coder-V2-Instruct-0724 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-Coder-V2-Lite-Base specs, VRAM requirements, and which GPUs can run it.

DeepSeek-Coder-V2-Lite-Instruct specs, VRAM requirements, and which GPUs can run it.

deepseek-math-7b-rl specs, VRAM requirements, and which GPUs can run it.

DeepSeek-Math-V2 specs, VRAM requirements, and which GPUs can run it.

deepseek-moe-16b-chat specs, VRAM requirements, and which GPUs can run it.

DeepSeek-Prover-V2-671B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-0528 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-0528-NVFP4 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-0528-NVFP4-v2 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-0528-Qwen3-8B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-0528-Qwen3-8B-MLX-4bit specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-0528-Qwen3-8B-MLX-8bit specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-Distill-Llama-70B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-Distill-Llama-8B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-Distill-Qwen-1.5B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-Distill-Qwen-14B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-Distill-Qwen-32B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-Distill-Qwen-7B specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-NVFP4 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-R1-Zero specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V2 specs, VRAM requirements, and which GPUs can run it.

Deepseek-V2 Pro specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V2-Chat specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V2-Chat-0628 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V2-Lite specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V2-Lite-Chat specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V2.5 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V2.5-1210 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3-0324 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3-0324-NVFP4 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3.1 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3.1-Base specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3.1-NVFP4 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3.1-Terminus specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3.2-Exp specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V3.2-Exp-Base specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V4-Flash specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V4-Flash-0731 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V4-Pro specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V4-Pro-0813 specs, VRAM requirements, and which GPUs can run it.

DeepSeek-V4-Pro-8bit specs, VRAM requirements, and which GPUs can run it.

DialoGPT-small specs, VRAM requirements, and which GPUs can run it.

diffusiongemma-26B-A4B-it-NVFP4 specs, VRAM requirements, and which GPUs can run it.

dolphin-2.9.1-yi-1.5-34b specs, VRAM requirements, and which GPUs can run it.

Dolphin-Mistral-24B-Venice-Edition specs, VRAM requirements, and which GPUs can run it.

Dream-v0-Instruct-7B specs, VRAM requirements, and which GPUs can run it.

droplychee-1.0-27b specs, VRAM requirements, and which GPUs can run it.

Ektome-Qwen3.8-27B-PristinelyUncensored specs, VRAM requirements, and which GPUs can run it.

Emo_1b14b_1T specs, VRAM requirements, and which GPUs can run it.

ESFT-vanilla-lite specs, VRAM requirements, and which GPUs can run it.

evolai-tfm-1p5b specs, VRAM requirements, and which GPUs can run it.

evolai-tfm-1p5b-alt specs, VRAM requirements, and which GPUs can run it.

EXAONE-3.5-7.8B-Instruct specs, VRAM requirements, and which GPUs can run it.

falcon-11B specs, VRAM requirements, and which GPUs can run it.

falcon-7b-instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-E-1B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-E-3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-0.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-1.5B-Deep-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-1.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-34B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-34B-Instruct-GPTQ-Int4 specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-34B-Instruct-GPTQ-Int8 specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-7B-Instruct-GPTQ-Int4 specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-Tiny-90M-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-Tiny-90M-Instruct-pre-DPO specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-Tiny-Multilingual-100M-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-Tiny-R-0.6B specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-Tiny-R-90M specs, VRAM requirements, and which GPUs can run it.

Falcon-H1-Tiny-Tool-Calling-90M specs, VRAM requirements, and which GPUs can run it.

Falcon-H1R-7B specs, VRAM requirements, and which GPUs can run it.

Falcon-H1R-7B-FP8 specs, VRAM requirements, and which GPUs can run it.

falcon-mamba-7b-instruct specs, VRAM requirements, and which GPUs can run it.

falcon-mamba-tiny-dev specs, VRAM requirements, and which GPUs can run it.

Falcon3-10B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon3-10B-Instruct-1.58bit specs, VRAM requirements, and which GPUs can run it.

Falcon3-1B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon3-1B-Instruct-1.58bit specs, VRAM requirements, and which GPUs can run it.

Falcon3-3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon3-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

Falcon3-7B-Instruct-1.58bit specs, VRAM requirements, and which GPUs can run it.

Falcon3-Mamba-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

farabi-1.7b specs, VRAM requirements, and which GPUs can run it.

Faust-1 specs, VRAM requirements, and which GPUs can run it.

Flex-reddit-2x7B-1T specs, VRAM requirements, and which GPUs can run it.

FlexOlmo-7x7B-1T specs, VRAM requirements, and which GPUs can run it.

FlexOlmo-7x7B-1T-RT specs, VRAM requirements, and which GPUs can run it.

FrogBoss-32B-2510 specs, VRAM requirements, and which GPUs can run it.

FrogMini-14B-2510 specs, VRAM requirements, and which GPUs can run it.

functiongemma-270m-it specs, VRAM requirements, and which GPUs can run it.

gemma-1.1-2b-it specs, VRAM requirements, and which GPUs can run it.

gemma-1.1-7b-it specs, VRAM requirements, and which GPUs can run it.

gemma-2-27b-it specs, VRAM requirements, and which GPUs can run it.

gemma-2-2b-it specs, VRAM requirements, and which GPUs can run it.

gemma-2-2b-jpn-it specs, VRAM requirements, and which GPUs can run it.

gemma-2-9b-it specs, VRAM requirements, and which GPUs can run it.

gemma-2-9b-it-AWQ-INT4 specs, VRAM requirements, and which GPUs can run it.

gemma-2b-it specs, VRAM requirements, and which GPUs can run it.

gemma-3-1b-it specs, VRAM requirements, and which GPUs can run it.

gemma-3-1b-it-qat-int4-unquantized specs, VRAM requirements, and which GPUs can run it.

gemma-3-1b-it-qat-q4_0-unquantized specs, VRAM requirements, and which GPUs can run it.

gemma-3-270m-it specs, VRAM requirements, and which GPUs can run it.

gemma-3-270m-it-qat-q4_0-unquantized specs, VRAM requirements, and which GPUs can run it.

Gemma-4-26B-A4B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Gemma-4-31B-IT-NVFP4 specs, VRAM requirements, and which GPUs can run it.

gemma-4-31B-it-NVFP4-turbo specs, VRAM requirements, and which GPUs can run it.

gemma-4-31B-it-OptiQ-4bit specs, VRAM requirements, and which GPUs can run it.

gemma-4-E4B-it-OBLITERATED specs, VRAM requirements, and which GPUs can run it.

gemma-4-e4b-it-OptiQ-4bit specs, VRAM requirements, and which GPUs can run it.

gemma-7b-aps-it specs, VRAM requirements, and which GPUs can run it.

gemma-7b-it specs, VRAM requirements, and which GPUs can run it.

gemma4-e4b-claims-comparison specs, VRAM requirements, and which GPUs can run it.

GLM-4.5-Air specs, VRAM requirements, and which GPUs can run it.

GLM-4.7-Flash specs, VRAM requirements, and which GPUs can run it.

GLM-4.7-Flash-AWQ-4bit specs, VRAM requirements, and which GPUs can run it.

GLM-4.7-Flash-FP8-Dynamic specs, VRAM requirements, and which GPUs can run it.

GLM-4.7-Flash-MLX-6bit specs, VRAM requirements, and which GPUs can run it.

GLM-4.7-Flash-MLX-8bit specs, VRAM requirements, and which GPUs can run it.

GLM-5-FP8 specs, VRAM requirements, and which GPUs can run it.

GLM-5-NVFP4 specs, VRAM requirements, and which GPUs can run it.

GLM-5.1-FP8 specs, VRAM requirements, and which GPUs can run it.

GLM-5.1-MLX-4.8bit specs, VRAM requirements, and which GPUs can run it.

GLM-5.2 specs, VRAM requirements, and which GPUs can run it.

GLM-5.2-FP8 specs, VRAM requirements, and which GPUs can run it.

GLM-5.2-NVFP4 specs, VRAM requirements, and which GPUs can run it.

GLM-5.2-NVFP4-FP8 specs, VRAM requirements, and which GPUs can run it.

gpt-oss-120b specs, VRAM requirements, and which GPUs can run it.

gpt-oss-20b specs, VRAM requirements, and which GPUs can run it.

gpt-oss-20b-MXFP4-Q8 specs, VRAM requirements, and which GPUs can run it.

gpt-oss-puzzle-88B specs, VRAM requirements, and which GPUs can run it.

granite-3.3-8b-instruct specs, VRAM requirements, and which GPUs can run it.

granite-4.0-h-small specs, VRAM requirements, and which GPUs can run it.

granite-4.0-micro specs, VRAM requirements, and which GPUs can run it.

granite-4.1-8b specs, VRAM requirements, and which GPUs can run it.

GRIN-MoE specs, VRAM requirements, and which GPUs can run it.

h2ovl-mississippi-2b specs, VRAM requirements, and which GPUs can run it.

h2ovl-mississippi-800m specs, VRAM requirements, and which GPUs can run it.

Hermes-2-Pro-Llama-3-8B specs, VRAM requirements, and which GPUs can run it.

Hermes-2-Pro-Mistral-7B specs, VRAM requirements, and which GPUs can run it.

Hermes-2-Theta-Llama-3-70B specs, VRAM requirements, and which GPUs can run it.

Hermes-2-Theta-Llama-3-8B specs, VRAM requirements, and which GPUs can run it.

Hermes-3-Llama-3.1-405B specs, VRAM requirements, and which GPUs can run it.

Hermes-3-Llama-3.1-70B specs, VRAM requirements, and which GPUs can run it.

Hermes-3-Llama-3.1-8B specs, VRAM requirements, and which GPUs can run it.

Hermes-3-Llama-3.2-3B specs, VRAM requirements, and which GPUs can run it.

Hermes-4-14B specs, VRAM requirements, and which GPUs can run it.

Hermes-4-14B-FP8 specs, VRAM requirements, and which GPUs can run it.

Hermes-4-405B specs, VRAM requirements, and which GPUs can run it.

Hermes-4-405B-FP8 specs, VRAM requirements, and which GPUs can run it.

Hermes-4-70B specs, VRAM requirements, and which GPUs can run it.

Hermes-4-70B-FP8 specs, VRAM requirements, and which GPUs can run it.

Hermes-4.3-36B specs, VRAM requirements, and which GPUs can run it.

Huihui-Qwen3-Coder-Next-Opus-4.6-Reasoning-Distilled-abliterated specs, VRAM requirements, and which GPUs can run it.

Hy3 specs, VRAM requirements, and which GPUs can run it.

internlm2_5-1_8b-chat specs, VRAM requirements, and which GPUs can run it.

internlm2_5-20b-chat specs, VRAM requirements, and which GPUs can run it.

internlm2_5-7b specs, VRAM requirements, and which GPUs can run it.

internlm2_5-7b-chat specs, VRAM requirements, and which GPUs can run it.

internlm2_5-7b-chat-1m specs, VRAM requirements, and which GPUs can run it.

internlm2-chat-1_8b specs, VRAM requirements, and which GPUs can run it.

internlm2-chat-20b specs, VRAM requirements, and which GPUs can run it.

internlm2-chat-7b specs, VRAM requirements, and which GPUs can run it.

internlm2-chat-7b-sft specs, VRAM requirements, and which GPUs can run it.

internlm2-math-7b specs, VRAM requirements, and which GPUs can run it.

internlm2-math-plus-1_8b specs, VRAM requirements, and which GPUs can run it.

internlm2-math-plus-7b specs, VRAM requirements, and which GPUs can run it.

internlm3-8b-instruct specs, VRAM requirements, and which GPUs can run it.

Jan-v3-4B-base-instruct specs, VRAM requirements, and which GPUs can run it.

japanese-stablelm-2-instruct-1_6b specs, VRAM requirements, and which GPUs can run it.

japanese-stablelm-3b-4e1t-instruct specs, VRAM requirements, and which GPUs can run it.

japanese-stablelm-instruct-beta-70b specs, VRAM requirements, and which GPUs can run it.

japanese-stablelm-instruct-beta-7b specs, VRAM requirements, and which GPUs can run it.

japanese-stablelm-instruct-gamma-7b specs, VRAM requirements, and which GPUs can run it.

k2-merged-3.5T-bf16 specs, VRAM requirements, and which GPUs can run it.

karma-electric-llama31-8b specs, VRAM requirements, and which GPUs can run it.

Karnak specs, VRAM requirements, and which GPUs can run it.

Karnak-40B-v1.0 specs, VRAM requirements, and which GPUs can run it.

KAT-Coder-V2.5-Dev specs, VRAM requirements, and which GPUs can run it.

KD-Tinker specs, VRAM requirements, and which GPUs can run it.

Kimi-K2-Instruct specs, VRAM requirements, and which GPUs can run it.

Kimi-K2-Instruct-0905 specs, VRAM requirements, and which GPUs can run it.

Kimi-K2-Thinking specs, VRAM requirements, and which GPUs can run it.

L3.3-GeneticLemonade-Final-v2-70B specs, VRAM requirements, and which GPUs can run it.

Laguna-S-2.1-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Laguna-XS-2.1 specs, VRAM requirements, and which GPUs can run it.

LFM2-1.2B specs, VRAM requirements, and which GPUs can run it.

LFM2-2.6B specs, VRAM requirements, and which GPUs can run it.

LFM2-24B-A2B specs, VRAM requirements, and which GPUs can run it.

LFM2-24B-A2B-MLX-4bit specs, VRAM requirements, and which GPUs can run it.

LFM2-24B-A2B-MLX-5bit specs, VRAM requirements, and which GPUs can run it.

LFM2-24B-A2B-MLX-6bit specs, VRAM requirements, and which GPUs can run it.

LFM2-24B-A2B-MLX-8bit specs, VRAM requirements, and which GPUs can run it.

LFM2-350M specs, VRAM requirements, and which GPUs can run it.

LFM2-700M specs, VRAM requirements, and which GPUs can run it.

LFM2-8B-A1B specs, VRAM requirements, and which GPUs can run it.

LFM2.5-1.2B-Instruct specs, VRAM requirements, and which GPUs can run it.

LFM2.5-1.2B-Instruct-MLX-4bit specs, VRAM requirements, and which GPUs can run it.

LFM2.5-1.2B-Instruct-MLX-6bit specs, VRAM requirements, and which GPUs can run it.

LFM2.5-1.2B-Instruct-MLX-8bit specs, VRAM requirements, and which GPUs can run it.

LFM2.5-1.2B-Thinking specs, VRAM requirements, and which GPUs can run it.

LFM2.5-2.6B specs, VRAM requirements, and which GPUs can run it.

LFM2.5-230M specs, VRAM requirements, and which GPUs can run it.

LFM2.5-350M specs, VRAM requirements, and which GPUs can run it.

LFM2.5-350M-home-assistant-sft specs, VRAM requirements, and which GPUs can run it.

LFM2.5-8B-A1B specs, VRAM requirements, and which GPUs can run it.

Ling-3.0-flash specs, VRAM requirements, and which GPUs can run it.

Ling-3.0-flash-fp4 specs, VRAM requirements, and which GPUs can run it.

Ling-3.0-flash-int4 specs, VRAM requirements, and which GPUs can run it.

Ling-3.0-tiny specs, VRAM requirements, and which GPUs can run it.

LLaDA-8B-Instruct specs, VRAM requirements, and which GPUs can run it.

Llama 3.1 70B specs, VRAM requirements, and which GPUs can run it. The sweet spot for local reasoning.

Llama 3.1 8B specs, VRAM requirements, and which GPUs can run it. The go-to small model for local inference.

Llama-2-13b-chat-hf specs, VRAM requirements, and which GPUs can run it.

Llama-2-70b-chat-hf specs, VRAM requirements, and which GPUs can run it.

Llama-2-7b-chat-hf specs, VRAM requirements, and which GPUs can run it.

Llama-3_3-Nemotron-Super-49B-v1 specs, VRAM requirements, and which GPUs can run it.

Llama-3_3-Nemotron-Super-49B-v1_5-FP8 specs, VRAM requirements, and which GPUs can run it.

Llama-3_3-Nemotron-Super-49B-v1_5-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Llama-3_3-Nemotron-Super-49B-v1-FP8 specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-405B-Instruct specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-405B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-70B-Instruct specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-70B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-8B-Instruct specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-8B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Nemotron-70B-Instruct-HF specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Nemotron-Nano-4B-v1.1 specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Nemotron-Nano-8B-v1 specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Nemotron-Safety-Guard-8B-v3 specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Tulu-3-405B specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Tulu-3-70B-DPO specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Tulu-3-70B-SFT specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Tulu-3-8B specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Tulu-3-8B-DPO specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Tulu-3-8B-SFT specs, VRAM requirements, and which GPUs can run it.

Llama-3.1-Tulu-3.1-8B specs, VRAM requirements, and which GPUs can run it.

Llama-3.2-1B-Instruct specs, VRAM requirements, and which GPUs can run it.

Llama-3.2-1B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Llama-3.2-1B-Instruct-FP8-dynamic specs, VRAM requirements, and which GPUs can run it.

Llama-3.2-3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Llama-3.3-70B-Instruct specs, VRAM requirements, and which GPUs can run it.

llama-3.3-70b-instruct-awq specs, VRAM requirements, and which GPUs can run it.

Llama-3.3-70B-Instruct-Eagle3 specs, VRAM requirements, and which GPUs can run it.

llama-7b specs, VRAM requirements, and which GPUs can run it.

Llama-Guard-3-1B specs, VRAM requirements, and which GPUs can run it.

Llama-Guard-3-8B specs, VRAM requirements, and which GPUs can run it.

Llama-Guard-3-8B-INT8 specs, VRAM requirements, and which GPUs can run it.

Llama3-ChatQA-1.5-8B specs, VRAM requirements, and which GPUs can run it.

LlamaGuard-7b specs, VRAM requirements, and which GPUs can run it.

llm-jp-3-3.7b-instruct specs, VRAM requirements, and which GPUs can run it.

LocoOperator-4B specs, VRAM requirements, and which GPUs can run it.

lynx-instruct-30b specs, VRAM requirements, and which GPUs can run it.

MagenticBrain specs, VRAM requirements, and which GPUs can run it.

maira-2 specs, VRAM requirements, and which GPUs can run it.

maple-preview specs, VRAM requirements, and which GPUs can run it.

medgemma-27b-text-it specs, VRAM requirements, and which GPUs can run it.

MediPhi specs, VRAM requirements, and which GPUs can run it.

MediPhi-Clinical specs, VRAM requirements, and which GPUs can run it.

MediPhi-Instruct specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3-70B-Instruct specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3-8B-Instruct specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3.1-70B-Instruct specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3.1-8B-Instruct specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3.1-8B-Instruct-AWQ-INT4 specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3.1-8B-Instruct-bnb-4bit specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3.1-8B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3.1-8B-Instruct-FP8-dynamic specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-3.3-70B-Instruct-AWQ-INT4 specs, VRAM requirements, and which GPUs can run it.

Meta-Llama-Guard-2-8B specs, VRAM requirements, and which GPUs can run it.

MiMo-7B-RL specs, VRAM requirements, and which GPUs can run it.

MiMo-V2.5 specs, VRAM requirements, and which GPUs can run it.

MiMo-V2.5-Pro specs, VRAM requirements, and which GPUs can run it.

mini-coder-1.7b specs, VRAM requirements, and which GPUs can run it.

MiniCPM5-1B specs, VRAM requirements, and which GPUs can run it.

MiniMax-M2-AWQ specs, VRAM requirements, and which GPUs can run it.

MiniMax-M2.5 specs, VRAM requirements, and which GPUs can run it.

MiniMax-M2.5-NVFP4 specs, VRAM requirements, and which GPUs can run it.

MiniMax-M2.7-NVFP4 specs, VRAM requirements, and which GPUs can run it.

MiniMax-M3-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Mistral 7B specs, VRAM requirements, and which GPUs can run it. Efficient and fast for everyday tasks.

Mistral-7B-Instruct-v0.1 specs, VRAM requirements, and which GPUs can run it.

Mistral-7B-Instruct-v0.2 specs, VRAM requirements, and which GPUs can run it.

Mistral-Medium-3.5-128B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Mistral-NeMo-Minitron-8B-Instruct specs, VRAM requirements, and which GPUs can run it.

Mistral-Small-24B-Instruct-2501-AWQ specs, VRAM requirements, and which GPUs can run it.

Mixtral-8x7B-Instruct-v0.1-GPTQ specs, VRAM requirements, and which GPUs can run it.

Nanbeige4.1-3B specs, VRAM requirements, and which GPUs can run it.

Nanbeige4.1-3B-heretic specs, VRAM requirements, and which GPUs can run it.

Nanbeige4.2-3B specs, VRAM requirements, and which GPUs can run it.

Nemotron-3-Nano-30B-A3B specs, VRAM requirements, and which GPUs can run it.

Nemotron-Cascade-2-30B-A3B specs, VRAM requirements, and which GPUs can run it.

Nemotron-Cascade-8B specs, VRAM requirements, and which GPUs can run it.

Nemotron-H-4B-Instruct-128K specs, VRAM requirements, and which GPUs can run it.

Nemotron-H-8B-Base-8K specs, VRAM requirements, and which GPUs can run it.

Nemotron-Labs-Diffusion-3B specs, VRAM requirements, and which GPUs can run it.

Nemotron-Labs-Diffusion-3B-Base specs, VRAM requirements, and which GPUs can run it.

Nemotron-Labs-Diffusion-8B specs, VRAM requirements, and which GPUs can run it.

Nemotron-Labs-Diffusion-8B-Base specs, VRAM requirements, and which GPUs can run it.

Nemotron-Orchestrator-8B specs, VRAM requirements, and which GPUs can run it.

NextCoder-14B specs, VRAM requirements, and which GPUs can run it.

NextCoder-32B specs, VRAM requirements, and which GPUs can run it.

NextCoder-7B specs, VRAM requirements, and which GPUs can run it.

nmt_21 specs, VRAM requirements, and which GPUs can run it.

nomos-1 specs, VRAM requirements, and which GPUs can run it.

Nous-Hermes-2-Mistral-7B-DPO specs, VRAM requirements, and which GPUs can run it.

Nous-Hermes-2-Mixtral-8x7B-DPO specs, VRAM requirements, and which GPUs can run it.

Nous-Hermes-2-Mixtral-8x7B-SFT specs, VRAM requirements, and which GPUs can run it.

Nous-Hermes-2-SOLAR-10.7B specs, VRAM requirements, and which GPUs can run it.

Nous-Hermes-2-Yi-34B specs, VRAM requirements, and which GPUs can run it.

NousCoder-14B specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Nano-4B specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Nano-4B-BF16 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Nano-4B-FP8 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Super-120B-A12B-BF16 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Super-120B-A12B-FP8 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-3.5-Lightning-30B-A3B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-Nano-12B-v2 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-Nano-9B-v2 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-Nano-9B-v2-FP8 specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-Nano-9B-v2-Japanese specs, VRAM requirements, and which GPUs can run it.

NVIDIA-Nemotron-Nano-9B-v2-NVFP4 specs, VRAM requirements, and which GPUs can run it.

OLMo-2-0325-32B-Instruct specs, VRAM requirements, and which GPUs can run it.

OLMo-2-0425-1B-Instruct specs, VRAM requirements, and which GPUs can run it.

OLMo-2-0425-1B-RLVR1 specs, VRAM requirements, and which GPUs can run it.

OLMo-2-1124-13B-DPO specs, VRAM requirements, and which GPUs can run it.

OLMo-2-1124-13B-Instruct specs, VRAM requirements, and which GPUs can run it.

OLMo-2-1124-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

Olmo-3-32B-Think specs, VRAM requirements, and which GPUs can run it.

Olmo-3-32B-Think-DPO specs, VRAM requirements, and which GPUs can run it.

Olmo-3-32B-Think-SFT specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-Instruct-DPO specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-Instruct-SFT specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-RL-Zero-General specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-RL-Zero-Math specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-RL-Zero-Mix specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-Think specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-Think-DPO specs, VRAM requirements, and which GPUs can run it.

Olmo-3-7B-Think-SFT specs, VRAM requirements, and which GPUs can run it.

Olmo-3.1-32B-Instruct specs, VRAM requirements, and which GPUs can run it.

Olmo-3.1-32B-Instruct-DPO specs, VRAM requirements, and which GPUs can run it.

Olmo-3.1-32B-Think specs, VRAM requirements, and which GPUs can run it.

Olmo-3.1-7B-RL-Zero-Code specs, VRAM requirements, and which GPUs can run it.

Olmo-3.1-7B-RL-Zero-Math specs, VRAM requirements, and which GPUs can run it.

OLMo-7B-0724-Instruct-hf specs, VRAM requirements, and which GPUs can run it.

OLMo-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

OLMo-7B-Instruct-hf specs, VRAM requirements, and which GPUs can run it.

OLMo-7B-SFT-hf specs, VRAM requirements, and which GPUs can run it.

Olmo-Hybrid-Instruct-DPO-7B specs, VRAM requirements, and which GPUs can run it.

Olmo-Hybrid-Instruct-SFT-7B specs, VRAM requirements, and which GPUs can run it.

Olmo-Hybrid-Think-SFT-7B specs, VRAM requirements, and which GPUs can run it.

OLMoE-1B-7B-0125-DPO specs, VRAM requirements, and which GPUs can run it.

OLMoE-1B-7B-0125-Instruct specs, VRAM requirements, and which GPUs can run it.

OLMoE-1B-7B-0924-Instruct specs, VRAM requirements, and which GPUs can run it.

OpenELM-1_1B-Instruct specs, VRAM requirements, and which GPUs can run it.

OpenReasoning-Nemotron-1.5B specs, VRAM requirements, and which GPUs can run it.

OpenReasoning-Nemotron-32B specs, VRAM requirements, and which GPUs can run it.

OptiMind-SFT specs, VRAM requirements, and which GPUs can run it.

Ornith-1.0-35B specs, VRAM requirements, and which GPUs can run it.

Ornith-1.0-35B-FP8 specs, VRAM requirements, and which GPUs can run it.

Ornith-1.0-397B-FP8 specs, VRAM requirements, and which GPUs can run it.

Ornith-1.0-9B specs, VRAM requirements, and which GPUs can run it.

OTel-2.0-LLM-31B-IT specs, VRAM requirements, and which GPUs can run it.

OTel-LLM-1B-IT specs, VRAM requirements, and which GPUs can run it.

OTel-LLM-270M-IT specs, VRAM requirements, and which GPUs can run it.

Phi-3-medium-128k-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3-medium-4k-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3-mini-128k-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3-mini-4k-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3-mini-4k-instruct-gptq-4bit specs, VRAM requirements, and which GPUs can run it.

Phi-3-small-128k-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3-small-8k-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3-vision-128k-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3.5-mini-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-3.5-MoE-instruct specs, VRAM requirements, and which GPUs can run it.

phi-4 specs, VRAM requirements, and which GPUs can run it.

Phi-4-mini-flash-reasoning specs, VRAM requirements, and which GPUs can run it.

Phi-4-mini-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-4-reasoning specs, VRAM requirements, and which GPUs can run it.

Phi-4-reasoning-plus specs, VRAM requirements, and which GPUs can run it.

Phi-mini-MoE-instruct specs, VRAM requirements, and which GPUs can run it.

Phi-tiny-MoE-instruct specs, VRAM requirements, and which GPUs can run it.

Qwen 2.5 72B specs, VRAM requirements, and which GPUs can run it. Strong on benchmarks, competitive with Llama 70B.

Qwen 2.5 72B specs, VRAM requirements, and which GPUs can run it.

Qwen 2.5 72B Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen1.5-110B-Chat-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen2 72B specs, VRAM requirements, and which GPUs can run it.

Qwen2 72B Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2-0.5B specs, VRAM requirements, and which GPUs can run it.

Qwen2-0.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2-1.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2-5 72B Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-0.5B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-0.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-1.5B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-1.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-1.5B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-1.5B-quantized.w8a8 specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-14B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-14B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-32B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-32B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-32B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-32B-Instruct-GPTQ-Int4 specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-3B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-72B-Instruct-abliterated specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-72B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-7B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-0.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-1.5B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-1.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-14B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-32B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-32B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-3B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-7B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-7B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-7B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Coder-7B-Instruct-GPTQ-Int4 specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Math-1.5B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Math-1.5B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-Math-7B specs, VRAM requirements, and which GPUs can run it.

Qwen2.5-VL-7B-Instruct-NVFP4 specs, VRAM requirements, and which GPUs can run it.

qwen27B-Agent-R2-abliterated-preview specs, VRAM requirements, and which GPUs can run it.

Qwen3-0.6B specs, VRAM requirements, and which GPUs can run it.

Qwen3-0.6B-Base specs, VRAM requirements, and which GPUs can run it.

Qwen3-0.6B-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-1.7B specs, VRAM requirements, and which GPUs can run it.

Qwen3-1.7B-Base specs, VRAM requirements, and which GPUs can run it.

Qwen3-1.7B-GPTQ-Int8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-14B specs, VRAM requirements, and which GPUs can run it.

Qwen3-14B-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen3-14B-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-14B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen3-14B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3-235B-A22B specs, VRAM requirements, and which GPUs can run it.

Qwen3-235B-A22B-Instruct-2507-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-235B-A22B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3-235B-A22B-Thinking-2507-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3-30B-A3B specs, VRAM requirements, and which GPUs can run it.

Qwen3-30B-A3B-Instruct-2507 specs, VRAM requirements, and which GPUs can run it.

Qwen3-30B-A3B-Instruct-2507-AWQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3-30B-A3B-Instruct-2507-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-30B-A3B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3-30B-A3B-Thinking-2507 specs, VRAM requirements, and which GPUs can run it.

Qwen3-32B specs, VRAM requirements, and which GPUs can run it.

Qwen3-32B-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen3-32B-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-32B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B-Base specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B-Instruct-2507 specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B-Instruct-2507-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B-Instruct-2507-unsloth-bnb-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B-SafeRL specs, VRAM requirements, and which GPUs can run it.

Qwen3-4B-Thinking-2507 specs, VRAM requirements, and which GPUs can run it.

Qwen3-8B specs, VRAM requirements, and which GPUs can run it.

Qwen3-8B-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen3-8B-Base specs, VRAM requirements, and which GPUs can run it.

Qwen3-8B-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-8B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-30B-A3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-30B-A3B-Instruct-AWQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-30B-A3B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-30B-A3B-Instruct-gptq-8bit specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-480B-A35B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-Next specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-Next-8bit specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-Next-AWQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-Next-Base specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-Next-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-Coder-Next-FP8-dynamic specs, VRAM requirements, and which GPUs can run it.

Qwen3-Nemotron-235B-A22B-GenRM specs, VRAM requirements, and which GPUs can run it.

Qwen3-Next-80B-A3B-Instruct specs, VRAM requirements, and which GPUs can run it.

Qwen3-Next-80B-A3B-Instruct-AWQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3-Next-80B-A3B-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-Next-80B-A3B-Thinking-FP8 specs, VRAM requirements, and which GPUs can run it.

Qwen3-VL-30B-A3B-Instruct-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-0.8B-OptiQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-122B-A10B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled-v2 specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-27B-Text-NVFP4-MTP specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-35B-A3B-Text-qx64-hi-mlx specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-4B-OptiQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-4B-Safety-Thinking specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-9B-abliterated specs, VRAM requirements, and which GPUs can run it.

Qwen3.5-9B-OptiQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16 specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-AEON-Ultimate-Uncensored-BF16-mlx-2Bit specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-AEON-Ultimate-Uncensored-Multimodal-NVFP4-MTP specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-AEON-Ultimate-Uncensored-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-AEON-Ultimate-Uncensored-Text-NVFP4-MTP-XS specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27b-gptq-int4 specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-OptiQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-27B-Text-NVFP4-MTP specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-35B-A3B-abliterated-v4 specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-35B-A3B-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3.6-35B-A3B-OptiQ-4bit specs, VRAM requirements, and which GPUs can run it.

Qwen3.8-27B-MTP-NVFP4 specs, VRAM requirements, and which GPUs can run it.

Qwen3Guard-Gen-0.6B specs, VRAM requirements, and which GPUs can run it.

Qwen3Guard-Gen-4B specs, VRAM requirements, and which GPUs can run it.

Qwen3Guard-Gen-8B specs, VRAM requirements, and which GPUs can run it.

QwQ-32B-AWQ specs, VRAM requirements, and which GPUs can run it.

Qwythos-9B-v2 specs, VRAM requirements, and which GPUs can run it.

recurrentgemma-2b-it specs, VRAM requirements, and which GPUs can run it.

recurrentgemma-9b-it specs, VRAM requirements, and which GPUs can run it.

Ring-2.5-1T specs, VRAM requirements, and which GPUs can run it.

Rio-3.0-Open specs, VRAM requirements, and which GPUs can run it.

Rio-3.0-Open-Mini specs, VRAM requirements, and which GPUs can run it.

Riva-Translate-4B-Instruct-v1.1 specs, VRAM requirements, and which GPUs can run it.

RnJ-1-Instruct-FP8 specs, VRAM requirements, and which GPUs can run it.

saiga_llama3_8b specs, VRAM requirements, and which GPUs can run it.

sarvam-105b-uncensored specs, VRAM requirements, and which GPUs can run it.

shieldgemma-27b specs, VRAM requirements, and which GPUs can run it.

shieldgemma-2b specs, VRAM requirements, and which GPUs can run it.

shieldgemma-9b specs, VRAM requirements, and which GPUs can run it.

SmolLM-1.7B-Instruct-quantized.w4a16 specs, VRAM requirements, and which GPUs can run it.

SmolLM-135M-Instruct specs, VRAM requirements, and which GPUs can run it.

SmolLM2-135M-Instruct specs, VRAM requirements, and which GPUs can run it.

SmolLM2-360M-Instruct specs, VRAM requirements, and which GPUs can run it.

SOLAR-10.7B-Instruct-v1.0 specs, VRAM requirements, and which GPUs can run it.

Solar-Open-100B specs, VRAM requirements, and which GPUs can run it.

Solar-Open-100B-NVFP4A16 specs, VRAM requirements, and which GPUs can run it.

Solar-Open2-250B specs, VRAM requirements, and which GPUs can run it.

solar-pro-preview-instruct specs, VRAM requirements, and which GPUs can run it.

stable-code-instruct-3b specs, VRAM requirements, and which GPUs can run it.

stablelm-2-1_6b-chat specs, VRAM requirements, and which GPUs can run it.

stablelm-2-12b-chat specs, VRAM requirements, and which GPUs can run it.

stablelm-2-zephyr-1_6b specs, VRAM requirements, and which GPUs can run it.

stablelm-zephyr-3b specs, VRAM requirements, and which GPUs can run it.

Starling-LM-7B-beta specs, VRAM requirements, and which GPUs can run it.

Step-3.5-Flash specs, VRAM requirements, and which GPUs can run it.

Step-3.5-Flash-FP8 specs, VRAM requirements, and which GPUs can run it.

step3 specs, VRAM requirements, and which GPUs can run it.

Strand-Rust-Coder-14B-v1 specs, VRAM requirements, and which GPUs can run it.

Ternary-Bonsai-27B-mlx-2bit specs, VRAM requirements, and which GPUs can run it.

tiny-aya-global specs, VRAM requirements, and which GPUs can run it.

TinyLlama-1.1B-Chat-v0.3-GPTQ specs, VRAM requirements, and which GPUs can run it.

TinyLlama-1.1B-Chat-v1.0 specs, VRAM requirements, and which GPUs can run it.

tulu-2-dpo-13b specs, VRAM requirements, and which GPUs can run it.

tulu-2-dpo-70b specs, VRAM requirements, and which GPUs can run it.

Turkish-Gemma-9b-T1 specs, VRAM requirements, and which GPUs can run it.

txgemma-27b-chat specs, VRAM requirements, and which GPUs can run it.

txgemma-9b-chat specs, VRAM requirements, and which GPUs can run it.

typhoon2.5-qwen3-4b specs, VRAM requirements, and which GPUs can run it.

Unsloth Llama 3 8B Instruct specs, VRAM requirements, and which GPUs can run it.

UserLM-8b specs, VRAM requirements, and which GPUs can run it.

VLM2Vec-Full specs, VRAM requirements, and which GPUs can run it.

Yi-1.5-34B-Chat specs, VRAM requirements, and which GPUs can run it.

Yi-1.5-34B-Chat-16K specs, VRAM requirements, and which GPUs can run it.

Yi-1.5-6B-Chat specs, VRAM requirements, and which GPUs can run it.

Yi-1.5-9B-Chat specs, VRAM requirements, and which GPUs can run it.

Yi-1.5-9B-Chat-16K specs, VRAM requirements, and which GPUs can run it.

Yi-34B-Chat specs, VRAM requirements, and which GPUs can run it.

Yi-34B-Chat specs, VRAM requirements, and which GPUs can run it.

Yi-34B-Chat-8bits specs, VRAM requirements, and which GPUs can run it.

Yi-6B-Chat specs, VRAM requirements, and which GPUs can run it.

Yi-6B-Chat-4bits specs, VRAM requirements, and which GPUs can run it.

Yi-Coder-1.5B-Chat specs, VRAM requirements, and which GPUs can run it.

Yi-Coder-9B-Chat specs, VRAM requirements, and which GPUs can run it.

zephyr-7b-alpha specs, VRAM requirements, and which GPUs can run it.

zephyr-7b-beta specs, VRAM requirements, and which GPUs can run it.

zephyr-7b-gemma-sft-v0.1 specs, VRAM requirements, and which GPUs can run it.

zephyr-7b-gemma-v0.1 specs, VRAM requirements, and which GPUs can run it.

zephyr-orpo-141b-A35b-v0.1 specs, VRAM requirements, and which GPUs can run it.