# Can I run it? GPU requirements for open models

The GPU memory each popular open model needs, the GPUs it fits on and what they cost by the hour. Check any other model on Hugging Face with `GET /v1/models/fit?model=owner/name` (no token).

## Popular open models

| Model | Parameters | 16-bit | 4-bit |
|---|---|---|---|
| [Qwen3-14B](/models/qwen/qwen3-14b.html.md) | `15B` | 35 GB: one [L40S](/gpus/l40s.html.md), [RTX 6000 Ada](/gpus/rtx-6000-ada.html.md) or [RTX A6000](/gpus/rtx-a6000.html.md), L40S from $0.44 per GPU-hour | 8.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-4B](/models/qwen/qwen3-4b.html.md) | `4.0B` | 9.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [gemma-4-31B-it](/models/google/gemma-4-31b-it.html.md) | `31B` | 75 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-8B](/models/qwen/qwen3-8b.html.md) | `8.2B` | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.8-27B](/models/qwen/qwen3.8-27b.html.md) | `28B` | 67 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 17 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.5-4B](/models/qwen/qwen3.5-4b.html.md) | `4.7B` | 11 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-VL-8B-Instruct](/models/qwen/qwen3-vl-8b-instruct.html.md) | `8.8B` | 21 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 5.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.5-9B](/models/qwen/qwen3.5-9b.html.md) | `9.7B` | 23 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 5.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [GLM-5.3-Flash](/models/zai-org/glm-5.3-flash.html.md) | `321B` | 771 GB: 4 × [B300](/gpus/b300.html.md), from $18.40 per hour for all 4 | 193 GB: one [B300](/gpus/b300.html.md), from $4.60 per GPU-hour |
| [gemma-4-26B-A4B-it](/models/google/gemma-4-26b-a4b-it.html.md) | `26B` | 62 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 15 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-V3.2](/models/deepseek-ai/deepseek-v3.2.html.md) | `685B` | 1,645 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 411 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |
| [gpt-oss-20b](/models/openai/gpt-oss-20b.html.md) | `21B` | 50 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 13 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-VL-7B-Instruct](/models/qwen/qwen2.5-vl-7b-instruct.html.md) | `8.3B` | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 5.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-7B-Instruct](/models/qwen/qwen2.5-7b-instruct.html.md) | `7.6B` | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.6-35B-A3B](/models/qwen/qwen3.6-35b-a3b.html.md) | `36B` | 86 GB: one [RTX PRO 6000](/gpus/rtx-pro-6000.html.md), from $1.90 per GPU-hour | 22 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Llama-3.1-8B-Instruct](/models/meta-llama/llama-3.1-8b-instruct.html.md) | `8.0B` | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-1.5B-Instruct](/models/qwen/qwen2.5-1.5b-instruct.html.md) | `1.5B` | 3.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-VL-4B-Instruct](/models/qwen/qwen3-vl-4b-instruct.html.md) | `4.4B` | 11 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-1.7B](/models/qwen/qwen3-1.7b.html.md) | `2.0B` | 4.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.2 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.8-Flash-Next](/models/qwen/qwen3.8-flash-next.html.md) | `180B` | 432 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 | 108 GB: one [H200](/gpus/h200.html.md), from $4.03 per GPU-hour |
| [Unlimited-OCR](/models/baidu/unlimited-ocr.html.md) | `3.3B` | 8.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.5-2B](/models/qwen/qwen3.5-2b.html.md) | `2.3B` | 5.5 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-V4-Flash-0731](/models/deepseek-ai/deepseek-v4-flash-0731.html.md) | `304B` | 730 GB: 4 × [B300](/gpus/b300.html.md), from $18.40 per hour for all 4 | 183 GB: one [B300](/gpus/b300.html.md), from $4.60 per GPU-hour |
| [Qwen2.5-3B-Instruct](/models/qwen/qwen2.5-3b-instruct.html.md) | `3.1B` | 7.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-32B](/models/qwen/qwen3-32b.html.md) | `33B` | 79 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [gpt-oss-120b](/models/openai/gpt-oss-120b.html.md) | `117B` | 280 GB: 2 × [H200](/gpus/h200.html.md), from $8.06 per hour for all 2 | 70 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour |
| [Qwen3-4B-Instruct-2507](/models/qwen/qwen3-4b-instruct-2507.html.md) | `4.0B` | 9.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [GLM-5.3](/models/zai-org/glm-5.3.html.md) | `753B` | 1,808 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 452 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |
| [Llama-3.2-1B-Instruct](/models/meta-llama/llama-3.2-1b-instruct.html.md) | `1.2B` | 3.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.6-27B](/models/qwen/qwen3.6-27b.html.md) | `28B` | 67 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 17 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-OCR](/models/deepseek-ai/deepseek-ocr.html.md) | `3.3B` | 8.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-V4.1-Flash](/models/deepseek-ai/deepseek-v4.1-flash.html.md) | `763B` | 1,832 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 458 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |
| [Qwen2.5-Coder-14B-Instruct](/models/qwen/qwen2.5-coder-14b-instruct.html.md) | `15B` | 35 GB: one [L40S](/gpus/l40s.html.md), [RTX 6000 Ada](/gpus/rtx-6000-ada.html.md) or [RTX A6000](/gpus/rtx-a6000.html.md), L40S from $0.44 per GPU-hour | 8.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [NVIDIA-Nemotron-3-Nano-4B-BF16](/models/nvidia/nvidia-nemotron-3-nano-4b-bf16.html.md) | `4.0B` | 9.5 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.5-27B](/models/qwen/qwen3.5-27b.html.md) | `28B` | 67 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 17 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [NVIDIA-Nemotron-3-Nano-30B-A3B-BF16](/models/nvidia/nvidia-nemotron-3-nano-30b-a3b-bf16.html.md) | `32B` | 76 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Mistral-7B-Instruct-v0.2](/models/mistralai/mistral-7b-instruct-v0.2.html.md) | `7.2B` | 17 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.5-35B-A3B](/models/qwen/qwen3.5-35b-a3b.html.md) | `36B` | 86 GB: one [RTX PRO 6000](/gpus/rtx-pro-6000.html.md), from $1.90 per GPU-hour | 22 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-R1](/models/deepseek-ai/deepseek-r1.html.md) | `684B` | 1,643 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 411 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |
| [DeepSeek-V3](/models/deepseek-ai/deepseek-v3.html.md) | `684B` | 1,643 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 411 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |
| [GLM-5](/models/zai-org/glm-5.html.md) | `754B` | 1,809 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 452 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |
| [Qwen2.5-VL-3B-Instruct](/models/qwen/qwen2.5-vl-3b-instruct.html.md) | `3.8B` | 9.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-Coder-7B-Instruct](/models/qwen/qwen2.5-coder-7b-instruct.html.md) | `7.6B` | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-VL-2B-Instruct](/models/qwen/qwen3-vl-2b-instruct.html.md) | `2.1B` | 5.1 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16](/models/nvidia/nvidia-nemotron-3-ultra-550b-a55b-bf16.html.md) | `561B` | 1,345 GB: 8 × [B200](/gpus/b200.html.md), from $54.32 per hour for all 8 | 336 GB: 2 × [B200](/gpus/b200.html.md), from $13.58 per hour for all 2 |
| [MiniMax-M2.5](/models/minimaxai/minimax-m2.5.html.md) | `229B` | 549 GB: 4 × [H200](/gpus/h200.html.md), from $16.12 per hour for all 4 | 137 GB: one [H200](/gpus/h200.html.md), from $4.03 per GPU-hour |
| [Hy3](/models/tencent/hy3.html.md) | `299B` | 717 GB: 4 × [B200](/gpus/b200.html.md), from $27.16 per hour for all 4 | 179 GB: one [B200](/gpus/b200.html.md), from $6.79 per GPU-hour |
| [GLM-4.5-Air](/models/zai-org/glm-4.5-air.html.md) | `110B` | 265 GB: 2 × [H200](/gpus/h200.html.md), from $8.06 per hour for all 2 | 66 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour |
| [NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16](/models/nvidia/nvidia-nemotron-3.5-lightning-30b-a3b-bf16.html.md) | `32B` | 76 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [NVIDIA-Nemotron-3-Super-120B-A12B-BF16](/models/nvidia/nvidia-nemotron-3-super-120b-a12b-bf16.html.md) | `124B` | 297 GB: 4 × [H100](/gpus/h100.html.md), from $6.60 per hour for all 4 | 74 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour |
| [MiniCPM5-2B](/models/openbmb/minicpm5-2b.html.md) | `2.5B` | 6.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.5 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-30B-A3B-Instruct-2507](/models/qwen/qwen3-30b-a3b-instruct-2507.html.md) | `31B` | 73 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Llama-3.2-3B-Instruct](/models/meta-llama/llama-3.2-3b-instruct.html.md) | `3.2B` | 7.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-32B-Instruct](/models/qwen/qwen2.5-32b-instruct.html.md) | `33B` | 79 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2-VL-2B-Instruct](/models/qwen/qwen2-vl-2b-instruct.html.md) | `2.2B` | 5.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3.5-122B-A10B](/models/qwen/qwen3.5-122b-a10b.html.md) | `125B` | 300 GB: 4 × [H100](/gpus/h100.html.md), from $6.60 per hour for all 4 | 75 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour |
| [Qwen3-30B-A3B](/models/qwen/qwen3-30b-a3b.html.md) | `31B` | 73 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [GLM-5.1](/models/zai-org/glm-5.1.html.md) | `754B` | 1,809 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 452 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |
| [DeepSeek-V4-Flash](/models/deepseek-ai/deepseek-v4-flash.html.md) | `291B` | 698 GB: 4 × [B200](/gpus/b200.html.md), from $27.16 per hour for all 4 | 175 GB: one [B200](/gpus/b200.html.md), from $6.79 per GPU-hour |
| [Qwen3.5-397B-A17B](/models/qwen/qwen3.5-397b-a17b.html.md) | `403B` | 968 GB: 4 × [B300](/gpus/b300.html.md), from $18.40 per hour for all 4 | 242 GB: one [B300](/gpus/b300.html.md), from $4.60 per GPU-hour |
| [GLM-4.7-Flash](/models/zai-org/glm-4.7-flash.html.md) | `31B` | 75 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [gemma-3-4b-it](/models/google/gemma-3-4b-it.html.md) | `4.3B` | 10 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-Coder-30B-A3B-Instruct](/models/qwen/qwen3-coder-30b-a3b-instruct.html.md) | `31B` | 73 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-VL-32B-Instruct](/models/qwen/qwen2.5-vl-32b-instruct.html.md) | `33B` | 80 GB: one [RTX PRO 6000](/gpus/rtx-pro-6000.html.md), from $1.90 per GPU-hour | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Kimi-K3](/models/moonshotai/kimi-k3.html.md) | `2.8T` | 6,672 GB: more than one 8-GPU machine | 1,668 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 |
| [Qwen2.5-14B-Instruct](/models/qwen/qwen2.5-14b-instruct.html.md) | `15B` | 35 GB: one [L40S](/gpus/l40s.html.md), [RTX 6000 Ada](/gpus/rtx-6000-ada.html.md) or [RTX A6000](/gpus/rtx-a6000.html.md), L40S from $0.44 per GPU-hour | 8.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-R1-Distill-Qwen-1.5B](/models/deepseek-ai/deepseek-r1-distill-qwen-1.5b.html.md) | `1.8B` | 4.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.1 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [HunyuanOCR](/models/tencent/hunyuanocr.html.md) | `1.1B` | 2.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [InternVL2-1B](/models/opengvlab/internvl2-1b.html.md) | `0.9B` | 2.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [gemma-3-1b-it](/models/google/gemma-3-1b-it.html.md) | `1.0B` | 2.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [SmolLM3-3B](/models/huggingfacetb/smollm3-3b.html.md) | `3.1B` | 7.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-1.5B](/models/qwen/qwen2.5-1.5b.html.md) | `1.5B` | 3.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [diffusiongemma-26B-A4B-it](/models/google/diffusiongemma-26b-a4b-it.html.md) | `26B` | 62 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 15 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [InternVL3_5-GPT-OSS-20B-A4B-Preview-HF](/models/opengvlab/internvl3_5-gpt-oss-20b-a4b-preview-hf.html.md) | `21B` | 51 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 13 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Cosmos-Reason2-2B](/models/nvidia/cosmos-reason2-2b.html.md) | `2.4B` | 5.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.5 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Llama-3.1-8B](/models/meta-llama/llama-3.1-8b.html.md) | `8.0B` | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2-VL-7B-Instruct](/models/qwen/qwen2-vl-7b-instruct.html.md) | `8.3B` | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 5.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [granite-4.1-3b](/models/ibm-granite/granite-4.1-3b.html.md) | `3.4B` | 8.2 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-4B-Thinking-2507](/models/qwen/qwen3-4b-thinking-2507.html.md) | `4.0B` | 9.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-7B](/models/qwen/qwen2.5-7b.html.md) | `7.6B` | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Llama-3.2-1B](/models/meta-llama/llama-3.2-1b.html.md) | `1.2B` | 3.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-Coder-32B-Instruct](/models/qwen/qwen2.5-coder-32b-instruct.html.md) | `33B` | 79 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-OCR-2](/models/deepseek-ai/deepseek-ocr-2.html.md) | `3.4B` | 8.1 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Hermes-3-Llama-3.1-8B](/models/nousresearch/hermes-3-llama-3.1-8b.html.md) | `8.0B` | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Mistral-7B-v0.1](/models/mistralai/mistral-7b-v0.1.html.md) | `7.2B` | 17 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-Coder-1.5B-Instruct](/models/qwen/qwen2.5-coder-1.5b-instruct.html.md) | `1.5B` | 3.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-Coder-3B-Instruct](/models/qwen/qwen2.5-coder-3b-instruct.html.md) | `3.1B` | 7.4 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-Coder-Next](/models/qwen/qwen3-coder-next.html.md) | `80B` | 191 GB: one [B300](/gpus/b300.html.md), from $4.60 per GPU-hour | 48 GB: one [L40S](/gpus/l40s.html.md), [RTX 6000 Ada](/gpus/rtx-6000-ada.html.md) or [RTX A6000](/gpus/rtx-a6000.html.md), L40S from $0.44 per GPU-hour |
| [Qwen3-VL-30B-A3B-Instruct](/models/qwen/qwen3-vl-30b-a3b-instruct.html.md) | `31B` | 75 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Kimi-K2.5](/models/moonshotai/kimi-k2.5.html.md) | `1.0T` | 2,465 GB: more than one 8-GPU machine | 616 GB: 8 × [H100](/gpus/h100.html.md), from $13.20 per hour for all 8 |
| [medgemma-4b-it](/models/google/medgemma-4b-it.html.md) | `4.3B` | 10 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-Coder-7B](/models/qwen/qwen2.5-coder-7b.html.md) | `7.6B` | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Apertus-8B-Instruct-2509](/models/swiss-ai/apertus-8b-instruct-2509.html.md) | `8.1B` | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Phi-3.5-mini-instruct](/models/microsoft/phi-3.5-mini-instruct.html.md) | `3.8B` | 9.2 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [LocateAnything-3B](/models/nvidia/locateanything-3b.html.md) | `3.8B` | 9.2 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [phi-4](/models/microsoft/phi-4.html.md) | `15B` | 35 GB: one [L40S](/gpus/l40s.html.md), [RTX 6000 Ada](/gpus/rtx-6000-ada.html.md) or [RTX A6000](/gpus/rtx-a6000.html.md), L40S from $0.44 per GPU-hour | 8.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen2.5-Coder-1.5B](/models/qwen/qwen2.5-coder-1.5b.html.md) | `1.5B` | 3.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Llama-3.3-70B-Instruct](/models/meta-llama/llama-3.3-70b-instruct.html.md) | `71B` | 169 GB: one [B200](/gpus/b200.html.md), from $6.79 per GPU-hour | 42 GB: one [L40S](/gpus/l40s.html.md), [RTX 6000 Ada](/gpus/rtx-6000-ada.html.md) or [RTX A6000](/gpus/rtx-a6000.html.md), L40S from $0.44 per GPU-hour |
| [DeepSeek-V4-Pro](/models/deepseek-ai/deepseek-v4-pro.html.md) | `1.6T` | 3,837 GB: more than one 8-GPU machine | 959 GB: 4 × [B300](/gpus/b300.html.md), from $18.40 per hour for all 4 |
| [MiniCPM-V-4.7-35B-A3B](/models/openbmb/minicpm-v-4.7-35b-a3b.html.md) | `35B` | 85 GB: one [RTX PRO 6000](/gpus/rtx-pro-6000.html.md), from $1.90 per GPU-hour | 21 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [MiniMax-M2.7](/models/minimaxai/minimax-m2.7.html.md) | `229B` | 549 GB: 4 × [H200](/gpus/h200.html.md), from $16.12 per hour for all 4 | 137 GB: one [H200](/gpus/h200.html.md), from $4.03 per GPU-hour |
| [Phi-3.5-vision-instruct](/models/microsoft/phi-3.5-vision-instruct.html.md) | `4.1B` | 10.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.5 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-R1-Distill-Qwen-32B](/models/deepseek-ai/deepseek-r1-distill-qwen-32b.html.md) | `33B` | 79 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-R1-0528-Qwen3-8B](/models/deepseek-ai/deepseek-r1-0528-qwen3-8b.html.md) | `8.2B` | 20 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.9 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Qwen3-235B-A22B](/models/qwen/qwen3-235b-a22b.html.md) | `235B` | 564 GB: 8 × [H100](/gpus/h100.html.md), from $13.20 per hour for all 8 | 141 GB: one [B200](/gpus/b200.html.md), from $6.79 per GPU-hour |
| [Phi-4-mini-instruct](/models/microsoft/phi-4-mini-instruct.html.md) | `3.8B` | 9.2 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [gemma-3-12b-it](/models/google/gemma-3-12b-it.html.md) | `12B` | 29 GB: one [RTX 5090](/gpus/rtx-5090.html.md), from $0.58 per GPU-hour | 7.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [gemma-3-27b-it](/models/google/gemma-3-27b-it.html.md) | `27B` | 66 GB: one [H100](/gpus/h100.html.md) or [A100](/gpus/a100.html.md), H100 from $1.65 per GPU-hour | 16 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [phi-2](/models/microsoft/phi-2.html.md) | `2.8B` | 6.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Llama-2-7b-hf](/models/meta-llama/llama-2-7b-hf.html.md) | `6.7B` | 16 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.0 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [granite-3.3-2b-instruct](/models/ibm-granite/granite-3.3-2b-instruct.html.md) | `2.5B` | 6.1 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 1.5 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Phi-3-mini-4k-instruct](/models/microsoft/phi-3-mini-4k-instruct.html.md) | `3.8B` | 9.2 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.3 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [EXAONE-3.5-7.8B-Instruct](/models/lgai-exaone/exaone-3.5-7.8b-instruct.html.md) | `7.8B` | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.7 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Kimi-K2-Instruct](/models/moonshotai/kimi-k2-instruct.html.md) | `1.0T` | 2,463 GB: more than one 8-GPU machine | 616 GB: 8 × [H100](/gpus/h100.html.md), from $13.20 per hour for all 8 |
| [DeepSeek-R1-Distill-Qwen-7B](/models/deepseek-ai/deepseek-r1-distill-qwen-7b.html.md) | `7.6B` | 18 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [Meta-Llama-3-8B-Instruct](/models/meta-llama/meta-llama-3-8b-instruct.html.md) | `8.0B` | 19 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.8 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [gemma-3-4b-pt](/models/google/gemma-3-4b-pt.html.md) | `4.3B` | 10 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 2.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [deepseek-coder-7b-instruct-v1.5](/models/deepseek-ai/deepseek-coder-7b-instruct-v1.5.html.md) | `6.9B` | 17 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 4.1 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [MiniCPM5-1B](/models/openbmb/minicpm5-1b.html.md) | `1.1B` | 2.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour | 0.6 GB: one [RTX 4090](/gpus/rtx-4090.html.md) or [RTX 3090](/gpus/rtx-3090.html.md), RTX 3090 from $0.19 per GPU-hour |
| [DeepSeek-V3-0324](/models/deepseek-ai/deepseek-v3-0324.html.md) | `685B` | 1,643 GB: 8 × [B300](/gpus/b300.html.md), from $36.80 per hour for all 8 | 411 GB: 2 × [B300](/gpus/b300.html.md), from $9.20 per hour for all 2 |

## Questions

**How do you work out the memory a model needs?** Its parameter count, from its files on Hugging Face, times the bytes each parameter takes: 2 in 16-bit, 1 in 8-bit and half a byte in 4-bit. Serving adds about 20% for the KV cache and activations; long contexts and large batches need more. The GPU memory guide has the rules, and the memory fine-tuning takes.

**Why does a mixture-of-experts model need memory for all its parameters?** Each token uses only a few experts, but any token can need any expert, so all of them stay in GPU memory. Fewer active parameters make it faster, not smaller.

**Can I check a model that is not listed here?** Yes. Paste any model's name or link from Hugging Face into the check at the top of this page. Gated models work too: their parameter count is public.

**How do I deploy a model on Arrakis?** Open Models in the console, paste the model's name, choose vLLM, SGLang or llama.cpp and rent a GPU it fits on. You get an OpenAI-compatible endpoint with its own API key, and root SSH to the machine.