Arrakis / Models / Qwen3.5-122B-A10B
Qwen3.5-122B-A10B GPU requirements
Qwen3.5-122B-A10B has 125B parameters. To serve it, plan for about 300 GB of GPU memory in 16-bit, 150 GB in 8-bit or 75 GB in 4-bit, including about 20% for the KV cache and activations.
It is a mixture of experts: 256 experts, 8 of them active for each token. All of them stay in GPU memory, so plan memory for all 125B parameters.
What it takes to serve it
GPU memory to run it for inference, with the smallest GPU setup that holds it and the lowest price on Arrakis right now.
| Precision | Memory and the smallest setup |
|---|---|
| 16-bit | 300 GB: 4 × H100, from $9.00 per hour for all 4 |
| 8-bit | 150 GB: one B200, from $6.79 per GPU-hour |
| 4-bit | 75 GB: one H100 or A100, H100 from $2.25 per GPU-hour |
What it takes to fine-tune it
QLoRA trains adapters on a 4-bit frozen model, LoRA on a 16-bit one, and full fine-tuning updates every weight. Figures are before activations, which grow with batch size and sequence length.
| Method | Memory and the smallest setup |
|---|---|
| QLoRA | 88 GB: one RTX PRO 6000, from $1.90 per GPU-hour |
| LoRA | 300 GB: 4 × H100, from $9.00 per hour for all 4 |
| Full fine-tuning | 2,001 GB: 8 × B300, from $36.80 per hour for all 8 |
About the model
From its card and files on Hugging Face. Memory figures here follow the GPU memory guide.
- Parameters
- 125B
- Active for each token
- 10B
- Experts
- 256
- Experts for each token
- 8
- Context window (tokens)
- 262,144
- Published in
- BF16
- License
- apache-2.0
- Released
- 2026-02-24
- Weights
- Qwen/Qwen3.5-122B-A10B
Deploy it on Arrakis
Open Models in the console, choose vLLM, SGLang or llama.cpp, and rent a GPU it fits on. You get an OpenAI-compatible endpoint with its own API key, and root SSH to the machine. Or run it yourself on any machine with enough GPU memory:
vllm serve Qwen/Qwen3.5-122B-A10B --tensor-parallel-size 4Questions
Live prices for every GPU are on the GPU prices page.