GMKtec EVO-X2 (128GB unified)
The $/GB winner: runs 70B-class and quantized big-MoE (V4 Flash tier) that no consumer GPU fits
RTX 5090 cloud pricing, August 2026
Live RTX 5090 quotes (32 GB VRAM) across the providers we track, cheapest first. Marketplace prices are real asks from the Vast.ai order book; secure/on-demand tiers carry datacenter SLAs (what the tiers mean).
Quotes refreshed 2026-08-23
Price floor: $0.321/hr (marketplace) at
Vast.ai.
Rent a RTX 5090 →
| Provider | Tier | $/hr per GPU | Median $/hr | Live offers | |
|---|---|---|---|---|---|
| Vast.ai | marketplace | $0.321 | $0.404 | 64 | Rent |
| RunPod | community | $0.690 | - | - | Rent |
| RunPod | secure | $0.990 | - | - | Rent |
What fits on a single RTX 5090
Models from our tracked open-weight set that fit in 32 GB, with KV-cache headroom included. Bigger models need multi-GPU nodes (math in the calculator).
| Model | Params | Fits at | VRAM needed | Cheapest API $/1M out |
|---|---|---|---|---|
| IBM Granite 4.1 8B | 8.8B | FP8 | 13 GB | compare → |
| GPT-OSS 20B | 21B | FP8 | 29 GB | compare → |
| Llama 3.1 8B | 8B | FP8 | 11 GB | compare → |
| Llama 3.2 3B | 3.2B | FP8 | 5 GB | compare → |
| Gemma 3 12B | 12B | FP8 | 17 GB | compare → |
| Phi-4 | 14.7B | FP8 | 21 GB | compare → |
| GLM-4.7 Flash | 31B | INT4 | 22 GB | compare → |
| Qwen3.6 35B A3B | 36B | INT4 | 25 GB | compare → |
| Qwen3.6 27B | 27.8B | INT4 | 20 GB | compare → |
| Qwen3.5 35B A3B | 36B | INT4 | 25 GB | compare → |
| Qwen3.5 27B | 27.8B | INT4 | 20 GB | compare → |
| Qwen3 32B | 32.8B | INT4 | 23 GB | compare → |
| Qwen3 30B A3B | 30.5B | INT4 | 21 GB | compare → |
| Mistral Small 3.1 | 24B | INT4 | 17 GB | |
| Nemotron 3 Nano | 30B | INT4 | 21 GB | compare → |
| IBM Granite 4.1 30B | 30B | INT4 | 21 GB | |
| Gemma 3 27B | 27B | INT4 | 19 GB | compare → |
| DeepSeek R1 Distill Qwen 32B | 32.8B | INT4 | 23 GB | compare → |
Prefer to own the hardware?
Renting wins for bursty loads; owning wins at sustained 24/7 use. Run your hours through the calculator. If you're buying, these are the machines this audience actually buys:
NVIDIA RTX 5090 (32GB)
Bandwidth-per-dollar king for the A3B-MoE and 27-32B dense workhorses
NVIDIA RTX PRO 6000 Blackwell (96GB)
The startup standard: only sub-$10K single card that runs 70B+ comfortably
As an Amazon Associate we earn from qualifying purchases · hardware links may be referral links · picks are editorial, not paid · disclosure
FAQ
How much does it cost to rent a RTX 5090?
As of 2026-08-23, RTX 5090 rentals start at $0.321/hr (marketplace tier at Vast.ai). Datacenter capacity with SLAs typically costs more than community or marketplace hardware.
What can you run on a RTX 5090?
With 32 GB of VRAM, a single RTX 5090 fits models up to roughly 22B parameters at FP8 or 45B at INT4 quantization, including KV-cache headroom.
Cite or embed today's floor
Live badge for a README. It updates itself with every daily refresh:
[](https://llmhosting.ai/gpus/rtx-5090)
Citation: RTX 5090 rental floor $0.321/hr (llmhosting.ai, 2026-08-23). Free to reuse with a link back.