Build guide
Team-grade dual 4090 rig targeting Llama 3.3 70B at Q4.
Budget
$12,000
Profile
TEAM SERVER
Target model
Llama 3.3 70B
59tok/s
50.2–67.9 tok/s decode on Llama 3.3 70B
Value: 4.92 tok/s per $1k
GPU
NVIDIA GeForce RTX 4090
CPU
AMD Ryzen 9 7950X
Motherboard
ASUS ROG STRIX X670E-E GAMING WIFI
RAM
G.Skill Trident Z5 64GB (2x32GB) DDR5-6000
Storage
Samsung 990 PRO 2TB NVMe
PSU
Corsair RM1000x (2021) 1000W 80+ Gold
Case
Fractal Design Meshify 2
Cooler
NZXT Kraken X73 360mm AIO