Catalog
Browse 13 GPU SKUs in the catalog.
AMD Radeon RX 7900 XTX
AMD· 132 tok/s ESTIMATED
NVIDIA A100 80GB PCIe
NVIDIA· 367 tok/s ESTIMATED
NVIDIA GeForce RTX 3090 (Used)
NVIDIA· 135.7 tok/s ESTIMATED
NVIDIA GeForce RTX 4060 Ti 16GB
NVIDIA· 39.6 tok/s ESTIMATED
NVIDIA GeForce RTX 4070 Ti SUPER
NVIDIA· 92.4 tok/s ESTIMATED
NVIDIA GeForce RTX 4080 SUPER
NVIDIA· 98.7 tok/s HIGH
NVIDIA GeForce RTX 4090
NVIDIA· 135.4 tok/s HIGH
NVIDIA GeForce RTX 5070 Ti
NVIDIA· 123.2 tok/s ESTIMATED
NVIDIA GeForce RTX 5080
NVIDIA· 140.8 tok/s ESTIMATED
NVIDIA GeForce RTX 5090
NVIDIA· 246.4 tok/s ESTIMATED
NVIDIA RTX A6000
NVIDIA· 105.6 tok/s ESTIMATED
NVIDIA RTX PRO 5000 Blackwell 48GB
NVIDIA· 123.2 tok/s ESTIMATED
NVIDIA RTX PRO 6000 Blackwell 96GB
NVIDIA· 246.4 tok/s ESTIMATED