Prices as of 29 September 2026
RTX 4090, 24 GB: $5,900 at one seller in July 2026; on 30 September 2026 the seller no longer has it. RTX 5090, 32 GB: $7,700–$7,900; in March 2025 the card cost from $4,200 and in January 2026 about $3,600, and the rise is explained by demand for video memory and the lack of competition. RTX PRO 6000 Blackwell, 96 GB: $13,000 at a large chain in February 2026, with a US price of 8,500–10,000 dollars. A100 80 GB: $13,000; A100 40 GB: $6,600. H100 SXM5 80 GB: $28,000 including VAT, in stock.
Memory and power
RTX 4090: 24 GB, 450 W, power supply from 850 W. RTX 5090: 32 GB GDDR7, 575 W. RTX PRO 6000: 96 GB with error correction, 600 W. A100 PCIe: 80 GB, 300 W. H100 SXM: 80 GB, up to 700 W, server chassis only; H100 NVL: 94 GB, 350–400 W.
Which card for which task
One user, models up to 32 billion parameters: RTX 5090 or 4090, 24–32 GB. 70-billion models in 4 bits for 3–5 users: an RTX PRO 6000 with 96 GB or two 32 GB cards; by our calculation, two 24 GB cards will not have enough memory. A service for dozens of users: an A100 or H100 in a server with a batch serving engine; one user gets only 8–13% more on them than on an RTX 4090, and the gain is in parallel serving. Training and fine-tuning large models: server cards only.
Risks
The maker lists memory error correction in the specs of the RTX PRO 6000, but not of gaming cards. Some early RTX 5090 cards, less than 0.5% by the maker’s statement, had a factory chip defect; the maker says it did not affect AI tasks, and such cards were replaced under warranty. Warranty terms differ by seller: check them on the invoice. Prices change by tens of percent in six months: fix the price on the invoice, not in a calculation from six months ago.