When a server needs a data center
A workstation with one card, such as an RTX 5090 with 32 GB, stays in the office: it draws about 800 W under load, and you hear it, but you can live with it. A server with two 96 GB cards draws up to 1.5 kW, and one with four H100 cards about 3.8 kW. Such a server with a UPS usually needs three-phase power, separate cooling and a place where the noise bothers nobody.
Server cards with blower fans are made for a rack, not for an office. So the rule is simple: one or two desktop cards live in the office, and a department server and anything bigger live in a data center.
How much hosting costs
Hosting in a commercial data center costs from $90 a month for a server up to 300 W, plus $24 for each additional 100 W. For a server with two RTX PRO 6000 cards at 1.5 kW this is about $400 a month, and for a server with four H100 cards at 4 kW about $1,000.
In our calculations, electricity is a separate line at a tariff of about $0.10 per kWh: a 1.5 kW server running around the clock uses about 1,080 kWh, or $100 a month. At some sites electricity is included in the price per kilowatt, so compare the total, not the line.
Office, colocation, rental or your own data center
Office: suits a Mac or a workstation with one card, with $0 for hosting. Commercial data center: the server is yours, and the rack and power belong to the site. By our calculation, a server with two RTX PRO 6000 cards costs about $2,100 a month, including depreciation, electricity, hosting, maintenance and an engineer.
GPU rental in a Russian data center: you don’t buy hardware, an H100 costs from $3 an hour, or from $1,700 a month at the cheapest offers. Counting the server, electricity and an engineer, buying pays off against renting in 18–54 months, by our calculation in the calculator.
You need your own data center when data cannot leave the company perimeter, not even for a Russian cloud or someone else’s rack: this is how a telecom operator, an airport or state bodies set the task. Department and division servers don’t need their own data center.
What to check in the contract
A site in Russia and a contract that shows who is responsible for the data: this matters for personal data under 152-FZ, Russia’s personal data law. Power per rack for GPUs in kilowatts, not only space in units. Whether electricity is included in the price, and how overuse is billed.
Your engineer’s access to the server, the procedure for replacing a card and the time the site needs to install it. A GPU rental contract signed in advance as a backup: switching it on in an hour is cheaper than a week of downtime.