MMOOZZGG.com

Practice

AI hardware buying checklist for local AI

3 min read11 sources

Use this AI hardware buying checklist before you pay for a workstation or a server for AI. The hardware costs from $7,800, and a large server costs many times more, while a hardware mistake cannot be fixed with a driver update. Below are fifteen questions to answer in writing before you pay the invoice, with figures from this section.

On this page · 5 sections

Task and model

1. Which model passed the exam on your 50 requests, and at what quantization. 2. How many users and agents work at the same time at peak. 3. What context length you need: a 10-page document of 1,800 characters a page is about 4,500–6,000 tokens for a Russian-language model at 3–4 characters per token; for other models, measure with the provider’s counter. 4. Whether a vision or speech model runs next to it: that adds memory.

Memory and speed

5. How much memory the calculator shows with a 15% reserve and a cache for all users: a 32-billion-parameter model for 10 dialogs of 8,000 tokens needs about 43 GB, not 22. 6. Will next year’s model fit: take memory one step higher. 7. Did you measure speed on a rented card, at about $0.50 to $7 an hour, with 1, 4 and 16 streams.

Hardware and location

8. Power: RTX 5090 575 W, RTX PRO 6000 600 W, H100 up to 700 W, plus the platform; is the power supply and the socket enough, and do you need a three-phase line. 9. Heat and noise: a workstation in an office can be heard, and server cards live in a data center, from $90 a month for a server of up to 300 W. 10. Warranty and replacement: the warranty term on the invoice, replacement outside warranty at the price of a new card, $6,500 to $28,000; does the seller have spare cards.

People and processes

11. Who runs the server: by our estimate 10–20% of an engineer’s time at a median salary of $2,700 to $3,000, or a contractor. 12. A failure plan: a spare card, a rental contract, a switch to the cloud for non-sensitive data. 13. An update procedure with a repeat exam. 14. Monitoring of temperature, memory errors and response time from day one.

Money

15. The payback point against the cloud and against rental, from the calculator: if it is not within 36 months and the data may leave the company, do not pay the invoice. By our calculation, a Mac Studio at $11,000 pays back in 71 months against a cloud bill of $250 a month, and in 10 months against $1,200 a month.

Questions and answers

What do companies most often buy in vain?

A card with too little memory for the next model, and a server with no engineer to run it. Both mistakes show up in calculators before the purchase.

Sources and fact-checking

Checked by the editors on 29 September 2026.

  1. Regard, GeForce RTX 5090, prices as of 29 September 2026 (regard.ru)
  2. NVIDIA, GeForce RTX 5090: 575 W, 32 GB GDDR7 (nvidia.com)
  3. NVIDIA, RTX PRO 6000 Blackwell: 96 GB, 600 W (nvidia.com)
  4. NVIDIA, H100: SXM 80 GB up to 700 W, NVL 94 GB 350–400 W (nvidia.com)
  5. HOSTKEY, colocation in Moscow, 2026 (hostkey.ru)
  6. Habr (Slurm), DevOps engineer salaries, 3 September 2026 (habr.com)
  7. Tproger, cloud GPUs for ML in 2026, 21 May 2026 (tproger.ru)
  8. store-apple.msk.ru, Mac Studio M4 Max 128 GB, 29 September 2026 (store-apple.msk.ru)
  9. Developer documentation of a Russian language model: token counting, 3–4 characters per token on average, 17 July 2026 (developers.sber.ru)
  10. GPU Index, RTX 4090 rental in Russia: 173 offers, from about $0.40 an hour (checked 30 September 2026) (gpuindex.ru)
  11. GPU Index, H100 rental in Russia: 41 offers, from $3 an hour (checked 30 September 2026) (gpuindex.ru)

Found a mistake? Tell us

Publications

Mike Mozg

Agentic AI use cases at AT&T: nearly 500 processes now run on agents

AT&T no longer uses AI only to help staff work faster: it is rebuilding whole business processes around agents. SiliconANGLE reported on 14 November 2026 that nearly 500 agentic AI use cases at AT&T are already in production. Here is how the company rebuilds them, where a human still checks the agent, and what other large companies can take from it.

News4 min
Contact us