MMOOZZGG.com

Questions

Local AI server cost and sovereign AI: questions and answers

4 min read15 sources

Local AI server cost and sovereign AI in questions and answers: the twenty-three questions we are asked most often, with short answers and links to the section’s pages, where the calculations and sources are.

On this page · 5 sections

The basics

What is sovereign AI? Under 243-FZ, Russia’s AI law, from 1 March 2027 it is a model that a Russian legal entity develops and fully reproduces, including training, with answers and data processed in Russian data centers; in everyday terms, it is a model that works at your site and sends no data out. Can you run foreign cloud models yourself? The flagship cloud models, no: their weights are closed; you can run open models: Russian ones with 32 and 8 billion parameters, and the world’s open families. Do you need internet? Only to download the model. How much worse are local models? On short chains of up to 3 steps, a 9-billion-parameter model did not fall behind cloud models in a test for a retail chain; on a 15-step task, no model gave a fully verifiable result.

Hardware

What runs on an ordinary laptop with 16 GB? Models of 4–8 billion parameters in 4 bits, 6.3 GB with a context of 8,000 tokens. Which Mac to buy? One with 128 GB for 70-billion models: a MacBook Pro for $8,100 or a Mac Studio for $11,000. Which graphics card? An RTX 5090 with 32 GB for $9,000 on 30 September 2026 for models up to 32 billion, and an RTX PRO 6000 with 96 GB for $13,000 at the February 2026 price for 70 billion and a department. What does a server cost? About $30,000 with two 96 GB cards, from $120,000 with four H100s. How much power? One RTX 5090 around the clock is about $39 a month, a server with four H100s about $250. How often does it break? By our calculation from Meta’s report on training on 16,384 H100 cards (419 failures in 54 days), one serious failure per about 2,100 days of one card’s work under full load.

Money

What does local AI cost per month? From $300 for a laptop to $6,100 for a server with four H100s, with power, hosting and an engineer. What does the cloud cost? At 60 million tokens a month, from $12 to $1,200 at prices on 29 September 2026. When does the local option pay back? When the cloud bill is clearly above the cost of your own hardware, or when data must not go out; by our calculation, a Mac Studio pays back in 10 months against Fable 5.1 and in 71 against Sonnet 5.5. What about rental? H100 from $3 an hour, from $1,700 a month at Russian providers.

Law

Is it legal to use foreign APIs from Russia? Russia is not on the supported country lists of Claude and OpenAI on 29 September 2026; OpenAI has blocked API traffic from such countries since 9 July 2024 and warns that access from outside the list may lead to the account being blocked. Most foreign suppliers have no data processing agreement under 152-FZ, Russia’s personal data law. Must a business use Russian models? No, there is no general ban; the criteria of 243-FZ take effect on 1 March 2027, and from the same date the government may define areas where only sovereign or national models are allowed; for systems created before that date, such limits do not apply until 1 September 2032 if data is processed and stored in Russia. Can you give personal data to a local model? Yes, if you meet your duties as a data operator: a local model removes cross-border transfer and third parties. What goes in the policy? Three classes of data: may go out, Russian cloud, inside only.

Adoption

Where do you start? With a data policy and 50 test requests. Do you need an engineer? Not for one computer; for a department server, 10–20% of a full-time role by our estimate. How long does adoption take? A pilot in 14 days from $1,499, a department in 4–6 weeks from $4,999. Can you move to the cloud later, or out of it? Yes, if the agents are built through a single model interface.

Questions and answers

Where do you get open models?

On public model repositories, which LM Studio and Ollama download from. Russian open-weights models are published there by their developers too.

Sources and fact-checking

Checked by the editors on 29 September 2026.

  1. CNews, which AI models will get sovereign status, 28 September 2026, an article marked “advertisement” (corp.cnews.ru)
  2. Claude Platform, supported regions (checked 29 September 2026) (platform.claude.com)
  3. OpenAI, supported countries for the API (checked 29 September 2026) (developers.openai.com)
  4. Caixin, OpenAI blocks API traffic from unsupported countries from 9 July 2024, 26 June 2024 (caixinglobal.com)
  5. Anti-Malware, 152-FZ and neural networks, 17 June 2026 (anti-malware.ru)
  6. apple-store.net.ru, MacBook Pro 14 M5 Max 128 GB 2 TB, 29 September 2026 (apple-store.net.ru)
  7. store-apple.msk.ru, Mac Studio M4 Max 128 GB, 29 September 2026 (store-apple.msk.ru)
  8. Regard, GeForce RTX 5090, prices on 29 September 2026 (regard.ru)
  9. iXBT, RTX PRO 6000 Blackwell 96 GB for $13,000 at DNS, 2 February 2026 (ixbt.com)
  10. Servermall, NVIDIA H100 SXM5 80 GB, price on 29 September 2026 (servermall.ru)
  11. Tom’s Hardware, failures during Llama 3 training on 16,384 H100s, 2024 (tomshardware.com)
  12. Claude Platform, API pricing (checked 29 September 2026) (platform.claude.com)
  13. Intelion Cloud, H100/H200 rental (checked 29 September 2026) (intelion.cloud)
  14. GPU Index, H100 rental in Russia: 41 offers, from $3 an hour (checked 30 September 2026) (gpuindex.ru)
  15. Federal Law No. 243-FZ of 26 July 2026, text on ConsultantPlus (consultant.ru)

Found a mistake? Tell us

Publications

Mike Mozg

Agentic AI use cases at AT&T: nearly 500 processes now run on agents

AT&T no longer uses AI only to help staff work faster: it is rebuilding whole business processes around agents. SiliconANGLE reported on 14 November 2026 that nearly 500 agentic AI use cases at AT&T are already in production. Here is how the company rebuilds them, where a human still checks the agent, and what other large companies can take from it.

News4 min
Contact us