1. May the data leave the company
If the data holds source code, medical records, credit documents or personal data with no processing contract with the provider, the answer is no. A telecom operator required in a tender that code must not leave its data center. Moscow health care deployed a language model locally for medical data, and a developer and a bank put an AI controller of credit documents into an isolated network. According to an estimate cited by an industry publication, most foreign providers have no processing contract under 152-FZ, Russia’s personal data law.
2. How many tokens a month
At 60 million tokens a month, cloud models cost from $12 to $1,200 a month at prices as of 29 September 2026. A 32 GB graphics card cost $9,000 at one seller on 30 September 2026. By our calculation, a workstation with this card, the platform, electricity and an engineer pays back in 17 months against flagship models at $1,200, and never against mid-level models at $250: its costs are higher than the bill. Against mid-level models, by our calculation, the local option pays back at hundreds of millions of tokens a month; the calculator finds the exact point.
3. What delay and availability you need
For code completion, the telecom operator wrote a response time of no more than 400 ms into the tender; a local model gives it without depending on the internet connection or the provider’s limits. For a chatbot, where the customer is ready to wait a few seconds for an answer, the cloud is enough.
4. What quality you need
On short chains of 2–3 steps, a local model with 9 billion parameters did as well as cloud models in a 27-run test by the IT unit of a retail chain; on a 15-step chain, no model gave a fully verifiable result. In the same 15-step test, a large 235-billion cloud model gave partial success in 2 runs of 3, and the local 9-billion model in 1. On a long chain the large model coped more often in this test, and running large models in-house needs, by our calculation, a server from $30,000, or a cloud at USD 10–50 per million output tokens for flagship models.
5. Who will maintain it
A local server needs a person: the median salary of a DevOps engineer in Russia is $2,700–$3,000 a month, and a middle-level engineer in Moscow earns up to $3,800. By our calculation, the share of that salary spent on the AI server is the largest cost item after hardware. The cloud includes this in the token price.
Summary
Data decides first; if it may leave the company, the next questions are volume and people. A hybrid setup, a local model for sensitive data and the cloud for the rest, covers most cases.