MMOOZZGG.com

Comparison

Hybrid AI architecture: a local model and the cloud in one system

3 min read13 sources

A hybrid AI architecture joins local AI and the cloud. A local model handles sensitive data and high-volume simple tasks, and complex tasks on anonymized data go to the cloud. Below: how it works, what it gives in cost and legal terms, and how to calculate it.

On this page · 5 sections

How it works

A router with one interface stands between the agents and the models, so an agent doesn’t know which model will answer. The routing rules: by data type, personal data and code always stay local; by complexity, chains of 10 or more steps go to the cloud; by time, night batch work runs on the local model; by failure, if one model is down, requests go to another. Before anything goes to the cloud, the router anonymizes it: it replaces names, numbers and amounts with labels and puts the real values back into the answer.

What it gives in cost

An example for 60 million tokens a month: 80% simple requests on a local model on a workstation with an RTX 5090, at $800 a month with an engineer, and 20% complex ones on Sonnet 5.5 at $49. The total is $800, against $1,200 on Fable 5.1 for the whole volume and $250 on Sonnet 5.5 for everything. So the hybrid is cheaper than the flagship and more expensive than a mid-range cloud model. Companies choose it for data control and fault tolerance, and by our calculation it wins on cost as volume grows.

What it gives in legal terms

152-FZ, Russia’s personal data law: personal data stays inside your perimeter, and anonymized data sent to the cloud is still personal if the labels can be linked to a person. So it needs a Russian provider with a data processing agreement, and a lawyer gives the final opinion. 243-FZ: the law gives sovereign and national model status to a model of its developer, a Russian legal entity, when answers and data storage happen in data centers in Russia. For the local part, this is a reason to choose a model that will get this status; the criteria take effect on 1 March 2027. It matters if a draft decree is adopted that would require sovereign models in some sectors when they cost no more than 1.5 times the national ones; the draft was reported on 8 September 2026.

What it looks like in cases

A telecom operator required in a tender that source code never leave its data center, with code completion responses within 400 ms. An airport built an AI plugin that checks and fixes code in a closed network, with more than 90% precision on checked findings. A retail chain compared a local 9-billion-parameter model with cloud models in the same setup: on a two-step task, all three models succeeded in every run. A property developer put a Russian model in an isolated network to check project finance terms and cut document analysis time by 80%.

Where to start

Build agents through one model interface, even if everything is in the cloud today. Label your data: what must never leave. Put a local model on one class of tasks and measure quality on 50 requests. Turn on routing and anonymization. We build this in a pilot in 14 days from $1,499 and in an AI department in 4–6 weeks from $4,999.

Questions and answers

Isn’t a hybrid more complex than one option?

It has one more component, the router. In return, moving between models becomes a setting, not a project, and a provider outage doesn’t stop the work.

How do you know which request is complex?

By rules: the number of steps, whether there is code or a long document, the type of agent. Start with a simple rule and refine it from the logs of the first month.

Sources and fact-checking

Checked by the editors on 29 September 2026.

  1. Claude Platform, API prices (checked 29 September 2026) (platform.claude.com)
  2. Regard, GeForce RTX 5090 prices as of 29 September 2026 (regard.ru)
  3. Habr (Slurm), DevOps engineer salaries, 3 September 2026 (habr.com)
  4. CNews, which AI models will get sovereign status, 28 September 2026, an article marked “advertising” (corp.cnews.ru)
  5. 3DNews, business may be required to use sovereign AI, 8 September 2026 (3dnews.ru)
  6. Anti-Malware, 152-FZ and neural networks, 17 June 2026 (anti-malware.ru)
  7. ComNews, developer MR put a Russian language model into checks of project finance terms, 15 September 2026 (comnews.ru)
  8. Digital Platforms catalog, case no. 3148, February 2026: T2 (Tele2) (platforms.su)
  9. Digital Platforms catalog, case no. 3502, 2 September 2026: Pulkovo Airport (platforms.su)
  10. Digital Platforms catalog, case no. 3534, 2 September 2026: Step agricultural holding (platforms.su)
  11. Digital Platforms catalog, case no. 4027, 2 September 2026: Faberlic (platforms.su)
  12. Digital Platforms catalog, case no. 4085, 2 September 2026: Petrovich-Tech (platforms.su)
  13. Federal Law No. 243-FZ of 26 July 2026, text on ConsultantPlus (consultant.ru)

Found a mistake? Tell us

Publications

Mike Mozg

Agentic AI use cases at AT&T: nearly 500 processes now run on agents

AT&T no longer uses AI only to help staff work faster: it is rebuilding whole business processes around agents. SiliconANGLE reported on 14 November 2026 that nearly 500 agentic AI use cases at AT&T are already in production. Here is how the company rebuilds them, where a human still checks the agent, and what other large companies can take from it.

News4 min

Cases on this topic: 6

  • Market case · Russia

    T2 (Tele2) tender for a self-hosted AI coding assistant in a closed data center: 15 developers, response within 400 ms

    In February 2026 the operator announced a tender for a self-hosted AI coding assistant that runs in the company’s closed data center in Rostov-on-Don, so source code never leaves its infrastructure. Requirements: 15 users, autocomplete with a response of at most 400 ms, six programming languages.

    Telecom

    2026 · source: platforms.su

    Read the case
  • Market case · Russia

    Pulkovo Airport AI secure code review plugin in a closed network: over 90% accuracy on checking findings and up to 85% on fixes

    The airport’s information security team built code analysis into the development environment. A trained AI plugin reviews vulnerabilities and fixes the code inside a closed network, so no data goes outside. The model verifies findings with more than 90% accuracy and fixes vulnerabilities with up to 85% accuracy.

    Industry and infrastructure

    2 September 2026 · source: platforms.su

    Read the case
  • Market case · Russia

    Step agroholding its own AI ecosystem on local neural networks, so data never goes to public services

    The holding builds its AI ecosystem on local AI models for companies, agents and chatbots, so confidential data does not go to public services. It already syncs herd management data with a government system and runs legal information monitoring for the back office. Several analytics projects have started.

    Industry and infrastructure

    2 September 2026 · source: platforms.su

    Read the case
  • Market case · Russia

    Developer MR Project finance AI controller in an isolated environment: 80% less time on credit document analysis

    The developer and its bank built a project finance AI controller on a Russian language model. It checks the terms of project finance automatically and tracks loan obligations. According to the company, the time spent on credit document analysis fell by 80%. Each large project comes with hundreds of pages of credit documents and dozens of additional agreements; the system assembles a master version of each contract and keeps one calendar of obligations.

    Industry and infrastructure

    15 September 2026 · source: comnews.ru

    Read the case
  • Market case · Russia

    Faberlik neural catalog search on a local Qwen model and rented GPUs

    The cosmetics maker replaced classic catalog search with neural search: a local Qwen language model and vector semantic search run on the GPU infrastructure of a Russian cloud. The model works inside infrastructure the company controls, data is not sent to outside services, and the cost of handling requests stays under control.

    Retail and manufacturing

    2 September 2026 · source: platforms.su

    Read the case
  • Market case · Russia

    Petrovich-Tech a local model with 9 billion parameters matched cloud models on tasks of 2–3 steps: 27 runs

    The IT unit of a building materials store chain compared three models in one agent setup with 13 analytics dashboard widgets and about 30 tools: a Western cloud model, an open cloud model with 235 billion parameters and a local model with 9 billion parameters in 4-bit quantization on one graphics card. The design: 3 scenarios, 3 models, 3 runs, 27 launches.

    Retail and manufacturing

    2 September 2026 · source: platforms.su

    Read the case
Contact us