What an LLM engineer does
An LLM engineer usually does not train a model from scratch. They take a ready model, through an API or on their own server, and build it into a process: connect data, tools and rules, and then check that the answers are good enough for the job.
First typical task: RAG, answers from company documents. Lewis and co-authors described the approach on 22 May 2020: the model answers not only from its own memory but also from chunks that a search engine found in a database. In practice the engineer cuts documents into chunks, computes vectors and sets up the search.
Second task: agents. The model gets tools, such as a query to the CRM or 1C, and decides itself when to call them. The engineer describes the tools, the access rights and the moment when the agent hands the case to a person.
Third task: quality evaluation. A set of test questions with reference answers is run after each prompt edit or model change. Part of the grading goes to another model: in the 2023 work of Zheng and co-authors, GPT-4 as a judge agreed with human ratings in more than 80% of cases, about as often as people agree with each other.
Fourth task: money. Models charge for tokens, the pieces of words a model counts text in. The engineer calculates the cost of one answer, removes extra context and sends simple requests to a low-cost model.
How it differs from an ML engineer and a prompt engineer
An ML engineer trains models on company data: demand forecasts, scoring, finding defects in photos. The work starts with a data sample and ends with a model metric.
A language model engineer more often takes a ready model and builds a system around it: data, tools, checks, monitoring of answers. They bring in training only when there is no other way, for example for fine-tuning on your own examples.
A prompt engineer writes and edits requests to a model. For an LLM engineer this is one skill, not the whole job: beyond the prompt, they are responsible for search, code, tests and costs.
On the market the borders are blurred. On 16 October 2026, the word LLM appeared in the text of 1,265 vacancies on hh.ru across Russia, but in the title of only 120: models are mentioned in vacancies for testers, DevOps engineers and developers too.
How to enter the profession
Most people come to the job from Python development, data analysis and ML. The first know code and APIs, the second metrics, the third models.
You can build the path in three steps. First, a first agent in one evening on a ready model, then RAG over your own documents, then a test set that catches errors after each edit.
A portfolio weighs more than a certificate. An employer needs a project with a clear metric: what share of questions the system closes, what one answer costs, how often it makes mistakes.
Demand for the skill is growing beyond engineering roles too. According to hh.ru, in the first half of 2026 employers posted more than 21,600 vacancies requiring skills with neural networks.
Where to learn for free
Below are university courses whose pages we opened on 16 October 2026. Programs change every semester, so check the terms on the course page before you start.
Stanford CS336 “Language Modeling from Scratch”, spring 2026: a language model from scratch. Tokenization, the transformer, training and scaling laws, inference, evaluation, fine-tuning and RLHF; lecture recordings are on YouTube.
Stanford CS224N, natural language processing with deep learning. The course covers the attention mechanism, transformers and LLMs, and the full set of videos for the 2024 class is free on YouTube.
MIT 6.S191 “Introduction to Deep Learning”, 2026: an intro course in deep learning with a topic on large language models. The materials are free under the MIT license, and the practice includes a lab on fine-tuning an LLM.
MIPT Deep Learning School, in Russian. You can study for free, and there is a paid Premium subscription; the second part is about text: embeddings, the attention mechanism, transformers and large language models.
AI courses for staff and managers are collected in our training section. Which universities in the world are strongest in AI, and what programs they have, is shown in the ranking of the world’s universities in AI.
Does a company need its own LLM engineer?
You need your own engineer when a language model becomes part of the product or when the company has many processes on models. Then someone must watch quality, costs and model updates every day.
For one or two processes, a staff specialist often costs more than the result. According to hh.ru data as of 17 July 2026, data scientists were offered on average $2,400 a month in vacancies with neural network skills, and programmers $1,500.
There is a third option: an external AI director. They choose the processes, set tasks for the contractor, check the metrics and answer for the result to the CEO, while the agents themselves can be ordered turnkey.
If you already have an engineer on staff, the AI director does not replace them. They give the engineer a queue of tasks, each with a price and a metric for the business.