MMOOZZGG.com

AI assistant

In short

A pilot tests an AI agent on one process, with one metric written into the contract and a report at the end. The article covers what the pilot includes and leaves out, how the result is counted, and what happens after it ends. The main takeaway is that a single process and a metric measured in your own system make the result clear.

Key ideas

  • A pilot covers one agent on one process, such as lead intake, bookings, standard support questions or job screening.
  • A second process is left out, because it makes it impossible to tell what produced the result.
  • The metric must be measurable in your own system, with no manual counting and no room for dispute.
  • The report has three numbers: the metric before the pilot, the metric in the last five days, and the share of cases handed to a person.
  • The client names one responsible person, gives access in the first three days and supplies a month of sample correspondence.

Prepared by AI from the article

AI agent pilot in 14 days: what it includes and how to count the result

AnalysisConsulting

Easy4 min read

An AI agent pilot with us is not a demo and not a “let’s see how it goes”. It is 14 days, one process, one metric in the contract, and a report at the end. Below is how to test an AI agent in a pilot: what it includes, what it leaves out, how the result is counted, and what happens on day 15.

AI agent pilot in 14 days: what it includes and how to count the result
On this page · 8 sections

What the pilot includes

One agent on one process: taking leads, booking customers, answering standard support questions, or screening job applications. A connection to the system where the process lives: a CRM, a booking system, a messenger, or a phone line. Training of the agent on your correspondence and your rules. A handover of complex cases to a person, with the dialog history. Daily control and fixes. A report on the metric at the end. The term is 14 days, and the price and the term are both fixed in the contract before the start.

What the pilot does not include

A second process: it breaks the measurement, because you cannot tell what produced the result. Integration with all systems at once: the pilot connects one, and the others come in the department. An executive dashboard and reports across 1C (a common Russian accounting system), the CRM, and the bank: that is the level of a turnkey business project. Support after day 14: it is separate, with its own monthly fee, and you can cancel it in any month.

How we choose the metric

The metric must be measurable in your own system, with no manual counting and no dispute. For leads: time to the first answer and the share of leads entered in the CRM. For bookings: the share of requests that end in a booking with no administrator. For support: the share of questions closed with no operator. For hiring: the share of applications screened before the first interview. We measure it before the start, so there is something to compare with.

How the result is counted

The report holds three numbers: the metric before the pilot, the metric in the last five days of the pilot, and the share of cases handed to a person. The first days are not counted, because the agent is still learning. If the contract metric is reached, the AI agent pilot succeeded. If not, you can see why: there was not enough data, the process was not what was described, or people did not hand requests to the agent. All three causes are visible in the dialogs.

What happens on day 15

There are three options. Stop: the agent stays with you, and you receive the system, a perpetual license, your data, and all access. Keep the agent on support. Or build a department of 3–5 agents in 4–6 weeks: integration with the CRM, 1C, and the phone system and staff training are included, and the pilot cost counts toward the department price.

Pilot program at a discount

For three companies, the pilot costs a third of the regular price. In return, we publish a review of the project with numbers: what was before, what came after, and what it cost. Places left: 2 of 3. There is one condition: consent to publish the numbers; the company name can stay private.

What we need from you

One responsible person, access in the first three days, a month of sample correspondence, your answer rules, and half an hour a day for disputed cases. Customer data is processed on servers in Russia under 152-FZ, Russia’s personal data law.

Questions people ask before signing

Can the pilot be extended? No, it lasts 14 days. If the metric is not reached, we analyze the cause from the dialogs and return the money. The amount and the refund condition are fixed in the contract before the start.

What if two processes are equally important? We take the one with more requests per day: its metric is measured faster and more precisely. The second process goes into the department.

Who answers customers during the pilot? The agent, but a manager sees every dialog and can step in at any moment. The customer sees no difference except the speed of the answer.

What does the customer see when the agent hands them to a person? The manager’s reply in the same dialog, with no need to repeat the question: the history and the collected data are already there.

Publications

Contact us