What ALICE does
ALICE works as a continuous audit of procurement. Every day the system automatically collects data on procedures that are under way right now, scores a set of risks and sends out signals to point auditors and managers to cases that deviate from the norm.
The main difference from a sample audit is timing. ALICE looks at tenders while they are still open, so an auditor can step in before the contract is signed instead of looking for the money after payment. This is how real-time monitoring works: the check runs along with the flow of documents.
No one can read such a flow by hand: in Brazil more than 500 procurement notices are published every day. ALICE reads them all and passes to people only those where risk signs were triggered.
Technically, ALICE began as robotic process automation (RPA). Now the CGU describes it as a combination of AI and RPA, and the office wrote its own algorithm to analyze procurement texts because ready text analysis tools were not enough.
Data sources
ALICE takes data from the main federal procurement platforms. The CGU names three sources: the Compras.gov.br portal, which is mandatory for the federal government; the Banco do Brasil procurement system called Licitações-e; and the official gazette Diário Oficial da União.
All three sources are public and updated every day. The system needs no access to closed databases to see a deviation in the procurement documents themselves: in the terms, deadlines, price and set of bidders.
Procurement in Brazil is about 10% of GDP, and during the pandemic its share reached almost 20%. So even a small share of risky procedures means large sums, and a full check pays back faster than a sample check.
An important condition for any country: data must come out in one format and without delay. If a notice is published a week after the decision, a real-time system turns into an after-the-fact audit.
40 types of risk
The CGU groups ALICE’s checks into about 40 types of risk (typologies). Each type describes a sign that can be checked against procurement data, not a conclusion that a violation took place.
The public project card on the OECD website has no full list of typologies. By meaning, the procurement signs that such systems rely on fall into four groups:
1. Tender terms: the bid deadline, requirements for bidders, the description of what is being bought.
2. Price: the starting price next to the prices of similar procurements in the same period.
3. Bidders: repeat winners, links between companies and with the buyer.
4. Course of the procedure: cancellations, changes of terms, repeated notices.
How such signs are built and why it is convenient to describe them as a list is covered on the page about red flags. A flag on its own proves nothing: the procurement differs from the norm and is worth a look, and the auditor makes the decision.
Who receives the signals
ALICE signals are targeted. More than 500 users receive them: staff of the CGU, other executive bodies, the judiciary, the prosecution service, and state and municipal audit bodies.
Not every signal becomes an audit. The CGU writes that the most critical signals grow into audit work. This way the auditors’ queue does not fill up with small deviations, and the effort goes to procurements with large sums and strong signs.
The creators of the system name organization, not the algorithm, as the key to success: ALICE’s results were built into the CGU’s regular work with strong support from leadership. A signal without a recipient and a response time stays a line in a report.
This setup answers a common fear of AI in oversight. The machine punishes no one; it puts a procurement in the queue of a person who knows the subject and answers for the conclusion. Any such system benefits from recording when an auditor disagrees with a signal: these notes are later used to refine the rules and remove false positives.
Results for 2019–2023
In 2019–2022, tenders worth more than 9.7 billion reais were suspended or canceled on ALICE signals. For the same period, the CGU recorded financial benefits of more than 1.3 billion reais.
In 2023 ALICE analyzed 190,923 procurements on the main platforms. The analysis and the signals to auditors led to 203 procurement audits with a total value of 27 billion reais.
Speed changes the most. A preventive audit on an ALICE signal takes 8 calendar days, while a traditional review takes more than 400 days on average.
The difference between the sums matters too. Suspended tenders show how much money went through a check before the contract was signed, and financial benefit shows how much was saved for the budget in the end. A report to leadership needs both numbers, plus the number of audits a signal started and the share of signals that were confirmed.
What Russia can take from this
ALICE’s experience transfers not as a program but as a way of working. Four decisions worth taking:
1. Check a procurement before the contract is signed. ALICE’s value is that it looks at tenders on the day they are published, and in Russia procurements are already published openly in the EIS, the state’s unified procurement information system.
2. Start with described risk signs. ALICE’s roughly 40 types of risk are clear to auditors; they can be discussed and challenged.
3. Build signals into people’s work. Each signal must have a recipient and a response time, or 8 days of preventive audit turn into the same 400 days.
4. Choose audit targets with a model, not at random. A study on budget data of Brazilian municipalities showed: with the same number of audits, a model points to almost twice as many municipalities with corruption as a random choice.
How such systems work in other countries is collected on the page about world experience.