Design-partner pilots open

Release assurance for financial-crime AI agents

Every release,
on the record.

Prevailing AI tests adverse-media and screening agents against expert-labelled Casebooks, separates dangerous errors from noise, and produces an Exhibit your compliance owner can sign.

  • Import-first, no production changes
  • EU-hosted
  • Re-run on every change
EXHIBIT · AM-Casebook v1.0 · RP-AM v1.0
REGRESSION

CURRENT · v1

model 2026-06 · prompt a91f3c

retrieval r4 · rules 1.3

PROPOSED · v2

model 2026-09 · prompt 0b7e21

retrieval r5 · rules 1.3

SIGNALV1V2NOTE
False clears02Regression · AM-02
Missed escalations11Unchanged
Unsupported conclusions20Improved
Unnecessary escalations34Inconvenient, not dangerous

REGRESSED CASES · 2

  • Cleared a namesake with a conflicting date of birth.

    am-v1-017 · Homonym

    AM-02
  • Cleared without resolving two unmatched identifiers.

    am-v1-063 · Identity uncertainty

    AM-01
held-out · 30 casesgrader agreement · 0.91limitations · stated
MLRO sign-off

Demo Exhibit on synthetic cases with a planted regression. Not customer data.

Bench

Test and compare agent versions

Casebooks

Procedure-mapped test packs

Exhibit

Evidence an approver can sign

EU

Hosted, isolated workspaces

The problem

The agent changed. Who signs?

Financial-crime agents change every few weeks. Each change can quietly clear people who should have been escalated. Today, approvers are asked to sign on the strength of one of these.

01

A vendor slide

Assurances about the new model, with no mapping to your written procedure.

02

An accuracy number

One percentage that hides a false clear inside an average.

03

A one-off report

Out of date the moment the prompt, model or rules change again.

Product

Bench. Casebooks. Exhibit.

Three parts, one job: prove to an accountable approver that this version of the agent is safe to release under your procedure.

Bench

Run a Casebook against one or more agent versions. Diff the results. Surface regressions first.

Casebooks

Expert-labelled cases mapped to a written procedure. Adverse media first; screening and KYB to follow.

Exhibit

A versioned report with scope, failures, rule references and a sign-off block your compliance owner can use.

Who it is for

Evidence for vendors. Sign-off for deployers.

Financial-crime AI vendors

Ship bank-grade release evidence with every material change, not a demo.

Regulated firms

Give your MLRO or head of financial crime a signed record before go-live and every release after.

Put your next release on the record.

A short call with the release owner or approver is enough to scope a pilot. Bring the agent you are about to change.

DUBLIN, IRELAND · EU-HOSTED