Skip to content
Roy Saurabh

AI assurance and accountability

What evidence about an AI system is adequate for a particular decision, held by a particular role, in a particular deployment?

Evidence fragments pass through four checks: context, obligation, adequacy and stress. Some are rejected before an assurance judgement is formed.

Claims about an AI system should be checkable by someone who was not involved in building it.

Most assurance work asks whether a model is good. That is the wrong unit. A model is not deployed, a system is, into an institution, for a decision, under a regulation, with someone accountable for the outcome. The same model can be adequately evidenced for one of those situations and badly evidenced for the next.

My work here builds methods and software that make that distinction operational: analysing risk as a function of deployment context, reasoning over regulatory obligations as executable statements rather than prose, and testing whether a body of audit evidence actually supports the decision it is offered for, including the cases where plausible-looking evidence does not.

Selected work

Research projects

  • An assurance toolchain for deployed AI

    A connected set of reproducible tools for deployment-conditioned risk analysis, executable regulatory reasoning, evidence adequacy scoring and adversarial stress testing.

Next / Territory

Privacy-preserving collaborative AI