Workshop

Actionable Auditing: How to Use It as an Effective Tool for “Ethical AI”?

A drawn image of hands making notes on different graphic models.
© Ezequiel Hyon

Thu, 29.09.2022 1:45 PM - 4:30 PM

The workshop is conducted by the German Research Center for Artificial Intelligence (DFKI) in cooperation with etami and the project Humane AI-Net/ Dorothea Winter, Mihai Maftei and Samantha Prange.

The growing adoption and deployment of Artificial Intelligence based systems came with its share of ethical incidents and societal concerns. It also unveiled the necessity to properly audit these systems in light of ethical principles. For such a novel type of algorithmic auditing to become standard practice, two main prerequisites need to be available: A lifecycle model that is tailored towards transparency and accountability, and a principled risk assessment procedure that allows the proper scoping of the audit.
Aiming to make a pragmatic step towards a wider adoption of AI auditing, we will present a two-phases auditing procedure that conforms to and extends the AI-HLEG guidelines published by the European Commission, serving as a common ground for alignment between the auditors and the audited organisation.
During the workshop, after presenting the tools used by us for audit procedures, participants will be divided into multiple groups. The groups will alternatively play the role of system designers and external auditors. In their role of systems developers, the participants will need to develop a system (or to expound an existent one), completing simultaneously an ethics self-assessment procedure, and being aware during the entire development round if the system comply with the EU ethics requirements. As external auditors, participants will have to audit the work of system designers' group unveiling potential issues, improvements, and solutions. Any group will have to develop a system and to audit one created by a different group. In the end, all the systems and auditing procedures will be discussed in plenum.

This workshop is aimed at the participants of the summer school and will not be available online.