Publications Office of the EU
The impact of human oversight on discrimination in AI-supported decision-making
DisplayCustomHeader
MyPortal
Nederlands
BasketSummary
Webcontent weergeven
Publication Detail Actions Portlet

Toegankelijkheidshulpmiddelen

Publication Detail Actions Portlet
 Gebruikerswaardering
custom-survey-notification
Publication Detail Portlet

Publication detail

Home

The impact of human oversight on discrimination in AI-supported decision-making

A large case study on human oversight of AI-based decision support systems in lending and hiring scenarios

Metagegevens publicatie

This large-scale study assesses the impact of human oversight on countering discrimination in AI aided decision-making for sensitive tasks. We use a mixed research method approach, in a sequential explanatory design whereby a quantitative experiment with HR and banking professionals in Italy and Germany (N=1411) is followed by qualitative analyses through interviews and workshops with volunteer participants in the experiment, fair AI experts and policymakers. We find that human overseers are equally likely to follow advice from a generic AI that is discriminatory as from an AI that is programmed to be fair. Human oversight does not prevent discrimination when the generic AI is used. Choice when a fair AI is used are less gender biased but are still affected by participants' biases. Interviews with participants show they prioritize their company's interests over fairness and highlights the need for guidance on overriding AI recommendations. Fair AI experts emphasize the need for a comprehensive systemic approach when designing oversight systems.
Meer informatie
Minder informatie
ISSN 1831-9424
ISBN 978-92-68-22566-0
DOI 10.2760/0189570
Catalogusnummer KJ-01-24-180-EN-N
PDF
ISSN 1831-9424 ISBN 978-92-68-22566-0 DOI 10.2760/0189570 Catalogusnummer KJ-01-24-180-EN-N
  • Released on EU publications website:
Publication Viewer

Documentviewer

Pop up window annotations