Jusletter IT

Automation Bias & the Proposal of the EU-Regulation on AI

  • Author: Jonas Pfister
  • Category of articles: Digital Law
  • Region: EU
  • Field of law: AI & Law
  • Collection: Conference proceedings IRIS 2022
  • DOI: 10.38023/6ec715d9-0ed6-4a44-8be0-6874a866d8e8
  • Citation: Jonas Pfister, Automation Bias & the Proposal of the EU-Regulation on AI, in: Jusletter IT 24 February 2022
In 2021 the European Commission proposed the world’s first legal framework for Artificial Intelligence. The proposal follows a risk-based approach to AI-regulation, meaning that artificial intelligence systems will have to adhere to different requirements proportional to the risk they pose. Insofar as a system will be considered “high-risk”, the artificial intelligence will have to be compliant with the requirements on human oversight set out in Article 14 of the regulation. According to article 14 par. 4 lit (b) these requirements include the obligation to be aware of a so-called “automation bias”, which will be the focal point of the following analysis. The paper aims to give a short overview over relevant parts of the new proposal, clarify what constitutes an “automation bias”, highlight the difficult compliance with this seemingly small requirement and propose possible solutions.

Table of contents

  • 1. Introduction
  • 2. Brief Overview: Proposal for the Regulation on AI
  • 3. Scope of the Provision
  • 4. Human Oversight according to Article 14
  • 5. Automation Bias in other Fields
  • 5.1. Influencing Factors
  • 6. “Awareness” as Legal Requirement
  • 6.1. National Case Law on Overreliance
  • 7. Compliance Solutions
  • 7.1. Design choices
  • 7.2. Human Resources Requirements
  • 8. Conclusion
  • 9. Acknowledgments
  • 10. Literature

No comments

There are no comments yet

Ihr Kommentar zu diesem Beitrag

AbonnentInnen dieser Zeitschrift können sich an der Diskussion beteiligen. Bitte loggen Sie sich ein, um Kommentare verfassen zu können.