For a better user experience please update your browser or use Chrome or Firefox browser.
Ferramentas
Publication detail
HomeThe role of AI safety benchmarks in evaluating systemic risks in general-purpose AI models
Collection of external scientific studies on general-purpose AI models under the EU AI Act
Metadados da publicação
The evaluation of systemic risks in General-Purpose AI (GPAI) models is a complex challenge that requires a multifaceted approach, extending beyond traditional capability assessments. This report analyses the role of AI safety benchmarks in identifying systemic risks in GPAI models, proposing a dual-trigger framework that combines capability triggers with safety benchmarks to provide a more comprehensive assessment of potential harms. The current landscape of safety benchmarks is still in development, with various initiatives emerging to address specific systemic risk categories, such as the ones identified in the GPAI Code of Practice: cyber offence, chemical, biological, radiological and nuclear (CBRN) risks, harmful manipulation, and loss of control. A tiered evaluation strategy is recommended, applying more rigorous and costly safety evaluations only to models that meet a predefined capability threshold or are intended for deployment in high-risk domains, ensuring proportionality and efficient resource allocation. Ultimately, the development of robust and standardised safety benchmarks is relevant for accurate classification of GPAI models as GPAI models with systemic risk, and policy initiatives should incentivise their creation to enable more effective systemic risk identification.
- Publicado em:
- Editado por: Fernández Llorca, David ; Eriksson, Maria ; Gómez, Emilia ;
- Temas: Tecnologia da informação e telecomunicações
- Tema: avaliação comparativa , direitos fundamentais , gestão de riscos , inovação , inteligência artificial , método de investigação , norma técnica , regulamento (UE) , segurança da informação
|
PDF
|
|||
| ISSN | ISBN 978-92-68-31428-9 | DOI 10.2760/1807342 | Número de catálogo KJ-01-25-456-EN-N |
- Released on EU publications website:
Visualização de documentos
Note:
A publicação não pode ser mostrada no visualizador de documentos. Abrir versão Web
Pode aceder-lhe a partir de: Descarregamento e línguas