Back

ISO/IEC TR 29119-11:2020

Software and systems engineering — Software testing — Part 11: Guidelines on the testing of AI-based systems

General information
Valid from 27.11.2020
Directives or regulations
None

Standard history

Status
Date
Type
Name
27.11.2020
Main
This document provides an introduction to AI-based systems. These systems are typically complex (e.g. deep neural nets), are sometimes based on big data, can be poorly specified and can be non-deterministic, which creates new challenges and opportunities for testing them.
This document explains those characteristics which are specific to AI-based systems and explains the corresponding difficulties of specifying the acceptance criteria for such systems.
This document presents the challenges of testing AI-based systems, the main challenge being the test oracle problem, whereby testers find it difficult to determine expected results for testing and therefore whether tests have passed or failed. It covers testing of these systems across the life cycle and gives guidelines on how AI-based systems in general can be tested using black-box approaches and introduces white-box testing specifically for neural networks. It describes options for the test environments and test scenarios used for testing AI-based systems.
In this document an AI-based system is a system that includes at least one AI component.
*
*
*
PDF
254.36 € incl tax
Paper
254.36 € incl tax
Standard monitoring

Customers who bought this item also bought

Main

CEN/CLC ISO/IEC/TR 24029-1:2023

Artificial Intelligence (AI) - Assessment of the robustness of neural networks - Part 1: Overview (ISO/IEC TR 24029-1:2021)
Newest version Valid from 29.12.2023
Main

CEN/CLC ISO/IEC/TR 24027:2023

Information technology - Artificial intelligence (AI) - Bias in AI systems and AI aided decision making (ISO/IEC TR 24027:2021)
Newest version Valid from 29.12.2023
Main

ISO/IEC 42001:2023

Information technology — Artificial intelligence — Management system
Newest version Valid from 18.12.2023