9. Accountability
9.1 Establishing responsibilities
Establishing clear roles and responsibilities is essential for ensuring accountability in the development and use of AI systems. In this section, you are asked to identify the individuals responsible for 3 key aspects of your AI system:
Use of AI insights and decisions
The person responsible for the application of the AI system’s outputs, including making decisions or taking actions based on those outputs.
Monitoring the performance of the AI system
The person responsible for overseeing the ongoing performance and safety of the AI system, including monitoring for errors, biases or unintended consequences.
Data governance
The person responsible for the governance of the data used for operating, training or validating the AI system.
Where feasible, it is recommended that these 3 roles not all be held by the same person. The responsible officers should be appropriately senior, skilled and qualified for their respective roles.
9.2 Training of AI system operators
AI system operators play a crucial role in ensuring the responsible and effective use of AI. They must have the necessary skills, knowledge and judgment to understand the system’s capabilities and limitations, how to appropriately use the system, interpret its outputs and make informed decisions based on those outputs.
In your answer, describe the process for ensuring AI system operators are adequately trained and skilled. This may include:
Initial training
What training do operators receive before being allowed to use the AI system? Does this training cover technical aspects of the system, as well as ethical and legal considerations?
Ongoing training
Is there a process for continuous learning and skill development? How are operators kept up to date with changes or updates to the AI system?
Evaluation
Are operators’ skills and knowledge assessed? Are there any certification or qualification requirements?
Support
What resources and support are available to operators if they have questions or encounter issues?
Consider whether this needs to be tailored to the specific needs and risks of your AI system or proposed use case or whether general AI training requirements are sufficient.