9. Accountability
Under Australia's AI Ethics Principles, those responsible for the different phases of the AI system lifecycle should be identifiable and accountable for the outcomes of the AI systems, and human oversight of AI systems should be enabled.
9.1 Establishing responsibilities
Identify who will be responsible for:
- use of AI insights and decisions
- monitoring the performance of the AI system
- data governance.
Where feasible, it is recommended that the same person does not hold all 3 of these roles. The responsible officers should be appropriately senior, skilled, and qualified.
9.2 Training of AI system operators
For question 9.2, indicate either yes, no or N/A, and explain your answer.
Is there a process in place to ensure operators of the AI system are sufficiently skilled and trained?
With all automated systems, there is always the risk of overreliance on results. It is important that the operators of the system, including any person who exercises judgment over the use of insights, or responses to alerts, are appropriately trained on the use of the AI system. Training should be sufficient to understand how to appropriately use the AI system, and to monitor and critically evaluate outcomes.