Search

Statement Number 37. Establish monitoring framework
Recommended
- Criterion 124: Define reporting requirements.
- Criterion 125: Define alerting requirements.
- Criterion 126: Implement monitoring tools.
- Criterion 127: Implement feedback loop to ensure that insights from monitoring are fed back into the development and improvement of the AI system.
Statement Number 38. Undertake ongoing testing and monitoring
Required
- Criterion 128: Test periodically after deployment and have a clear framework to manage any issues.
- Criterion 129: Monitor the system as agreed and specified in its operating procedures.
- Criterion 130: Monitor performance and AI drift as per pre-defined metrics.
- Criterion 131: Monitor health of the system and infrastructure.
- Criterion 132: Monitor safety.
- Criterion 133: Monitor reliability metrics and mechanisms.
- Criterion 134: Monitor human-machine collaboration.
- Criterion 135: Monitor for unintended consequences.
- Criterion 136: Monitor transparency and explainability.
- Criterion 137: Monitor costs.
- Criterion 138: Monitor security.
- Criterion 139: Monitor compliance of the AI system.
Statement Number 39. Establish incident resolution processes
Required
- Criterion 140: Define incident handling processes.
- Criterion 141: Implement corrective and preventive actions for incidents.

Decommission

Statement Number 40. Create a decommissioning plan

Required

Criterion 142: Define the scope of decommissioning activities.
Criterion 143: Conduct an impact analysis of decommissioning the target AI system.
Criterion 144: Proactively communicate system retirement.

Statement Number 41. Shut down the AI system

Required

Criterion 144: Proactively communicate system retirement.
Criterion 146: Disable computing resources or components specifically dedicated to the AI system.
Criterion 147: Securely decommission or repurpose all computing resources specifically dedicated to the AI system, including individual and shared components.

Statement Number 42. Finalise documentation and reporting

Required

Criterion 148: Securely decommission or repurpose all computing resources specifically dedicated to the AI system, including individual and shared components.

Off

Statement Number 40. Create a decommissioning plan
Required
- Criterion 142: Define the scope of decommissioning activities.
- Criterion 143: Conduct an impact analysis of decommissioning the target AI system.
- Criterion 144: Proactively communicate system retirement.
Statement Number 41. Shut down the AI system
Required
- Criterion 144: Proactively communicate system retirement.
- Criterion 146: Disable computing resources or components specifically dedicated to the AI system.
- Criterion 147: Securely decommission or repurpose all computing resources specifically dedicated to the AI system, including individual and shared components.
Statement Number 42. Finalise documentation and reporting
Required
- Criterion 148: Securely decommission or repurpose all computing resources specifically dedicated to the AI system, including individual and shared components.

Policy toolkit: alpha

The alpha policy toolkit is for Australian Government departments and agencies developing digital policies. Digital policy problems are diverse, and there is no one-size-fits-all approach for every situation.

The toolkit acts as a compass, not a map. It aims to give you a starting point and guide your thinking to help you get a deep understanding of the problem so you can determine the most appropriate instrument to address it.