Role of the Chief Digital and Artificial Intelligence Officer

(a) Monitoring and evaluation The Chief Digital and Artificial Intelligence Officer shall monitor and evaluate artificial intelligence capabilities in, and cybersecurity for, autonomous and semi-autonomous weapon systems, and shall advise the Secretary on such matters. (b) Testable requirements The Chief Digital and Artificial Intelligence Officer shall, in collaboration with the Under Secretary of Defense for Research and Engineering— (1) formulate concrete, testable requirements for implementing the Ethical Principles for Artificial Intelligence and the Responsible Artificial Intelligence Strategy and Implementation Pathway; (2) establish policy and issue guidance on definitions of requirements and testability for artificial intelligence-enabled systems to implement and demonstrate adherence to the Ethical Principles for Artificial Intelligence and the Responsible Artificial Intelligence Strategy and Implementation Pathway; and (3) issue guidance on test and evaluation practices for artificial intelligence capabilities in autonomous or semi-autonomous weapon systems, which shall include an adversarial assessment (known as red-team assessment) that evaluates weapon system vulnerability to adversarial manipulation under operationally realistic conditions. (c) Common tools and infrastructure The Chief Digital and Artificial Intelligence Officer shall coordinate with the Under Secretary of Defense for Research and Engineering and the Director of Operational Test and Evaluation on developing and using common tools and infrastructure for test and evaluation and verification and validation of artificial intelligence capabilities in autonomous or semi-autonomous weapon systems, including assurance benchmarks for reliability, robustness, security, and human-machine team performance.