Advanced Artificial Intelligence Evaluation Program
Read this section in the full bill →
This section appears in one version only, so there is nothing to compare yet.
(a) In general Not later than 90 days after the date of enactment of this Act, the Secretary shall establish an Advanced Artificial Intelligence Evaluation Program within the Department of Energy. (b) Activities The program shall— (1) offer standardized and classified testing and evaluation of advanced AI systems to systematically collect data on the likelihood of adverse AI incidents for a given advanced AI system; (2) implement testing protocols that match or exceed anticipated real-world AI jailbreaking techniques, including adversarial testing by red teams with expertise comparable to sophisticated malicious actors; (3) to the extent feasible, establish and facilitate classified, independent third-party assessments and blind model evaluations to maintain transparency and reliability; (4) provide participating entities with a formal report based on testing outcomes that clearly identifies evaluated risks and safety measures; (5) develop recommended containment protocols, contingency planning, and mitigation strategies informed by testing data to address identified risks; (6) inform the creation of evidence-based standards, regulatory options, guidelines, and governance mechanisms based on data collected from testing and evaluations; (7) assist Congress in determining the potential for controlled AI systems to reach artificial superintelligence, exceed human oversight or operational control, or pose existential threats to humanity by providing comprehensive empirical evaluations and risk assessments; and (8) develop proposed options for regulatory or governmental oversight, including potential nationalization or other strategic measures, for preventing or managing the development of artificial superintelligence if artificial superintelligence seems likely to arise. (c) Plan for permanent framework (1) In general Not later than 360 days after the date of enactment of this Act, the Secretary shall submit to Congress a detailed recommendation for Federal oversight of advanced artificial intelligence systems, drawing directly upon insights, empirical data, and lessons learned from the program. (2) Contents The plan submitted under paragraph (1) shall— (A) summarize and analyze outcomes from testing, identifying key trends, capabilities, potential risks, and system behaviors such as weaponization potential, self-replication capabilities, scheming behaviors, autonomous decisionmaking, and automated AI development capabilities; (B) recommend evidence-based standards, certification procedures, licensing requirements, and regulatory oversight structures specifically informed by testing and evaluation data, ensuring alignment between identified risks and regulatory responses; (C) outline proposals for automated and continuous monitoring of AI hardware usage, computational resource inputs, and cloud-computing deployments based on observed relationships between those factors and AI system performance or emergent capabilities; (D) propose adaptive governance strategies that account for ongoing improvements in algorithmic efficiency and system capabilities, ensuring that regulatory frameworks remain relevant and effective as AI technology advances; (E) suggest revisions with respect to Federal oversight or resourcing, such as a new office within an existing agency, a new agency, or additional funding, that may be necessary to develop and administer a permanent framework for oversight of advanced artificial intelligence systems; and (F) provide comprehensive evaluations regarding the potential for tested AI systems to exceed human oversight, approach artificial superintelligence, threaten economic competition (including in labor markets), undermine civil liberties, and pose existential risks to humanity, including clearly articulated options for regulatory or governmental oversight measures to address scenarios of imminent concern identified through testing. (3) Updates Not less frequently than once every year for the duration of the program, the Secretary shall— (A) update the plan submitted under paragraph (1) with new insights, data, and lessons from the program; and (B) submit the updated plan to Congress. (d) Sunset The program shall terminate on the date that is 7 years after the date of enactment of this Act, unless renewed by Congress.