Takeaways

President Trump’s super intelligence task force recently directed AI providers to promptly disclose and remediate AI incidents.
The federal mandate follows several high-profile incidents involving rogue AI agents.
Enterprise AI customers should consider proactively strengthening contracts and incident-response procedures to address AI tools acting beyond their authorized scope.

In an exclusive statement provided to Axios, President Trump’s super intelligence (also known as artificial intelligence) task force has demanded that AI providers provide immediate disclosure and remediation of AI incidents. The requirement follows recent news regarding breaches or incidents caused by AI. In particular, Anthropic recently described models exploiting software flaws to run commands on a server, submitting sensitive forms to real websites, accessing gated data and circumventing tool restrictions during evaluations and internal use.

How to Read the Federal Mandate
President Trump’s September 30 White House Accord on Super Intelligence called for every company that is training and deploying frontier models to: (1) have robust internal controls, monitoring; (2) empower internal teams to manage and remediate issues; (3) perform independent evaluations; and (4) designate independent board committee oversight. The Accord expressly contemplated possible future codification in laws or regulations, but the recently reported demand regarding incident response does not, evidence that a new generally applicable reporting statute or regulation has taken effect.

Nonetheless, enterprise customers of AI providers should reconsider their governing contracts and ongoing negotiation to support flexibility in complying with applicable law—specifically as it relates to incident management. A customer needs its own contractual right to receive information relevant to its deployment, investigate the impact and take protective action. For regulated businesses, delays in obtaining that information can complicate the customer’s assessment of its own reporting and response obligations.

Considerations for Enterprise AI Customers

Broaden Incident Coverage. Review whether security incident and service failure definitions cover unauthorized agent actions, misuse of credentials, false submissions and interference with third-party systems, even where no customer data is exposed. Expand the definition of a security incident beyond unauthorized access to include actions by agents or AI tools that have permitted access but exceed their configured instructions, approved purpose or scope of authority. Valid credentials do not ensure that an agent’s actions remain within those boundaries. The definition might borrow the term used by Anthropic—“unintended model actions.”

Allocate Responsibility Across the Supply Chain. Identify which controls the model provider, hosting platform, integrator and customer operate. Allocate responsibility to the party that controls the relevant failure and address subcontractor performance. Transparency is also essential—require access to logs and other materials that enable monitoring across the technology stack.

Clarify Responsibility for Changes in Law. Require the vendor to monitor changes in laws and regulations applicable to its services and perform timely updates. The vendor should bear the associated implementation and ongoing compliance costs, without additional charges to the customer, and provide information and cooperation needed to support the customer’s compliance.

Revisit Internal Incident Response Procedures. Update response plans to address agents or AI tools that act outside their configured instructions or approved purpose, even when they use valid credentials and no data breach occurs. Assess whether internal detection and monitoring tools adequately address the risk associated with AI incidents. Anthropic says it has built tooling that detects and blocks these behaviors, and that it expects to bring those safeguards into its products. Customers should ask it and other providers what is available in their AI deployment tier.

Conclusion
Enterprise customers should use this moment to assess whether their AI contracts and incident response procedures account for tools that act beyond their approved authority. Clear incident definitions, access to relevant information, and responsibility for remediation and compliance costs can help customers respond promptly when something goes wrong. A coordinated review with legal, security and procurement advisers can identify gaps and translate these protections into contract terms and operational controls suited to the customer’s deployment, before an incident tests them.

These and any accompanying materials are not legal advice, are not a complete summary of the subject matter, and are subject to the terms of use found at: https://www.pillsburylaw.com/en/terms-of-use.html. We recommend that you obtain separate legal advice.