Global / AI Safety
Anthropic veteran and former METR COO launch AI safety startup with $40m Series A
A new startup aims to constrain uncontrolled AI agent behaviour through underwriting mechanisms.
Artificial Intelligence Underwriting Company (AIUC), founded by an early Anthropic hire and former METR COO, has raised $40 million in Series A funding led by Ribbit Capital with First Harmonic participation. The startup focuses on reining in rogue AI agents.
Published · significance 58 of 100 (medium) · 1 source
What happened
Artificial Intelligence Underwriting Company (AIUC) has closed a $40 million Series A round led by Ribbit Capital, with First Harmonic also participating. The startup was founded by an early Anthropic hire and the former COO of METR. AIUC is developing mechanisms to control wayward AI agent behaviour.
Why it matters
AI agent deployment is accelerating, but the systems lack proven safeguards against misalignment or harmful outputs. AIUC's focus on underwriting-based constraints suggests the industry recognises a gap between current deployment speeds and available risk controls. This signals both market demand and investor confidence in specialised safety infrastructure for autonomous systems.
What changes
Companies deploying AI agents may now have access to third-party validation and risk mitigation tools. Developers and enterprises face pressure to adopt guardrails before deployment rather than relying solely on in-house safety measures.
Involved
Sources
Written by AI from the reports above; scored by a published formula. How we work. Found a mistake? Email lockedinshreyash@gmail.com. Up To Date summarises and links to original reporting; it never reproduces articles.
Related coverage
- Anthropic disrupts Russian and Chinese efforts to misuse Claude for cyberattacks and bioweapons research — The frontier lab is now publishing details of state-sponsored and criminal abuse attempts against its own models. (2026-09-10)
- Anthropic researcher quits, warns of uncontrolled superintelligence race — A public resignation at a frontier lab, backed by its alignment lead, raises doubts about whether safety keeps pace with capability scaling. (2026-09-09)
- Anthropic reports Houthi militants used AI to develop advanced weapons — The disclosure underscores how frontier models are accessible to non-state actors despite safety measures. (2026-09-11)
- Anthropic CEO warns AI agents could breach internet security within a year — The safety case for slowing AI development finds fresh urgency as frontier labs confront plausible near-term threats. (2026-09-14)
- Anthropic CEO Dario Amodei urges slowdown in frontier model development — A leading AI lab's leader warns that speed now risks systemic danger, forcing the industry to reckon with its own momentum. (2026-09-14)