Brifing

Shopify Deploys Cyber Chaos Monkey to Automate Production Security

AI agents proactively hunt vulnerabilities in production environments using advanced chaos engineering principles.

Shopify Engineering2 min

1Proactive Security via Automation

Shopify has introduced the Cyber Chaos Monkey, an agentic system designed to identify software vulnerabilities in live production environments. By leveraging frontier AI models, the platform proactively attacks its own infrastructure to discover potential security gaps. This approach aims to find critical issues before malicious actors can exploit them in the wild.

2Rising Threat Landscape Dynamics

The company reports a 300% increase in bug bounty submissions since 2024, reflecting a broader industry trend where AI models lower the cost of vulnerability discovery. To maintain a competitive edge, Shopify utilizes its deep internal knowledge of its own software systems to gain an informational advantage over external adversaries.

3Chaos Engineering for Security

Inspired by Netflix’s 2011 Chaos Monkey tool, this system applies chaos engineering principles to cybersecurity. It performs tens of thousands of offensive engagements against production systems without causing service outages. The goal is to build confidence in system resilience while identifying novel ways to bypass existing safeguards in real-time environments.

4Architecture of the System

The Cyber Chaos Monkey operates as a containerized workload within Kubernetes, separating functions into Discovery and Sandbox components. Each engagement is treated as a distinct job, providing a controlled environment for AI agents to test hypotheses. This architecture ensures that security testing remains isolated from critical merchant and buyer data flows.

5Two-Person Integrity Mechanism

To prevent unauthorized behavior, Shopify implements a novel Two-Person Integrity (TPI) model using two distinct AI agents. An 'executor' agent performs the offensive testing, while a separately aligned 'judge' agent monitors session logs in real time. If the judge detects behavior violating the Rules of Engagement, it instantly terminates the executor.

6Strict Containment and Control

The system mandates explicit positive control, requiring the judge agent to actively adjudicate messages from the executor. If the judge crashes or fails to respond, the orchestrator terminates the entire pod immediately. This design prevents execution containers from running without oversight, mitigating risks associated with AI agents potentially exceeding their intended scope.

7Leveraging Informational Asymmetry

Shopify views this initiative as a strategic bet on asymmetry. While frontier models assist all parties, Shopify’s unique access to its own source code, threat intelligence, and infrastructure records provides a significant advantage. This allows the company to reach impactful security issues faster than external attackers, effectively raising the cost for adversaries.

8Future of Defensive AI

By integrating AI agents into the core of their security program, Shopify is shifting from reactive patching to continuous, automated red-teaming. This methodology demonstrates how organizations can harness the same tools used by attackers to harden their own defenses, ensuring that security capabilities evolve at the same pace as modern software development.

Original article: Shopify Engineering — Shopify Deploys Cyber Chaos Monkey to Automate Production Security