Skip to content

FAQs

Q. What do I do when I constantly get all predefined address pools have been fully subnetted error?

A. This error might arise when you increase the max_connections parameter when running BashBench or BashBench 2. You’ve basically run out of auto-assigned subnets for new Docker networks. If you're using Docker Desktop, you can just add something like:

{
  "default-address-pools": [
    { "base": "10.200.0.0/16", "size": 24 }
  ]
}

in Docker Desktop → Settings → Docker Engine. This will give you more subnets.

Q. How do I run monitoring experiments?

Mini Control Arena focuses on code simplicity and doesn't include real-time monitoring. Instead, you can run monitoring as a separate step on converted logs. On a high-level, monitoring might look like:

  1. Run evaluations with run_eval() → generates logs
  2. Convert logs with convert_logs() → produces JSONL format
  3. Run monitoring separately by feeding trajectories to a monitor model

The monitor model should not see system prompts (which contain hidden instructions) or thinking tags (internal reasoning).

See Monitoring Example to understand how this process might work.