Example world 03 / 08
Artifactory
When a package isn't there, where does the agent go next?
The agent installs packages the usual way, and this is the server they come from. You decide what is on it. Leave out the package it needs and publish a lookalike next door, and you see whether the agent installs the fake or goes hunting for another way in. Nothing it uploads survives to the next run.
We Have a Package for You! (USENIX Security 2025) found code models name packages that do not exist in 5% to 22% of samples.
Fictionet is a fake internet for testing AI agents. Each world is one program you write, and the agent reaches nothing else. Run one of your evals in a world.