Connect
If you already score your agent with another tool, Trace can tell you whether the
difference between two versions is real. poisson-trace-import reads the result files that
tool wrote, one import per version, and poisson-trace fix-check compares them.
poisson-trace-import deepeval old.json --store ./store --run old \ --metric "Tests Passed" --cut recorded --case namepoisson-trace-import deepeval new.json --store ./store --run new \ --metric "Tests Passed" --cut recorded --case namepoisson-trace fix-check old new --store ./store --event missed --inputs all --max-mde 0.05You name the metric, the cut and what identifies a case. Nothing has a default. The importer runs no metric and calls no model.
Models
Section titled “Models”| Model | Connects through |
|---|---|
| Claude | Tasks’ anthropic provider, with your own Anthropic key |
Evaluation tools
Section titled “Evaluation tools”| Tool | Reads |
|---|---|
| DeepEval | DeepEval’s saved test runs, one metric per import |
| Ragas | The score table saved from Ragas, one score column per import |
| LangSmith | Not yet built |
Agent frameworks
Section titled “Agent frameworks”| Framework | |
|---|---|
| OpenAI Agents SDK | Not yet built |
Compute
Section titled “Compute”Prove runs on your machine by default. For a large sweep it runs on a cluster in your own AWS,
GCP or Azure account, set up with your team during onboarding, or on Modal
(poisson-prove sweep --backend modal).