Skip to content
Poisson Labs Docs
GitHub poissonlabs.ai

Connect

If you already score your agent with another tool, Trace can tell you whether the difference between two versions is real. poisson-trace-import reads the result files that tool wrote, one import per version, and poisson-trace fix-check compares them.

Terminal window
poisson-trace-import deepeval old.json --store ./store --run old \
--metric "Tests Passed" --cut recorded --case name
poisson-trace-import deepeval new.json --store ./store --run new \
--metric "Tests Passed" --cut recorded --case name
poisson-trace fix-check old new --store ./store --event missed --inputs all --max-mde 0.05

You name the metric, the cut and what identifies a case. Nothing has a default. The importer runs no metric and calls no model.

ModelConnects through
ClaudeTasks’ anthropic provider, with your own Anthropic key
ToolReads
DeepEvalDeepEval’s saved test runs, one metric per import
RagasThe score table saved from Ragas, one score column per import
LangSmithNot yet built
Framework
OpenAI Agents SDKNot yet built

Prove runs on your machine by default. For a large sweep it runs on a cluster in your own AWS, GCP or Azure account, set up with your team during onboarding, or on Modal (poisson-prove sweep --backend modal).