Method · Money
The universal verifier pipeline
To verify an agent trajectory: generate a good rubric with N criteria of what success looks like; rank the trajectory's screenshots by relevance for each criterion and use the top-K evidence to determine whether each criterion was met; check for contradictions between what the agent said it did and the actual environment state; output a scored rubric with process score (partial credit in some cases) plus an outcome Boolean for whether the agent accomplished the task as a reasonable user would expect.
AI Engineer · Your LLM Judge Is a Confident Liar: Building Better Verifiers — Browserbase
Method described by Miguel Pagano
Method preserved for inspection; not a verified protocol.