Skip to main content

agrag.eval.trajectory.verifier_before_answer_metric

verifier_before_answer_metric(*, threshold:float = 0.5) -> ScoreMetric

Build the metric that the verifier ran before the answer.

Passes when the planner's last LLM span starts after at least one verifier task span ended. Scores 1.0 or 0.0.

Parameters:

  • threshold (float) – The minimum score that counts as success.

Returns:

  • ScoreMetric – A ScoreMetric that scores verifier-before-answer.