Observability and eval review for LLM products

Authenticated session

App

Overview Traces Failures Evals Regressions Alerts Settings

Authenticated product

Alerts

Configure webhook notifications triggered when an eval score drops below a threshold.

Rule name

Eval definition ID

Webhook URL

Score threshold (0–1)

Loading…

Evidence

How alerts work

Triggerscore < threshold

MethodPOST (JSON)

Payloadeval_definition_id, score, passed, threshold

RetriesNone — check delivery log