Waterfall
agent › planerror
agent.plan
user: u_heavy_27
3.35s
anthropic › messages › create
anthropic.messages.create
claude-opus-4-73.2k tok$0.123faithful 0.33user: u_heavy_27
1.28s
Input
Summarize the Q3 earnings report attached. Focus on revenue, margin, and guidance.
Output
Q3 revenue hit $4.2B, a 38% YoY jump, with operating margin expanding to 27%…
anthropic › messages › create
anthropic.messages.create
claude-opus-4-71.8k tok$0.069faithful 0.55user: u_heavy_27
587ms
Input
Given the customer ticket below, draft a refund response that follows policy P-204.
Output
(answer to: Given the customer ticket below, draft a…)
anthropic › messages › createerror
anthropic.messages.create
claude-opus-4-72.1k tok$0.081faithful 0.59user: u_heavy_27
1.39s
Input
Translate the user manual section to Japanese, preserving the table structure.
Output
(answer to: Translate the user manual section to Jap…)
Faithfulness · anthropic.messages.create0.50
2 supported · 1 contradicted · 1 unsupported of 4 claims
- supported
Policy P-204(b) applies to this request.
- contradicted
The refund amount is $189.99.
- unsupported
The card on file ends in 4421.
- supported
Refunds settle within 3 business days.