Run DACZHZPC
completed
★ baseline
ci
9 Jul 2026, 10:02
95.1%
All 8 rows passed. Pass rate 93.0%.
8 rows × 24 samples
cost $0.0143
judge $0.0057 4m 0s
gate passed
bd10bfe · main · Add refund policy to the system prompt
github
| Input | Samples | Score | vs baseline | Cost inc. judge |
|---|---|---|---|---|
|
▶
Can I get a refund without a receipt?
anthropic/claude-sonnet-5
|
3/3 | 91.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.7s stop
91.1%
Input
Can I get a refund without a receipt? Expected
receipt Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: receipt actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Is there a warranty on clearance items?
anthropic/claude-sonnet-5
|
3/3 | 91.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.9s stop
91.1%
Input
Is there a warranty on clearance items? Expected
no warranty Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no warranty actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Do you price match other retailers?
anthropic/claude-sonnet-5
|
3/3 | 93.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.3s stop
93.1%
Input
Do you price match other retailers? Expected
no Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Can I change the delivery address after ordering?
anthropic/claude-sonnet-5
|
3/3 | 93.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.8s stop
93.1%
Input
Can I change the delivery address after ordering? Expected
before dispatch Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: before dispatch actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Do you ship to Australia?
anthropic/claude-sonnet-5
|
3/3 | 95.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.8s stop
95.1%
Input
Do you ship to Australia? Expected
no Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Do you offer student discount?
anthropic/claude-sonnet-5
|
3/3 | 95.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.0s stop
95.1%
Input
Do you offer student discount? Expected
no Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
What time do you close on a Tuesday?
anthropic/claude-sonnet-5
|
3/3 | 97.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.7s stop
97.1%
Input
What time do you close on a Tuesday? Expected
5pm Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: 5pm actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
I bought a lamp last week, can I still return it?
anthropic/claude-sonnet-5
|
3/3 | 99.1% | — | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.3s stop
99.1%
Input
I bought a lamp last week, can I still return it? Expected
30 days Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: 30 days actual: According to our policy, that is not something we currently offer. I can point y...
|
||||