Run 47JP8EFZ
completed
ci
13 Aug 2026, 10:02
95.5%
▲ 0.4 vs baseline
All 8 rows passed. Pass rate 93.0%.
8 rows × 24 samples
cost $0.0143
judge $0.0057 4m 0s
gate passed
bf07d53 · main · Add two price-match cases
github
| Input | Samples | Score | vs baseline | Cost inc. judge |
|---|---|---|---|---|
|
▶
Can I get a refund without a receipt?
anthropic/claude-sonnet-5
|
3/3 | 91.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.9s stop
91.5%
Input
Can I get a refund without a receipt? Expected
receipt Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: receipt actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Is there a warranty on clearance items?
anthropic/claude-sonnet-5
|
3/3 | 91.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.0s stop
91.5%
Input
Is there a warranty on clearance items? Expected
no warranty Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no warranty actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Do you price match other retailers?
anthropic/claude-sonnet-5
|
3/3 | 93.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.6s stop
93.5%
Input
Do you price match other retailers? Expected
no Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Can I change the delivery address after ordering?
anthropic/claude-sonnet-5
|
3/3 | 93.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 2.5s stop
93.5%
Input
Can I change the delivery address after ordering? Expected
before dispatch Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: before dispatch actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Do you ship to Australia?
anthropic/claude-sonnet-5
|
3/3 | 95.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.4s stop
95.5%
Input
Do you ship to Australia? Expected
no Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Do you offer student discount?
anthropic/claude-sonnet-5
|
3/3 | 95.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 2.6s stop
95.5%
Input
Do you offer student discount? Expected
no Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: no actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
What time do you close on a Tuesday?
anthropic/claude-sonnet-5
|
3/3 | 97.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.9s stop
97.5%
Input
What time do you close on a Tuesday? Expected
5pm Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: 5pm actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
I bought a lamp last week, can I still return it?
anthropic/claude-sonnet-5
|
3/3 | 99.5% | +0.4 | $0.0018 |
|
anthropic/claude-sonnet-5 412→96 tok
$0.0018 1.7s stop
99.5%
Input
I bought a lamp last week, can I still return it? Expected
30 days Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: 30 days actual: According to our policy, that is not something we currently offer. I can point y...
|
||||