Run WH9WXQYN
completed
★ baseline
ci
30 Jul 2026, 10:02
100.0%
All 6 rows passed. Pass rate 100.0%.
6 rows × 6 samples
cost $0.0018
judge $0.0007 4m 0s
gate passed
2cc5cd7 · main · Add the billing category
github
| Input | Samples | Score | vs baseline | Cost inc. judge |
|---|---|---|---|---|
|
▶
My order never arrived and nobody has replied
openai/gpt-5-mini
|
3/3 | 96.0% | — | $0.0003 |
|
openai/gpt-5-mini 412→96 tok
$0.0003 1.2s stop
96.0%
Input
My order never arrived and nobody has replied Expected
delivery Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: delivery actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Please cancel my subscription immediately
openai/gpt-5-mini
|
3/3 | 96.0% | — | $0.0003 |
|
openai/gpt-5-mini 412→96 tok
$0.0003 2.2s stop
96.0%
Input
Please cancel my subscription immediately Expected
billing Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: billing actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
I was charged twice for the same order
openai/gpt-5-mini
|
3/3 | 98.0% | — | $0.0003 |
|
openai/gpt-5-mini 412→96 tok
$0.0003 1.0s stop
98.0%
Input
I was charged twice for the same order Expected
billing Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: billing actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
The app crashes when I open my basket
openai/gpt-5-mini
|
3/3 | 100.0% | — | $0.0003 |
|
openai/gpt-5-mini 412→96 tok
$0.0003 2.2s stop
100.0%
Input
The app crashes when I open my basket Expected
technical Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: technical actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
Can you tell me when you are open?
openai/gpt-5-mini
|
3/3 | 100.0% | — | $0.0003 |
|
openai/gpt-5-mini 412→96 tok
$0.0003 1.7s stop
100.0%
Input
Can you tell me when you are open? Expected
general Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: general actual: According to our policy, that is not something we currently offer. I can point y...
|
||||
|
▶
This is the third time I have written about this
openai/gpt-5-mini
|
3/3 | 100.0% | — | $0.0003 |
|
openai/gpt-5-mini 412→96 tok
$0.0003 2.0s stop
100.0%
Input
This is the third time I have written about this Expected
urgent Response
According to our policy, that is not something we currently offer. I can point you to the relevant page if that would help. Assertions
✓
contains
deterministic · gate
1.00
expected: urgent actual: According to our policy, that is not something we currently offer. I can point y...
|
||||