toy
anthropicclaude-haiku-4-5complete- Pass rate
- 1/5 (20%)
- Cost
- $0.2500
- Avg latency
- 584ms
- Started
- May 2, 2026, 10:46 PM
- Triggered
- api-seed
Prompt template
Answer with a single lowercase word and nothing else. No punctuation, no quotes, no explanation. Question: __SAMPLE__
Results
| Pass | Src | Input | Expected | Output | Score | Cost | Latency |
|---|---|---|---|---|---|---|---|
| ✗ | A | What is the opposite of hot? | cold | cold. | 0% exact: expected "cold", got "cold." | $0.0600 | 204ms |
| ✓ | A | What color is the sky on a clear day? | blue | blue | 100% | $0.0400 | 534ms |
| ✗ | A | What animal says "meow"? | cat | dog | 0% exact: expected "cat", got "dog" | $0.0600 | 689ms |
| ✗ | A | How many legs does a spider have? Answer as a written-out number. | eight | six | 0% exact: expected "eight", got "six" | $0.0500 | 694ms |
| ✗ | A | Capital of France? | paris | london | 0% exact: expected "paris", got "london" | $0.0400 | 800ms |