Dom
|
6544ebe3f0
|
feat(evaluation): add 16 LeaBench cases from replay failures
Extend LeaBench computer-use coverage with cases mined from
data/training/replay_failures/. Adds 8 distinct categories:
save_as visible, target absent (blank desktop / wrong window),
start button, start-menu search, task-view wrong state, systray
overflow, ambiguous tab labels, modal-blocker dialogs, and a
wrong-window Lea-terminal case.
- 16 new cases in benchmarks/computer_use/cases/leabench_extended_2026-05-24.jsonl
- 0 duplicate case_id vs notepad_replay_failures_2026-05-24.jsonl
- Validated with: python3 tools/lea_bench.py --cases ... --json
- pytest tests/unit/test_computer_use_bench.py: 7 passed
|
2026-05-24 21:57:24 +02:00 |
|