Evaluation & Benchmarks · 2023
Agent/Web Benchmarks (AgentBench/WebArena/GAIA/tau-bench)
A family of interactive agent benchmarks (WebArena, AgentBench, GAIA, tau-bench) that evaluate models on multi-step tasks in realistic executable environments (live websites, tools, APIs, simulated customer service) rather than static prompts, measuring whether an agent actually completes a goal.
Editorial record
Plain-language summary
Static QA benchmarks cannot measure whether a model can plan and act over many steps against a stateful environment. WebArena provides self-hosted realistic websites where agents must navigate and complete tasks judged by end-state, AgentBench spans multiple environments (OS, database, web, games), GAIA poses real-world questions needing tool use and multi-hop reasoning, and tau-bench simulates tool-and-user customer-service dialogues. By scoring task completion in executable settings, they exposed a large gap between chat competence and reliable agentic execution.
Source record
Provenance
- Record ID
- P-446
- Record created
- 2026-07-13
- Last reviewed
- 2026-07-14
- Record version
- 2
- https://arxiv.org/abs/2311.12983
- arXiv:2311.12983
Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.