Agent Trajectory Evaluation
AgentBench
BrowseComp
GAIA Benchmark
LLM-as-Judge (Agent)
Mind2Web
OSWorld
SWE-bench
Task Success Rate
Tau-bench
-
D
Agent Evals — LangChain/LangSmith docs: trajectory match and LLM-as-judge trajectory evaluators Docs 1 term
-
-
A
AI Agents That Matter (Kapoor et al., Princeton) — accuracy-only agent benchmarking and cost Pap… 1 term
-
-
C
Evaluate Gen AI agents — trajectory metrics (exact/in-order/any-order match, precision, recall) Docs 1 term
-
-
-
-
-
O
Mind2Web project page (OSU NLP) — 2,350 tasks, 137 websites, cross-task/website/domain settings Art… 1 term
-
-
A
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments (arXiv paper, NeurIPS 2024) Pap… 1 term
-
O
OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments (official project page) Art… 1 term
-
-
-
-
-
G
THUDM/AgentBench — benchmark code, 8 interactive environments (OS, DB, KG, web, games) Code 1 term
-
H
Using LLM-as-a-judge for an automated and versatile evaluation — Hugging Face Cookbook Docs 1 term
-
-
No terms or links match your search.