A curated collection of the world’s most advanced benchmark datasets for evaluating Large Language Model (LLM) Agents.
🧠 Discover and evaluate advanced benchmark datasets for Large Language Model agents to enhance performance assessment in real-world tasks.
麋鹿ai测试集（Elk AI Test Set）：通用 AI 产品评测 Skill，覆盖目标、样本、评分标准与 CSV/Excel 汇总。
Security evaluation datasets for DSH plugins
Synthetic industrial-manual RAG evaluation pack for revisions, wrong-model traps, access boundaries, abstention, and citations
Turns raw production logs into a labeled, deduplicated, statistically validated eval dataset. Human-vs-judge agreement measured double-blind (Cohen's κ + bootstrap CI95): a first run blocked at κ=0.26, drove a guideline fix, then cleared at κ=0.80 on the target domain. Honest dedup, HDBSCAN coverage, sha256 provenance, 677 offline tests.
To associate your repository with the evaluation-dataset topic, visit your repo's landing page and select "manage topics."