tooltrace-bench/CITATION.cff at main · webdevsamran/tooltrace-bench · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
cff-version: 1.2.0
message: "If you use ToolTrace Bench, please cite it as below."
title: "ToolTrace Bench: vendor-neutral, reproducible benchmarking of AI agents"
type: software
authors:
  - name: webdevsamran
    alias: webdevsamran
    affiliation: "Independent / Open Source"
identifiers:
  - type: url
    value: "https://github.com/webdevsamran/tooltrace-bench"
repository-code: "https://github.com/webdevsamran/tooltrace-bench"
url: "https://github.com/webdevsamran/tooltrace-bench"
abstract: >-
  ToolTrace Bench is a vendor-neutral, reproducible benchmarking framework for
  AI agents. It measures task completion, tool-use correctness, failure
  recovery, step efficiency, workspace safety, consistency across repeated
  runs, latency (wall/model/tool), and token/cost data when available — using
  deterministic executable scoring and complete versioned JSONL traces.
keywords:
  - benchmarking
  - ai-agents
  - evaluation
  - tool-use
  - reliability
  - reproducibility
license: Apache-2.0
version: 0.3.0
date-released: "2026-09-07"