SOURCE-PINNED BENCHMARK RECORDS

Public task library

4,552 public benchmark task definitions and 831 parameterized definitions (templates and level variants) from 18 pinned benchmark sources, with original instructions, verifier references and source snapshots.

Definitions, not execution scores. Original wording and upstream licenses are retained.

Compare sources

SourceRecordsPlatformLicenseEvidence
OSWorld418Linux / WindowsApache-2.0b138d348 · Source ZIP
Windows Agent Arena154WindowsMIT6d39ed88 · Source ZIP
WebArena812WebApache-2.0dce04686 · Source ZIP
VisualWebArena910WebMIT89f5af29 · Source ZIP
macOSWorld231macOSCC-BY-NC-4.0e2ca8334 · Source ZIP
AndroidWorld116AndroidApache-2.030583e22 · Source ZIP
TheAgentCompany175LinuxMIT98b68ef8 · Source ZIP
Enterprise-Bench (DevRev)14LinuxApache-2.0c921345c · Source ZIP
iOSWorld133iOSApache-2.0c59287b6 · Source ZIP
WorkArena / WorkArena++715WebApache-2.0e8851309 · Source ZIP
CADWorld200LinuxApache-2.0fa02aa03 · Configuration ZIP
DeskCraft538LinuxApache-2.073985ecd · Source ZIP
WeaveBench114LinuxMITcd887bf5 · Source ZIP
WindowsWorld181WindowsApache-2.0fbccd464 · Source ZIP
OmegaUse-OfficeVal100Not declaredApache-2.05f3da616 · Source ZIP
SCUBA300WebApache-2.0b893e223 · Source ZIP
Finch / FinWorkBench172Not declaredCC-BY-3.0-US530700c2 · Original JSONL + data card ZIP
BankerToolBench100LinuxCC-BY-4.06407cdc2 · Original JSONL + data card ZIP

JSONL · Source manifest · Licenses and notices