SOURCE-PINNED BENCHMARK RECORDS
Public task library
4,452 public benchmark task definitions and 831 parameterized definitions (templates and level variants) from 17 pinned benchmark sources, with original instructions, verifier references and source snapshots.
Definitions, not execution scores. Original wording and upstream licenses are retained.
Compare sources
| Source | Records | Platform | License | Evidence |
|---|---|---|---|---|
| OSWorld | 418 | Linux / Windows | Apache-2.0 | b138d348 · Source ZIP |
| Windows Agent Arena | 154 | Windows | MIT | 6d39ed88 · Source ZIP |
| WebArena | 812 | Web | Apache-2.0 | dce04686 · Source ZIP |
| VisualWebArena | 910 | Web | MIT | 89f5af29 · Source ZIP |
| macOSWorld | 231 | macOS | CC-BY-NC-4.0 | e2ca8334 · Source ZIP |
| AndroidWorld | 116 | Android | Apache-2.0 | 30583e22 · Source ZIP |
| TheAgentCompany | 175 | Linux | MIT | 98b68ef8 · Source ZIP |
| Enterprise-Bench (DevRev) | 14 | Linux | Apache-2.0 | c921345c · Source ZIP |
| iOSWorld | 133 | iOS | Apache-2.0 | c59287b6 · Source ZIP |
| WorkArena / WorkArena++ | 715 | Web | Apache-2.0 | e8851309 · Source ZIP |
| CADWorld | 200 | Linux | Apache-2.0 | fa02aa03 · Configuration ZIP |
| DeskCraft | 538 | Linux | Apache-2.0 | 73985ecd · Source ZIP |
| WeaveBench | 114 | Linux | MIT | cd887bf5 · Source ZIP |
| WindowsWorld | 181 | Windows | Apache-2.0 | fbccd464 · Source ZIP |
| OmegaUse-OfficeVal | 100 | Not declared | Apache-2.0 | 5f3da616 · Source ZIP |
| SCUBA | 300 | Web | Apache-2.0 | b893e223 · Source ZIP |
| Finch / FinWorkBench | 172 | Not declared | CC-BY-3.0-US | 530700c2 · Original JSONL + data card ZIP |