SOURCE-PINNED BENCHMARK RECORDS
Public task library
3,699 public benchmark task definitions and 831 parameterized definitions (templates and level variants) from 13 pinned benchmark sources, with original instructions, verifier references and source snapshots.
Definitions, not execution scores. Original wording and upstream licenses are retained.
Compare sources
| Source | Records | Platform | License | Evidence |
|---|---|---|---|---|
| OSWorld | 418 | Linux / Windows | Apache-2.0 | b138d348 · Source ZIP |
| Windows Agent Arena | 154 | Windows | MIT | 6d39ed88 · Source ZIP |
| WebArena | 812 | Web | Apache-2.0 | dce04686 · Source ZIP |
| VisualWebArena | 910 | Web | MIT | 89f5af29 · Source ZIP |
| macOSWorld | 231 | macOS | CC-BY-NC-4.0 | e2ca8334 · Source ZIP |
| AndroidWorld | 116 | Android | Apache-2.0 | 30583e22 · Source ZIP |
| TheAgentCompany | 175 | Linux | MIT | 98b68ef8 · Source ZIP |
| Enterprise-Bench (DevRev) | 14 | Linux | Apache-2.0 | c921345c · Source ZIP |
| iOSWorld | 133 | iOS | Apache-2.0 | c59287b6 · Source ZIP |
| WorkArena / WorkArena++ | 715 | Web | Apache-2.0 | e8851309 · Source ZIP |
| CADWorld | 200 | Linux | Apache-2.0 | fa02aa03 · Configuration ZIP |
| DeskCraft | 538 | Linux | Apache-2.0 | 73985ecd · Source ZIP |
| WeaveBench | 114 | Linux | MIT | cd887bf5 · Source ZIP |