SOURCE-PINNED BENCHMARK RECORDS
Public task library
4,280 public benchmark task definitions and 831 parameterized definitions (templates and level variants) from 16 pinned benchmark sources, with original instructions, verifier references and source snapshots.
Definitions, not execution scores. Original wording and upstream licenses are retained.
Compare sources
| Source | Records | Platform | License | Evidence |
|---|---|---|---|---|
| OSWorld | 418 | Linux / Windows | Apache-2.0 | b138d348 · Source ZIP |
| Windows Agent Arena | 154 | Windows | MIT | 6d39ed88 · Source ZIP |
| WebArena | 812 | Web | Apache-2.0 | dce04686 · Source ZIP |
| VisualWebArena | 910 | Web | MIT | 89f5af29 · Source ZIP |
| macOSWorld | 231 | macOS | CC-BY-NC-4.0 | e2ca8334 · Source ZIP |
| AndroidWorld | 116 | Android | Apache-2.0 | 30583e22 · Source ZIP |
| TheAgentCompany | 175 | Linux | MIT | 98b68ef8 · Source ZIP |
| Enterprise-Bench (DevRev) | 14 | Linux | Apache-2.0 | c921345c · Source ZIP |
| iOSWorld | 133 | iOS | Apache-2.0 | c59287b6 · Source ZIP |
| WorkArena / WorkArena++ | 715 | Web | Apache-2.0 | e8851309 · Source ZIP |
| CADWorld | 200 | Linux | Apache-2.0 | fa02aa03 · Configuration ZIP |
| DeskCraft | 538 | Linux | Apache-2.0 | 73985ecd · Source ZIP |
| WeaveBench | 114 | Linux | MIT | cd887bf5 · Source ZIP |
| WindowsWorld | 181 | Windows | Apache-2.0 | fbccd464 · Source ZIP |
| OmegaUse-OfficeVal | 100 | Not declared | Apache-2.0 | 5f3da616 · Source ZIP |
| SCUBA | 300 | Web | Apache-2.0 | b893e223 · Source ZIP |