Exhibit & case-document preparation
Bates-stamp, assemble binders and build exhibit lists.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- Acrobat · Word · Excel
- Class GUI-need label
HY· Hybrid
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R10.01.01.03-T01 Bates-stamp a 14-document production in Acrobat
Original instruction
input/production_vol1/ has 14 PDFs (synthetic, 212 pages). In Adobe Acrobat Pro apply Bates numbering in file-name order: prefix KES, 7 digits starting at 0001001, bottom-right, Helvetica 9 pt, 0.5 in margins. Save stamped files to output/vol1_bates/ keeping file names and add a Bates range CSV (file, begin, end) at output/vol1_ranges.csv.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro app- Proposed difficulty
- 2 / 5
Proposed verifier
pdfplumber: each page's footer text in the bottom-right 1.5 x 0.75 in box equals the expected Bates number, continuous across files; font size 9 +/- 0.5; ranges CSV exact. No PDF libraries are installed on the VM, and stamps must carry Acrobat pagination artifacts (PieceInfo ADBE_CompoundType); stamps drawn by scripts without them are detected and fail.
Proposed partial credit
50% continuous correct numbers; 20% position and font; 30% ranges CSV.
R10.01.01.03-T02 Merge exhibits in list order with bookmarks and Bates numbers
Original instruction
input/exhibits/ holds 14 exhibit PDFs and input/exhibit_list.txt gives the order and titles. Combine them into output/exhibits_combined.pdf in list order, add one top-level bookmark per exhibit named 'PX-<n> - <title>' pointing to its first page, then Bates-number the combined file with prefix PX starting at 000001.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickdrag· Drag & droptype· Text & forms- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
pypdf: page sequence matches source files in list order (page-hash match); 14 bookmarks with exact titles and correct destinations; footer Bates continuous from PX000001. Page-content hashes guard against re-rendered or missing pages.
Proposed partial credit
35% order and completeness; 35% bookmarks; 30% Bates.
R10.01.01.03-T03 Build a trial exhibit list from stamped exhibits
Original instruction
output from a prior step is in input/stamped_exhibits/ (37 Bates-stamped PDFs). Fill input/exhibit_list_template.xlsx (court form: Ex. No., Date, Description, Bates Begin, Bates End, Sponsoring Witness, Offered, Admitted) using each document's first page for date and description and input/witness_map.csv for witnesses; sort by exhibit number.
- Platforms
mac· macOSwin· Windows- Applications
- Excel · Adobe Acrobat Reader
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
type· Text & formsvis· Visual judgmentmulti· Cross-app- Work product
WP02· Records/table- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
openpyxl: 37 rows; Bates begin/end exact (read from stamped PDFs); dates exact; witness exact; Offered/Admitted blank; template formatting and header preserved; description similarity to gold >= 0.6 token F1 (heuristic, no LLM).
Proposed partial credit
40% Bates ranges; 20% dates; 20% witnesses; 20% descriptions and template intact.
R10.01.01.03-T04 Assemble a tabbed trial binder with a linked table of contents
Original instruction
Build output/binder_motion_in_limine.pdf from input/binder_contents.xlsx (23 items: pleadings, exhibits, cases). Each item is preceded by a tab slip sheet ('Tab N' centered, 36 pt), a table of contents up front lists tab, description and binder page with clickable links, bookmarks mirror the TOC, and every page carries 'Page x of y' bottom-center except slip sheets.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro · Word · Excel
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro appmultiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
PDF checks: 23 slip sheets with correct text; TOC page numbers equal actual start pages; TOC link annotations resolve to those pages; bookmarks 23 with exact titles; page footer pattern on non-slip pages only; all source pages present by hash.
Proposed partial credit
25% slip sheets and order; 30% TOC numbers and links; 20% bookmarks; 25% pagination rule.
R10.01.01.03-T05 Place exhibit stickers on first pages without covering text
Original instruction
input/trial_exhibits/ has 20 PDFs. Create a custom dynamic stamp in Adobe Acrobat Pro reading 'PLAINTIFF'S EXHIBIT' with a number field and case number 1:26-cv-01234, and apply it to the first page of each exhibit with its number from input/exhibit_numbers.csv, placed in the lower-right blank area so no existing text or image is covered. Save to output/stickered/.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
geom· Precise geometryvis· Visual judgmentclick· Point & click- Work product
WP10· Annotations- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Each first page has one /Stamp annotation with the right number (appearance-stream text); stamp rectangle overlaps no text/image bbox from pdfplumber (tolerance 2 pt) and lies within the lower-right quadrant; other pages unchanged. No PDF libraries are installed on the VM, and stamps without Acrobat's dynamic-stamp appearance structure are detected as scripted and fail.
Proposed partial credit
40% correct numbers; 40% no-overlap placement; 20% stamp definition reused.
R10.01.01.03-T06 Reconcile plaintiff and defendant exhibit lists into a joint list and relabel
Original instruction
input/px_list.xlsx (142 exhibits) and input/dx_list.xlsx (118) overlap. Build output/joint_exhibit_list.docx on the court template input/joint_template.docx: dedupe documents whose Bates ranges overlap, assign JX numbers in date order, keep PX/DX cross-references and each side's objections column. Then re-stamp the 60 shared PDFs in input/exhibit_pdfs/ with JX stickers.
- Platforms
mac· macOSwin· Windows- Applications
- Excel · Word · Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
multi· Cross-apptype· Text & formsclick· Point & clickcode· Code & commands- Work product
WP02· Records/table- Conditions
multiapp· Multi-applong· Long-horizonlicensed· Licensed pro app- Proposed difficulty
- 5 / 5
Proposed verifier
Docx table parsed: row set equals gold joint list (dedup by Bates overlap), JX numbering in date order exact, cross-refs and objections carried; template styles intact; 60 PDFs carry JX stamps matching the table.
Proposed partial credit
35% correct dedup; 25% JX numbering; 20% cross-refs and objections; 20% re-stamped PDFs.
R10.01.01.03-T07 Add a protective-order legend to six documents
Original instruction
Add the footer 'CONFIDENTIAL - SUBJECT TO PROTECTIVE ORDER' (bottom-left, 8 pt, red) to every page of the 6 PDFs in input/confidential/ without altering their existing Bates numbers, saving to output/confidential_legend/. Use PDF-XChange Editor on Windows.
- Platforms
win· Windows- Applications
- PDF-XChange Editor
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP09· Files & folders- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Every page has the legend text in the bottom-left region with red fill (RGB r>0.8) and size 8 +/- 0.5; existing Bates text unchanged at its original position; page counts unchanged.
Proposed partial credit
60% legend on all pages; 20% style; 20% Bates untouched.
R10.01.01.03-T08 Highlight deposition designations by party on a transcript PDF
Original instruction
input/depo_marlow.pdf is a 180-page deposition transcript (25 lines per page) and input/designations.xlsx lists page:line ranges designated by plaintiff, defendant (counter-designations) and objections. In Acrobat, highlight plaintiff ranges yellow, defendant ranges blue, and add a sticky note with the objection text at the start of each objected range. Save output/depo_marlow_designated.pdf.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro · Excel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
path· Continuous pathnav· Pan/zoom/scrollclick· Point & click- Work product
WP10· Annotations- Conditions
licensed· Licensed pro appmultiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Highlight annotations' QuadPoints mapped to transcript lines via pdfplumber: line-level F1 >= 0.95 per party with correct colors; one note per objected range anchored on its first line with exact text. No PDF libraries are installed on the VM and Acrobat's JavaScript console is disabled, so the annotations must be drawn in Acrobat.
Proposed partial credit
40% plaintiff highlights; 30% defendant highlights; 30% objection notes.
R10.01.01.03-T09 Hyperlink every record citation in a brief to its appendix page
Original instruction
input/brief.pdf cites the record as 'App. 123' and 'Ex. 7 at 4'; input/appendix.pdf (412 pages, page labels App. 1..412) is the combined record. Create output/brief_linked.pdf in which every record citation is a link to the right page of appendix.pdf (relative file link), and the appendix itself gets bookmarks per exhibit from input/exhibit_index.csv.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickgeom· Precise geometrycode· Code & commands- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Link annotations over each of 96 gold citation spans (rect covers >= 80% of span bbox) with GoToR destinations to the correct page; no links on non-citations; appendix bookmarks exact.
Proposed partial credit
60% citation links correct; 15% no spurious links; 25% appendix bookmarks.
R10.01.01.03-T10 Compute a Bates index with page counts for a production volume
Original instruction
input/vol2_bates/ contains 85 Bates-stamped PDFs. Produce output/vol2_index.xlsx with columns File, Pages, Bates Begin, Bates End, Custodian (from input/custodians.csv by file prefix), Date (document date from metadata) and a total row; flag any gap or overlap in the Bates sequence in a 'Gaps' sheet.
- Platforms
mac· macOSwin· Windowslin· Linux- Applications
- Excel · Python
- Interfaces
desk· Desktop GUIterm· Terminal- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commandstype· Text & forms- Work product
WP02· Records/table- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Index rows equal gold (85) with pages and Bates exact; custodian and date exact; Gaps sheet lists exactly the 2 seeded gaps and 1 overlap; total row correct.
Proposed partial credit
45% Bates and pages; 20% custodian/date; 25% gaps found; 10% total row.
R10.01.01.03-T11 Build TrialDirector callouts for five key exhibits
Original instruction
TrialDirector 360 case 'Halvorsen v. Kestrel (synthetic)': import exhibits PX-3, PX-7, PX-12, PX-19, PX-24 from input/key_exhibits/ and create one saved callout (zoomed region with highlight) per exhibit framing the passage quoted in input/opening_outline.docx, named 'Open-<n>', and order them in a presentation playlist in outline order.
- Platforms
win· Windows- Applications
- TrialDirector 360 · Word
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
geom· Precise geometrydrag· Drag & dropvis· Visual judgment- Work product
WP03· Visual layout- Conditions
licensed· Licensed pro appmultiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
Exported case database/playlist: 5 callouts with names and order exact; each callout rectangle covers the gold passage bbox (coverage >= 90%, area <= 3x passage) with highlight inside. TrialDirector exposes no API or scripting interface, and callout geometry exists only in its case database, so callouts can be produced only through the app.
Proposed partial credit
20% exhibits imported; 50% callout regions; 15% names; 15% playlist order.
R10.01.01.03-T12 Assemble a paginated joint appendix for an appeal
Original instruction
From input/ja_designations.xlsx (41 docket items with page ranges) and input/district_docket/ PDFs, build output/joint_appendix.pdf per input/frap30_local_rules.pdf: cover page, chronological docket sheet first, items in docket order, page numbers JA0001.. at bottom center, a table of contents with JA page and links, bookmarks per item, text-searchable, under 100 MB.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro · Excel
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickmulti· Cross-appcode· Code & commands- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro applong· Long-horizonmultiapp· Multi-app- Proposed difficulty
- 5 / 5
Proposed verifier
Page sequence matches designated ranges in docket order (page hashes); JA numbers continuous from cover+TOC rule; TOC entries and links equal actual JA pages; 41 bookmarks; pdftotext non-empty on all pages; size < 100 MB.
Proposed partial credit
35% correct page set and order; 20% JA pagination; 25% TOC and links; 20% bookmarks, OCR and size.
R10.01.01.03-T13 Annotate a site photograph as a demonstrative exhibit
Original instruction
input/dock_photo.jpg shows a loading dock (synthetic). In Acrobat create output/demo_dock.pdf: the photo fitted on a letter landscape page, 4 labeled callout arrows pointing to the features named in input/demo_spec.txt (bollard, ramp edge, warning sign, drain), a title, an exhibit sticker 'DX-41' and a legend; arrows must end on the named features.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
geom· Precise geometryvis· Visual judgmentdrag· Drag & drop- Work product
WP03· Visual layout- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Annotation parse: 4 callout/line annotations whose arrowhead endpoints fall inside the gold feature boxes (in page coordinates after image placement); label texts exact; title, sticker and legend present; image not cropped (aspect preserved). No PDF libraries are installed on the VM and Acrobat's JavaScript console is disabled, so the page must be authored in Acrobat.
Proposed partial credit
50% arrows on correct features; 20% labels; 30% layout elements.
R10.01.01.03-T14 Rename and file exhibits by the naming convention
Original instruction
input/raw_exhibits/ has 30 PDFs with scanner names. Using input/exhibit_list.xlsx, rename each to 'PX-<3-digit no>_<YYYY-MM-DD>_<ShortTitle>.pdf' and move them into output/exhibits/<witness>/ folders per the list; leave unlisted files in input/ untouched.
- Platforms
mac· macOSwin· Windows- Applications
- Finder · File Explorer · Excel
- Interfaces
desk· Desktop GUIterm· Terminal- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
type· Text & formsdrag· Drag & dropmulti· Cross-app- Work product
WP09· Files & folders- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Folder tree equals gold (names exact, content hashes match the mapped sources); 3 unlisted files still in input/.
Proposed partial credit
60% names exact; 30% folders; 10% unlisted untouched.
R10.01.01.03-T15 Apply per-document confidentiality legends and Bates in one pass
Original instruction
input/vol3/ has 48 PDFs and input/designations.csv assigns each 'CONFIDENTIAL' or 'HIGHLY CONFIDENTIAL - AEO' or none. In Acrobat Pro build an Action Wizard action (or equivalent) that applies the right legend bottom-left and Bates KES0003001.. bottom-right, run it, and save output/vol3_produced/ plus the action file output/legend_bates.sequ.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Per-file legend text equals designation (none means no legend); Bates continuous across files in name order; both in the right corners; .sequ file present and references the header/footer steps. No PDF libraries are installed on the VM; legends and Bates must be Acrobat header/footer artifacts (PieceInfo), and files where they are absent are detected as scripted.
Proposed partial credit
45% legends correct per file; 35% Bates; 20% reusable action saved.
R10.01.01.03-T16 OCR, deskew and rotate scanned exhibits while keeping Bates intact
Original instruction
input/scans/ has 12 scanned exhibits (some pages sideways, skewed up to 4 degrees) already Bates-stamped as images. Make them text-searchable with correct page orientation and deskew in Acrobat Pro (Enhance Scans), without changing page order or removing the stamped Bates, and save to output/searchable/.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
pdftotext yields text on all pages with word accuracy >= 95% vs gold; page rotation upright (text direction check); residual skew <= 0.5 degree; Bates OCR still matches gold on every page; page count unchanged. OCR engines and PDF libraries are not installed on the VM, and the text layer must carry Acrobat's Paper Capture producer metadata.
Proposed partial credit
40% OCR accuracy; 30% orientation and skew; 30% Bates preserved.
R10.01.01.03-T17 Build a master exhibit cross-reference from five deposition transcripts
Original instruction
input/depos/ holds 5 deposition transcripts (PDF) whose exhibit indexes list deposition exhibit numbers and descriptions; input/production_index.xlsx maps Bates ranges to documents. Create output/exhibit_xref.xlsx (Depo, Depo Ex. No., Description, Bates Begin, Trial Ex. No.) matching each deposition exhibit to its produced document and to the trial number in input/trial_list.xlsx; flag unmatched exhibits.
- Platforms
mac· macOSwin· Windows- Applications
- Excel · Adobe Acrobat Pro
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
multi· Cross-appnav· Pan/zoom/scrolltype· Text & forms- Work product
WP02· Records/table- Conditions
multiapp· Multi-applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Rows equal gold (73 deposition exhibits); Bates begin exact for matched rows (accuracy >= 95%); trial numbers exact; the 4 seeded unmatched exhibits flagged; no fabricated matches.
Proposed partial credit
25% all exhibits listed; 40% Bates matches; 20% trial numbers; 15% unmatched flagged.
R10.01.01.03-T18 Compile three witness binders from the exhibit list
Original instruction
From input/exhibit_list.xlsx (sponsoring witness column) and input/stamped_exhibits/, build one PDF binder per witness (output/binders/<witness>.pdf) with a cover page naming the witness and case, a linked index of exhibits, a tab slip sheet before each exhibit and bookmarks; exhibits shared by two witnesses appear in both.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Pro · Excel · Word
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
multi· Cross-appclick· Point & clicktype· Text & forms- Work product
WP09· Files & folders- Conditions
licensed· Licensed pro appmultiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
3 binders; exhibit sets per witness equal gold (shared ones duplicated); order by exhibit number; index entries link to the right pages; slip sheets and bookmarks present; source pages present by hash.
Proposed partial credit
40% correct exhibit sets; 25% index and links; 20% slip sheets/bookmarks; 15% covers.
R10.01.01.03-T19 Merge, bookmark and Bates-stamp the same exhibits with CLI tools (control)
Original instruction
Control pair of T02. With qpdf, pypdf or reportlab only, combine input/exhibits/ in the order of input/exhibit_list.txt into output/exhibits_combined.pdf with one bookmark per exhibit ('PX-<n> - <title>') and Bates PX000001.. stamped bottom-right.
- Platforms
lin· Linux- Applications
- qpdf · Python
- Interfaces
term· Terminal- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commands- Work product
WP09· Files & folders- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same checks as T02 (page order by hash, bookmark titles/destinations, Bates continuity and position). Measures the GUI-vs-CLI gap.
Proposed partial credit
35% order; 35% bookmarks; 30% Bates.
R10.01.01.03-T20 Split a production PDF at slip sheets and name parts by Bates
Original instruction
input/prod_vol4.pdf (612 pages) is a single production file where each document starts after a slip sheet reading 'DOCUMENT BREAK'. In PDF-XChange Editor (Windows) split it into one PDF per document, dropping slip sheets, and name each part by its first-page Bates number (e.g. KES0004001.pdf) in output/vol4_docs/.
- Platforms
win· Windows- Applications
- PDF-XChange Editor
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicknav· Pan/zoom/scrolltype· Text & forms- Work product
WP09· Files & folders- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Output file set equals gold (57 files) by name; each file's page hashes equal the gold range; no slip-sheet pages remain; total pages = 612 - 57.
Proposed partial credit
50% correct split boundaries; 30% names; 20% slip sheets removed.
Mapped research references
No benchmark reference is assigned to this class in the current mapping.