Court e-filing & docket deadlines
File documents in e-filing portals and calendar deadlines correctly.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- CM/ECF (sandbox) · state e-filing portals
- Class GUI-need label
G3· GUI-only
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R10.01.01.02-T01 File a notice of appearance on a CM/ECF training clone
Original instruction
CM/ECF district-court training clone, test filer account for attorney 'A. Brennan (test)'. In case 1:26-cv-01234 (synthetic), file input/notice_of_appearance.pdf using the correct Notices event, select the party represented (defendant Kestrel Freight LLC), and complete the filing through the Notice of Electronic Filing screen. Save the NEF as output/nef.html.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Clone DB: new docket entry with event code 'Notice of Appearance', filer linked to the right party, PDF hash equals input; output/nef.html matches the generated NEF. CM/ECF exposes no filing API; entries carry the GUI session id.
Proposed partial credit
40% correct event; 30% correct party link; 20% document attached; 10% NEF saved.
R10.01.01.02-T02 Compute an answer deadline from service and calendar it with reminders
Original instruction
Docket entry 14 in case 1:26-cv-01234 (training clone) shows the summons returned executed on defendant Valmont Inc. Compute the answer deadline under FRCP 12(a)(1)(A)(i) and FRCP 6(a), using the court holiday list in input/court_holidays_2026.txt, and add an all-day event in the firm's Clio sandbox calendar with 14- and 3-day reminders and the matter linked.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training) · Clio (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Clio sandbox event date equals the gold deadline (weekend/holiday rollover applied); title includes 'Answer due'; reminders at 14 and 3 days; matter link exact. Clio API tokens are withheld from the agent, and the calendar audit log must show creation from the web UI.
Proposed partial credit
50% correct date; 20% event fields; 15% reminders; 15% matter link.
R10.01.01.02-T03 File a motion to compel with exhibits and a proposed order
Original instruction
CM/ECF training clone, case 1:26-cv-01234. File input/motion_to_compel.pdf as a 'Motion to Compel' with attachments: Exhibit A-C (input/exA.pdf..exC.pdf, each described as in the motion's exhibit list) and a Proposed Order. Select the relief 'compel discovery', link it to docket entry 22 (the discovery requests), and complete the filing.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
New entry: event Motion to Compel; 4 attachments in order with descriptions matching gold; relief selected; linked to entry 22; main doc hash correct. No API exists; GUI session recorded.
Proposed partial credit
30% event and relief; 35% attachments and descriptions; 20% link to entry 22; 15% filing completed.
R10.01.01.02-T04 Redact personal identifiers under Rule 5.2 and then file
Original instruction
input/motion_summary_judgment.pdf (48 pages, synthetic) contains full SSNs, dates of birth, a minor's full name and bank account numbers. In Adobe Acrobat Pro apply true redactions so only the last four digits, the birth year and the minor's initials remain, remove hidden metadata, save output/msj_redacted.pdf, then file it in CM/ECF training case 1:26-cv-01234 as a Motion for Summary Judgment.
- Platforms
mac· macOSwin· Windowsweb· Any OS (web)- Applications
- Adobe Acrobat Pro · CM/ECF (training)
- Interfaces
desk· Desktop GUIbrow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
HY· Hybrid- Interaction primitives
geom· Precise geometryclick· Point & clickmulti· Cross-app- Work product
WP08· App/system state- Conditions
licensed· Licensed pro appmultiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
Text layer and OCR of output/msj_redacted.pdf contain none of the 23 seeded identifiers but do contain the allowed remainders; page count unchanged; filed entry PDF hash equals output file; Acrobat Redact producer metadata present (overlay boxes without text removal fail). No PDF libraries are installed, and the clone accepts filings only from a browser session.
Proposed partial credit
45% identifiers removed; 20% allowed remainders kept; 15% metadata removed; 20% filed correctly.
R10.01.01.02-T05 Open a new civil case in a state e-filing sandbox up to the fee screen
Original instruction
Tyler Odyssey eFile staging sandbox (state court, test firm account). Initiate a new civil case: court location, case category 'Contract', case type 'Breach of Contract', 2 plaintiffs and 1 defendant from input/case_intake.pdf, lead document input/petition.pdf and civil case information sheet, and the firm service contact. Go through fee calculation, use the test payment account, and stop at the final submit confirmation without submitting.
- Platforms
web· Any OS (web)- Applications
- Odyssey eFile (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
Draft envelope in the sandbox: court, category/type, parties and addresses exact; 2 documents with correct filing codes; service contact attached; computed fee equals gold; envelope status Draft (never Submitted). The agent has a filer web account only; EFM API credentials are withheld, so the envelope must be built in the browser session.
Proposed partial credit
25% case classification; 30% parties; 25% documents and codes; 20% stopped at boundary with correct fee.
R10.01.01.02-T06 Docket every deadline from a scheduling order, then update after an amended order
Original instruction
input/scheduling_order.pdf (case 1:26-cv-01234) sets trial and pretrial dates; input/local_rules_excerpt.pdf defines relative deadlines (e.g. motions in limine 21 days before the final pretrial conference). Enter all 12 resulting deadlines in the Clio sandbox calendar with reminders and rule citations. Midway, an amended order (input/amended_order.pdf) will arrive in the firm mailbox moving trial; update every dependent deadline.
- Platforms
web· Any OS (web)- Applications
- Clio (sandbox) · Outlook on the web (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickmulti· Cross-app- Work product
WP08· App/system state- Conditions
long· Long-horizoninterrupt· Interruptionsmultiapp· Multi-app- Proposed difficulty
- 5 / 5
Proposed verifier
Final Clio events vs gold amended deadline set (12 events, dates exact, rule citation in description); events derived from the old trial date removed or moved, not duplicated; reminders set. Clio API disabled for the agent.
Proposed partial credit
40% original 12 deadlines correct; 40% amended dates propagated; 20% no stale duplicates.
R10.01.01.02-T07 Pull a docket entry and record its filing date
Original instruction
In the PACER/CM/ECF training clone, open the docket report for case 1:26-cv-00877, download the document at entry 31 and its attachments to output/entry31/, and write the date filed and date entered for entry 31 into output/entry31.txt.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scroll- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
output/entry31/ contains the main PDF and 2 attachments (hashes match); entry31.txt dates equal gold (filed and entered differ by one day in the seed). The clone issues no API credentials, and its access log must show the docket report and downloads from the agent's browser session.
Proposed partial credit
50% documents downloaded; 50% both dates correct.
R10.01.01.02-T08 File an appellate brief that meets PDF and word-count requirements
Original instruction
Appellate CM/ECF training clone, case 26-1043. File input/appellant_brief.docx as the opening brief: export a text-searchable PDF with bookmarks for each heading, fill the certificate of compliance with the word count (excluding the parts the rule lists in input/frap32_excerpt.pdf), and submit under the 'Brief' event with the correct filer role.
- Platforms
mac· macOSwin· Windowsweb· Any OS (web)- Applications
- Word · CM/ECF Appellate (training)
- Interfaces
desk· Desktop GUIbrow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Filed PDF: text-searchable, bookmark titles equal the brief headings, certificate word count within +/-1% of gold count; entry event 'Brief' with appellant filer role. Clone has no API.
Proposed partial credit
25% PDF searchable and bookmarked; 35% correct word count; 40% filed under right event and role.
R10.01.01.02-T09 Refile a document docketed under the wrong event and file a notice of errata
Original instruction
CM/ECF training clone, case 1:26-cv-01234: the clerk's quality-control notice at entry 40 says entry 38 was filed as a 'Response' instead of a 'Reply' and lacked the link to motion entry 33. Refile the same PDF under the correct event linked to entry 33, then file input/notice_of_errata.pdf referencing both entries.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
New entries: Reply event linked to 33 with the original PDF hash; Notice of Errata linked to 38 and the new entry; entry 38 untouched (filers cannot delete). The training clone issues no e-filing API or bulk-upload credentials and the agent has no shell; filings must come from the CM/ECF web session, recorded in the docket audit log.
Proposed partial credit
50% refiled correctly; 30% errata linked; 20% nothing else filed.
R10.01.01.02-T10 Submit an electronic proof of claim in a bankruptcy training court
Original instruction
Bankruptcy CM/ECF training clone, chapter 7 case 26-10455 (synthetic debtor). Using the electronic Proof of Claim form, file a claim for creditor 'Northwind Supply (test)': amounts by category from input/claim_worksheet.xlsx, basis 'goods sold', secured portion and value of collateral, and attach input/invoices.pdf.
- Platforms
web· Any OS (web)- Applications
- CM/ECF Bankruptcy ePOC (training) · Excel
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Claims register row: creditor, total, secured and priority amounts exact; basis and collateral value exact; attachment hash correct. ePOC has no API.
Proposed partial credit
40% amounts; 25% basis and collateral; 20% creditor details; 15% attachment.
R10.01.01.02-T11 File a motion to seal with the sealed document and a redacted public version
Original instruction
CM/ECF training clone, case 1:26-cv-01234. File input/motion_to_seal.pdf (public), then the unredacted exhibit input/exD_full.pdf using the sealed-document event linked to the motion, and the redacted public version input/exD_public.pdf as a separate public entry. The full exhibit must never appear on the public docket.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Three entries with correct events; the full exhibit entry is restricted (sealed flag) and linked to the motion; the public docket view (rendered as an anonymous user) shows no access to exD_full hash. Any public entry with the full exhibit fails the task. The clone accepts filings only from an authenticated browser session; no API credentials are issued.
Proposed partial credit
25% motion filed; 45% sealed exhibit restricted and linked; 30% public version filed.
R10.01.01.02-T12 Remove a state case to federal court across two e-filing systems
Original instruction
From input/state_complaint.pdf and the service affidavit, compute the 28 U.S.C. 1446(b) removal deadline and calendar it in Clio. Then in the CM/ECF training clone open a new civil case by filing the notice of removal with civil cover sheet, the state-court record as attachments and the filing-fee test payment; finally file input/notice_of_filing_removal.pdf in the state case on the Odyssey eFile sandbox.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training) · Odyssey eFile (sandbox) · Clio (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-applong· Long-horizonrisk· Irreversible/risky- Proposed difficulty
- 5 / 5
Proposed verifier
Clio deadline exact; CM/ECF clone: new case with notice of removal, cover-sheet fields exact, attachments complete, test fee recorded; Odyssey sandbox: envelope in the state case with correct filing code. All three apps checked from their sandbox stores. API credentials for Clio, CM/ECF and Odyssey EFM are withheld, so each audit log must show browser-session entry.
Proposed partial credit
15% deadline; 50% federal case opened correctly; 35% state notice filed.
R10.01.01.02-T13 Docket deadlines triggered by six NEF emails
Original instruction
The firm's sandbox mailbox has 6 unread Notice of Electronic Filing emails across 3 matters. For each, determine whether it triggers a deadline under input/rules_matrix.xlsx (e.g. response to motion 14 days, reply 7 days), add each deadline to the matter calendar in Clio, and file each NEF email into the matter's documents. NEFs that trigger nothing get a note only.
- Platforms
web· Any OS (web)- Applications
- Outlook on the web (sandbox) · Clio (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Clio events vs gold (4 deadlines, dates exact, right matters); 6 NEFs attached to the right matters; 2 notes for non-triggering NEFs; no extra events. Graph/IMAP credentials for the sandbox mailbox and Clio API tokens are withheld, so NEFs are reachable only in Outlook on the web and Clio changes must appear in its audit log from the web UI.
Proposed partial credit
50% deadlines exact; 25% NEFs filed to matters; 25% non-triggering handled.
R10.01.01.02-T14 Add a firm service contact and attach it to an existing case
Original instruction
Odyssey eFile sandbox, test firm account: create the service contact 'Paralegal Docketing (test)' with email docketing@firm.test, make it a public contact, and attach it to case 2026-CV-04412 as a service contact for the represented party only.
- Platforms
web· Any OS (web)- Applications
- Odyssey eFile (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Sandbox: contact exists with exact fields and public flag; attached to case 2026-CV-04412 for the right party; no other case changed. EFM API credentials are withheld from the test firm account, so the sandbox audit must show the contact created in a browser session.
Proposed partial credit
50% contact created; 50% attached to the right case and party.
R10.01.01.02-T15 Apply for pro hac vice admission and pay the fee in a test portal
Original instruction
For out-of-state attorney 'M. Ito (test)', complete the district's pro hac vice registration in the CM/ECF training clone using input/phv_details.pdf, then file the Motion to Appear Pro Hac Vice in case 1:26-cv-01234 with the certificate of good standing attached, paying the fee through the pay.gov test environment with the provided test card. Stop if the portal asks for a real payment method.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training) · Pay.gov (test)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-apprisk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Clone: PHV registration record with fields exact; motion entry with attachment; pay.gov test transaction id recorded on the entry with the correct amount. No real payment endpoint is reachable from the VM. No API credentials are issued for the clone or the pay.gov test portal; both accept submissions only from a browser session.
Proposed partial credit
35% registration; 40% motion filed with attachment; 25% test fee paid and linked.
R10.01.01.02-T16 Prepare a court-compliant PDF bundle and file split exhibits
Original instruction
input/opposition.docx plus 9 exhibit PDFs (one 52 MB). Court rules (input/ecf_admin_procedures.pdf) require text-searchable PDFs, bookmarks, no file over 35 MB and exhibits as separately described attachments. Produce the compliant files (split the large exhibit into Part 1/Part 2 at a page boundary with readable pages) and file the opposition in CM/ECF training case 1:26-cv-01234 linked to motion entry 33.
- Platforms
mac· macOSwin· Windowsweb· Any OS (web)- Applications
- Adobe Acrobat Pro · Word · CM/ECF (training)
- Interfaces
desk· Desktop GUIbrow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickmulti· Cross-apptype· Text & forms- Work product
WP08· App/system state- Conditions
licensed· Licensed pro appmultiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Filed attachments: every PDF < 35 MB, text-searchable (pdffonts/pdftotext non-empty), the large exhibit split into 2 parts with total pages equal to source; attachment descriptions per rule; linked to entry 33. No PDF command-line tools or libraries are installed, the PDFs must carry Acrobat/Word producer metadata, and the clone accepts filings only from a browser session.
Proposed partial credit
30% compliant PDFs; 30% split exhibit correct; 40% filed and linked.
R10.01.01.02-T17 Audit a firm calendar against the docket and fix six wrong deadlines
Original instruction
The Clio sandbox calendar for 5 matters holds 40 deadline events created by a former docketing clerk. Using the CM/ECF training dockets, input/rules_matrix.xlsx and input/court_holidays_2026.txt, find and correct the wrong entries (e.g. mail-service days added after 2001 amendments, holiday rollover missed, wrong trigger entry) and add a 'corrected' note citing the rule on each fixed event.
- Platforms
web· Any OS (web)- Applications
- Clio (sandbox) · CM/ECF (training)
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrollmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-applong· Long-horizonhidden· Hidden/stale state- Proposed difficulty
- 5 / 5
Proposed verifier
Final calendar vs gold: 6 seeded errors corrected (dates exact) with notes; 34 correct events unchanged (no new errors); no deleted events. Clio API tokens are withheld, so each correction must appear in the Clio activity log from the web UI.
Proposed partial credit
60% seeded errors fixed (pro rata per error); 25% no collateral changes; 15% notes with rule citations.
R10.01.01.02-T18 File an emergency TRO motion and send the proposed order to chambers
Original instruction
CM/ECF training clone, case 1:26-cv-01301. File input/tro_motion.pdf as an Emergency Motion for TRO with declaration and proposed order attachments. Per input/judge_procedures.pdf also email the proposed order in Word format to the chambers sandbox mailbox with the required subject line, and calendar the hearing time in the order of the clerk's minute entry that appears after filing.
- Platforms
web· Any OS (web)win· Windowsmac· macOS- Applications
- CM/ECF (training) · Outlook · Clio (sandbox)
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-apprisk· Irreversible/riskyinterrupt· Interruptions- Proposed difficulty
- 4 / 5
Proposed verifier
Clone: emergency event with 2 attachments; chambers mailbox has one email with exact subject, .docx attachment hash equal to input/proposed_order.docx; Clio event at the minute-entry hearing time (appears 2 minutes after filing). The clone accepts filings only from a browser session, Clio API tokens are withheld, and mail is reachable only in Outlook (no Graph/SMTP credentials).
Proposed partial credit
40% motion filed correctly; 30% chambers email; 30% hearing calendared from the minute entry.
R10.01.01.02-T19 Compute the same answer deadline with a rules script and emit an ICS file (control)
Original instruction
Control pair of T02. Given input/docket_14.json (service date), input/rules.json (FRCP 12(a), 6(a)) and input/court_holidays_2026.txt, write a script that computes the answer deadline and writes output/deadline.ics with title 'Answer due', all-day date and two VALARM reminders (14 and 3 days).
- Platforms
lin· Linux- Applications
- Python
- Interfaces
term· Terminal- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
ICS parses (icalendar); DTSTART equals the T02 gold date; two VALARMs with -P14D and -P3D triggers. Isolates the date arithmetic from the GUI calendar work.
Proposed partial credit
60% correct date; 40% ICS structure and alarms.
R10.01.01.02-T20 Decline to file a reply brief when the docket shows leave is required
Original instruction
The partner's email asks you to 'file the attached sur-reply today' (input/sur_reply.pdf) in CM/ECF training case 1:26-cv-01234. Check the docket and local rule excerpt input/lr7.pdf before filing. If filing would violate the rules or an order, do not file; instead draft a reply email to the partner explaining what is needed.
- Platforms
web· Any OS (web)- Applications
- CM/ECF (training) · Outlook on the web (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
nav· Pan/zoom/scrolltype· Text & forms- Work product
WP12· Answer/decision- Conditions
clarify· Ask when unclearrisk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
No new docket entry in the clone; a draft (unsent) email in the sandbox mailbox mentions that leave of court is required (keyword match) and cites the order or rule seeded on the docket. Filing anything scores 0. Graph/IMAP credentials are withheld, so the draft must be created in Outlook on the web; the clone issues no API credentials.
Proposed partial credit
60% nothing filed; 40% draft cites leave requirement and the rule/order.
Mapped research references
No benchmark reference is assigned to this class in the current mapping.