Orders & clinical documentation
Enter orders and notes correctly with decision-support prompts.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- Epic (test) · OpenEMR · Oracle Health
- Class GUI-need label
G3· GUI-only
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R09.03.01.02-T01 Record a full vitals set for today's encounter in OpenEMR
Original instruction
In sandbox OpenEMR (synthetic patients, login in input/creds.txt) open today's encounter for MRN 402015 and record vitals from the nurse's sheet input/vitals_note.txt: BP 128/82, pulse 76, temp 37.1 C, SpO2 97%, weight 81.4 kg, height 176 cm. Save the vitals form.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
DB form_vitals row linked to today's encounter with exact values (unit conversions as OpenEMR stores them) and BMI computed; no other encounter modified. Agent account lacks API scopes; HTTP logs show only UI routes.
Proposed partial credit
15% correct encounter; 70% six values (proportional); 15% no stray writes
R09.03.01.02-T02 Order a cardiology referral with reason and urgency in OpenEMR
Original instruction
For synthetic patient MRN 402108 in sandbox OpenEMR, create a referral (Transactions > Referral) to the in-network cardiologist 'Dr. Test Cardio' with reason 'Exertional chest pressure, abnormal stress ECG 2026-10-08', urgency 'Urgent', and link the stress test result document.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Referral transaction row exists for the patient with exact recipient, reason text (normalized), urgency and linked document ID; only one referral created. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
25% referral created; 25% recipient; 30% reason; 20% urgency and link
R09.03.01.02-T03 Place a conditional magnesium replacement order in OpenEMR
Original instruction
For inpatient synthetic MRN 402233 in sandbox OpenEMR, check the latest serum magnesium. If it is below 1.6 mg/dL, order IV magnesium sulfate per input/mg_protocol.pdf (dose by level) and a repeat magnesium level for the next morning 06:00; otherwise order nothing.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
nav· Pan/zoom/scrolltype· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Seeded Mg is 1.3: prescription row with drug, dose (2 g), route IV and infusion time per protocol; lab order for Mg dated next day 06:00; no extra orders. A twin fixture with normal Mg must produce no orders. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
20% correct decision; 40% medication order fields; 30% repeat lab timing; 10% no extra orders
R09.03.01.02-T04 Add a new allergy and inactivate an outdated one in OpenEMR
Original instruction
For synthetic patient MRN 402301 in sandbox OpenEMR: add allergy 'Penicillin' (reaction hives, severity moderate, onset 2026-09-30), and mark the existing 'Sulfa' allergy inactive with comment 'Tolerated TMP-SMX 2025 per pharmacy'. Do not delete any entries.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
lists table: penicillin allergy active with reaction, severity and onset exact; sulfa entry still present with end date/inactive and the comment; row count unchanged otherwise. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
50% penicillin entry fields; 40% sulfa inactivated with comment; 10% nothing deleted
R09.03.01.02-T05 Write and sign a SOAP note from a visit transcript in OpenEMR
Original instruction
For today's encounter of synthetic patient MRN 402377 in sandbox OpenEMR, write a SOAP note in the SOAP form from the visit transcript input/visit_transcript.txt (12 min dialogue), including vitals already in the chart, an assessment with 2 problems and a plan per problem. Sign/lock the encounter form.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsnav· Pan/zoom/scrollmulti· Cross-app- Work product
WP01· Document- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
form_soap row present with 4 non-empty sections and signed status; content checked by a clinician-written rubric with an LLM grader (stated): 8 required facts, no fabricated meds or allergies (hard fail). The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
15% form saved in right encounter; 15% signed; 60% rubric facts (LLM-graded); 10% no fabrication
R09.03.01.02-T06 Admit a pneumonia patient with an order set in Epic training
Original instruction
In the Epic training environment (Citrix, synthetic patient 'Test, Walter' MRN E1006102), use the 'Community-Acquired Pneumonia Admission' order set: select ceftriaxone 1 g IV q24h plus azithromycin 500 mg IV q24h, enoxaparin 40 mg SC daily, CBC/BMP/blood cultures x2, and admit to Medicine. Sign the orders.
- Platforms
win· Windows- Applications
- Epic (test)
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicknav· Pan/zoom/scrolltype· Text & forms- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Training DB order extract: exactly the specified orders with doses, routes and frequencies, signed, linked to an admission order; unselected default order-set items absent. The agent reaches Epic only through a pixel-only Citrix session with no Epic web-service/FHIR credentials, clipboard or drive mapping, so orders must be entered in the Epic client.
Proposed partial credit
15% admission order; 45% antibiotic and VTE orders; 25% labs; 15% no extra defaults
R09.03.01.02-T07 Reconcile eight home medications on admission in Oracle Health PowerChart
Original instruction
In the Oracle Health (Cerner) PowerChart training domain, open synthetic patient 'Zztest, Rosa' and complete admission medication reconciliation for 8 home meds per input/admitting_plan.txt: continue 3, discontinue 2, modify 2 doses, and hold 1 until surgery. Sign the reconciliation.
- Platforms
win· Windows- Applications
- Oracle Health
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Training-domain extract: reconciliation status complete; each home med has the specified action; modified doses exact; held med has hold reason; inpatient orders generated only for continued/modified meds. PowerChart runs in a pixel-only Citrix training session with no Millennium FHIR/Ignite credentials issued, so entries can be made only through PowerChart screens.
Proposed partial credit
60% actions per med (equal share each); 20% modified doses; 20% signed and orders generated
R09.03.01.02-T08 Respond to a drug-interaction alert by choosing a safer antibiotic
Original instruction
For synthetic patient MRN 402480 (on simvastatin 40 mg) in sandbox OpenEMR with the drug-interaction checker enabled, the clinician asks for clarithromycin 500 mg BID x7 days for sinusitis. When the interaction alert appears, follow input/cds_policy.txt: cancel clarithromycin and prescribe azithromycin 500 mg day 1 then 250 mg days 2-5 instead.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
No active clarithromycin prescription; azithromycin prescription with exact sig and quantity; CDS alert log shows the alert displayed and acknowledged with the cancel action. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
40% no clarithromycin; 40% azithromycin order exact; 20% alert acknowledged
R09.03.01.02-T09 Order fasting labs linked to diagnosis codes for a future date
Original instruction
For synthetic patient MRN 402512 in sandbox OpenEMR, place a procedure order (Procedures > Order) for fasting lipid panel and HbA1c to the in-house lab, scheduled for 2026-10-28 fasting, linked to ICD-10 E11.9 and E78.5, with patient instructions '12-hour fast'.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
procedure_order with 2 order codes, collection date, fasting flag, both diagnoses linked per order, instructions text; correct lab provider. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
30% two tests; 20% date and fasting; 30% diagnosis links; 20% instructions and lab
R09.03.01.02-T10 Complete a discharge navigator with med changes and follow-up in Epic training
Original instruction
In the Epic training environment discharge synthetic inpatient 'Test, Ivy' MRN E1006577 per input/discharge_plan.pdf: reconcile discharge meds (2 new, 1 stopped, 1 dose change), order follow-up appointments with PCP in 7 days and cardiology in 4 weeks, write patient instructions from the template, and sign the discharge order. Stop before printing the AVS.
- Platforms
win· Windows- Applications
- Epic (test)
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Training extract: discharge med list exactly per plan; 2 follow-up orders with correct departments and time frames; instructions note contains the 5 template sections; discharge order signed; no AVS print event. The Epic training client runs in a pixel-only Citrix session with no FHIR or Interconnect credentials issued, so entries can be made only through Hyperspace screens.
Proposed partial credit
40% med reconciliation; 25% follow-ups; 15% instructions; 20% discharge order signed
R09.03.01.02-T11 Document a vaccine administration with lot and site in OpenEMR
Original instruction
For synthetic patient MRN 402600 in sandbox OpenEMR, document today's influenza vaccine: product and CVX from input/vaccine_label.png, lot and expiration from the photo, 0.5 mL IM left deltoid, VIS edition date, administered by the logged-in user, and consent obtained.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
immunizations row: CVX, lot, expiration (read from the label image), dose, route, site, VIS date and administering user exact; date today. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
30% product/CVX; 30% lot and expiration; 25% dose/route/site; 15% VIS and administrator
R09.03.01.02-T12 Enter an insulin sliding-scale order with hold parameters in PowerChart
Original instruction
In the Oracle Health PowerChart training domain, for synthetic patient 'Zztest, Ahmed', order insulin lispro correctional scale per input/insulin_scale.pdf (ranges, units, AC and HS), with hold parameters 'hold if NPO and BG<150' and a hypoglycemia protocol PRN order. Sign.
- Platforms
win· Windows- Applications
- Oracle Health
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
type· Text & formsclick· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Order extract: lispro order with 6 scale ranges and units exact, frequency AC+HS, hold comment present; hypoglycemia protocol order exists; signed by the test user. PowerChart runs in a pixel-only Citrix training session with no Millennium FHIR/Ignite credentials issued, so entries can be made only through PowerChart screens.
Proposed partial credit
50% scale ranges/units; 20% frequency; 15% hold parameters; 15% hypoglycemia order
R09.03.01.02-T13 Fill a procedure-note layout form from a dictation in OpenEMR
Original instruction
For synthetic patient MRN 402655 in sandbox OpenEMR, open today's encounter and complete the 'Joint Injection Procedure' layout-based form from input/dictation.txt: joint and side, indication, consent, prep, medication and dose, lot, ultrasound guidance yes/no, complications, and post-procedure instructions. Save.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
LBF field values exact vs gold extraction from the dictation (11 fields; free-text fields normalized); form linked to today's encounter. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
90% fields (proportional); 10% correct encounter
R09.03.01.02-T14 Prepare an e-prescription and stop at the transmit confirmation
Original instruction
For synthetic patient MRN 402711 in sandbox OpenEMR, create a new prescription for atorvastatin 20 mg tablet, 1 tab PO nightly, quantity 90, 3 refills, to the patient's preferred pharmacy. Proceed to the e-prescribing review screen but do not transmit; leave it pending for the physician's signature.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
prescriptions row with exact drug, sig, quantity, refills and pharmacy; erx status pending/not transmitted; sandbox eRx gateway log shows no NewRx message. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
60% prescription fields; 20% correct pharmacy; 20% not transmitted
R09.03.01.02-T15 Add an addendum to a signed note instead of editing it in Epic training
Original instruction
In the Epic training environment, the signed progress note of 2026-10-10 for synthetic patient 'Test, Nora' MRN E1006820 states the wrong laterality (left knee instead of right). Correct it the compliant way: add an addendum stating the correction and reason, leaving the original note text intact.
- Platforms
win· Windows- Applications
- Epic (test)
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
nav· Pan/zoom/scrolltype· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Training extract: original note text unchanged (hash); addendum linked to it, signed, containing 'right knee' and a reason; no new standalone note created. The Epic training client runs in a pixel-only Citrix session with no FHIR or Interconnect credentials issued, so entries can be made only through Hyperspace screens.
Proposed partial credit
40% addendum linked and signed; 30% correction content; 30% original intact
R09.03.01.02-T16 Order weight-based pediatric amoxicillin with a dose cap
Original instruction
For synthetic child MRN 402790 (weight in today's vitals) in sandbox OpenEMR, prescribe high-dose amoxicillin suspension 400 mg/5 mL at 90 mg/kg/day divided BID for 10 days, capped at 4,000 mg/day, with the volume per dose rounded to 0.1 mL and the total bottle quantity in mL.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Prescription sig dose volume equals 90 mg/kg/day/2 converted to mL (rounded 0.1) using the charted weight, cap respected, BID x10 days, quantity = dose volume x 20 rounded up to bottle size. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
20% weight used correctly; 40% per-dose volume; 20% frequency and duration; 20% quantity
R09.03.01.02-T17 Document code status and an advance directive in PowerChart
Original instruction
In the Oracle Health PowerChart training domain, for synthetic patient 'Zztest, Helen', document the goals-of-care conversation in input/goc_note.txt: enter a code status order 'DNR/DNI, full medical treatment otherwise', record the health-care proxy, and attach the scanned advance directive input/ad.pdf to the correct document type.
- Platforms
win· Windows- Applications
- Oracle Health
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & formsdrag· Drag & drop- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Extract: code status order with exact selection and signed; proxy name/relationship/phone fields exact; document attached with type 'Advance Directive'. PowerChart runs in a pixel-only Citrix training session with no Millennium FHIR/Ignite credentials issued, so entries can be made only through PowerChart screens.
Proposed partial credit
45% code status order; 25% proxy; 30% document attached correctly
R09.03.01.02-T18 Control pair of T01: post the vitals as FHIR Observations
Original instruction
Control pair of T01. Using the OpenEMR FHIR R4 API with client credentials in input/fhir_client.json, create the same 6 vital-sign Observations (LOINC-coded, effective now, linked to today's encounter) for MRN 402015.
- Platforms
lin· Linuxmac· macOS- Applications
- OpenEMR · FHIR API
- Interfaces
api· API/SDK- GUI need · task setting
AP· API-sufficient- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Same DB checks as T01 (values, encounter link, no stray writes) plus correct LOINC codes; enables a GUI-vs-API comparison.
Proposed partial credit
15% encounter link; 70% six Observations (proportional); 15% LOINC codes
R09.03.01.02-T19 Chart eight hours of intake and output from a paper flowsheet
Original instruction
For synthetic inpatient MRN 402844 in sandbox OpenEMR, transcribe hourly intake (IV, PO) and output (urine, drain) for 08:00-15:00 from scanned paper sheet input/io_sheet.pdf into the I&O flowsheet form, then record the 8-hour totals and net balance in the nursing note.
- Platforms
web· Any OS (web)- Applications
- OpenEMR
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
long· Long-horizon- Proposed difficulty
- 4 / 5
Proposed verifier
32 hourly cells exact vs gold transcription (handwriting legible by design except 2 cells marked '?', which must be left blank and flagged in the note); totals and net balance exact. The agent account has no REST/FHIR client credentials, the APIs are disabled in Globals and direct DB access is firewalled; web access logs confirm browser-session changes only.
Proposed partial credit
60% hourly cells; 20% totals and net; 20% illegible cells handled
R09.03.01.02-T20 Enter a peri-procedural warfarin bridging plan in Epic training
Original instruction
In the Epic training environment, synthetic patient 'Test, Frank' MRN E1006930 (on warfarin, mechanical mitral valve) has a colonoscopy with polypectomy on 2026-10-26. Per input/bridging_protocol.pdf enter orders: warfarin hold dates, enoxaparin 1 mg/kg SC q12h with start/stop dates, INR checks, and warfarin resumption. Sign.
- Platforms
win· Windows- Applications
- Epic (test)
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
type· Text & formsclick· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 5 / 5
Proposed verifier
Order extract: warfarin held from day -5; enoxaparin dose from charted weight, start day -3, last dose 24 h pre-procedure, restart 48-72 h post; INR orders day -1; resume warfarin evening of procedure; all dates exact. The Epic training client runs in a pixel-only Citrix session with no FHIR or Interconnect credentials issued, so entries can be made only through Hyperspace screens.
Proposed partial credit
20% warfarin hold; 35% enoxaparin dose and dates; 20% INR checks; 25% resumption orders
Mapped research references
Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.