Laboratory information system operations
Accession specimens, enter and release results with QC.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- LIS · SENAITE
- Class GUI-need label
G2· GUI-essential
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R09.06.01.02-T01 Receive four water samples and assign pH and lead analyses in SENAITE
Original instruction
SENAITE LIMS sandbox, client 'Riverbend Water District (test)'. From input/coc_0912.pdf (chain of custody), register 4 drinking-water samples with sample point, container, date sampled and sampler, assign analyses pH and Pb to each, and receive all 4 at the bench.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
SENAITE catalog query: 4 samples for the client with fields equal to the CoC, analyses {pH, Pb} each, review_state 'sample_received'. senaite.jsonapi is disabled for the agent user; the audit log must show browser-session snapshots.
Proposed partial credit
40% samples registered with correct fields; 30% analyses assigned; 30% received.
R09.06.01.02-T02 Accession 24 mixed-matrix samples and assign test panels by matrix
Original instruction
SENAITE sandbox: input/coc_env_24.pdf lists 24 samples from 3 clients (water, soil, wastewater) with requested panels. Register them using the matching sample types and analysis profiles (Metals-W, Metals-S, Nutrients, BOD), set containers and preservation, mark 2 samples received with broken custody seals as 'received with exception' in remarks.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
long· Long-horizon- Proposed difficulty
- 3 / 5
Proposed verifier
Catalog export of 24 samples vs gold (client, sample type, profile, container, preservation, date sampled); 2 seeded samples have the exception remark; all received. API disabled; audit snapshots required.
Proposed partial credit
50% samples with correct type and profile; 25% containers and preservation; 25% exception remarks and receipt.
R09.06.01.02-T03 Enter worksheet results from an instrument printout and submit
Original instruction
SENAITE sandbox worksheet WS-0145 holds 10 water samples for Nitrate-N and Phosphate. Transcribe results from input/autoanalyzer_printout.pdf, applying the dilution factors printed per sample, then submit the worksheet. Results flagged out of specification must keep their flag; do not edit specifications.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP02· Records/table- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Analysis results vs gold (dilution applied, 3 significant figures); review_state 'to_be_verified' for all 20 analyses; out-of-spec flags on the 3 seeded samples; specifications unchanged. senaite.jsonapi is disabled on the sandbox and the analyst has no ZMI access, so results must be entered in the worksheet UI (checked in each analysis's audit log).
Proposed partial credit
60% results correct after dilution; 25% submitted; 15% specs untouched.
R09.06.01.02-T04 Run a QC worksheet with blank, control and duplicate and act on a control failure
Original instruction
OpenELIS Global sandbox: create a worksheet for serum glucose with 12 patient specimens (synthetic), one reagent blank, two control levels and one duplicate. Enter results from input/glucose_run.csv. Apply input/qc_rules.pdf (Westgard 1-3s, 2-2s): if a control fails, reject the run, do not release any patient result, and log the corrective action.
- Platforms
web· Any OS (web)- Applications
- OpenELIS Global
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
OpenELIS DB: worksheet with correct QC positions; the seeded 1-3s control failure leads to run rejected and 0 patient results released; corrective-action note present. Any released patient result fails the task. OpenELIS REST/FHIR write endpoints are disabled for the tech account and its database is not reachable from the agent VM, so entry must go through the worksheet UI.
Proposed partial credit
25% worksheet layout incl. QC; 25% results entered; 50% correct reject decision with no releases.
R09.06.01.02-T05 Second-analyst verification: verify, retract one result, and publish a COA
Original instruction
SENAITE sandbox, logged in as a second analyst (four-eyes rule on). Review the 8 submitted results on sample RW-0331..0338: verify the correct ones; retract the Pb result on RW-0336 whose dilution factor disagrees with input/bench_sheet.pdf and enter the retest; then publish the certificate of analysis for the samples that are fully verified.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
7 analyses verified; RW-0336 Pb retracted with a retest analysis carrying the corrected value; published COA PDFs exist only for fully verified samples (parsed text matches values). Verification by the submitting user is blocked by the four-eyes setting.
Proposed partial credit
30% verifications; 35% retraction and corrected retest; 35% COAs published for the right samples only.
R09.06.01.02-T06 Run a full clinical bench day from requisitions to released results
Original instruction
OpenELIS Global sandbox. Accession 15 synthetic patient specimens from input/requisitions/ (scanned forms), import chemistry results from input/analyzer_c311.csv, enter manual urinalysis results, review delta-check and critical-value flags, document a callback for each critical value with read-back, then release all results that pass QC.
- Platforms
web· Any OS (web)- Applications
- OpenELIS Global
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
long· Long-horizonrisk· Irreversible/risky- Proposed difficulty
- 5 / 5
Proposed verifier
15 orders with correct patient/test mapping; results vs gold (100%); 2 seeded critical values each have a callback note with recipient, time and read-back flag; 1 delta-check failure held, not released; all others released. REST/FHIR write endpoints are disabled and the database is not reachable from the agent VM; the audit trail must show UI entry.
Proposed partial credit
25% accessioning; 30% results; 25% critical callbacks; 20% correct release/hold set.
R09.06.01.02-T07 Reject a mislabeled specimen and record the reason
Original instruction
OpenELIS Global sandbox: specimen accession 26-004417 arrived with a tube label name that does not match its requisition (see input/label_photo.jpg and input/req_004417.pdf). Per input/acceptance_criteria.pdf, reject the specimen with reason 'Labeling discrepancy', cancel its tests and add a note requesting recollection.
- Platforms
web· Any OS (web)- Applications
- OpenELIS Global
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickvis· Visual judgmenttype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
Sample status rejected with the gold reason code; all ordered tests cancelled; note contains 'recollect'; no results attached. OpenELIS REST/FHIR write endpoints are disabled for the account and the database is not reachable from the agent VM; UI audit entries required.
Proposed partial credit
50% rejected with right reason; 30% tests cancelled; 20% recollection note.
R09.06.01.02-T08 Configure a calculated hardness analysis with sample-type specifications
Original instruction
SENAITE sandbox: add analysis service 'Total Hardness' (keyword HARD, unit mg/L as CaCO3) with calculation 2.497*[Ca] + 4.118*[Mg], dependent on existing Ca and Mg services, precision 1 decimal, and add a specification for sample type 'Drinking Water' with warn range 60-120 and max 180. Add it to analysis profile Metals-W.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Setup catalog: service HARD exists with formula, dependencies, unit and precision as specified; specification and profile membership exact; a grader-created test sample with Ca=40, Mg=12 yields HARD = 149.3. senaite.jsonapi is disabled and ZMI/Python script access is denied to the lab-manager account, so setup must be done in the SENAITE Setup UI.
Proposed partial credit
40% service and calculation; 30% specification; 15% profile; 15% test sample computes correctly.
R09.06.01.02-T09 Configure analyte limits and re-flag pending results in LabWare
Original instruction
LabWare LIMS training instance: a new regulatory notice input/limits_2026.pdf changes the action limits for 5 analytes in product spec 'FINISHED-WATER'. Create a new spec version effective 2026-10-01, retire the old one for new samples only, and re-evaluate the 12 pending samples received after that date so their out-of-spec flags reflect the new limits.
- Platforms
win· Windows- Applications
- LabWare LIMS
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Spec table: new version with 5 limits exact and effective date; old version unchanged and still linked to pre-10-01 samples; 12 pending samples re-evaluated with flags equal to gold. The training instance exposes no web services, and LIMS Basic and SQL console access are denied to the agent role, so spec changes must be made in the LabWare GUI.
Proposed partial credit
35% new spec version; 20% old version preserved; 45% re-evaluated flags correct.
R09.06.01.02-T10 Create preservation partitions and route them to departments
Original instruction
SENAITE sandbox: wastewater sample WW-0920 was received as one bulk container. Create 3 partitions (unpreserved for BOD, H2SO4 for nutrients, HNO3 for metals) with the right container types, move each analysis to its partition, and confirm each partition appears in its department's worklist.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
WW-0920 has 3 partitions with gold container/preservation; every analysis is on the correct partition and none remains on the primary; worksheet-assignable lists per department contain the right partition. senaite.jsonapi is disabled and ZMI access is denied, so partitions must be created with the sample's Partition form (audit log checked).
Proposed partial credit
40% partitions created; 40% analyses moved correctly; 20% department routing.
R09.06.01.02-T11 Import an ICP-MS results file and reconcile unmatched sample IDs
Original instruction
SENAITE sandbox worksheet WS-0150 (20 samples, metals). Import input/icpms_export.csv through the worksheet's instrument import tool (Agilent ICP-MS interface). Two rows use sample IDs with a transposed digit; match them to the right samples by bench sheet input/ws0150_bench.pdf and enter their values manually. Mark the run's failed CCV so affected results are not submitted.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP02· Records/table- Conditions
multiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
Results vs gold for all 20 samples x 6 metals; the 2 transposed IDs resolved to the right samples; analyses bracketed by the failed CCV remain unsubmitted with a remark; others submitted. senaite.jsonapi is disabled for the analyst account; the import log must show the worksheet GUI import action.
Proposed partial credit
35% import applied; 25% two mismatches resolved; 40% CCV-bracketed results held.
R09.06.01.02-T12 Correct a post-release sample swap with an amended report
Original instruction
SENAITE sandbox: samples RW-0410 and RW-0411 were published yesterday, but input/swap_memo.pdf shows their bottles were swapped at login. Use the invalidation workflow to invalidate both, create the retests with values swapped back, re-verify through the four-eyes step (second analyst account provided), and publish amended COAs marked as amendments.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
risk· Irreversible/riskyhidden· Hidden/stale state- Proposed difficulty
- 5 / 5
Proposed verifier
Originals in state 'invalid' (not deleted); retests linked with corrected values; verified by the second account; amended COAs contain 'Amended' and reference the original COA numbers; audit log shows both invalidations.
Proposed partial credit
30% invalidation of both; 30% retests with corrected values; 20% verification; 20% amended COAs.
R09.06.01.02-T13 Review a Levey-Jennings chart and log Westgard violations
Original instruction
LabWare LIMS training instance: open the QC chart for control lot GLU-L2 (last 30 runs). Identify every Westgard rule violation (1-3s, 2-2s, R-4s, 10x) by run number, record each in the QC event log with the rule name and corrective action from input/qc_sop.pdf, and set the instrument status to 'Out of control' if the latest run violates a rejection rule.
- Platforms
win· Windows- Applications
- LabWare LIMS
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
vis· Visual judgmentclick· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
QC event log rows vs gold set of (run, rule) pairs, F1 >= 0.9; corrective-action codes per SOP; instrument status matches gold. Raw QC values are only visible through the chart and run grid in the training UI.
Proposed partial credit
60% violations F1; 20% corrective actions; 20% instrument status.
R09.06.01.02-T14 Export samples above the lead action level for one client
Original instruction
SENAITE sandbox: list every sample from client 'Riverbend Water District (test)' received in September 2026 whose verified Pb result exceeds 15 ug/L. Export them via the samples listing to output/pb_exceedances.csv with sample ID, sample point, date sampled and Pb value.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrolltype· Text & forms- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
CSV rows equal the 6 gold samples (set equality) with values exact; unverified results excluded. senaite.jsonapi is disabled and the database is not reachable from the agent VM, so sample data are available only through the browser samples listing.
Proposed partial credit
70% correct sample set; 30% columns and values.
R09.06.01.02-T15 Enter a urine culture with organism ID and susceptibility panel
Original instruction
Epic Beaker training environment, microbiology. Culture specimen M26-1188 (synthetic patient): enter the preliminary report (>100,000 CFU/mL gram-negative rods), then the final organism ID (E. coli) and a 12-drug MIC panel from input/vitek_printout.pdf with S/I/R interpretations per input/breakpoints.pdf, suppress the two drugs the cascade-reporting rule hides, and finalize.
- Platforms
win· Windows- Applications
- Epic Beaker (training)
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
type· Text & formsclick· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Training export: preliminary report then final in correct order; organism code; 12 MIC values and interpretations exact; 2 suppressed drugs hidden from the patient report; status Final. Beaker is reachable only through the Citrix client, and the training account has no HL7 or FHIR interface access.
Proposed partial credit
20% preliminary; 50% MICs and interpretations; 15% cascade suppression; 15% finalized.
R09.06.01.02-T16 Update age-banded reference ranges and re-flag pending results
Original instruction
OpenELIS Global sandbox: the alkaline phosphatase reagent changed; input/alp_insert.pdf gives new reference ranges for 6 pediatric and 2 adult age/sex bands. Update the test's normal ranges effective today, then re-evaluate the 9 pending ALP results so their H/L flags use the new ranges. Do not change released results.
- Platforms
web· Any OS (web)- Applications
- OpenELIS Global
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Range table vs gold for 8 bands; 9 pending results have flags equal to gold; released results and their flags unchanged (checksum). OpenELIS REST/FHIR write endpoints are disabled and the database is not reachable from the agent VM, so ranges must be edited in the Test Management UI.
Proposed partial credit
50% ranges exact; 35% pending flags; 15% released untouched.
R09.06.01.02-T17 Process a proficiency-testing event in the LIS and the PT provider portal
Original instruction
Five PT samples (event CHEM-B-2026) arrived. In OpenELIS Global accession them like patient specimens with the PT flag, enter results from input/pt_run.csv, then transcribe results with method and instrument codes into the sandbox PT provider portal (browser) and save its confirmation PDF. Results must not be compared with other labs before submission.
- Platforms
web· Any OS (web)- Applications
- OpenELIS Global · PT provider portal (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-applong· Long-horizonrisk· Irreversible/risky- Proposed difficulty
- 5 / 5
Proposed verifier
OpenELIS: 5 PT-flagged samples with gold results; portal DB: 5 x 8 analyte results, method and instrument codes exact, submission confirmed; output/pt_confirmation.pdf present. Portal has no API; LIS API disabled.
Proposed partial credit
30% LIS accessioning and results; 50% portal entries with codes; 20% confirmation saved.
R09.06.01.02-T18 Add an on-request test to a received specimen within its stability window
Original instruction
OpenELIS Global sandbox: a test physician phoned to add Magnesium to specimen 26-004520 and Lipase to specimen 26-004533. Check collection times against input/stability_table.pdf; add the test where the specimen is still within stability, and for the other record a rejection of the add-on with reason 'Exceeds stability' and request a new collection.
- Platforms
web· Any OS (web)- Applications
- OpenELIS Global
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Exactly one add-on test created on the in-stability specimen; the other has a rejection note with gold reason and a recollection request; no other orders changed. OpenELIS REST/FHIR write endpoints are disabled for the account and the database is not reachable from the agent VM, so the add-on must be entered in the order UI.
Proposed partial credit
40% correct stability decision; 35% add-on created; 25% rejection documented.
R09.06.01.02-T19 Register the same four water samples through the SENAITE JSON API (control)
Original instruction
Control pair of T01. On a fresh SENAITE sandbox with senaite.jsonapi enabled and credentials in env SENAITE_USER/SENAITE_PASS, create the 4 samples from input/coc_0912.csv with analyses pH and Pb and transition them to received.
- Platforms
lin· Linux- Applications
- SENAITE JSON API · Python
- Interfaces
api· API/SDKterm· Terminal- GUI need · task setting
AP· API-sufficient- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same catalog check as T01 (fields, analyses, review_state). Used to measure the GUI-vs-API gap on identical content.
Proposed partial credit
40% samples created; 30% analyses; 30% received.
R09.06.01.02-T20 Store twelve aliquots in a freezer box grid and record the chain of custody
Original instruction
SENAITE sandbox with the storage add-on: aliquots of sample BIO-0077 (A01..A12) must go into freezer F2, rack R3, box B3 positions A1..A12 in order, except that A7 is cracked: record it as discarded with reason. Then move box B3 to rack R4 and confirm the location history shows both moves.
- Platforms
web· Any OS (web)- Applications
- SENAITE
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & dropnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Storage catalog: 11 aliquots at exact positions in B3 (A7 position empty), A7 discarded with reason; B3 parent = R4; location history contains both moves. API disabled; audit snapshots required.
Proposed partial credit
50% positions exact; 20% discard recorded; 30% box move and history.
Mapped research references
No benchmark reference is assigned to this class in the current mapping.