Emergency operations & incident reporting
Maintain incident boards, resource requests and situation reports.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- WebEOC · ArcGIS dashboards
- Class GUI-need label
G2· GUI-essential
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R10.04.01.03-T01 Post a significant event to the EOC board
Original instruction
WebEOC training instance, incident 'Exercise - River Flood 2026' (synthetic). From the radio note in input/note_0715.txt, post a Significant Event on the Sig Events board with time, location, category (Infrastructure), jurisdiction, description and the 'Notify Planning' flag, and link it to the incident.
- Platforms
web· Any OS (web)- Applications
- WebEOC
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 2 / 5
Proposed verifier
Board table export: one new row with fields equal to gold (time to the minute) linked to the incident; notify flag set. The training position has no WebEOC API access; the audit log shows the board input view.
Proposed partial credit
60% fields; 20% category and flag; 20% linked to incident.
R10.04.01.03-T02 Submit a typed resource request and route it to Logistics
Original instruction
WebEOC training instance, Resource Request board (ICS 213RR). From input/request_email.pdf, create a request for 2 Type 2 portable generators and 1 Type 3 water pumping unit with delivery location, needed-by time, priority, requesting position and justification using the FEMA resource typing names in input/rtlt_excerpt.pdf, then route it to the Logistics Section.
- Platforms
web· Any OS (web)- Applications
- WebEOC
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Request rows (one per kind/type) vs gold: kind/type names exact, quantities, location, needed-by and priority exact; status 'Routed to Logistics'. WebEOC API (web services) access is denied to the agent position, and the board audit must confirm UI entry from the browser session.
Proposed partial credit
40% kind/type and quantity; 30% logistics fields; 30% routed.
R10.04.01.03-T03 Compile and publish a situation report from board data
Original instruction
WebEOC training instance, operational period 2 (06:00-18:00). Compile the Situation Report board entry from the Shelters, Road Closures, Damage Reports and Sig Events boards: counts of open shelters and occupancy, active closures, damage totals by category, and the 5 most significant events, using the template fields, then publish it.
- Platforms
web· Any OS (web)- Applications
- WebEOC
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
nav· Pan/zoom/scrolltype· Text & formsmulti· Cross-app- Work product
WP01· Document- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
SitRep row: numeric fields equal values computed from board snapshots for the period (seeded edits outside the period excluded); 5 events match the gold top-5 by severity flag; status Published. WebEOC API (web services) access is denied to the agent position, and the board audit must confirm UI entry from the browser session.
Proposed partial credit
50% numeric fields; 30% top events; 20% published.
R10.04.01.03-T04 Build an EOC dashboard of shelters, closures and call volume
Original instruction
ArcGIS Online (sandbox org) holds feature layers Shelters, Road_Closures and Calls_311. Build an ArcGIS Dashboard 'Flood EOC - Ops' with: a map with shelter points symbolized by percent occupancy, an indicator of active closures, a serial chart of 311 calls per hour, a list of shelters over 80% full, and a category selector that filters all elements by district. Share with the 'EOC Staff' group.
- Platforms
web· Any OS (web)- Applications
- ArcGIS Dashboards · ArcGIS Online
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & dropvis· Visual judgment- Work product
WP03· Visual layout- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Dashboard item JSON: 5 required elements with correct data sources, expressions (occupancy ratio, active filter, hourly binning), selector wired to all elements; shared to the group. Rendered screenshot compared against layout rubric (elements visible, no errors). No API key is issued and the sandbox proxy blocks ArcGIS REST calls from outside the browser session, so the dashboard must be authored in the Dashboards app.
Proposed partial credit
50% elements and data bindings; 25% selector wiring; 15% sharing; 10% renders without errors.
R10.04.01.03-T05 Update six shelters' status from a phone log
Original instruction
WebEOC training instance, Shelters board. input/shelter_calls.txt has the latest calls from 6 shelter managers. Update each shelter's current occupancy, capacity, pet-friendly and ADA status, close the one shelter that lost power (with reason), and leave the other shelters unchanged.
- Platforms
web· Any OS (web)- Applications
- WebEOC
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Shelter rows equal gold for the 6 shelters, the closed one has status Closed and reason; the other 9 shelter rows unchanged (diff). WebEOC API (web services) access is denied to the agent position, and the board audit must confirm UI entry from the browser session.
Proposed partial credit
60% six shelter updates; 25% closure; 15% no collateral changes.
R10.04.01.03-T06 Staff the planning desk through a 45-minute exercise with live injects
Original instruction
WebEOC training instance, live functional exercise: injects arrive every 2-4 minutes by email and phone transcript. Log significant events, process 8 resource requests (create, route, update status as Logistics replies), update shelter and road-closure boards, and publish the end-of-period SitRep at minute 45.
- Platforms
web· Any OS (web)- Applications
- WebEOC · Outlook on the web (sandbox)
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickmulti· Cross-apprt· Real-time control- Work product
WP08· App/system state- Conditions
licensed· Licensed pro applong· Long-horizoninterrupt· Interruptions- Proposed difficulty
- 5 / 5
Proposed verifier
Graded against the exercise master scenario events list: each inject's required board action present with correct fields within 5 minutes of the inject; final SitRep numbers equal board state at minute 45. WebEOC API access is denied and the mailbox has no Graph/IMAP credentials, so injects are reachable only in Outlook on the web and board actions must appear in the WebEOC audit.
Proposed partial credit
30% events logged; 30% resource requests lifecycle; 20% shelter/closure updates; 20% final SitRep.
R10.04.01.03-T07 Reopen five road closures on the closures map
Original instruction
ArcGIS Online sandbox, web map 'Road Closures' with an editable Road_Closures layer. Public Works reports 5 roads reopened (input/pw_update.txt). Using the map's edit widget, set those 5 closures to status 'Reopened' with reopen time, without moving their geometry or touching other closures.
- Platforms
web· Any OS (web)- Applications
- ArcGIS Online
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrolltype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
Feature layer query: 5 features with status and time exact; geometries unchanged (hash); other features unchanged. Agent account has no API token; edit tracking shows Map Viewer edits.
Proposed partial credit
70% five updates; 30% no other changes.
R10.04.01.03-T08 Prepare ICS 204 assignment lists for three divisions
Original instruction
From the planning meeting notes input/planning_notes.pdf and the resource roster input/roster.xlsx, complete three ICS 204 Assignment List forms (fillable PDFs in input/ics204_blank.pdf) for Divisions A, B and C: operational period, supervisors, resources assigned with leader and number of persons, work assignments, special instructions and communications. Save output/ics204_A.pdf, _B.pdf, _C.pdf.
- Platforms
mac· macOSwin· Windows- Applications
- Adobe Acrobat Reader · Excel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
type· Text & formsmulti· Cross-app- Work product
WP01· Document- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
AcroForm field values per form vs gold (resource rows exact, persons totals correct, period exact); free-text assignment fields contain the required tasks (keyword sets). Python and PDF form libraries are absent from the VM, so the forms must be filled in Acrobat Reader (files saved by Reader, checked in metadata).
Proposed partial credit
40% resources and leaders; 30% header fields; 30% assignments and instructions.
R10.04.01.03-T09 QA forty damage reports by photo and compute preliminary damage totals
Original instruction
ArcGIS Online sandbox: layer Damage_Reports has 40 field reports from Survey123 with photos and a damage level chosen by volunteers. Review each photo against input/damage_criteria.pdf (affected/minor/major/destroyed), correct misclassified levels in the layer, then compute counts by level and by insured status in output/pda_summary.xlsx for the preliminary damage assessment.
- Platforms
web· Any OS (web)- Applications
- ArcGIS Online · Survey123 · Excel
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
vis· Visual judgmentclick· Point & clicknav· Pan/zoom/scroll- Work product
WP10· Annotations- Conditions
multiapp· Multi-applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Damage level per feature vs expert gold (accuracy >= 0.9; 9 seeded misclassifications); summary counts equal counts from the corrected layer and from gold. Photos carry no level hints in names or EXIF. No API key is issued and the sandbox proxy blocks ArcGIS REST calls from outside the browser session; edits must appear in the layer's editor tracking.
Proposed partial credit
60% level accuracy; 25% summary counts; 15% only damage field edited.
R10.04.01.03-T10 Activate an incident room from a plan template and assign roles
Original instruction
Veoci sandbox: activate the 'Severe Weather Activation' room template for incident 'Winter Storm Kaia (exercise)', assign the 7 EOC roles from input/staffing.csv, set the operational period, and instantiate the 'Level 2 Activation' checklist with due times relative to activation per input/eop_annex.pdf.
- Platforms
web· Any OS (web)- Applications
- Veoci
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Room created from the template with correct name and period; 7 role assignments exact; checklist items present with due times = activation + offsets; no API key used (audit shows UI).
Proposed partial credit
25% room; 35% roles; 40% checklist with due times.
R10.04.01.03-T11 Reconcile resource requests with deliveries and flag duplicates for cost recovery
Original instruction
WebEOC training instance: 26 resource requests from the last 3 operational periods. Using delivery receipts in input/receipts/ (PDFs) update each request's fulfillment status and quantities, mark duplicates (same kind/type and location within 2 hours) as duplicate with a link to the original, and export the reconciled list to output/cost_tracking.xlsx with vendor and cost from the receipts.
- Platforms
web· Any OS (web)- Applications
- WebEOC · Excel
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP02· Records/table- Conditions
licensed· Licensed pro appmultiapp· Multi-apphidden· Hidden/stale state- Proposed difficulty
- 4 / 5
Proposed verifier
Request statuses and delivered quantities equal gold; 3 seeded duplicates marked with correct original links; export rows equal gold with cost values exact. WebEOC API (web services) access is denied to the agent position, so status updates and duplicate links must appear in the board audit from the browser session.
Proposed partial credit
40% fulfillment updates; 25% duplicates; 35% cost export.
R10.04.01.03-T12 Digitize a flood extent and build a common operating picture
Original instruction
ArcGIS Online sandbox: from the post-event satellite image layer, digitize the flood extent polygon in a new layer, then build web map 'River Flood COP' with the extent, shelters, closures and critical facilities. Compute how many critical facilities and residential parcels fall inside the extent, add those indicators to a dashboard, and share both with the 'EOC Staff' group.
- Platforms
web· Any OS (web)- Applications
- ArcGIS Online · ArcGIS Dashboards
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
path· Continuous pathvis· Visual judgmentnav· Pan/zoom/scrollclick· Point & click- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro applong· Long-horizonmultiapp· Multi-app- Proposed difficulty
- 5 / 5
Proposed verifier
Flood polygon vs expert gold IoU >= 0.75; web map has the 4 layers; reported counts equal spatial-join counts on the agent's polygon and within 10% of counts on gold; dashboard indicators bound to those queries; shared. No API key is issued and the sandbox proxy blocks ArcGIS REST calls from outside the browser session, so the polygon must be digitized in Map Viewer.
Proposed partial credit
40% flood extent; 20% web map; 25% counts; 15% dashboard and sharing.
R10.04.01.03-T13 Compile an ICS 214 activity log from board history
Original instruction
From the WebEOC training instance's activity and position logs for the Logistics Section Chief during operational period 2, complete an ICS 214 Activity Log (input/ics214_blank.pdf): name, ICS position, home agency, resources assigned, and the chronological activity entries (time, notable activity). Save output/ics214_logistics.pdf.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- WebEOC · Adobe Acrobat Reader
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
nav· Pan/zoom/scrolltype· Text & formsmulti· Cross-app- Work product
WP01· Document- Conditions
licensed· Licensed pro appmultiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Form fields: header fields exact; activity entries vs the 18 gold log entries (time exact, text token-F1 >= 0.7), chronological; no entries from other positions. WebEOC API access is denied and PDF form libraries are absent from the VM, so logs must be read in the WebEOC UI and the form filled in Acrobat Reader.
Proposed partial credit
20% header; 60% activity entries; 20% ordering and scope.
R10.04.01.03-T14 Count unfilled high-priority resource requests older than twelve hours
Original instruction
In the WebEOC training instance's Resource Request board, determine how many requests are high priority, not yet filled, and were submitted more than 12 hours ago as of the board's current time, and which requesting jurisdiction has the most of them. Write output/answer.json.
- Platforms
web· Any OS (web)- Applications
- WebEOC
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
nav· Pan/zoom/scrollclick· Point & click- Work product
WP12· Answer/decision- Conditions
licensed· Licensed pro app- Proposed difficulty
- 2 / 5
Proposed verifier
Count and jurisdiction equal values computed from the board snapshot; a seeded 'partially filled' status counts as unfilled per the board legend. WebEOC API (web services) access is denied to the agent position, so board data are reachable only through the board views in the browser.
Proposed partial credit
60% count; 40% jurisdiction.
R10.04.01.03-T15 Update evacuation zone statuses and reshape one zone on the map
Original instruction
ArcGIS Online sandbox, layer Evac_Zones (polygons). Per input/ic_order_1400.pdf, set 4 zones from 'Warning' to 'Order', lift 2 orders, and reshape zone E-7 so its new northern boundary follows Route 12 as described. Confirm the dashboard 'Evacuation Status' indicators update.
- Platforms
web· Any OS (web)- Applications
- ArcGIS Online · ArcGIS Dashboards
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickpath· Continuous pathgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Status attributes equal gold for 6 zones; E-7 geometry: northern edge within 30 m of the Route 12 centerline along its length (Hausdorff), rest of polygon unchanged; dashboard indicator values equal the new counts. No API key is issued and the sandbox proxy blocks ArcGIS REST calls from outside the browser session; edits must appear in editor tracking.
Proposed partial credit
45% statuses; 40% reshape accuracy; 15% dashboard reflects.
R10.04.01.03-T16 Record personnel check-in and equipment deployment for an incident
Original instruction
D4H Incident Management sandbox, incident 'Exercise - River Flood 2026'. From the paper check-in sheet input/checkin_scan.pdf, record check-in times and assignments for 14 responders, and deploy 6 equipment items to Division B with times. Two responders checked out at shift change; record their check-out.
- Platforms
web· Any OS (web)- Applications
- D4H
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickvis· Visual judgment- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Attendance records vs gold (14 check-ins, 2 check-outs, times to the minute, assignments); 6 equipment deployments with division and time; handwriting on the scan seeded for 3 times. D4H API tokens are withheld from the sandbox account, so records must appear in the incident audit log from the browser session.
Proposed partial credit
50% check-ins; 20% check-outs; 30% equipment deployments.
R10.04.01.03-T17 Write an exercise after-action report and improvement plan in HSEEP format
Original instruction
From the exercise logs (input/exercise_logs/ with WebEOC exports, evaluator guides and hotwash notes), write output/aar_ip.docx using input/hseep_aar_template.docx: map observations to the 3 exercise objectives and core capabilities, list strengths and areas for improvement with root causes, and complete the improvement plan matrix with corrective actions, owners and dates.
- Platforms
mac· macOSwin· Windows- Applications
- Word · Excel
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
type· Text & formsmulti· Cross-appnav· Pan/zoom/scroll- Work product
WP01· Document- Conditions
long· Long-horizonmultiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
Structure checks: template sections present; each of 9 gold areas for improvement appears (keyword match) with a capability mapping equal to gold; IP matrix rows complete with owner and date. Narrative quality by LLM rubric (25%).
Proposed partial credit
35% areas for improvement found and mapped; 25% IP matrix; 15% structure; 25% narrative (LLM rubric).
R10.04.01.03-T18 Build a generator-status board in the WebEOC board editor
Original instruction
WebEOC training instance (admin role). Create a new board 'Generator Status' with an input view (facility, generator ID, kW, fuel level %, runtime hours, status dropdown, last updated), a list view sorted by fuel level with rows under 25% highlighted red, and a display view filter by status. Assign the board to the Logistics position.
- Platforms
web· Any OS (web)- Applications
- WebEOC Board Editor
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsdrag· Drag & drop- Work product
WP08· App/system state- Conditions
licensed· Licensed pro apptutorial· Follow docs/tutorial- Proposed difficulty
- 4 / 5
Proposed verifier
Board definition export: fields and types exact; list view sort and conditional formatting rule (fuel < 25 -> red) present; filter works on a grader-inserted test row; board assigned to Logistics position. WebEOC API access is denied and board package import is disabled for the admin role, so the board must be built in the Board Editor (board history checked).
Proposed partial credit
40% fields; 30% list view sort and highlight; 15% filter; 15% assignment.
R10.04.01.03-T19 Reopen the same five road closures through the ArcGIS REST API (control)
Original instruction
Control pair of T07. With a token in env AGOL_TOKEN, use the feature service applyEdits endpoint to set the 5 closures in input/pw_update.txt to 'Reopened' with reopen time, without changing geometry or other features.
- Platforms
lin· Linux- Applications
- ArcGIS REST API · Python
- Interfaces
api· API/SDKterm· Terminal- GUI need · task setting
AP· API-sufficient- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same feature checks as T07. Measures GUI-vs-API gap.
Proposed partial credit
70% five updates; 30% no other changes.
R10.04.01.03-T20 Draft a geotargeted public alert in a training alert-origination tool
Original instruction
In the alert origination software's training mode, draft a flash-flood evacuation alert for zones E-3 and E-4: draw the alert polygon matching the two zones from the map layer, set CAP fields (event, urgency, severity, certainty, expiry 4 h), write the 90-character and 360-character messages per input/alert_style.pdf, and send it only to the training/test channel. Do not send to any live channel.
- Platforms
web· Any OS (web)- Applications
- alert origination tool (training mode)
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
path· Continuous pathtype· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
Training-channel CAP message: polygon IoU >= 0.8 with zone union; CAP fields exact; message lengths within limits and contain required elements (hazard, action, area, time); no live-channel transmission record. The tool issues no API credentials for CAP submission and live channels are blocked for the training account, so the alert must be drafted and sent from the tool UI.
Proposed partial credit
35% polygon; 25% CAP fields; 25% messages; 15% test channel only.
Mapped research references
No benchmark reference is assigned to this class in the current mapping.