Facility & building automation operations
Adjust building-automation schedules and setpoints and manage facility work orders.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- Niagara · Metasys · CMMS
- Class GUI-need label
HY· Hybrid
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R05.13.01.07-T01 Set a holiday schedule to unoccupied for four air handlers
Original instruction
A Niagara 4 training station (web UI, simulated BACnet AHUs) is open. Add a holiday exception so AHU-1..AHU-4 run unoccupied from 2026-12-24 00:00 through 2026-12-26 23:59, using the existing 'Holidays' calendar referenced by each AHU's weekly schedule. Do not change the weekly schedules.
- Platforms
web· Any OS (web)- Applications
- Niagara 4
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Station read via grader-only fox/BACnet: calendar has the 3-day exception; simulated occupancy for each AHU is unoccupied at sampled times in the range and occupied per weekly schedule on 12-23; weekly schedules byte-identical. Agent account lacks oBIX/BQL web access and admin/program rights, and its VM has no Workbench or fox/BACnet route to the station, so changes go through the web UI.
Proposed partial credit
50% exception dates; 30% effective on all 4 AHUs; 20% weekly schedules untouched.
R05.13.01.07-T02 Apply a timed cooling setpoint reduction to one floor
Original instruction
In the Metasys training site (web UI), lower the occupied cooling setpoint of all 14 VAV zones on Floor 3 by 1 degF from 13:00 to 17:00 today only, using a temporary override/scheduled command that releases automatically. Other floors and other days must be unaffected.
- Platforms
web· Any OS (web)- Applications
- Metasys
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Simulator log: Floor 3 zone setpoints = base - 1 between 13:00 and 17:00 sim time and back to base after; priority array released; no change elsewhere. Write access exists only through the UI session.
Proposed partial credit
35% all 14 zones adjusted; 35% time window and auto-release; 30% no collateral setpoint changes.
R05.13.01.07-T03 Acknowledge priority alarms and raise CMMS work orders
Original instruction
The Niagara training station alarm console shows 9 unacknowledged alarms. Acknowledge the 3 with priority <= 50, and for each create a corrective work order in the CMMS (UpKeep sandbox) with asset, problem text from the alarm, priority High, and the alarm timestamp in the description. Leave lower-priority alarms unacknowledged.
- Platforms
web· Any OS (web)- Applications
- Niagara 4 · UpKeep
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Alarm DB: exactly the 3 high-priority alarms acknowledged by agent user; CMMS: 3 work orders with correct assets, priority and timestamps; low-priority alarms untouched. Station fox/BACnet access and UpKeep API tokens are withheld from the agent, so alarms must be acked in the web console and orders made in UpKeep's web app.
Proposed partial credit
35% correct alarms acknowledged; 45% work orders complete; 20% others untouched.
R05.13.01.07-T04 Export a supply-air trend and quantify setpoint deviation
Original instruction
In the Metasys training site, export the trend of AHU-2 supply air temperature and its setpoint for 2026-10-05..11 at 5-minute samples to output/ahu2_sat.csv, then compute the percentage of occupied-hours samples where |SAT - setpoint| > 1 degF and write it to output/deviation.txt.
- Platforms
web· Any OS (web)win· Windowsmac· macOS- Applications
- Metasys · Excel
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrollmulti· Cross-app- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
CSV covers the range and interval with both series; percentage within 0.5 points of key computed from the simulator's history and the occupancy schedule.
Proposed partial credit
40% trend export; 20% occupied-hours filter; 40% percentage within tolerance.
R05.13.01.07-T05 Build a graphic page for a new air handler
Original instruction
In Niagara Workbench on Windows (training station), create a Px view for AHU-5 from template sketch input/ahu5_graphic.png: duct background, animated supply fan bound to fan status, SAT and RAT value labels, damper position bar, and a setpoint field users can edit. Bind every widget to the correct point and set it as the AHU's default view.
- Platforms
win· Windows- Applications
- Niagara Workbench
- Interfaces
desk· Desktop GUIhmi· Device/HMI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropgeom· Precise geometryvis· Visual judgmentclick· Point & click- Work product
WP03· Visual layout- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Parse Px XML: widget bindings to exact ord paths; widget positions within 20 px of the sketch layout; setpoint field writable; default view set. Render test: SSIM >= 0.8 vs reference rendering. Workbench program modules are disabled, the VM has no scripting runtime and file writes outside Workbench are logged, so the Px must be built in Workbench.
Proposed partial credit
45% correct bindings; 25% layout match; 15% writable setpoint; 15% default view.
R05.13.01.07-T06 Wire economizer enable logic on a wire sheet
Original instruction
In Niagara Workbench (training station), on AHU-5's wire sheet add economizer enable logic: enable when OAT < RAT - 2 degF and OAT < 65 degF and supply fan proven, with a 5-minute minimum-on timer, and drive the outdoor-air damper command between minimum position 20% and the mixed-air PID output when enabled.
- Platforms
win· Windows- Applications
- Niagara Workbench
- Interfaces
desk· Desktop GUIhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
licensed· Licensed pro app- Proposed difficulty
- 5 / 5
Proposed verifier
Behavioral test in simulator over 6 scripted OAT/RAT profiles: enable state and damper command match the sequence (min-on timer honored); wire sheet contains no program objects (custom code blocked). Station has no scripting module.
Proposed partial credit
40% enable logic correct; 20% min-on timer; 30% damper command; 10% no custom code.
R05.13.01.07-T07 Override VAV dampers for balancing and release them
Original instruction
In Siemens Desigo CC (training, Windows), the balancer needs VAV-3-01..VAV-3-06 at max airflow. Command each damper to 100% at operator priority from the floor graphic, record measured flows from input/tab_readings.csv into each point's comment, then release all overrides so control returns to automatic.
- Platforms
win· Windows- Applications
- Desigo CC
- Interfaces
desk· Desktop GUIhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP08· App/system state- Conditions
licensed· Licensed pro apprisk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
Command log: 6 overrides then 6 releases by agent user; final priority arrays have no operator entries; comments with flows exact. Leaving any override in place fails that milestone. Desigo CC's web/OPC/BACnet interfaces are firewalled from the agent VM, so commands must come from the floor graphic in the client.
Proposed partial credit
30% overrides applied; 30% flows recorded; 40% all released.
R05.13.01.07-T08 Create a delayed high-temperature alarm with routing
Original instruction
In EcoStruxure Building Operation WorkStation (training server), create an alarm on CHW supply temperature: high limit 48 degF, 10-minute time delay, 1 degF deadband, priority 'Critical', routed to notification group 'Plant Ops' with acknowledgement required. Test it with the simulator ramp in input/ramp.txt.
- Platforms
win· Windows- Applications
- EcoStruxure Building Operation
- Interfaces
desk· Desktop GUIhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Alarm object properties exact; simulator ramp produces exactly one alarm after 10 min above 48 and return-to-normal below 47; notification delivered to group. EBO web services and Script programs are disabled for the agent account, so the alarm must be configured in WorkStation.
Proposed partial credit
50% alarm properties; 30% behavior under ramp; 20% routing.
R05.13.01.07-T09 Retune a hunting discharge-air PID loop
Original instruction
In the Niagara training station (simulated AHU-3 with plant dynamics running in real time at 10x), the discharge-air temperature loop oscillates. Observe the trend, then adjust proportional and integral gains on the PID block until a 2 degF setpoint step settles within 15 sim-minutes with overshoot below 1 degF and no sustained oscillation.
- Platforms
win· Windowsweb· Any OS (web)- Applications
- Niagara 4
- Interfaces
desk· Desktop GUIhmi· Device/HMI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
rt· Real-time controlvis· Visual judgmenttype· Text & forms- Work product
WP07· Simulation result- Conditions
licensed· Licensed pro app- Proposed difficulty
- 5 / 5
Proposed verifier
Grader applies a fresh setpoint step with the final gains: settling time <= 15 sim-min, overshoot < 1 degF, decay ratio < 0.25; gains within block limits. Program objects are disabled and fox/BACnet ports are firewalled from the agent, so gains must be edited on the PID block property sheet.
Proposed partial credit
40% settling time; 30% overshoot; 30% no sustained oscillation.
R05.13.01.07-T10 Execute a demand-response load shed and verify kW reduction
Original instruction
The utility called a DR event 14:00-18:00 (sim time). In the Metasys training site, apply the shed plan in input/dr_plan.pdf: +2 degF cooling setpoint reset on non-critical zones, disable 2 of 4 corridor lighting groups, cap AHU fan speeds at 80%. Total building kW must drop >= 15% vs baseline, and everything restores at 18:00.
- Platforms
web· Any OS (web)- Applications
- Metasys
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsrt· Real-time control- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Simulator meter: average kW during event <= 0.85 x baseline; only non-critical zones reset; settings restored by 18:05 sim; no critical zones touched. Metasys REST API credentials are withheld and the BACnet network is firewalled from the agent VM, so commands must come from the Metasys UI.
Proposed partial credit
40% kW reduction met; 25% correct zones/groups; 25% restoration; 10% critical zones untouched.
R05.13.01.07-T11 Create preventive maintenance schedules for pumps
Original instruction
In IBM Maximo (training), create PM records for the 8 pumps in input/pumps.xlsx: monthly lubrication job plan JP-LUBE and quarterly vibration route JP-VIB, starting next Monday 2026-10-19, frequency from last start, with the assigned crafts. Generate the first work orders.
- Platforms
web· Any OS (web)- Applications
- IBM Maximo · Excel
- Interfaces
brow· Browser- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
PM table: 16 PMs (8 x 2) with asset, job plan, frequency, start date and crafts; first work orders generated with target dates.
Proposed partial credit
50% PM records; 25% frequencies and dates; 25% work orders generated.
R05.13.01.07-T12 Close completed work orders with labor and parts
Original instruction
In UpKeep (sandbox), close the 10 completed work orders listed in input/tech_notes.md: record labor hours per technician, parts used from inventory with quantities, completion notes, and set status Complete. Two notes say the job is not finished; leave those In Progress with the note added.
- Platforms
web· Any OS (web)- Applications
- UpKeep
- Interfaces
brow· Browser- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Work orders: 8 complete with labor and parts lines exact (inventory decremented), 2 in progress with notes.
Proposed partial credit
35% labor; 35% parts; 20% statuses; 10% notes.
R05.13.01.07-T13 Find top downtime assets and open root-cause work orders
Original instruction
In Fiix CMMS (sandbox), use the downtime records for Q3 2026 to find the 3 assets with the most unplanned downtime hours, then create an RCA work order for each with type 'Root Cause Analysis', the downtime total in the description, and assignment to the reliability engineer. Write the ranking to output/top3.csv.
- Platforms
web· Any OS (web)- Applications
- Fiix
- Interfaces
brow· Browser- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
nav· Pan/zoom/scrollclick· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
CSV ranking and hours equal key; 3 RCA work orders with correct assets, type, description hours and assignee.
Proposed partial credit
40% ranking; 15% hours; 45% RCA work orders.
R05.13.01.07-T14 Complete a work order checklist on a phone
Original instruction
On an Android emulator with the UpKeep mobile app (technician account), open work order WO-2291 'Monthly AHU-2 inspection', complete the 8-item checklist per input/inspection_results.txt, enter the filter differential-pressure meter reading, attach the photo from the gallery, and submit.
- Platforms
and· Android- Applications
- UpKeep mobile
- Interfaces
mob· Mobile touch- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturestype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Work order checklist responses exact; meter reading on the right meter; photo attached; status complete; events from mobile client.
Proposed partial credit
50% checklist; 20% meter; 15% photo; 15% submitted.
R05.13.01.07-T15 Schedule after-hours HVAC for a tenant and bill it
Original instruction
Tenant 'Suite 410' requested after-hours HVAC (input/ahhvac_request.eml) for Saturday 2026-10-17 09:00-14:00. In the Metasys training site, add a one-time occupied event for the zones serving Suite 410 only, then in the CMMS (UpKeep sandbox) create a billable request with 5 hours at the lease rate in input/lease_rates.csv.
- Platforms
web· Any OS (web)- Applications
- Metasys · UpKeep
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
Simulator occupancy for the 3 Suite 410 zones on the date/time only; no other zones; CMMS request with hours and amount = 5 x rate. Metasys REST and UpKeep API credentials are withheld from the agent, so the event and request must be made in the two web UIs.
Proposed partial credit
50% correct zones and window; 15% no other zones; 35% billing record.
R05.13.01.07-T16 Discover BACnet devices and map tagged points
Original instruction
In Niagara Workbench (training station on a simulated BACnet/IP network), discover the 3 new VAV controllers, add them to the station, and map 12 points (zone temp, setpoints, damper, airflow) using the naming convention in input/naming.md, correct engineering units, and Haystack tags (zone, air, temp, sensor, etc.).
- Platforms
win· Windows- Applications
- Niagara Workbench
- Interfaces
desk· Desktop GUIhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & droptype· Text & forms- Work product
WP08· App/system state- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Station export: 3 devices with correct instance numbers; 12 proxy points bound to the right object ids; names, units and tag sets match key. Workbench program modules are disabled and the VM has no BACnet tool outside Workbench, so discovery and point mapping must be done in Workbench.
Proposed partial credit
25% devices; 35% point bindings; 20% names/units; 20% tags.
R05.13.01.07-T17 Control: write the T01 holiday exception over BACnet
Original instruction
Control pair of T01. Using a BACnet command-line tool or Python bacpypes on the same simulated network (device and object ids in input/bacnet_map.json), write the 2026-12-24..26 date-range exception into the Calendar object referenced by AHU-1..4 schedules.
- Platforms
lin· Linuxwin· Windowsmac· macOS- Applications
- bacpypes · Python
- Interfaces
term· Terminal- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same occupancy checks as T01 via the simulator.
Proposed partial credit
50% exception dates; 30% effective on all AHUs; 20% weekly schedules untouched.
R05.13.01.07-T18 Detect simultaneous heating and cooling from zone trends
Original instruction
In the Niagara training station, review last week's trends for the 20 VAV zones with reheat on Floor 2. Identify zones where reheat valve > 10% while the AHU supplies air below 58 degF and zone is above its cooling setpoint for > 2 h total. Create a CMMS (Fiix sandbox) work order per zone and list them in output/shc.csv.
- Platforms
web· Any OS (web)- Applications
- Niagara 4 · Fiix
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
vis· Visual judgmentnav· Pan/zoom/scrollmulti· Cross-app- Work product
WP12· Answer/decision- Conditions
multiapp· Multi-app- Proposed difficulty
- 4 / 5
Proposed verifier
CSV zone set equals key (5 zones) with hours within 0.25 h; work orders for those zones only.
Proposed partial credit
50% zone set; 20% hours; 30% work orders.
R05.13.01.07-T19 Create an astronomical lighting schedule with offsets
Original instruction
In the Niagara training station lighting module, create a schedule for parking-lot lighting groups PL-1..PL-3: on at sunset +15 min, off at 23:00, back on at 05:00, off at sunrise -10 min, for the site latitude/longitude in the station, and link it to the 3 groups.
- Platforms
web· Any OS (web)- Applications
- Niagara 4
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Simulated output for 7 sampled dates matches astronomical on/off times +/- 2 min; all 3 groups follow the schedule. Agent account lacks program rights and has no fox/BACnet access, so the schedule must be built in the web UI.
Proposed partial credit
40% sunset/sunrise offsets; 30% fixed times; 30% linked to groups.
R05.13.01.07-T20 Change a building over from heating to cooling season
Original instruction
In the Metasys training site, execute the seasonal changeover checklist input/changeover.pdf: switch the plant mode, enable chiller staging and disable boiler lead/lag, update 40 zone setpoints via the group command, adjust AHU discharge reset schedules and occupancy schedules for summer hours, and verify in the simulator that space temps hold within setpoint +/-1.5 degF for 2 sim-hours.
- Platforms
web· Any OS (web)- Applications
- Metasys
- Interfaces
brow· Browserhmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scrollrt· Real-time control- Work product
WP08· App/system state- Conditions
long· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Simulator state after 2 sim-hours: plant mode cooling, chillers staged, boilers off, 40 setpoints per checklist, reset and schedules exact; >= 95% of zone samples within +/-1.5 degF. Metasys REST API credentials are withheld and the BACnet network is firewalled from the agent VM, so commands must come from the Metasys UI.
Proposed partial credit
20% plant mode; 20% setpoints; 20% reset/schedules; 40% comfort verification.
Mapped research references
No benchmark reference is assigned to this class in the current mapping.
In this workflow family
- R05.13.01.01 Hotel & restaurant operations (PMS, POS)
- R05.13.01.02 Retail store & point-of-sale operations
- R05.13.01.03 Real estate & property management
- R05.13.01.04 Insurance claims & underwriting
- R05.13.01.05 Banking & lending operations
- R05.13.01.06 Construction estimating & field management
- R05.13.01.08 Service appointment scheduling (provider side)