R07.12.01.01 · TASK CLASS

Flight planning & performance

Plan routes, fuel, weight-and-balance and procedures in flight-planning tools and simulators.

20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.

Typical applications: ForeFlight · SkyVector · X-Plane FMS
Class GUI-need label: G2 · GUI-essential

Task proposals · 20

Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.

R07.12.01.01-T01 Build an airway route on SkyVector and report its distance

Original instruction

Training exercise, not for real navigation. On SkyVector, build the IFR route KBOI direct BOI V4 LKV direct KMFR (use the IFR Low chart), and write the total route distance in nm and the number of legs shown in the nav log to output/answer.json.

Platforms: web · Any OS (web)
Applications: SkyVector
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms nav · Pan/zoom/scroll
Work product: WP12 · Answer/decision
Conditions: None declared
Proposed difficulty: 2 / 5

Proposed verifier

Grader compares to reference computed from the chart cycle snapshot served by the sandbox: distance within 1 nm, leg count exact. The SkyVector route string must also appear in output/route.txt and match. The agent VM has no terminal or Python and the sandbox serves chart data only to browser sessions, so the route can only be built in the SkyVector web UI.

Proposed partial credit

30% correct route string; 50% distance; 20% leg count.

R07.12.01.01-T02 Program a 737 FMC route with SID, STAR and approach in X-Plane

Original instruction

In X-Plane 12 with the default 737-800 at KSEA, program the FMC: KSEA SUMMA2 departure (runway 16L), route per input/route.txt to KPDX, HHOOD4 arrival and RNAV (GPS) 10R approach, cruise FL250. Execute the route and leave the FMC on LEGS page 1.

Platforms: mac · macOS win · Windows lin · Linux
Applications: X-Plane FMS
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G3 · GUI-only
Interaction primitives: click · Point & click type · Text & forms
Work product: WP08 · App/system state
Conditions: licensed · Licensed pro app
Proposed difficulty: 3 / 5

Proposed verifier

Grader reads the active FMC flight plan via datarefs/fms export: waypoint sequence equals reference (from the shipped navdata cycle), procedures and runway exact, cruise altitude 25000 ft. Grader reads datarefs through its own plugin; agent-side plugins, UDP dataref writes and the web API are disabled and logged.

Proposed partial credit

25% departure/runway; 35% enroute sequence; 25% arrival/approach; 15% cruise level and executed.

R07.12.01.01-T03 Compute weight and balance for a C172 within the CG envelope

Original instruction

Training exercise. In ForeFlight (sandbox account), create a W&B scenario for aircraft profile N-SYN172 (C172S) with pilot 86 kg, front passenger 92 kg, rear passenger 70 kg, baggage area 1 25 kg and full fuel. If over MTOW or outside the envelope, reduce fuel only, to the maximum allowed in 1 gal steps. Report fuel and CG.

Platforms: ios · iOS/iPadOS web · Any OS (web)
Applications: ForeFlight
Interfaces: brow · Browser mob · Mobile touch
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: type · Text & forms click · Point & click touch · Touch gestures
Work product: WP12 · Answer/decision
Conditions: licensed · Licensed pro app
Proposed difficulty: 3 / 5

Proposed verifier

Grader reads the saved scenario via the sandbox account export: station loads exact, fuel equals the max legal value computed by grader, reported CG within 0.1 in. The ForeFlight sandbox issues no API token, so the scenario can only be saved from an app or browser session; the export records the creating client.

Proposed partial credit

30% loads entered; 40% fuel reduction correct; 30% CG reported.

R07.12.01.01-T04 Plan a VFR route around Class B and restricted airspace in Little Navmap

Original instruction

Training exercise. In Little Navmap, plan a VFR route from KHWD to KSNS at 4,500 ft that stays clear of the SFO Class B shelves (by altitude or laterally), the restricted areas in the shipped airspace data and terrain by 1,000 ft. Use at most 6 user waypoints; export output/khwd_ksns.lnmpln.

Platforms: mac · macOS win · Windows lin · Linux
Applications: Little Navmap
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: CL · CLI-sufficient
Interaction primitives: click · Point & click drag · Drag & drop nav · Pan/zoom/scroll vis · Visual judgment
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 4 / 5

Proposed verifier

Grader parses the .lnmpln: every leg sampled at 0.1 nm avoids Class B volume at planned altitude and restricted polygons; terrain clearance >=1,000 ft vs DEM; <=6 user waypoints. The agent has no terminal or text editor, and the file audit log must show the .lnmpln written by the Little Navmap process.

Proposed partial credit

40% airspace clearance; 30% terrain clearance; 20% endpoints/altitude; 10% waypoint limit.

R07.12.01.01-T05 Set up 737 FMC performance and read takeoff V-speeds

Original instruction

In X-Plane 12's 737-800 at KDEN runway 34L (OAT 30 C, QNH 1013), enter PERF INIT values from input/load_sheet.pdf (ZFW, fuel, reserves, cost index 35, FL350), set takeoff flaps 5 and derate per sheet on TAKEOFF REF, and write V1, VR, V2 to output/vspeeds.json.

Platforms: mac · macOS win · Windows lin · Linux
Applications: X-Plane FMS
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: type · Text & forms click · Point & click
Work product: WP12 · Answer/decision
Conditions: licensed · Licensed pro app
Proposed difficulty: 3 / 5

Proposed verifier

Grader reads FMC datarefs: PERF INIT fields exact; flaps/derate set; reported V-speeds equal the FMC-computed values. Grader reads datarefs through its own plugin; agent-side plugins, UDP dataref writes and the web API are disabled and logged.

Proposed partial credit

40% PERF INIT entries; 20% takeoff settings; 40% V-speeds.

R07.12.01.01-T06 Build a fuel plan and nav log without filing it

Original instruction

Training exercise; do not file. In the ForeFlight web planner (sandbox), plan N-SYN58 (BE58 profile) from KAUS to KMSY IFR at 8,000 ft with alternate KBTR, using the planner's winds. Ensure FAR 91.167 reserves; stop at the filing screen, export the nav log PDF, and record trip, alternate, reserve and total fuel.

Platforms: web · Any OS (web)
Applications: ForeFlight
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms
Work product: WP01 · Document
Conditions: licensed · Licensed pro app risk · Irreversible/risky
Proposed difficulty: 4 / 5

Proposed verifier

Grader reads the sandbox account: flight saved but not filed (filing endpoint call log empty); fuel numbers in output/fuel.json equal the planner's; total meets 91.167 (trip+alt+45 min). The ForeFlight sandbox issues no API token, so the flight can only be planned in a browser session.

Proposed partial credit

20% route and alternate; 40% fuel values; 20% reserves rule met; 20% not filed and nav log exported.

R07.12.01.01-T07 Fly a coupled RNAV approach to minimums in X-Plane

Original instruction

In X-Plane 12 (Cessna 172 G1000), starting 15 nm west of KPAE at 4,000 ft, load and activate the RNAV (GPS) RWY 16R approach, couple the autopilot (APR) and fly to the decision altitude, then hand-fly to touchdown. Stay within 1 dot laterally and vertically until DA.

Platforms: mac · macOS win · Windows lin · Linux
Applications: X-Plane FMS
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click key · Shortcuts rt · Real-time control vis · Visual judgment
Work product: WP11 · Game/sim state
Conditions: licensed · Licensed pro app
Proposed difficulty: 5 / 5

Proposed verifier

Grader logs datarefs at 10 Hz: approach loaded/active, AP in APR mode by FAF, CDI and VDI deflections <=1 dot until DA, touchdown on runway within 600 m of threshold and below 600 fpm. Grader reads datarefs through its own plugin; agent-side plugins, UDP dataref writes and the web API are disabled and logged.

Proposed partial credit

20% approach loaded; 20% coupling; 35% tracking within 1 dot; 25% landing criteria.

R07.12.01.01-T08 Look up airport and airway facts on SkyVector

Original instruction

On SkyVector, find for airport KBFI the field elevation and the ATIS frequency, and for airway V23 between SEA and OLM the MEA. Write all three values to output/answer.json.

Platforms: web · Any OS (web)
Applications: SkyVector
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click nav · Pan/zoom/scroll type · Text & forms
Work product: WP12 · Answer/decision
Conditions: None declared
Proposed difficulty: 2 / 5

Proposed verifier

Grader compares to values from the chart/airport-data snapshot served in the sandbox (exact). The agent VM has no terminal or Python and the sandbox serves chart data only to browser sessions, so values must be read in the SkyVector UI.

Proposed partial credit

33% elevation correct; 33% ATIS frequency correct; 34% MEA correct.

R07.12.01.01-T09 Generate an A320 operational flight plan in SimBrief

Original instruction

Training exercise. In SimBrief (sandbox profile), generate an OFP for A320 KJFK to KBOS with 150 passengers at 84 kg, 2,000 kg cargo, cost index 30 and alternate KBDL, using the route in input/route.txt. Write block fuel, trip fuel and planned TOW to output/ofp.json.

Platforms: web · Any OS (web)
Applications: SimBrief
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms
Work product: WP12 · Answer/decision
Conditions: None declared
Proposed difficulty: 2 / 5

Proposed verifier

Grader fetches the generated OFP from the sandbox account: inputs exact; reported values equal the OFP. No SimBrief API key is issued to the sandbox profile, so the OFP can only be generated in a browser session; API calls are logged and fail.

Proposed partial credit

40% inputs correct; 60% values reported.

R07.12.01.01-T10 Check King Air loading at takeoff and landing CG

Original instruction

Training exercise. In ForeFlight W&B (sandbox), load profile N-SYN350 (King Air 350) for the 8 occupants and baggage in input/manifest.csv with 2,800 lb fuel, check takeoff and landing CG (after burning 1,900 lb), and reassign seats only (not weights) so both points are within the envelope. Save the scenario.

Platforms: ios · iOS/iPadOS web · Any OS (web)
Applications: ForeFlight
Interfaces: brow · Browser mob · Mobile touch
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: drag · Drag & drop type · Text & forms click · Point & click
Work product: WP12 · Answer/decision
Conditions: licensed · Licensed pro app
Proposed difficulty: 4 / 5

Proposed verifier

Grader reads the scenario: all occupants present with original weights; takeoff and landing CG within the envelope polygon; at least one seat change required (baseline is out of limits). The ForeFlight sandbox issues no API token, so the scenario can only be saved from an app or browser session; the export records the creating client.

Proposed partial credit

20% manifest entered; 40% takeoff CG in envelope; 40% landing CG in envelope.

R07.12.01.01-T11 Compute top of descent and trip fuel in Little Navmap

Original instruction

In Little Navmap, open fixtures/klax_ksfo.lnmpln, load the aircraft performance file fixtures/b350.lnmperf, set cruise FL240 with the winds-aloft file fixtures/winds.grib, and write top-of-descent distance from destination and trip fuel (lbs) to output/answer.json.

Platforms: mac · macOS win · Windows lin · Linux
Applications: Little Navmap
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: CL · CLI-sufficient
Interaction primitives: click · Point & click type · Text & forms
Work product: WP12 · Answer/decision
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Grader computes with Little Navmap's own calculation on the same inputs (headless): TOD within 1 nm and fuel within 1%. The agent VM has no terminal or Python (no GRIB decoder), so values can only be taken from Little Navmap's own profile and fuel report.

Proposed partial credit

50% TOD; 50% trip fuel.

R07.12.01.01-T12 Enter a holding pattern with the correct entry in X-Plane

Original instruction

In X-Plane 12 (Baron 58 G1000), you are 20 nm southeast of the OLM VOR at 5,000 ft. Fly to OLM and enter the published-style hold in input/hold.txt (radial, right/left turns, 1-min legs) using the correct entry type, and complete 2 circuits within 0.5 nm of the racetrack.

Platforms: mac · macOS win · Windows lin · Linux
Applications: X-Plane FMS
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: key · Shortcuts click · Point & click rt · Real-time control vis · Visual judgment
Work product: WP11 · Game/sim state
Conditions: licensed · Licensed pro app
Proposed difficulty: 4 / 5

Proposed verifier

Grader logs position: entry type inferred from track (direct/teardrop/parallel) must match the geometrically correct entry; 2 complete circuits; max deviation from racetrack <=0.5 nm; altitude +/-100 ft. Grader reads datarefs through its own plugin; agent-side plugins, UDP dataref writes and the web API are disabled and logged.

Proposed partial credit

30% correct entry; 40% two circuits within tolerance; 30% altitude held.

R07.12.01.01-T13 Pick the fastest cruise altitude from winds aloft in ForeFlight

Original instruction

Training exercise. In the ForeFlight planner (sandbox), for N-SYN20 (SR22 profile) KDAL to KMEM IFR, compare the planner's altitude options from 6,000 to 16,000 ft (2,000 ft steps) and select the altitude with the shortest ETE that keeps fuel reserve >=60 min. Save the flight and report the altitude and ETE.

Platforms: web · Any OS (web)
Applications: ForeFlight
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click vis · Visual judgment
Work product: WP12 · Answer/decision
Conditions: licensed · Licensed pro app
Proposed difficulty: 3 / 5

Proposed verifier

Grader reads the saved flight: altitude equals the best option from the snapshot of winds used by the sandbox; reported ETE matches. The ForeFlight sandbox issues no API token, so the flight can only be built and saved in a browser session.

Proposed partial credit

60% optimal altitude; 20% reserve rule; 20% ETE reported.

R07.12.01.01-T14 Plan an ETOPS-180 North Atlantic crossing

Original instruction

Training exercise. Plan a B777-200ER KJFK to EGLL flight using the synthetic NAT track message in input/nat_tracks.txt: choose the track minimizing time with the winds in input/winds.grib, select ETOPS alternates so every point is within 180 min single-engine, generate the OFP in SimBrief and the route in Little Navmap.

Platforms: web · Any OS (web) mac · macOS win · Windows
Applications: SimBrief · Little Navmap
Interfaces: brow · Browser desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms nav · Pan/zoom/scroll multi · Cross-app
Work product: WP08 · App/system state
Conditions: multiapp · Multi-app long · Long-horizon
Proposed difficulty: 5 / 5

Proposed verifier

Grader: chosen track equals the time-optimal track; ETOPS circles from selected alternates cover the route (coverage check at 1 nm); OFP and .lnmpln routes identical. No SimBrief API key is issued and the agent has no terminal or Python, so the OFP must be generated in a browser session; the file audit log must show the .lnmpln written by the Little Navmap process.

Proposed partial credit

30% track choice; 40% ETOPS coverage; 30% consistent OFP and route file.

R07.12.01.01-T15 Compute airway route distance from navdata by script (control pair of T01)

Original instruction

Control pair of T01: from the navdata extract input/navdata_cycle.csv (fixes, airways, coordinates), write a script that expands 'KBOI BOI V4 LKV KMFR' into legs and computes total great-circle distance in nm; write output/answer.json.

Platforms: mac · macOS win · Windows lin · Linux
Applications: Python
Interfaces: term · Terminal
GUI need · task setting: CL · CLI-sufficient
GUI need · ordinary access: CL · CLI-sufficient
Interaction primitives: code · Code & commands
Work product: WP12 · Answer/decision
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Control pair of T01: distance within 0.5 nm of reference; leg list exact.

Proposed partial credit

50% leg expansion; 50% distance.

R07.12.01.01-T16 Hand-fly an engine failure after V1 in X-Plane

Original instruction

In X-Plane 12 (King Air C90 at KBJC runway 30R), the instructor script fails the left engine just after V1. Continue the takeoff: maintain runway heading +/-10 deg, climb at Vyse to 1,500 ft AGL, feather the failed prop and complete the after-takeoff checklist items in input/checklist.txt.

Platforms: mac · macOS win · Windows lin · Linux
Applications: X-Plane FMS
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: key · Shortcuts rt · Real-time control vis · Visual judgment
Work product: WP11 · Game/sim state
Conditions: licensed · Licensed pro app
Proposed difficulty: 5 / 5

Proposed verifier

Grader logs datarefs: heading within 10 deg, IAS within Vyse-5/+10 kt after liftoff, no stall/ground contact, left prop feathered within 30 s, gear up and checklist states set by 1,500 ft AGL. Grader reads datarefs through its own plugin; agent-side plugins, UDP dataref writes and the web API are disabled and logged.

Proposed partial credit

30% directional control; 30% airspeed; 20% feather; 20% checklist states.

R07.12.01.01-T17 Enter a flight plan and approach on a GTN 750 trainer

Original instruction

Training exercise. In the Garmin GTN 750Xi Trainer, enter the flight plan KBDN-DSD-RDM-KRDM, load the RNAV (GPS) RWY 23 approach with vectors-to-final, and activate it. Leave the flight plan page displayed.

Platforms: win · Windows ios · iOS/iPadOS
Applications: Garmin GTN Trainer
Interfaces: desk · Desktop GUI mob · Mobile touch
GUI need · task setting: G3 · GUI-only
GUI need · ordinary access: G3 · GUI-only
Interaction primitives: touch · Touch gestures type · Text & forms click · Point & click
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Grader reads the trainer's saved flight plan export and screen state (VLM rubric used only for the displayed page): waypoints, approach and VTF activation exact. The trainer has no API.

Proposed partial credit

40% enroute plan; 40% approach and VTF; 20% correct page displayed.

R07.12.01.01-T18 Read takeoff distance from POH performance charts

Original instruction

Using the scanned POH charts in input/poh_pa28_takeoff.pdf, determine the ground roll and distance over a 50 ft obstacle for pressure altitude 5,000 ft, OAT 28 C, weight 2,400 lb, 5 kt headwind and paved dry runway. Write both values and the density altitude to output/answer.json.

Platforms: mac · macOS win · Windows
Applications: PDF viewer
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: vis · Visual judgment nav · Pan/zoom/scroll
Work product: WP12 · Answer/decision
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Grader reference from digitized chart interpolation: distances within 5%, density altitude within 150 ft. The agent VM has no terminal, Python or image tools and the digitized reference curves are withheld, so values must be read from the charts in the PDF viewer.

Proposed partial credit

30% density altitude; 35% ground roll; 35% 50-ft distance.

R07.12.01.01-T19 Produce a four-leg VFR nav log with wind corrections

Original instruction

Training exercise. Using SkyVector for courses and distances and the winds in input/winds_aloft.txt, build a VFR nav log for KPAO-KLVK-KSCK-KMOD-KPAO at 5,500/6,500 ft (hemispheric rule) with TAS 105 kt: true course, wind correction, magnetic heading, groundspeed, ETE and fuel at 8.5 gph. Save output/navlog.xlsx.

Platforms: web · Any OS (web) mac · macOS win · Windows
Applications: SkyVector · Excel
Interfaces: brow · Browser desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms nav · Pan/zoom/scroll multi · Cross-app
Work product: WP02 · Records/table
Conditions: multiapp · Multi-app
Proposed difficulty: 4 / 5

Proposed verifier

Grader recomputes per leg from the chart snapshot: course within 2 deg, distance within 1 nm, heading within 2 deg, GS within 2 kt, ETE within 1 min, fuel within 0.2 gal; altitudes follow hemispheric rule. The agent has no terminal or Python, Excel macros are blocked, and chart data is served only to browser sessions, so courses and distances must be read in SkyVector.

Proposed partial credit

25% courses/distances; 35% wind solutions; 25% ETE/fuel; 15% altitudes.

R07.12.01.01-T20 Report a VFR route made infeasible by active TFRs

Original instruction

Training exercise. Plan a VFR flight KSMO to KSBA at 4,500 ft for 1600Z using the sandbox TFR/airspace overlay in Little Navmap (fixtures/tfr_overlay.json). If no route satisfies the client's constraints in input/constraints.md, do not violate them: write output/advisory.md explaining which constraint blocks the flight.

Platforms: mac · macOS win · Windows lin · Linux
Applications: Little Navmap
Interfaces: desk · Desktop GUI
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: CL · CLI-sufficient
Interaction primitives: click · Point & click nav · Pan/zoom/scroll vis · Visual judgment
Work product: WP12 · Answer/decision
Conditions: clarify · Ask when unclear
Proposed difficulty: 3 / 5

Proposed verifier

The constraints are infeasible by design (TFR + no-Class-B + max 4,500 ft). Grader: advisory.md names the blocking TFR and constraint; no .lnmpln violating constraints is exported. The agent has no terminal or text editor; any exported .lnmpln must be written by Little Navmap (file audit log).

Proposed partial credit

50% infeasibility correctly declared; 30% blocking element named; 20% no violating plan saved.

Mapped research references

Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.

Agents' Last Exam (ALE)