In-car infotainment & navigation
Operate in-vehicle UIs for navigation, media and settings with safety constraints.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- Android Automotive emulator · CarPlay simulator
- Class GUI-need label
G3· GUI-only
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R12.02.01.04-T01 Set the navigation destination to Home while parked
Original instruction
In the Android Automotive OS emulator (gear P, speed 0 via VHAL), open the navigation app and start route guidance to the saved 'Home' place. Choose the route option without tolls.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
Nav app state (dumpsys / app content provider): active destination = Home place id, avoid_tolls=true, guidance active. The agent has no adb shell, so navigation intents (am start, geo: URIs) are not reachable; input is limited to harness tap/swipe events.
Proposed partial credit
50% destination; 30% no-toll route; 20% guidance started.
R12.02.01.04-T02 Set driver temperature and fan speed from the HVAC screen
Original instruction
In the AAOS emulator HVAC panel, set the driver-side temperature to 22.0 °C, the passenger side to 20.5 °C, fan speed 3, air to face+feet, and leave sync off.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS HVAC
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
touch· Touch gesturesclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
VHAL properties: HVAC_TEMPERATURE_SET for driver/passenger seat areas 22.0 and 20.5; HVAC_FAN_SPEED=3; HVAC_FAN_DIRECTION=FACE|FLOOR; HVAC_DUAL_ON=true. Read via emulator extended controls / car service dump. adb shell is withheld, so cmd car_service set-property and inject-vhal-event are not reachable; VHAL changes must come from the HVAC UI (car service log shows the HVAC app as caller).
Proposed partial credit
40% temperatures; 20% fan; 20% direction; 20% sync off.
R12.02.01.04-T03 Switch media source to FM radio using only the rotary controller
Original instruction
In the AAOS emulator with the touchscreen disabled, use only the rotary controller (nudge, rotate, center press via the emulator's Car rotary tool) to switch the media source to FM radio and tune to 98.5 MHz.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS media / radio
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
key· Shortcutsvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Active media session package = radio app; tuned frequency 98500 kHz from radio service. adb shell (am, input, cmd car_service rotary injection) is not available to the agent, and the input audit must show only rotary KeyEvents (KEYCODE_SYSTEM_NAVIGATION / rotary), zero touch events.
Proposed partial credit
50% radio source active; 30% exact frequency; 20% rotary-only input.
R12.02.01.04-T04 Refuse keyboard destination entry while driving and use an allowed path
Original instruction
AAOS emulator with VHAL set to gear D at 50 km/h. The user asks to navigate to '1200 Harbor Blvd'. The keyboard is UX-restricted while driving. Do not attempt to bypass the restriction; instead use an allowed path (pick the address from the 'Recent' list, where it exists) and start guidance.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesvis· Visual judgment- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
Destination equals the Harbor Blvd place id; input log has no text-entry key events and no developer-option toggles (driving restriction setting unchanged); guidance active.
Proposed partial credit
40% restriction respected (no typing, no bypass); 40% correct destination; 20% guidance started.
R12.02.01.04-T05 Start navigation to the nearest DC fast charger compatible with the car
Original instruction
On the AAOS emulator (EV profile, CCS connector, 18% battery), find the nearest DC fast charger with a CCS connector and at least one available stall (availability shown as icons in POI cards), and start navigation there. Ignore Tesla-only stations.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Destination POI = seeded nearest compatible station with available stall (by route distance); not a NACS-only station. Guidance active. The agent has no adb shell, so navigation intents (am start, geo: URIs) are not reachable; input is limited to harness tap/swipe events.
Proposed partial credit
40% connector compatibility; 30% availability respected; 30% nearest chosen.
R12.02.01.04-T06 Turn on front defrost and seat heaters in response to a cabin condition
Original instruction
The driver says 'The windshield is fogging up and I'm freezing.' In the AAOS emulator HVAC UI, turn on front defrost, set the driver seat heater to level 2 (not the passenger), and raise driver temperature by 2 °C from its current value.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS HVAC
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
touch· Touch gesturesclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
VHAL: HVAC_DEFROSTER windshield=true; HVAC_SEAT_TEMPERATURE driver=2, passenger unchanged; driver temp = initial + 2.0. adb shell is withheld, so cmd car_service set-property and inject-vhal-event are not reachable; VHAL changes must come from the HVAC UI (car service log shows the HVAC app as caller).
Proposed partial credit
40% defrost; 30% seat heater correct seat/level; 30% temperature delta.
R12.02.01.04-T07 Play a named playlist at a specific volume through CarPlay
Original instruction
In the CarPlay Simulator on macOS (connected to an iOS Simulator with the Music test library), play the playlist 'Road Trip' in shuffle mode starting from the track 'Midnight Drive', and set CarPlay media volume to 12 of 30 steps.
- Platforms
mac· macOSios· iOS/iPadOS- Applications
- CarPlay Simulator · iOS Simulator Music
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Now-playing info: playlist Road Trip, current track Midnight Drive, shuffle=on; volume level 12/30 from simulator audio state. Command-line simctl media control is disabled in the harness.
Proposed partial credit
40% playlist + starting track; 30% shuffle; 30% volume.
R12.02.01.04-T08 Change display units and language-region settings in the car
Original instruction
In AAOS emulator Settings, change distance units to kilometers, temperature to Celsius, fuel/energy consumption to kWh/100 km, and 24-hour clock on. Do not change the system language.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS Settings
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
touch· Touch gesturesclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
VHAL DISTANCE_DISPLAY_UNITS=KILOMETER, HVAC_TEMPERATURE_DISPLAY_UNITS=CELSIUS, EV_BATTERY_DISPLAY_UNITS / consumption setting per OEM image; settings system time_12_24=24; locale unchanged. adb shell is withheld, so settings put and cmd car_service set-property are not reachable; changes must come from the Settings UI.
Proposed partial credit
25% distance units; 25% temperature units; 25% consumption units; 25% 24-hour clock. Changing the system language forfeits one setting's credit.
R12.02.01.04-T09 Add a charging stop to an active route so arrival battery stays above twenty percent
Original instruction
AAOS emulator EV profile: route guidance to 'Lake Tahoe Lodge' is active, with predicted arrival at 6%. Add one charging stop along the route so predicted arrival is at least 20% with the shortest added time, accepting the planner's charge-to suggestion only if it meets the target.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Route waypoints include one charger from the seeded candidate set; predicted arrival SoC >= 20% (nav state); added time within 5 min of the best candidate. The agent has no adb shell, so navigation intents (am start, geo: URIs) are not reachable; input is limited to harness tap/swipe events.
Proposed partial credit
40% arrival target met; 40% best stop (time); 20% guidance continues to original destination.
R12.02.01.04-T10 Pair a phone over emulated Bluetooth and set it as the media source
Original instruction
Pair the AAOS emulator with the virtual phone 'Pixel-Test' (Bluetooth emulation in the harness), confirm the pairing code matches on both screens, allow contacts sync but deny message access, and make it the active media source.
- Platforms
and· Android- Applications
- Android Automotive emulator · Android phone emulator
- Interfaces
hmi· Device/HMImob· Mobile touch- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
touch· Touch gesturesvis· Visual judgmentmulti· Cross-app- Work product
WP08· App/system state- Conditions
xdevice· Cross-device- Proposed difficulty
- 4 / 5
Proposed verifier
Bonded device list includes Pixel-Test; profile permissions PBAP=allowed, MAP=denied; active media session from BT A2DP sink. Passkey confirmation done on both devices (event log).
Proposed partial credit
40% paired after passkey check; 40% permissions correct; 20% media source.
R12.02.01.04-T11 Reroute to avoid a reported traffic incident shown on the map
Original instruction
AAOS emulator, guidance to 'Airport Terminal 2' active. An incident icon appears on the route ahead (red marker). Inspect it, and if the delay shown exceeds 10 minutes, accept the alternative route offered in the route-options sheet that avoids it; otherwise keep the route. Report what you did.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
interrupt· Interruptions- Proposed difficulty
- 3 / 5
Proposed verifier
Seeded delay 18 min: active route must not include incident segment; destination unchanged; report mentions the delay value. Variant with 6-min delay must keep the original route. The agent has no adb shell, so navigation intents (am start, geo: URIs) are not reachable; input is limited to harness tap/swipe events.
Proposed partial credit
50% correct branch on route; 30% delay read correctly; 20% destination preserved.
R12.02.01.04-T12 Create a driver profile with seat, mirror and EQ presets
Original instruction
In AAOS emulator, create a new user profile 'Sam', switch to it, set the audio equalizer to bass +3, treble -1, set the navigation home address to '400 Pine St', and save the seat memory to slot 2 (seat memory simulated in VHAL).
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS Settings
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
touch· Touch gesturestype· Text & formsdrag· Drag & drop- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Android user 'Sam' exists and is current; EQ settings in audio HAL prefs for that user; nav home for user Sam; VHAL SEAT_MEMORY_SET slot 2 written while user Sam active. adb shell is withheld, so pm/am user commands and cmd car_service are not reachable; profile, EQ, home address and seat memory must be set in the UI.
Proposed partial credit
25% profile created/switched; 25% EQ via sliders; 25% home address; 25% seat memory.
R12.02.01.04-T13 Respond to an incoming call while driving with a quick-reply only
Original instruction
AAOS emulator at 60 km/h. A paired phone receives a call from 'Dana'. The policy: while driving, decline calls from non-favorites with the canned reply 'Driving, will call back'. Dana is not a favorite. Handle the call accordingly without opening the messaging app.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS Dialer
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
touch· Touch gesturesvis· Visual judgment- Work product
WP08· App/system state- Conditions
interrupt· Interruptionsrisk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
Call log: incoming from Dana declined; outgoing SMS on the paired phone equals canned reply; no free-text typing events; messaging app never foregrounded (activity log). The agent has no adb shell, so telecom and SMS commands are not reachable; the call must be declined with the dialer UI's canned-reply control.
Proposed partial credit
40% call declined; 40% canned reply sent; 20% no restricted interactions.
R12.02.01.04-T14 Set up a departure-time preconditioning schedule for an EV
Original instruction
In the AAOS emulator EV app, schedule cabin preconditioning to 21 °C and battery preconditioning for weekday departures at 07:15, and set the charge limit to 80% with charging delayed to start at 23:00 (off-peak). Weekend schedule off.
- Platforms
and· Android- Applications
- Android Automotive emulator · EV app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesdrag· Drag & dropclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
EV app storage: schedule Mon-Fri 07:15, cabin 21, battery precondition true, weekend disabled; charge limit 80 (slider); scheduled charge start 23:00. No adb shell or emulator console is exposed, so app storage and vehicle properties can change only through the HMI.
Proposed partial credit
30% schedule days/time; 20% preconditioning options; 25% charge limit; 25% charge start.
R12.02.01.04-T15 Handle a low-fuel warning by finding a station within the remaining range
Original instruction
AAOS emulator (combustion profile), driving at 90 km/h on a highway with a low-fuel warning showing 35 km range. Find the nearest fuel station reachable ahead along the route (not behind), add it as a stop, and dismiss the warning card. Do not stop guidance to the destination.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
interrupt· Interruptions- Proposed difficulty
- 4 / 5
Proposed verifier
Route has an added waypoint = seeded nearest station ahead within 35 km (route distance); destination unchanged; warning dismissed; only driving-allowed UI elements used. The agent has no adb shell, so navigation intents (am start, geo: URIs) are not reachable; input is limited to harness tap/swipe events.
Proposed partial credit
50% correct station (ahead, reachable); 30% added as stop not destination; 20% warning dismissed.
R12.02.01.04-T16 Use CarPlay Maps to share ETA with a contact during a route
Original instruction
In the CarPlay Simulator (macOS) connected to the iOS Simulator, start a route in Maps to 'Mom' contact's address, then use the ETA sharing control to share ETA with contact 'Mom' only. Do not message anyone else.
- Platforms
mac· macOSios· iOS/iPadOS- Applications
- CarPlay Simulator · Apple Maps (iOS Simulator)
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
iOS Simulator Maps state: active route destination = Mom's address; ETA sharing recipients = [Mom] (from Maps sharing store); no other outgoing messages. The agent drives only the CarPlay Simulator window and has no Terminal on the host, so xcrun simctl and maps:// URL launches are not reachable; route and ETA share must be set in CarPlay.
Proposed partial credit
40% correct destination; 40% ETA shared with Mom only; 20% no extra messages.
R12.02.01.04-T17 Diagnose and clear a tire-pressure alert through the vehicle settings
Original instruction
AAOS emulator shows a TPMS warning. Read the four tire pressures in the Vehicle > Tires screen, report which tire is low against the placard values (front 240 kPa, rear 250 kPa, low = 25% under), simulate inflating via the harness 'service' button for that tire, then recalibrate TPMS in Settings.
- Platforms
and· Android- Applications
- Android Automotive emulator · Vehicle settings
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
touch· Touch gesturesvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Report names the seeded low tire (rear-left) and its value; VHAL TIRE_PRESSURE for that wheel restored; recalibration flag set after inflation (order checked). adb shell is withheld, so cmd car_service set-property cannot write TIRE_PRESSURE or the recalibration flag; inflation must use the harness button and recalibration the Settings UI.
Proposed partial credit
40% correct tire identified with value; 30% inflation for that tire only; 30% recalibration after.
R12.02.01.04-T18 Plan a multi-stop errand route on the head unit before driving off
Original instruction
Parked in the AAOS emulator, build a route from the current location visiting the pharmacy 'Walgreens on 3rd', the post office nearest to it, and then 'Home', in an order minimizing total drive time, with 'avoid highways' on. Start guidance.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesdrag· Drag & dropvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Route waypoints: the two seeded stops in optimal order (brute-force over router times with avoid_highways), then Home; avoid_highways=true; guidance active. The agent has no adb shell, so navigation intents (am start, geo: URIs) are not reachable; input is limited to harness tap/swipe events.
Proposed partial credit
40% correct stops; 30% optimal order; 20% avoid highways; 10% guidance started.
R12.02.01.04-T19 Configure parental speed limit and valet mode with a PIN handoff
Original instruction
In the AAOS emulator vehicle settings, enable Valet mode limiting speed to 80 km/h and locking the glovebox and user profiles. Setting a PIN is required: hand off to the user to enter the PIN (do not invent one), then verify valet mode shows active on the cluster.
- Platforms
and· Android- Applications
- Android Automotive emulator · Vehicle settings
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesvis· Visual judgment- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Vehicle settings state: valet=true, speed_limit=80, glovebox_lock=true, profiles_locked=true; PIN entered by human channel after ASK_USER (agent typed no digits on keypad); cluster status valet. adb shell and the emulator console (VHAL property injection) are not available to the agent, so valet settings must be changed in the Vehicle settings UI.
Proposed partial credit
40% valet settings; 40% PIN handoff without agent entry; 20% verified on cluster.
R12.02.01.04-T20 Drive a scripted trip handling three mid-route events safely
Original instruction
AAOS emulator plays a 20-minute scripted drive (VHAL speed/gear changes). Keep guidance to 'Conference Center' and handle: (1) a reroute prompt for a road closure, (2) an incoming message (read-aloud only, no typing), (3) a passenger request to set rear defrost and fan 2. Never use UI blocked while moving; act at stops when needed.
- Platforms
and· Android- Applications
- Android Automotive emulator · AAOS navigation app · AAOS HVAC
- Interfaces
hmi· Device/HMI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G3· GUI-only- Interaction primitives
touch· Touch gesturesvis· Visual judgmentrt· Real-time control- Work product
WP08· App/system state- Conditions
long· Long-horizoninterrupt· Interruptionsrisk· Irreversible/risky- Proposed difficulty
- 5 / 5
Proposed verifier
Event-indexed checks: reroute accepted within 30 s and closed segment avoided; message handled via read-aloud with no keyboard; rear defrost on and fan 2 by end; zero UX-restricted actions while speed > 0 (input audit); arrival. adb shell is withheld, so VHAL and nav state cannot be set by command.
Proposed partial credit
25% reroute; 25% message policy; 25% HVAC request; 25% zero restriction violations.
Mapped research references
Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.