Display, sound, input, voice & shortcuts
Configure scaling, night light, audio routing, keyboard layouts, input methods, trackpad, voice assistant (Siri, Cortana) and custom hotkeys.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- System Settings · Windows Settings · KDE System Settings
- Class GUI-need label
G2· GUI-essential
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R01.01.01.02-T01 Typing feel: repeat rate, delay and function keys
Original instruction
In Keyboard settings set Key repeat rate to the second-fastest notch and Delay until repeat to the second-shortest notch, turn on 'Use F1, F2, etc. keys as standard function keys', and set 'Press 🌐 key to' Show Emoji & Symbols.
- Platforms
mac· macOS- Applications
- System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
-g KeyRepeat=6 and InitialKeyRepeat=25 (grader maps notches to values), com.apple.keyboard.fnState=1, com.apple.HIToolbox AppleFnUsageType=2. Terminal withheld; writes must be attributed to System Settings, and eslogger exec audit detecting defaults -> 0.
Proposed partial credit
25% repeat rate notch; 25% delay notch; 25% fn keys; 25% globe key action
R01.01.01.02-T02 Scale and rotate two displays for a reading station
Original instruction
Two virtual displays are attached. Set display 1 to 1920×1080 at 125% scale; set display 2 to 1080×1920 portrait (rotated 90°) at 100% scale; make display 1 the main display. Keep refresh rates unchanged.
- Platforms
win· Windows- Applications
- Windows Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
QueryDisplayConfig: mode sizes, rotation DISPLAYCONFIG_ROTATION_ROTATE90 on display 2, primary at (0,0); per-monitor DpiValue in PerMonitorSettings gives 125%/100%; refresh rates equal seed. PowerShell/regedit blocked by AppLocker; Sysmon detects reg.exe, PowerShell or DisplaySwitch scripting -> 0.
Proposed partial credit
30% display 1 resolution+scale; 40% display 2 portrait+scale; 30% primary display and unchanged refresh
R01.01.01.02-T03 Night light on a custom late schedule
Original instruction
Turn on Night light with a custom schedule from 21:30 to 06:45 and strength 60, and leave it currently off until the schedule starts.
- Platforms
win· Windows- Applications
- Windows Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Decode CloudStore bluelightreduction settings blob: schedule mode=set hours, start 21:30, end 06:45, color temperature equals strength-60 value (±2); state blob shows not active. regedit/PowerShell blocked by AppLocker; Sysmon detects reg.exe writes to CloudStore -> 0.
Proposed partial credit
30% schedule enabled; 40% exact times; 30% strength within tolerance
R01.01.01.02-T04 Night Shift with custom hours and warm temperature
Original instruction
Enable Night Shift on a custom schedule 22:00–07:00 and set the Color Temperature slider to three-quarters toward 'More Warm'. Also turn off True Tone and 'Automatically adjust brightness' on the built-in display.
- Platforms
mac· macOS- Applications
- System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Grader helper reads CBBlueLightClient status: mode=custom, from 22:00 to 07:00, CCT strength 0.75±0.05; com.apple.CoreBrightness True Tone off; auto-brightness off. No supported CLI and Terminal withheld; eslogger exec audit detects defaults on CoreBrightness -> 0.
Proposed partial credit
30% schedule mode; 30% exact times; 20% temperature within ±0.05; 20% True Tone and auto-brightness off
R01.01.01.02-T05 Build a multi-output audio device for screen recording
Original instruction
In Audio MIDI Setup create a Multi-Output Device named 'Record+Speakers' combining BlackHole 2ch and MacBook Pro Speakers, with Speakers as primary (clock) device and drift correction on BlackHole only. Make it the system output, keep alerts on the Speakers, and set the BlackHole input level to 0.7.
- Platforms
mac· macOS- Applications
- Audio MIDI Setup · System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 5 / 5
Proposed verifier
CoreAudio query: aggregate device named Record+Speakers with 2 subdevices, master = speakers UID, drift flag only on BlackHole; default output = aggregate; default system (alert) output = speakers; BlackHole input scalar 0.70±0.03. Terminal and Script Editor withheld; eslogger exec audit detects SwitchAudioSource/osascript -> 0.
Proposed partial credit
30% aggregate with correct members+name; 20% clock & drift settings; 30% default vs alert output; 20% input level
R01.01.01.02-T06 Route apps to different audio endpoints on Windows
Original instruction
Make 'Speakers (VB-Audio Point)' the default device and 'Headset (Virtual)' the default communications device for both playback and recording. In the Volume mixer route only Spotify output to 'CABLE Input'. Set the headset mic level to 60 and disable 'Stereo Mix'.
- Platforms
win· Windows- Applications
- Windows Settings · Sound control panel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 5 / 5
Proposed verifier
IMMDeviceEnumerator defaults for eConsole/eCommunications (render+capture); per-app PolicyConfig store maps spotify.exe to CABLE Input; IAudioEndpointVolume mic 0.60±0.02; Stereo Mix state DISABLED. No SoundVolumeView/nircmd on the VM and PowerShell AppLocker-blocked; Sysmon detects AudioDeviceCmdlets or such tools -> 0.
Proposed partial credit
30% defaults per role; 30% Spotify per-app route; 20% mic level; 20% Stereo Mix disabled
R01.01.01.02-T07 Set up German and Pinyin input sources
Original instruction
Add the keyboard input sources 'German – Standard' and 'Pinyin – Simplified', remove 'U.S.' while keeping 'ABC', and enable 'Use the Caps Lock key to switch to and from ABC'. Order does not matter.
- Platforms
mac· macOS- Applications
- System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
com.apple.HIToolbox AppleEnabledInputSources contains German-Standard layout id and com.apple.inputmethod.SCIM.ITABC, includes ABC, excludes U.S.; TISCapsLockSwitch key enabled. Terminal withheld; eslogger exec audit detects defaults/plutil -> 0.
Proposed partial credit
30% German added; 30% Pinyin added; 20% U.S. removed with ABC kept; 20% Caps Lock switching
R01.01.01.02-T08 Japanese IME plus a direct-switch hotkey on Windows
Original instruction
Add Japanese with the Microsoft IME keyboard, remove 'United States-International', and in Advanced keyboard settings > Input language hot keys assign Ctrl+Shift+0 to switch directly to Japanese. Keep English (US) as the default input method.
- Platforms
win· Windows- Applications
- Windows Settings · Text Services and Input Languages
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Get-WinUserLanguageList (run by grader) contains ja-JP with 0411:{IME TIP}, no 0020409 layout; HKCU\Control Panel\Input Method\Hot Keys entry for ja-JP with Ctrl+Shift and VK '0'; default method en-US. Agent PowerShell blocked by AppLocker; Sysmon detects Set-WinUserLanguageList or reg.exe writes -> 0.
Proposed partial credit
30% Japanese IME present; 20% US-Intl removed; 35% direct hotkey; 15% default unchanged
R01.01.01.02-T09 Trackpad: tap to click, corner right-click, three-finger drag
Original instruction
Enable Tap to click, set Secondary click to 'Click in Bottom Right Corner', tracking speed to the 7th notch, turn off natural scrolling, and enable three-finger drag (it lives under Accessibility > Pointer Control > Trackpad Options).
- Platforms
mac· macOS- Applications
- System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
com.apple.AppleMultitouchTrackpad Clicking=1, TrackpadCornerSecondaryClick=2, TrackpadRightClick=0, TrackpadThreeFingerDrag=1; com.apple.trackpad.scaling = notch-7 value; com.apple.swipescrolldirection=0. Terminal withheld; eslogger exec audit detects defaults -> 0.
Proposed partial credit
20% tap to click; 20% corner click; 35% tracking speed and natural scrolling off; 25% three-finger drag (hidden pane)
R01.01.01.02-T10 Custom menu shortcuts for Preview and Mail
Original instruction
Create app shortcuts: in Preview, File > 'Export as PDF…' = ⌘⇧E; in Mail, Message > 'Archive' = ⌃⌘A. Titles must match menus exactly, including the ellipsis character. Test each once on fixtures/sample.pdf and a seeded mail.
- Platforms
mac· macOS- Applications
- System Settings · Preview · Mail
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formskey· Shortcuts- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
com.apple.Preview NSUserKeyEquivalents {'Export as PDF…':'@$e'}, com.apple.mail {'Archive':'^@a'}; grader sends ⌘⇧E in Preview and checks Export sheet opens. Terminal withheld; eslogger exec audit detects defaults write -> 0.
Proposed partial credit
40% Preview shortcut exact; 40% Mail shortcut exact; 20% shortcuts fire in live test
R01.01.01.02-T11 KDE global hotkey and layout switching
Original instruction
In KDE Plasma System Settings: add a custom global shortcut Meta+Shift+T that launches Konsole with profile 'Ops'; add keyboard layouts English (US) and Russian; set layout switching to Alt+Shift; show the layout indicator as a flag.
- Platforms
lin· Linux- Applications
- KDE System Settings · Konsole
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickkey· Shortcutstype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
kglobalshortcutsrc entry for a .desktop with Exec 'konsole --profile Ops' bound to Meta+Shift+T; kxkbrc LayoutList=us,ru, Options grp:alt_shift_toggle, ShowFlag=true; grader fires the shortcut and finds a Konsole window with profile Ops. Konsole may only be launched by the shortcut test; auditd detects kwriteconfig/kcmshell or rc-file edits by a shell -> 0.
Proposed partial credit
35% custom shortcut works; 30% layouts; 20% switch option; 15% flag indicator
R01.01.01.02-T12 Arrange an external display left and make it main
Original instruction
A virtual 2560×1440 display is attached. In Displays > Arrange, place it to the left of the built-in display with top edges aligned, and make it the main display by moving the menu bar to it.
- Platforms
mac· macOS- Applications
- System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
drag· Drag & dropgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
CGDisplayBounds: external is main (origin 0,0); built-in origin.x = +2560 (adjacent right) and origin.y = 0 ±4 pt; no mirroring. Terminal withheld; eslogger exec audit detects displayplacer -> 0. Paired with T20 (CLI control).
Proposed partial credit
40% external left of built-in; 30% top edges aligned within 4 pt; 30% external is main
R01.01.01.02-T13 Three-monitor arrangement from a desk diagram
Original instruction
Arrange three virtual monitors as in input/desk_layout.png: monitor 2 left of monitor 1 with bottom edges aligned, monitor 3 above monitor 1 and horizontally centered on it. Monitor 1 stays primary. Set monitor 3 to 150% scale.
- Platforms
win· Windows- Applications
- Windows Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropgeom· Precise geometryvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 5 / 5
Proposed verifier
QueryDisplayConfig source positions: m2.right = m1.left, m2.bottom = m1.bottom (±10 px); m3.bottom = m1.top, m3 center x within ±20 px of m1 center; m1 primary; m3 DpiValue 150%. PowerShell blocked by AppLocker; Sysmon detects SetDisplayConfig tools/PowerShell -> 0.
Proposed partial credit
30% monitor 2 placement; 40% monitor 3 centered above; 15% primary unchanged; 15% scale
R01.01.01.02-T14 Assign a calibrated ICC profile to a monitor
Original instruction
Install fixtures/ProArt_D65.icc and make it the default profile for monitor 'Generic PnP Monitor #2' only, via Color Management with 'Use my settings for this device' checked. Monitor 1 must keep its current profile.
- Platforms
win· Windows- Applications
- Color Management · Windows Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
click· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Profile file in spool\drivers\color with hash of fixture; WcsGetDefaultColorProfile for monitor 2 device key (user scope) returns ProArt_D65.icc and per-user flag true; monitor 1 profile unchanged. PowerShell blocked by AppLocker; Sysmon detects colorcpl automation scripts or file copies outside Color Management -> 0.
Proposed partial credit
20% profile installed; 50% default for monitor 2 per-user; 30% monitor 1 untouched
R01.01.01.02-T15 Built-in display: More Space, P3 profile, fixed refresh
Original instruction
On the MacBook test VM-display, choose the 'More Space' scaled resolution, set the color profile to 'Display P3', set refresh rate to 60 Hz, and turn off 'Slightly dim the display on battery'.
- Platforms
mac· macOS- Applications
- System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
CoreGraphics current mode equals the largest scaled mode listed; ColorSync profile for display = Display P3; refresh 60; com.apple.PowerManagement 'ReduceBrightness'=0 on battery. Terminal withheld; eslogger exec audit detects displayplacer/pmset -> 0.
Proposed partial credit
35% More Space mode; 25% P3 profile; 20% refresh; 20% battery dim off
R01.01.01.02-T16 Alert sounds, feedback and startup chime
Original instruction
Set alert sound to 'Submerge' at 50% alert volume, turn on 'Play feedback when volume is changed', turn off 'Play sound on startup', set output volume to 30% and make 'BlackHole 2ch' the input device at 70% input volume.
- Platforms
mac· macOS- Applications
- System Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
-g com.apple.sound.beep.sound ends with Submerge.aiff, com.apple.sound.beep.volume 0.5±0.03, com.apple.sound.beep.feedback=1; nvram StartupMute=%01; output volume 28-32; default input BlackHole at 0.70±0.03. Terminal withheld; eslogger detects osascript/defaults/nvram -> 0.
Proposed partial credit
25% alert sound+volume; 35% feedback on and startup sound off; 20% output volume; 20% input device+level
R01.01.01.02-T17 Remap keys with PowerToys Keyboard Manager
Original instruction
Using PowerToys Keyboard Manager, remap Caps Lock to Left Ctrl, and remap the shortcut Ctrl+Alt+T to launch Windows Terminal only when Explorer is focused. Keep Keyboard Manager enabled at startup.
- Platforms
win· Windows- Applications
- PowerToys · Windows Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickkey· Shortcuts- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Keyboard Manager default.json: remapKeys CapsLock(20)->LCtrl(162); remapShortcuts app-specific explorer.exe Ctrl+Alt+T -> run wt.exe; grader injects Caps+C in Notepad (copy happens) and Ctrl+Alt+T in Explorer (wt window). Sysmon detects edits to default.json by any non-PowerToys process -> 0.
Proposed partial credit
35% key remap works; 40% app-specific shortcut works; 25% saved config persists after PowerToys restart
R01.01.01.02-T18 Left-handed mouse setup on both systems
Original instruction
A left-handed user says the mouse 'feels backwards and the pointer is hard to see'. On both test machines swap the primary button to right, set pointer speed to the middle notch, and make the pointer larger (size 3 on Windows; 'Pointer size' about 2× on macOS) with a black fill.
- Platforms
mac· macOSwin· Windows- Applications
- System Settings · Windows Settings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickgeom· Precise geometry- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Windows: SwapMouseButtons=1, MouseSensitivity=10, Accessibility CursorSize=3, CursorType black; macOS: com.apple.mouse.swapLeftRightButton=1, mouse scaling mid, com.apple.universalaccess mouseDriverCursorSize 2.0±0.25, cursorFill black. Shells withheld on both VMs; Sysmon/eslogger detect reg.exe/defaults writes -> 0.
Proposed partial credit
30% primary button swapped (both OS); 20% pointer speed; 30% larger pointer; 20% black fill
R01.01.01.02-T19 Import text replacements and turn off auto-text features
Original instruction
Add the five text replacements in input/snippets.csv (shortcut,phrase) under Keyboard > Text Replacements, then turn off Correct spelling automatically, Capitalize words automatically, 'Add period with double-space' and smart quotes and dashes. Snippets must work in TextEdit.
- Platforms
mac· macOS- Applications
- System Settings · TextEdit
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
~/Library/KeyboardServices/TextReplacements.db has exactly the 5 pairs (case-exact); -g NSAutomaticSpellingCorrectionEnabled, NSAutomaticCapitalizationEnabled, NSAutomaticPeriodSubstitutionEnabled, NSAutomaticQuoteSubstitutionEnabled, NSAutomaticDashSubstitutionEnabled all 0; grader types a shortcut in TextEdit and checks expansion. Terminal withheld; eslogger detects sqlite3/defaults exec -> 0.
Proposed partial credit
50% five snippets exact (equal share per snippet); 30% four toggles off; 20% live expansion works
R01.01.01.02-T20 Arrange displays from the terminal (control)
Original instruction
Control pair of T12: with displayplacer installed, place the 2560×1440 external display left of the built-in display with top edges aligned and make it the main display, from the terminal only.
- Platforms
mac· macOS- Applications
- Terminal · displayplacer
- Interfaces
term· Terminal- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Same CGDisplayBounds checks as T12; used to measure the GUI-vs-CLI gap on an identical end state.
Proposed partial credit
40% external left; 30% top aligned; 30% external main
Mapped research references
Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.