Computer-Use Agent Taxonomy中文
R01.10.01.01 · TASK CLASS

Tabs, profiles, history & site settings

Organize tabs and groups, profiles, bookmarks, history, extensions and per-site permissions.

20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.

Typical applications
Chrome · Safari · Edge · Firefox
Class GUI-need label
G2 · GUI-essential

Task proposals · 20

Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.

R01.10.01.01-T01 Sort open Chrome tabs into two named, colored tab groups

Original instruction

Chrome has 7 tabs open from a seeded session: 4 about a trip to Lisbon (flights, hotel, museum, weather) and 3 work dashboards. Create a tab group `Lisbon` (blue) with the 4 trip tabs and a group `Work` (green) with the 3 dashboards, in that left-to-right order, then collapse `Work`.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
drag · Drag & drop click · Point & click type · Text & forms
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

After graceful Chrome shutdown, the profile's Sessions file is parsed: two groups with exact titles/colors and exact tab membership; Lisbon before Work; Work collapsed. Extensions/DevTools protocol are disabled for the agent.

Proposed partial credit

40% Lisbon group correct; 40% Work group correct; 20% order and collapse

R01.10.01.01-T02 Create a Safari Tab Group from open tabs and pin a tab

Original instruction

Safari on the Mac has 6 tabs open. Create a Tab Group named `Thesis` containing the 4 tabs from `scholar.local` and `library.local`, pin the `library.local/account` tab inside that group, and close the other 2 tabs in the original window.

Platforms
mac · macOS web · Any OS (web)
Applications
Safari
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click drag · Drag & drop type · Text & forms
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

SafariTabs.db: tab group Thesis with exactly the 4 URLs; the account tab flagged pinned in that group; the default window has none of the 2 extra URLs open. AppleScript to Safari is blocked by TCC for the agent's terminal.

Proposed partial credit

50% group with right tabs; 25% pinned tab; 25% other tabs closed

R01.10.01.01-T03 Build an Edge collection with notes from research tabs

Original instruction

In Microsoft Edge, create a collection `Heat pump quotes` containing the 4 open supplier pages, in price order (lowest first, prices visible on each page), and add a note at the top with the text `Lowest: <supplier name> <price>`.

Platforms
win · Windows mac · macOS web · Any OS (web)
Applications
Edge
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop click · Point & click vis · Visual judgment
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Edge collectionsSQLite: collection with the 4 URLs in correct order (prices rendered as images on two pages); note item first with the correct supplier and price string. Edge remote debugging is disabled by policy and the OS file audit detects non-Edge writes to collectionsSQLite; such edits fail.

Proposed partial credit

30% collection with 4 pages; 40% price order; 30% note text correct

R01.10.01.01-T04 Isolate work and personal sites with Firefox Multi-Account Containers

Original instruction

Firefox has the Multi-Account Containers extension installed. Create containers `Work` (blue, briefcase) and `Banking` (red, dollar). Set `crm.sandbox.test` and `mail.work.test` to always open in Work, and `bank.sandbox.test` to always open in Banking. Re-open the currently open bank tab in Banking.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Firefox
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
click · Point & click type · Text & forms nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

containers.json has both containers with colors/icons; extension storage (storage.js/IndexedDB) has the three site assignments; sessionstore shows the bank tab with userContextId = Banking. Firefox remote debugging/Marionette are disabled by policy and the OS file audit detects non-Firefox writes to containers.json or extension storage; such edits fail.

Proposed partial credit

30% containers; 45% site assignments; 25% open bank tab moved

R01.10.01.01-T05 Set up a separate Chrome profile for a client engagement

Original instruction

Create a new Chrome profile named `Client-A` (no Google sign-in) with the yellow theme color, set its startup pages to `https://portal.client-a.test` and `https://wiki.client-a.test`, import bookmarks from `~/Desktop/client_a_bookmarks.html` into the bookmarks bar, and create a desktop shortcut for the profile.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

Local State profile.info_cache has Client-A; its Preferences: theme color yellow, restore_on_startup 4 with both URLs; Bookmarks bar contains the imported 15 entries; shortcut file exists pointing to --profile-directory of Client-A. Startup URLs are MAC-protected in Secure Preferences (outside edits are reset), CDP is disabled by policy, and the file audit detects non-Chrome writes to the profile.

Proposed partial credit

40% profile with theme; 25% startup pages; 25% bookmarks imported; 10% shortcut

R01.10.01.01-T06 Set per-site camera, notification and pop-up permissions in Chrome

Original instruction

In Chrome site settings: allow camera and microphone only for `meet.sandbox.test`, block notifications for `news-a.test`, `news-b.test` and `deals.test`, allow pop-ups and redirects for `bank.sandbox.test`, and set the global default for notifications to 'Don't allow sites to send notifications'.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Preferences profile.content_settings.exceptions: media_stream_camera/mic allow for https://meet.sandbox.test:443; notifications block for the 3 sites; popups allow for bank; default_content_setting_values.notifications 2. Policy files are absent and edits outside Chrome invalidate Secure Preferences MAC.

Proposed partial credit

30% camera+mic; 30% notification blocks; 20% pop-ups; 20% global default

R01.10.01.01-T07 Configure Safari per-website zoom, autoplay and Reader settings

Original instruction

In Safari > Settings > Websites, set page zoom 125% for `docs.local`, 'Never Auto-Play' for `video-a.test` and `video-b.test`, Reader automatically on for `news.local`, and deny location for `weather.local`. Leave other sites at defaults.

Platforms
mac · macOS web · Any OS (web)
Applications
Safari
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Safari PerSitePreferences.db rows: PageZoom 1.25 for docs.local; AutoplayPolicy never for both video sites; ReaderMode on for news.local; Geolocation deny for weather.local; no other new rows. The agent shell lacks Full Disk Access, so PerSitePreferences.db in Safari's container is not accessible outside Safari, and TCC blocks AppleScript to Safari.

Proposed partial credit

25% zoom; 25% autoplay; 25% reader; 25% location

R01.10.01.01-T08 Selectively clear Firefox history and cookies without logging out elsewhere

Original instruction

Firefox should forget the last 2 hours of browsing history and all cookies and site data for `shop-tracker.test`, but keep the user logged into `mail.sandbox.test` and keep all older history. Do this through Firefox's Clear Recent History and Manage Data dialogs.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Firefox
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
risk · Irreversible/risky
Proposed difficulty
4 / 5

Proposed verifier

places.sqlite: no visits after T-2h, all seeded older visits intact; cookies.sqlite: zero cookies for shop-tracker.test, mail.sandbox.test session cookie present; other sites' cookies count unchanged. Firefox remote debugging is disabled by policy and the OS file audit detects sqlite3 or other non-Firefox writes to places.sqlite/cookies.sqlite; such edits fail.

Proposed partial credit

35% recent history cleared; 25% older history kept; 25% tracker data removed; 15% mail session kept

R01.10.01.01-T09 Reorganise 40 Chrome bookmarks into folders by dragging

Original instruction

Using Chrome's Bookmark Manager, reorganise the 40 loose bookmarks on the bookmarks bar according to `~/Desktop/bookmark_plan.md`: create 5 folders, move each bookmark into its folder in the stated order, delete the 6 duplicates (same URL), and leave only the 5 folders on the bar.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop click · Point & click type · Text & forms
Work product
WP08 · App/system state
Conditions
long · Long-horizon
Proposed difficulty
5 / 5

Proposed verifier

Bookmarks JSON: bar children = 5 named folders in plan order; each folder's URLs equal the plan order (Kendall tau for partial credit); 34 unique URLs remain, no duplicates; no bookmarks lost. CDP is disabled by policy and the OS file audit (eslogger/Sysmon) detects non-Chrome writes to the Bookmarks file; such edits fail.

Proposed partial credit

20% folders; 50% membership and order; 20% duplicates removed; 10% nothing lost

R01.10.01.01-T10 Import Chrome data into Edge and make it the default browser

Original instruction

On Windows, import bookmarks, history and open tabs from the Chrome profile `Default` into Microsoft Edge (not passwords or payment info), make Edge the default browser, and set Edge to open the previous session's tabs on startup.

Platforms
win · Windows
Applications
Edge · Chrome
Interfaces
brow · Browser desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Edge Favorites contain the Chrome bookmark set; History DB contains imported URLs; Login Data has no imported passwords; UserChoice for http/https = MSEdgeHTM with valid hash; Edge restore_on_startup = 1. Sysmon detects reg.exe/PowerShell UserChoice writes (UCPD blocks scripted http/https changes) and non-Edge writes to the Edge profile; such edits fail.

Proposed partial credit

40% bookmarks+history imported; 20% no passwords imported; 25% default browser; 15% startup

R01.10.01.01-T11 Install an unpacked extension and restrict its site access

Original instruction

Install the unpacked extension in `~/Desktop/linkcheck-ext/` in Chrome (Developer mode), pin it to the toolbar, and change its site access to 'On click'. Then turn Developer mode off again.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Preferences extensions.settings has the extension (location unpacked, path matches), withholding_permissions true; pinned_extensions contains its id; extensions.ui.developer_mode false at end. extensions.settings is MAC-protected in Secure Preferences (outside edits are reset); --load-extension is unsupported in branded Chrome and remote debugging is disabled by policy.

Proposed partial credit

40% installed; 20% pinned; 30% site access on click; 10% dev mode off

R01.10.01.01-T12 Find a page from last week in history and bookmark it

Original instruction

The user remembers reading a page about a 'warranty claim' for their dishwasher some time last Tuesday in Chrome but not the site. Find it in Chrome history, reopen it, bookmark it in folder `Home/Appliances`, and write its URL to `~/Desktop/answer.txt`.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
type · Text & forms nav · Pan/zoom/scroll vis · Visual judgment
Work product
WP12 · Answer/decision
Conditions
personal · Personal context
Proposed difficulty
3 / 5

Proposed verifier

answer.txt equals the seeded URL (history has 3 similar warranty pages on other days and one on Tuesday for a different appliance); Bookmarks JSON has that URL in Home/Appliances; History DB visit after task start. CDP is disabled by policy and the OS file audit detects sqlite3/Python reads of the History DB or writes to Bookmarks, which void the task.

Proposed partial credit

60% correct URL; 30% bookmarked in right folder; 10% reopened

R01.10.01.01-T13 Migrate Safari Tab Groups to Chrome tab groups

Original instruction

The user is switching from Safari to Chrome on the Mac. Recreate each of their 3 Safari Tab Groups (`Thesis`, `Kitchen reno`, `Taxes`) as Chrome tab groups with the same names and the same tab URLs in the same order, all in one Chrome window, and save each group so it appears in Chrome's saved tab groups bar.

Platforms
mac · macOS web · Any OS (web)
Applications
Safari · Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
drag · Drag & drop multi · Cross-app type · Text & forms
Work product
WP08 · App/system state
Conditions
multiapp · Multi-app
Proposed difficulty
4 / 5

Proposed verifier

Chrome Sessions + saved tab groups store: 3 saved groups with exact names; URL lists equal the Safari groups (order-sensitive score); Safari groups unchanged. CDP is disabled by policy and eslogger detects non-Chrome writes to the Chrome profile (Sessions, saved groups); such edits fail.

Proposed partial credit

30% three groups created; 50% URL sets/orders; 20% saved to bar

R01.10.01.01-T14 Configure Firefox tracking protection with a site exception and mic permission

Original instruction

In Firefox, set Enhanced Tracking Protection to Strict, add an exception (turn protection off) for `video-call.sandbox.test` only, allow its microphone permanently but block its camera, and set `Send websites a Do Not Track signal` / Global Privacy Control on.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Firefox
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

prefs.js browser.contentblocking.category 'strict'; permissions.sqlite: trackingprotection exception for the origin, microphone allow (1) and camera deny (2) permanent; privacy.globalprivacycontrol.enabled true. Firefox remote debugging is disabled, policies.json is absent, and the file audit detects non-Firefox writes to prefs.js/user.js or permissions.sqlite; such edits fail.

Proposed partial credit

25% strict; 25% exception; 35% mic/camera; 15% GPC

R01.10.01.01-T15 Find and remove an extension from one of four Chrome profiles

Original instruction

Chrome on this machine has 4 profiles. One of them has the extension `QuickCoupons` installed, which IT wants removed. Find which profile has it, remove it from that profile only, and write that profile's display name to `answer.txt`. Do not modify extensions in other profiles.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click nav · Pan/zoom/scroll vis · Visual judgment
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

answer.txt equals the seeded profile name; that profile's Preferences lacks the extension id; the other 3 profiles' extension lists unchanged (a decoy profile has a similarly named 'QuickCoupon Finder'). Extension state is MAC-protected in Secure Preferences and the file audit detects non-Chrome writes or deletions in the profiles' Extensions folders; such edits fail.

Proposed partial credit

40% correct profile; 40% extension removed; 20% no collateral

R01.10.01.01-T16 Create a Safari profile with its own favorites and open-in rules

Original instruction

In Safari 17+, create a profile `School` with the purple color and graduation-cap icon, its own favorites folder containing `lms.school.test` and `library.school.test`, and set links to `lms.school.test` to always open in the School profile. Close the personal window afterwards.

Platforms
mac · macOS web · Any OS (web)
Applications
Safari
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

Safari profiles store: profile School with color/symbol; its bookmarks root favorites contains exactly the 2 URLs; open-in-profile rule for lms.school.test; no School favorites in the personal profile. The agent shell lacks Full Disk Access, so Safari's container stores are not accessible outside Safari, and TCC blocks AppleScript to Safari.

Proposed partial credit

30% profile; 30% favorites; 30% open-in rule; 10% personal profile untouched

R01.10.01.01-T17 Tune Edge sleeping tabs and efficiency mode with exclusions

Original instruction

In Microsoft Edge, enable sleeping tabs after 15 minutes of inactivity, fade sleeping tabs, never put `music.sandbox.test` and `dash.ops.test` to sleep, and set efficiency mode to 'When unplugged, low battery'.

Platforms
win · Windows mac · macOS web · Any OS (web)
Applications
Edge
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Edge Preferences: performance_tuning.sleeping_tabs.enabled true, timeout 900, fade true, exclusion list exactly the two origins; efficiency mode setting value corresponding to 'unplugged, low battery'. Edge remote debugging is disabled, and file/registry audits detect non-Edge writes to Preferences or Edge policy keys (e.g. SleepingTabsTimeout); such edits fail.

Proposed partial credit

30% sleeping tabs + timeout; 20% fade; 30% exclusions; 20% efficiency mode

R01.10.01.01-T18 Control pair of T06: apply the same site permissions through Chrome policy

Original instruction

Control pair of T06. Produce the same per-site permissions as T06 using Chrome enterprise policy only: write the managed policy (plist on macOS or registry/JSON on Windows) for camera/mic allow, notification blocks, pop-up allow and default notification block. Do not open Chrome settings.

Platforms
mac · macOS win · Windows
Applications
Chrome · defaults/reg
Interfaces
term · Terminal
GUI need · task setting
CL · CLI-sufficient
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
code · Code & commands
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

chrome://policy JSON export (taken by the grader) lists VideoCaptureAllowedUrls/AudioCaptureAllowedUrls, NotificationsBlockedForUrls, PopupsAllowedForUrls, DefaultNotificationsSetting=2 with exact values.

Proposed partial credit

30% camera+mic; 30% notifications; 20% pop-ups; 20% default

R01.10.01.01-T19 Recover a crashed Chrome window's tabs and save them as a bookmark folder

Original instruction

Chrome was force-quit with a window of 12 tabs about a grant application; on restart the session was not restored and other windows have been used since. Recover those 12 tabs via History > Recently closed (or full history), reopen them in one window, and bookmark them all into a new folder `Grant 2026` on the bookmarks bar.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
click · Point & click nav · Pan/zoom/scroll vis · Visual judgment
Work product
WP08 · App/system state
Conditions
hidden · Hidden/stale state
Proposed difficulty
4 / 5

Proposed verifier

Bookmarks JSON: folder Grant 2026 with exactly the 12 seeded URLs (no extras from the later session); Sessions file shows a window with those 12 tabs. Decoy: a later-closed window of 5 unrelated tabs. CDP is disabled by policy and the OS file audit detects non-Chrome writes to Bookmarks or Sessions; such edits fail.

Proposed partial credit

50% correct 12 URLs recovered; 30% bookmark folder exact; 20% reopened in one window

R01.10.01.01-T20 Triage a 60-tab, 3-window browser session into grouped, deduplicated tabs

Original instruction

Chrome has 3 windows with 60 tabs. Following `~/Desktop/session_rules.md`: close exact-duplicate URLs, close any tab from `ads.*` or tracking redirect domains, merge everything into one window, and group remaining tabs by project label shown in each page's header banner (5 projects), groups ordered alphabetically, tabs within a group ordered by banner date.

Platforms
mac · macOS win · Windows web · Any OS (web)
Applications
Chrome
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
drag · Drag & drop vis · Visual judgment nav · Pan/zoom/scroll
Work product
WP08 · App/system state
Conditions
long · Long-horizon
Proposed difficulty
5 / 5

Proposed verifier

Sessions file: single window; tab set equals expected 38 URLs; 5 groups with exact names/members; group order alphabetical; within-group order by date (Kendall tau partial). Project label is rendered on-page only (not in title/URL). CDP is disabled by policy and the OS file audit detects non-Chrome writes to the Sessions file; such edits fail.

Proposed partial credit

20% duplicates/ads closed; 15% single window; 40% group membership; 25% ordering

Mapped research references

Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.

In this workflow family