Computer-Use Agent Taxonomy中文
R01.02.01.01 · TASK CLASS

Find & browse by attributes

Find files by name, kind, date, size, tags or content, preview and inspect them (Quick Look, Get Info), and configure file-manager views.

20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.

Typical applications
Finder · File Explorer · Nautilus
Class GUI-need label
G2 · GUI-essential

Task proposals · 20

Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.

R01.02.01.01-T01 List large 2025 PDFs found with Explorer search

Original instruction

Under C:\Users\tester\Documents (with subfolders), find every PDF larger than 5 MB modified during 2025 using File Explorer search, and write their full paths, one per line, to C:\out\big_pdfs.txt.

Platforms
win · Windows
Applications
File Explorer · Notepad
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
type · Text & forms click · Point & click
Work product
WP12 · Answer/decision
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

big_pdfs.txt line set equals ground-truth set (7 files; decoys: 4.9 MB PDF, 2024 PDF, large .pdf.bak). F1 scored. cmd/PowerShell blocked by AppLocker; Sysmon detecting dir/Get-ChildItem/where.exe launched by the agent -> 0.

Proposed partial credit

20% file exists; 80% F1 over expected paths

R01.02.01.01-T02 Smart Folder for Q3 red-tagged invoices

Original instruction

Create a Finder Smart Folder 'Q3 Invoices' searching This Mac for Kind is PDF, Name contains 'INV', Created between 2025-07-01 and 2025-09-30, and Tag is Red. Save it with 'Add to Sidebar' checked.

Platforms
mac · macOS
Applications
Finder
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms
Work product
WP09 · Files & folders
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

~/Library/Saved Searches/Q3 Invoices.savedSearch: RawQuery has kMDItemContentTypeTree pdf, kMDItemFSName *INV*, creation date bounds, kMDItemUserTags Red; sidebar favorites list contains it; running the query returns the 9 expected files. Terminal withheld; eslogger detects .savedSearch or sidebar plist writes by any process other than Finder -> 0.

Proposed partial credit

20% saved file; 60% four criteria (equal share per criterion); 20% in sidebar

R01.02.01.01-T03 Find a document by a phrase inside it

Original instruction

One of ~400 files in ~/Documents (docx, pdf, txt, pages) mentions 'Project Halcyon budget'. Find it with Spotlight or Finder search and write its full path to ~/Desktop/answer.txt.

Platforms
mac · macOS
Applications
Finder · Spotlight
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
type · Text & forms click · Point & click
Work product
WP12 · Answer/decision
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

answer.txt equals the single true path (decoys mention 'Halcyon' or 'budget' alone; one has the phrase in its filename only). Terminal withheld; eslogger detects mdfind/grep/find -> 0.

Proposed partial credit

20% answer file exists; 80% exact path

R01.02.01.01-T04 Configure the Downloads list view

Original instruction

Set the Downloads folder (only) to List view with columns Date Added, Size and Kind visible, sorted by Size descending, with 'Calculate all sizes' on and 'Show icon preview' off.

Platforms
mac · macOS
Applications
Finder
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click hover · Hover & context
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Parse ~/Downloads/.DS_Store (ds_store lib) lsvp/lsvP: view style Nlsv, visible columns include dateAdded,size,kind, sort column size descending, calculateAllSizes=1, showIconPreview=0; other folders' view unchanged. Terminal withheld; eslogger detects defaults/python writing .DS_Store, and .DS_Store must be saved by Finder -> 0 otherwise.

Proposed partial credit

25% list view; 30% columns; 25% sort; 20% sizes/preview options

R01.02.01.01-T05 Explorer view: extensions, hidden items, grouped Details

Original instruction

Turn on file name extensions, hidden items and the Details pane. Set the Downloads folder to Details view grouped by Type, sorted by Date modified descending, and add the 'Date taken' column.

Platforms
win · Windows
Applications
File Explorer
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
click · Point & click hover · Hover & context
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Explorer\Advanced HideFileExt=0, Hidden=1; Modules\GlobalSettings DetailsContainer shown; ShellBags for Downloads: LogicalViewMode details, GroupBy System.ItemTypeText, Sort -System.DateModified, ColInfo includes System.Photo.DateTaken. regedit/PowerShell blocked by AppLocker; Sysmon detects reg.exe writes -> 0.

Proposed partial credit

30% global toggles; 20% Details view; 25% group+sort; 25% Date taken column

R01.02.01.01-T06 Tag every Canon-shot photo found by EXIF metadata

Original instruction

~/Pictures contains 600 images from four cameras. Use Finder search with the 'Device make' attribute to find every photo taken with a Canon camera and give each the orange tag 'Canon'. Do not tag anything else.

Platforms
mac · macOS
Applications
Finder · Spotlight
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms drag · Drag & drop
Work product
WP09 · Files & folders
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

kMDItemUserTags 'Canon' (orange) on exactly the 143 files whose EXIF Make starts with 'Canon' (decoy: 'Canon' in filename only); precision and recall scored. Terminal withheld; eslogger detects mdfind/xattr/tag CLI -> 0.

Proposed partial credit

20% tag created orange; 80% F1 over tagged set

R01.02.01.01-T07 Star recent spreadsheets and bookmark an archive in Files

Original instruction

In GNOME Files, find all spreadsheets (.ods, .xlsx) under ~/Projects modified in the last 7 days using the search filters, star them, and add ~/Projects/Archive to the sidebar bookmarks.

Platforms
lin · Linux
Applications
Nautilus
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms
Work product
WP09 · Files & folders
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

tracker3 SPARQL: starred set equals the 6 expected files; ~/.config/gtk-3.0/bookmarks contains file:///home/u/Projects/Archive. Terminal withheld; auditd detects find/tracker3/gio exec by the agent -> 0.

Proposed partial credit

70% starred set F1; 30% bookmark

R01.02.01.01-T08 Report the five largest files on a data drive

Original instruction

Using File Explorer search on D:\Data (all subfolders), find the five largest files and write C:\out\largest.csv with header name,bytes listing them largest first; bytes must be exact (from Properties), not rounded.

Platforms
win · Windows
Applications
File Explorer · Notepad
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
type · Text & forms click · Point & click hover · Hover & context
Work product
WP02 · Records/table
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

largest.csv rows equal ground truth names in order; byte counts exact. Sizes copied from rounded 'Size' column (KB/MB) fail the exact check. cmd/PowerShell blocked by AppLocker; Sysmon detects PowerShell/dir -> 0.

Proposed partial credit

40% correct five names; 20% order; 40% exact byte counts

R01.02.01.01-T09 Find hidden .env files with Finder search

Original instruction

Under ~/Code (35 repos), list every hidden file named '.env' or matching '.env.*' into ~/Desktop/env_files.txt (one absolute path per line). Spotlight skips invisible files by default; use Finder's search attributes 'File invisible' and 'System files' as needed.

Platforms
mac · macOS
Applications
Finder
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms key · Shortcuts
Work product
WP12 · Answer/decision
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

Line set equals the 11 expected paths (decoys: env.example, .envrc). F1 scored. Terminal withheld; eslogger detects find/mdfind/ls -> 0.

Proposed partial credit

20% file exists; 80% F1 over paths

R01.02.01.01-T10 Identify the last photo of a trip and its lens

Original instruction

In ~/Pictures/Trip2024 (220 JPEGs with shuffled names), find the photo with the latest capture time (EXIF DateTimeOriginal, not file dates) and write 'filename,lens model' to ~/Desktop/answer.txt, using Finder Get Info or Preview's inspector.

Platforms
mac · macOS
Applications
Finder · Preview
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click hover · Hover & context nav · Pan/zoom/scroll
Work product
WP12 · Answer/decision
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

answer.txt equals ground truth 'IMG_x.jpg,<LensModel>' (file mtimes are shuffled to mislead). Terminal withheld; eslogger detects exiftool/mdls/sips -> 0.

Proposed partial credit

60% correct filename; 40% exact lens string

R01.02.01.01-T11 Saved Explorer search for one author's drawings this week

Original instruction

Create a saved search on D:\CAD for *.dwg files modified this week whose Authors property is 'J. Kim', and save it to the Desktop as 'Kim DWGs'. The search must use Explorer's search syntax, not a static file list.

Platforms
win · Windows
Applications
File Explorer
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
type · Text & forms click · Point & click
Work product
WP09 · Files & folders
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

Desktop\Kim DWGs.search-ms XML: scope D:\CAD, conditions on System.FileExtension .dwg, System.DateModified this week, System.Author 'J. Kim'; executing it via Windows Search returns the 4 expected files. cmd/PowerShell blocked by AppLocker; Sysmon detects .search-ms written by any process other than explorer.exe -> 0.

Proposed partial credit

20% file saved; 60% three conditions (equal share each); 20% returns expected set

R01.02.01.01-T12 Find the deck with a given slide using Quick Look only

Original instruction

Thirty Keynote decks in ~/Decks have generic names. Using Quick Look previews (do not open Keynote), find the deck that contains a slide titled 'Retention cohort' and tag it Green.

Platforms
mac · macOS
Applications
Finder · Quick Look
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
key · Shortcuts vis · Visual judgment nav · Pan/zoom/scroll
Work product
WP09 · Files & folders
Conditions
licensed · Licensed pro app
Proposed difficulty
4 / 5

Proposed verifier

Only the target deck has Green tag; Keynote never launched (process log); Terminal withheld; eslogger detects unzip/strings/mdfind on .key -> 0. Slide titles are images on 3 decoys so text search misleads.

Proposed partial credit

70% correct deck tagged; 30% no other decks tagged and Keynote not launched

R01.02.01.01-T13 Customize the Finder sidebar

Original instruction

Add ~/Clients to the Finder sidebar Favorites as the second item, remove Recents and AirDrop from the sidebar, and show External disks under Locations.

Platforms
mac · macOS
Applications
Finder
Interfaces
desk · Desktop GUI
GUI need · task setting
G3 · GUI-only
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop click · Point & click
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

FavoriteItems .sfl3 (com.apple.LSSharedFileList) order: Clients at index 1; Recents and AirDrop hidden in com.apple.finder ShowRecentTags/sidebar flags; ShowExternalHardDrivesOnDesktop unaffected, sidebar externals shown. No supported CLI for sfl3; Terminal withheld and eslogger detects sidebar plist/sfl3 writes by non-Finder processes -> 0.

Proposed partial credit

40% Clients at position 2; 40% Recents and AirDrop removed; 20% external disks shown

R01.02.01.01-T14 Quick access pins and privacy

Original instruction

Pin D:\Clients and D:\Scans to Quick access as the first two pinned folders in that order, unpin Pictures and Music, and turn off 'Show recently used files' and 'Show frequently used folders'.

Platforms
win · Windows
Applications
File Explorer
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop hover · Hover & context click · Point & click
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Shell namespace enumeration of Quick access pinned items: [Clients, Scans, ...] with Pictures/Music absent; Explorer ShowRecent=0, ShowFrequent=0. PowerShell blocked by AppLocker; Sysmon detects Shell.Application InvokeVerb scripts -> 0.

Proposed partial credit

40% two pins in order; 30% unpinned; 30% privacy toggles

R01.02.01.01-T15 Find files downloaded from a vendor portal

Original instruction

Some files in ~/Downloads and ~/Documents were downloaded from https://vendor-portal.test. Using Finder search with the 'Where from' attribute, find all of them and write their names, sorted, to ~/Desktop/vendor_files.txt.

Platforms
mac · macOS
Applications
Finder
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms
Work product
WP12 · Answer/decision
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

vendor_files.txt equals the sorted list of 9 names whose kMDItemWhereFroms contains vendor-portal.test (decoys: vendor-portal.test in filename; files from vendor-portal.example). Terminal withheld; eslogger detects mdls/xattr/mdfind -> 0.

Proposed partial credit

20% file exists; 70% F1 over names; 10% sorted

R01.02.01.01-T16 Office documents by author and tag, with matching columns

Original instruction

In D:\Reports (nested, 300 Office files) find documents whose Authors include 'Lin' and whose Tags include 'Q3'. Show the results in Details view with Authors and Tags columns, then write their file names to C:\out\authors_q3.txt.

Platforms
win · Windows
Applications
File Explorer
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
type · Text & forms click · Point & click hover · Hover & context
Work product
WP12 · Answer/decision
Conditions
None declared
Proposed difficulty
5 / 5

Proposed verifier

authors_q3.txt set equals the 12 expected names (decoys: author 'Linda', tag 'Q3-draft', 'Lin' in body text only). Saved view of search results includes System.Author and System.Keywords columns. PowerShell blocked by AppLocker; Sysmon detects PowerShell COM property readers -> 0.

Proposed partial credit

70% F1 over names; 30% search view has both columns

R01.02.01.01-T17 Recover yesterday's unnamed spreadsheet

Original instruction

The user saved a Numbers spreadsheet 'yesterday afternoon' about pallet counts but forgot its name and folder. Find it (it may be in iCloud Drive or local folders), open it in Numbers, and write its full path to ~/Desktop/found.txt.

Platforms
mac · macOS
Applications
Finder · Spotlight · Numbers
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
type · Text & forms click · Point & click
Work product
WP12 · Answer/decision
Conditions
licensed · Licensed pro app
Proposed difficulty
3 / 5

Proposed verifier

found.txt equals the true path (decoys: pallet counts from last week; a CSV with 'pallet' saved yesterday); Numbers has that document open (AX window title). Terminal withheld; eslogger detects mdfind/find -> 0.

Proposed partial credit

70% correct path; 30% opened in Numbers

R01.02.01.01-T18 Find long 4K videos in a large archive

Original instruction

/Volumes/Archive holds ~12,000 files. Using Finder search with Duration and Pixel height/width attributes, find every video longer than 10 minutes at 3840×2160 and write their paths to ~/Desktop/long_4k.txt.

Platforms
mac · macOS
Applications
Finder · Spotlight
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms nav · Pan/zoom/scroll
Work product
WP12 · Answer/decision
Conditions
None declared
Proposed difficulty
5 / 5

Proposed verifier

Line set vs 23 expected paths (decoys: 4K 9:58 clip, 4096×2160 DCI, 1080p 2-hour films, .mov proxies). F1 scored. Terminal withheld; eslogger detects mdfind/mdls/ffprobe -> 0.

Proposed partial credit

10% file exists; 90% F1 over paths

R01.02.01.01-T19 Configure GNOME Files list view defaults

Original instruction

In GNOME Files preferences set the default view to List, enable expandable folders in list view, sort folders before files, show hidden files, and add the 'Detailed Type' and 'Modified — Time' columns to the default visible columns.

Platforms
lin · Linux
Applications
Nautilus
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

gsettings org.gnome.nautilus.preferences default-folder-viewer 'list-view', list-view use-tree-view true, gtk sort-directories-first true, show-hidden true, list-view default-visible-columns contains detailed_type and date_modified_with_time. Terminal withheld; auditd detects gsettings/dconf exec -> 0.

Proposed partial credit

20% list default; 20% expandable; 30% folders first and hidden files shown; 30% columns

R01.02.01.01-T20 Find files owned by a departed contractor on a share

Original instruction

On D:\Share (2,400 files) find every file whose NTFS owner is CORP\contractor01 using Explorer's Owner column, and write C:\out\owner_files.csv with path,size_bytes,date_modified (ISO). Do not change ownership or permissions.

Platforms
win · Windows
Applications
File Explorer
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click hover · Hover & context nav · Pan/zoom/scroll
Work product
WP02 · Records/table
Conditions
long · Long-horizon
Proposed difficulty
5 / 5

Proposed verifier

owner_files.csv path set vs 31 expected (decoys: author property 'contractor01', owner contractor010); size/date fields exact per row; ACL/owner hashes of all files unchanged. cmd/PowerShell blocked by AppLocker; Sysmon detects icacls/Get-Acl/PowerShell -> 0.

Proposed partial credit

50% F1 over paths; 30% field accuracy; 20% no ACL changes

Mapped research references

Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.

In this workflow family