Computer-Use Agent Taxonomy中文
R04.04.01.04 · TASK CLASS

Diagrams, SmartArt, tables & charts in slides

Build diagrams, SmartArt, tables and charts inside slides to spec.

20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.

Typical applications
PowerPoint · Keynote · Google Slides
Class GUI-need label
G3 · GUI-only

Task proposals · 20

Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.

R04.04.01.04-T01 Turn five bullets into a Basic Process SmartArt

Original instruction

On slide 4 of input/onboarding.pptx, convert the 5 bullet steps into a SmartArt 'Basic Process' graphic (left to right, step order unchanged), apply color 'Colorful – Accent Colors' and style 'Subtle Effect', and size it to the content placeholder area. Save.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G3 · GUI-only
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

Slide 4 has a dgm graphicFrame with layout uniqueId 'process1', 5 nodes in order with exact text, colors 'colorful1' and quickstyle 'simple3' ids; frame within placeholder bounds (±0.05 in); bullet text box removed. SmartArt cannot be authored by python-pptx; VBA, COM and AppleScript automation disabled, no Python in the VM.

Proposed partial credit

30% SmartArt created from bullets; 30% node order and text; 25% color + style; 15% size/position.

R04.04.01.04-T02 Insert a formatted comparison table to an exact spec

Original instruction

On slide 6 of input/plan_options.pptx insert a 5-row × 4-column table from input/options.csv using table style 'Medium Style 2 – Accent 1', header row and banded rows on, first column bold, column widths 3.0/2.0/2.0/2.0 in, numbers right-aligned, positioned at (0.6 in, 1.6 in).

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms geom · Precise geometry
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

tbl XML: tableStyleId of Medium Style 2 – Accent 1, firstRow/bandRow/firstCol flags, gridCol widths (±0.01 in), cell text equals CSV, algn='r' on numeric cells; graphicFrame offset (±0.02). Saved by PowerPoint; VBA, COM and AppleScript automation disabled, no Python in the VM.

Proposed partial credit

35% cell contents; 25% style + flags; 25% column widths/alignment; 15% position.

R04.04.01.04-T03 Build an org chart SmartArt with an assistant and hanging layout

Original instruction

On slide 2 of input/team_intro.pptx create an Organization Chart SmartArt from input/org.csv (17 people, manager column): correct reporting lines, the EA added as an Assistant node under the CEO, and the Operations manager's 5 reports in a 'Both' hanging layout. Text shows name and title on two lines.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G3 · GUI-only
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

SmartArt data model (data1.xml): hierarchy equals org.csv tree (isomorphic with labels); EA node type 'asst'; Operations node has hierarchyBranch 'hang' (both); node text two lines name/title. VBA, COM and AppleScript automation disabled, no Python in the VM; python-pptx cannot author SmartArt.

Proposed partial credit

45% reporting tree correct; 20% assistant node; 20% hanging layout on the right node; 15% text format.

R04.04.01.04-T04 Chart a slide table as a sorted native bar chart with labels

Original instruction

Slide 3 of input/nps_review.pptx contains a table of NPS by product line. On slide 4 insert a native clustered bar chart of the same values sorted descending (largest on top), data labels at the outside end, no gridlines, bars in Accent 1, title 'NPS by product line'. Keep the table on slide 3.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Chart part on slide 4: barDir bar, series values equal table values in descending visual order (category axis orientation handled), dLbls outEnd, no majorGridlines, fill schemeClr accent1, title exact; slide 3 unchanged. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

35% values and order; 25% labels; 20% formatting; 20% title and table intact.

R04.04.01.04-T05 Draw a six-stage cycle diagram with curved connectors in Keynote

Original instruction

On slide 5 of input/product_lifecycle.key, draw a cycle of 6 rounded rectangles labelled per input/stages.txt, evenly placed on a circle of radius 300 pt centered on the slide, joined clockwise by curved connection lines attached to the shapes, all shapes the same size.

Platforms
mac · macOS
Applications
Keynote
Interfaces
desk · Desktop GUI
GUI need · task setting
G3 · GUI-only
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop geom · Precise geometry click · Point & click
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Grader exports to .pptx and reads shapes: 6 labelled shapes, centers on a 300 pt circle (±4 pt) at 60° steps (±2°), equal sizes; 6 connectors whose endpoints lie on consecutive shapes clockwise. osascript/JXA is blocked for the agent; the file must be saved by Keynote.

Proposed partial credit

25% shapes and labels; 35% circular placement; 30% connectors attached in order; 10% equal sizes.

R04.04.01.04-T06 Plot eight initiatives on a 2×2 effort–impact matrix in Google Slides

Original instruction

On slide 3 of Google Slides deck 'Roadmap triage', draw a 2×2 matrix (6×4 in) with axis labels 'Effort' and 'Impact' and quadrant titles, then place 8 labelled circles at positions proportional to the (effort, impact) scores 0–10 in input/initiatives.csv.

Platforms
web · Any OS (web)
Applications
Google Slides
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop geom · Precise geometry type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Slides API: matrix frame size/position; circle centers map back to (effort, impact) within ±0.25 score units; labels match CSV names; axis and quadrant texts exact. Agent has no API token and Apps Script is disabled for the test account; revision history must show editor UI edits.

Proposed partial credit

25% matrix frame + labels; 60% circles placed (pro-rata); 15% quadrant titles.

R04.04.01.04-T07 Build a feature comparison table with merged headers and checkmarks

Original instruction

On slide 8 of input/pricing.pptx build a table comparing 3 plans across 10 features: merged header cells grouping features into 'Core' and 'Advanced', ✓/— symbols centered from input/features.csv, the 'Pro' column shaded Accent 2 at 20% tint, 14 pt text.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
click · Point & click type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

tbl XML: gridSpan/rowSpan merges as specified; cell symbols equal CSV (U+2713 / U+2014) and centered; Pro column fills schemeClr accent2 with lumMod/lumOff for 20% tint; sz 1400. Saved by PowerPoint. VBA, COM and AppleScript automation disabled, no Python in the VM.

Proposed partial credit

30% merges; 35% symbols; 20% Pro shading; 15% font size.

R04.04.01.04-T08 Reorganize an existing hierarchy SmartArt and change its layout

Original instruction

Slide 5 of input/reorg.pptx has a Hierarchy SmartArt of the old structure. Update it to input/new_structure.md by promoting, demoting and moving nodes (do not rebuild), change the layout to 'Horizontal Hierarchy', and keep the custom fill colors set on the 3 VP nodes.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G3 · GUI-only
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click key · Shortcuts drag · Drag & drop
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

SmartArt data model tree equals new_structure; layout uniqueId 'hierarchy2' (horizontal); the 3 VP nodes keep their custom fills (node model ids persisted, i.e. not rebuilt); text unchanged. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

50% tree correct; 20% layout changed; 20% custom fills kept; 10% same SmartArt object (not rebuilt).

R04.04.01.04-T09 Create a labeled donut chart with brand colors in Keynote

Original instruction

On slide 7 of input/budget_story.key create a native Keynote donut chart of the 6 budget categories in input/budget.csv, segment colors from input/palette.txt in category order, value labels as percentages outside the ring with leader lines, legend hidden, and the total '$4.2M' text centered in the hole.

Platforms
mac · macOS
Applications
Keynote
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms geom · Precise geometry
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Grader export to .pptx: doughnutChart with 6 points equal CSV, point fills match palette (ΔE ≤2), dLbls showPercent outside, legend absent; text box centered on chart center (±3 pt); render vs reference SSIM ≥0.9. osascript is blocked for the agent; the file must be saved by Keynote.

Proposed partial credit

30% chart data; 25% colors; 25% labels; 20% centered total and no legend.

R04.04.01.04-T10 Rebuild a flowchart image as editable shapes and connectors

Original instruction

Slide 9 of input/claims_sop.pptx has a flattened flowchart image (input/flow.png, 11 nodes incl. 2 decisions, 13 edges). Replace it with editable PowerPoint shapes (rectangles, diamonds, terminators) and glued elbow connectors with the same labels and Yes/No edge labels, laid out like the image.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop geom · Precise geometry type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

Graph extracted from shapes and glued connectors is isomorphic to the reference with labels (fuzzy ≥0.9) and shape types; edge labels Yes/No attached to the right edges; image removed; node layout correlation with image positions ≥0.9. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

40% nodes with types and labels; 35% edges glued correctly; 10% decision labels; 15% layout similarity.

R04.04.01.04-T11 Draw a 12-task Gantt diagram on a slide from a project plan

Original instruction

On slide 4 of input/steering.pptx draw a Gantt diagram for the 12 tasks in input/project.xlsx: a month scale Jan–Dec 2026 across 10 in, one bar per task whose left edge and length are proportional to start and duration, task names left of bars, milestones as diamonds, critical tasks in Accent 2.

Platforms
mac · macOS win · Windows
Applications
PowerPoint · Excel
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
geom · Precise geometry drag · Drag & drop type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

Bars: x and width map to dates within ±2 days; rows ordered as the plan; names match; 3 milestones as diamonds at the right dates; critical-path bars filled accent2; month axis labels spaced evenly. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

45% bars placed (pro-rata); 15% names/order; 15% milestones; 25% critical colors and month scale.

R04.04.01.04-T12 Build a three-set Venn diagram with labels in each region

Original instruction

On slide 6 of input/skills_overlap.pptx, draw a 3-circle Venn (equal circles, 40% transparency, Accent 1–3) and place the 7 region labels from input/venn_regions.csv (A only, A∩B, … A∩B∩C) inside their correct regions, centered visually, 14 pt.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
geom · Precise geometry drag · Drag & drop vis · Visual judgment
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

3 ellipses of equal size with alpha 60% and accent fills; grader computes the 7 planar regions from circle geometry and checks each label's center lies inside its correct region and ≥0.1 in from region borders; text and size exact. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

25% circles; 60% labels in correct regions (pro-rata over 7); 15% formatting.

R04.04.01.04-T13 Shade a Google Slides table as a heatmap by value bands

Original instruction

Slide 5 of Google Slides deck 'Clinic utilisation' has a 7×9 table of percentages. Fill each data cell by band (<50% #E8F5E9, 50–79% #A5D6A7, 80–94% #FFB74D, ≥95% #E57373) and make text bold white in the ≥95% cells. Do not change values.

Platforms
web · Any OS (web)
Applications
Google Slides
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click vis · Visual judgment
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Slides API tableCellProperties fill colors per cell equal band mapping (63 cells); text style bold + white in ≥95% cells only; cell text unchanged. Agent has no API token and Apps Script is disabled for the test account; revision history must show editor UI edits.

Proposed partial credit

70% fills correct (pro-rata over 63); 20% text style rule; 10% values unchanged.

R04.04.01.04-T14 Draw an 18-component architecture diagram from a YAML spec

Original instruction

On slide 3 of input/platform_review.pptx draw the system in input/architecture.yaml: 18 components using icons from input/icons/, grouped into 4 labelled zones (rounded rectangles), 22 directed connectors glued to components with protocol labels, nothing overlapping, all inside the slide safe area.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
drag · Drag & drop geom · Precise geometry type · Text & forms
Work product
WP03 · Visual layout
Conditions
long · Long-horizon
Proposed difficulty
5 / 5

Proposed verifier

Extracted graph (components by label, connectors by stCxn/endCxn with arrowheads) isomorphic to the YAML; each component inside its zone bbox; icon hashes match; labels on edges; no shape overlaps; within safe area. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

30% components and icons; 35% edges glued with direction; 15% zones; 20% edge labels and no overlaps.

R04.04.01.04-T15 Recreate a flattened chart image as a matching native chart

Original instruction

Slide 10 of input/analyst_day.pptx has a chart pasted as an image (input/chart.png, stacked columns, 8 categories × 3 series, no data labels). Replace it with a native PowerPoint chart reproducing the values (read from the image within ±2% of axis range), colors, axis scale, legend and title.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
vis · Visual judgment click · Point & click type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
5 / 5

Proposed verifier

Native barChart stacked with 3×8 values within ±2% of axis range of hidden truth; series fills ΔE2000 ≤3 vs image; axis min/max/major unit equal; render SSIM vs image ≥0.9; image removed. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

45% values within tolerance (pro-rata); 20% colors; 20% axes/legend/title; 15% render match.

R04.04.01.04-T16 Lay out a seven-step infographic along a curved path in Keynote

Original instruction

On slide 4 of input/customer_journey.key draw an S-shaped curve with the pen tool through the 4 guide points marked on the slide, then place 7 numbered circles with icons and captions so their centers lie on the curve at equal arc-length spacing, captions alternating sides.

Platforms
mac · macOS
Applications
Keynote
Interfaces
desk · Desktop GUI
GUI need · task setting
G3 · GUI-only
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
path · Continuous path geom · Precise geometry drag · Drag & drop
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
5 / 5

Proposed verifier

Grader export to .pptx: custGeom curve passes within 6 pt of the 4 guide points; circle centers within 5 pt of the curve and arc-length spacing equal (±4%); numbering order along the curve; captions alternate sides. osascript/JXA is blocked for the agent; the file must be saved by Keynote.

Proposed partial credit

25% curve through guide points; 45% circles on curve with equal spacing; 15% numbering; 15% captions alternate.

R04.04.01.04-T17 Control pair of T02: insert the comparison table with python-pptx

Original instruction

Control pair of T02. With python-pptx from the terminal, add the same 5×4 table from input/options.csv to slide 6 of input/plan_options.pptx with style, flags, widths, alignment and position as in T02. Save output/plan_options_cli.pptx.

Platforms
mac · macOS win · Windows lin · Linux
Applications
python-pptx
Interfaces
term · Terminal
GUI need · task setting
CL · CLI-sufficient
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
code · Code & commands
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

Same checker as T02 without the PowerPoint-save requirement; compared with T02 to measure GUI vs script success.

Proposed partial credit

35% contents; 25% style/flags; 25% widths/alignment; 15% position.

R04.04.01.04-T18 Insert a six-stage sales funnel chart into a slide

Original instruction

On slide 7 of input/pipeline_review.pptx insert a native Funnel chart (Office 2016+ chart type) of the 6 stages in input/funnel.csv in stage order, data labels showing value and % of first stage (as a custom label from cells), bars in Accent 1, gap width 30%.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

chartex part with layoutId 'funnel', 6 points in order equal CSV; labels include value and computed % (from a cell range in the embedded workbook); fill accent1; gapWidth 30. python-pptx cannot author chartex. VBA, COM and AppleScript automation disabled, no Python in the VM; file must be saved by PowerPoint (app.xml).

Proposed partial credit

35% funnel with right data/order; 35% labels; 15% fill; 15% gap width.

R04.04.01.04-T19 Build a picture SmartArt of team members with roles

Original instruction

On slide 3 of input/new_team.pptx create a SmartArt 'Picture Accent List' with 4 entries from input/team.csv: each picture placeholder filled with the person's photo from input/photos/, name as level-1 text and role as level-2 text, in CSV order.

Platforms
mac · macOS win · Windows
Applications
PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G3 · GUI-only
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

SmartArt layout uniqueId for Picture Accent List; 4 nodes with level-1/level-2 text equal CSV; each node's picture blip hash equals the right photo; order preserved. VBA, COM and AppleScript automation disabled, no Python in the VM; python-pptx cannot author SmartArt.

Proposed partial credit

25% correct SmartArt layout; 40% photos matched (pro-rata); 35% text levels.

R04.04.01.04-T20 Draw a 15-person org chart with shapes and connectors in Google Slides

Original instruction

On slide 2 of Google Slides deck 'Ops handbook', draw an org chart for the 15 people in input/ops_org.csv as boxes with name/title, connected by elbow lines from manager to report, each level on one horizontal row with equal vertical spacing, siblings centered under their manager.

Platforms
web · Any OS (web)
Applications
Google Slides
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop geom · Precise geometry type · Text & forms
Work product
WP03 · Visual layout
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

Slides API: 15 boxes with text matching CSV; line elements connected (connection sites) manager→report forming the CSV tree; boxes in the same level share y (±0.03 in); sibling groups centered under manager (±0.05 in). Agent has no API token and Apps Script is disabled for the test account; revision history must show editor UI edits.

Proposed partial credit

25% boxes/text; 35% connections form the right tree; 25% level rows; 15% sibling centering.

Mapped research references

Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.

In this workflow family