Computer-Use Agent Taxonomy中文
R15.01.01.04 · TASK CLASS

Instructional media & assessment authoring

Author interactive lessons and question banks.

20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.

Previous class address: R10.05.01.04 · Original proposal IDs are retained.

Typical applications
H5P · Articulate Storyline · Kahoot
Class GUI-need label
G2 · GUI-essential

Task proposals · 20

Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.

R10.05.01.04-T01 Build a ten-question Kahoot quiz with time limits and images

Original instruction

Kahoot! (sandbox teacher account). Create kahoot 'Cell Organelles Review' from input/questions.docx: 10 questions (8 quiz, 2 true/false) with the given correct answers, 20-second limits (30 s for the two longest), standard points, and the image from input/images/ attached to questions 3, 6 and 9. Save it as private.

Platforms
web · Any OS (web)
Applications
Kahoot!
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
type · Text & forms click · Point & click drag · Drag & drop
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

Kahoot export/JSON read by grader: 10 questions in order with exact text, correct choices, time limits and types; images attached on the right questions (perceptual hash); visibility private. Spreadsheet import is disabled for the account; edit history from the creator UI.

Proposed partial credit

50% questions and answers; 20% time limits/types; 20% images; 10% private.

R10.05.01.04-T02 Add timed interactions to a lecture video with H5P Interactive Video

Original instruction

Moodle sandbox with H5P. Create an Interactive Video activity from input/photosynthesis.mp4 with 5 interactions at the times in input/plan.csv (3 single-choice questions that pause the video, 1 true/false, 1 text overlay), 4 bookmarks for chapter starts, and a submit screen; pass percentage 80%.

Platforms
web · Any OS (web)
Applications
H5P · Moodle
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
av · Audio/video over time click · Point & click drag · Drag & drop
Work product
WP05 · Time-based media
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

content.json: interactions with start times within 0.5 s of plan, correct types and answers, pause flags; bookmarks at chapter times; passPercentage 80; summary/submit screen present. .h5p package upload is disabled for the role and Moodle web services are off, so content must be authored in the H5P editor (content history checked).

Proposed partial credit

45% interactions and times; 20% answers; 20% bookmarks; 15% scoring settings.

R10.05.01.04-T03 Create a heart-labeling drag-and-drop exercise in H5P

Original instruction

H5P (in Moodle sandbox). Using input/heart_diagram.png, create a Drag and Drop activity with 8 labels (right atrium, left ventricle, aorta, etc.) and 8 drop zones placed precisely over the matching structures shown in input/answer_key.png, each zone accepting only its label, with feedback for incorrect drops and 'Enable retry'.

Platforms
web · Any OS (web)
Applications
H5P · Moodle
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
drag · Drag & drop geom · Precise geometry vis · Visual judgment
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

content.json: 8 drop zones whose rectangles (percent coords) contain the gold structure centers and overlap gold boxes IoU >= 0.4; correctElements map each zone to its label only; feedback and retry flags set. .h5p package upload is disabled for the role and Moodle web services are off, so the activity must be authored in the H5P editor.

Proposed partial credit

50% zone placement; 30% correct mappings; 20% feedback/retry.

R10.05.01.04-T04 Author a branching customer-service scenario with score variables in Storyline

Original instruction

Articulate Storyline 360 (Windows). Build a scenario from input/script.docx: 3 decision points with 3 choices each, a number variable that adds the points in the script, triggers that branch to consequence slides, a results slide showing the variable and passing at >= 7, and publish as SCORM 1.2 to output/scenario_scorm.zip with the .story saved.

Platforms
win · Windows
Applications
Articulate Storyline 360 · Word
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
click · Point & click drag · Drag & drop type · Text & forms
Work product
WP08 · App/system state
Conditions
licensed · Licensed pro app multiapp · Multi-app
Proposed difficulty
4 / 5

Proposed verifier

Grader runs the SCORM package in a headless test LMS and plays 4 scripted paths: branch targets, final variable values and cmi.core.lesson_status (passed/failed) equal gold for each; output/scenario.story present. The package must be published by Storyline from the saved .story (player build stamp checked); hand-built SCORM packages are detected and fail.

Proposed partial credit

40% branching correct on all paths; 30% variable scoring; 20% pass/fail reporting; 10% .story saved.

R10.05.01.04-T05 Build an H5P Course Presentation with embedded checks and a summary

Original instruction

H5P in Moodle sandbox. Create a Course Presentation 'Water Cycle' with 6 slides from input/slides_outline.docx: text and image layouts as described, a fill-in-the-blanks interaction on slide 3, a single-choice set on slide 5, a summary slide with score, and navigation set to show slide titles in the menu.

Platforms
web · Any OS (web)
Applications
H5P · Moodle
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click drag · Drag & drop type · Text & forms
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

content.json: 6 slides with element types per outline, blank answers and choices exact, summary slide enabled, slide titles in keywords; element positions inside slide bounds without overlap (rendered layout check). .h5p package upload is disabled for the role and Moodle web services are off, so the presentation must be authored in the H5P editor.

Proposed partial credit

30% slides and elements; 40% interactions; 15% summary; 15% layout.

R10.05.01.04-T06 Record a software simulation with try-mode hotspots and xAPI reporting

Original instruction

In Articulate Storyline 360 record a software simulation of the 7-step expense-submission flow in the sandbox web app at input/app_url.txt, convert it to Try mode with hotspots on each correct click target, incorrect-click feedback after 2 misses, a 'hint' layer per step, and publish with xAPI to the sandbox LRS endpoint in input/lrs.json. Save output/expense_sim.story.

Platforms
win · Windows
Applications
Articulate Storyline 360
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
geom · Precise geometry click · Point & click drag · Drag & drop
Work product
WP05 · Time-based media
Conditions
licensed · Licensed pro app long · Long-horizon multiapp · Multi-app
Proposed difficulty
5 / 5

Proposed verifier

Grader plays the published sim headlessly: each of 7 hotspots overlaps the target control IoU >= 0.5; wrong clicks trigger feedback after 2 misses; completing the path emits xAPI 'completed'/'passed' statements to the LRS; .story present. The output must be published by Storyline from the saved .story (player build stamp); hand-built packages are detected.

Proposed partial credit

45% hotspots; 20% feedback/hint layers; 25% xAPI statements; 10% .story.

R10.05.01.04-T07 Create a Quizlet study set with images from a glossary

Original instruction

Quizlet (sandbox teacher account). Create study set 'Unit 3 Vocabulary' with the 30 terms and definitions in input/glossary.pdf, add the images from input/term_images/ to the 6 terms that have one, set term language English and definition language English, and share it to class 'Bio P2'.

Platforms
web · Any OS (web)
Applications
Quizlet
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
type · Text & forms click · Point & click
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
2 / 5

Proposed verifier

Set export: 30 term/definition pairs exact (order-insensitive); images on the 6 terms (perceptual hash); shared to class. The 'import' paste box is disabled in the sandbox; entries must be typed.

Proposed partial credit

60% terms and definitions; 25% images; 15% shared.

R10.05.01.04-T08 Author calculated, drag-onto-image and cloze questions in the Moodle question bank

Original instruction

Moodle sandbox, course PHYS101-F26 question bank, category 'Kinematics'. Author 8 questions from input/item_specs.pdf: 3 calculated questions with wildcards {v} and {t} and tolerances, 2 drag-and-drop onto image (labeling a velocity-time graph), 2 Cloze (embedded answers) and 1 drag-and-drop into text; preview each to confirm grading.

Platforms
web · Any OS (web)
Applications
Moodle
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
type · Text & forms drag · Drag & drop geom · Precise geometry
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

question tables: 8 questions with qtypes, formulas, tolerances and datasets exact; ddimageortext drop zones within 15 px of gold coordinates; cloze answer keys exact; grader attempts each with correct and wrong responses and checks marks. Question XML import disabled.

Proposed partial credit

35% calculated; 30% drag-onto-image placement; 20% cloze; 15% drag-into-text.

R10.05.01.04-T09 Build a Rise 360 lesson with process, accordion and knowledge checks

Original instruction

Articulate Rise 360 (sandbox). Create course 'Lab Safety Basics' with 3 lessons from input/outline.docx using a process block for the spill-response steps, an accordion for PPE types, 4 knowledge-check blocks (2 multiple choice, 1 multiple response, 1 matching), a continue block that requires completion, and export SCORM 2004 to output/lab_safety.zip.

Platforms
web · Any OS (web)
Applications
Articulate Rise 360
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click drag · Drag & drop type · Text & forms
Work product
WP08 · App/system state
Conditions
licensed · Licensed pro app
Proposed difficulty
4 / 5

Proposed verifier

Export parsed: lessons and block types in order; knowledge-check answers exact; continue-block completion setting; SCORM manifest valid and launches in the test LMS reporting completion after all lessons. The sandbox issues no API token, and the package must be Rise's own SCORM export (Rise player build in the manifest); hand-built packages are detected.

Proposed partial credit

30% lesson structure; 35% knowledge checks; 15% gating; 20% valid SCORM export.

R10.05.01.04-T10 Build a randomized quiz from question pools in Adobe Captivate

Original instruction

Adobe Captivate (Windows or macOS). Create a responsive project with 2 question pools (Pool A 10 items, Pool B 6 items) authored from input/items.xlsx, a quiz drawing 5 random items from A and 3 from B, pass at 75%, 2 attempts, review mode on, and publish HTML5 with SCORM 1.2 reporting to output/captivate_quiz.zip.

Platforms
win · Windows mac · macOS
Applications
Adobe Captivate · Excel
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
click · Point & click type · Text & forms
Work product
WP08 · App/system state
Conditions
licensed · Licensed pro app multiapp · Multi-app
Proposed difficulty
3 / 5

Proposed verifier

Test-LMS runs: each launch serves 8 questions (5 from A, 3 from B, verified via interaction ids); pass threshold and attempts behave per spec; item answers match spreadsheet; project file .cptx saved. The package must be published by Captivate from the saved .cptx (generator stamp checked); hand-built SCORM packages are detected and fail.

Proposed partial credit

35% pools and items; 30% random draw; 25% scoring/attempts; 10% project saved.

R10.05.01.04-T11 Create a drag-and-drop sorting interaction with states and accessible alternative

Original instruction

Articulate Storyline 360. Build a slide where learners sort 8 waste items into Recycle, Compost and Landfill bins (drag-and-drop freeform), with drop-correct and drop-incorrect states on items, correct/incorrect feedback layers, a 2-attempt limit, and a keyboard-accessible alternative (a pick-many layer) reachable via tab focus order. Publish to output/sorting_web/ and save the .story.

Platforms
win · Windows
Applications
Articulate Storyline 360
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
drag · Drag & drop geom · Precise geometry click · Point & click
Work product
WP08 · App/system state
Conditions
licensed · Licensed pro app
Proposed difficulty
4 / 5

Proposed verifier

Headless runs: correct sort yields correct layer and score, wrong yields incorrect layer and 2-attempt cap; items show states after drops; keyboard-only run (tab/enter) can complete via the alternative; focus order follows reading order. Output must be published by Storyline from the saved .story (player build stamp); hand-built HTML is detected.

Proposed partial credit

40% drag-drop correctness; 20% states/feedback; 15% attempts; 25% keyboard alternative.

R10.05.01.04-T12 Localize a Storyline course into Spanish and fix text overflow

Original instruction

input/onboarding.story (24 slides, English). Export the text for translation as Word, replace it with the Spanish translations in input/es_translations.docx (matching IDs), import back into a copy saved as output/onboarding_es.story, then fix every slide where Spanish text overflows its shape or button (resize, reflow or reduce font no smaller than 14 pt), and publish output/onboarding_es_web/.

Platforms
win · Windows
Applications
Articulate Storyline 360 · Word
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
vis · Visual judgment geom · Precise geometry multi · Cross-app
Work product
WP03 · Visual layout
Conditions
licensed · Licensed pro app multiapp · Multi-app long · Long-horizon
Proposed difficulty
5 / 5

Proposed verifier

Published slides rendered headless: every text string equals the Spanish translation; zero text boxes with overflow (rendered text bbox inside shape bbox) on the 18 seeded overflow slides; min font >= 14 pt; English file untouched. Output must be published by Storyline from the saved .story (player build stamp); edits to published HTML are detected.

Proposed partial credit

35% translations imported; 45% overflow fixed; 10% font floor; 10% original untouched.

R10.05.01.04-T13 Author a Canvas New Quizzes item bank with formula and hot-spot items

Original instruction

Canvas sandbox, New Quizzes item bank 'Chem Stoichiometry'. Author 12 items from input/items.pdf: 4 formula items with variable ranges and answer tolerance, 3 hot-spot items marking regions on lab-equipment images, 3 multiple-answer, and a stimulus with 2 attached items; align each to the outcome named in the spec.

Platforms
web · Any OS (web)
Applications
Canvas New Quizzes
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
type · Text & forms geom · Precise geometry click · Point & click
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Item bank export (QTI): 12 items with types; formula definitions and tolerances exact; hot-spot regions overlap gold regions IoU >= 0.5; stimulus linkage; outcome alignments exact. Canvas API token creation is disabled for the agent's role and QTI import is disabled in the sandbox, so items must be authored in the New Quizzes editor.

Proposed partial credit

30% formula items; 30% hot spots; 20% multiple answer and stimulus; 20% alignments.

R10.05.01.04-T14 Add interactive poll and draw-it slides to a Nearpod lesson

Original instruction

Nearpod (sandbox teacher account). Import input/fractions.pptx as a lesson, then insert a Poll after slide 3 and a Draw It activity after slide 6 (using input/number_line.png as background), each with the prompt text given in input/activities.txt, and save the lesson in folder 'Grade 4 Math'.

Platforms
web · Any OS (web)
Applications
Nearpod
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click drag · Drag & drop type · Text & forms
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
1 / 5

Proposed verifier

Lesson structure: imported slides in order with poll at position 4 and Draw It at position 8; prompts exact; background image attached; saved in the folder. Nearpod issues no API token to the sandbox teacher account, so the lesson must be built in the Nearpod editor from the browser session.

Proposed partial credit

30% import; 50% activities at correct positions with prompts; 20% folder.

R10.05.01.04-T15 Build an H5P branching scenario with video segments and end scores

Original instruction

H5P Branching Scenario (Moodle sandbox). From input/flowchart.pdf build a scenario on de-escalation: 4 video segments from input/clips/, 3 branching questions, 2 information screens and 3 different endings with scores 0, 5 and 10; enable 'go back' and a scoring scheme based on end scenario.

Platforms
web · Any OS (web)
Applications
H5P · Moodle
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click drag · Drag & drop av · Audio/video over time
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
4 / 5

Proposed verifier

content.json graph equals the flowchart (node types, edges, end scores); videos attached in the right nodes; scoring scheme setting; grader plays 3 paths and reads the xAPI score per ending. .h5p package upload is disabled for the role and Moodle web services are off, so the scenario must be authored in the H5P editor.

Proposed partial credit

45% graph structure; 20% media placement; 20% end scores; 15% settings.

R10.05.01.04-T16 Sync narration to slide animations and add a quiz with iSpring Suite

Original instruction

PowerPoint with iSpring Suite (Windows). Open input/safety_training.pptx, import narration input/narration.mp3, and in the iSpring timeline sync each slide's animation steps to the narration cue times in input/cues.csv; add a 5-question graded quiz at the end, then publish SCORM 2004 to output/safety_scorm.zip.

Platforms
win · Windows
Applications
iSpring Suite · PowerPoint
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
av · Audio/video over time drag · Drag & drop click · Point & click
Work product
WP05 · Time-based media
Conditions
licensed · Licensed pro app multiapp · Multi-app
Proposed difficulty
3 / 5

Proposed verifier

Published output: per-slide audio offsets and animation step times within 0.3 s of cues (from the player's timing data); quiz items and answers exact; SCORM package launches and reports score in the test LMS. PowerPoint VBA macros are disabled by policy, and the package must be published by iSpring (player build stamp); hand-built packages are detected.

Proposed partial credit

45% narration sync; 30% quiz; 25% valid SCORM.

R10.05.01.04-T17 Make a Storyline quiz conform to WCAG 2.1 AA

Original instruction

input/compliance_quiz.story (12 slides) fails an accessibility review (input/a11y_findings.pdf): missing alt text, wrong focus order, narration without captions, color-only feedback, and a drag-and-drop with no keyboard path. Fix every finding in Storyline, add closed captions from input/narration.srt, publish to output/compliance_web/ and save output/compliance_quiz_fixed.story.

Platforms
win · Windows
Applications
Articulate Storyline 360
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
click · Point & click vis · Visual judgment geom · Precise geometry
Work product
WP08 · App/system state
Conditions
licensed · Licensed pro app long · Long-horizon
Proposed difficulty
5 / 5

Proposed verifier

axe-core on published slides: 0 violations for image-alt, color-contrast, focus-order rules; captions present and timed within 0.3 s of SRT; scripted keyboard-only run completes the quiz; feedback distinguishable without color (text/icon present). Output must be published by Storyline from the saved .story (build stamp); edits to published HTML are detected.

Proposed partial credit

25% alt text/contrast; 20% focus order; 20% captions; 35% keyboard path and non-color feedback.

R10.05.01.04-T18 Add clickable hotspots and quiz questions to a Camtasia training video

Original instruction

Camtasia (Windows or macOS). Open input/crm_tour.tscproj, add 3 hotspot interactions linking to the help pages in input/links.txt at the times shown, 4 quiz questions at chapter ends, and export with the interactive player and SCORM reporting to output/crm_tour_scorm.zip.

Platforms
win · Windows mac · macOS
Applications
Camtasia
Interfaces
desk · Desktop GUI
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G3 · GUI-only
Interaction primitives
av · Audio/video over time geom · Precise geometry click · Point & click
Work product
WP05 · Time-based media
Conditions
licensed · Licensed pro app
Proposed difficulty
4 / 5

Proposed verifier

Project file: hotspot regions over the UI elements named (IoU >= 0.5 with gold), start/end times within 0.5 s, URLs exact; quiz markers at chapter ends with correct answers; SCORM package reports quiz score in the test LMS. The package must be Camtasia's interactive-player export (generator stamp), and a .tscproj that fails to reopen in Camtasia is detected as hand-edited.

Proposed partial credit

40% hotspots; 35% quiz; 25% SCORM export.

R10.05.01.04-T19 Write the same eight questions as Moodle XML and import them (control)

Original instruction

Control pair of T08. Produce output/kinematics.xml in Moodle XML format containing the same 8 questions from input/item_specs.pdf (calculated with datasets, drag-onto-image with coordinates, cloze, drag-into-text) and import it with the Moodle CLI or a test import on a fresh sandbox.

Platforms
lin · Linux
Applications
Python · Moodle CLI
Interfaces
term · Terminal
GUI need · task setting
CL · CLI-sufficient
GUI need · ordinary access
CL · CLI-sufficient
Interaction primitives
code · Code & commands
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

Same question-table checks as T08 after import (drop zones from the gold coordinates file). Measures GUI-vs-file authoring gap.

Proposed partial credit

35% calculated; 30% drag-onto-image; 20% cloze; 15% drag-into-text.

R10.05.01.04-T20 Build an H5P question set with a randomized pool and gradebook sync

Original instruction

Moodle sandbox, course BIO101-F26. Create an H5P Question Set with 20 questions from input/pool.docx, presenting 10 randomly chosen per attempt, pass percentage 70%, retry allowed, and add it as an H5P activity whose grade syncs to the Moodle gradebook with max grade 10.

Platforms
web · Any OS (web)
Applications
H5P · Moodle
Interfaces
brow · Browser
GUI need · task setting
G2 · GUI-essential
GUI need · ordinary access
G2 · GUI-essential
Interaction primitives
click · Point & click type · Text & forms
Work product
WP08 · App/system state
Conditions
None declared
Proposed difficulty
3 / 5

Proposed verifier

content.json: 20 questions with correct answers, poolSize 10, passPercentage 70, retry enabled; Moodle grade_item for the activity with grademax 10; grader attempt produces a scaled grade in grade_grades. .h5p package upload is disabled for the role and Moodle web services are off, so the set must be authored in the H5P editor.

Proposed partial credit

45% questions; 25% pool and pass settings; 30% gradebook sync.

Mapped research references

No benchmark reference is assigned to this class in the current mapping.

In this workflow family