LMS course building & configuration
Build modules, assignments, quizzes and release rules.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
Previous class address: R10.05.01.01 · Original proposal IDs are retained.
- Typical applications
- Moodle · Canvas · Blackboard
- Class GUI-need label
G2· GUI-essential
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R10.05.01.01-T01 Create a Moodle course shell with named sections and completion tracking
Original instruction
Moodle 4.x sandbox, manager role. Create course 'BIO101 Introductory Biology' (short name BIO101-F26) in category Science with start 2026-09-07, end 2026-12-18, Topics format with 3 sections named 'Cells', 'Genetics', 'Evolution', completion tracking enabled, and the course visible to students.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Moodle DB: course row with names, category, dates, format and enablecompletion=1; course_sections names exact for sections 1-3; visible=1. Web services are disabled for the role and the agent has no server shell for admin/cli scripts; logstore_standard_log events for the course must have origin 'web' (no ws/cli).
Proposed partial credit
40% course settings; 30% section names; 15% completion; 15% visibility.
R10.05.01.01-T02 Add a bank-drawn quiz gated behind completion of the first section
Original instruction
Moodle sandbox, course BIO101-F26. In section 'Genetics' add quiz 'Genetics Check' with the 5 questions from bank category 'Genetics/Week3', 20-minute time limit, 2 attempts (highest grade), review options showing correct answers only after the quiz closes, and an access restriction requiring completion of every activity in section 'Cells'.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
quiz row: timelimit 1200, attempts 2, grademethod highest, review bitmasks per spec; quiz_slots reference the 5 bank questions; course_modules.availability JSON requires completion of each 'Cells' activity. Web services are disabled for the role and the agent has no server shell; only web-origin log events are accepted.
Proposed partial credit
25% quiz settings; 25% question slots; 20% review options; 30% availability restriction.
R10.05.01.01-T03 Build sequential Canvas modules with prerequisites and requirements
Original instruction
Canvas LMS sandbox, course 'HIST 210 (sandbox)'. Create modules Week 1-4. Add the pages, assignments and quizzes listed in input/module_plan.xlsx, set completion requirements (view page, submit assignment, score >= 70 on quiz), require sequential progress in each module, and make each week's module a prerequisite for the next. Publish all modules.
- Platforms
web· Any OS (web)- Applications
- Canvas LMS
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & droptype· Text & forms- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Grader-side Canvas API export: 4 modules with items in the planned order; completion requirements and min score exact; require_sequential_progress true; prerequisite chain correct; published. The agent account has no API token; page views logs show UI edits.
Proposed partial credit
30% items and order; 30% requirements; 25% prerequisites and sequence; 15% published.
R10.05.01.01-T04 Copy last term's course and shift every date by eighteen weeks
Original instruction
Moodle sandbox: import all content from course CHEM110-S26 into the empty CHEM110-F26, shifting dates by 126 days via the import/restore date options. Then fix the 3 assignment due dates that now fall on the campus holidays in input/holidays_f26.txt (move to the next weekday at the same time), and set the new course start/end dates.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrolltype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
All date fields (assign duedate/allowsubmissionsfromdate/cutoffdate, quiz open/close, availability date conditions) equal source + 126 days, except the 3 holiday items moved to gold dates; course dates exact; content count equals source. Web services are disabled for the role and the agent has no server shell; logstore events must have origin 'web'.
Proposed partial credit
35% content imported; 35% date shift across modules; 20% holiday fixes; 10% course dates.
R10.05.01.01-T05 Set up an anonymous peer-reviewed group assignment in Canvas
Original instruction
Canvas sandbox, course 'ENGL 101 (sandbox)'. Create a group set 'Essay Teams' with students auto-assigned 4 per group, then a group assignment 'Team Argument Essay' using that set (graded individually), with the rubric in input/rubric.csv attached and used for grading, 2 anonymous peer reviews per student assigned automatically on the due date, and online text/file submission.
- Platforms
web· Any OS (web)- Applications
- Canvas LMS
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
API export: group set with groups of size <= 4 covering all students; assignment with group_category, grade_group_students_individually true, rubric association with use_for_grading, peer_reviews with count 2, anonymous, automatic; submission types exact. Personal access token creation is disabled for the agent's role, so Canvas API calls are blocked and setup must be done in the web UI.
Proposed partial credit
25% group set; 25% group assignment settings; 25% rubric; 25% peer review settings.
R10.05.01.01-T06 Build a complete twelve-week course from a syllabus
Original instruction
Moodle sandbox, empty course PSYC200-F26. From input/syllabus.pdf build 12 weekly sections with titles and summaries, each week's readings (URL/page), discussion forum, assignment and quiz as listed (quiz questions from input/questions.gift via the question bank import), completion conditions, weekly date-based restrictions, and the late-submission cutoff rules from the syllabus policy section.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scrolldrag· Drag & drop- Work product
WP08· App/system state- Conditions
long· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Course backup (.mbz) parsed vs gold structure: 12 sections, activity set per week (F1 >= 0.95 on type+name), dates and cutoffs exact, completion settings and availability JSON per week; question bank has all GIFT questions. Web services are disabled for the role and the agent has no server shell; web-origin logs required.
Proposed partial credit
25% sections; 30% activities per week; 25% dates, cutoffs and restrictions; 20% completion and quizzes.
R10.05.01.01-T07 Add a content folder with timed release in Blackboard Ultra
Original instruction
Blackboard Learn Ultra sandbox, course 'ACCT 201 (sandbox)'. Create folder 'Week 5 Materials' containing the 3 files in input/week5/, set the folder to be released to students on 2026-10-05 08:00 via a date/time release condition, and keep it hidden from the student preview until then.
- Platforms
web· Any OS (web)- Applications
- Blackboard Learn Ultra
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & droptype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Grader REST read: folder exists with 3 file items (hash match); adaptive release rule with exact datetime; visibility conditional. Blackboard REST application keys are withheld from the agent, so the folder and release rule must be created in the Ultra UI from the browser session.
Proposed partial credit
40% folder and files; 60% release condition.
R10.05.01.01-T08 Create groups and groupings and a separate-groups forum in Moodle
Original instruction
Moodle sandbox, course BIO101-F26 (60 enrolled students). Using input/lab_sections.csv, create 4 groups (Lab A-D) with their members through the Groups page, a grouping 'Labs' containing them, and a forum 'Lab Discussion' in Separate groups mode restricted to grouping 'Labs'.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
groups/groups_members equal CSV (60 memberships); groupings_groups correct; forum course_module groupmode=1 and groupingid set. Group CSV import tool disabled; memberships must be added via the UI (web-origin logs).
Proposed partial credit
45% group memberships; 20% grouping; 35% forum mode and grouping.
R10.05.01.01-T09 Configure score-based conditional release paths after a Canvas quiz
Original instruction
Canvas sandbox with Mastery Paths enabled, course 'MATH 105 (sandbox)'. For quiz 'Unit 2 Diagnostic', set three scoring ranges: below 60% unlocks module item set 'Review Fractions', 60-80% unlocks 'Standard Practice', above 80% unlocks 'Enrichment'. Ensure items in those sets are hidden until released and verify with the student-view test accounts in input/test_students.csv.
- Platforms
web· Any OS (web)- Applications
- Canvas LMS
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & droptype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Conditional release rules export: 3 ranges with exact bounds and item sets; grader submits quiz attempts for 3 test students at 50/70/90% and checks each sees only the right set. Personal access token creation is disabled for the agent's role, so Canvas API calls are blocked and rules must be set in the web UI.
Proposed partial credit
40% ranges and assignments; 20% items hidden; 40% verified unlock behavior.
R10.05.01.01-T10 Set up a Google Classroom class with topics, rubrics and scheduled work
Original instruction
Google Classroom (sandbox Workspace for Education domain). Create class 'Grade 8 Science - P3', topics Units 1-3, and three assignments from input/assignments.xlsx with points, due dates, topic, the rubric in input/rubric_lab.csv on the lab report, and each scheduled to post at 07:30 on its start date.
- Platforms
web· Any OS (web)- Applications
- Google Classroom
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Grader Classroom API read: class and topics exist; 3 coursework items with points, due dates, topic and scheduledTime exact; rubric criteria/levels match CSV on the lab report. Agent account has no API OAuth grant.
Proposed partial credit
20% class and topics; 45% assignments; 20% scheduling; 15% rubric.
R10.05.01.01-T11 Build a randomized Moodle quiz with student accommodations
Original instruction
Moodle sandbox, course PSYC200-F26. Create quiz 'Midterm' with 30 random questions (10 each from categories Memory, Learning, Perception), shuffled answers, deferred feedback, open 2026-10-20 09:00-21:00, 60-minute limit. Add user overrides: student s1042 gets 90 minutes, student s1077 gets 2 attempts and a 2026-10-21 close.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
quiz settings exact; quiz_slots contain 30 random-question references with the right category filters; shuffleanswers=1; preferredbehaviour deferredfeedback; quiz_overrides rows for the 2 users exact. Web services are disabled for the role and the agent has no server shell; web-origin logs only.
Proposed partial credit
25% timing and window; 35% random slots by category; 10% behaviour; 30% overrides.
R10.05.01.01-T12 Author a graded Open edX unit sequence with cohort-specific content
Original instruction
Open edX Studio (sandbox). In course 'DataSci 101', build Section 3 with 2 subsections and 6 units per input/outline.xlsx: HTML content, a multiple-choice problem, a numerical-input problem with 2% tolerance, and a video with transcript. Set the grading policy (Homework 40%, Exam 60%), subsection graded types and due dates, and make one unit visible only to content group 'Track B'.
- Platforms
web· Any OS (web)- Applications
- Open edX Studio
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsdrag· Drag & drop- Work product
WP08· App/system state- Conditions
long· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Course export (OLX tarball) parsed: structure and order exact; problem XML correct answers and tolerance; grading policy weights; subsection formats and due dates; group_access on the Track B unit. Studio REST import disabled for the agent.
Proposed partial credit
30% structure; 25% problems; 25% grading policy and due dates; 20% content group restriction.
R10.05.01.01-T13 Set release conditions on Brightspace content topics
Original instruction
D2L Brightspace sandbox, course 'NURS 310 (sandbox)'. On the topic 'Case Study 2' create release conditions: visible only after the learner completes quiz 'Pharm Basics' with any attempt AND the date is between 2026-10-12 and 2026-11-30. Make the 'Answer Key' topic release only to the section 'Instructors-Preview'.
- Platforms
web· Any OS (web)- Applications
- Brightspace
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Grader Valence read: Case Study 2 conditions (quiz completion + date range) with AND logic; Answer Key restricted to the section; grader test-learner visibility checks pass. Valence API app keys are withheld from the agent, so release conditions must be set in the Brightspace UI from the browser session.
Proposed partial credit
50% Case Study 2 conditions; 20% AND logic; 30% Answer Key restriction.
R10.05.01.01-T14 Enrol teaching assistants and open the course to students
Original instruction
Moodle sandbox, course BIO101-F26. Enrol the 3 TAs in input/tas.txt with the Non-editing teacher role via manual enrolments, add them to all lab groups, and make the course visible.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
user_enrolments + role_assignments: 3 users with teacher (non-editing) role in the course context; group memberships in every lab group; course visible=1. Web services are disabled for the role and the agent has no server shell; logstore events must have origin 'web'.
Proposed partial credit
50% enrolments with role; 30% groups; 20% visibility.
R10.05.01.01-T15 Update and sync a Canvas Blueprint course to three sections
Original instruction
Canvas sandbox, Blueprint course 'COMP 101 Blueprint' with 3 associated section courses. Lock content and due dates on all assignments and quizzes, replace the syllabus page with input/syllabus_v2.html, add the new assignment from input/new_assignment.json, and sync to associated courses including course settings. Section 03 has a local announcement that must survive.
- Platforms
web· Any OS (web)- Applications
- Canvas LMS
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Blueprint restrictions on all assignment/quiz items (content, due_dates); each associated course has the updated syllabus and the new assignment; Section 03's local announcement still present; one sync migration in the history. Personal access token creation is disabled for the agent's role, so Canvas API calls are blocked and changes must come from the web UI.
Proposed partial credit
25% locks; 25% blueprint content updated; 35% synced to 3 courses; 15% local content preserved.
R10.05.01.01-T16 Fix accessibility problems in five Moodle pages and a lecture video
Original instruction
Moodle sandbox, course HIST110-F26. The accessibility report lists issues in 5 Page resources: images without alt text, skipped heading levels, a table without header cells, and low-contrast colored text. Fix them in the editor, and add captions input/lecture3.vtt to the Lecture 3 video in its media settings.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Page HTML parsed: all img have non-empty alt (decorative ones alt="" with role per gold); heading order without skips; table has th scope; contrast >= 4.5:1 for text; video track element with the VTT. axe-core run on rendered pages: 0 violations of those rules. Web services are disabled and the agent has no server shell; edits must log origin 'web'.
Proposed partial credit
30% alt text; 20% headings; 30% table headers and contrast; 20% captions.
R10.05.01.01-T17 Migrate a Blackboard course export into Canvas and repair what breaks
Original instruction
Import input/bb_export_ECON200.zip into the empty Canvas sandbox course 'ECON 200 (sandbox)' with the course import tool. Then repair migration damage: re-link 14 links pointing to the old Blackboard host, rebuild the 2 rubrics that failed to import from input/rubrics.pdf, set all due dates for Fall 2026 from input/schedule.xlsx, and get the Course Link Validator to report 0 broken links.
- Platforms
web· Any OS (web)- Applications
- Canvas LMS · Excel
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrolltype· Text & formsmulti· Cross-app- Work product
WP08· App/system state- Conditions
long· Long-horizonmultiapp· Multi-app- Proposed difficulty
- 5 / 5
Proposed verifier
Content counts equal source manifest; 0 links to the old host; link validator result 0 broken; 2 rubrics with criteria/points exact and associated; due dates equal schedule for 24 items. Personal access token creation is disabled for the agent's role, so Canvas API calls are blocked and repairs must be made in the web UI.
Proposed partial credit
20% import; 35% links fixed and validator clean; 20% rubrics; 25% due dates.
R10.05.01.01-T18 Reorder forty activities across sections to match a revised syllabus
Original instruction
Moodle sandbox, course CHEM110-F26 (12 sections, 40 activities). input/new_order.xlsx gives the revised section and position for each activity, including 3 activities moving to new sections and 2 sections swapping places. Use drag and drop or the move tool to reorganize the course; do not delete or recreate activities.
- Platforms
web· Any OS (web)- Applications
- Moodle
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropnav· Pan/zoom/scrollclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
course_sections.sequence equals gold order for every section; course_modules ids unchanged (no delete/recreate); section names in swapped positions correct. Web services are disabled for the role and the agent has no server shell; logstore move events must have origin 'web'.
Proposed partial credit
60% activity order; 20% sections swapped; 20% no recreated modules.
R10.05.01.01-T19 Create the same course shell with the Moodle shell CLI (control)
Original instruction
Control pair of T01. On the Moodle server shell, use moosh or the admin CLI scripts to create course BIO101-F26 with the same category, dates, format, 3 named sections, completion tracking and visibility.
- Platforms
lin· Linux- Applications
- moosh · Moodle CLI
- Interfaces
term· Terminal- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same DB checks as T01; log origin 'cli' expected. Measures GUI-vs-CLI gap.
Proposed partial credit
40% course settings; 30% section names; 15% completion; 15% visibility.
R10.05.01.01-T20 Configure Canvas course navigation, home page and syllabus
Original instruction
Canvas sandbox, course 'BIOL 150 (sandbox)'. Hide People, Pages and Outcomes from student navigation and reorder it to Home, Syllabus, Modules, Assignments, Grades. Set the home page to the wiki page 'Start Here' (create it from input/start_here.html), add the course card image input/banner.jpg, and put the syllabus text from input/syllabus.docx in the Syllabus tool with the course summary shown.
- Platforms
web· Any OS (web)- Applications
- Canvas LMS · Word
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
multiapp· Multi-app- Proposed difficulty
- 3 / 5
Proposed verifier
Tabs export: hidden flags and order exact; default_view 'wiki' with front page 'Start Here' (HTML content match); course image set; syllabus_body contains the document text (token F1 >= 0.95) and syllabus course summary on. Personal access token creation is disabled for the agent's role, so Canvas API calls are blocked and setup must be done in the web UI.
Proposed partial credit
35% navigation; 25% home page; 10% image; 30% syllabus.
Mapped research references
Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.