R11.06.01.02 · TASK CLASS

Forum & community participation

Post, reply, vote, subscribe and follow in forums and code-hosting communities, including posts built from information gathered on other sites (test accounts).

20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.

Typical applications: Reddit-style forum · GitLab · Discourse
Class GUI-need label: G2 · GUI-essential

Task proposals · 20

Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.

R11.06.01.02-T01 Adjust forum subscriptions on the Postmill replica

Original instruction

On the Postmill forum replica, logged in as test user 'quietfox', subscribe to f/books, f/scifi and f/woodworking, and unsubscribe from f/news and f/politics. Leave all other subscriptions as they are.

Platforms: web · Any OS (web)
Applications: Postmill
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click nav · Pan/zoom/scroll
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 1 / 5

Proposed verifier

Postmill DB: quietfox's forum_subscriptions equals the gold set (3 added, 2 removed, others unchanged). Postmill has no public API, the agent has no shell and DevTools are disabled, so changes must come from the forum pages (access log shows subscribe/unsubscribe POSTs with the page CSRF token).

Proposed partial credit

60% three subscriptions added; 40% two removed and nothing else changed

R11.06.01.02-T02 Like a proposal and reply quoting its second paragraph on Discourse

Original instruction

On the Discourse test forum as 'lena', open the topic 'Proposal: weekly office hours' in category Meta. Like the first post, then reply quoting exactly its second paragraph (select it and use the quote button) and add one sentence offering to host on Thursdays at 15:00 UTC. Do not reply anywhere else.

Platforms: web · Any OS (web)
Applications: Discourse
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click path · Continuous path type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 2 / 5

Proposed verifier

Discourse DB: like post_action by lena on post 1; one new post whose raw holds a [quote=...post:1...] block equal to paragraph 2 and a sentence with 'Thursday' and '15:00 UTC'; no other new posts. User API keys are disabled, the agent has no shell and DevTools are disabled, so the composer UI is the only route.

Proposed partial credit

30% like on the first post; 50% quote of exactly paragraph 2; 20% offer sentence and no other posts

R11.06.01.02-T03 Star projects, follow a user, react and subscribe on GitLab

Original instruction

On the GitLab CE test instance as 'byteblaze', star the projects 'a11yproject/a11yproject.com' and 'primer/design', follow user 'jdoe', add a thumbs-up reaction to issue #12 in 'primer/design', and turn on notifications for that issue.

Platforms: web · Any OS (web)
Applications: GitLab
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click nav · Pan/zoom/scroll
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 2 / 5

Proposed verifier

GitLab DB: users_star_projects for both projects, follow relationship to jdoe, award_emoji thumbsup by byteblaze on issue #12, subscriptions row subscribed=true. The agent holds no PAT, token creation is disabled, and with no shell and DevTools disabled the UI is the only route.

Proposed partial credit

30% both stars; 20% follow; 25% reaction; 25% issue subscription

R11.06.01.02-T04 Post a fact-check to f/nyc using figures from the wiki replica

Original instruction

In the Wikipedia replica at http://wiki.test, find the year the Brooklyn Bridge opened and its main span length in metres. Then, on the Postmill replica as 'quietfox', create a text post in f/nyc titled 'Brooklyn Bridge fact check' whose body states both facts and links the wiki article.

Platforms: web · Any OS (web)
Applications: Postmill · Kiwix Wikipedia replica
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: nav · Pan/zoom/scroll type · Text & forms multi · Cross-app
Work product: WP08 · App/system state
Conditions: multiapp · Multi-app
Proposed difficulty: 3 / 5

Proposed verifier

Postmill DB: exactly one new submission by quietfox in f/nyc with the exact title; body contains 1883, the span 486 m (486.3 accepted) and the wiki.test article URL. No Postmill API exists, the agent has no shell and DevTools are disabled, so posting must use the submit form (access log).

Proposed partial credit

25% post in f/nyc with title; 25% opening year; 25% span length; 25% article link and single post

R11.06.01.02-T05 Upvote the five newest image posts in f/gardening and reply to the oldest

Original instruction

On the Postmill replica as 'quietfox', in f/gardening sorted by new, upvote the 5 most recent submissions that are image posts (not text or link posts), then comment 'Lovely result - what variety is this?' on the oldest of those five. Do not vote on anything else.

Platforms: web · Any OS (web)
Applications: Postmill
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click vis · Visual judgment type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Postmill DB: quietfox's new votes are exactly +1 on the 5 gold submissions (extra votes subtract); one comment with the text on the correct submission. No API exists, the agent has no shell and DevTools are disabled; votes must come from the forum pages (access log).

Proposed partial credit

60% correct five upvotes (minus wrong votes); 40% comment on the right post

R11.06.01.02-T06 File a bug from a crash report using the project's GitLab issue template

Original instruction

In project 'primer/design' on the GitLab test instance, as 'byteblaze', open a new issue with the project's 'Bug' description template, filling every section from input/crash_report.txt (steps, expected, actual, version, browser). Title it '[Bug] Tooltip clipped in Safari 18', add labels 'bug' and 'browser::safari', and link it as related to issue #37.

Platforms: web · Any OS (web) mac · macOS
Applications: GitLab
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms multi · Cross-app
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

GitLab DB: issue with exact title, description keeps every template heading with section content matching the gold fields (normalized), both labels, issue_links row to #37. No PAT is issued and token creation is disabled; with no shell and DevTools disabled the issue form is the only route.

Proposed partial credit

35% template sections filled correctly; 20% title; 25% labels; 20% related link

R11.06.01.02-T07 Create a tagged meetup topic with a scheduled single-choice poll

Original instruction

On the Discourse test forum as 'lena', create a topic in category 'Events' titled 'Pick the Q4 meetup date' with tags 'meetup' and 'q4'. Use the composer's Build Poll tool to add a single-choice poll with options Oct 23, Oct 30, Nov 6 (in that order), results shown only after voting, closing 2026-10-20 18:00 UTC.

Platforms: web · Any OS (web)
Applications: Discourse
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Discourse DB: topic in Events with both tags; polls row type regular, results on_vote, close_at 2026-10-20T18:00Z, options in order. User API keys are disabled, the agent has no shell and DevTools are disabled, so the composer UI is the only route. Control pair: T20.

Proposed partial credit

25% topic in category with tags; 35% poll options; 40% poll results and close settings

R11.06.01.02-T08 Cross-post a repair-café event on Lemmy, subscribe and block a community

Original instruction

On the Lemmy test instance lemmy.test as 'harbor_ann', cross-post the post 'Free repair café this Saturday' from c/makers to c/localevents with the title prefixed '[Cross-post] ', then subscribe to c/localevents and block the community c/memes.

Platforms: web · Any OS (web)
Applications: Lemmy
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Lemmy DB: new post in localevents by harbor_ann with the prefixed title, same URL and a body referencing the original post; community_follower row for localevents; community_block row for memes. No JWT or API credentials are given, the agent has no shell and DevTools are disabled, so only the web UI can act.

Proposed partial credit

50% cross-post correct; 25% subscribed; 25% community blocked

R11.06.01.02-T09 Answer a Python date question with runnable code and retag it

Original instruction

On the Apache Answer Q&A test site as 'ravi_dev', answer 'How do I parse ISO week dates in Python?' with a fenced Python code block that parses '2026-W41-3' using datetime.strptime with ISO week directives and prints the date, plus the docs link in input/ref.txt. Upvote the question and add the tag 'datetime' to it.

Platforms: web · Any OS (web)
Applications: Apache Answer
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: type · Text & forms click · Point & click code · Code & commands
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 4 / 5

Proposed verifier

DB: answer by ravi_dev; its code block is executed in a sandbox and must print 2026-10-07; docs link present; vote row on the question; question revision by ravi_dev adding 'datetime'. No API key is issued, the agent has no shell and DevTools are disabled, so the editor UI is the only route.

Proposed partial credit

40% answer with code that runs correctly; 15% docs link; 20% upvote; 25% tag added

R11.06.01.02-T10 Reply to four book recommendations with year and shop price

Original instruction

On the Postmill replica as 'quietfox', the f/books thread 'Recommend me a 1970s sci-fi novel' has 4 top-level comments, each naming a book. Reply to each with the book's first publication year (wiki.test) and its current price on the OneStopShop replica, or 'not stocked'. Then upvote the comment whose book is cheapest.

Platforms: web · Any OS (web)
Applications: Postmill · OneStopShop · Kiwix Wikipedia replica
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: nav · Pan/zoom/scroll type · Text & forms multi · Cross-app
Work product: WP08 · App/system state
Conditions: multiapp · Multi-app
Proposed difficulty: 4 / 5

Proposed verifier

Postmill DB: 4 replies with parent = the right comment, each with the gold year and price (or 'not stocked'); one upvote on the cheapest-book comment and no other votes. No Postmill or shop API is available, the agent has no shell and DevTools are disabled.

Proposed partial credit

30% replies under the right comments; 25% years; 30% prices; 15% correct upvote

R11.06.01.02-T11 Set category, tag and topic notification levels and a timed bookmark

Original instruction

On the Discourse test forum as 'lena': set category 'Announcements' to Watching First Post, mute the tag 'off-topic', set the topic 'Release 4.2 feedback' to Tracking, and bookmark its post #7 with a reminder for 2026-10-21 09:00 in your profile time zone.

Platforms: web · Any OS (web)
Applications: Discourse
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Discourse DB: category_users level 4, tag_users level 0, topic_users level 2, bookmarks row on post 7 with reminder_at = 2026-10-21 09:00 in lena's zone. User API keys are disabled, the agent has no shell and DevTools are disabled, so only the UI can change these.

Proposed partial credit

25% category level; 25% tag muted; 25% topic tracking; 25% bookmark with reminder

R11.06.01.02-T12 Submit a GitLab merge request review with line and range comments

Original instruction

On the GitLab test instance as 'byteblaze', open MR !42 in 'infra/terraform-modules'. Start a review with the 3 inline comments in input/review_notes.md (file, new-diff line, text), add a multi-line comment spanning lines 18-24 of modules/vpc/main.tf, then submit the review with summary 'Requesting changes on CIDR handling'.

Platforms: web · Any OS (web)
Applications: GitLab
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click drag · Drag & drop type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 4 / 5

Proposed verifier

GitLab DB: diff notes whose position (path, new_line) and text match the 3 notes; one note with line_range 18-24 on main.tf; all in one submitted review with the summary note. No PAT, token creation disabled, no shell and DevTools disabled, so the diff UI is the only route.

Proposed partial credit

45% three inline comments on exact lines; 25% multi-line range; 30% submitted as one review with summary

R11.06.01.02-T13 Publish a weekly digest table of top posts from three city forums

Original instruction

As 'quietfox' on the Postmill replica, create a post in f/localnews titled 'Week 41 digest' with a Markdown table of the 5 highest-scoring submissions from the 7 days before the date in task.txt across f/nyc, f/boston and f/philadelphia. Columns: Forum, Title, Score, Link; sort by score, ties by more comments.

Platforms: web · Any OS (web)
Applications: Postmill
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: nav · Pan/zoom/scroll type · Text & forms click · Point & click
Work product: WP08 · App/system state
Conditions: long · Long-horizon
Proposed difficulty: 5 / 5

Proposed verifier

Grader parses the new submission body: 5 table rows equal gold (forum, title, score at the frozen snapshot, link resolving to the submission) in order; rendered HTML contains a table. No Postmill API exists, the agent has no shell and DevTools are disabled, so listings must be read and the post made in the UI.

Proposed partial credit

20% post in f/localnews with title; 50% correct five rows in order; 30% columns, links and table renders

R11.06.01.02-T14 Vote, save and comment from the top-week feed in an Android Lemmy client

Original instruction

On the Android emulator, Jerboa is logged in to lemmy.test as 'harbor_ann'. In c/cycling switch the sort to Top Week, upvote the top 3 posts, save the first one, and comment on the second: 'Which tyre width are you running?'

Platforms: and · Android
Applications: Jerboa · Lemmy
Interfaces: mob · Mobile touch
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G3 · GUI-only
Interaction primitives: touch · Touch gestures nav · Pan/zoom/scroll type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 4 / 5

Proposed verifier

Lemmy DB: post_like +1 by harbor_ann on exactly the 3 gold posts (Top Week at the frozen snapshot), post_saved on the first, comment with the text on the second. The account JWT stays inside Jerboa; the agent has no adb shell or browser login, so only the app UI can act.

Proposed partial credit

45% correct three upvotes; 20% save; 35% comment on the right post

R11.06.01.02-T15 Correct your own post with an edit reason, add an image and mark a solution

Original instruction

On the Discourse test forum as 'lena', in your Support topic 'NAS keeps dropping SMB shares': edit your post #3 to change firmware 4.1.2 to 4.1.3 with edit reason 'firmware typo', append input/smb_settings.png with alt text 'SMB settings page', and mark reply #5 by 'kmorales' as the solution.

Platforms: web · Any OS (web) win · Windows
Applications: Discourse
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: type · Text & forms click · Point & click
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Discourse DB: post 3 revision with edit_reason 'firmware typo', raw has 4.1.3 and not 4.1.2, an upload reference with alt 'SMB settings page'; solved accepted answer = post 5. User API keys disabled, no shell and DevTools disabled, so the composer and topic UI are the only route.

Proposed partial credit

30% correction with reason; 35% image uploaded with alt text; 35% solution marked

R11.06.01.02-T16 Announce a shop only where the forum's self-promotion rules allow

Original instruction

As 'quietfox' on the Postmill replica, the user wants the shop announcement in input/announce.txt posted in f/woodworking. Read the forum's sidebar rules first and post it only where they allow, adapting the text if a rule limits links or wording, and tell the user in note.txt where you posted and what you changed.

Platforms: web · Any OS (web)
Applications: Postmill
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: nav · Pan/zoom/scroll type · Text & forms
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 4 / 5

Proposed verifier

Gold rules allow self-promotion only as a comment in the pinned 'Weekly Show & Sell' thread with one link. Postmill DB: no new submission in f/woodworking, one comment there by quietfox with <=1 link and the shop name; note.txt names the thread. No API, shell or DevTools, so only the UI can post.

Proposed partial credit

40% no rule-breaking submission; 40% comment in the allowed thread; 20% link limit kept and note written

R11.06.01.02-T17 Reply with a measurement list and inline photo, then watch the phpBB topic

Original instruction

On the phpBB 3.3 test board as 'rivet', reply in 'Post your homelab power draw' with a BBCode [list] of 'device: watts' items from input/power.csv (6 rows, file order), attach input/rack.jpg placed inline after the list, and subscribe to the topic so you are notified of replies.

Platforms: web · Any OS (web) win · Windows
Applications: phpBB
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: type · Text & forms click · Point & click
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

phpbb_posts: new post by rivet with a list of the 6 items matching the CSV; attachment row for rack.jpg with an inline [attachment] tag after the list; topics_watch row for rivet. phpBB has no write API, the agent has no shell and DevTools are disabled, so the posting form is the only route.

Proposed partial credit

40% list content; 30% inline attachment placement; 30% topic subscription

R11.06.01.02-T18 Reproduce ten reported UI bugs and record verdicts on GitLab issues

Original instruction

In 'primer/design' on the GitLab test instance, 10 issues carry label 'needs-repro'. As 'byteblaze', follow each issue's steps in the demo app at http://primer.test. If it reproduces: thumbs-up the issue, comment 'Reproduced on <version from the app footer>' and add label 'confirmed'. If not: comment 'Could not reproduce on <version>' and leave labels.

Platforms: web · Any OS (web)
Applications: GitLab · Primer demo app
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: click · Point & click vis · Visual judgment multi · Cross-app
Work product: WP08 · App/system state
Conditions: multiapp · Multi-app long · Long-horizon
Proposed difficulty: 5 / 5

Proposed verifier

Seeded bugs make 6 of 10 reproducible. GitLab DB per issue: verdict comment with the right version, label and award only on reproducible ones. No PAT, token creation disabled, no shell and DevTools disabled, so both apps must be used through the UI.

Proposed partial credit

50% correct verdicts (pro-rata); 30% comments with correct version; 20% labels and reactions consistent

R11.06.01.02-T19 Summarize a merge request discussion as a Discourse topic and link back

Original instruction

Read the discussion on MR !88 in 'infra/terraform-modules' (GitLab test instance). As 'lena' on the Discourse test forum, create a topic in 'Infra' titled 'Summary: VPC module v3 decisions' with a bullet list of the 4 decisions, a checklist of open questions each @mentioning its owner, and a link to the MR. Then comment on the MR (as 'byteblaze') with the topic's URL.

Platforms: web · Any OS (web)
Applications: Discourse · GitLab
Interfaces: brow · Browser
GUI need · task setting: G2 · GUI-essential
GUI need · ordinary access: G2 · GUI-essential
Interaction primitives: nav · Pan/zoom/scroll type · Text & forms multi · Cross-app
Work product: WP08 · App/system state
Conditions: multiapp · Multi-app
Proposed difficulty: 5 / 5

Proposed verifier

Discourse DB: topic raw parsed; decision bullets matched to the 4 gold decisions by an LLM rubric (only rubric part); checklist items with @mentions equal gold owners; MR link present. GitLab DB: note on !88 with the topic URL. No API keys or PATs, no shell and DevTools disabled.

Proposed partial credit

35% decisions captured; 25% open questions with correct owners; 20% topic links to MR; 20% MR comment with topic URL

R11.06.01.02-T20 Control pair of T07: create the poll topic through the Discourse API

Original instruction

Control pair of T07. Using the user API key in ~/.config/discourse_key and curl or Python, create the same topic as T07 in category 'Events' (tags meetup, q4) with a single-choice poll Oct 23 / Oct 30 / Nov 6, results on vote, closing 2026-10-20 18:00 UTC, via POST /posts.json with poll markup.

Platforms: lin · Linux
Applications: Discourse API · curl
Interfaces: term · Terminal api · API/SDK
GUI need · task setting: AP · API-sufficient
GUI need · ordinary access: AP · API-sufficient
Interaction primitives: code · Code & commands
Work product: WP08 · App/system state
Conditions: None declared
Proposed difficulty: 3 / 5

Proposed verifier

Same DB checks as T07 (category, tags, poll type, option order, results on_vote, close_at). Grader confirms creation via the API key in the Discourse request log; API-side control for the GUI task T07.

Proposed partial credit

25% topic in category with tags; 35% poll options; 40% poll results and close settings

Mapped research references

Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.

WebArena

In this workflow family

R11.06.01.01 Content moderation & community administration