Team chat operations
Create channels, threads, pins, reminders and permissions to a spec.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- Slack · Teams · Feishu · Rocket.Chat
- Class GUI-need label
G2· GUI-essential
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R11.02.01.01-T01 Create a private release channel, invite two people and pin the freeze date
Original instruction
In Rocket.Chat (test server, logged in as release.mgr), create private channel #release-q3 with topic 'Q3 release coordination', invite alice and bob, post the message from freeze_note.txt, and pin the message in #general that contains 'freeze date'.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Rocket.Chat
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Verifier REST (admin token, not given to agent): room type p named release-q3 with topic; members exactly release.mgr, alice, bob; note message present; the 'freeze date' message in #general has pinned=true. Agent's personal access tokens disabled.
Proposed partial credit
30% channel and topic; 30% members; 15% note posted; 25% correct pin
R11.02.01.01-T02 Set up a project channel with topic, bookmarks and members
Original instruction
In Slack (sandbox workspace), create public channel #proj-atlas with description and topic from atlas_brief.md, add the 9 members listed there, add bookmarks 'Spec' and 'Board' to the given URLs, and post a kickoff message mentioning @atlas-core that links the spec.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Slack
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin export via verifier token: channel purpose/topic exact, members equal list, 2 bookmarks with exact titles/links, kickoff message contains user-group mention and spec URL. Compared with control pair T17. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
25% channel and topic; 30% members; 25% bookmarks; 20% kickoff message
R11.02.01.01-T03 Schedule recurring and personal reminders in Slack
Original instruction
In Slack, set a channel reminder in #team-ops 'Standup in 5 min' every weekday at 09:25 workspace time, and a personal reminder 'Submit expenses' on the last weekday of each month at 16:00. Also snooze notifications for 1 hour now.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Slack
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
reminders.list (verifier token for the agent's user): channel reminder recurrence weekdays 09:25 targeting #team-ops; personal monthly last-weekday 16:00; dnd.info shows snooze ending 60±2 min after task time. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
45% channel reminder; 35% personal reminder; 20% snooze
R11.02.01.01-T04 Create a Teams team with private channel, tabs and moderated announcements
Original instruction
In Microsoft Teams (test tenant), create team 'Field Ops' with channels General, Announcements, Dispatch (standard) and Leads (private, owners: you and kim@). Add a Planner tab 'Jobs' to Dispatch and a OneNote tab to Leads. Turn on channel moderation for Announcements so only owners post.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Microsoft Teams
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Graph read: team and channels with membershipType; Leads members/owners; tabs with teamsApp ids Planner/OneNote and display names; Announcements moderationSettings: userNewMessageRestriction moderators. No Graph credentials, app registration or Teams PowerShell module are issued to the agent, so changes must come from Teams client sessions.
Proposed partial credit
25% team and channels; 20% private channel membership; 30% tabs; 25% moderation
R11.02.01.01-T05 Answer channel questions in threads from an FAQ and mark them resolved
Original instruction
In Slack #help-desk, five unanswered questions were posted today. Reply to each in its thread using the matching answer from faq.md, add a :white_check_mark: reaction to each question, and for the VPN question also send the reply to the channel.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Slack
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & clickhover· Hover & context- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
conversations.replies per question: one reply from agent with text containing the gold FAQ answer key phrase; reactions include white_check_mark; VPN reply has subtype thread_broadcast. No top-level replies otherwise. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
50% correct thread answers; 25% reactions; 15% broadcast; 10% no stray posts
R11.02.01.01-T06 Configure a Feishu group with admins, announcement and @all limits
Original instruction
In Feishu/Lark (test tenant), create group '华东销售周会' with the 12 members from roster.xlsx, set two group admins, post the group announcement from announce.md, pin it, and restrict '@所有人' and group-info edits to owner and admins only.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Feishu
- Interfaces
desk· Desktop GUIbrow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Open-platform read with verifier app token: chat members equal roster; manager list has the 2 admins; announcement content matches; pinned message present; chat settings at_all_permission and edit_permission = only_owner(+admins). No Feishu open-platform app credentials are issued to the agent and app creation is disabled in the test tenant, so setup must be done in the Feishu client.
Proposed partial credit
25% members; 20% admins; 25% announcement pinned; 30% permissions
R11.02.01.01-T07 Lock an announcements channel and set default channels
Original instruction
As Slack workspace admin (sandbox), restrict posting in #announcements to workspace admins and owners, allow threaded replies from everyone, and make #announcements, #general-help and #random default channels for new members.
- Platforms
web· Any OS (web)- Applications
- Slack
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin API read: channel posting prefs restricted to admins with threads allowed; team default channels equal the three. A test member's post attempt via verifier fails while thread reply succeeds. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
45% posting restriction; 15% threads allowed; 40% default channels
R11.02.01.01-T08 Schedule an important Teams channel post with a team mention
Original instruction
In Microsoft Teams, in team 'Field Ops' channel Announcements, compose a post with subject 'Holiday rota', body from rota.md, marked Important, mentioning @Field Ops, and schedule it to send on 2026-10-19 09:00 local time.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Microsoft Teams
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
After clock advance in the test tenant: channel message posted at 09:00±1 min with subject, importance high, mention of the team entity, body text match; no message before the time. No Graph credentials, app registration or Teams PowerShell module are issued to the agent, so changes must come from Teams client sessions.
Proposed partial credit
25% content and subject; 20% importance; 20% team mention; 35% scheduled timing
R11.02.01.01-T09 Archive stale channels except a keep-list
Original instruction
In Mattermost (test server, system admin), archive every public channel in team 'eng' with no posts in the last 90 days, except those in keep.txt. Post 'Archiving: no activity in 90 days' in each before archiving. Save the archived names to archived.txt.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Mattermost
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrolltype· Text & forms- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
Server DB: exactly the 6 gold stale channels have DeleteAt>0 with the notice as last post; keep-list and active channels unarchived; archived.txt equals the set. Personal access tokens and mmctl are disabled on the test server and the agent has no terminal or DB access, so archiving must be done in the Mattermost client.
Proposed partial credit
50% correct archives; 25% no wrong archives; 15% notice posts; 10% list file
R11.02.01.01-T10 Build a channel canvas checklist for onboarding
Original instruction
In Slack, add a channel canvas to #new-hires titled 'Week 1 checklist' containing the 10 items from week1.md as a checklist, with section headers Day 1 / Day 2–3 / Day 4–5, links on 3 items, and the canvas tab pinned to the channel header.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Slack
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
type· Text & formsclick· Point & click- Work product
WP01· Document- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Canvas content export: title, three headers in order, 10 checklist items with exact text under correct headers, 3 hyperlinks with gold URLs; canvas is the channel canvas of #new-hires. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
15% canvas attached; 25% headers; 40% checklist items; 20% links
R11.02.01.01-T11 Create an on-call user group with default channels
Original instruction
In Slack create user group @oncall-web (handle exactly that) named 'Web On-call' with the 4 engineers in rota.csv for this week, default channels #incidents and #web-alerts, then add the group to both channels and post '@oncall-web is live' in #incidents.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Slack
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
usergroups.list: handle, name, users equal 4, prefs.channels both; channel member lists include all 4; post contains <!subteam^ID> mention. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
35% group and members; 25% default channels; 20% channel membership; 20% post
R11.02.01.01-T12 Define a custom moderator role in Rocket.Chat and assign it
Original instruction
In Rocket.Chat Administration, create role 'Moderator-lite' (scope Rooms) with permissions: delete-message, pin-message, mute-user, view-room-administration; nothing else. Assign it to carol and dave in #support only, and remove the global 'moderator' role from dave.
- Platforms
web· Any OS (web)- Applications
- Rocket.Chat
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Verifier REST: role exists with scope Subscriptions; permissions collection grants exactly the 4 permissions to it; room roles for #support include carol and dave; dave lacks global moderator. Personal access tokens are disabled for the agent and it has no terminal or MongoDB access, so the role must be set up in Rocket.Chat Administration.
Proposed partial credit
25% role; 35% exact permissions; 25% scoped assignment; 15% dave demoted
R11.02.01.01-T13 Create a shared channel with an external org and tag groups
Original instruction
In Teams (test tenant A), create shared channel 'Vendor-Bridge' in team 'Procurement', share it with team 'Supply' in partner tenant B (trust preconfigured), add external user li@partner.test, and create tags @frontend (3 members) and @buyers (2 members) usable in the channel.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Microsoft Teams
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Graph read tenant A: channel membershipType shared; sharedWithTeams includes tenant B team; member li@ present; teamwork tags with exact members. Tenant B sees channel. No Graph credentials, app registration or Teams PowerShell module are issued to the agent, so changes must come from Teams client sessions.
Proposed partial credit
30% shared channel; 25% shared with team; 15% external member; 30% tags
R11.02.01.01-T14 Set up a Feishu topic group with rules and keyword replies
Original instruction
In Feishu, create a topic-style group '产品反馈' with members from feedback_team.txt, post 3 starter topics from topics.md, set group rules text, and configure the group's custom bot so the keyword '报修' auto-replies with the repair form link from links.txt.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Feishu
- Interfaces
desk· Desktop GUIbrow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Verifier app read: chat_mode topic; members; 3 topic threads with titles; group rules setting; bot keyword reply config; test message '报修' from verifier user receives reply with link within 10 s. No Feishu open-platform app credentials are issued to the agent and app creation is disabled in the test tenant; the keyword bot must be set up in the client.
Proposed partial credit
20% topic group and members; 25% topics; 15% rules; 40% keyword bot works
R11.02.01.01-T15 Curate pins and bookmarks in an onboarding channel
Original instruction
In Slack #onboarding, pin the 5 messages listed (by author and first words) in curate.md, unpin the 3 outdated pins named there, and add 4 bookmarks with the exact titles and URLs given. Do not delete any messages.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Slack
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrollhover· Hover & context- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
pins.list equals gold set of 5 plus untouched pins; 3 outdated unpinned; bookmarks.list has 4 exact entries; message count unchanged. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
40% pins; 20% unpins; 30% bookmarks; 10% nothing deleted
R11.02.01.01-T16 Sync a team's roster from HR data: add, promote and remove
Original instruction
In the Microsoft 365 test tenant's Teams team 'Clinic Staff' (synthetic users), apply roster_oct.csv: add 25 new members, make 3 of them owners, and remove the 2 leavers listed. Leavers' private channel memberships must also be removed. Post a welcome message mentioning the new members' tag @new-oct (create it).
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Microsoft Teams
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsnav· Pan/zoom/scroll- Work product
WP08· App/system state- Conditions
risk· Irreversible/riskylong· Long-horizon- Proposed difficulty
- 4 / 5
Proposed verifier
Graph: team members equal expected set; roles owner for the 3; leavers absent from team and private channels; tag @new-oct with the 25; welcome post mentions the tag. No Graph credentials, app registration or Teams PowerShell module are issued to the agent, so changes must come from Teams client sessions.
Proposed partial credit
35% members added; 15% owners; 25% leavers removed everywhere; 25% tag and post
R11.02.01.01-T17 Set up #proj-atlas via the Slack Web API (control pair of T02)
Original instruction
Control pair of T02. Using the provided bot and user tokens, write setup_atlas.py that creates #proj-atlas with the same purpose, topic, 9 members, 2 bookmarks and kickoff message.
- Platforms
mac· macOSwin· Windowslin· Linux- Applications
- Slack Web API
- Interfaces
api· API/SDK- GUI need · task setting
AP· API-sufficient- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
code· Code & commands- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Same checks as T02; audit logs show calls from the script tokens.
Proposed partial credit
25% channel; 30% members; 25% bookmarks; 20% kickoff
R11.02.01.01-T18 Build an access-request workflow in Slack Workflow Builder
Original instruction
In Slack Workflow Builder create 'Request access' started from a link/shortcut in #it-help: a form (system dropdown with 5 options, justification text, urgency radio), then post a formatted request to private channel #it-access-queue with requester mention, and DM the requester a confirmation. Publish and run it once as a test.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Slack Workflow Builder
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 5 / 5
Proposed verifier
Workflow export JSON: trigger type, form fields and options exact, steps order. Test run: message in #it-access-queue contains all form values and requester mention; DM confirmation delivered. The agent gets no Slack token and the Slack CLI and app installs are disabled in the sandbox, so the workflow must be built in Workflow Builder.
Proposed partial credit
35% form fields; 25% post step; 15% DM step; 25% published and test run
R11.02.01.01-T19 Move files into a new private channel and pin a Files tab
Original instruction
In the Microsoft 365 test tenant's Teams team 'Finance', create private channel 'Payroll' (members: you, ana@, ben@), move folder General/Files/Payroll2026 into the new channel's Files (SharePoint), and add a tab to the 'Payroll2026' folder. Leave a forwarding note file in the old location.
- Platforms
web· Any OS (web)mac· macOSwin· Windows- Applications
- Microsoft Teams · SharePoint
- Interfaces
brow· Browserdesk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & dropmulti· Cross-app- Work product
WP09· Files & folders- Conditions
multiapp· Multi-apprisk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Graph: private channel and members; channel drive contains Payroll2026 with all 18 files (hashes equal); original folder gone except note file; channel tab points to the folder. No Graph credentials, PnP/SharePoint PowerShell or OneDrive sync client are issued to the agent; moves must be made in Teams or SharePoint app/browser sessions.
Proposed partial credit
25% channel; 45% files moved intact; 15% note file; 15% tab
R11.02.01.01-T20 Stand up a new team's Slack workspace to a governance spec
Original instruction
Per slack_governance.pdf in a fresh sandbox workspace: create 8 channels following the naming convention, set sections in your sidebar, create 3 user groups, restrict posting in 2 channels, set message retention 400 days for #legal-*, upload 4 custom emoji, set default channels, and invite 12 users from users.csv.
- Platforms
web· Any OS (web)- Applications
- Slack
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsdrag· Drag & drop- Work product
WP08· App/system state- Conditions
long· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Admin API state vs spec: channel names/privacy/topics; user groups; posting prefs; retention policies; emoji names; default channels; invitations to 12 emails. Score as weighted checklist. The agent is issued no Slack user or bot token and app installs are disabled in the sandbox, so changes can only come from Slack client sessions.
Proposed partial credit
25% channels; 15% groups; 30% posting prefs and retention; 30% emoji, invites and defaults
Mapped research references
Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.