计算机使用智能体分类English
R11.02.01.03 · 任务小类

视频会议控制

Video-meeting session control

Run meetings: share the right window, manage participants, record, breakout rooms.

20 条本项目编写的提案 · 分类 v1.1 · 新增基准运行 0 次。下方验证方式与部分得分规则是设计,不是执行结果。

典型应用
Zoom · Teams · Google Meet · Jitsi
小类 GUI 需求标签
G3 · 仅 GUI

任务提案 · 20

展开查看完整原文与建议检查方式;两种界面均保留提案英文原文。

R11.02.01.03-T01 Join a Jitsi room muted with camera off and a display name

原始指令

Join Jitsi Meet room 'qa-sync' on the test server meet.sandbox.test with microphone muted and camera off before entering, using display name 'Agent-1'. Stay in the room.

平台
web · 任意系统(网页)
应用
Jitsi Meet
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 type · 文字与表单
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
1 / 5

建议验证方式

Prosody/XMPP presence: participant 'Agent-1' in qa-sync with audioMuted=true and videoMuted=true from the moment of join (no unmuted media packets on the JVB for that endpoint). Browser DevTools are disabled by policy and the agent has no terminal or Prosody admin access, so room controls can only be used from the Jitsi web UI.

建议部分得分

30% joined right room; 20% display name; 25% muted on join; 25% camera off on join

R11.02.01.03-T02 Share only the presentation window and start the slideshow

原始指令

In a Zoom meeting already joined (test account), share only the PowerPoint window for decks/q3_plan.pptx (not the desktop or other apps) and start the slideshow from slide 1, then advance to slide 3. Chat and email windows are open with private content and must not appear.

平台
mac · macOS win · Windows
应用
Zoom · PowerPoint
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
click · 指向与点击 multi · 跨应用 vis · 视觉判断
工作产物
WP08 · 应用 / 系统状态
条件
multiapp · 多应用 risk · 高风险 / 不可逆
提案难度
3 / 5

建议验证方式

A verifier bot participant records the share: frames match slide 1 then slide 3 renders (SSIM ≥0.85); OCR never detects the canary strings from the chat/email windows; Zoom share type = application window. Zoom API and SDK credentials are withheld from the agent (the verifier bot is grader-only), so the share must be started from the Zoom client.

建议部分得分

25% window share; 25% slideshow from slide 1; 25% advanced to slide 3; 25% no private content leaked

R11.02.01.03-T03 Create and open breakout rooms from a roster

原始指令

As host of the running Zoom meeting 'Workshop' (16 scripted participants), create 4 breakout rooms named Team A–D, assign participants per roster.csv, set rooms to close automatically after 15 minutes with a 60-second countdown, and open all rooms.

平台
mac · macOS win · Windows
应用
Zoom
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
drag · 拖放 click · 指向与点击 type · 文字与表单
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
4 / 5

建议验证方式

Zoom dashboard/metrics (verifier admin) and bot clients: 4 rooms with names, each bot reports its room; assignments match roster (16/16); settings auto-close 15 min and countdown 60 s; rooms opened. Compared with control pair T17. Zoom API and Server-to-Server OAuth credentials are withheld from the agent (the verifier admin token is grader-only), so actions must come from the Zoom client.

建议部分得分

15% rooms named; 50% assignments; 20% timing settings; 15% opened

R11.02.01.03-T04 Admit invited guests from the lobby and remove an intruder

原始指令

As organizer of a Teams meeting in progress, admit from the lobby only the 5 people on invitees.txt, deny the others, remove the uninvited participant 'Promo Bot' who slipped in, then mute all attendees and disable their mics.

平台
mac · macOS win · Windows web · 任意系统(网页)
应用
Microsoft Teams
交互表面
desk · 桌面 GUI brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 nav · 平移 / 缩放 / 滚动
工作产物
WP08 · 应用 / 系统状态
条件
risk · 高风险 / 不可逆
提案难度
3 / 5

建议验证方式

Teams call records / bot participants: the 5 invitees admitted, 3 non-invitees never admitted, Promo Bot removed, all attendee bots report muted with unmute disabled. Graph credentials and app registration are withheld from the agent, so meeting controls must be used in the Teams client.

建议部分得分

35% correct admits; 20% denied others; 20% intruder removed; 25% mute and lock

R11.02.01.03-T05 Record and transcribe a Meet call into Drive

原始指令

In a Google Meet (Workspace test tenant) you host with two scripted participants, start recording with transcripts and captions in English, keep it running about 2 minutes while the bots talk, then stop. Confirm the recording and transcript land in My Drive > Meet Recordings.

平台
web · 任意系统(网页)
应用
Google Meet
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 av · 音视频时序
工作产物
WP05 · 时序媒体
条件
未声明
提案难度
3 / 5

建议验证方式

Drive API (verifier): recording MP4 of 100–140 s and transcript Doc in Meet Recordings linked to this meeting code; transcript contains the bots' scripted sentences (WER ≤20%). The agent gets no OAuth client or Meet/Drive API token and DevTools are disabled by policy, so host controls must be used in the Meet browser session.

建议部分得分

35% recording started/stopped; 35% file in Drive with duration; 30% transcript present and accurate

R11.02.01.03-T06 Spotlight two speakers and hide non-video participants

原始指令

In a Zoom meeting you host (12 scripted participants), spotlight the two panelists named in panel.txt for everyone, turn on 'Hide non-video participants' in gallery, and rename the participant 'iPhone (5)' to 'Guest - Lee'.

平台
mac · macOS win · Windows
应用
Zoom
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 hover · 悬停与上下文 type · 文字与表单
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
3 / 5

建议验证方式

Attendee bots record layout: spotlit video tiles equal the 2 panelists; host client state shows hide-non-video on (bot sees no avatar tiles); participant list shows 'Guest - Lee'. Zoom API and Server-to-Server OAuth credentials are withheld from the agent (the verifier admin token is grader-only), so actions must come from the Zoom client.

建议部分得分

50% correct spotlight; 20% hide non-video; 30% rename

R11.02.01.03-T07 Assign presenter roles and turn on live captions in Teams

原始指令

In a Teams meeting you organize, open Meeting options and set 'Who can present' to Specific people, choose maria@ and tom@ as presenters (others attendees), turn on live captions with spoken language English, and pin maria@'s video for yourself.

平台
mac · macOS win · Windows web · 任意系统(网页)
应用
Microsoft Teams
交互表面
desk · 桌面 GUI brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
click · 指向与点击 type · 文字与表单
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
3 / 5

建议验证方式

Graph onlineMeeting: allowedPresenters roleIsPresenter with exactly maria and tom; participant roles in call; captions enabled event in call record; client telemetry shows pinned participant. Graph credentials and app registration are withheld from the agent, so meeting controls must be used in the Teams client.

建议部分得分

50% presenter roles; 30% captions; 20% pin

R11.02.01.03-T08 Share a video clip with computer audio

原始指令

In a Zoom meeting, share the QuickTime/Media Player window playing media/safety_brief.mp4 with 'Share sound' enabled and 'Optimize for video clip' on, play it to the end (45 s), then stop sharing.

平台
mac · macOS win · Windows
应用
Zoom · QuickTime Player
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 av · 音视频时序 multi · 跨应用
工作产物
WP08 · 应用 / 系统状态
条件
multiapp · 多应用
提案难度
3 / 5

建议验证方式

Verifier bot recording: shared video frames match source (SSIM ≥0.7 on sampled frames) at ≥20 fps; received audio cross-correlates with the clip soundtrack (≥0.6) for ≥40 s; share stopped afterward. Zoom API and Server-to-Server OAuth credentials are withheld from the agent (the verifier admin token is grader-only), so actions must come from the Zoom client.

建议部分得分

30% window shared; 35% audio shared; 20% video optimized smoothness; 15% stopped after

R11.02.01.03-T09 Secure a Jitsi room with lobby and moderation

原始指令

As moderator of Jitsi room 'board-q4' on the test server, enable the lobby, set the room password from room_pw.txt, admit only the 3 named board members waiting, kick the participant spamming chat, and enable 'Everyone starts muted' and 'Everyone starts hidden'.

平台
web · 任意系统(网页)
应用
Jitsi Meet
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 type · 文字与表单
工作产物
WP08 · 应用 / 系统状态
条件
risk · 高风险 / 不可逆
提案难度
4 / 5

建议验证方式

Prosody room config: members_only (lobby) on, password set; occupants equal moderator + 3 members; spammer kicked event; startAudioMuted/startVideoMuted policies set (new bot joins muted/hidden). Browser DevTools are disabled by policy and the agent has no terminal or Prosody admin access, so room controls can only be used from the Jitsi web UI.

建议部分得分

20% lobby; 15% password; 30% correct admits; 35% kick and start-muted policies

R11.02.01.03-T10 Launch a prepared poll and share the results

原始指令

In a Zoom meeting you host, launch the prepared poll 'Pick the date' (3 options), wait until at least 8 of the 10 scripted participants have voted, end the poll, and share the results with participants.

平台
mac · macOS win · Windows
应用
Zoom
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
click · 指向与点击
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
3 / 5

建议验证方式

Zoom poll report (verifier API): poll launched and ended once with ≥8 responses; bot clients received the shared-results view; poll not relaunched. Zoom API and Server-to-Server OAuth credentials are withheld from the agent (the verifier admin token is grader-only), so actions must come from the Zoom client.

建议部分得分

30% launched; 30% ended after ≥8 votes; 40% results shared

R11.02.01.03-T11 Run Teams breakout rooms with a mid-session reassignment

原始指令

In a Teams meeting with 12 scripted attendees, create 3 breakout rooms (Red/Green/Blue), assign per groups.csv, set a 10-minute time limit, open them, move 'Ana Ortiz' from Red to Blue after she asks in chat, send an announcement to all rooms, then close rooms and return everyone.

平台
mac · macOS win · Windows
应用
Microsoft Teams
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 click · 指向与点击 type · 文字与表单
工作产物
WP08 · 应用 / 系统状态
条件
interrupt · 中断
提案难度
4 / 5

建议验证方式

Bot clients report room membership timeline: initial assignment matches CSV; Ana moved to Blue after her chat request; all bots receive announcement text; all back in main meeting after close; time limit set 10 min. Graph credentials and app registration are withheld from the agent, so meeting controls must be used in the Teams client.

建议部分得分

30% initial assignment; 25% reassignment; 20% announcement; 25% close/return and timer

R11.02.01.03-T12 Keep confidential pop-ups out of a live screen share

原始指令

You are sharing your screen in a Zoom meeting to demo the expense app. During the demo, a chat app will pop up notifications with confidential text. Keep the demo going (open three expense reports in order) while ensuring none of the notification content is visible to attendees.

平台
mac · macOS win · Windows
应用
Zoom · Expense app
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
click · 指向与点击 vis · 视觉判断 multi · 跨应用
工作产物
WP08 · 应用 / 系统状态
条件
interrupt · 中断 risk · 高风险 / 不可逆 multiapp · 多应用
提案难度
4 / 5

建议验证方式

Verifier bot recording: OCR never shows the notification canary strings; three report pages appear in order; acceptable strategies: window-only share, Focus/DND on, or pause share during pop-up (gap ≤10 s). Zoom API and Server-to-Server OAuth credentials are withheld from the agent (the verifier admin token is grader-only), so actions must come from the Zoom client.

建议部分得分

50% no leak; 35% three reports demoed; 15% share continuity

R11.02.01.03-T13 Set host controls in Google Meet and end for all

原始指令

In a Google Meet you host, turn on Host management, turn off chat messages and screen sharing for everyone except hosts, then end the call for everyone at exactly the 5-minute mark of the meeting.

平台
web · 任意系统(网页)
应用
Google Meet
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
2 / 5

建议验证方式

Meet REST/report (verifier): host management on; chat and present locks on; bot participant's attempt to chat/share fails; conference end time 5:00 ±20 s after start, all participants disconnected. The agent gets no OAuth client or Meet/Drive API token and DevTools are disabled by policy, so host controls must be used in the Meet browser session.

建议部分得分

25% host management; 40% locks; 35% ended for all on time

R11.02.01.03-T14 Moderate a webinar Q&A and promote a panelist

原始指令

In a Zoom Webinar (test account) as host, answer live the 5 attendee questions that match faq.md (type answers publicly), dismiss the 2 off-topic spam questions, and promote attendee 'Dr. Okafor' to panelist when she asks in Q&A.

平台
mac · macOS win · Windows
应用
Zoom
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
type · 文字与表单 click · 指向与点击 nav · 平移 / 缩放 / 滚动
工作产物
WP08 · 应用 / 系统状态
条件
interrupt · 中断
提案难度
4 / 5

建议验证方式

Webinar Q&A report: 5 questions answered publicly with text containing FAQ key facts; 2 spam dismissed; no other dismissals; participant report shows Okafor role changed to panelist after her request. Zoom API and Server-to-Server OAuth credentials are withheld from the agent (the verifier admin token is grader-only), so actions must come from the Zoom client.

建议部分得分

50% answers; 20% spam dismissed; 30% promotion

R11.02.01.03-T15 Present with PowerPoint Live and hand over control

原始指令

In a Teams meeting, share decks/roadmap.pptx via PowerPoint Live, use presenter view to go to slide 4, turn off attendees' ability to browse slides privately, then give control to co-presenter tom@ and take it back after he advances two slides.

平台
mac · macOS win · Windows
应用
Microsoft Teams · PowerPoint
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
click · 指向与点击 nav · 平移 / 缩放 / 滚动 multi · 跨应用
工作产物
WP08 · 应用 / 系统状态
条件
multiapp · 多应用
提案难度
4 / 5

建议验证方式

Attendee bot captures: PowerPoint Live share at slide 4; private navigation disabled (bot browsing blocked); control granted to tom@ (bot advances to slide 6) then reclaimed; final presenter is agent. Graph credentials and app registration are withheld from the agent, so meeting controls must be used in the Teams client.

建议部分得分

25% PowerPoint Live; 15% slide 4; 20% private browsing off; 40% control handoff and return

R11.02.01.03-T16 Record locally with separate audio tracks per participant

原始指令

In Zoom desktop settings enable local recording with 'Record a separate audio file for each participant' and save location ~/Zoom/recordings. In the running meeting, record 60 s while three scripted participants speak in turn, then stop and wait for conversion.

平台
mac · macOS win · Windows
应用
Zoom
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 av · 音视频时序
工作产物
WP05 · 时序媒体
条件
未声明
提案难度
3 / 5

建议验证方式

Recording folder contains MP4 (55–70 s) and per-participant audio files (≥3), each dominated by its speaker's scripted audio (energy only in their turns, correlation ≥0.6). No terminal, ffmpeg or Zoom API credentials for the agent; recording files written by any process other than Zoom are caught by a file-write audit log.

建议部分得分

30% setting enabled; 30% recording made; 40% separate per-participant tracks

R11.02.01.03-T17 Pre-assign breakout rooms via the Zoom API (control pair of T03)

原始指令

Control pair of T03. With Zoom Server-to-Server OAuth test credentials, write prebreakout.py that updates meeting 'Workshop' with 4 pre-assigned breakout rooms per roster.csv (by email) before it starts.

平台
mac · macOS win · Windows lin · Linux
应用
Zoom API
交互表面
api · API / SDK
GUI 需求 · 任务设定
AP · API 足够
GUI 需求 · 普通权限
AP · API 足够
交互原语
code · 代码与命令
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
2 / 5

建议验证方式

GET meeting settings.breakout_room: 4 rooms named Team A–D with participant emails matching roster; bot clients land in assigned rooms when host opens them.

建议部分得分

40% room config; 60% correct assignment

R11.02.01.03-T18 Sketch on the meeting whiteboard during a Jitsi call

原始指令

In Jitsi room 'arch-review', open the shared whiteboard and draw three labeled boxes 'Client', 'API', 'DB' connected left-to-right by arrows, so participants can see it, then close the whiteboard for everyone.

平台
web · 任意系统(网页)
应用
Jitsi Meet
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 type · 文字与表单 path · 连续路径
工作产物
WP03 · 视觉排版
条件
未声明
提案难度
3 / 5

建议验证方式

Whiteboard (Excalidraw collab) scene snapshot captured by bot: 3 rectangles with exact labels ordered left→right, 2 arrows binding Client→API and API→DB; whiteboard closed event afterwards. Browser DevTools are disabled by policy and the agent has no terminal or Prosody admin access, so room controls can only be used from the Jitsi web UI.

建议部分得分

40% three labeled boxes; 40% arrows bound correctly; 20% closed after

R11.02.01.03-T19 Run a moderated town hall end to end

原始指令

Run 'October Town Hall' (Teams town hall, test tenant) per runbook.md: start on time, spotlight the CEO, run moderated Q&A (publish 6 approved questions, reject 3), show the prepared slide deck, record, end at the scheduled time, and download the attendance report to reports/.

平台
mac · macOS win · Windows
应用
Microsoft Teams
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 nav · 平移 / 缩放 / 滚动 multi · 跨应用
工作产物
WP08 · 应用 / 系统状态
条件
long · 长流程 interrupt · 中断
提案难度
5 / 5

建议验证方式

Event logs: started within 1 min; spotlight on CEO; Q&A states: 6 published, 3 rejected per runbook criteria; deck shared; recording exists; ended ±1 min; attendance CSV in reports/ matches bot roster. Graph credentials and app registration are withheld from the agent, so meeting controls must be used in the Teams client.

建议部分得分

30% start/end timing and spotlight; 35% Q&A moderation; 15% deck; 20% recording and report

R11.02.01.03-T20 Host a timed training session following a rundown

原始指令

Host a Zoom training per rundown.csv: share window A (terminal) at 00:00 for 3 min, switch share to window B (browser docs) without stopping the meeting, at 06:00 launch 3 breakout rooms (auto-assign) for 5 min, bring everyone back, run poll 'Recap', and end at 15:00.

平台
mac · macOS win · Windows
应用
Zoom · Terminal · Browser
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
click · 指向与点击 rt · 实时控制 multi · 跨应用
工作产物
WP08 · 应用 / 系统状态
条件
multiapp · 多应用 long · 长流程
提案难度
5 / 5

建议验证方式

Bot recording and Zoom metrics: share content switches at 3:00 ±20 s with no desktop shown; breakout opened at 6:00 ±30 s for 5 min ±30 s; poll launched after return; meeting ends at 15:00 ±30 s. Zoom API and Server-to-Server OAuth credentials are withheld from the agent (the verifier admin token is grader-only), so actions must come from the Zoom client.

建议部分得分

25% share sequence; 25% breakout timing; 20% poll; 30% end time and no desktop exposure

已有研究映射

当前映射未给此小类指定基准参考。

同工作流族的小类