R02.07.01.01 · 任务小类

探索式UI测试与缺陷报告

Exploratory UI testing & bug reports

Find, reproduce and write up defects in an app by using it.

20 条本项目编写的提案 · 分类 v1.1 · 新增基准运行 0 次。下方验证方式与部分得分规则是设计，不是执行结果。

典型应用: any app · bug tracker
小类 GUI 需求标签: G3 · 仅 GUI

任务提案 · 20

展开查看完整原文与建议检查方式；两种界面均保留提案英文原文。

R02.07.01.01-T01 Explore a sandbox web shop checkout and file defects in Jira

原始指令

The staging shop 'Shoply' (test accounts in fixtures/accounts.md) has a new cart and checkout. Explore it for defects in cart, promo codes, shipping and payment (test card only). File each defect in the Jira sandbox project SHOP with title, steps, expected, actual, severity and a screenshot.

平台: web · 任意系统（网页）
应用: Jira · Shoply staging
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 type · 文字与表单 vis · 视觉判断
工作产物: WP01 · 文档
条件: multiapp · 多应用
提案难度: 3 / 5

建议验证方式

Grader matches Jira issues to 6 seeded bugs by URL, element accessible name and expected/actual values; per-bug credit. Unmatched issues cost 5% each. Screenshots must show the defect (VLM check). Seeded bugs are client-side only, so no API reveals them; agent has no Jira API token.

建议部分得分

70% seeded bugs found (6 equal shares); 15% fields complete; 15% screenshot evidence; false reports deduct 5 pts each

R02.07.01.01-T02 Hunt for crashes in an Android notes app and attach logcat traces

原始指令

On the Pixel 7 API 34 emulator, the test build of 'QuickNotes' has crash bugs. Use the app (long text, emoji, attachments, rotation, sharing into it) to find crashes, and open a GitHub issue in the sandbox repo for each with minimal steps and the logcat stack trace.

平台: and · Android
应用: QuickNotes · GitHub Issues · Android Emulator
交互表面: mob · 移动触控
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G3 · 仅 GUI
交互原语: touch · 触控手势 type · 文字与表单 vis · 视觉判断
工作产物: WP01 · 文档
条件: multiapp · 多应用
提案难度: 3 / 5

建议验证方式

Each issue's stack trace is matched to 4 seeded exceptions by top-frame signature; steps are replayed by a grader script mapped from the reported action list to UiAutomator calls (must crash). Duplicate issues earn nothing. APK is R8-obfuscated with no source or mapping on the VM, and adb is wrapped to allow logcat only (am, monkey, input blocked), so crashes must come from UI use.

建议部分得分

60% seeded crashes found (15 pts each); 25% steps replay to the crash; 15% traces attached

R02.07.01.01-T03 Turn a vague 'total is sometimes wrong' report into an exact repro

原始指令

Customer ticket CS-881 says the order total in the sandbox billing portal is 'sometimes wrong'. Find the exact conditions that trigger it, reduce to minimal steps, and update the ticket in Linear with the repro, expected vs actual amounts, and the affected scope.

平台: web · 任意系统（网页）
应用: Linear · Billing portal sandbox
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 type · 文字与表单 vis · 视觉判断
工作产物: WP12 · 答案 / 决策
条件: multiapp · 多应用
提案难度: 4 / 5

建议验证方式

Seeded condition: EUR currency + percentage coupon + quantity edit after coupon. Grader parses the Linear issue: the three conditions must be named; steps ≤8 and replay to the wrong total; expected/actual amounts exact. LLM rubric (10%) only for clarity. Portal JS ships minified with source maps withheld and no backend/DB access; no Linear API key is issued, so the issue is edited in the browser.

建议部分得分

45% trigger conditions; 25% minimal steps replay; 20% amounts exact; 10% clarity rubric

R02.07.01.01-T04 Find layout regressions between two builds at three viewports

原始指令

Builds A (production) and B (release candidate) of the marketing site run at two staging URLs. Compare all 8 pages at 1440, 768 and 375 px and report each layout regression in B as a Linear issue with page, viewport, a screenshot and the element affected.

平台: web · 任意系统（网页）
应用: Linear · Chrome
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: vis · 视觉判断 nav · 平移 / 缩放 / 滚动 click · 指向与点击
工作产物: WP01 · 文档
条件: 未声明
提案难度: 3 / 5

建议验证方式

Seeded: 5 regressions (overlap, clipped text, wrong breakpoint, missing image, misaligned footer), matched by page, viewport and element selector or box IoU ≥0.5 with the seeded region. Changes listed in release notes are not bugs; reporting them counts as false positives. Agent VM has no headless browser or Playwright and no Linear API key, so issues are filed from the browser session.

建议部分得分

75% seeded regressions (15 pts each); 15% evidence screenshots; 10% no intentional changes reported

R02.07.01.01-T05 Test a macOS app in German and Japanese for localization defects

原始指令

Run the test build of 'Tally' (macOS) with -AppleLanguages de and ja. Inspect every screen and menu for untranslated strings, truncation, wrong date/number formats and layout breaks. Record findings in output/l10n_findings.csv (screen, locale, element, issue_type, observed).

平台: mac · macOS
应用: Tally (test build)
交互表面: desk · 桌面 GUI
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G3 · 仅 GUI
交互原语: vis · 视觉判断 click · 指向与点击 nav · 平移 / 缩放 / 滚动
工作产物: WP02 · 记录 / 表格
条件: 未声明
提案难度: 3 / 5

建议验证方式

CSV matched to 9 seeded defects by screen, locale, element and issue_type; precision and recall computed; pass needs recall ≥0.8 and precision ≥0.7. The strings catalog is stripped from the bundle and System Events/JXA UI scripting is disabled for the agent, so defects must be found by viewing the UI.

建议部分得分

60% recall; 25% precision; 15% schema-valid CSV

R02.07.01.01-T06 Find validation bugs in a legacy Windows invoice entry form

原始指令

On the Windows VM, the WinForms app 'InvoicePro' has an invoice entry screen. Explore field validation (dates, VAT rates, negative quantities, rounding, 255+ char text, paste) and report defects in the Azure DevOps sandbox board as Bugs with steps and expected/actual.

平台: win · Windows
应用: InvoicePro · Azure DevOps
交互表面: desk · 桌面 GUI
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G3 · 仅 GUI
交互原语: type · 文字与表单 click · 指向与点击 vis · 视觉判断
工作产物: WP01 · 文档
条件: multiapp · 多应用
提案难度: 3 / 5

建议验证方式

Azure DevOps work items are matched to 7 seeded validation bugs by field name and triggering input class; repro steps replayed via FlaUI from the stated inputs. False positives −4% each. No Azure DevOps PAT is issued and the app has no API; UI Automation tools (FlaUI, PowerShell UIA) are blocked for the agent.

建议部分得分

70% seeded bugs (10 pts each); 20% replayable steps; 10% correct severity per rubric table

R02.07.01.01-T07 Triage 25 incoming GitHub issues by reproducing each

原始指令

The sandbox repo 'taskboard' has 25 new issues. Reproduce each against the running app, then label confirmed, cannot-reproduce or needs-info, add a 'duplicate of #N' comment and close for duplicates, and add the component label (ui, sync, auth, export).

平台: web · 任意系统（网页）
应用: GitHub Issues · Taskboard app
交互表面: brow · 浏览器
GUI 需求 · 任务设定: HY · 混合
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 type · 文字与表单 multi · 跨应用
工作产物: WP08 · 应用 / 系统状态
条件: multiapp · 多应用 long · 长流程
提案难度: 4 / 5

建议验证方式

Ground-truth table: per issue, expected status label, duplicate target and component. Grader reads labels/comments via read-only API: accuracy on status, duplicates and component. Closing non-duplicates costs 5% each.

建议部分得分

45% status labels; 25% duplicates linked and closed; 20% component labels; 10% no wrong closures

R02.07.01.01-T08 Verify ten 'fixed' Jira tickets on a new build

原始指令

Jira sandbox filter 'Ready for QA' lists 10 tickets fixed in build 2.4.1 of the web app. Verify each fix on the 2.4.1 staging URL; move verified ones to Done, and reopen the others with a comment stating what still fails.

平台: web · 任意系统（网页）
应用: Jira · Web app staging
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 type · 文字与表单 vis · 视觉判断
工作产物: WP08 · 应用 / 系统状态
条件: multiapp · 多应用
提案难度: 2 / 5

建议验证方式

Seeded: 7 truly fixed, 3 still broken. Grader reads transitions and comments: correct final status per ticket; reopened tickets' comments must mention the failing step keyword from the ticket's repro. No Jira API token is issued and the app's DB/logs are not reachable, so each fix must be checked and transitioned in the browser.

建议部分得分

70% correct status per ticket (7 pts each); 30% reopen comments specific

R02.07.01.01-T09 Find collision bugs in a 2D platformer test build

原始指令

Play the test build of 'Lumen' (level 1-1 to 1-3) on the desktop with keyboard controls. Find places where the player falls through floors, clips into walls or gets stuck, and log each in output/collision_bugs.json with level, x/y from the debug overlay and the action that triggers it.

平台: mac · macOS win · Windows
应用: Lumen (test build)
交互表面: desk · 桌面 GUI
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G3 · 仅 GUI
交互原语: rt · 实时控制 key · 快捷键 vis · 视觉判断
工作产物: WP10 · 标注
条件: 未声明
提案难度: 5 / 5

建议验证方式

Grader matches entries to 6 seeded collision faults by level and position (within 32 px) and trigger action; each reported entry is replayed by a scripted input bot from the stated position: must reproduce. Level data ships encrypted, the debug console/API is disabled and memory readers are blocked on the VM, so faults must be found by playing.

建议部分得分

60% seeded faults (10 pts each); 30% entries reproduce; 10% schema

R02.07.01.01-T10 Test an iOS app's behavior under interruptions

原始指令

In the iOS Simulator, test 'FitTrack' workout recording against interruptions: backgrounding, lock screen, low-memory warning, rotation, a simulated incoming call and changed location permission. Report defects in output/interruption_bugs.md with steps, expected and actual.

平台: ios · iOS/iPadOS
应用: FitTrack · iOS Simulator
交互表面: mob · 移动触控
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G3 · 仅 GUI
交互原语: touch · 触控手势 vis · 视觉判断
工作产物: WP01 · 文档
条件: interrupt · 中断
提案难度: 4 / 5

建议验证方式

Seeded: 5 state-loss defects. Grader parses the markdown into entries (fixed headings) and matches by interruption type and screen; each matched entry's steps are replayed via XCUITest + simctl. LLM rubric only for clarity (10%). Release build has no source or dSYM; simctl and XCUITest are blocked for the agent, so interruptions come via Simulator menus and gestures.

建议部分得分

65% seeded defects (13 pts each); 25% replayable; 10% clarity rubric

R02.07.01.01-T11 Boundary-test a signup form for validation defects

原始指令

Test the signup form of the sandbox web app: email, password rules, date of birth, phone, country/postcode and terms checkbox. List every defect in output/signup_bugs.csv (field, input, expected, actual).

平台: web · 任意系统（网页）
应用: Signup sandbox app
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: type · 文字与表单 click · 指向与点击
工作产物: WP02 · 记录 / 表格
条件: 未声明
提案难度: 2 / 5

建议验证方式

6 seeded defects (e.g., accepts 31 Feb, password rule off-by-one). CSV rows matched by field and an input that triggers the same equivalence class; grader re-enters the input via Playwright to confirm. Precision penalty for unmatched rows. The signup endpoint accepts only requests carrying the page's CSRF token and browser session cookie, and the bundle has no source maps, so inputs must be entered in the form.

建议部分得分

75% seeded defects (12.5 pts each); 15% inputs reproduce; 10% precision

R02.07.01.01-T12 Find browser-specific bugs across Chrome, Firefox and Safari

原始指令

Test the sandbox scheduling app in Chrome, Firefox and Safari (WebKit on macOS). Find defects that appear in only one or two browsers (date pickers, drag-to-reschedule, clipboard, layout) and file them in Linear tagged with the affected browsers.

平台: mac · macOS web · 任意系统（网页）
应用: Chrome · Firefox · Safari · Linear
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: drag · 拖放 click · 指向与点击 vis · 视觉判断
工作产物: WP01 · 文档
条件: multiapp · 多应用
提案难度: 4 / 5

建议验证方式

3 seeded browser-specific bugs; matched by feature and exact affected-browser set. Reports tagging the wrong browser set get half credit. Grader replays steps with Playwright in each engine. App bundles are minified without source maps and no Linear API key is issued, so issues are filed from a browser session.

建议部分得分

60% seeded bugs; 25% correct browser sets; 15% replayable steps

R02.07.01.01-T13 Run a timed exploratory session with a charter and report

原始指令

Run a 45-minute session-based exploratory test of the 'Export' feature in the desktop app 'ChartLab' (CSV, PNG, PDF exports). Write output/session.md with charter, areas covered, test notes, bugs found (steps/expected/actual) and issues/questions, using the provided SBTM template.

平台: mac · macOS win · Windows
应用: ChartLab
交互表面: desk · 桌面 GUI
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G3 · 仅 GUI
交互原语: click · 指向与点击 vis · 视觉判断
工作产物: WP01 · 文档
条件: 未声明
提案难度: 3 / 5

建议验证方式

Bugs section matched to 4 seeded export defects (wrong DPI, truncated CSV, PDF fonts, locale decimals). Template sections must be present (parser). Coverage claims checked against the app's telemetry log of visited dialogs. LLM rubric for notes quality (15%).

建议部分得分

50% seeded bugs; 20% coverage claims match telemetry; 15% template complete; 15% rubric

R02.07.01.01-T14 Rewrite eight vague bug reports into reproducible ones

原始指令

Eight bug reports in the Bugzilla sandbox (product 'PhotoShelf' web app) are vague ('upload broken', 'weird colors'). Reproduce each in the app and edit it with precise steps, environment, expected and actual; resolve as WORKSFORME the ones you cannot reproduce after trying.

平台: web · 任意系统（网页）
应用: Bugzilla · PhotoShelf
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 type · 文字与表单
工作产物: WP01 · 文档
条件: multiapp · 多应用
提案难度: 2 / 5

建议验证方式

6 of 8 are reproducible by seeded triggers. Grader reads each bug: steps mention the trigger condition (keyword table) and replay via Playwright; the 2 non-reproducible ones must be WORKSFORME; no reproducible bug closed. No Bugzilla API key is issued and PhotoShelf source/DB are not reachable, so bugs are reproduced and edited in the browser.

建议部分得分

60% reproducible reports rewritten (10 pts each); 25% correct WORKSFORME; 15% fields complete

R02.07.01.01-T15 Locate UI freezes in an Electron app and report with a profile

原始指令

Users say 'Kanbanize Desktop' (test build) freezes randomly. Find which user actions block the UI for over 2 s, capture a DevTools performance profile for each, and file reports in output/freezes/ (one folder per freeze with steps.md and profile.json).

平台: mac · macOS win · Windows
应用: Kanbanize Desktop · Chrome DevTools
交互表面: desk · 桌面 GUI
GUI 需求 · 任务设定: HY · 混合
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 vis · 视觉判断
工作产物: WP01 · 文档
条件: 未声明
提案难度: 4 / 5

建议验证方式

3 seeded freezes. Grader replays steps with Playwright _electron and measures long tasks: must exceed 2 s; profile.json must contain the seeded function in the top self-time frames. Unrelated folders cost 5% each.

建议部分得分

45% freezes found; 30% steps reproduce freeze; 25% profiles identify hot function

R02.07.01.01-T16 Find stale-state bugs between views in a CRM sandbox

原始指令

In the sandbox CRM, edits made in one place sometimes do not appear elsewhere (list vs detail vs kanban vs report). Explore contacts, deals and tasks, and report each propagation bug in output/stale_bugs.md with the edit made, where it was missing, and how to refresh to see it.

平台: web · 任意系统（网页）
应用: CRM sandbox
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 type · 文字与表单 vis · 视觉判断
工作产物: WP01 · 文档
条件: hidden · 隐藏 / 过期状态
提案难度: 3 / 5

建议验证方式

4 seeded caching bugs; matched by entity type, source view and stale view. Grader replays the stated edit via Playwright and checks the stale view shows old data. Server data is correct, so only the UI reveals the bugs.

建议部分得分

70% seeded bugs; 20% replay confirms; 10% refresh workaround correct

R02.07.01.01-T17 Test offline sync in an Android app on a throttled network

原始指令

On the API 34 emulator, test 'FieldLog' (offline-first form app) while toggling airplane mode and throttling the network via the emulator controls. Create, edit and delete records offline and online; report sync defects with exact sequences in output/sync_bugs.json.

平台: and · Android
应用: FieldLog · Android Emulator
交互表面: mob · 移动触控
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G3 · 仅 GUI
交互原语: touch · 触控手势 type · 文字与表单
工作产物: WP01 · 文档
条件: interrupt · 中断 hidden · 隐藏 / 过期状态
提案难度: 3 / 5

建议验证方式

3 seeded sync bugs (lost edit, duplicate on retry, delete resurrected). Grader replays each reported sequence with UiAutomator + emulator console network commands and checks the backend record state. Precision penalty for non-reproducing entries. APK is R8-obfuscated with no source, and the backend DB and API docs are not reachable, so bugs are found by using the app with the emulator controls.

建议部分得分

60% seeded bugs; 30% sequences reproduce; 10% schema-valid JSON

R02.07.01.01-T18 Probe role permissions in an admin app for UI authorization bugs

原始指令

The sandbox admin portal has roles Viewer, Editor and Admin (test accounts in fixtures/roles.md). Using each account, check what each role can see and do in the UI against spec/permissions.md, and report every mismatch in output/rbac_findings.csv. Do not modify data belonging to the 'prod-mirror' tenant.

平台: web · 任意系统（网页）
应用: Admin portal sandbox
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 vis · 视觉判断
工作产物: WP02 · 记录 / 表格
条件: risk · 高风险 / 不可逆
提案难度: 4 / 5

建议验证方式

5 seeded mismatches (e.g., Viewer sees Delete and it works). Rows matched by role, action and screen. Grader checks the audit log: any write to tenant prod-mirror fails the task. Precision penalty for spec-consistent rows. No API token is issued, so role checks must be done by signing in as each role in the browser.

建议部分得分

70% mismatches found; 15% precision; 15% no forbidden writes (gate)

R02.07.01.01-T19 Run a full release-candidate exploratory pass on a PM app

原始指令

Release candidate 3.0 of the sandbox project-management app 'Planr' (boards, Gantt drag, comments, notifications, CSV import, settings) must be signed off. Explore it end to end and file all defects in the Jira sandbox project PLANR with severity, then add a sign-off comment on PLANR-1 recommending go or no-go.

平台: web · 任意系统（网页）
应用: Planr · Jira
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: drag · 拖放 click · 指向与点击 type · 文字与表单 vis · 视觉判断
工作产物: WP01 · 文档
条件: long · 长流程 multiapp · 多应用
提案难度: 5 / 5

建议验证方式

15 seeded bugs (3 blocker, 5 major, 7 minor). Grader matches issues by feature area, element and trigger; severity scored against seeded levels. The recommendation must be 'no-go' (blockers exist) citing ≥1 blocker key. Planr ships minified without source maps and no Jira API token is issued, so bugs must be found and filed through the browser.

建议部分得分

50% bugs found (weighted by severity); 20% severity correct; 15% replayable steps; 15% go/no-go with blocker cited

R02.07.01.01-T20 Find a reliable repro for duplicate orders from double submit

原始指令

Support reports occasional duplicate orders in the sandbox ordering app. Find the exact user interaction and timing that creates duplicates (it involves the Submit button and slow network), reduce it to a reliable repro, and document it in output/dup_order.md with the success rate over 10 tries.

平台: web · 任意系统（网页）
应用: Ordering app sandbox · Chrome DevTools
交互表面: brow · 浏览器
GUI 需求 · 任务设定: G3 · 仅 GUI
GUI 需求 · 普通权限: G2 · GUI 必要
交互原语: click · 指向与点击 rt · 实时控制 vis · 视觉判断
工作产物: WP12 · 答案 / 决策
条件: 未声明
提案难度: 5 / 5

建议验证方式

Seeded race: second click within the 300–900 ms window after the first under 'Slow 3G' throttling. Grader parses the doc for interaction, timing window and throttle setting, then replays 10× via Playwright: ≥8/10 duplicates. Reported rate within ±20% of measured. The order API accepts only requests carrying the page's CSRF token and browser session cookie, and the bundle has no source maps, so the race must be found via the UI.

建议部分得分

35% correct trigger and timing window; 35% replay reliability; 20% throttle condition; 10% rate accuracy

已有研究映射

当前映射未给此小类指定基准参考。

探索式UI测试与缺陷报告

任务提案 · 20

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

原始指令

建议验证方式

建议部分得分

已有研究映射

同工作流族的小类