计算机使用智能体分类English
R01.11.02.03 · 任务小类

双指缩放、旋转与地图操作

Pinch, rotate & map manipulation

Zoom, rotate and position maps, photos and documents to a target view.

20 条本项目编写的提案 · 分类 v1.1 · 新增基准运行 0 次。下方验证方式与部分得分规则是设计,不是执行结果。

典型应用
Maps · OsmAnd · Gallery
小类 GUI 需求标签
G3 · 仅 GUI

任务提案 · 20

展开查看完整原文与建议检查方式;两种界面均保留提案英文原文。

R01.11.02.03-T01 OsmAnd: pinch-zoom until the scale bar reads 100 m

原始指令

In OsmAnd centred on the Ferry Building, San Francisco, pinch to zoom until the on-screen ruler/scale bar reads exactly 100 m. Do not use the +/− buttons or volume keys.

平台
and · Android
应用
OsmAnd
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
2 / 5

建议验证方式

OsmAnd map state (prefs last_known_map_zoom and fractional zoom) maps to a 100 m scale step; input log shows multi-touch pinch events and no zoom-button taps.

建议部分得分

70% zoom at the 100 m step; 30% pinch route only.

R01.11.02.03-T02 OsmAnd: rotate map so north points right, then restore north-up

原始指令

In OsmAnd with map rotation set to 'manual', two-finger rotate the map so north points to the right (bearing 270° ±5°) and hold it for 3 s, then rotate it back to north-up (±2°) by gesture, not the compass button.

平台
and · Android
应用
OsmAnd
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 geom · 精确几何
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
3 / 5

建议验证方式

OsmAnd instrumentation log of map bearing: a ≥3 s interval within 270±5°, final bearing 0±2°; compass button tap not logged. adb and root shell are withheld from the agent (screen input only), so geo: intents and the OsmAnd AIDL API are unavailable; the map must be rotated by gesture.

建议部分得分

50% intermediate bearing held; 50% final north-up by gesture.

R01.11.02.03-T03 PDF reader: zoom page 4 to 200% and screenshot the table

原始指令

In Docreader, open Documents/annual.pdf, go to page 4, pinch-zoom to 200% (±10%) and pan so the 'Regional totals' table fills the screen, then take a screenshot.

平台
and · Android
应用
Docreader
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 nav · 平移 / 缩放 / 滚动
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
2 / 5

建议验证方式

App state zoom 1.8–2.2 on page 4; newest screenshot's OCR contains all 6 row labels and the table header; table bbox covers ≥ 70% of the screenshot width. adb and root shell are withheld from the agent (screen input only), so intents and screencap are unavailable; zoom and screenshot must be done on the device.

建议部分得分

40% zoom in range on correct page; 40% table fully visible; 20% screenshot taken.

R01.11.02.03-T04 Gallery: pinch the grid to five columns

原始指令

In the Gallery app's photo grid, use a pinch-out/pinch-in gesture to change the grid to exactly 5 columns, then open the photo in row 3, column 5 and mark it as favourite.

平台
and · Android
应用
Gallery
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 vis · 视觉判断
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
2 / 5

建议验证方式

Gallery prefs grid_column_count=5; favourite flag set on the photo at index 14 of the current sort order and on no other photo. adb and root shell are withheld from the agent (screen input only), so run-as pref edits are unavailable; the grid must be pinched.

建议部分得分

50% five columns; 50% correct photo favourited.

R01.11.02.03-T05 OsmAnd: frame Coit Tower at zoom 17 with bearing 45°

原始指令

In OsmAnd (manual rotation), set the map view so Coit Tower is at screen centre (±40 px), zoom level 17 (±0.2), and bearing 45° (±5°), using gestures only. Leave it on screen.

平台
and · Android
应用
OsmAnd
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 geom · 精确几何 nav · 平移 / 缩放 / 滚动
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
3 / 5

建议验证方式

OsmAnd map state dump: centre lat/lon within ~40 px equivalent of Coit Tower, zoom 16.8–17.2, bearing 40–50°; search activity never opened. adb and root shell are withheld from the agent (screen input only), so geo: intents and the OsmAnd AIDL API are unavailable; the map must be framed by gesture.

建议部分得分

35% centre; 35% zoom; 30% bearing.

R01.11.02.03-T06 Photo editor: straighten a tilted horizon with the rotate gesture

原始指令

Open Pictures/sea_tilt.jpg (horizon tilted 7.3°) in the Gallery editor's crop tool, straighten it with the two-finger rotate gesture or the angle dial so the horizon is level, and save a copy.

平台
and · Android
应用
Gallery editor
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
CL · CLI 足够
交互原语
touch · 触控手势 geom · 精确几何 vis · 视觉判断
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
4 / 5

建议验证方式

Hough-line horizon angle in the saved copy within ±0.5° of level; image not flipped; resolution ≥ 80% of source. adb and root shell are withheld from the agent (screen input only), so file pushes are unavailable; the copy must be straightened and saved in the editor.

建议部分得分

30% saved copy; 50% horizon within ±0.5° (25 pts if ±1.5°); 20% no excessive crop.

R01.11.02.03-T07 MapLibre demo: match a target camera with pitch and bearing

原始指令

In the MapLibre Android demo app's 'Simple Map', match the camera in fixtures/target_view.png: centre, zoom 15.5, pitch 50°, bearing 120°. Use pinch, two-finger rotate and two-finger vertical drag for tilt.

平台
and · Android
应用
MapLibre demo
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 geom · 精确几何 vis · 视觉判断
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
4 / 5

建议验证方式

Camera position logged by the demo's instrumentation: centre within 50 m, zoom ±0.25, pitch ±4°, bearing ±5°. adb and root shell are withheld from the agent (screen input only), so am start camera extras are unavailable; the camera must be set by gesture.

建议部分得分

25% centre; 25% zoom; 25% pitch; 25% bearing.

R01.11.02.03-T08 OsmAnd: find a street name by panning with search disabled

原始指令

In OsmAnd (search disabled in this build), the start view shows Union Square. Pan and zoom to the intersection marked by the red favourite 'X1' about 3 km away and write the two street names at that intersection into Markor x1.md.

平台
and · Android
应用
OsmAnd · Markor
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
touch · 触控手势 nav · 平移 / 缩放 / 滚动 vis · 视觉判断
工作产物
WP12 · 答案 / 决策
条件
multiapp · 多应用
提案难度
3 / 5

建议验证方式

x1.md contains both street names (normalised case/abbreviations) from the OSM ground truth; no extra names. adb and root shell are withheld from the agent (screen input only), so geo: intents are unavailable and search is disabled; names must be found by panning.

建议部分得分

20% reached favourite; 80% both street names correct (40 each).

R01.11.02.03-T09 iOS MapKit: zoom and rotate to a target view in MapProbe

原始指令

On the iOS 18 Simulator, MapProbe shows a MapKit map. Use pinch and two-finger rotate (Option-drag in Simulator) to show Golden Gate Bridge centred at a camera distance of 3,000 m (±10%) with heading 300° (±5°).

平台
ios · iOS/iPadOS
应用
MapProbe · MapKit
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 geom · 精确几何
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
3 / 5

建议验证方式

MapProbe logs its MKMapCamera: centre within 150 m of the bridge midpoint, distance 2700–3300 m, heading 295–305°. Host shell and xcrun simctl are withheld from the agent, so camera deep links cannot be sent; the view must be set by gesture.

建议部分得分

35% centre; 35% distance; 30% heading.

R01.11.02.03-T10 iOS Photos: zoom to read a sign and record it

原始指令

In Photos on the iOS 18 Simulator, open IMG_0102 (a street scene). Pinch-zoom to the small shop sign at the lower left until legible and type the shop's name and phone number into a new Notes note 'Shop'.

平台
ios · iOS/iPadOS
应用
Photos · Notes
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 vis · 视觉判断
工作产物
WP12 · 答案 / 决策
条件
multiapp · 多应用
提案难度
3 / 5

建议验证方式

Note text contains the exact shop name and the 10-digit phone number from ground truth (digits-only comparison). The sign is unreadable at fit-to-screen size. Host shell and xcrun simctl are withheld from the agent, so the photo cannot be pulled to the host; the sign must be read by zooming in Photos.

建议部分得分

50% shop name; 50% phone number.

R01.11.02.03-T11 Document scanner: drag four corner handles to the page corners

原始指令

In OpenNoteScanner, load Pictures/contract_photo.jpg. Auto-detection is off; drag the four crop handles onto the paper's corners (use the magnifier) and save the rectified scan.

平台
and · Android
应用
OpenNoteScanner
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
touch · 触控手势 drag · 拖放 geom · 精确几何
工作产物
WP10 · 标注
条件
未声明
提案难度
4 / 5

建议验证方式

Grader recovers the applied quad from the app's log (or by homography fit of the output) and compares to annotated corners: mean corner error ≤ 1.5% of page diagonal; output text OCR similarity ≥ 0.9. adb and root shell are withheld from the agent (screen input only), so file pushes and intents are unavailable; corners must be dragged in the app.

建议部分得分

60% corner accuracy (scaled); 20% saved output; 20% OCR quality.

R01.11.02.03-T12 OsmAnd: measure a trail with the ruler by placing points along it

原始指令

Using OsmAnd's Plan a route / measure tool in 'straight line' mode, trace the Lands End Trail from the parking lot to the labyrinth by placing points along the path (zooming as needed), save it as GPX 'landsend', and report its length in Markor.

平台
and · Android
应用
OsmAnd · Markor
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
touch · 触控手势 path · 连续路径 geom · 精确几何
工作产物
WP04 · 三维 / 空间模型
条件
multiapp · 多应用
提案难度
4 / 5

建议验证方式

Saved GPX: 95% of points within 20 m of the OSM trail polyline, endpoints within 30 m; reported length within 5% of the GPX length and of the trail length. adb and root shell are withheld from the agent (screen input only), so GPX file pushes are unavailable; points must be placed with the ruler.

建议部分得分

40% path fidelity; 20% endpoints; 20% saved GPX; 20% length reported.

R01.11.02.03-T13 Geofence app: draw a polygon around a park boundary

原始指令

In GeofenceDemo (MapLibre-based), create a polygon geofence 'Dolores Park' by tapping vertices around the park's boundary (zoom and pan as needed), with at most 24 vertices, and save it.

平台
and · Android
应用
GeofenceDemo
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 path · 连续路径 geom · 精确几何
工作产物
WP04 · 三维 / 空间模型
条件
未声明
提案难度
5 / 5

建议验证方式

Saved polygon vs OSM park polygon: IoU ≥ 0.85 for full credit (scaled down to 0.6); vertex count ≤ 24; name exact. adb and root shell are withheld from the agent (screen input only), so run-as file edits are unavailable; the polygon must be drawn in the app.

建议部分得分

70% IoU (scaled); 15% vertex limit; 15% saved with name.

R01.11.02.03-T14 Tablet labeling app: zoom and place six keypoints within 5 px

原始指令

On the Pixel Tablet AVD, open LabelDemo image hand_017.png (4000×3000). Place the six requested keypoints (wrist, thumb tip, index tip, middle tip, ring tip, pinky tip), zooming in so each lands within 5 px at native resolution, and save.

平台
and · Android
应用
LabelDemo
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
5 / 5

建议验证方式

Saved annotation JSON vs ground truth: per-keypoint error in native pixels; full credit ≤ 5 px, partial ≤ 15 px; labels must match. adb and root shell are withheld from the agent (screen input only), so run-as file edits are unavailable; keypoints must be placed in the app.

建议部分得分

50% keypoints 1-3 (one sixth each); 50% keypoints 4-6 (one sixth each); per point full credit ≤ 5 px, half ≤ 15 px.

R01.11.02.03-T15 Collage app: rotate, scale and place a photo tile

原始指令

In CollageDemo, place Pictures/logo.png on the canvas and use two-finger gestures to rotate it 30° clockwise (±2°), scale it to 1.5× (±0.05), and centre it at the marked crosshair (±10 px), then export.

平台
and · Android
应用
CollageDemo
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G3 · 仅 GUI
交互原语
touch · 触控手势 geom · 精确几何
工作产物
WP03 · 视觉排版
条件
未声明
提案难度
3 / 5

建议验证方式

Exported project JSON transform: rotation, scale and centre within tolerances; exported PNG matches the transform (template match). adb and root shell are withheld from the agent (screen input only), so run-as project edits are unavailable; the tile must be placed by gesture.

建议部分得分

35% rotation; 35% scale; 30% position.

R01.11.02.03-T16 OsmAnd: download offline map of the area currently in view

原始指令

Pan and zoom OsmAnd until the downtown Oakland city-hall area is in view, then download the offline map region that contains it using the map's 'download this region' prompt, not the list.

平台
and · Android
应用
OsmAnd
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
touch · 触控手势 nav · 平移 / 缩放 / 滚动
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
3 / 5

建议验证方式

OsmAnd data dir contains the region file covering Oakland city hall; download initiated from the map context (OsmAnd log event). adb and root shell are withheld from the agent (screen input only), so host file pushes are unavailable; the region must be downloaded from the map prompt.

建议部分得分

40% correct region in view; 60% region downloaded via map prompt.

R01.11.02.03-T17 Gallery: zoom-compare two near-identical photos and report the difference

原始指令

Pictures/pair_a.jpg and pair_b.jpg differ in one small detail (a single object changed). Pinch-zoom and pan both in Gallery to find it and write which object differs and in which quadrant into Markor diff.md.

平台
and · Android
应用
Gallery · Markor
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
touch · 触控手势 nav · 平移 / 缩放 / 滚动 vis · 视觉判断
工作产物
WP12 · 答案 / 决策
条件
multiapp · 多应用
提案难度
4 / 5

建议验证方式

diff.md matched against the ground-truth object label (synonym list) and quadrant (TL/TR/BL/BR). Detail is < 1% of image area. adb and root shell are withheld from the agent (screen input only), so photos cannot be pulled for pixel diffing; the difference must be found by zooming.

建议部分得分

60% object identified; 40% quadrant correct.

R01.11.02.03-T18 OsmAnd: locate the highest summit in a region from contours

原始指令

With OsmAnd contour lines enabled and search disabled, find the highest summit inside the red polygon 'Area B' (Marin Headlands) by panning and zooming, long-press to drop a favourite named 'Summit' on it, and note its elevation.

平台
and · Android
应用
OsmAnd
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
touch · 触控手势 nav · 平移 / 缩放 / 滚动 vis · 视觉判断
工作产物
WP12 · 答案 / 决策
条件
long · 长流程
提案难度
5 / 5

建议验证方式

favourites.gpx point 'Summit' within 30 m of the DEM maximum inside Area B; recorded elevation within 5 m (in description). adb and root shell are withheld from the agent (screen input only), so file pushes and the OsmAnd AIDL API are unavailable; the favourite must be placed on the map.

建议部分得分

60% favourite within 30 m (30 pts within 100 m); 20% named; 20% elevation.

R01.11.02.03-T19 iOS Photos: crop and rotate a document photo to a straight A4 page

原始指令

In Photos on the iOS 18 Simulator, edit IMG_0300 (a tilted receipt): use crop with free aspect and the rotation dial to straighten it to within 1°, and crop tightly to the paper edges.

平台
ios · iOS/iPadOS
应用
Photos
交互表面
mob · 移动触控
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
touch · 触控手势 geom · 精确几何 drag · 拖放 vis · 视觉判断
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
4 / 5

建议验证方式

Rendered edited asset: text-line angle within ±1° (Hough on OCR boxes); paper occupies ≥ 90% of area with < 5% background on any edge. Host shell and xcrun simctl are withheld from the agent, so Photos.sqlite and host image tools are unavailable; the edit must be made in Photos.

建议部分得分

50% rotation within tolerance; 50% tight crop.

R01.11.02.03-T20 Control pair of T05: set the OsmAnd view via a geo intent

原始指令

Control pair of T05. With adb on the same AVD, open OsmAnd at Coit Tower, zoom 17, using an Android intent/URL scheme, and set bearing 45° via OsmAnd's API or settings, without touching the screen.

平台
and · Android lin · Linux
应用
adb · OsmAnd
交互表面
term · 终端 api · API / SDK
GUI 需求 · 任务设定
CL · CLI 足够
GUI 需求 · 普通权限
CL · CLI 足够
交互原语
code · 代码与命令
工作产物
WP08 · 应用 / 系统状态
条件
未声明
提案难度
2 / 5

建议验证方式

Same map-state checks as T05; input log shows no touch events. Reported as the CLI baseline for the gesture task.

建议部分得分

35% centre; 35% zoom; 30% bearing.

已有研究映射

当前映射未给此小类指定基准参考。

同工作流族的小类