计算机使用智能体分类English
R03.08.01.01 · 任务小类

图像框、多边形与掩码

Image boxes, polygons & masks

Label objects in images to an IoU threshold against reference annotations.

20 条本项目编写的提案 · 分类 v1.1 · 新增基准运行 0 次。下方验证方式与部分得分规则是设计,不是执行结果。

典型应用
CVAT · Label Studio · labelme
小类 GUI 需求标签
G3 · 仅 GUI

任务提案 · 20

展开查看完整原文与建议检查方式;两种界面均保留提案英文原文。

R03.08.01.01-T01 Box every car in a traffic set (CVAT)

原始指令

In CVAT, open the project 'traffic10' (10 street images) and draw a tight bounding box labeled 'car' around every car. Include partially visible cars at image edges. Export as COCO when done.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Exported COCO matched to hidden gold: mean IoU >= 0.7 and recall >= 0.9 for class car. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

40% recall of cars; 40% mean IoU >= 0.7; 20% edge cars included

R03.08.01.01-T02 Polygon around a lake (satellite)

原始指令

In Label Studio, open sat_lake.png and draw a polygon labeled 'water' that traces the lake shoreline, following the inlets. Submit the task.

平台
web · 任意系统(网页)
应用
Label Studio
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
path · 连续路径 vis · 视觉判断 click · 指向与点击
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Polygon-to-gold IoU >= 0.85 for the lake region. Graded on the exported polygon; in-tool vertex placement required. Label Studio API tokens are disabled for the agent and import is turned off, so annotations can be submitted only from the labeling UI; each must carry a non-zero lead_time.

建议部分得分

50% lake covered (IoU>=0.7); 50% tight shoreline (IoU>=0.85)

R03.08.01.01-T03 Instance mask for a product (labelme)

原始指令

In labelme, open bottle.jpg and draw a polygon mask labeled 'bottle' around the single product, excluding the shadow. Save the .json next to the image.

平台
win · Windows mac · macOS lin · Linux
应用
labelme
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
path · 连续路径 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
2 / 5

建议验证方式

The saved labelme polygon has IoU >= 0.85 to the gold mask and excludes the shadow region. Graded on the .json geometry. The desktop has no terminal or Python interpreter (labelme runs as a frozen executable), and a file-access audit must show labelme as the only process that wrote the .json.

建议部分得分

60% object masked (IoU>=0.75); 40% shadow excluded (IoU>=0.85)

R03.08.01.01-T04 Rotated boxes for document text regions

原始指令

In CVAT, annotate scan_doc1.png and scan_doc2.png with rotated bounding boxes labeled 'textline' around each slanted line of text, matching the line orientation. Export the rotated-box annotations.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
4 / 5

建议验证方式

Rotated boxes match gold with mean IoU >= 0.7 and angle error <= 8 degrees per line; recall >= 0.9. Graded on the exported rotated boxes (in-tool rotation handles used). CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

40% all lines boxed; 30% IoU >= 0.7; 30% angle error <= 8 deg

R03.08.01.01-T05 Human-pose keypoints on synthetic figures

原始指令

In CVAT, label the 17 COCO-style body keypoints on each of the 8 synthetic rendered figures in project 'pose8', marking occluded joints with the visibility flag rather than skipping them.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Mean keypoint position error (OKS) >= 0.8 vs gold and visibility flags match >= 90%. Graded on the exported keypoints. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

30% all joints placed; 40% OKS >= 0.8; 30% visibility flags correct

R03.08.01.01-T06 Fix five mislabeled boxes

原始指令

In CVAT project 'review5', the review notes list 5 boxes labeled 'truck' that should be 'bus'. Change exactly those 5 labels and leave all other annotations untouched. Re-export.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
2 / 5

建议验证方式

The 5 flagged boxes are relabeled bus and the class diff vs the original is exactly those 5; no geometry changed. Graded on the label diff. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

60% all 5 relabeled; 40% nothing else changed

R03.08.01.01-T07 Add occlusion attribute to hidden objects

原始指令

In Label Studio project 'occ', every person box exists but the 'occluded' attribute is unset. Set occluded=true on every person who is partially hidden by another object and leave fully visible people as false. Submit all tasks.

平台
web · 任意系统(网页)
应用
Label Studio
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
click · 指向与点击 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

The occluded attribute matches gold for >= 90% of person instances. Graded on the attribute diff vs gold. Label Studio API tokens are disabled for the agent and import is turned off, so annotations can be submitted only from the labeling UI; each must carry a non-zero lead_time.

建议部分得分

50% occluded set where hidden; 50% visible left false (at least 90 percent overall)

R03.08.01.01-T08 Instance polygons for synthetic cells

原始指令

In CVAT, open the synthetic microscopy image micro_01.png and draw a separate polygon labeled 'cell' around each cell instance, splitting touching cells into distinct instances. Export instance polygons.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
path · 连续路径 vis · 视觉判断 geom · 精确几何
工作产物
WP10 · 标注
条件
未声明
提案难度
4 / 5

建议验证方式

Instance mask AP (IoU 0.5) >= 0.75 vs gold, with the correct instance count (+/-2) and touching cells separated. Graded on exported instance polygons. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

30% cells detected; 30% instances separated; 40% mask IoU/AP threshold

R03.08.01.01-T09 Dense retail shelf product boxes

原始指令

In CVAT, annotate shelf.jpg with a bounding box labeled 'product' around every item on the shelf (densely packed, many overlapping). Aim for complete recall on the front-facing products.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 vis · 视觉判断 nav · 平移 / 缩放 / 滚动
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Recall >= 0.85 and mean IoU >= 0.65 for front-facing products vs gold. Graded on the exported boxes; in-tool drawing required. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

50% product recall; 30% IoU threshold; 20% no duplicate boxes

R03.08.01.01-T10 Semantic road segmentation mask

原始指令

In CVAT (or Label Studio brush), paint a semantic mask on street_seg.png with classes 'road', 'sidewalk', and 'background', covering the whole image with no unlabeled pixels. Export the segmentation mask.

平台
web · 任意系统(网页)
应用
CVAT · Label Studio
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
path · 连续路径 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
4 / 5

建议验证方式

Per-class mean IoU >= 0.8 vs gold and <1% of pixels left unlabeled. Graded on the exported mask. Neither CVAT nor Label Studio issues the agent an API token and annotation import is disabled in both, so the mask can be produced only by painting in the browser UI.

建议部分得分

30% road IoU; 30% sidewalk IoU; 40% full coverage (no unlabeled)

R03.08.01.01-T11 Multi-class vehicle and person boxes

原始指令

In CVAT project 'multi12' (12 images), box every instance of classes car, bus, person, and bicycle with the correct label. Export COCO.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Per-class recall >= 0.85 and mean IoU >= 0.7 vs gold; class confusion < 5%. Graded on the exported COCO. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

40% per-class recall; 40% IoU threshold; 20% low class confusion

R03.08.01.01-T12 Label small traffic signs with zoom

原始指令

In CVAT, annotate highway.jpg with tight boxes labeled 'sign' around every traffic sign, including distant ones that require zooming in. Small signs must still be tightly bounded.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 nav · 平移 / 缩放 / 滚动 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
4 / 5

建议验证方式

Recall >= 0.9 including small (<32px) signs; mean IoU >= 0.6 for small and >= 0.75 overall vs gold. Graded on exported boxes. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

40% overall recall; 30% small-sign recall; 30% IoU thresholds

R03.08.01.01-T13 Camera-trap animal boxes

原始指令

In Label Studio, box every animal in the 15 camera-trap images of project 'wild15' with label 'animal', including animals that are motion-blurred or at the frame edge. Skip empty images (mark as reviewed).

平台
web · 任意系统(网页)
应用
Label Studio
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Recall >= 0.85 and mean IoU >= 0.6 vs gold; empty images correctly left with no boxes. Graded on exported boxes. Label Studio API tokens are disabled for the agent and import is turned off, so annotations can be submitted only from the labeling UI; each must carry a non-zero lead_time.

建议部分得分

40% animal recall; 30% IoU threshold; 30% empty images handled

R03.08.01.01-T14 Irregular boundary polygons (leaves)

原始指令

In labelme, open leaves3.jpg and draw a polygon mask labeled 'leaf' around each of the three leaves, following the serrated edges closely. Save the .json.

平台
win · Windows mac · macOS lin · Linux
应用
labelme
交互表面
desk · 桌面 GUI
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
path · 连续路径 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Each leaf polygon has IoU >= 0.8 to gold with boundary adherence (mean contour distance below threshold). Graded on the saved polygons. The desktop has no terminal or Python interpreter (labelme runs as a frozen executable), and a file-access audit must show labelme as the only process that wrote the .json.

建议部分得分

40% three leaves masked; 30% IoU >= 0.75; 30% edge adherence

R03.08.01.01-T15 Tighten loose boxes

原始指令

In CVAT project 'tighten', 12 car boxes are drawn too loosely. Resize each so it tightly bounds the car without clipping it. Do not add or remove boxes.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
2 / 5

建议验证方式

After editing, mean IoU to gold rises to >= 0.85 for the 12 boxes and the box count is unchanged. Graded on the IoU improvement. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

50% all boxes tightened; 50% mean IoU >= 0.85

R03.08.01.01-T16 Brush defect regions on synthetic parts

原始指令

In CVAT, paint a brush mask labeled 'defect' over the scratch and dent regions on part_01.png and part_02.png. Leave clean surface unlabeled. Export masks.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
path · 连续路径 vis · 视觉判断
工作产物
WP10 · 标注
条件
未声明
提案难度
3 / 5

建议验证方式

Defect-mask IoU >= 0.7 vs gold on both images with precision >= 0.8 (little over-paint onto clean areas). Graded on the exported masks. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

50% defects covered (IoU); 50% precision (no over-paint)

R03.08.01.01-T17 Overlapping instances with distinct IDs

原始指令

In CVAT, annotate crowd_small.jpg where several people overlap; draw a separate box per person with a unique instance id even where bodies occlude each other, labeling the visible extent of each. Export.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 vis · 视觉判断 nav · 平移 / 缩放 / 滚动
工作产物
WP10 · 标注
条件
未声明
提案难度
4 / 5

建议验证方式

Instance count matches gold (+/-1), each person has a distinct id, and mean IoU >= 0.6 for visible extents. Graded on exported instances. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

40% correct instance count; 30% distinct ids; 30% IoU threshold

R03.08.01.01-T18 Count-focused dense crowd heads

原始指令

In CVAT, place a tight box labeled 'head' on every visible head in stadium.jpg (a dense crowd). Maximize recall; aim for complete coverage of the lower-and-mid stands where heads are resolvable.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 geom · 精确几何 nav · 平移 / 缩放 / 滚动 vis · 视觉判断
工作产物
WP10 · 标注
条件
long · 长流程
提案难度
5 / 5

建议验证方式

Recall >= 0.8 over resolvable heads vs gold with precision >= 0.85 (few false boxes) and count within 10% of gold. Graded on exported boxes. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

40% head recall; 30% count within 10 percent of gold; 30% precision

R03.08.01.01-T19 Organ boundary segmentation to Dice

原始指令

In CVAT, trace a polygon labeled 'organ' around the target structure in each of the 6 synthetic cross-section images of project 'organ6', following the boundary precisely. Export masks.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
path · 连续路径 vis · 视觉判断 nav · 平移 / 缩放 / 滚动
工作产物
WP10 · 标注
条件
long · 长流程
提案难度
5 / 5

建议验证方式

Mean Dice >= 0.9 vs gold across the 6 images with boundary (Hausdorff) error below threshold. Graded on the exported masks. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

40% organ segmented on all images; 30% Dice >= 0.85; 30% Dice >= 0.9 + boundary

R03.08.01.01-T20 Combined boxes and masks to a joint threshold

原始指令

In CVAT project 'joint8' (8 urban images), produce boxes for classes car/person and instance polygon masks for class 'building', all with correct labels. Export a COCO file containing both box and segmentation annotations.

平台
web · 任意系统(网页)
应用
CVAT
交互表面
brow · 浏览器
GUI 需求 · 任务设定
G3 · 仅 GUI
GUI 需求 · 普通权限
G2 · GUI 必要
交互原语
drag · 拖放 path · 连续路径 geom · 精确几何 vis · 视觉判断
工作产物
WP10 · 标注
条件
long · 长流程
提案难度
5 / 5

建议验证方式

Box recall >= 0.85 and IoU >= 0.7 for car/person, and building mask AP(0.5) >= 0.75 vs gold; the single export contains both annotation types. Graded on the combined COCO. CVAT accepts only browser sessions (CSRF + session cookie, no API token), annotation import and auto-annotation are disabled for the agent role, and the client event log must show the shapes drawn in the UI.

建议部分得分

35% car/person boxes meet threshold; 35% building masks meet AP; 30% single valid combined export

已有研究映射

当前映射未给此小类指定基准参考。

同工作流族的小类