Design review, measurement & reverse engineering
Interrogate models against rules and rebuild parametric CAD from scans or meshes.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- eDrawings · FreeCAD · SolidWorks ScanTo3D
- Class GUI-need label
HY· Hybrid
Digital-employee context
Project class assignments, not demonstrated employee capability or imported benchmark coverage. Acceptance criteria and value metrics are proposals; no ROI has been measured.
Related roles
- Engineering and technical design · Concrete engineering artifacts include constrained parts, valid edits/assemblies, drawings, measurements, FEA results and simulated toolpaths.
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R07.01.02.02-T01 eDrawings: measure arm-to-housing clearance and arm mass
Original instruction
Open input/actuator.easm in eDrawings. Measure the minimum clearance between parts 'arm' and 'housing' in the shown position, and the mass of 'arm' assuming Al 6061 (2.70 g/cm³) from its volume. Write {clearance_mm, arm_mass_g} to output/review.json.
- Platforms
win· Windowsmac· macOS- Applications
- eDrawings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickvis· Visual judgmentgeom· Precise geometry- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Values vs kernel-computed ground truth: clearance ±0.05 mm, mass ±1%. The .easm holds only display data readable by eDrawings (no API), so the measure and mass tools in the GUI are the route; answers without a measure session in the eDrawings log are flagged.
Proposed partial credit
50% clearance within tolerance; 50% mass within tolerance.
R07.01.02.02-T02 FreeCAD: convert an STL to a refined solid and report its volume
Original instruction
Import input/bracket.stl in FreeCAD, convert the mesh to a refined solid (Part › Create shape from mesh, then refine), export output/bracket_solid.step and write the solid's volume in mm³ to output/volume.txt.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & click- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
STEP is a valid closed solid (BRep check), volume within 1% of mesh volume; refined (planar faces merged: face count ≤ 1.2× reference); volume.txt ±1%.
Proposed partial credit
40% valid solid; 30% refined; 30% volume reported.
R07.01.02.02-T03 CloudCompare: fit a cylinder to a scanned bore and report diameter
Original instruction
Open input/housing_scan.ply in CloudCompare. Segment the main bore region and fit a cylinder (RANSAC Shape Detection or Fit › Cylinder). Report diameter and axis direction to output/bore.json.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- CloudCompare
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
path· Continuous pathclick· Point & clickvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Diameter within ±0.05 mm and axis within 0.5° of ground truth from the synthetic scan's source CAD; segmentation file (saved .bin) contains ≥ 80% bore points and < 5% outliers.
Proposed partial credit
60% diameter; 25% axis; 15% clean segmentation.
R07.01.02.02-T04 FreeCAD: section an STL at Z=15 and export the profile as DXF
Original instruction
In FreeCAD, cross-section input/housing.stl at Z=15 mm, convert the section to clean polylines/arcs (Draft), and export output/section_z15.dxf in mm.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
DXF closed loops vs reference section: Hausdorff < 0.2 mm, loop count equal, units mm; arcs fitted for holes (≤ 1 % radius error) earn the cleanliness credit.
Proposed partial credit
60% Hausdorff and loop count; 20% units/closure; 20% arcs fitted for circular features.
R07.01.02.02-T05 Count distinct fastener part numbers in a STEP assembly
Original instruction
Open input/gearbox.step in eDrawings or FreeCAD. Using the assembly tree and visual inspection, list every distinct fastener part number (screws, nuts, washers, pins) with its quantity in output/fasteners.csv (part_number,qty).
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- eDrawings · FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicknav· Pan/zoom/scrollvis· Visual judgment- Work product
WP02· Records/table- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
CSV set/quantities compared to ground truth from the STEP product structure; some fasteners share generic names and must be distinguished by geometry (length).
Proposed partial credit
60% part-number set (F1); 40% quantities exact.
R07.01.02.02-T06 SolidWorks ScanTo3D: parametric bracket from a scan within 0.02 Chamfer
Original instruction
From input/bracket_scan.ply, use SolidWorks ScanTo3D (mesh prep, surface/feature extraction) and parametric features to produce output/bracket.SLDPRT and STEP with at most 12 features, normalised Chamfer distance < 0.02 to the scan.
- Platforms
win· Windows- Applications
- SolidWorks ScanTo3D
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickvis· Visual judgmentgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Chamfer distance (normalised by bbox diagonal) on 50k samples < 0.02; feature count ≤ 12 via API; holes are true cylinders with diameters ±0.05 vs design intent table.
Proposed partial credit
50% Chamfer distance (scaled); 25% feature budget; 25% hole diameters.
R07.01.02.02-T07 SolidWorks Thickness Analysis: list regions thinner than 1.5 mm
Original instruction
Run Thickness Analysis on input/cover_molded.SLDPRT with target 1.5 mm. Record each thin region's location (centroid XYZ) and minimum thickness in output/thin_regions.csv, and add a 'DFM Note' custom property with the count.
- Platforms
win· Windows- Applications
- SolidWorks
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader's ray-cast thickness map identifies seeded thin regions; CSV rows matched by centroid within 3 mm; min thickness ±0.05; property count equals region count.
Proposed partial credit
60% regions found (F1); 25% thickness values; 15% property set.
R07.01.02.02-T08 eDrawings: review markups against a checklist
Original instruction
Review input/enclosure.easm against input/review_checklist.pdf (8 items: fastener access, cable bend radius, label area, etc.). For each failing item, add an eDrawings markup cloud with a comment starting with the item number, then save output/enclosure_markup.easm.
- Platforms
win· Windowsmac· macOS- Applications
- eDrawings
- Interfaces
desk· Desktop GUI- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickpath· Continuous pathvis· Visual judgmenttype· Text & forms- Work product
WP10· Annotations- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Markup file parsed: comments for exactly the seeded failing items (3 of 8) with correct item numbers; each cloud's 3D anchor lies near the relevant component (bbox test). The markup file must be saved by eDrawings (its app metadata is checked) and the agent has no shell or scripting host to write markups directly.
Proposed partial credit
60% correct failing items flagged (F1); 40% markups anchored at right components.
R07.01.02.02-T09 CloudCompare: as-built scan vs CAD deviation report
Original instruction
Align input/asbuilt.ply to input/design.step (tessellated) in CloudCompare with fine registration, compute cloud-to-mesh distances, and report the percentage of points within ±0.3 mm and the max deviation in output/deviation.json; save the coloured scalar-field image.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- CloudCompare
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickgeom· Precise geometryvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Grader recomputes after its own ICP: reported % within ±1 point and max deviation ±0.05 mm; registration RMS reported ≤ reference RMS × 1.2; image file present with colour scale.
Proposed partial credit
30% registration quality; 40% % within tolerance; 20% max deviation; 10% image.
R07.01.02.02-T10 Geomagic Design X: impeller rebuilt as parametric CAD from scan
Original instruction
In Geomagic Design X, rebuild input/impeller_scan.stl as parametric CAD: hub by revolve, one blade by lofted surfaces, circular pattern (7 blades), bore with keyway. Export output/impeller.step; mean deviation to scan ≤ 0.1 mm.
- Platforms
win· Windows- Applications
- Geomagic Design X
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
path· Continuous pathgeom· Precise geometryvis· Visual judgment- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Accuracy Analyzer equivalent computed by grader: mean deviation ≤ 0.1, 95th percentile ≤ 0.3 mm; blade count 7 by pattern; bore Ø ±0.02; STEP is a valid solid.
Proposed partial credit
50% deviation metrics; 20% pattern; 15% hub/bore; 15% valid solid.
R07.01.02.02-T11 FreeCAD: draft-angle check of a molded part for a parting direction
Original instruction
For input/clip_body.step with pull direction +Z, use FreeCAD's draft analysis (Part › Check geometry / Draft angle analysis add-on) to list every face with draft below 1°. Write face indices and their draft to output/draft_faces.csv.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Grader computes face drafts from the STEP; CSV face set F1 ≥ 0.95 and angles ±0.1°. Face indices follow the documented STEP order.
Proposed partial credit
70% face set; 30% angle values.
R07.01.02.02-T12 Onshape: compare two versions and list changed features
Original instruction
In Onshape document 'Housing-R', use Compare between versions V5 and V7 to find every feature added, removed or changed, and write them to output/changes.csv (feature,change_type,detail).
- Platforms
web· Any OS (web)- Applications
- Onshape
- Interfaces
brow· Browser- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scrollvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
CSV rows compared to the seeded change list (feature names, types); detail must contain the changed parameter for 'changed' rows.
Proposed partial credit
60% change set (F1); 25% change types; 15% detail parameter.
R07.01.02.02-T13 Fusion mesh workspace: convert a knob scan into a prismatic body
Original instruction
Import input/knob_scan.obj into Fusion, repair and reduce the mesh, and convert it to a prismatic BRep (Convert Mesh › Prismatic), then rebuild the bore as a true cylinder of the measured diameter. Export STEP.
- Platforms
win· Windowsmac· macOS- Applications
- Fusion
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickvis· Visual judgmentgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
STEP valid solid; planar/cylindrical faces recognised (face count ≤ 1.5× reference); bore is a cylindrical surface Ø ±0.1 of truth; overall deviation to scan ≤ 0.2 mm mean.
Proposed partial credit
30% prismatic conversion; 40% bore cylinder; 30% deviation.
R07.01.02.02-T14 MeshLab: Hausdorff distance between a printed scan and its STL
Original instruction
In MeshLab, align input/print_scan.ply to input/model.stl (point-pair alignment then ICP) and compute one-sided Hausdorff distance scan→model. Write mean, RMS and max to output/hausdorff.json.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- MeshLab
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Grader recomputes after its own alignment; values within 5% (mean/RMS) and 10% (max).
Proposed partial credit
40% alignment acceptable; 60% three metrics within tolerance.
R07.01.02.02-T15 FSAE impact attenuator rule compliance from CAD
Original instruction
Using input/front_bulkhead.step and the rule excerpt input/fsae_rules_T3.pdf, determine whether the impact attenuator mounting complies (attenuator size, anti-intrusion plate thickness, bolt count/size). Write compliant yes/no and the governing dimension with value to output/compliance.json.
- Platforms
win· Windowsmac· macOS- Applications
- eDrawings · FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickvis· Visual judgmentgeom· Precise geometry- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Answer vs expert ground truth: verdict exact, governing rule ID exact, measured value ±0.1 mm. Seeded case fails exactly one rule.
Proposed partial credit
40% verdict; 30% governing rule; 30% value.
R07.01.02.02-T16 SolidWorks: assembly mass properties and inertia check against spec
Original instruction
Open input/gimbal.SLDASM with materials assigned. Report the assembly centre of mass relative to the 'Pivot' coordinate system and principal moments of inertia to output/massprops.json, and state whether CoM lies within the Ø2 mm spec zone around the pivot axis.
- Platforms
win· Windows- Applications
- SolidWorks
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & click- Work product
WP12· Answer/decision- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Values vs kernel ground truth: CoM ±0.05 mm, inertias ±0.5%, boolean exact; must use the Pivot coordinate system (values differ from default origin).
Proposed partial credit
40% CoM in correct frame; 40% inertias; 20% verdict.
R07.01.02.02-T17 SolidWorks Design Checker: run company standard and fix violations
Original instruction
Run SolidWorks Design Checker on input/plate.SLDPRT with input/acme_std.swstd, then fix the five reported violations (units, material, custom properties, unconstrained sketches, hole standard) in the part. Rerun until clean and save.
- Platforms
win· Windows- Applications
- SolidWorks Design Checker
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader re-runs the standard via Design Checker API: 0 failures; geometry volume unchanged ±0.01%; each violation's fix verified individually.
Proposed partial credit
80% five violations fixed (16 each); 20% geometry unchanged.
R07.01.02.02-T18 Photogrammetry to scaled mesh and measured part dimensions
Original instruction
Build a mesh from the 48 photos in input/photos/ (turntable, includes a 100 mm scale bar) with Meshroom, scale it in MeshLab using the bar, and measure the part's overall length, width and the main hole diameter into output/measure.json.
- Platforms
win· Windowslin· Linux- Applications
- Meshroom · MeshLab
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
HY· Hybrid- Interaction primitives
click· Point & clickgeom· Precise geometryvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
multiapp· Multi-applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Measurements vs ground truth: overall dims ±0.5 mm, hole ±0.3 mm; scaled mesh file present and its scale bar length 100 ±0.3 mm.
Proposed partial credit
30% mesh reconstructed; 20% scale applied; 50% three measurements.
R07.01.02.02-T19 FreeCAD: wall thickness at a marked location via section view
Original instruction
input/tank.step has a red-marked face patch. In FreeCAD, create a section through the mark perpendicular to the wall and measure the wall thickness there. Write it to output/wall.txt (mm, 2 decimals).
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickgeom· Precise geometryvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Value within ±0.1 mm of kernel-computed thickness at the mark; the wall is drafted, so a measurement at the wrong location or angle fails.
Proposed partial credit
30% section at correct location; 70% thickness within tolerance.
R07.01.02.02-T20 Control pair of T03: bore cylinder fit with Open3D
Original instruction
Control pair of T03. Without a GUI, write scripts/fit_bore.py using Open3D/NumPy to segment the bore in input/housing_scan.ply and fit a cylinder; write the same output/bore.json fields.
- Platforms
lin· Linuxmac· macOSwin· Windows- Applications
- Open3D · Python
- Interfaces
term· Terminalapi· API/SDK- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commands- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same diameter (±0.05 mm) and axis (±0.5°) checks as T03; reported as the scripted baseline.
Proposed partial credit
70% diameter; 30% axis.
Mapped research references
Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.