Part from dimensioned drawing or spec
Sketch with full constraints and build features so the part matches dimensions and mass properties.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- SolidWorks · Fusion · Siemens NX · FreeCAD · Onshape
- Class GUI-need label
G2· GUI-essential
Digital-employee context
Project class assignments, not demonstrated employee capability or imported benchmark coverage. Acceptance criteria and value metrics are proposals; no ROI has been measured.
Related roles
- Engineering and technical design · Concrete engineering artifacts include constrained parts, valid edits/assemblies, drawings, measurements, FEA results and simulated toolpaths.
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R07.01.01.01-T01 FreeCAD: spacer washer with fully constrained sketch
Original instruction
In FreeCAD 1.0 PartDesign, model spacer per input/spacer.pdf: OD 30 mm, ID 10.5 mm, thickness 3 mm, 0.5 mm × 45° chamfer on both outer edges. The base sketch must be fully constrained. Save output/spacer.FCStd and export output/spacer.step.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
Grader opens the FCStd headless: Body with Pad and Chamfer features, sketch DoF=0, no recompute errors; STEP volume within 0.2% and bbox within 0.01 mm of reference. Python console and macros are disabled; FCStd without GUI-created feature history (e.g. Part::Feature solids) scores 0.
Proposed partial credit
30% sketch fully constrained; 40% volume/bbox; 30% feature types and clean recompute.
R07.01.01.01-T02 Onshape: regular hexagon pocket fully constrained in a plate
Original instruction
In Onshape (sandbox account), create Part Studio 'HexPlate': a 60 × 40 × 6 mm plate with a through hexagonal pocket inscribed in a Ø25 mm construction circle, centred, with one flat parallel to X. All sketch entities fully constrained. Export output/hexplate.step.
- Platforms
web· Any OS (web)- Applications
- Onshape
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Grader reads the document via Onshape REST (read-only key): sketch solver status fully defined, construction circle Ø25, feature list Extrude×2; STEP volume ±0.2%, hex flat orientation from face normals. Feature edits must come from browser sessions (document history client field); FeatureScript custom features disallowed.
Proposed partial credit
40% sketch fully defined with construction circle; 40% geometry; 20% orientation.
R07.01.01.01-T03 FreeCAD: flange with bolt circle and chamfer from drawing
Original instruction
Model input/flange.pdf in FreeCAD PartDesign: OD 120 mm, hub Ø50 × 20 mm, flange 12 mm thick, bore Ø30 H7 (model nominal), 6 × Ø10 holes on a Ø95 PCD (PolarPattern), 2 mm chamfer on the outer edge. Save FCStd and STEP.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
STEP volume within 0.5% and bbox within 0.05 mm of reference; hole centres on Ø95 ±0.02; FCStd tree contains Pad, Pocket/Hole, PolarPattern (6 occurrences), Chamfer; all sketches DoF=0. Python console disabled; GUI history required.
Proposed partial credit
30% overall volume/bbox; 30% hole pattern; 20% hub/bore; 20% feature tree and constraints.
R07.01.01.01-T04 SolidWorks: sheet-metal L-bracket with flat pattern DXF
Original instruction
In SolidWorks 2025, build input/bracket.pdf as sheet metal: 3 mm 5052-H32, inside bend radius 3 mm, K-factor 0.44, two Ø6.6 holes and a 10 × 30 slot on the flanges, relief per drawing. Save output/bracket.SLDPRT and export the flat pattern to output/bracket_flat.dxf.
- Platforms
win· Windows- Applications
- SolidWorks
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader (SolidWorks API, read-only) checks Sheet-Metal feature with thickness/radius/K-factor; mass with 5052 within 0.5%; DXF outer profile Hausdorff < 0.05 mm vs reference flat (developed length). VBA/macro execution disabled by policy; feature tree created in-session (no imported body).
Proposed partial credit
30% sheet-metal parameters; 30% 3D geometry/mass; 30% flat pattern DXF; 10% holes/slot positions.
R07.01.01.01-T05 Onshape: shelled enclosure with internal screw bosses
Original instruction
In Onshape, model a 120 × 80 × 40 mm box enclosure open at the top: 2 mm walls, 3 mm outside corner fillets, four Ø6 mm bosses with Ø2.5 mm pilot holes at the inside corners (4 mm from walls), bosses 3 mm below the rim. Export Parasolid output/enclosure.x_t.
- Platforms
web· Any OS (web)- Applications
- Onshape
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Parasolid volume within 0.5%, bbox exact ±0.05; boss axes positions ±0.05 mm; wall thickness probes at 12 points = 2.00 ±0.02. No FeatureScript features. The agent is issued no Onshape API keys or OAuth app, so edits can only come from the browser session (checked in document history).
Proposed partial credit
30% shell and outer geometry; 40% bosses position/size; 30% fillets and boss height.
R07.01.01.01-T06 Fusion: stepped shaft with keyway and retaining-ring grooves
Original instruction
In Fusion, model input/shaft.pdf: stepped shaft Ø20/Ø25/Ø20 with lengths 40/80/40 mm, 6 × 6 × 32 mm keyway on the Ø25 section (DIN 6885), two DIN 471 grooves for Ø20 rings, 1 mm chamfers. Assign AISI 1045 and export output/shaft.step.
- Platforms
win· Windowsmac· macOS- Applications
- Fusion
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
STEP volume within 0.3%, groove widths/diameters to DIN 471 table ±0.02 mm, keyway depth 3.5 mm in shaft; Fusion timeline (exported .f3d inspected) contains revolve/extrude-cut features; mass with 1045 within 0.5%. Fusion API scripts/add-ins disabled.
Proposed partial credit
30% shaft steps; 25% keyway; 25% grooves to standard; 20% material/mass.
R07.01.01.01-T07 SolidWorks: involute spur gear from first principles (no Toolbox)
Original instruction
In SolidWorks, model a spur gear per input/gear_spec.pdf: module 2, 24 teeth, 20° pressure angle, face width 15 mm, bore Ø12 with 4 mm keyway, root fillet 0.38m. Build the involute with an equation-driven curve; Toolbox and design-library gears are not allowed. Export output/gear.step.
- Platforms
win· Windows- Applications
- SolidWorks
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 5 / 5
Proposed verifier
Grader samples the STEP tooth flank and compares to the analytic involute: max deviation ≤ 0.02 mm; tip/root diameters ±0.02; 24 teeth by pattern; Toolbox metadata absent in SLDPRT. Macros disabled.
Proposed partial credit
40% involute flank accuracy; 20% tip/root diameters; 20% tooth count/pattern; 20% bore/keyway.
R07.01.01.01-T08 Fusion: knurled knob with D-shaft bore by revolve and pattern
Original instruction
Model a Ø32 × 18 mm knob in Fusion: revolved profile per input/knob.dxf, 30 straight knurl grooves (R0.8 mm) via circular pattern, and a 6 mm D-shaft bore with 0.5 mm flat, 12 mm deep. Export output/knob.step.
- Platforms
win· Windowsmac· macOS- Applications
- Fusion
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickgeom· Precise geometrytype· Text & forms- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
STEP volume ±0.5%; groove count 30 by cylindrical-face count; D-flat distance 2.5 ±0.02 mm from axis; profile Hausdorff to DXF revolve < 0.05 mm. Timeline required; API disabled.
Proposed partial credit
30% revolved profile; 30% knurl pattern; 30% D bore; 10% export.
R07.01.01.01-T09 SolidWorks: pump housing from a three-view drawing with Hole Wizard
Original instruction
Model input/pump_housing.pdf (three views, 25 dimensions, casting radii R3 unless noted) in SolidWorks. All threaded holes (4 × M6 × 12, 2 × G1/4) must be Hole Wizard features. Assign gray cast iron and export STEP.
- Platforms
win· Windows- Applications
- SolidWorks
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometryvis· Visual judgment- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 4 / 5
Proposed verifier
STEP volume within 0.5%, IoU ≥ 0.98 after alignment; Hole Wizard features with correct standard/size via API; mass ±0.5%. SolidWorks macros/VSTA and external API (COM) access are disabled for the agent, and imported or macro-built bodies are flagged (feature tree must originate in the interactive session).
Proposed partial credit
40% IoU/volume; 25% hole features correct; 20% fillets/casting radii; 15% material.
R07.01.01.01-T10 FreeCAD: reproduce a part from orthographic images with only overall size
Original instruction
input/views/ has front, top, right and isometric PNG renders of a machined block; only overall size 100 × 60 × 40 mm is dimensioned. Infer remaining features from the images (pixel-to-mm via the overall size) and model it in FreeCAD; export STEP.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
vis· Visual judgmentgeom· Precise geometryclick· Point & click- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
IoU with hidden reference after alignment: full credit ≥ 0.92, partial ≥ 0.8; feature count within ±3 of reference; bbox exact ±0.1. Python console disabled; GUI history required.
Proposed partial credit
60% IoU (scaled 0.8→0.92); 20% bbox; 20% feature topology (holes/pockets count).
R07.01.01.01-T11 Onshape: configurable hex standoff family
Original instruction
In Onshape, model an M3 hex standoff (5.5 mm A/F, female-female, M3 tapped both ends 6 mm deep) with a List configuration 'Length' = 6, 10, 15, 20 mm. Export each configuration as output/standoff_<L>.step.
- Platforms
web· Any OS (web)- Applications
- Onshape
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Configuration definition read via REST: list with 4 values; each STEP volume within 0.3% of reference; across-flats 5.50 ±0.02; tapped hole features (Hole feature with tapped M3) present. The agent is issued no Onshape API keys or OAuth app, so edits can only come from the browser session (checked in document history).
Proposed partial credit
30% configuration set up; 50% four exports correct; 20% hole features.
R07.01.01.01-T12 Siemens NX: molded cover with draft, ribs and uniform wall
Original instruction
In NX, model input/cover.pdf: 150 × 90 × 25 mm cover, 1.5° draft on all vertical faces from parting plane, 2 mm wall via Shell, 8 ribs 1.2 mm thick with 0.5° draft, R1 fillets on rib roots. Export output/cover.step.
- Platforms
win· Windows- Applications
- Siemens NX
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Grader draft analysis on STEP faces: all side faces ≥ 1.5° (ribs ≥ 0.5°); thickness probes 2.0 ±0.05; IoU ≥ 0.97; NX part file contains Draft/Shell/Rib features (read via NX Open in grader). Journal playback disabled for agent.
Proposed partial credit
30% draft compliance; 25% wall thickness; 25% ribs; 20% IoU.
R07.01.01.01-T13 Inventor: tubular handrail by sweep along a 3D sketch
Original instruction
In Inventor 2025, model input/handrail.pdf: Ø42.4 × 2.6 mm tube swept along a 3D path with three bends (R100 centreline) between given XYZ points, end caps 3 mm. Export output/handrail.step and report centreline length in the iProperties description.
- Platforms
win· Windows- Applications
- Inventor
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
STEP: tube OD/ID ±0.02, path Hausdorff to reference centreline < 0.2 mm, volume ±0.5%; iProperty Description equals centreline length ±0.5 mm. iLogic rules disallowed (none in file). VBA and iLogic are disabled in the agent's Inventor and no scripting host (PowerShell/Python) can reach its COM API, so the sweep must be modelled interactively.
Proposed partial credit
40% path accuracy; 30% tube section; 20% caps/volume; 10% reported length.
R07.01.01.01-T14 Fusion: ergonomic mouse shell lofted from guide curves
Original instruction
Import input/mouse_curves.dxf (top outline, side profile, 3 sections) into Fusion and build a closed solid mouse shell by loft/patch with G2 continuity across the top surface; shell inward 1.8 mm leaving the bottom open. Export output/mouse.step.
- Platforms
win· Windowsmac· macOS- Applications
- Fusion
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
path· Continuous pathgeom· Precise geometryvis· Visual judgment- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 5 / 5
Proposed verifier
Surface deviation of the outer skin vs reference ≤ 0.3 mm at 95% of 5,000 samples; curvature continuity check across loft seams (no tangency breaks > 1°); wall thickness 1.8 ±0.05 at probes. Fusion's Scripts and Add-Ins dialog and Text Commands window are disabled in the agent's install, so the loft can only be modelled interactively.
Proposed partial credit
50% surface deviation; 20% continuity; 20% shell thickness; 10% bottom open/closed solid validity.
R07.01.01.01-T15 SolidWorks: weldment frame with cut list lengths
Original instruction
In SolidWorks, build the frame in input/frame.pdf as a weldment: 40 × 40 × 3 square tube (ISO), mitred corners, end-trimmed cross members, 4 base plates 100 × 100 × 8. Update the cut list so item lengths and quantities match and save output/frame.SLDPRT.
- Platforms
win· Windows- Applications
- SolidWorks
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickgeom· Precise geometrytype· Text & forms- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader reads cut-list folders via API: lengths and quantities equal reference ±0.1 mm; structural member profile ISO 40×40×3; total mass ±0.5%; no interferences between members (interference detection volume 0). SolidWorks macros, VBA and API add-ins are disabled for the agent, and a file-write audit fails any frame.SLDPRT not saved by the SolidWorks UI process.
Proposed partial credit
40% cut list exact; 30% profiles/trims; 20% mass; 10% no interference.
R07.01.01.01-T16 FreeCAD SheetMetal: vented lid with louvres and flat pattern
Original instruction
In FreeCAD with the SheetMetal workbench, model input/lid.pdf: 1.5 mm steel lid 200 × 150 with 15 mm flanges, bend radius 1.5, K 0.4, and 6 louvres per drawing. Save FCStd and unfold to output/lid_flat.dxf.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD · SheetMetal workbench
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
3D STEP volume ±0.5%; DXF flat outer boundary within 0.1 mm of reference developed size; louvre count and positions ±0.1. Python console disabled; GUI history required.
Proposed partial credit
30% base and flanges; 30% louvres; 40% flat pattern.
R07.01.01.01-T17 Siemens NX: turned pin with undercut and thread from drawing
Original instruction
In NX, model input/pin.pdf: turned pin Ø16 h6 × 70 with M12 × 1.25 thread (symbolic) 20 mm long, DIN 509 undercut type F, cross-hole Ø4, 0.5 × 45° chamfers. Export output/pin.step and keep thread as an NX Thread feature.
- Platforms
win· Windows- Applications
- Siemens NX
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
STEP volume ±0.3%; undercut geometry matches DIN 509 F table ±0.02; cross-hole position ±0.02; NX Open read of the .prt lists Thread feature (symbolic, M12×1.25). NX journal playback and NX Open execution are disabled in the agent's NX session, so the pin must be modelled interactively.
Proposed partial credit
30% body; 25% undercut; 20% cross-hole; 25% thread feature.
R07.01.01.01-T18 Onshape: tune a pocket depth to hit a mass target
Original instruction
In Onshape document 'Mount', the 6061 bracket must weigh 250.0 g ±0.5 g. Add a variable #pocket_depth driving the existing side pockets and adjust it (keeping ≥ 2 mm floor) until mass properties show the target. Do not change other dimensions.
- Platforms
web· Any OS (web)- Applications
- Onshape
- Interfaces
brow· Browser- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
REST mass-properties call: 249.5–250.5 g with 6061 density; variable feature exists and drives both pockets; floor thickness ≥ 2 mm; all other dimension values unchanged vs snapshot. The agent is issued no Onshape API keys or OAuth app, so edits can only come from the browser session (checked in document history).
Proposed partial credit
30% variable created and wired; 50% mass in range; 20% constraints respected.
R07.01.01.01-T19 FreeCAD: counterbored mounting plate with coloured machined faces
Original instruction
Model input/plate.pdf in FreeCAD: 160 × 100 × 12 mm plate, 8 × M5 counterbores (ISO 4762), a 10 × 30 mm slot, 1 mm edge chamfers. Colour all machined (counterbore, slot) faces red and export STEP AP214 with colours.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- FreeCAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
STEP volume ±0.3%; counterbore Ø10/5.5 depth 5.4 (ISO 4762 M5 clearance) ±0.05; STEP face-colour entities red on exactly the counterbore and slot faces. GUI-created Hole/Pocket features required. FreeCAD's Python console and Macro menu are disabled in the agent's build and FreeCADCmd is absent, so features can only be made in the GUI.
Proposed partial credit
40% geometry; 30% counterbore spec; 30% face colours.
R07.01.01.01-T20 Control pair of T03: flange via CadQuery script
Original instruction
Control pair of T03. Without a CAD GUI, write scripts/flange.py with CadQuery that builds the same flange from input/flange.pdf and exports output/flange_cq.step.
- Platforms
lin· Linuxmac· macOSwin· Windows- Applications
- CadQuery
- Interfaces
term· Terminalapi· API/SDK- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commands- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same STEP checks as T03 (volume ±0.5%, bbox, hole PCD). Feature-tree checks do not apply; reported as the scripting baseline for the GUI task.
Proposed partial credit
40% volume/bbox; 40% hole pattern; 20% hub/bore.
Mapped research references
Existing benchmark-to-class links from the research catalog. They are not record-level annotations, executions or product endorsements.