Geological, reservoir & mine modeling
Build geological or resource models and plan extraction to constraints.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- Petrel · Leapfrog Geo · Surpac
- Class GUI-need label
G2· GUI-essential
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R07.11.01.01-T01 Import and validate a drillhole database in Leapfrog Geo
Original instruction
In Leapfrog Geo, create project 'Kestrel' and import collars, surveys, lithology and assay tables from fixtures/kestrel_dh/*.csv. Resolve every validation error (overlapping intervals, missing collars, depth beyond EOH) using the Leapfrog error tools per input/fix_rules.md, and save.
- Platforms
win· Windows- Applications
- Leapfrog Geo
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP02· Records/table- Conditions
licensed· Licensed pro app- Proposed difficulty
- 2 / 5
Proposed verifier
Grader exports the drillhole tables from the saved project: 64 holes, zero remaining validation errors, each fix matches the rule set (e.g., truncate vs ignore) row by row; source CSVs unchanged. Grader exports objects from the saved project in its own Leapfrog session; API/Python access is disabled in the agent VM.
Proposed partial credit
30% tables imported with correct column mapping; 50% errors resolved per rules; 20% no CSV edits.
R07.11.01.01-T02 Build a three-unit geological model from drillhole contacts
Original instruction
In Leapfrog Geo project fixtures/kestrel.lfproj, build a geological model with chronology: Basement, deposit 'Sandstone', deposit 'Shale', and erosion 'Cover', using contact points from the 'lith' table, with model extents from input/extents.csv at 10 m resolution. Export the three contact surfaces as .obj.
- Platforms
win· Windows- Applications
- Leapfrog Geo
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clickdrag· Drag & drop- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Grader: contact surfaces honor >=95% of drillhole contacts within 0.5 m; chronology order and contact types (deposit/erosion) exact; extents and resolution exact. Grader exports objects from the saved project in its own Leapfrog session; API/Python access is disabled in the agent VM.
Proposed partial credit
20% chronology correct; 20% extents/resolution; 60% surfaces honor contacts.
R07.11.01.01-T03 Model a gold vein and edit it to a geologist's interpretation
Original instruction
In fixtures/vein_project.lfproj, build a vein from the 'qv' intervals with hanging-wall and footwall surfaces, then add the interpretation polylines in input/vein_interp.dxf and adjust so the vein pinches out north of section 4200N and honors all intercepts. Export the vein solid.
- Platforms
win· Windows- Applications
- Leapfrog Geo
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickpath· Continuous pathgeom· Precise geometryvis· Visual judgment- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader: vein solid contains >=95% of qv intercepts, excludes all non-qv intervals by >=0.5 m, zero volume north of 4200N, polylines used as vein inputs. Grader exports objects from the saved project in its own Leapfrog session; API/Python access is disabled in the agent VM.
Proposed partial credit
40% intercepts honored; 20% no false inclusion; 25% pinch-out; 15% polylines incorporated.
R07.11.01.01-T04 Interpret a seismic horizon and faults in Petrel
Original instruction
In Petrel project fixtures/northsea_synth.pet, interpret the Top Chalk horizon on the 3D seismic cube using seeded 3D autotracking with manual infill every 20th inline/crossline, interpret the 3 major faults with fault sticks, and create a gridded time surface. Save the project.
- Platforms
win· Windows- Applications
- Petrel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickpath· Continuous pathvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 4 / 5
Proposed verifier
Grader exports the horizon and faults: horizon RMS time error vs synthetic truth <=4 ms over >=95% of the survey area; fault sticks within 50 m of true fault planes for all 3 faults. Grader exports objects via its own Ocean plugin from the saved project; Ocean/Python (Prizm) workflows are disabled for the agent and logged.
Proposed partial credit
45% horizon accuracy and coverage; 35% faults; 20% gridded surface created.
R07.11.01.01-T05 Pick formation tops across eight wells using log correlation
Original instruction
In Petrel project fixtures/field_b.pet, display GR, RHOB and NPHI in a well section for the 8 wells and pick tops Top_Reservoir, Mid_Shale and Base_Reservoir in each well following input/correlation_guide.pdf. Save the well tops.
- Platforms
win· Windows- Applications
- Petrel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickvis· Visual judgmentnav· Pan/zoom/scroll- Work product
WP10· Annotations- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Grader exports well tops: each of 24 picks within 1.5 m MD of the reference interpretation. Grader exports objects via its own Ocean plugin from the saved project; Ocean/Python (Prizm) workflows are disabled for the agent and logged.
Proposed partial credit
50% fraction of the 24 picks within 4 m MD; 50% fraction of the 24 picks within 1.5 m MD.
R07.11.01.01-T06 Build a faulted 3D grid and compute STOOIP in Petrel
Original instruction
In fixtures/field_c.pet, build a pillar grid from the 4 interpreted faults and 3 horizons, define 2 zones with proportional layering (8 and 12 layers), upscale porosity and NTG logs, populate with SGS using input/variograms.json, set the OWC at 2,140 m TVDSS and compute STOOIP per zone.
- Platforms
win· Windows- Applications
- Petrel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP07· Simulation result- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Grader exports the grid: fault and horizon honoring (cell corner residual <2 m), zone/layer counts exact, upscaled cells match logs; STOOIP per zone within 3% of reference realization (fixed seed). Grader exports objects via its own Ocean plugin from the saved project; Ocean/Python (Prizm) workflows are disabled for the agent and logged.
Proposed partial credit
25% grid and faults; 15% zonation/layering; 25% property modeling; 35% volumes.
R07.11.01.01-T07 Design a pit bench layout from a toe string in Surpac
Original instruction
In GEOVIA Surpac, from the pit bottom toe string fixtures/pit_toe.str, design the pit to surface with 10 m benches, 5 m berms, 70 deg batter angles and a 25 m wide ramp at 10% grade, intersect with the topography DTM fixtures/topo.dtm and report the excavation volume.
- Platforms
win· Windows- Applications
- Surpac
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clickpath· Continuous pathgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader parses the design strings and DTM: bench heights, berm widths and batter angles within 0.5 m/1 deg; ramp width and grade within tolerance; volume within 1% of reference. Surpac TCL/SCL macro execution is disabled; the macro log must be empty.
Proposed partial credit
30% bench geometry; 30% ramp; 20% intersection with topography; 20% volume.
R07.11.01.01-T08 Report tonnes above cutoff from a constrained block model in Surpac
Original instruction
In Surpac, open block model fixtures/kestrel.mdl, constrain it by the solid fixtures/ore_domain.dtm and report tonnes and average Au grade above 0.5 g/t using the density attribute. Write output/report.csv.
- Platforms
win· Windows- Applications
- Surpac
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP12· Answer/decision- Conditions
licensed· Licensed pro app- Proposed difficulty
- 2 / 5
Proposed verifier
Grader computes the constrained report: tonnes within 0.5% and grade within 0.01 g/t. Surpac TCL/SCL macro execution is disabled; the macro log must be empty.
Proposed partial credit
40% constraint applied correctly; 30% tonnes; 30% grade.
R07.11.01.01-T09 Interpolate gold grade shells with a numeric model in Leapfrog
Original instruction
In fixtures/kestrel.lfproj, create an RBF numeric model of Au composites (2 m) inside the 'Ore' domain using the spheroidal interpolant and trend from input/rbf_params.json, generate 0.5 and 1.0 g/t isosurfaces, and report their volumes.
- Platforms
win· Windows- Applications
- Leapfrog Geo
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Grader: interpolant parameters and trend exact; domain boundary used; isosurface volumes within 2% of reference. Grader exports objects from the saved project in its own Leapfrog session; API/Python access is disabled in the agent VM.
Proposed partial credit
40% interpolant setup; 20% domain/compositing; 40% shell volumes.
R07.11.01.01-T10 Generate nested pit shells and pick the optimal shell
Original instruction
Using GEOVIA Whittle with block model fixtures/kestrel_whittle.mod, economics from input/economics.xlsx (price, costs, recovery) and slope regions from input/slopes.csv, run a pit optimization with revenue factors 0.3-1.5, then pick the shell maximizing discounted cash flow for the specified schedule.
- Platforms
win· Windows- Applications
- GEOVIA Whittle · Excel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP07· Simulation result- Conditions
licensed· Licensed pro applong· Long-horizonmultiapp· Multi-app- Proposed difficulty
- 5 / 5
Proposed verifier
Grader reopens the project: economics and slopes exact; shell tonnages within 1% of reference run; chosen shell number matches reference max-DCF shell. Excel macros are blocked and the agent VM has no terminal, so the optimization can only be run in the Whittle GUI; project files edited outside Whittle are detected via the file audit log.
Proposed partial credit
30% inputs; 20% slopes; 25% shell tonnages; 25% optimal shell selection.
R07.11.01.01-T11 Map faults on a coherence attribute in OpendTect
Original instruction
In OpendTect, open survey fixtures/f3_synth, compute a similarity (coherence) attribute volume, extract it on the tracked horizon 'H2', and digitize the 4 major fault traces on the horizon map as polylines. Export them to output/faults.txt.
- Platforms
win· Windowsmac· macOSlin· Linux- Applications
- OpendTect
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickpath· Continuous pathvis· Visual judgment- Work product
WP10· Annotations- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Grader: attribute definition parameters valid; each digitized fault within 40 m (mean distance) of true trace and >=80% of its length covered. OpendTect's Python environment and batch command-line programs are disabled in the agent VM, so the attribute and fault polylines can only be made in the GUI.
Proposed partial credit
20% attribute computed; 20% horizon extraction; 60% fault traces (15 pts each).
R07.11.01.01-T12 Build the three-unit model with GemPy (control pair of T02)
Original instruction
Control pair of T02: with GemPy in Python, build the same chronology (Basement, Sandstone, Shale, Cover erosion) from the T02 contact points exported in input/contacts.csv and orientations in input/orient.csv, compute on a 10 m grid and export the three surfaces as .obj.
- Platforms
mac· macOSwin· Windowslin· Linux- Applications
- GemPy · Python
- Interfaces
term· Terminal- GUI need · task setting
CL· CLI-sufficient- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
code· Code & commands- Work product
WP04· 3D/spatial model- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Control pair of T02: surfaces honor >=95% of contacts within 0.5 m; stack order and erosion relation exact; script reruns.
Proposed partial credit
20% stack order; 60% contact honoring; 20% reproducible script.
R07.11.01.01-T13 Plan a deviated well to two targets around a fault zone in Petrel
Original instruction
In fixtures/field_c.pet, design a well path from surface location SL-7 hitting target T1 (within 25 m radius) and T2 (within 25 m) in sequence, keeping >=100 m from the fault zone polygon at reservoir level and dogleg severity <=3 deg/30 m. Export the survey.
- Platforms
win· Windows- Applications
- Petrel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickdrag· Drag & dropgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader exports the well survey: target hits within radius, min distance to fault surface >=100 m, max DLS <=3 deg/30 m (minimum-curvature recomputation). Grader exports objects via its own Ocean plugin from the saved project; Ocean/Python (Prizm) workflows are disabled for the agent and logged.
Proposed partial credit
30% T1; 30% T2; 20% fault standoff; 20% DLS.
R07.11.01.01-T14 Composite assays and set up domains in Leapfrog Geo
Original instruction
In fixtures/kestrel.lfproj, create 2 m composites of the Au assays within the 'Ore' and 'Waste' domains (minimum length 0.5 m, residuals distributed), view the domain statistics and export composites to output/composites.csv and statistics to output/stats.csv.
- Platforms
win· Windows- Applications
- Leapfrog Geo
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP02· Records/table- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Grader recomputes compositing with the same rules: interval count and length-weighted grade per domain within 0.5%; stats (mean, CV, max) within 1%. Grader exports objects from the saved project in its own Leapfrog session; API/Python access is disabled in the agent VM.
Proposed partial credit
40% compositing rules; 30% composites match; 30% stats.
R07.11.01.01-T15 Design underground stopes from a grade shell with the stope optimiser
Original instruction
In Surpac, run the stope optimiser on block model fixtures/ug_vein.mdl with stope 20 m strike x 25 m height, minimum width 3 m, dip 60-90 deg and cutoff 3.5 g/t, then export stope solids and a tonnage/grade report.
- Platforms
win· Windows- Applications
- Surpac
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
CL· CLI-sufficient- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Grader: optimiser parameters exact; stope solids valid and closed; total tonnes within 2% and grade within 0.05 g/t of the reference run. Surpac TCL/SCL macro execution is disabled; the macro log must be empty.
Proposed partial credit
35% parameters; 20% solids valid; 45% tonnes and grade.
R07.11.01.01-T16 Load LAS logs and build a log template with cutoffs in Petrel
Original instruction
In Petrel project fixtures/field_b.pet, import LAS files for 5 wells from fixtures/las/, create a log template showing GR (0-150 API, shading below 75 API), RHOB and NPHI on a shared track with crossover fill, and save the template.
- Platforms
win· Windows- Applications
- Petrel
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP03· Visual layout- Conditions
licensed· Licensed pro app- Proposed difficulty
- 2 / 5
Proposed verifier
Grader exports wells and template settings: 5 wells with 3 logs each mapped to the right global log types; template track scales and fills as specified. Grader exports objects via its own Ocean plugin from the saved project; Ocean/Python (Prizm) workflows are disabled for the agent and logged.
Proposed partial credit
40% LAS import and mapping; 60% template settings.
R07.11.01.01-T17 History-match a sector model by region permeability multipliers
Original instruction
fixtures/sector.pet couples Petrel with an ECLIPSE deck. Adjust permeability multipliers in the 4 regions (0.2-5.0) so the simulated water cut at wells P1-P3 matches input/observed_wct.csv with RMSE <=0.05 over the history period. Save the case and output/multipliers.csv.
- Platforms
win· Windows- Applications
- Petrel · ECLIPSE
- Interfaces
desk· Desktop GUIterm· Terminal- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
HY· Hybrid- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP07· Simulation result- Conditions
licensed· Licensed pro applong· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Grader reruns the saved case: water-cut RMSE <=0.05 per well (partial to 0.10); multipliers within bounds; only region multipliers changed.
Proposed partial credit
20% multipliers within bounds and nothing else changed; 80% RMSE per well (pro-rata).
R07.11.01.01-T18 Produce annotated cross-sections through a Leapfrog model
Original instruction
In fixtures/kestrel.lfproj, create 3 serial cross-sections at 4100N, 4200N and 4300N (50 m width) showing the geological model, drillholes within 25 m colored by lithology, and export them to output/sections.pdf with a legend and scale bar.
- Platforms
win· Windows- Applications
- Leapfrog Geo
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP03· Visual layout- Conditions
licensed· Licensed pro app- Proposed difficulty
- 3 / 5
Proposed verifier
Grader checks the project's section objects (positions, widths) and the PDF: 3 pages, legend text, scale bar, drillhole labels present (text extraction); visual check by VLM rubric for model display (stated). Grader exports objects from the saved project in its own Leapfrog session; API/Python access is disabled in the agent VM.
Proposed partial credit
40% section definitions; 30% PDF pages and labels; 30% content rubric.
R07.11.01.01-T19 Design a switchback haul road at 10% grade in Deswik.CAD
Original instruction
In Deswik.CAD, design a 25 m wide haul road from the pit exit in fixtures/pit_exit.dxf up to the dump crest in fixtures/dump.dxf, at a maximum 10% grade with one switchback of minimum inner radius 30 m, and generate the road surface against fixtures/topo_mesh.dxf.
- Platforms
win· Windows- Applications
- Deswik.CAD
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clickpath· Continuous pathgeom· Precise geometry- Work product
WP04· 3D/spatial model- Conditions
licensed· Licensed pro app- Proposed difficulty
- 4 / 5
Proposed verifier
Grader parses exported centerline and surface: grade <=10% everywhere (5 m sampling), width 25+/-0.5 m, switchback inner radius >=30 m, endpoints within 2 m of the given points. Deswik.CAD macro/script execution and plugin loading are disabled in the agent VM, and the exported files must be written by Deswik.CAD (file audit log).
Proposed partial credit
35% grade; 20% width; 25% switchback radius; 20% endpoints.
R07.11.01.01-T20 Report inconsistent drillhole depths instead of guessing
Original instruction
Import fixtures/heron_dh/*.csv into Leapfrog Geo. Some holes have survey depths beyond end-of-hole and assay intervals that overlap lithology gaps inconsistently. Do not alter data; list each problem hole, table and interval in output/issues.csv and leave the affected rows flagged in Leapfrog.
- Platforms
win· Windows- Applications
- Leapfrog Geo
- Interfaces
desk· Desktop GUI- GUI need · task setting
G2· GUI-essential- GUI need · ordinary access
G3· GUI-only- Interaction primitives
click· Point & clickvis· Visual judgment- Work product
WP12· Answer/decision- Conditions
licensed· Licensed pro appclarify· Ask when unclear- Proposed difficulty
- 3 / 5
Proposed verifier
Grader has 9 planted problems: issues.csv F1 over (hole, table, interval); source CSVs unchanged; no rows deleted in the project. Grader exports objects from the saved project in its own Leapfrog session; API/Python access is disabled in the agent VM.
Proposed partial credit
70% issue F1; 30% data left unaltered.
Mapped research references
No benchmark reference is assigned to this class in the current mapping.