Audience segmentation & lifecycle campaigns
Define audience segments from customer data and build lifecycle campaigns and automations across email, SMS and push in marketing tools.
20 project-authored proposals · taxonomy v1.1 · 0 new benchmark runs. Verifiers and partial-credit rules below are designs, not executed results.
- Typical applications
- Mailchimp · HubSpot Marketing · Klaviyo
- Class GUI-need label
G3· GUI-only
Digital-employee context
Project class assignments, not demonstrated employee capability or imported benchmark coverage. Acceptance criteria and value metrics are proposals; no ROI has been measured.
Related roles
- Sales and marketing · Representative outcomes: qualified CRM records, segmented outreach campaigns and scheduled sales handoffs.
Task proposals · 20
Expand to inspect the complete original wording and proposed checks. Original proposal text remains English in both interfaces.
R05.07.01.02-T01 Create a lapsed-customer segment in Mailchimp
Original instruction
Mailchimp test account, audience 'Brightline Shop (synthetic)'. Create saved segment 'Lapsed 90d': subscribed contacts whose last e-commerce purchase was more than 90 days before 2026-10-14 and who have purchased at least once, excluding tag 'VIP'. Write the segment size to output/count.txt.
- Platforms
web· Any OS (web)- Applications
- Mailchimp
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Admin read: saved segment conditions equal key (match all); member count equals key and count.txt. Mailchimp API keys are withheld from the agent, so the segment can only be built in the web app.
Proposed partial credit
60% conditions; 20% VIP exclusion; 20% count
R05.07.01.02-T02 Update subject, preview text and UTM tags on a Klaviyo flow email
Original instruction
Klaviyo test account. In flow 'Welcome Series', email 2: set subject 'Your first order ships free', preview text 'Free shipping ends Sunday', and enable UTM tracking with utm_campaign=welcome_2 and utm_source=klaviyo for all links. Keep the flow in Manual status.
- Platforms
web· Any OS (web)- Applications
- Klaviyo
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 2 / 5
Proposed verifier
Admin read: message subject, preview text, UTM params exact; flow status manual; other messages unchanged. Klaviyo private API keys are withheld from the agent; flow/segment history must show edits from the web app.
Proposed partial credit
40% subject and preview; 40% UTM settings; 20% status unchanged
R05.07.01.02-T03 Report open and click rates of a HubSpot marketing email
Original instruction
HubSpot test portal (seeded analytics). Find marketing email 'Oct Newsletter 2026' and write its open rate and click-through rate (as shown, 1 decimal) and number of unsubscribes to output/answer.txt as 'open;ctr;unsubs'.
- Platforms
web· Any OS (web)- Applications
- HubSpot Marketing
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicknav· Pan/zoom/scroll- Work product
WP12· Answer/decision- Conditions
- None declared
- Proposed difficulty
- 1 / 5
Proposed verifier
Values equal seeded analytics; the A/B variant B email is a decoy with a similar name. Private-app tokens are withheld from the agent, so email analytics are reachable only in the HubSpot web app.
Proposed partial credit
40% open rate; 40% CTR; 20% unsubscribes
R05.07.01.02-T04 Build a responsive sale email with the drag-and-drop editor
Original instruction
Mailchimp test account. Create regular campaign 'Fall Sale 2026' with the new builder: hero image input/hero.jpg with alt text, headline, a 2-column product block for 3 SKUs from input/skus.csv (image, name, price), and a CTA button to https://shop.example.test/sale. It must render on mobile without horizontal scroll. Send a test to qa@sink.test; do not send to the audience.
- Platforms
web· Any OS (web)- Applications
- Mailchimp
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP03· Visual layout- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Blocks present; HTML rendered at 375px has scrollWidth <= 375; alt texts, links, prices equal input; all test sends are captured by a Mailpit sink; any send to the real audience fails. Mailchimp API keys are withheld from the agent; grader reads via an admin key and detects non-builder content (drag-and-drop template JSON blocks required, not pasted custom HTML). Control pair: T12.
Proposed partial credit
30% blocks present; 30% content accuracy; 30% mobile rendering; 10% test send only
R05.07.01.02-T05 Schedule a subject-line A/B test with automatic winner selection
Original instruction
Mailchimp test account. Create A/B campaign 'Win-back Oct' to segment 'Lapsed 90d': test 2 subject lines from input/subjects.txt, 20% of recipients in the test (10/10), winner by open rate after 4 hours, schedule for 2026-11-03 09:00 audience timezone. Leave it scheduled only in this test account.
- Platforms
web· Any OS (web)- Applications
- Mailchimp
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 3 / 5
Proposed verifier
Admin read: variate campaign settings (test_size 20, winner_criteria opens, wait_time 240), subject combinations, schedule time, segment. Mailchimp API keys are withheld from the agent, so the A/B campaign can only be built in the web app.
Proposed partial credit
30% variations; 30% test size and winner rule; 30% schedule; 10% segment
R05.07.01.02-T06 Build an abandoned-cart flow with a value-based split in Klaviyo
Original instruction
Klaviyo test account connected to a demo store. Create flow 'Abandoned Cart 2026': trigger Started Checkout, flow filter 'placed order zero times since starting this flow', wait 4 hours, conditional split on cart value > 100: high branch gets email A with 10% code, low branch email B without code; both branches wait 1 day then email C. Leave in Manual mode.
- Platforms
web· Any OS (web)- Applications
- Klaviyo
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin read of flow definition: trigger, filter, delays, split condition, message order equal spec (graph match); grader injects 2 test events and checks branch assignment in preview. Klaviyo private API keys are withheld from the agent; flow/segment history must show edits from the web app.
Proposed partial credit
20% trigger and filter; 30% delays; 30% split logic; 20% messages
R05.07.01.02-T07 Create a lead-nurture workflow with branches in HubSpot
Original instruction
HubSpot test portal (Marketing Hub Pro trial). Build contact workflow 'Ebook nurture': enroll on form submission 'Ebook - Pallet Guide', delay 2 days, send email 1, if lifecycle stage = SQL then end else delay 3 days and send email 2, set property nurture_complete = true; re-enrollment off. Turn it on.
- Platforms
web· Any OS (web)- Applications
- HubSpot Marketing
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin read of workflow actions graph equals spec; grader enrolls 2 test contacts (SQL/non-SQL) with time-skip and checks emails to sink and property values. No private-app token; HubSpot audit log must show edits from the web app.
Proposed partial credit
25% enrollment; 35% branch logic; 25% actions; 15% re-enrollment and on
R05.07.01.02-T08 Create a transactional template with conditional blocks in Brevo
Original instruction
Brevo test account. Create transactional template 'Order shipped' using the drag-and-drop editor with dynamic params {{ params.order_id }}, {{ params.items }} (loop list) and a conditional block shown only when params.express is true. Send a test via the UI with input/test_params.json to qa@sink.test.
- Platforms
web· Any OS (web)- Applications
- Brevo
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP03· Visual layout- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin read of template; rendered test email in sink contains looped items in order and express block per params; no other sends. Brevo API keys are withheld from the agent, so the template can only be created in the web editor.
Proposed partial credit
30% dynamic params; 30% loop; 30% conditional block; 10% test send
R05.07.01.02-T09 Define a multi-condition high-value segment in Klaviyo
Original instruction
Klaviyo test account. Create segment 'High value repeaters': placed order at least 2 times in the last 180 days, predicted CLV > 200, not in list 'Suppressed - complaints', and email marketing consent = subscribed. Write the member count after processing to output/count.txt.
- Platforms
web· Any OS (web)- Applications
- Klaviyo
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin read: segment definition conditions equal key (AND groups); member count equals key and file. Klaviyo private API keys are withheld from the agent; flow/segment history must show edits from the web app.
Proposed partial credit
70% definition; 30% count
R05.07.01.02-T10 Build a tag-based Customer Journey with branching in Mailchimp
Original instruction
Mailchimp test account (Standard trial). Create Customer Journey 'Onboarding by plan': starting point tag added 'new-customer'; if/else on tag 'plan-pro' -> Pro emails (2, 3 days apart) else Basic email (1) then 7-day delay and an upsell email; exit when tag 'churned' is added. Turn it on for the test audience only.
- Platforms
web· Any OS (web)- Applications
- Mailchimp
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin read of journey steps graph equals spec; grader tags 3 test contacts and checks journey paths in the sink with time-compressed delays. Mailchimp API keys are withheld from the agent, so the journey can only be built in the web app.
Proposed partial credit
25% starting point/exit; 35% branch logic; 30% emails and delays; 10% active
R05.07.01.02-T11 Personalize email sections by lifecycle stage with HubSpot smart content
Original instruction
HubSpot test portal. In marketing email 'Q4 Update', make the hero module smart content with 3 versions (lifecycle stage Lead, Customer, default) using copy from input/smart_copy.md, and send test emails previewed as 3 test contacts to qa@sink.test. Do not send to lists.
- Platforms
web· Any OS (web)- Applications
- HubSpot Marketing
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP03· Visual layout- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Admin read: smart rule on lifecycle stage with 3 variants; sink holds 3 test emails whose hero text matches each variant. No private-app token; HubSpot audit log must show edits from the web app.
Proposed partial credit
40% smart rules; 40% variant content; 20% test sends only
R05.07.01.02-T12 Create the same sale campaign via the Mailchimp API (control pair of T04)
Original instruction
Control pair of T04. Separate Mailchimp test account with API key in env MC_KEY. Create the 'Fall Sale 2026' campaign by API with your own responsive HTML (hero, 3-product 2-column block, CTA) and send a test to qa@sink.test.
- Platforms
lin· Linuxmac· macOSwin· Windows- Applications
- Mailchimp Marketing API · Python
- Interfaces
api· API/SDKterm· Terminal- GUI need · task setting
AP· API-sufficient- GUI need · ordinary access
AP· API-sufficient- Interaction primitives
code· Code & commands- Work product
WP03· Visual layout- Conditions
- None declared
- Proposed difficulty
- 3 / 5
Proposed verifier
Same rendering and content checks as T04 (builder-origin check waived); compared with T04 to measure the GUI penalty.
Proposed partial credit
30% structure; 30% content; 30% mobile render; 10% test send
R05.07.01.02-T13 Build a cross-channel canvas with exit criteria and frequency capping
Original instruction
Braze sandbox workspace. Create Canvas 'Trial conversion': entry on custom event trial_started, day 1 email, day 3 push if no event 'project_created', day 5 email with promo only for users in segment 'Teams', exit when 'subscription_started' occurs; global frequency cap 1 marketing message/day. Launch for the test segment only.
- Platforms
web· Any OS (web)- Applications
- Braze
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Canvas definition read via admin export: steps, delays, audience filters, exit events, capping; grader simulates 4 test users and checks message logs. Braze REST API keys are withheld from the agent; the Canvas changelog must show the edits from its dashboard session.
Proposed partial credit
20% entry/exit; 40% step logic; 20% capping; 20% test-user outcomes
R05.07.01.02-T14 Build a sunset flow that suppresses unengaged profiles in Klaviyo
Original instruction
Klaviyo test account. Create segment 'Unengaged 180d' (no opens/clicks in 180 days, subscribed > 180 days) and flow 'Sunset': trigger on entering the segment, two re-engagement emails 5 days apart, then if still no engagement, update profile property sunset=true and suppress the profile. Leave in Manual status and preview with 3 test profiles.
- Platforms
web· Any OS (web)- Applications
- Klaviyo
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
risk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Segment and flow definitions equal spec; grader runs 3 test profiles through the flow in a cloned test account and checks suppression only for the never-engaged one. Klaviyo private API keys are withheld from the agent; flow/segment history must show edits from the web app.
Proposed partial credit
25% segment; 35% flow structure; 30% suppression behavior; 10% manual status
R05.07.01.02-T15 Fix a template so it renders accessibly in Outlook and dark mode
Original instruction
Mailchimp test account, classic code-your-own template 'Corporate 2025'. Fix it so it passes the grader's rendering checks: alt text on every image, bulletproof (VML) CTA button for Outlook desktop, color-scheme meta and dark-mode styles, minimum 14px body text, and no table wider than 600px. Save as 'Corporate 2026' and send a test to qa@sink.test.
- Platforms
web· Any OS (web)- Applications
- Mailchimp · VS Code
- Interfaces
brow· Browser- GUI need · task setting
HY· Hybrid- GUI need · ordinary access
HY· Hybrid- Interaction primitives
type· Text & formscode· Code & commandsvis· Visual judgment- Work product
WP03· Visual layout- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Saved template HTML passes checks: images with alt, VML button markup, dark-mode media query, font sizes, widths; screenshots in Outlook-sim and dark-mode renderer compared with SSIM >= 0.9 to reference.
Proposed partial credit
20% alt text; 30% Outlook button; 25% dark mode; 25% sizing and render similarity
R05.07.01.02-T16 Set up consent, subscription types and double opt-in in HubSpot
Original instruction
HubSpot test portal. Enable GDPR features, create subscription types 'Product updates' and 'Events' with descriptions, require double opt-in for EU contacts, add a consent checkbox to form 'Newsletter signup' mapped to 'Product updates', update the email footer with the company address, and test by submitting the form as an EU test contact.
- Platforms
web· Any OS (web)- Applications
- HubSpot Marketing
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
click· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
risk· Irreversible/risky- Proposed difficulty
- 4 / 5
Proposed verifier
Admin read: GDPR on, subscription types, double opt-in setting, form consent field mapping; sink contains the double opt-in email for the test contact; contact status pending until confirmation. No private-app token; HubSpot audit log must show edits from the web app.
Proposed partial credit
20% GDPR/subscription types; 30% double opt-in; 30% form consent; 20% test flow
R05.07.01.02-T17 Build an automation with a goal and lead-scoring rules in ActiveCampaign
Original instruction
ActiveCampaign trial. Create scoring rule 'Engagement' (+5 email open, +10 link click, +25 pricing page visit, -10 per 30 days inactivity) and automation 'Demo push': on tag 'webinar-attended', send email, wait 2 days, goal 'Demo booked' (tag demo-booked) that jumps ahead, else if score > 40 notify owner. Activate.
- Platforms
web· Any OS (web)- Applications
- ActiveCampaign
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
- None declared
- Proposed difficulty
- 4 / 5
Proposed verifier
Admin read: scoring rules and automation graph equal spec; grader runs 3 test contacts (goal met early, high score, low score) and checks actions. No API key for the agent.
Proposed partial credit
30% scoring rules; 40% automation with goal; 30% test outcomes
R05.07.01.02-T18 Run a three-email product-launch program end to end in Mailchimp
Original instruction
Mailchimp test account. From input/launch_brief.pdf build: segments by purchase history (3), a teaser, launch and last-chance email in the builder with UTM tagging per convention, an A/B test on the launch email subject, and timezone-based scheduling for 2026-11-10/12/15 09:00. Send QA tests of each to qa@sink.test; schedule only.
- Platforms
web· Any OS (web)- Applications
- Mailchimp
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP08· App/system state- Conditions
long· Long-horizonrisk· Irreversible/risky- Proposed difficulty
- 5 / 5
Proposed verifier
Admin read: segments, 3 campaigns with content blocks, UTMs, A/B settings, timewarp schedules equal brief; sink holds QA tests; no audience sends. Mailchimp API keys are withheld from the agent; grader reads via an admin key and detects non-builder content (drag-and-drop template JSON blocks required, not pasted custom HTML).
Proposed partial credit
20% segments; 30% emails; 20% UTMs; 30% A/B and schedules
R05.07.01.02-T19 Rebuild four Mailchimp automations as Klaviyo flows from screenshots
Original instruction
Klaviyo test account. input/mc_journeys/ contains screenshots and exported settings of 4 Mailchimp Customer Journeys (welcome, browse abandonment, post-purchase, win-back). Recreate each as a Klaviyo flow with equivalent triggers, filters, delays, splits and message content (copy from the screenshots), leaving them in Manual status.
- Platforms
web· Any OS (web)- Applications
- Klaviyo
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & formsvis· Visual judgment- Work product
WP06· Code/engineering- Conditions
long· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Each flow graph matches the key's equivalent logic (node types, conditions, delays) and message subjects/body text match screenshots (normalized text); all Manual. Klaviyo private API keys are withheld from the agent; flow/segment history must show edits from the web app.
Proposed partial credit
60% flow logic (equal share per flow); 30% message content; 10% manual status
R05.07.01.02-T20 Implement MQL-to-SQL lifecycle automation with scoring in HubSpot
Original instruction
HubSpot test portal. Per input/lifecycle_spec.pdf: create score property 'Fit+Engagement' with the given criteria, a workflow setting Lifecycle = MQL at score >= 60, rotating MQLs to owners in team 'EMEA Sales', creating a task and Slack-style internal email notification, and a nurture branch for scores 30-59. Test with the 5 test contacts in input/test_contacts.csv.
- Platforms
web· Any OS (web)- Applications
- HubSpot Marketing
- Interfaces
brow· Browser- GUI need · task setting
G3· GUI-only- GUI need · ordinary access
G2· GUI-essential- Interaction primitives
drag· Drag & dropclick· Point & clicktype· Text & forms- Work product
WP06· Code/engineering- Conditions
long· Long-horizon- Proposed difficulty
- 5 / 5
Proposed verifier
Admin read: score criteria and workflows equal spec; after test, each test contact's score, lifecycle stage, owner, tasks and nurture enrollment equal key. No private-app token; HubSpot audit log must show edits from the web app.
Proposed partial credit
30% score property; 35% MQL workflow; 20% nurture branch; 15% test outcomes
Mapped research references
No benchmark reference is assigned to this class in the current mapping.