Skip to main content

Stop testing on vibes.

9 free Claude skills to plan the work, and the Experimentation Lead to run it on your live data.

Experimentation Lead
Experimentation Lead
Experimentation LeadOnline · ready to run skills
G2
0.0on G2
10B+events
500M+users
7+years profitable
50+enterprises

The jobs the Experimentation Lead takes off your plate

Hypothesis-driven testing

Every experiment starts with a hypothesis, primary metric, guardrail metric, and sample size calculation.

Visual personalizations

Show different content to different segments based on behavior, traffic source, or lifecycle stage.

Ship decision framework

The Experimentation Lead tells you when results are significant, recommends ship or hold, and explains the trade-offs.

Everything you get, free

Free to start

The Experimentation Lead, on your data

Every test ships with a hypothesis, a primary metric, a guardrail and a sample size. Ships or holds each variant on real data.

  • Hypothesis-driven testing
  • Visual personalizations
  • Ship decision framework
Get the Experimentation Lead free

Free plan · No credit card

4 steps, prompt to shipped work

You approve at every gate. The agent drafts inside them.

Funnel · Drops rankedICE-scored
01
Pricing → checkout
-24% · impact 8
biggest
02
Product → detail
-11% · impact 6
medium
03
Cart → checkout
-8% · impact 5
small
04
Detail → cart
-6% · impact 4
small

Step 1

Find the highest-impact drop

Builds your funnel, ranks steps by ICE score, surfaces the biggest opportunity to test.

Test · Specgated
01
Hypothesis
sticky nav lifts add-to-cart
stated
02
Primary metric
add_to_cart rate
chosen
03
Sample size
min 3,200 per arm · 14 days
80% power
04
Guardrail
session-time > 60s
tracked

Step 2

Design the experiment

Hypothesis, variants, primary metric, guardrail, sample size - defined before a pixel moves.

Run · Dailylive
01
Day 5
+9% · p=0.12
not sig
02
Day 9
+7% · p=0.06
close
03
Day 12
+8% · p=0.03
significant
04
Guardrail
session-time steady
OK

Step 3

Run and monitor

Tracks significance and confidence intervals live. No spreadsheet, no manual calculation.

Decision · Shiprecommended
01
Recommendation
SHIP
confirmed
02
Lift
+8% add-to-cart · 95% CI
measured
03
Rollout
100% Monday 06:00
queued
04
Next test
cart page price anchoring
drafted

Step 4

Ship, then design the next

Recommends ship or kill with the reasoning, then designs the next test from what you learned.

Is the Experimentation Lead right for you?

When to use it

You have traffic and want every test to start with a hypothesis, a metric, a guardrail and a sample size.

When not to

Your traffic is too thin to reach significance. The free skills can still design the test.

The old way, and the Experimentation Lead way

The way it works today

Tests launch on a hunch, with no success metric agreed.

Every visitor sees the same page, whatever brought them there.

Results get called early, or argued about for weeks.

The way it should work

Every test starts with a hypothesis, a primary metric, a guardrail and a sample size.

Different content by behavior, traffic source or lifecycle stage.

Told when a result is significant, with a ship or hold call and the trade-offs.

Hire the role, or deploy the agent?

Same job. Fully loaded headcount against an agent that runs on your customer data around the clock.

Hiring an Experimentation LeadThe AI Experimentation Agent
Annual cost$100,000 base + benefits$0 on Free plan, then a per-seat price on paid plans (see intempt.com/pricing)
Tests designed per quarter8-12, gated by capacityAs many as your traffic can power
Sample size calculationManual, spreadsheetAuto, before launch, blocks under-powered tests
Guardrail metric trackingIf they remember to define oneRequired field, flagged live if breached
Ship or hold decisionJudgement, sometimes debatedRecommends with reasoning; human decides
Personalization from test winsRebuild the segment by handSame segment reused with one click

US Glassdoor median base salary, 2026. Fully-loaded cost adds 25-35% for benefits, equipment, and payroll tax.

Teams love it

They stopped stitching tools andhired one system.

StockInvest

Acquisition and retention are one connected motion. Personalizing the path before signup only pays off when the same system carries the user through onboarding afterward.

Anonymous traffic was not turning into registered users, and acquisition and retention were run as two separate problems. We ran Experiences on the anonymous visitor flow to put the right content and CTAs in front of each visitor, then handed new signups to automated Journeys for onboarding and deeper engagement.

455,396

users instrumented

Read the full research
FieldsUSA

Judge experiments on revenue per visitor instead of conversion rate. A variant can win on conversions and still lose on revenue, and repeat buying only shows up when the whole journey is in one view.

High-intent shoppers browsed a large, specialized outdoor catalog, and browsing, product interest and purchase history sat in different places. We unified them into one customer view, then ran real-time personalization, intent-based segmentation and timely follow-ups on top of it, judging experiments on revenue per visitor.

Read the full research
Hoperfy

Build the pipeline on observed signals. When follow-ups trigger on intent, the team spends its time on the users who are genuinely engaging.

Static lead lists and timeline-based follow-ups were hiding who was actually engaging. We ran a signal-led outbound pipeline where follow-ups fire on real behavior: outbound replies, onboarding progress and product usage.

Read the full research

See the Marketing team at work

The Experimentation Lead is one of the Marketing team's agents in this tour.

Questions?Answered.

Everything worth asking before you hire the Experimentation Lead.

AI experimentation is running A/B tests and personalizations where an AI drafts the hypothesis, defines the primary metric and guardrail, calculates sample size, and recommends ship or hold based on significance. Intempt's AI experimentation agent does all four so tests reach a real decision, not a spreadsheet.

Intempt Design

Stop testing on vibes.

9 free Claude skills to plan the work, and the Experimentation Lead to run it on your live data.