AdPilot · Corpus
T-033 — Landing-page studio + experimentation
T-033 — Landing-page studio + experimentation
Frozen spec for the T-033 build: per-audience landing variants, A/B/n experiments with honest statistics, and the promote-winner flow.
Decisions
- Scope (Q1): sandbox-first. Assignment is a deterministic hash bucket per visitor key (sticky across requests); conversions are recorded events; the winner label requires every arm at ≥ min-n assignments AND a two-proportion z ≥ 1.96 between the top two arms — otherwise the UI shows "keep testing". Variant generation is a deterministic sandbox spec (hook + brief → hero/angle/sections/CTA), brand-kit aware via the studioSession handoff; real provider generation is deferred to the credentials-gated wiring.
- Implementer — promote:
POST /v1/experiments/{id}/promoterefuses with 422 until the guardrails pass, then writes an audit-trailed targeting/creative suggestion (experiment + winning arm + z detail); no direct campaign mutation.
Surface-area deltas
services/api/internal/domain/experiments.go— the experiment model, stickyAssignArm,ArmStats, pooled two-proportionEvaluateWinner(min-n + z ≥ 1.96),BuildMatrixaudience × arm cells with best marking.services/api/internal/domain/experiments_test.go— sticky assignment, min-n and significance guardrails, matrix cells + best marking.services/api/internal/store/experiments.go+services/api/internal/store/migrations/0013_experiments.sql— landing_variants, experiments, experiment_events.services/api/internal/api/handlers_experiments.go— variant create/list, experiment create/list, sandbox assign + convert, matrix with verdict, guardrailed promote; 8 new routes inservices/api/internal/api/server.go.tasks/00-backlog/T-033-landing-pages-experiments.md,tasks/10-in-progress/T-033-landing-pages-experiments.md, anddocs/tech-spec/T-033.mdare bookkeeping.
Verification
Go gates: go test ./... (6/6 packages; 3 new test functions covering
sticky assignment, min-n and significance guardrails, matrix cells).
Manual: two generated variants → sandbox assign/convert events → matrix
populates with best cells → promote refused until significant.
Out of scope
Real traffic serving, provider-generated variant copy (credentials-gated), promote wiring into live campaign targeting, multi-armed bandits.