Designing a Smarter Experiment Dashboard
I feel like experiment dashboards could be improved to better set expectations: what decisions are allowed, what could be expected, and how much longer a sequential experiment might need to get there. So here's me putting my experiment + UI design hat back on for a playful prototype.
The Prototype
The key ingredients I was going for:
- Spatial and colour-coded action recommendation Each row sits in the column of the decision it is heading for (Wait, Abort, Give Up, Ship), so position and colour alone tell you where it stands.
- Visualizing change since last visit An effect that strengthened arrives larger, one that weakened arrives smaller, and a decision that flips columns entirely travels across and leaves a coloured trail behind it.
- Flexibility for different test designs Sequential, fixed-horizon, and hybrid test designs are allowed and codified as icons, alongside one- and two-tailed and non-inferiority goals.
- Show "how much longer" tests need to run Sequential rows still gathering data carry a running estimate of the days left to a decision.
- Visualize that some tests cannot be aborted by design A fixed-horizon test only reads once, at completion, so it has no early abort to offer — shown as a greyed-out, dashed placeholder instead of a live column.
-
Seq / 2-TailEXP-014-Cart-ShippingCostVisibleAbort at 43k-4.1%
-
Seq / 2-TailEXP-021-Signup-InlineValidationGive Up at 29k+0.3%
-
Seq / 2-TailEXP-009-Pricing-TableAboveFoldShip at 49k+5.6%
-
Seq / 1-TailEXP-031-Product-StickyAddToCartShip at 24k+3.4%
-
Seq / 2-TailEXP-006-Search-AutocompleteSuggestAbort at 27k-3.5%
-
Seq / 2-TailEXP-027-Checkout-TrustBadges11 days left 23k of 55k+0.1%
-
Seq / 1-TailEXP-034-Nav-CategoryReorder16 days left 14k of 50k+0.2%
-
Seq / 1-TailEXP-038-Email-SubjectPersonaliseShip at 44k+3.1%
-
Seq / 2-TailEXP-041-Form-FewerFields29 days left 5.4k of 60k+0.2%
-
Hybrid / 2-TailEXP-052-Onboarding-ProgressBar9 days left 38k of 60k+2.8%
-
Hybrid / 2-TailEXP-058-Checkout-UpsellStepAbort at 26k-3.4%
-
Seq / Non-InfEXP-061-Infra-ImageCDNSwapShip at 38k, margin ±1.0%-0.3%
-
Fixed / Non-InfEXP-066-Billing-VendorMigration12 days left 25k of 52k-0.4%
-
Fixed / 2-TailEXP-045-Pricing-AnnualDefault18 days left 31k of 80k+1.4%
-
Fixed / 2-TailEXP-071-Footer-NewsletterCopyGive Up at 60k+0.5%
-
Fixed / 2-TailEXP-078-Nudge-UrgencyIntensityDo Less Of at 50k-2.1%
This is just a prototype for now, but if you're working on experiment platform-level improvements, like better decision UI or clearer test status, I'd be glad to help design or build it with you.
Want to Build This Together? Let's Chat
A friendly 25-min call about experiment & UI design
Jakub Linowski on Sep 07, 2026
Comments