Senior Experimentation Manager with Optimizely, VWO and advanced statistical analysis expertise required by a digital consultancy specialising in large-scale websites and digital products. You'll help clients understand which website changes, product features and customer journey improvements genuinely improve performance, using robust experimentation mainly using Optimizely and related tools.
Working closely with product, UX, engineering and analytics teams, you'll help clients decide which website changes and product features are worth investing in, and which should be abandoned, based on statistically valid evidence. You'll also act as the senior authority on experimentation methodology, helping to shape testing strategy, improve standards and ensure experimentation delivers measurable commercial value.
Essential Requirements
Hands-on experience with Optimizely Web, Optimizely Feature Experimentation and VWO
Proven experience designing, executing and analysing end-to-end experimentation programmes
Expert knowledge of significance testing, confidence intervals, effect sizes, MDE calculation and power analysis
Experience managing concurrent experiments and mitigating interaction effects within complex product environments
Experience building and prioritising experimentation roadmaps with senior stakeholders
Strong data visualisation and experiment reporting skills
Consultancy or client-facing agency experience
Benefits
Flexible working with home and office-based options
25 days' holiday plus bank holidays, increasing with length of service
Holiday buy and sell scheme
Birthday leave
Private health insurance and wellbeing benefits
Royal London pension scheme
Client and recruitment referral bonus scheme
Structured onboarding and ongoing professional development
Cycle-to-work scheme and Electric Vehicle Salary Sacrifice Scheme
Personal sustainability allowance
Volunteering day and access to the OnHand volunteering app
Travel loan and discounted parking options
Apply now!
.png)