I will set up ab testing frameworks for marketing teams

India

I speak English

Marketing Measurement Marketing Insights Analytics Professional

I am a Data & Analytics Professional with 12+ years of experience driving data-backed transformation in commercial, sales, and marketing analytics. I specialize in experiment design, attribution, and ...
About this Gig

A/B Test Planning and Evaluation Package

A/B testing can be run easily on the marketing automation tool but I help you find if they are statistically significant and learn from failed tests too. This package covers the test from planning to the final readout.

What you get


  1. 1 hour - Consultation call: To understand the scenario, maturity and feasibilities.
  2. Pre-test framework: I write up a test plan for your specific test. It covers the hypothesis, the primary metric, the smallest improvement worth detecting, sample size per group, how many days to run it, and the traffic split. It also sets the decision rule up front, so the result cannot be argued after the fact.
  3. Post-test evaluation sheet: An Excel sheet set up for your test. You enter the group sizes and results, and it runs a sample ratio mismatch (SRM) check to confirm traffic was split as planned and Statistical Significance tests that tells you whether the new version won, lost, or showed no clear difference, with a likely range for the real effect.
  4. Results roundup: A short written summary of the plan, what happened, and what I would do next. It is written for stakeholders who do not want to read statistics.

Related tags