AB testing button colours — is it even worth the effort?

1. Testing micro-variable

  1. The more granular the change, the less likely it is to have an effect.
  2. Each test takes time to run and thus there are opportunity costs with every experiment.

2. Testing a completely new page design

Defining the goals of the experiment

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store