Effective Experiments

Vanity metrics don't just exist in data analysis. They also exist in Experimentation programs themselves.


But, some of the ones organisations set as a barometer for the health and success of an program are causing teams to go down a path that doesn't ensure long term growth and success.

There's a new series of blog posts I have written on the Effective Experiments blog about vanity metrics and alternatives.


Forward it on to your CMO, VP of marketing and anyone that oversees experimentation. They are the ones that need this more than a

Want to learn new strategies to drive awareness of experimentation in your organisation?

Effective Experiments is running "The Democratise Experimentation" challenge to help you build a culture of experimentation.

Free to join and sent straight to your inbox. Join other CROs in driving cultural change in your organisation.

Register here https://effectiveexperiments.com/democratise-experimentation-challenge/

Whether your organisation is asking you to make everyone interested in or it's an initiative taken by the team, there are some basics that need to be addressed.

These basic questions and steps can be ignored at your own peril.

If experimentation is to be firmly embedded into an organisations way of working, these 4 questions must be answered.

Link to blog post - https://effectiveexperiments.com/blog/questions-to-ask-when-democratizing-experimentation-in-an-organization/

No more meetings. How CROs need to work more efficiently in the crisis and beyond to ensure experimentation plays a role in the organization

No More Meetings - How the current crisis requires CROs to work differently There are few practices that Optimizers have become so accustomed to, that they haven't stopped to question why. The crisis is an chance to evaluate them.

How do you Marie Kondo your A/B Test idea backlog?

How To Effectively Manage Your Backlog Of Ideas Having a steady stream of ideas is important when running an experimentation program. But, a bloated backlog can cause problems for your experimentation program. We explore how to maintain your idea backlog properly.

PIE? ICE? PXL? Which one should you use for prioritizing your test backlog?

The Practical Guide To A/B Test Prioritisation - Why, How & Frameworks The "Test everything" ideology perpetuated by CRO experts back in 2011-2013 is a myth that needs to be busted. It's not practical and it's not simply not realistic. Learn how to prioritise your tests efficiently.

Which framework should you use to prioritise you test ideas?

The Practical Guide To A/B Test Prioritisation - Why, How & Frameworks The "Test everything" ideology perpetuated by CRO experts back in 2011-2013 is a myth that needs to be busted. It's not practical and it's not simply not realistic. Learn how to prioritise your tests efficiently.

The practical guide to prioritizing the right ideas for A/B Testing

The Practical Guide To A/B Test Prioritisation - Why, How & Frameworks The "Test everything" ideology perpetuated by CRO experts back in 2011-2013 is a myth that needs to be busted. It's not practical and it's not simply not realistic. Learn how to prioritise your tests efficiently.

Here's how CRO teams need to work differently in the crisis and beyond so that stakeholders take action using your insights and learnings.

No More Meetings - How the current crisis requires CROs to work differently There are few practices that Optimizers have become so accustomed to, that they haven't stopped to question why. The crisis is an chance to evaluate them.

Most A/B test reports and insights never get looked at beyond the presentation. Here's how to change this during the crisis and beyond.
https://effectiveexperiments.com/blog/how-the-current-crisis-requires-cros-to-work-differently/

Are stakeholders getting bored of CRO? Here's how to keep them engaged and taking action during the crisis and beyond.

No More Meetings - How the current crisis requires CROs to work differently There are few practices that Optimizers have become so accustomed to, that they haven't stopped to question why. The crisis is an chance to evaluate them.