Experimentation Rigor: Pitfalls and How to Fix Them

This week is all about experimentation rigor!

Author

Haley Carpenter
30 Apr • Reading Time: 4 minutes

Experimentation rigor has been a huge topic lately and our friends at Convert invited me to write another piece with them on this subject. Check it out! 👇

-------------

In this content collab with Convert, we dive into experimentation rigor, common pitfalls, and solutions to fix them.

In this article you’ll learn more about the following topics, plus plenty of linked resources to address each issue:

  • What is experimentation rigor?

  • Spaghetti testing 🍝

  • Lack of stakeholder alignment

  • Inadequate testing infrastructure

We’ve partnered with Convert in the past to talk about rigor, and that piece has been a fan favorite. In case you missed it, I discuss the ins and outs about how experimentation rigor is the secret sauce to success.

This piece is a conversation for folks who are just starting to learn about experimentation rigor. 💡 Watch this collaboration to learn more about:

  • Experimentation rigor fundamentals and why it's essential for A/B testing

  • Rigor in research and what it looks like for teams

  • Rigor in statistical analysis (and common pitfalls to avoid)

  • How to promote the idea of rigor and avoid testing willy-nilly

Here's a peek into what our customers have to say about their interactions with us! Thank you for the kind words Royal Caribbean! 🛳️

Interested in learning more about how we worked with Royal Caribbean? Check out our recently published case study: Royal Caribbean’s CRO Journey with Chirpy.

Share

If you like this newsletter, please forward it to someone that could benefit from it. It would help so much. 🙏

Subscribe

First time getting this? Get these emails weekly if you like it. Subscribe here.

👋 Work with Me

Whenever you're ready there are 4 ways I can help you with optimizations and changing your business’ decision-making culture to make sure you’re an industry dominator:

  1. Consulting & execution for large enterprise in-house teams for lead generation or eCommerce businesses in any industry, find out if we’re a fit by scheduling a 15-minute meeting with me or learning more about it

  2. Training & workshops for any business suited to what you’re looking to accomplish, find out if I can help you by a 15-minute meeting with me or learning more about it

  3. More resources by following me on LinkedIn or visiting my website for blog posts, trainings, and a pre-test checklist

  4. Coffee chats to talk about whatever is on your mind, email me at [email protected] or DM me on LinkedIn