post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

Building your own user experience and software stack: This week’s product news

Guest Post

Building for change: When transformation and product management meet

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Why teams often struggle with OKRs: A conversation with Jeff Gothelf

Lessons from my first year as a Prod Ops Manager

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

What are product features? Definition, examples, and 5 types

Andres is a freelance writer and digital marketer with a background in engineering and a keen interest in the latest technology advancements. He currently helps tech companies and startups tell their stories by turning their complex ideas into easy to understand material. You can reach out to him on LinkedIn

Andres Phillips

<p>In this #mtpcon London+EMEA session, sponsored by <a href="https://flo.health/" target="_blank" rel="noopener">Flo Health</a>, Terry Lee, Flo’s Senior Product Manager, explains how product functions can support an experimentation culture and shares some of the pitfalls that product managers should avoid.</p>
<p>Watch the session in full to see the talk or read on for an overview of his key points:</p>
<ul>
<li>An experimentation culture requires people to understand the benefits and company investment into teams and tools</li>
<li>There are some pitfalls to watch out for. To identify them, you need to identify pillars of growth: speed, learning, improvement, and iteration</li>
<li>To ensure growth without pitfalls you need to question your data</li>
<li>A culture of experimentation requires business support. You need multiple product personnel and different perspectives</li>
</ul>
<h2>Experimentation culture</h2>
<p>As Terry explains, an experimentation culture is born from two things:</p>
<ol>
<li>The people at the business such as product managers, analysts, designers, or everyone with an understanding of the benefits of experimentation</li>
<li>The company making investments into teams and tools</li>
</ol>
<p>In order to create an experimentation culture, the product team needs to run lots of experiments and have an appetite for risk.</p>
<p>At Flo, the web team ran over 100 experiments in Q3 in 2021. They were able to do this, says Terry, because the team structure supported experimentation and they had the tools and system in place and the trust of others in the company.</p>
<h2>Pitfalls</h2>
<p>There are, however, some pitfalls to be aware of and, in order to identify pitfalls, the first step is to identify pillars of growth: speed, learning, improvement, and iteration.</p>
<h3>Speed</h3>
<p>Speed is an essential pillar for any product team as new features and improvements must be delivered quickly. However, with the need for speed, tests are not always thoroughly thought out, there isn’t always proper risk assessment completed or documentation created. Also, directionless speed offers little benefit and can lead product teams down unnecessary rabbit holes.</p>
<h3>Learning</h3>
<p>Learning is critical for team growth, as you need to learn from mistakes to grow in the right way. However, it’s easy to jump to conclusions and reach false positives based on your learning. Plus, you need to be aware of whether or not your learning is based on tunnel vision.</p>
<h3>Improvement</h3>
<p>Making improvements on previous learnings is essential to making improvements on the product. However, you need to be wary of if you’re improving the product as a whole. Also, while metrics are helpful, improvement cannot only be defined by metrics.</p>
<h3>Iteration</h3>
<p>The process of iterating on the product is also an essential requirement for product managers. It requires experimentation and sound thinking. However, iteration of successful tests to production without thought leads to fragmentation. For example, when product managers in large companies are only responsible for one product feature, they might not consider other product features. Also, minor changes can inadvertently affect user expectations.</p>
<h2>How product managers can ensure growth</h2>
<p>Terry suggests that product managers should question their data to ensure growth and that their product doesn’t become a mismatch of features or a Frankenstein product. Is it on brand? Have you checked other health metrics? Are you creating a false positive? Does this set the right expectations for customers?</p>
<p>Take a step back and ensure your tests are grouped together, the basis for hypotheses, and that changes align with other teams’ work. Constant communication with other user-facing teams is essential, so you must share findings and challenge the norm with your data.</p>
<p>However, careful planning is still necessary, which means accepting reality and planning to avoid pitfalls, plus having an idea of your next steps before kicking off tests.</p>
<h2>Business support</h2>
<p>Finally, Terry explains, support from the business begins with team structure. Teams need multiple product personnel and different perspectives. It also means access to resources such as design, research and analyst assistance when required. Official team touchpoints such as having a culture of cross-team collaboration and demos and sharing sessions are necessary. Plus, the team needs trust, which means giving teams the freedom to make mistakes and time to plan.</p>
<p>The key takeaways are that creating an experimentation culture is challenging and requires support from the business. Still, there are also some pitfalls of experimentation which product managers must know.</p>
<h2>Explore more content like this</h2>
<p>Ordinarily, premium <a href="https://www.mindtheproduct.com/tag/mtpcon/" target="_blank" rel="noopener">#mtpcon video content</a> such as this can only be accessed by Mind the Product members. Today, we’re offering up this talk to everyone in the community. If you like the content and want more like it, you can <a href="https://www.mindtheproduct.com/membership/compare/" target="_blank" rel="noopener">check out our Mind the Product membership plans</a>.</p>

core/freeform

Hypothesis and Testing

The journey to product experimentation by Split

Progressive product development: release products that deliver by Split

Surveillance art, dying phones, and fake likes – Dries Depoorter at MTP Engage Hamburg

Understanding and executing effective research

What’s stopping teams from running experiments by Cameron Savage

How to be a better data-driven product manager

Product’s role in experimentation culture by Terry Lee

Stay Humble or Be Humbled — Case Studies from the Experimentation Trenches by Anthony Rindone