post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Creating metrics that matter

A case study: Launching a product process in a project-based company

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

Emily brings nearly 15 years of product management experience to her role as Managing Director for Mind the Product. While she has worked across a variety of industries, she will always have a soft spot for the travel industry where she spent most of her early career building software for airlines and developing a leading consumer travel app, TripCase. Emily is passionate about the craft of product management and loves talking about new ways to make products people love.

Managing Director

Emily Tate

<p>No one is immune to cognitive biases. <a href="https://twitter.com/cindyalvarez" target="_blank" rel="noopener">Cindy Alvarez</a>, Principle Researcher at Microsoft and Author of <em>Lean Customer Development</em> wants us to recognize this fact. Because while we can’t avoid bias altogether, she has some advice for us on how to work around bias and reduce the impact it has in our research.</p>
<blockquote><p>You are all an incredibly smart audience, and it doesn’t actually matter, because cognitive biases are really going to screw up what you do anyways. <cite>Cindy Alvarez</cite></p></blockquote>
<p>Our brains are not very good at making nuanced decisions. So cognitive bias creeps in and impacts the questions we ask, what people tell us in response, and how we interpret what we have heard. Cindy talks us through several common biases, how they manifest themselves in our work, and what questions we should be asking instead.</p>
<p><img loading="lazy" decoding="async" class="alignnone size-full wp-image-13642" src="https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-speaker.jpg" alt="Cindy Alvarez at mtpcon" width="2048" height="1365" srcset="https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-speaker.jpg 2048w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-speaker-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-speaker-768x512.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-speaker-1024x683.jpg 1024w" sizes="(max-width: 2048px) 100vw, 2048px" /></p>
<h2>Types of Bias</h2>
<h3>Confirmation Bias</h3>
<p>With confirmation bias, we look for evidence that proves us right, and avoid or ignore evidence that contradicts our beliefs. We don’t do this on purpose, but it happens. Instead of asking <em>“How likely would you be to use (a solution)?”</em>, ask <em>“Tell me about what you’re currently doing in (a situation).”</em> Hearing people’s stories is better way to discover what they really need and what they really care about.</p>
<h3>Cognitive Dissonance</h3>
<p>Cognitive dissonance is the feeling when we’re trying to hold two contradicting views at the same time. When research is not proving what we thought it would, it is tempting to ask, <em>“Are we sure we’re talking to the right customers?”</em> This helps us feel better by saying it’s the users fault, not ours, but it’s not solving the right problem.</p>
<p><img loading="lazy" decoding="async" class="alignnone size-full wp-image-13641" src="https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-right-customers-question.jpg" alt="Cindy Alvarez tells us not to ask Are you sure we're talking to the right customers?" width="2048" height="1366" srcset="https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-right-customers-question.jpg 2048w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-right-customers-question-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-right-customers-question-768x512.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-mtpcon-right-customers-question-1024x683.jpg 1024w" sizes="(max-width: 2048px) 100vw, 2048px" /></p>
<p>Instead, start by saying, <em>“Let’s assume (an undesirable belief) is true. Now what?”</em> Just the semantic break of pretending something is true lets our brains release and helps us get to a different answer.</p>
<h3>Survivorship Bias</h3>
<p>We want to talk to happy customers because it makes us feel good. This is the heart of survivorship bias, or “Happy Customer Bias.” But your happiest customers are not typically the best representation of what needs to change in your product.</p>
<p>Instead, talk to churned customers, low-usage customers, or non-customers using competitor products. Talk about what drove them away or why they’re not using it. Ask them questions like, <em>“If you HAD to change one thing…”</em>, <em>“Which tasks do you put off doing?”</em>, or <em>“How have you done (a task) differently in the past?”</em></p>
<h3>The Curse of Knowledge</h3>
<p>Once we have a fact or skill, we cannot remember what it was like to not have that fact or skill. So the people who have used your product for a long time don’t know what it was like before they started. We’ll often ask <em>“How hard was it to get started with (a solution)?”</em> and you’ll hear people say, “It wasn’t that hard. I figured it out.”</p>
<p>Instead ask, <em>“Suppose you had a new coworker join your team &#8211; what advice would you give them to get started?”</em> People will immediately start telling you all of the difficulties and workarounds they have to implement to use your app. When you ask in this way, people don’t feel like they’re criticizing you, they feel like they’re helping a friend.</p>
<p><img loading="lazy" decoding="async" class="alignnone size-full wp-image-13640" src="https://www.mindtheproduct.com/wp-content/uploads/2018/08/29688389668_4b31e465d0_k.jpg" alt="Cindy Alvarez talks about social desirability bias at mtpcon" width="2048" height="1365" srcset="https://www.mindtheproduct.com/wp-content/uploads/2018/08/29688389668_4b31e465d0_k.jpg 2048w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/29688389668_4b31e465d0_k-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/29688389668_4b31e465d0_k-768x512.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/29688389668_4b31e465d0_k-1024x683.jpg 1024w" sizes="(max-width: 2048px) 100vw, 2048px" /></p>
<h3>Social Desirability Bias</h3>
<p>When you ask people, “How often do you go to the gym?”, many will say 5 or 7 days a week with a straight face even if they only wish they exercised that often. This is social desirability bias &#8211; we (unconsciously) edit what we say to make ourselves look good. So think about if your questions have a socially-preferable answer that might bias your results. For example, <em>“Do you have a hard time meeting deadlines?”</em> Who wants to say yes to that?</p>
<p>You would get more honest information by asking, <em>“In the past month, tell me about a time when you got something done later than you originally promised.”</em> We give people permission to admit to faults, which helps us see problems to solve.</p>
<h3>Backfire Effect</h3>
<p>The backfire effect &#8211; presenting rational evidence against our beliefs can make us reject it, and believe in our original thought even more strongly. Or put simply: you can’t fight feelings with facts. If a customer thinks they need a feature, you can’t convince them otherwise.</p>
<p>To manage the backfire effect, don’t tell someone <em>“You’re wrong.&#8221;</em> Say, <em>“You’re right &#8211; and…”</em> Nothing deflates a fight better than “you’re right” or “I’m sorry.”</p>
<p><img loading="lazy" decoding="async" class="alignnone size-full wp-image-13639" src="https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-on-mtpcon-stage.jpg" alt="Cindy Alvarez at mtpcon" width="2048" height="1366" srcset="https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-on-mtpcon-stage.jpg 2048w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-on-mtpcon-stage-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-on-mtpcon-stage-768x512.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2018/08/cindy-alvarez-on-mtpcon-stage-1024x683.jpg 1024w" sizes="(max-width: 2048px) 100vw, 2048px" /></p>
<h2>Get to the Real Answers</h2>
<p>Cindy wraps up by talking us through an example of asking questions in the right way to avoid common biases. She gave us some key questions that will help you understand if your customers truly need what they are asking for:</p>
<ul>
<li>“Just to be sure I’m clear &#8211; if you had that already, how would it make your job/life easier?”</li>
<li>“Since you don’t have it today, what is your current workaround?”</li>
<li>“In the last 6 months, how often has that happened?”</li>
<li>“You’re right, (our competitor) does offer this feature. I’d love to hear your impression of the solution.”</li>
<li>“You mentioned it might come in handy in the future. How are you anticipating your needs changing?”</li>
<li>“If you could wave a magic wand and change anything about (a situation), it doesn’t have to be possible, what would it be?”</li>
</ul>
<p>These types of questions help you understand if there are actually problems to be solved and if the features your customers are asking for are really needed, or if they are just things that are nice-to-haves that can be removed from your roadmap. Asking questions in the right way will help you avoid biases, understand your customers better, and build the things that are really needed to solve problems.</p>
<h3>There&#8217;s more where that came from! Access more great product management content on Mind the Product</h3>
<ul>
<li><a href="https://www.mindtheproduct.com/designing-for-cognitive-bias-david-dylan-thomas/" target="_blank" rel="noopener">Designing for Cognitive Bias – David Dylan Thomas on The Product Experience </a></li>
<li><a href="https://www.mindtheproduct.com/a-product-managers-guide-to-customer-development/" target="_blank" rel="noopener">A product manager’s guide to customer development</a></li>
<li><a href="https://www.mindtheproduct.com/crossing-the-chasm-target-customer-scenario-canvas/" target="_blank" rel="noopener">Crossing the chasm with the ‘target customer scenario’ canvas</a></li>
</ul>

core/freeform

Product Management Conference

Product teams in flux – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Berlin’s leading companies – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Amsterdam’s leading companies – Pendomonium+#mtpcon roadshow: Amsterdam

Product teams in flux – Pendomonium+#mtpcon roadshow: London

AI in practice at London’s leading companies – Pendomonium+#mtpcon roadshow: London

What’s next for product management in 2024? Nichole Mace (SVP Product and User Experience, Pendo)

Perspectives from an unconventional CPO – Yuelin Li (CPO, Onfido)

The future of product management – Trisha Price (CPO, Pendo)

The future of product management in 2024 and beyond (Brian Walsh, SVP Product, Pendo)

Cognitive biases and the questions you shouldn’t be asking by Cindy Alvarez

Emily Tate