post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Development

What are Product Features? Definition, Examples, and 5 Types

Podcast

How to Prioritise Your Work for Impact- Nacho Bassino (Product Leadership Coach)

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Why teams often struggle with OKRs: A conversation with Jeff Gothelf

Lessons from my first year as a Prod Ops Manager

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

5 ways to invent and simplify as an AI/ML product manager

Jon Dobrowolski

<img loading="lazy" decoding="async" class="alignright size-medium wp-image-4043" alt="Group of Customers" src="https://www.mindtheproduct.com/wp-content/uploads/2013/11/group-of-customers-300x214.png" width="300" height="214" srcset="https://www.mindtheproduct.com/wp-content/uploads/2013/11/group-of-customers-300x214.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2013/11/group-of-customers.png 700w" sizes="(max-width: 300px) 100vw, 300px" />A customer testing group can provide value in a variety of situations, ranging from a gut-check to getting long term deep insight. Here&#8217;s a guide on how user testing and consultation, alongside a tiered approach to segmenting your customers, can add value to your role as a product manager.
<h3>Continuous User Testing &amp; Consultation</h3>
When solving customer problems like growth, retention and usability, it&#8217;s important to have a group of users to poll quickly for their opinions. At a previous company we had a CEO that decided we should engage our users via push message several times a day because we saw higher engagement when we did this. Simple right?
This seemed excessive to me, but I didn&#8217;t have great data or customer sentiment on hand to push back. After speaking with only a handful of customers from different age groups and different engagement patterns I found that we didn&#8217;t need to be as conservative as I had argued. The insights were surprising and within a day I had great data to bring back to the business to use to start experimenting with an approach.
<h3>The Tiered Approach</h3>
Discussions like this come up on a daily basis and it&#8217;s hard to dig deep into every little problem you want to solve. Think about the time you spend as a product manager on a graduated scale. It&#8217;s important to keep communication with users tactical and focused. Just as you have close friends and general acquaintances, you should group the users that you reach out to. Here&#8217;s a framework that can be tailored to the needs of your organization: 
<img loading="lazy" decoding="async" class="size-full wp-image-3681 aligncenter" alt="CuratedCustomerTestingSmall-JonDobrowolski" src="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTestingSmall-JonDobrowolski.png" width="528" height="479" srcset="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTestingSmall-JonDobrowolski.png 528w, https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTestingSmall-JonDobrowolski-300x272.png 300w" sizes="(max-width: 528px) 100vw, 528px" />
Group 1 &#8211; Infrequent Contact (~2000 people) 
Think of this as your catch-all group for people you&#8217;ve engaged in the past. These can also be non-customers you poll in a blind study.
This group is great for:
<ul>
<li>Competitive research</li>
<li>Early rollout of new builds and features</li>
<li>Infrequent surveys, NPS, awareness</li>
</ul>
Group 2 &#8211; Advisory Committee (~200 people) 
These are generally users that have opted into surveys in the past, submitted feature requests or bugs or even users culled from a Tweet, comment or review of your product.
This group is great for:
<ul>
<li>Pool of users for testing</li>
<li>Frequent surveys</li>
<li>Prototypes</li>
<li>Sending and auditing screenshots of near-term releases</li>
<li>Feature usage data</li>
</ul>
Group 3 &#8211; Personal Group (~20 people) 
This is your group. If you are on a team each of you should have your own group of 15-20 users that you have constant contact with. All of these groups should have a healthy mix of demographic, but this group should have the most variance.
This group is great for:
<ul>
<li>Questioning the validity of new features and the removal of old ones</li>
<li>Product health of patient questions</li>
<li>Sharing rough prototypes</li>
<li>Beta testing</li>
</ul>
Each group is not mutually exclusive, but remember that you want to limit your communication with everyone except Group 3, so that your response rates are healthy. Feeling out how often that engagement should happen comes with time.
<h3>Constant Grooming</h3>
The beauty of this tiered approach is that you can generally graduate users from one group to the next (or skip them ahead). Don&#8217;t forget that you need to constantly groom this collection of users. Ensure that these users are of varied demographics, have different use cases and are a mix of old and new customers (this is where the hard work comes in).
<a href="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski.png"><img loading="lazy" decoding="async" class="size-full wp-image-3682 aligncenter" alt="CuratedCustomerTesting-JonDobrowolski" src="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski.png" width="1062" height="749" srcset="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski.png 1062w, https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski-300x211.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski-1024x722.png 1024w" sizes="(max-width: 1062px) 100vw, 1062px" /></a>

core/freeform

Guest Post

Building Consumer-Grade Experiences for the Enterprise By Ciara Peter

What Makes a Great Product Manager by Graham Siener

The GIST Framework by Itamar Gilad

Scaling the Product and the Team by Rachael Shah

Decisions, Debt, and Other Dilemmas by Janna Bastow

Hacking Your Product Career by Gibson Biddle

How Medicine and Research Translates to Patients by Shree Patel

The Future of Product Management by Richard Harrison

Data Science and Digital Businesses by Ali Gulez

You Need A Product Strategy by Sam Odio

Getting Value From Customer Testing

ProductTank Manchester

ProductTank Lisbon

ProductTank São Paulo

ProductTank Madrid

ProductTank Montevideo

ProductTank Montréal

ProductTank Boston

ProductTank Ahmedabad

ProductTank Bangalore

ProductTank Berlin

ProductTank Oslo

ProductTank Des Moines

ProductTank Bangkok

ProductTank Abu Dhabi

ProductTank Helsinki

ProductTank Pune

ProductTank Kraków

ProductTank Cardiff

ProductTank Mumbai

ProductTank Johannesburg

ProductTank Tauranga

ProductTank Bielefeld

ProductTank Vilnius

ProductTank Timisoara

ProductTank Stockholm

ProductTank München

ProductTank Düsseldorf

ProductTank Birmingham

ProductTank Norwich

ProductTank Heidelberg

ProductTank Malmö

ProductTank Barcelona

ProductTank Newcastle Upon Tyne

ProductTank London

ProductTank Málaga

ProductTank Tokyo

ProductTank Braunschweig

ProductTank Edinburgh

ProductTank Pittsburgh

ProductTank Vienna

ProductTank Bristol

ProductTank Raleigh

ProductTank Brno

ProductTank Paris

ProductTank Orlando

ProductTank Hong Kong

ProductTank Charlotte

ProductTank Exeter

Getting Value From Customer Testing

Jon Dobrowolski

Read more

Comments