post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Pricing

YouTube expands subscription strategy with Premium Lite pilot

Podcast

From Co-op CPO to Co-Founder – Adam Warburton (Co-Founder, Rove)

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Hiring trends, Duolingo, and DeepSeek: February’s top product management reads

UK hiring managers reveal the realities of hiring product managers

Bumble results: Will an improved user experience save it from dating app fatigue?

The best resources for product managers in 2025

Claude in the Google Cloud while OpenAI tops 400m users: AI news roundup

Jon Dobrowolski has worked as a designer, developer and product manager for over a decade. His focus is on user experience, rapid prototyping and agile methodologies. Jon believes that team morale can be improved through product management.

Jon Dobrowolski

<img loading="lazy" decoding="async" class="alignright size-medium wp-image-4043" alt="Group of Customers" src="https://www.mindtheproduct.com/wp-content/uploads/2013/11/group-of-customers-300x214.png" width="300" height="214" srcset="https://www.mindtheproduct.com/wp-content/uploads/2013/11/group-of-customers-300x214.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2013/11/group-of-customers.png 700w" sizes="(max-width: 300px) 100vw, 300px" />A customer testing group can provide value in a variety of situations, ranging from a gut-check to getting long term deep insight. Here&#8217;s a guide on how user testing and consultation, alongside a tiered approach to segmenting your customers, can add value to your role as a product manager.
<h3>Continuous User Testing &amp; Consultation</h3>
When solving customer problems like growth, retention and usability, it&#8217;s important to have a group of users to poll quickly for their opinions. At a previous company we had a CEO that decided we should engage our users via push message several times a day because we saw higher engagement when we did this. Simple right?
This seemed excessive to me, but I didn&#8217;t have great data or customer sentiment on hand to push back. After speaking with only a handful of customers from different age groups and different engagement patterns I found that we didn&#8217;t need to be as conservative as I had argued. The insights were surprising and within a day I had great data to bring back to the business to use to start experimenting with an approach.
<h3>The Tiered Approach</h3>
Discussions like this come up on a daily basis and it&#8217;s hard to dig deep into every little problem you want to solve. Think about the time you spend as a product manager on a graduated scale. It&#8217;s important to keep communication with users tactical and focused. Just as you have close friends and general acquaintances, you should group the users that you reach out to. Here&#8217;s a framework that can be tailored to the needs of your organization: 
<img loading="lazy" decoding="async" class="size-full wp-image-3681 aligncenter" alt="CuratedCustomerTestingSmall-JonDobrowolski" src="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTestingSmall-JonDobrowolski.png" width="528" height="479" srcset="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTestingSmall-JonDobrowolski.png 528w, https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTestingSmall-JonDobrowolski-300x272.png 300w" sizes="(max-width: 528px) 100vw, 528px" />
Group 1 &#8211; Infrequent Contact (~2000 people) 
Think of this as your catch-all group for people you&#8217;ve engaged in the past. These can also be non-customers you poll in a blind study.
This group is great for:
<ul>
<li>Competitive research</li>
<li>Early rollout of new builds and features</li>
<li>Infrequent surveys, NPS, awareness</li>
</ul>
Group 2 &#8211; Advisory Committee (~200 people) 
These are generally users that have opted into surveys in the past, submitted feature requests or bugs or even users culled from a Tweet, comment or review of your product.
This group is great for:
<ul>
<li>Pool of users for testing</li>
<li>Frequent surveys</li>
<li>Prototypes</li>
<li>Sending and auditing screenshots of near-term releases</li>
<li>Feature usage data</li>
</ul>
Group 3 &#8211; Personal Group (~20 people) 
This is your group. If you are on a team each of you should have your own group of 15-20 users that you have constant contact with. All of these groups should have a healthy mix of demographic, but this group should have the most variance.
This group is great for:
<ul>
<li>Questioning the validity of new features and the removal of old ones</li>
<li>Product health of patient questions</li>
<li>Sharing rough prototypes</li>
<li>Beta testing</li>
</ul>
Each group is not mutually exclusive, but remember that you want to limit your communication with everyone except Group 3, so that your response rates are healthy. Feeling out how often that engagement should happen comes with time.
<h3>Constant Grooming</h3>
The beauty of this tiered approach is that you can generally graduate users from one group to the next (or skip them ahead). Don&#8217;t forget that you need to constantly groom this collection of users. Ensure that these users are of varied demographics, have different use cases and are a mix of old and new customers (this is where the hard work comes in).
<a href="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski.png"><img loading="lazy" decoding="async" class="size-full wp-image-3682 aligncenter" alt="CuratedCustomerTesting-JonDobrowolski" src="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski.png" width="1062" height="749" srcset="https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski.png 1062w, https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski-300x211.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2013/08/CuratedCustomerTesting-JonDobrowolski-1024x722.png 1024w" sizes="(max-width: 1062px) 100vw, 1062px" /></a>

core/freeform

Guest Post

Building Consumer-Grade Experiences for the Enterprise By Ciara Peter

What Makes a Great Product Manager by Graham Siener

The GIST Framework by Itamar Gilad

Scaling the Product and the Team by Rachael Shah

Decisions, Debt, and Other Dilemmas by Janna Bastow

Hacking Your Product Career by Gibson Biddle

How Medicine and Research Translates to Patients by Shree Patel

The Future of Product Management by Richard Harrison

Data Science and Digital Businesses by Ali Gulez

You Need A Product Strategy by Sam Odio

Getting Value From Customer Testing

ProductTank Baku

ProductTank Rotterdam

ProductTank London

ProductTank Portland

ProductTank Thanh Pho Ho Chi Minh

ProductTank Stockholm

ProductTank Amsterdam

ProductTank Pittsburgh

ProductTank Auckland

ProductTank Brno

ProductTank Cardiff

ProductTank Montréal

ProductTank Waterloo

ProductTank Valletta

ProductTank Vilnius

ProductTank Belfast

ProductTank Curitiba

ProductTank Lausanne

ProductTank München

ProductTank Oxford

ProductTank Seattle

ProductTank Madison

ProductTank Köln

ProductTank Norwich

ProductTank Bangkok

ProductTank Heidelberg

ProductTank Manchester

ProductTank Chicago

ProductTank Reston

ProductTank Edinburgh

ProductTank Valencia

ProductTank Paris

ProductTank Exeter

ProductTank Birmingham

ProductTank San Francisco

ProductTank Orlando

ProductTank Tokyo

ProductTank Madrid

ProductTank Zürich

ProductTank Perth

ProductTank Los Angeles

ProductTank Des Moines

ProductTank Bucharest

ProductTank Bielefeld

Getting Value From Customer Testing

Jon Dobrowolski

Read more

Comments