post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Creating metrics that matter

A case study: Launching a product process in a project-based company

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

Linda Escobar is a senior researcher at Alpha UX, a real-time user insights platform that combines all the solutions above into one, easy-to-use experience for product teams. Prior to Alpha UX, Linda was a team member of Digital First Ventures, the venture capital arm of Digital First Media. While at Digital First, Linda managed operations for the ventures team and carried out strategic investments throughout the product validation cycle within the company.

Linda Escobar

It’s no surprise that product teams at companies large and small are increasingly emphasizing methodologies to capture customer feedback early and often. Generating feedback is critical to becoming a user-centric organization, and the <a href="http://www.watermarkconsult.net/blog/2013/04/02/the-watermark-consulting-2013-customer-experience-roi-study/" target="_blank">chart below</a> illustrates the overwhelmingly positive stock performance of the top 10 companies on Forrester’s Annual Customer Experience Ranking when compared to the bottom 10.
&nbsp;
<a href="https://www.mindtheproduct.com/wp-content/uploads/2015/06/customer-experience-image.png"><img loading="lazy" decoding="async" class=" size-medium wp-image-6848 aligncenter" src="https://www.mindtheproduct.com/wp-content/uploads/2015/06/customer-experience-image-300x198.png" alt="customer experience image" width="300" height="198" srcset="https://www.mindtheproduct.com/wp-content/uploads/2015/06/customer-experience-image-300x198.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2015/06/customer-experience-image-1024x674.png 1024w, https://www.mindtheproduct.com/wp-content/uploads/2015/06/customer-experience-image.png 1236w" sizes="(max-width: 300px) 100vw, 300px" /></a>
<a href="http://blog.alpha-ux.co/why-product-teams-need-to-master-rapid-prototyping" target="_blank">Rapid prototyping experiments may unlock user insights</a>, but designing interactive mockups isn’t the only component product teams need to master. Survey tools are also required to distribute the prototype and capture user behavior and self-reported data. Here are the few we rely on to generate comprehensive user insights.
Schedule in-person interviews
We typically begin by generating qualitative feedback from in-person interviews. We’ll often source users in our target demographic from Craigslist or Reddit. <a href="http://usepowwow.com/" target="_blank">PowWowApp</a> makes scheduling in-person interviews a breeze. It automatically syncs with your calendar to avoid conflicts and sends your available time slots in a group message or via a public URL. Participants can reviews session details and book appointments without any need to create an account, and, once booked, both parties receive confirmation and automated reminders to avoid no-shows.
Remote user sessions
Sometimes in-person interviews aren’t feasible for any number of reasons. In these cases, we use <a href="http://www.usertesting.com/" target="_blank">UserTesting</a> to conduct remote, recorded user sessions. This can be done later in the lifecycle to assess usability or earlier on to paint a competitive landscape. We’ll often use it for the latter, asking users to “Solve for [fill in the problem]” to see what they do and say.
UserTesting enables you to annotate insights as you watch and create individual, shareable clips. One thing to keep an eye out for, though, is that the target audience selection is limited so it’s possible to end up with the wrong user demographic taking your test. It’s also limited to instructions on a designated popup window so you can’t draw testers’ attention to specific areas of a website or prototype.
Quick surveys
After generating qualitative feedback, we’ll turn to quantitative feedback to substantiate our findings. For example, if during interviews we see a consistent pattern of user behavior that suggests a new proposition could be of value, we’ll run a survey to 100 target users that introduces a basic mockup and asks a series of questions.
If you have your own standing user panel, I like <a href="http://www.typeform.com/">Typeform</a> because it has a sleek interface for building and taking survey. Oftentimes however, it’s convenient to use a survey tool that can also source users.
<a href="http://aytm.com/" target="_blank">Ask Your Target Market</a> lets you source target users, split them into separate groups, introduce design variants unique to each group, and then assess their survey responses to measure the differences in perceptions. The typically one-day turnaround is a huge win for product teams looking to iterate quickly.
Robust surveys
While quick and easy, Ask Your Target Market lacks some of the sophistication that research tools like <a href="http://qualtrics.com" target="_blank">Qualtrics</a> and <a href="https://www.surveymonkey.com/" target="_blank">SurveyMonkey</a> easily account for. You’ll need to use a tool like those if you’re looking for branded surveys, advanced metrics like <a href="http://www.netpromoter.com/why-net-promoter/know" target="_blank">Net Promoter Score</a>, or extensive analytics. The downside however is a higher price point and considerably longer turnaround times to create the survey and collect responses.
Interactive mockup surveys
As you continue to refine the user experience of a proposed solution, you’ll need a survey tool that better integrates with interactive prototypes. We use <a href="https://validately.com/" target="_blank">Validately</a> to source users and ask them all the same set of questions. We then split the users into cohorts for each design variant we are testing, connect Validately with our prototypes in <a href="http://invisionapp.com" target="_blank">Invision</a>, send a cohort to each variant, and then ask all the users a set of questions at the end.
This is the <a href="http://uxmag.com/articles/how-split-testing-validates-new-product-concepts-without-code" target="_blank">process we use to split test prototypes</a> but that’s not all. Validately also captures user behavior while interacting with the prototypes, so we can assess usability, bottlenecks, and engagement.
Getting started
If you’re looking to up your prototyping and customer feedback game, I&#8217;d recommend checking out <a href="http://info.alpha-ux.co/rapid-prototyping" target="_blank">What Product Managers Need to Know About Rapid Prototyping.</a> The ebook is a comprehensive guide to rapidly generating user insights with frameworks, best practices, tools, and case studies.
Know a great use tip for any of these tools? Or have we missed one? Let us know in the comments.

core/freeform

How to lead data-centric product teams: Jon Mora (Chief AI Officer, Zefr)

How to be a better data-driven product manager

User insights for product decisions by Cris Valerio

Data scaling for startups by Crystal Widjaja

Make Better Product Decisions by Using Quantitative and Qualitative Data, by Brian Tran

The Most Effective Research Tools for Gathering Customer Feedback

Linda Escobar

Read more

Comments