post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

Sunday Rewind: Whose job is it anyway? The rise of Product Ops and why it deserves to be an independent function

Guest Post

Creating metrics that matter

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

Eira is an editor for Mind the Product. She's been a business journalist, editor, and copywriter for longer than she cares to think about.

Eira Hayward

In this #mtpcon San Francisco 2023 keynote, <a href="https://www.linkedin.com/in/tomersharon" target="_blank" rel="noopener">Tomer Sharon,</a> Co-founder and CXO at workplace experience platform <a href="https://www.anywell.com/" target="_blank" rel="noopener">anywell</a>, talks about measuring the user experience and the advantages of high-level metrics. Watch the video in full of read on for his key points. 
<hr />
He starts by asking the audience to rate the conference so far and wonders what variables would affect their answers &#8211; the time, the temperature, their past experience might all come into play.
Tomer then tells a story from his time working on the Google Search team more than 10 years ago. The team loved looking at two metrics, long and short clicks. The team thought that long clicks &#8211; where a user clicked on a link and stayed there for a long time &#8211; were good, because the user had gone to the right place. They thought short clicks &#8211; where the user clicked back and forth through many links  &#8211; were bad. It was only when they watched users in a lab that they realised this wasn’t the case. “It was just that the internet was a mess and they couldn’t find what they were looking for,” Tomer says.
<h3>Experience metrics</h3>
Experience metrics are quantitative scores for important and actionable phenomena related to using products and services, Tomer says.
He splits a product launch into four stages of a cycle &#8211; someone has the idea, you build it, launch it and learn from it.
<ul>
<li>Tactical research happens from the time we learn something till we have an idea</li>
<li>Strategic research should happen all the time. It looks into motivations and needs</li>
<li>Metrics come into their own after product launch, when we want to learn</li>
</ul>
The biggest challenge that a team has is understanding the answer to the question “how are we doing?”, Tomer says. Dashboards aren’t clear, and there’s no clear answer to this question and so teams focus on detailed metrics rather than high-level metrics. “People strive to solve the problems that humans have but they’re not looking at the data that helps them to solve these problems,” he says.
<h3>Principles of high-level metrics</h3>
Tomer then talks about some of the principles of high-level metrics and overall versus specific metrics. “I’d argue that coming up with a number for an overall satisfaction score should not come from a question about the overall experience.It should come from a series of questions about the most important components which are then aggregated into one score.”
You should also focus on behaviour rather than opinion, because our opinions are very unstable. “Satisfaction is extremely biased and there are other, more telling, metrics that show the actual behaviour,” Tomer says.
Tomer moves on to the Google Heart framework of metrics (happiness, engagement, adoption, retention, task success), omitting the last metric of task success because it’s more relevant to tactical research. Happiness is opinion, he explains, but the other three metrics are behavioural.
One of the biggest advantages of high-level metrics is that you can very quickly understand what’s going on. They can be extremely useful in creating OKRs, Tomer says, and for understanding the effect of change.
<h3>Want to turn the learning from this talk into action?</h3>
Our exciting #mtpcon San Francisco 2023 <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Keynote Kit</a> brings you all of the insights from our San Francisco keynote talks plus additional helpful discussion points and thought starters so you can easily translate the insights into actions – perfect for making effective improvements to your role, team, and product. Plus, get an email notification when each talk is published! <a href="https://www.mindtheproduct.com/resources/mtpcon-san-francisco-2023-keynote-kit-sign-up/">Sign up now</a>.

core/freeform

Product Management Conference

Product teams in flux – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Berlin’s leading companies – Pendomonium+#mtpcon roadshow: Berlin

AI in practice at Amsterdam’s leading companies – Pendomonium+#mtpcon roadshow: Amsterdam

Product teams in flux – Pendomonium+#mtpcon roadshow: London

AI in practice at London’s leading companies – Pendomonium+#mtpcon roadshow: London

What’s next for product management in 2024? Nichole Mace (SVP Product and User Experience, Pendo)

Perspectives from an unconventional CPO – Yuelin Li (CPO, Onfido)

The future of product management – Trisha Price (CPO, Pendo)

The future of product management in 2024 and beyond (Brian Walsh, SVP Product, Pendo)

Measuring the user experience by Tomer Sharon

Eira Hayward