post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Podcast

How to prioritise your work for impact – Nacho Bassino (Product Leadership Coach)

AI governance

Perplexity lawsuit sends warning to product managers

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Why teams often struggle with OKRs: A conversation with Jeff Gothelf

Lessons from my first year as a Prod Ops Manager

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

5 ways to invent and simplify as an AI/ML product manager

Satheesh Nanniyur

<p>It is well accepted that outcomes  &#8211; such as product adoption, customer satisfaction, user experience, and product performance  &#8211; rather than outputs and tactical tasks should be used in evaluating product managers. However, in practice, these outcomes are at least influenced by &#8211; and often determined by &#8211; external factors.</p>
<p>What are these external factors and how do we account for them when evaluating product managers? Furthermore, in order to ensure that product teams don’t become too risk averse to learn from their failures and iterate their way to success, a few cautions are warranted in evaluating product teams.</p>
<h2>Watch What You Measure</h2>
<p>I was in a coaching session with our president of technology at Salesforce when he quoted Pearson’s Law &#8211; “that which is measured, improves”. He cited an exaggerated example  &#8211; that if you use bugs per line of code to measure the performance of a developer, then they’re unlikely to write any code at all so that they can improve this metric. Similarly, blindly measuring product managers by outcomes and product success can backfire. In fact, it can make them extremely risk averse as these outcomes are highly dependent on factors beyond their sphere of influence. Ideally, we would like product managers to take risks, learn from failures, iterate to improvise, and stubbornly persist to succeed.</p>
<h2>Provide a Secure Environment</h2>
<p>Product managers are deemed effective when their product succeeds in the marketplace. This is irrespective of how success is defined &#8211; often a form of revenue, adoption, market share, user engagement, customer satisfaction, or any other metric. In the real world product managers never succeed or fail all by themselves. They work at the intersection of a complex ecosystem, interacting with developers, sales, customers, channel partners, operations, and many other stakeholders. The effectiveness of the ecosystem, industry trends, and competitive forces has a disproportionate impact on the effectiveness of product managers.</p>
<p>The last thing that product teams need is a leader who tells them: “You either succeed or you’re out.” In my experience, product managers perform at their best when they’re led by a trusted leader with strong ability to guide and listen, and who can encourage them in the face of failures. Such leadership often increases the credibility and effectiveness of product managers in the ecosystem.</p>
<h2>Implementation in Practice</h2>
<p>How do we evaluate the performance of product managers amidst these uncertainties? Here are some thoughts, based on my experience in managing product management teams.</p>
<h3>Define the Role and Success Criteria</h3>
<p>Product managers play different roles in different contexts. Often a product manager’s role depends on variables such as product lifecycle, type of product, and organization structure. Additionally, the role of the product management teams should be strongly aligned with organizational goals. It’s important for leaders of product management teams to define the expected contribution of product managers and to communicate this clearly.</p>
<p>A framework I have successfully used to define a product management role by product lifecycle is depicted by the picture below.</p>
<p><img decoding="async" src="https://docs.google.com/a/mindtheproduct.com/drawings/d/syMritLZOE2Gizr5E5upVDw/image?rev=1&amp;h=253&amp;w=624&amp;ac=1" alt="" /></p>
<p>Irrespective of the structure you use, it’s important to acknowledge that the role of product managers varies across several dimensions. This means that deliberate attention needs to be paid to this thought exercise beforehand and communicated to product management teams, as well as applied consistently in evaluating product managers.</p>
<h3>Establish Baselines for Success Criteria</h3>
<p>Once the role of product management and the desired outcomes are established, it’s important to establish appropriate baseline benchmarks for measuring the success of product management teams. For example: if you task a product manager with improving the availability of a system, help them to define the historical availability and expected results. This context is important in order to set realistic expectations on success criteria.</p>
<p>When you establish the baseline, account for the market dynamics such as competitive solutions. If you’re an online retailer with a top-notch product manager and are attacked by Amazon, your product manager is unlikely to be successful unless you account for this competitive situation in measuring their performance.</p>
<h3>Account for Strengths and Weaknesses of the Ecosystem</h3>
<p>Product managers seldom work in isolation. Even though they play the role of individual contributors, product managers manage people cross-functionally. Their degree of success is determined by the capabilities of their ecosystem. As an example, if you want to measure the success of your product manager by velocity of iterations, don’t ignore the development team’s velocity.</p>
<h3>Obtain Buy-in</h3>
<p>As in any leadership situation, you need to inspire commitment by getting buy-in. Although this seems like an obvious step, it requires significant rigor to clearly articulate and negotiate metrics leading up to buy-in. But, investing this time in people always pays off.</p>
<h2>Closing Thoughts</h2>
<p>In both my roles of managing product managers and evaluated by managers, I have seen the natural tendency of managers to fall back to evaluation by output rather than outcomes. It requires strong organizational commitment reinforced by executive leadership to stick to measuring product management effectiveness by outcomes. I realize that many thoughts expressed in this blog are also applicable to evaluating other functions in an organization. Thus, organizational commitment, culture, and processes play a disproportionate role in how product teams are evaluated. Organizations that are mindful of this tend to have committed, high-performance employees in general.</p>
<p>&nbsp;</p>

core/freeform

Common transformation pitfalls by Marty Cagan

Using principles to make better decisions faster by Martin Eriksson

How to build for creators by Peter Yang

How to navigate tricky work relationships

Organizing around complex products at the intersection of physical and digital by Matthew Cornford

Evaluating Product Teams: Mind What You Measure

Satheesh Nanniyur

Read more

Comments