post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

AI governance

Perplexity lawsuit sends warning to product managers

Guest Post

The Irony of Product-led Growth: How Adding More Can Slow You Down

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

Why teams often struggle with OKRs: A conversation with Jeff Gothelf

Lessons from my first year as a Prod Ops Manager

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

5 ways to invent and simplify as an AI/ML product manager

Rene Rosendahl

Prioritization of work is hard: it’s often more an art than a science. Unless you work in an organization that has mastered the delicate balance of work from a prioritized roadmap as well as customer requests, you too may often be faced with squeaky-wheel prioritization: The customer yelling the loudest (or the one who last spoke with sales or the CEO) gets what they want.
We product management professionals thought there must be a better way to figure out prioritization, one that’s more “scientific” and less subjective. So various schemes for prioritization emerged from the industry, looking at the benefits of features such as new revenue, customer retention, cost savings, … you name it. Either one or multiple of these factors were being considered and summarized into terms such as “business value”. Agilists quickly pointed out that absolute values (e.g. dollars) make things hard to compare and that measurements are often imprecise, so we started thinking in relative business value points.
Great, so now we have a way of systematically prioritizing our features, right? As long as we work our way down our feature backlog in descending order of business value, we’re making sure we deliver the most value to the business and we solved the problem of old-school prioritization, right?
Well, not so fast, cowboy. I think we’re missing something here. Stay with me as I walk you through an example:
Let’s say we have four feature candidates to pick from for an upcoming quarter, each assigned with business value points (for simplicity, using a scale from 1-10):
<figure id="attachment_15009" aria-describedby="caption-attachment-15009" style="width: 452px" class="wp-caption alignnone"><img loading="lazy" decoding="async" class="wp-image-15009 " src="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-1-300x223.png" alt="" width="452" height="336" srcset="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-1-300x223.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-1-768x570.png 768w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-1.png 776w" sizes="(max-width: 452px) 100vw, 452px" /><figcaption id="caption-attachment-15009" class="wp-caption-text">Features with business value</figcaption></figure>
The obvious thing would be to work through them in order of business value, so we’d work our way down the list like this in order to maximize value.
<figure id="attachment_15010" aria-describedby="caption-attachment-15010" style="width: 439px" class="wp-caption alignnone"><img loading="lazy" decoding="async" class="wp-image-15010 " src="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-2-300x239.png" alt="" width="439" height="350" srcset="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-2-300x239.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-2.png 722w" sizes="(max-width: 439px) 100vw, 439px" /><figcaption id="caption-attachment-15010" class="wp-caption-text">Features sorted by descending business value</figcaption></figure>
But since we might not be able to complete all of them in the given timeframe, we have to look at the size of these items, so we can make appropriate commitments to our internal and external stakeholders. Therefore, let’s add “size” to these features &#8211; in this case we’ll call it “effort” and use the same 1-10 scale:
<figure id="attachment_15011" aria-describedby="caption-attachment-15011" style="width: 533px" class="wp-caption alignnone"><img loading="lazy" decoding="async" class="wp-image-15011 " src="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-3-300x124.png" alt="" width="533" height="220" srcset="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-3-300x124.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-3-768x319.png 768w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-3-1024x425.png 1024w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-3.png 1408w" sizes="(max-width: 533px) 100vw, 533px" /><figcaption id="caption-attachment-15011" class="wp-caption-text">Features with effort</figcaption></figure>
Let’s say that our capacity for the quarter is 15 units of “effort”. Given the sequence above, by the end of the quarter, we will have delivered the first feature and will be in the middle of implementing the second feature. Sorry, earned value folks, but since we didn’t actually deliver the second feature to customers, we can only claim to have delivered 10 value points in this quarter (feature A).
So what’s missing here? We are ignoring the effort in our prioritization. If you had two features with 10 business value points, one with three effort points and one with eight effort points, which one would you work on? The one with the smaller effort, of course! This is where ROI comes in: How much return do we get from the effort we’re expending? (Kinda like return on effort/“ROE”) The 10 business value point feature requiring only three effort units has a significant higher return for each unit of effort.
Therefore we’ll add another column to our original spreadsheet, showing the return per unit of effort:
<figure id="attachment_15012" aria-describedby="caption-attachment-15012" style="width: 595px" class="wp-caption alignnone"><img loading="lazy" decoding="async" class="wp-image-15012 " src="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-4-300x126.png" alt="" width="595" height="250" srcset="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-4-300x126.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-4-768x323.png 768w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-4-1024x431.png 1024w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-4.png 1398w" sizes="(max-width: 595px) 100vw, 595px" /><figcaption id="caption-attachment-15012" class="wp-caption-text">Features with “ROE”</figcaption></figure>
Now we can look at this and prioritize the work based on ROI instead of just business value alone. Once we sort our backlog by descending “ROE”, a new, maybe surprising, sequence emerges:
<figure id="attachment_15013" aria-describedby="caption-attachment-15013" style="width: 633px" class="wp-caption alignnone"><img loading="lazy" decoding="async" class="wp-image-15013 " src="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-5-300x100.png" alt="" width="633" height="211" srcset="https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-5-300x100.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-5-768x256.png 768w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-5-1024x342.png 1024w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/table-5.png 1720w" sizes="(max-width: 633px) 100vw, 633px" /><figcaption id="caption-attachment-15013" class="wp-caption-text">Features sorted by descending “ROE”</figcaption></figure>
So Feature A, the one with the highest business value, now ends up on the very bottom of our backlog! That’s right. This is because of the very high amount of effort it requires while other features with smaller business value offer a higher ROE.
Going back to what our next quarter could look like: With this new approach and rank order, we’ll be able to deliver 15 business value points (50% more than in the original sequence!) in the first quarter (features B, C, and D)! I’m pretty sure any business owner would agree that we deliver more value to the business by sequencing the work this way.
(For those of you in larger organizations who are employing the Agile scaling framework SAFe, you’ll obviously recognize the resemblance with the more sophisticated <a href="https://www.scaledagileframework.com/wsjf" target="_blank" rel="noopener">WSJF</a> (“weighted smallest job first”) methodology, which uses the terms “cost of delay” and ”job size” instead. The nice thing about how SAFe defines cost of delay is that it consists of several useful sub-components, such as risk avoidance and opportunity enablement.)
One technique that could come in handy during prioritization discussions is to place new features on a chart like this:
<img loading="lazy" decoding="async" class="alignnone wp-image-15014" src="https://www.mindtheproduct.com/wp-content/uploads/2019/02/effort-business-value-matrix-300x183.png" alt="Effort vs Business Value matrix" width="751" height="458" srcset="https://www.mindtheproduct.com/wp-content/uploads/2019/02/effort-business-value-matrix-300x183.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/effort-business-value-matrix-768x468.png 768w, https://www.mindtheproduct.com/wp-content/uploads/2019/02/effort-business-value-matrix.png 864w" sizes="(max-width: 751px) 100vw, 751px" />
This view will make it pretty obvious that it’s best to focus on work in quadrant 1 (high value, low effort), followed by quadrant 2. Work in quadrant 3 is questionable while items in the top left quadrant should be eliminated altogether.
The takeaway from all of this is simple: Don’t just blindly sequence your backlog based on business value (or priority, or revenue opportunity, etc.). Take into account the effort/size and respective ROI/ROE. This requires a little more data as well as discipline, but it will literally pay off. Yes, it’s deceivingly easy to just rank your features by business value. But don’t be fooled: Ignoring effort is a mistake. Without looking at the ROI, you will not end up delivering the most value. That said, getting your stakeholders to take this new perspective will take some effort on your part. Maybe walk them through these examples and … “do the math”.

core/freeform

How to lead data-centric product teams: Jon Mora (Chief AI Officer, Zefr)

How to be a better data-driven product manager

User insights for product decisions by Cris Valerio

Data scaling for startups by Crystal Widjaja

Make Better Product Decisions by Using Quantitative and Qualitative Data, by Brian Tran

Nail your Backlog Priorities by Figuring out Return on Effort

Rene Rosendahl

Read more

Comments