post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

Sunday Rewind: Whose job is it anyway? The rise of Product Ops and why it deserves to be an independent function

Guest Post

Creating metrics that matter

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

Liam helps to build digital products and product teams as a freelance product manager. Connect with him on LinkedIn.

Liam Smith

Having &#8220;no company strategy&#8221; is one of the biggest issues facing product managers, according to a recent <a href="https://www.productfocus.com/wp-content/uploads/2018/03/Product-Focus-Industry-Survey-2018.pdf" target="_blank" rel="noopener">survey</a> of over 600 product people. After all, how can you set a reasonable direction for your product when you don&#8217;t know where your company is headed?
It’s an issue that confronted me recently, when I started work with a higher education provider in the UK.
A few months on, and we&#8217;ve found we’ve been able to solve it. And it landed pretty well, we&#8217;ve been given the green light (and extra cash) to deliver it!
Here&#8217;s how we did it.
<h2>Step 1. Define Your key Objective</h2>
Initially, the project was presented to me as something to &#8220;increase the number of people who apply to, and join the university&#8221;. While these numbers may be useful to measure, they&#8217;re also vanity metrics, much like website visitors for an e-commerce website.
Here&#8217;s why.
UK universities typically get paid by the student every three or four months, receiving the first payment about three weeks into the first semester. So a student is of no commercial value until this point. Getting paid enables the university to deliver its mission of providing education services and helping people into employment.
So, as a minimum, our key objective had to be something like, &#8220;to increase the number of people who pay their first tuition fee instalment&#8221;. But we felt that wasn’t enough really, because if the student leaves after the first semester then the university would lose on a significant amount of revenue &#8211; around 89% for a three-year course.
The key objective, therefore, had to be focused on retention. Something like, &#8220;to increase the number of people who complete their studies with the university&#8221;. And you could go a step further and add, &#8220;&#8230;and enter their chosen field of employment&#8221;, given that this is typically a student&#8217;s end goal and hence a factor in their likelihood to recommend the university.
What we were talking about, of course, was customer lifetime value (LTV) &#8211; a term that&#8217;s widely used in SaaS and subscription-based businesses &#8211; and Net Promoter Score (NPS).
We made one final tweak &#8211; to focus on the percentage of applicants rather than total numbers, as it was more within our control &#8211; and went with &#8220;to increase the percentage of applicants who complete their studies with the university, and enter their chosen field of employment&#8221;.
<figure style="width: 740px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/3c5ac761-3a7e-423e-afb1-b5406128f1ab_image2.png" alt="" width="740" height="416" /><figcaption class="wp-caption-text">The key objective we defined as part of our product strategy</figcaption></figure>
In hindsight, we basically answered two questions to determine our key objective. These were, why does the company exist (i.e. what&#8217;s its mission)? And what needs to happen to allow the company to keep working towards its mission?
<h2>Step 2. Define Your Target Customer</h2>
The university had a number of distinct customer segments spanning across qualification levels (e.g. undergraduate, postgraduate), study type (e.g. full-time, part-time), demographics (e.g. age, residency) and more. It would have been nigh-on impossible to try to create something for every combination from day one.
Fortunately, there was enough data available on the student population and the market to be able to determine which combinations were the most significant. A lot of this information was freely available online, for example, Universities UK&#8217;s <a href="https://www.universitiesuk.ac.uk/facts-and-stats/Pages/higher-education-data.aspx" target="_blank" rel="noopener">Higher education in numbers</a> report, which gave us the rich insight displayed below.
We learned that an overwhelming number of students are undergraduates&#8230;
<img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/58bf96cd-3c42-4a70-b85f-d9eb5f80fbf5_image5.png" alt="" width="805" height="518" />
&#8230;and choose to study full-time.
<img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/42cf719e-0558-4bef-8fc4-2185564169d3_image3.png" alt="" width="763" height="491" />
Likewise, a high number of students came from the UK, which was important because the application process differs slightly depending where the student is coming from.
<img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/3beeb1f3-b231-4660-bbfc-0d2bb599ebba_image9.png" alt="" width="821" height="530" />
So, based on this, we decided to focus our efforts on full-time, undergraduate students, who came from the UK, with a view to expanding to all segments as soon as possible.
<h2>Step 3. Map the Steps to Your key Objective</h2>
To understand where the existing experience could be improved and where we should focus first, we mapped out the milestones a student must go through to reach our key objective. In other words, we mapped out a conversion funnel.
Here are the milestones we came up with.
<figure style="width: 802px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/84fe3268-72e9-4e30-b193-9354cf291d5f_image4.png" alt="" width="802" height="451" /><figcaption class="wp-caption-text">The milestones a typical student will go through before reaching the key objective</figcaption></figure>
These milestones could also be used as lead metrics, to help determine whether a student is making meaningful progress towards the key objective, which in this case could take over three years to achieve.
<h2>Step 4. Collect the Data</h2>
Next, we cobbled together data from a variety of sources and populated the conversion funnel. We didn&#8217;t have useful data for the final step (entering chosen employment) so we left it out and made a request to start collecting it.
We ended up with something like this.
<figure style="width: 808px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/58dc25b1-90a8-4492-bf38-e80df46bee76_image7.png" alt="" width="808" height="454" /><figcaption class="wp-caption-text">The number of people at each stage of the funnel and as a percentage of the total number of applicants, figures are illustrative only</figcaption></figure>
At this point, there was still no way of telling what was good or bad so we gathered benchmarks for each of the figures based on competitor and sector averages, where known, as well as any internal year-on-year trends.
This gave us a number of areas to investigate further, for example, the withdrawal rates during the first year, which were among the highest in the sector and the “application” to “offer” rates, which were were notably lower than competitor averages.
<h2>Step 5. Determine the &#8220;why&#8221; Behind the &#8220;What&#8221;</h2>
Analysing data was great for telling us what was happening but it didn&#8217;t tell us why. So, we took the outputs of the steps above and laid out each one as a question. Then we dug deeper.
You could use an infinite number of methods here but we focused on three things: speaking with people (colleagues and students) to understand what happens at different milestones and why, analysing reams of secondary research and consumer reports, and scouring the largest UK student forum, <a href="https://www.thestudentroom.co.uk/" target="_blank" rel="noopener">The Student Room</a> (TSR).
The Student Room was particularly useful. We found thousands of people in our target customer segment openly discussing the same questions we&#8217;d laid out, from why they wanted to go to university to how they decide between institutions. The legwork was in finding the answers and drawing logical conclusions, and Google&#8217;s Site Search function helped with this.
<figure style="width: 896px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/cb9b753f-8a18-4121-8e0a-6fe6c31a5ab3_image8.png" alt="C:UsersliamsAppDataLocalTempenhtmlclipImage(10).png" width="896" height="373" /><figcaption class="wp-caption-text">We used Google&#8217;s site search function to trawl The Student Room</figcaption></figure>
<figure style="width: 863px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/4eece717-b3ea-42f7-8414-dc547c5a9b40_image12.png" alt="C:UsersliamsAppDataLocalTempenhtmlclipImage(5).png" width="863" height="535" /><figcaption class="wp-caption-text">An example of one of the more helpful threads on The Student Room &#8211; a survey showing why people choose to go to university</figcaption></figure>
To help us draw conclusions from the research, we created a mind map. This had our key objective at the centre, our most important questions surrounding it, then any insight and best-guess answers coming off as branches. By the end, it covered most the stuff you&#8217;d expect to find on something like a <a href="http://www.romanpichler.com/blog/the-product-vision-board/" target="_blank" rel="noopener">Product Vision Board</a> from the market and customer needs to internal objectives and product requirements.
<figure style="width: 840px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/ea8483af-1f00-475a-bf20-296285c7d685_image11.png" alt="" width="840" height="472" /><figcaption class="wp-caption-text">We built a mind map to help draw conclusions from the data and research we were gathering</figcaption></figure>
We were able to deduce that a number of the “problematic” areas actually had more to do with the perception of the university, which was way beyond the scope of this work to change (though was noted in our recommendations). Improving the areas later in the funnel, as well as internal efficiency, were perhaps more within our control to change. We then formed a number of hypotheses about how we might achieve our key objective and agreed specific targets (as percentage point increases). This gave us the focus we needed to proceed.
<h2>Step 6. Scope the Solution</h2>
The next step &#8211; and perhaps the simplest &#8211; was to think about a solution.
Based on what we&#8217;d learned so far, we layered in high-level user experience designs alongside the conversion funnel.
<figure style="width: 810px" class="wp-caption alignnone"><img loading="lazy" decoding="async" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/bf6b7b71-63b9-45c1-be9f-032e1da256ea_image10.png" alt="" width="810" height="455" /><figcaption class="wp-caption-text">We layered in high-level user experience designs alongside the conversion funnel, which provided a useful template</figcaption></figure>
Three or four distinct &#8211; but connected &#8211; products emerged from our first pass of the experience design, for example, an application product and a separate customer support product. This in turn gave us ideas for the high-level architecture, team structures and skills needed.
Then, using the insight we&#8217;d gathered plus some additional technical discovery, we were able to form a view on the relative priority of the products and features and a rough Now, Next, Later-style product roadmap.
<figure id="attachment_13999" aria-describedby="caption-attachment-13999" style="width: 833px" class="wp-caption alignnone"><img loading="lazy" decoding="async" class="wp-image-13999" src="https://www.mindtheproduct.com/wp-content/uploads/2018/10/Product-Funnel_Product-Roadmap-300x169.png" alt="" width="833" height="469" srcset="https://www.mindtheproduct.com/wp-content/uploads/2018/10/Product-Funnel_Product-Roadmap-300x169.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2018/10/Product-Funnel_Product-Roadmap-768x432.png 768w, https://www.mindtheproduct.com/wp-content/uploads/2018/10/Product-Funnel_Product-Roadmap-1024x576.png 1024w, https://www.mindtheproduct.com/wp-content/uploads/2018/10/Product-Funnel_Product-Roadmap-285x160.png 285w, https://www.mindtheproduct.com/wp-content/uploads/2018/10/Product-Funnel_Product-Roadmap-570x320.png 570w, https://www.mindtheproduct.com/wp-content/uploads/2018/10/Product-Funnel_Product-Roadmap.png 1920w" sizes="(max-width: 833px) 100vw, 833px" /><figcaption id="caption-attachment-13999" class="wp-caption-text">We also created a Now, Next, Later-style product roadmap based on what we’d learnt so far</figcaption></figure>
All that was left was to share it with senior management and get the go-ahead…
<h2>So, how did it Turn out?</h2>
Surprisingly well, actually. We were successful in &#8220;selling&#8221; our vision and strategy, and were allocated funds to deliver it. And because we&#8217;d involved a number of teams in the process, our peers were (and still are) generally supportive too.
The products and services that are delivered will inevitably be quite different from our early designs. That&#8217;s fine, at least we have overcome one of the biggest hurdles to corporate innovation &#8211; the urge to procrastinate and do nothing.
Perhaps the most valuable part of this work, however, was the template and process that were created &#8211; connecting company strategy (objectives), data and insights to the product strategy, and then seamlessly to the user experience and what&#8217;s delivered. This is something I&#8217;ve personally struggled to do in the past, having wrestled with tools like the Business Model Canvas and Product Vision Board. Similar to these tools though, the Product Funnel (as we now call it) can continually be updated as the team inevitably learn more – everything is stuck on with Post-it Notes and Blu Tack after all.
Want to give it a try? <a href="https://tinyurl.com/y86gnuea" target="_blank" rel="noopener">Download the Product Funnel template</a>.

core/freeform

How to lead data-centric product teams: Jon Mora (Chief AI Officer, Zefr)

How to be a better data-driven product manager

User insights for product decisions by Cris Valerio

Data scaling for startups by Crystal Widjaja

Make Better Product Decisions by Using Quantitative and Qualitative Data, by Brian Tran

How to Create a Product Strategy Without a Clear Company Strategy

Liam Smith

Read more

Comments