post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Product Management

Sunday Rewind: Whose job is it anyway? The rise of Product Ops and why it deserves to be an independent function

Guest Post

Creating metrics that matter

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

Jock Busuttil (jockbusuttil.com) is a product management and leadership coach, product leader and author. He has spent over two decades working with technology companies to improve their product management practices, from startups to multinationals. In 2012 Jock founded Product People Limited (productpeo.pl), which provides product management consultancy, coaching and training. Its clients include BBC, University of Cambridge, Ometria, Prolific and the UK’s Ministry of Justice and Government Digital Service (GDS). Jock holds a master’s degree in Classics from the University of Cambridge. He is the author of the popular book The Practitioner’s Guide To Product Management (jockbusuttil.com/#book), which was published in January 2015 by Grand Central Publishing in the US and Piatkus in the UK. He writes the blog I Manage Products (imanageproducts.com) and weekly product management newsletter PRODUCTHEAD (producthead.news). You can find him on Twitter (@jockbu) and LinkedIn.

Freelance Head of Product, Coach, Author & Speaker

Jock Busuttil

<img loading="lazy" decoding="async" class="alignright size-medium wp-image-4651" alt="ProductTank - Product Management in eCommerce" src="https://www.mindtheproduct.com/wp-content/uploads/2014/02/GF3C2442-2-300x200.jpg" width="300" height="200" srcset="https://www.mindtheproduct.com/wp-content/uploads/2014/02/GF3C2442-2-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2014/02/GF3C2442-2.jpg 720w" sizes="(max-width: 300px) 100vw, 300px" />As the UK shops itself out of recession, it was more than fitting that February&#8217;s <a title="ProductTank London" href="http://www.producttank.com/" target="_blank">ProductTank London</a> was all about product management in commerce: online, offline and mobile.  This month we had three eye-opening talks:
<ul>
<li>CEO at <a title="Depop" href="http://www.depop.com/" target="_blank">Depop</a> Runar Reistrup (<a title="Runar Reistrup on Twitter" href="https://twitter.com/runarreistrup" target="_blank">@runarreistrup</a>) talking about mobile design for the real world;</li>
<li>&#8220;<a title="&quot;the Malcolm Tucker of testing&quot;" href="https://twitter.com/shagg/status/436296314209726464" target="_blank">the Malcolm Tucker of testing</a>&#8221; Craig Sullivan (<a title="Craig Sullivan on Twitter" href="https://twitter.com/OptimiseOrDie" target="_blank">@OptimiseOrDie</a>) telling us about the most common A/B testing mistakes; and</li>
<li>product owner at <a title="M&amp;S Digital Labs on Twitter" href="https://twitter.com/mnslabs" target="_blank">M&amp;S Digital Labs</a> Hemal Kuntawala (<a title="Hemal Kuntawala on Twitter" href="https://twitter.com/hemalkuntawala" target="_blank">@hemalkuntawala</a>) mashing up Lean, fast feedback and leopard print.</li>
</ul>

<h2>Mobile Product Design for the Real World</h2>
Runar Reistrup (<a title="Runar Reistrup on Twitter" href="https://twitter.com/runarreistrup" target="_blank">@runarreistrup</a>) took the stage first, immediately showing his age by talking about building for mobile in a pre-iPhone era &#8211; back then there was no easy means of distributing apps.  His view on this era of mobile commerce is that, just as early TV programmes were essentially radio plays filmed, we&#8217;re still yet to see the full effects of the mobile revolution.
Mobile is incredible difficult to do well: Facebook was failing at mobile until it bought Instagram; likewise PayPal until it acquired Braintree &#8211; but not every company has the buying power of Google, eBay or Facebook (which coincidentally <a title="WhatsApp – The power of product focus" href="https://www.mindtheproduct.com/whatsapp-power-product-focus/" target="_blank">acquired WhatsApp for an eye-popping $16 billion</a> that same night).  For this reason, Depop chose to focus purely on the mobile experience; they have no desktop site.
<blockquote>&#8220;On average, people check their mobile over 150 times per day.&#8221; &#8211; Runar Reistrup</blockquote>
&#8220;Amazon should never have existed,&#8221; said Runar, &#8220;Walmart and Barnes &amp; Noble should have got there first&#8221;.
Opportunities for new market entrants arose when established players failed to make the leap from offline to online.  The same holds now for companies who don&#8217;t realise that mobile and online commerce experiences differ.  After all, he asked, can you be bothered typing your 16-digit credit card number into a mobile retailer&#8217;s site, on the street, standing in the rain?
Compare and contrast the web era approaches of Addison Lee, Seatwave and eBay with the mobile era approaches of Uber, YPlan and Depop; disruption favours the new &#8211; and the brave.
<blockquote>&#8220;High social capital helps you connect with your buyers more and sell more.&#8221; &#8211; Runar Reistrup</blockquote>
Shopping used to be a social experience.  You&#8217;d go into a &#8220;Mom and Pop&#8221; store and the grocer would recommend and fetch you the items you needed to buy.  The move to department stores and hypermarkets took that social component away.
Rather than listening to an anonymous corporation, which sneakers would your peers and market experts recommend for you?  To win at mobile commerce, you need to look to the real world, see how people make purchases, and make shopping social again.
<h3>Parting Thoughts</h3>
<ul>
<li>Mobile blurs offline and online experiences</li>
<li>Mobile users are out there being distracted in the real world, so design for them 
</li>
<li>Disruption favours the new and the brave</li>
<li>To win at mobile commerce, make shopping social</li>
</ul>
<h2>Easy A/B Testing F**k-Ups</h2>
<blockquote>&#8220;We believe that doing [A] for people [B] will make outcome [C] happen. We&#8217;ll know this when we observe data [D] and obtain feedback [E].&#8221; &#8211; Craig Sullivan</blockquote>
ProductTank took an amusingly sweary turn as conversion rate optimisation (CRO) expert Craig Sullivan (<a title="Craig Sullivan on Twitter" href="https://twitter.com/OptimiseOrDie" target="_blank">@OptimiseOrDie</a>) took the stage.  He was reprising his well-received and entertaining talk from <a title="ProductCamp London" href="http://www.productcamplondon.com/" target="_blank">ProductCamp London</a> earlier in the month on the 13 most common A/B testing mistakes made:
<ol>
<li>Testing in the wrong place</li>
<li>Your hypothesis inputs are crap</li>
</ol>
<a href="https://www.mindtheproduct.com/wp-content/uploads/2014/02/These-are-the-inputs-you-need-for-AB-testing.png"><img loading="lazy" decoding="async" class="aligncenter wp-image-4526" alt="These are the inputs you need for AB testing" src="https://www.mindtheproduct.com/wp-content/uploads/2014/02/These-are-the-inputs-you-need-for-AB-testing-1024x768.png" width="1024" height="768" srcset="https://www.mindtheproduct.com/wp-content/uploads/2014/02/These-are-the-inputs-you-need-for-AB-testing-1024x768.png 1024w, https://www.mindtheproduct.com/wp-content/uploads/2014/02/These-are-the-inputs-you-need-for-AB-testing-300x225.png 300w" sizes="(max-width: 1024px) 100vw, 1024px" /></a>
<ol start="3">
<li>No analytics integration</li>
<li>Your test will finish after you die</li>
<li>Not testing for long enough</li>
<li>No QA for your split test</li>
<li>Opportunities are not prioritised</li>
<li>Testing cycles are too slow</li>
<li>Your test fails</li>
<li>The result is &#8216;about the same&#8217;</li>
<li>Test flips or moves around</li>
<li>Nobody &#8216;feels&#8217; the test</li>
<li>You forgot you were responsive</li>
</ol>
His full <a title="Product Tank - 13 Easy AB and Split Testing F***ups" href="http://www.slideshare.net/sullivac/product-tank-13-easy-ab-and-split-testing-fups" target="_blank">slide deck and notes</a> are available on Slideshare.
<h3>Parting Thoughts</h3>
<ul>
<li>You can&#8217;t A/B test everything before you die, so concentrate on the aspects that matter most e.g. bounce rate</li>
<li>A department store couldn&#8217;t refurbish every floor each year, so look for three key things: footfall, low return, and where the opportunities are</li>
<li>Don&#8217;t forget to monitor micro-conversions within a commerce workflow, e.g. checking if a product is avail in desired size, colour</li>
<li>Remedy poor hypotheses for your A/B tests with empathy &#8211; look at real users&#8217; behaviour</li>
</ul>
<h2>Lean, Fast Feedback and Leopard Print</h2>
UK retailer Marks &amp; Spencer (M&amp;S) recently created a digital lab, at which our next speaker Hemal Kuntawala (<a title="Hemal Kuntawala on Twitter" href="https://twitter.com/hemalkuntawala" target="_blank">@hemalkuntawala</a>) is product owner.  Their mission: to use Lean Startup techniques to kick-start products and experiences that their customers wouldn&#8217;t normally expect from M&amp;S.
They wanted to cut red tape and make bolder, riskier changes to their online commerce experience.  They also wanted to move quickly, so they used Lean techniques to build rapidly, release often (seven times a day) and gather rapid feedback to inform their next iteration.
<blockquote>&#8220;Vision, instinct and obsession &#8211; that would be a great name for a fragrance for product managers&#8221; &#8211; Hemal Kuntawala</blockquote>
Starting with three specific insights and assumptions that they wanted to challenge, they asked &#8220;what if&#8230;?&#8221;
<ul>
<li>Would their customers want to create outfit combinations?</li>
<li>Do models alienate customers and affect conversion rates?</li>
<li>Do their brands confuse?</li>
</ul>
So they set out to test out these questions.  After just four weeks, the result was the M&amp;S Style Board:
<a href="https://www.mindtheproduct.com/wp-content/uploads/2014/02/MS-Style-Board.png"><img loading="lazy" decoding="async" class="aligncenter size-medium wp-image-4564" alt="M&amp;S Style Board" src="https://www.mindtheproduct.com/wp-content/uploads/2014/02/MS-Style-Board-300x223.png" width="300" height="223" srcset="https://www.mindtheproduct.com/wp-content/uploads/2014/02/MS-Style-Board-300x223.png 300w, https://www.mindtheproduct.com/wp-content/uploads/2014/02/MS-Style-Board.png 994w" sizes="(max-width: 300px) 100vw, 300px" /></a>
They learned that:
<ul>
<li>conversion to style creation improved to 38%;</li>
<li>removing brands led to customers mixing and matching more across brands; and</li>
<li>observing how customers combined items led to better product suggestions.</li>
</ul>
<figure id="attachment_4566" aria-describedby="caption-attachment-4566" style="width: 160px" class="wp-caption aligncenter"><img loading="lazy" decoding="async" class="size-full wp-image-4566" alt="Mix of M&amp;S Brands" src="https://www.mindtheproduct.com/wp-content/uploads/2014/02/MS-Labs-Category-Mix-Before.png" width="160" height="159" srcset="https://www.mindtheproduct.com/wp-content/uploads/2014/02/MS-Labs-Category-Mix-Before.png 160w, https://www.mindtheproduct.com/wp-content/uploads/2014/02/MS-Labs-Category-Mix-Before-150x150.png 150w" sizes="(max-width: 160px) 100vw, 160px" /><figcaption id="caption-attachment-4566" class="wp-caption-text">Mix of M&amp;S Brands</figcaption></figure>
&nbsp;
What&#8217;s next for M&amp;S Digital Labs? Using personalisation to draw together their customers&#8217; offline and online retail experiences.  Most online department stores sell very different categories of products in the same way, something they want to change.
Hemal&#8217;s full <a title="Product Tank - Lean product development, fast feedback (&amp; leopard print dresses)" href="http://www.slideshare.net/hemalkuntawala/mslabs-producttank" target="_blank">slide deck and notes</a> are available on Slideshare.
<h3>Parting Thoughts</h3>
<ul>
<li>In an established business, find new opportunities by challenging your deep-rooted assumptions </li>
<li>Experiments can uncover new data that will provide new (and unexpected) insights</li>
<li>Go where the data takes you</li>
</ul>
<h2>Q&amp;A on Commerce</h2>
<blockquote><a href="https://www.mindtheproduct.com/wp-content/uploads/2014/02/Asking-a-question-ProductTank.jpg"><img loading="lazy" decoding="async" class="alignright size-thumbnail wp-image-4574" alt="Asking a question - ProductTank" src="https://www.mindtheproduct.com/wp-content/uploads/2014/02/Asking-a-question-ProductTank-150x150.jpg" width="150" height="150" /></a>Mobile has really changed how we do ecommerce; what will mobile change next?</blockquote>
Craig: Sensors tracking our movements and usage will be the future after mobile.
<blockquote>Any testing tips for personalisation?</blockquote>
Craig: Treat it in the same way &#8211; run a test on the effect of personalisation.
<blockquote>Thinking about the web versus mobile era Runar mentioned, which other payment providers are making mobile better?</blockquote>
Runar: Braintree and Stripe are leading the way, we&#8217;re seeing a lot of drop-offs from PayPal on mobile.
<blockquote>Should I go mobile-only, or responsive for my app?</blockquote>
Runar: We see a 50:50 split mobile to desktop, so go both.
Craig: Go mobile web first for rapid prototyping and getting it right, then worry about building a native app.
Hemal: Depends on what you want to do, you can use web content to lead in people to the mobile app.
Craig: You have to have a mobile presence &#8211; there&#8217;s a lot of mobile traffic out there.
And with that we drew the talks, curated with aplomb by Amrita Kriplani (<a title="Amrita Kriplani on Twitter" href="https://twitter.com/elusion" target="_blank">@elusion</a>), to a close, leaving only the important matter of ensuring the drinks our sponsor Tesco had generously provided were all neatly consumed.  Grateful faces all round!  Keep an eye out for the videos of the talks that will be posted up soon.
Do join us for our next <a title="ProductTank" href="http://www.producttank.com/">ProductTank London</a> at 6.30pm on Wednesday 19th March (third Wednesday of each month as usual) on creating a product culture within your organisation.  <a title="ProductTank on Meetup" href="http://www.meetup.com/ProductTank/" target="_blank">Tickets</a> will be made available soon.
Don&#8217;t forget to save the date for 2014’s <a title="Mind The Product Conference" href="http://conference.mindtheproduct.com/" target="_blank">Mind The Product Conference</a> on Friday 12th September.
You can also get in touch with us if you’re interested in <a href="http://www.meetup.com/ProductTank/suggestion/" target="_blank">speaking at or curating a ProductTank</a>, <a title="Guest Post Guidelines" href="https://www.mindtheproduct.com/guest-post-guidelines/" target="_blank">writing for our blog</a> on Mind The Product, or <a title="Sponsor a Product Managers Event" href="https://www.mindtheproduct.com/sponsor-a-product-managers-event/" target="_blank">sponsoring our events</a>.
P.S.  Never let it be said that we don&#8217;t practice what we preach:
<blockquote class="twitter-tweet" lang="en">The remote to advance slides is working! Now that&#8217;s, &#8220;iterative development.&#8221; <a href="https://twitter.com/search?q=%23producttank&amp;src=hash">#producttank</a>
— Simba Sagwete (@Twimba_Sagwete) <a href="https://twitter.com/Twimba_Sagwete/statuses/436226493027741696">February 19, 2014</a></blockquote>
&nbsp;

core/freeform

How to lead data-centric product teams: Jon Mora (Chief AI Officer, Zefr)

How to be a better data-driven product manager

User insights for product decisions by Cris Valerio

Data scaling for startups by Crystal Widjaja

Make Better Product Decisions by Using Quantitative and Qualitative Data, by Brian Tran

Product Management in Commerce: Online, Offline and Mobile

Jock Busuttil

Read more

Comments