post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

A case study: Launching a product process in a project-based company

Product Management

What I wish I knew sooner in product: Lessons from the community

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

I've been in the digital industry for over 10 years and have worked across small and large charities, as well as my own freelance projects. I am now Director of Digital at the sector leading creative agency William Joseph. 

Having been at Cancer Research UK for the last four years, I have been able to work on high volume, high profile campaigns such as Race for Life, Dryathlon and the much-quoted #nomakeupselfie. 

In that time I helped drive forward the charity’s digital product and marketing capabilities to be some of the most respected and successful in the sector. 

I'm always excited to work with other organisations, share expertise and swap cat gifs. Give me a shout!

Director of Digital

James Gadsby Peet

<p>Machine learning has taken over huge parts of our world, from diagnosis of medical conditions to legal queries to beating human players in Go. How does this affect how we design, build, and manage products? In this insightful talk from Mind the Product London 2017, <a href="https://twitter.com/bigmediumjosh" rel="noopener" target="_blank">Josh Clark</a> shares how we need to think about product design and product management in the era of the algorithm.</p>
<p>Rather than trying to design a single route through an experience or product, when working with machines it’s about working out all the possible outcomes and how to handle them. Product managers will be key in this process, if we hope to create products that are going to have a positive impact on people&#8217;s’ lives, rather than simply embed the injustices of the past.</p>
<p><img loading="lazy" decoding="async" class="aligncenter size-large wp-image-12420" src="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Product-in-the-Era-of-the-Algorithm-by-Josh-Clark-at-mtpcon-1024x684.jpg" alt="Product in the Era of the Algorithm by Josh Clark at #mtpcon" width="1024" height="684" srcset="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Product-in-the-Era-of-the-Algorithm-by-Josh-Clark-at-mtpcon-1024x684.jpg 1024w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Product-in-the-Era-of-the-Algorithm-by-Josh-Clark-at-mtpcon-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Product-in-the-Era-of-the-Algorithm-by-Josh-Clark-at-mtpcon-768x513.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Product-in-the-Era-of-the-Algorithm-by-Josh-Clark-at-mtpcon.jpg 2048w" sizes="(max-width: 1024px) 100vw, 1024px" /></p>
<p>At this point algorithms still make too many mistakes and this holds up their widespread adoption. Voice commands, for example, is one area where there are many bugs &#8211; the machines are struggling to pick up the nuances that are communicated in most languages. Microsoft’s picdescbot can describe what is in an image &#8211; but is still struggling to pick up the difference between many types of imagery. But this is not going to last long.</p>
<p>So how do we design products in world of algorithms?</p>
<h2>Embrace Uncertainty</h2>
<p>Google’s snippet tool gives answers to questions posed &#8211; for about 15% of searches. When it works it’s great, but there are many instances where it gets it wrong. This can be especially risky when associated with news events and politics &#8211; given the amount of controversial information that is on the web.</p>
<p>As with many of these tools, only a single answer is typically presented &#8211; which by default reduces the nuance which can be illustrated. We have to design interfaces to have some sort of humility when they are not sure of the answer. Most of the image analysis tools now available have a confidence scale, but it is rarely used in their outputs. This needs to change if they are to become truly useful &#8211; when they are confused, let them say so.</p>
<p>Following on from this, transparency and collaboration between humans and machines are where really interesting work can happen. When an algorithm fails, that’s the point at which the machines should ask for human input to improve their results. Wikipedia for example flags a number of its pages as ‘Disputed’ &#8211; so that the reader knows to proceed with an extra cautious eye.</p>
<p><img loading="lazy" decoding="async" class="aligncenter size-large wp-image-12418" src="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-Algorithm-Era-at-mtpcon-1024x684.jpg" alt="Josh Clark Algorithm Era at #mtpcon" width="1024" height="684" srcset="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-Algorithm-Era-at-mtpcon-1024x684.jpg 1024w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-Algorithm-Era-at-mtpcon-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-Algorithm-Era-at-mtpcon-768x513.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-Algorithm-Era-at-mtpcon.jpg 2048w" sizes="(max-width: 1024px) 100vw, 1024px" /></p>
<h2>Machines Only Know What we Tell Them</h2>
<p>Garbage in equals garbage out. The goal of machine learning is often to decide what’s normal, and point out when things are going to deviate from it. The problem is that they learn from the existing situation, which is often far from perfect. For example Google’s speech recognition is worse at recognising a woman’s voice than a man’s because of the data that it was fed originally. This can get much worse, there are examples from across the industry of automated systems that don’t recognise people with dark skin or non-caucasian eyes.</p>
<p>We must be cognisant of the fact that we could easily code our historical biases into the machines of the future. People who have been persecuted in the past are not outliers, they must be integrated into the fabric of our societies and we can help make that happen with technology.</p>
<p><img loading="lazy" decoding="async" class="aligncenter size-large wp-image-12419" src="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-at-mtpcon-1024x684.jpg" alt="Josh Clark at #mtpcon" width="1024" height="684" srcset="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-at-mtpcon-1024x684.jpg 1024w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-at-mtpcon-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-at-mtpcon-768x513.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Josh-Clark-at-mtpcon.jpg 2048w" sizes="(max-width: 1024px) 100vw, 1024px" /></p>
<h2>Responsible Data Collection</h2>
<p>Data input is actually UX research at an unprecedented scale. Design teams need more diversity so that we can better interpret these inputs and allow our products to meet the needs of the range of perspectives we now design for.</p>
<p>We need to make it easy for our users to contribute accurate data to our products. Tinder and Facebook have done this, because of the inherent motivations of their users. We need to see how else we can get our users to help us improve their experiences &#8211; but it has to be done transparently so that everyone understands and agrees to how that data is being used.</p>
<p><img loading="lazy" decoding="async" class="aligncenter size-large wp-image-12417" src="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Hostile-Information-Zones-at-mtpcon-1024x684.jpg" alt="Hostile Information Zones at #mtpcon" width="1024" height="684" srcset="https://www.mindtheproduct.com/wp-content/uploads/2017/11/Hostile-Information-Zones-at-mtpcon-1024x684.jpg 1024w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Hostile-Information-Zones-at-mtpcon-300x200.jpg 300w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Hostile-Information-Zones-at-mtpcon-768x513.jpg 768w, https://www.mindtheproduct.com/wp-content/uploads/2017/11/Hostile-Information-Zones-at-mtpcon.jpg 2048w" sizes="(max-width: 1024px) 100vw, 1024px" /></p>
<h2>Be Loyal to Users</h2>
<p>Finally, be loyal to your users. We are going to be designing products that impact peoples&#8217; experiences, lives and perhaps even human rights. We need to take this seriously and apply our human decency to product decisions &#8211; so that we can be kind to each other in the tools and experiences that we make.</p>

core/freeform

AI ethics advice from former White House technologist – Kasia Chmielinski (Co-founder, The Data Nutrition Project)

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

LLM workflows for product managers: 3 key takeaways (Niloufar Salehi, Assistant Professor at UC Berkeley) – ProductTank SF

The future of product management: Insights from ProductTank San Francisco

Product lessons learned making early moves with AI in media: Lindsey Jayne (CPO, Financial Times)

A year with ChatGPT and product innovation: Navigating the AI landscape

How to keep your head about generative AI (when everyone is losing theirs) by Claire Woodcock

Product Design in the Era of the Algorithm by Josh Clark

James Gadsby Peet