post

Footer About

Footer Contribute

Footer Get Involved

Footer Links

Mind the Product

Guest Post

Creating metrics that matter

A case study: Launching a product process in a project-based company

B2B product management

Artificial Intelligence (AI) & Machine Learning (ML)

Building Product Teams

Business Strategy

Data Driven Product Management

Digital Transformation

Diversity and Inclusion

Minimum Viable Product

OKRs

Prioritisation

Product Design

Product Research

Product Development Process

Product Ethics

Product Discovery

Product Leadership

Product Management Career

Product Strategy

Stakeholder Management

🌎 <a href="https://www.mindtheproduct.com/world-product-day/" style="color:#FFFFFF;text-decoration:underline;">Happy World Product Day!</a> Be sure to celebrate product, yourself, and your peers today! 🎉

How much are product managers getting paid in 2024?

Leading product ops at Delivery Hero with Koen Dubelaar

Connecting fans to creators at Spotify (Dariusz Dziuk, Product Lead, Spotify)

“You’re not as competent as you think” 5 lessons from Ken Chin on navigating a product career (CPO, Spark Networks)

Everything wrong with the product management job market. And how to fix it

Louron serves as the Editor at Mind the Product, bringing nearly a decade of experience in editorial positions across business and technology publications. For any editorial inquiries, you can connect with him on LinkedIn or Twitter.

Louron Pratt

<p><em>This article is part of our AI Knowledge Hub, created with <a href="https://www.pendo.io/?&amp;utm_source=mtp&amp;utm_medium=website&amp;utm_campaign=ai-hub-post" target="_blank" rel="noopener">Pendo</a>. For similar articles and even more free AI resources, <a class="c-link" href="https://www.mindtheproduct.com/ai-knowledge-hub/" target="_blank" rel="noopener noreferrer" data-stringify-link="https://www.mindtheproduct.com/ai-knowledge-hub/" data-sk="tooltip_parent">visit the AI Knowledge Hub now.</a></em></p>
<h2>Creating a freemium subscription model</h2>
<p><span style="text-decoration: underline;"><a href="https://www.linkedin.com/in/edwinbodge/">Edwin Bodge</a></span> has been at Duolingo for five years. He comes from a software and engineering background and has focused on monetising the app since he joined the company. “We want the app to be free for everyone worldwide to use. However, we also need to keep the lights on,” he says. “We use the investment gained from our subscription model to reinvest in the business, improve our learning experience, and teach better.”</p>
<p>Creating a disciplined culture of keeping some features free while inventing new functions worth paying for is a continuous journey. “We only want a portion of our members to be subscribers. Making this free product <a href="https://www.mindtheproduct.com/making-your-product-more-accessible/" target="_blank" rel="noopener">accessible</a> will help us grow as a brand and consequently grow our user base without as much marketing resources required.”</p>
<h2>The introduction of AI</h2>
<p>Edwin explains how Duolingo gained access to a GPT-4 demo in August 2022, a few months before it was released to the public: “We’ve been using AI for nearly a decade and countless in-house AI models are used by our team of AI researchers. However we recently pivoted a single monetisation team to go all in on GPT-4,” says Edwin. Duolingo concluded it could use <a href="https://www.mindtheproduct.com/from-lala-land-to-the-matrix-can-ai-replace-product-management/" target="_blank" rel="noopener">GPT-4</a> to add a new subscription tier to its payment model. “The features that we were able to build through GPT-4 would help to serve users’ needs,” he adds.</p>
<p>With <span style="text-decoration: underline;"><a href="https://blog.duolingo.com/duolingo-max/">Duolingo MAX</a></span>, the higher-tier model, the team built a role-playing feature where users can spark a conversation with AI characters.</p>
<p>Edwin explains that one of the biggest learner needs is understanding the rules of language. “Adult learners especially want to know why a sentence is wrong. GPT helps us do that well. If you make a mistake, it pulls up an explanation which enhances the overall learning experience.”</p>
<h2>What external and internal stakeholders think of Duolingo</h2>
<p>Edwin says they are always looking for ways to improve the application. The team is currently focused on engaging complete beginner learners. “One of the things we’ve learned through user interviews is that we could be much more proactive in providing feedback on how well they are learning,” he says. “Not all learners are conscious that they need help. We are asking ourselves how to use <span style="text-decoration: underline;"><a href="https://openai.com/research/gpt-4">GPT-4</a></span> more and make it act more like a coach.”</p>
<h3>Introducing new features</h3>
<p>Gamification is at the core of Duolingo’s product experience—characters, daily streaks, and leaderboards are just a few features it offers to create a playful learning journey. The product team constantly asks themselves, ‘Is this feature useful?’ Asking these questions makes a streamlined process for killing and introducing new features.</p>
<p>A/B testing is also at the core of introducing new features. “We A/B test everything,” Edwin adds. “It enables us to make quick data-driven decisions and helps us to roll things out quickly,”</p>
<h3>Creating a user experience for all</h3>
<p>When it looks to create a learning experience that engages every user, Edwin explains how Duolingo breaks this down into three dimensions: geography, age group, and proficiency.</p>
<p>He acknowledges that the application must find different ways to engage with different demographics and age groups. For example, its data shows that if a user lives outside of the United States, they tend to learn a foreign language faster. In addition, older learners tend to retain much better, despite the younger generation being more aware of the brand, Edwin says.</p>
<h3>Retention, retention, retention</h3>
<p>Duolingo focuses heavily on <a href="https://www.mindtheproduct.com/customer-adoption-retention-product-manager-karen-adie/" target="_blank" rel="noopener">retention</a>. One of its mantras is that ‘the best way to learn a language is to keep trying’. User retention and Daily Active Users are the key metrics that it tracks. “A fourth of our product and engineering function is geared towards growth and retention. That’s where a lot of gamification strategy comes from, such as the streak or the owl notifications.” Edwin explains.</p>
<h2>An ongoing learning experience</h2>
<p>Edwin says that the team at Duolingo focuses heavily on continuously learning to create the best experience for its customers. He has seen the company grow from 50 to 750 people in five years. “We&#8217;ve tried to make sure our process is lightweight, with limited red tape around anything so that our product managers can just run with an idea, and instead of it taking a few months to get an experiment out, we can get a test out in the course of a few weeks.”</p>
<p>Of Duolingo’s GPT-4 journey thus far, Edwin says: “It’s been a really fun and crazy ride over the past year. We’ve encouraged our team to be curious about these new AI learning tools. Pretty much everyone on the team can have a go and see what happens. We want everyone involved on that product strategy journey so they can chip in, and we can all figure out what is best for our learners.”</p>

core/freeform

AI ethics advice from former White House technologist – Kasia Chmielinski (Co-founder, The Data Nutrition Project)

How Google makes AI work at Enterprise scale – Miku Jha (Director, AI/ML and Generative AI, Google Cloud)

LLM workflows for product managers: 3 key takeaways (Niloufar Salehi, Assistant Professor at UC Berkeley) – ProductTank SF

The future of product management: Insights from ProductTank San Francisco

Product lessons learned making early moves with AI in media: Lindsey Jayne (CPO, Financial Times)

A year with ChatGPT and product innovation: Navigating the AI landscape

How to keep your head about generative AI (when everyone is losing theirs) by Claire Woodcock

How Duolingo uses AI to enhance its user experience

Louron Pratt

Read more

Comments