As language learning makes a sea change to online, users will come to expect personalized learning experiences. China’s AI-powered online education market alone reached $568 million in 2017 and is expected to surpass $26 billion in 2022. At Sana Labs, we build AI technologies to power these learning experiences through easy to integrate APIs. This means that machine learning models for personalization as well as pronunciation, grammar, and overall fluency feedback can be production-ready in days, not months. In this article, I’ll highlight why deep learning will power this shift.
Recent breakthroughs in speech recognition are making their way to language learning. Traditionally, machine learning models for automated speech scoring have relied on handcrafted rules and heuristics. This is not ideal due to difficulties in finding a model that can address real-world noise issues as well as varying levels of non-native speech.
“Recently, end-to-end solutions that apply neural networks have achieved state-of-the-art performance on par with human level graders.”
Recently, end-to-end solutions that apply neural networks to encode acoustical cues to learn predictive features automatically, have achieved state-of-the-art performance on par with human level graders. This is equally a function of larger datasets, computational capacity (both training and inference) and algorithmic breakthroughs. What this means in practice is that scalable feedback on pronunciation, fluency, and intonation is now able to deal with learner levels, accents, and background noise.
Detecting and correcting grammar errors is a highly complex task that involves addressing over 75 different error types learners can make. While approaches with distinct classifiers for different error types have achieved strong results, they do not handle the wide variety of orthographic and grammatical errors in a flexible manner. In order to capture the nuances of language, richer models are appropriate.
“The power of neural networks enables us to capture the complexities of language learning and to off-load teacher grading while maintaining the same accuracy and provide a real-time writing assistant to every student.”
The past few years have seen neural networks achieve state-of-the-art performance on nearly all language processing tasks. The power of neural networks lies in their ability to automatically discover features that are useful for the task, enabling us to capture the complexities of language learning and provide significantly more accurate feedback. In practice, this could off-load teacher grading while maintaining the same accuracy and provide a real-time writing assistant to every student.
In order to personalize practice one has to model both aspects of the user (such as proficiency and memory) as well as the content (such as question relationships and difficulty). Traditional approaches have relied on hard-coded rules and simple heuristics based on psychological theories of learning. However, these models often fall short of capturing the complexity of content and human knowledge acquisition.
“By capturing aspects such as how users forget concepts and how mistakes relate to particular knowledge gaps we can generate personalized study plan recommendations that drive engagement and learning outcomes.”
Combining neural networks with immense datasets of language learning, we are now able to capture a myriad of aspects such as how users forget a particular word and how mistakes relate to particular knowledge gaps as well as the optimal difficulty and order of exercises. Hence we can generate personalized study plan recommendations that drive engagement and learning outcomes. Case in point this approach won all categories in Duolingo’s SLAM competition.
Users of language learning products enter at fundamentally different levels of proficiency and with different backgrounds. Thus placement tests and assessments are core components of language learning platforms. In order to create effective tests, the assessment value of each content item and how it relates to other content items must be derived. Effective assessment systems target this problem in a data-driven way and provide immediate feedback.
“We can predict, with approximately 90% accuracy, whether users will answer certain questions correctly”.
Applying breakthroughs highlighted across speech recognition, grammar error detection, and knowledge tracing, we can more effectively assess and give feedback on a student’s knowledge. As a result, we can predict, with approximately 90% accuracy, whether users can answer certain questions correctly. This allows us to provide more effective placement tests as well as adaptive, personalized, real-time language proficiency assessment.
In the Yunnan province alone, 70% of schools lack English teachers and in the U.S. two-thirds of them report feeling underprepared to adequately help students succeed. With the number of students learning English predicted to grow from 1.5 billion in 2018 to 1.9 billion in 2020, I’m hopeful that deep learning can make language learning more scalable and accessible to all.
If you want to partner with us in bringing personalized education to everyone, everywhere please send a note to firstname.lastname@example.org /email@example.com
The writer is Anna Nordell-Westling Co-Founder & CMO Sana Labs.
Anna is the co-founder and CMO of Sana Labs, an artificial intelligence company that applies deep learning to personalize education. Anna is an entrepreneurial multi-disciplinary strategic brand builder with 15+ years of experience in developing and implementing marketing strategies for a wide variety of brands. Previous to Sana Labs, Anna headed brand strategy and consumer insight at international and national agencies like Saatchi & Saatchi, Acne, and King for almost ten years. She also ran her marketing acceleration agency for five years working with tech startups and fast-growing companies mainly in Stockholm, Berlin, San Francisco, and Kuala Lumpur. Always with one main focus, to accelerate business through traction and growth. In the last five years Anna has also angel invested in tech startups, she’s on the board of Stockholm.AI and sits in the steering committee of Nordic.AI.
At EduTECH Asia, Anna will keynoting on Personalizing education at scale through AI. Join her on 6th November at 2pm at Suntec Convention Center, Level 4.
Book your seat now before the ticket price rises.
See you there!
If you have big ideas and experience in using technology to transform teaching and learning, we want you on our stage at EduTECH Asia – Asia’s largest education conference. Email firstname.lastname@example.org to discuss speaking opportunities.