No. 09
AI & VR
Polyglot
Polyglot VR is a choice-based virtual reality game designed to reimagine second-language learning. The project addresses the lack of engaging, practical speaking experience in standard curricula by allowing users to roleplay and converse with AI-driven NPCs. The outcome is an interactive space that develops speaking and listening skills through contextual immersion. It won the Design Excellence Award at Northumbria University.
Role
Interaction Designer
Timeline
15 weeks
Team
Solo project (thesis)
Year
2022
The problem & the user
The Challenge
Traditional language learning relies heavily on book learning, which often fails to engage or provide practical speaking experience. As we get older, finding the time to commit to learning a language is difficult, and the fear of embarrassment can hinder practice.
The User
The target users are intermediate language learners (A2-B2 CEFR) who own VR headsets and enjoy gaming, typically aged 16-34. They already possess foundational knowledge but struggle with natural cadence, conversational skills, and contextual vocabulary.
In numbers
64%
of language learners experience high “speaking anxiety”
70%
of adults regret losing their foreign language skills
<10%
of language students achieve true proficiency
The approach & process
01
Research & Discovery
Research began with a literature review on language pedagogy and a market analysis of existing tools like Duolingo and Mondly VR. I conducted 5 user interviews to understand learner motivations, discovering a strong desire for contextual immersion and a fear of embarrassment when speaking.
02
Ideation & Wireframing
Through techniques like SCAMPER, Crazy 8s, and decision matrices, I produced various AR and VR concepts before pivoting entirely to VR to maximise immersion. I designed the information architecture and wireframes specifically optimised for Oculus’ curved UI guidelines, ensuring higher accessibility.
03
Prototyping & Testing
I developed a high-fidelity Figma prototype to test the UI flow, followed by a functional Unity prototype. I hosted a design workshop with multidisciplinary students, utilising Think-Aloud protocols, A/B testing, and Wizard of Oz roleplay to validate the interactions and refine the conversational UI.
The solution
The result was a fantasy-themed virtual reality game where players navigate a branching quest by speaking in their target language.
Voice-Based NPC Interactions
Players speak directly with NPCs using speech recognition. This core mechanic addresses the user’s need for practical speaking experience, providing a safe, consequence-free environment to build confidence and experiment with contextual vocabulary.
AI-Powered Grading System
After each interaction, players receive a detailed UI breakdown of their performance based on Correctness, Delivery, and Engagement. This provides actionable, specific feedback, helping users understand exactly how to improve their conversational skills, grammar, and natural intonation.
Replayability for Proficiency
To develop real CEFR proficiency, the game uses its branching structure to turn playtime into practice. Reaching an ending encourages players to restart and explore new conversational paths. By replaying the game to master each subject and collect every item, players unlock an advanced final interaction, ensuring that their drive to complete the game directly mirrors their journey to language mastery.
Voice-Based NPC Interactions
Players speak directly with NPCs using speech recognition. This core mechanic addresses the user’s need for practical speaking experience, providing a safe, consequence-free environment to build confidence and experiment with contextual vocabulary.
AI-Powered Grading System
After each interaction, players receive a detailed UI breakdown of their performance based on Correctness, Delivery, and Engagement. This provides actionable, specific feedback, helping users understand exactly how to improve their conversational skills, grammar, and natural intonation.
Replayability for Proficiency
To develop real CEFR proficiency, the game uses its branching structure to turn playtime into practice. Reaching an ending encourages players to restart and explore new conversational paths. By replaying the game to master each subject and collect every item, players unlock an advanced final interaction, ensuring that their drive to complete the game directly mirrors their journey to language mastery.
Results
Impact
+40%
Potential vocabulary increase through NPC interactions (Rankin study)
115
Unique ways to play
94%
Task completion during usability testing
Reflection & learnings
What I learned
Holding my first solo workshop was instrumental; it proved that gathering diverse perspectives is crucial to stepping outside my own biases. I also learnt how to navigate Unity and the Oculus SDK, translating 2D UI concepts into tangible VR interfaces.
Changes I’d make
I would proactively strive to create a less Eurocentric prototype by arranging focus groups with diverse communities to challenge my biases. Additionally, better time management during the ideation phase would have allowed me more time to refine the game’s branding and explore backend machine learning concepts further.