LingoLift: Supporting Educators in Personalized Oral Language Teaching for Autistic Children through Content Generation

Authors
Jiawen Zhang, Dongyijie Primo Pan, Li Wang, Pan Hui, Xin Tong
Year
2026
Publication
Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems (CHI '26)
DOI
10.1145/3772318.3790284
Standards Referenced
VB-MAPP, ABLLS-R

Summary

This CHI 2026 paper presents LingoLift, a generative AI system that supports special-education teachers and speech-language pathologists in preparing and delivering personalized oral language lessons for autistic children. The authors argue that existing autism-language tech largely positions children as independent users, sidelining educators whose professional judgment is actually what makes one-on-one teaching effective; and that educators spend disproportionate time preparing individualized lesson plans and materials, leaving less time for instruction itself. The work is structured in three phases. A formative study with 30 hours of video observation of 3 educators and 5 autistic children (ages 6-8), analysis of the school's VB-MAPP-based teaching materials, and expert interviews with 3 speech-language pathologists surfaced three themes: systemic burden in lesson preparation, a lack of thematic coherence across lesson segments (articulation, vocabulary, grammar, conversation), and concrete educator strategies for ability-adaptive and interest-integrated teaching. Grounded in VB-MAPP and localized Chinese Articulation assessment, LingoLift combines a React Native teacher tablet, a Node.js/MongoDB vector-store backend using Tencent Hunyuan text and image models with RAG, and a MediaPipe-gesture-controlled classroom projection client. Three design features - Personalized Teaching Content Generation, Coherent Learning Pathway, and AR Card Interface - drive a workflow from child profile to learning objectives, thematic lesson, generated word lists and illustrations, and gesture-controlled delivery. A three-week deployment with 10 educator-child dyads (30 lessons) at a specialized school in Guangzhou evaluated usability, lesson quality, learning outcomes, and educators' adaptive practices.

Key Findings

LingoLift reduced lesson preparation time from a mean of 72 minutes to 24.7 minutes (66% reduction, range 10-60 min) while maintaining high perceived quality. Post-study questionnaire means on 1-7 Likert scales were consistently above midpoint: Ease of Use M=5.28 (SD=0.58), Usefulness-Efficiency M=5.08 (0.88), Usefulness-Performance M=4.88 (0.83), Satisfaction M=4.80 (1.00). Lesson Coherence and Personalized Alignment stayed stable across weeks; Child Engagement showed a statistically significant upward trend (Week 1 M=4.20 to Week 3 M=5.10, p<0.05), with objective achievement reaching M=5.27 (0.52). Tact (naming) skill gains were rated highest (M=5.17). Seven of ten children (C1-C4, C7-C9) engaged strongly with the AR projection; three (C5, C6, C10) struggled with virtual content, preferring physical manipulatives. Educators went well beyond the intended functionality: T2 created an immersive "parking-lot" spatial-reasoning game, T1 designed a gesture-driven butterfly-chasing activity, T6 prepared video + pinwheel + mirror multi-sensory supplements for articulation, and T3 introduced olfactory/gustatory anchors via food for zoo-themed sessions. Qualitative analysis revealed that educators actively "negotiated" AI outputs via iterative prompt refinement - T2 asked over ten times for local bus imagery and eventually settled for the closest approximation, while T7 filtered out museum images she deemed unsuitable for easily-frightened autistic children. The authors frame educators' prompt refinement as an interactional layer that steers AI toward contextually and emotionally appropriate materials.

Relevance to Practice

For practitioners working on AI-assisted special education, this paper is a concrete demonstration that the most valuable role for generative AI in autism language teaching is augmenting expert educators rather than replacing them. The 66% reduction in preparation time, combined with educators' creative extensions (physical-digital hybrids, multi-sensory compensations, local cultural anchoring), argues for a design stance the authors call "AI as Adaptive Collaborative Partner" with three capabilities: generative flexibility for hot-fixes, behavioural co-regulation (adjusting visual complexity and pacing in response to hyperactivity or attention loss), and embedded expert guidance. The VB-MAPP-grounded, assessment-driven content-generation architecture is directly reusable for other assistive language tools. The paper's documentation of children who do not respond well to virtual content (C5, C6, C10) is an honest limitation: projection-based AI materials risk systematically disadvantaging the most sensory-sensitive or cognitively-support-intensive children, and the authors advocate hybrid physical-digital design and digital-readiness assessment before deployment. Other limits: Guangzhou urban sample, Mandarin-specific phonetics pipeline, three-week horizon with confounding concurrent therapies, and no longitudinal measurement of language development trajectory.