Abu Dhabi University (ADU) has marked a significant milestone in inclusive technology with the granting of a patent for its innovative 'HearMe' application. Announced on April 8, 2026, this AI-powered tool promises to revolutionize communication for individuals with hearing impairments, particularly in educational settings across the United Arab Emirates (UAE). Developed by ADU's Associate Professor of Computer Science and Information Technology, Dr. Modafar Ati, in collaboration with BSc Information Technology alumna Reem Al Bostami, HearMe addresses a critical gap in real-time multilingual sign language translation, fostering greater accessibility in higher education and beyond.

The app's emergence comes at a time when UAE universities are increasingly prioritizing digital inclusion, aligning seamlessly with national strategies to empower People of Determination. With an estimated 12,000 individuals living with hearing loss in the UAE, tools like HearMe could transform how deaf and hard-of-hearing students engage in academic environments, where traditional communication barriers often hinder participation.

🛠️ The Innovation Behind HearMe

HearMe stands out for its bidirectional functionality, converting signed gestures into written text or spoken words while simultaneously transforming typed or spoken input into animated sign language avatars. This real-time processing leverages advanced artificial intelligence (AI), including computer vision for gesture recognition and natural language processing (NLP) for accurate translation across multiple sign systems.

Dr. Modafar Ati, whose research focuses on smart cities, cybersecurity, and eHealth, explained the technical foundation: "HearMe uses deep learning models trained on diverse datasets of sign languages, ensuring high accuracy even in varied lighting or backgrounds." The app supports languages such as American Sign Language (ASL), French Sign Language (Langue des Signes Française, LSF), and crucially, elements of Emirati Sign Language (ESL), the predominant system in the UAE. This multilingual capability is vital in the UAE's expatriate-heavy population, where users might switch between Arabic, English, and international sign variants.

Reem Al Bostami's contribution as an alumna highlights ADU's role in nurturing talent from ideation to patent. Her involvement underscores how university-industry collaborations can yield practical solutions, with the duo's work originating from ADU's labs aimed at applied AI for social good.

Addressing Communication Barriers in UAE Classrooms

In UAE higher education, deaf students face substantial challenges. Studies indicate that while enrollment of students with disabilities has risen—up 116% in Abu Dhabi private schools from 2023 to 2024—specialized support remains limited. Traditional interpreters are scarce, and reliance on written notes or lip-reading falls short in dynamic lectures or group discussions.

HearMe changes this by enabling seamless interaction. Imagine a deaf engineering student at ADU following a lecture in real time: the professor's speech converts to on-screen animated signs, while the student's signed questions translate to text for peers. Early pilots at ADU have shown promising results, with users reporting 85-90% translation accuracy for common academic vocabulary.

This isn't just technology; it's empowerment. By integrating with platforms like Microsoft Teams or Zoom—common in UAE unis—the app extends to hybrid learning, a staple post-pandemic.

UAE's National Push for Inclusion in Higher Education

The patent aligns perfectly with the UAE's National Policy for Empowering People of Determination 2020-2024, which emphasizes digital equity and accessible education. The Zayed Higher Organisation for People of Determination reports that hearing impairments affect about 1% of the UAE population, with higher education enrollment for deaf students lagging at under 0.5% compared to the general 60% tertiary participation rate.

ADU's efforts complement broader initiatives, such as Dubai's Guinness World Record for the largest virtual Emirati Sign Language class (over 6,000 participants in January 2026), signaling growing societal commitment. Other UAE universities like Khalifa University and UAEU are advancing AI for accessibility, but HearMe's patent positions ADU as a leader.

Professor Dr. Ghassan A. Abu-Lebdeh, ADU Provost, noted: "This patent exemplifies ADU's Vision 2027, embedding innovation with community impact."

Technical Edge: AI Models and Multilingual Challenges

Developing HearMe involved overcoming key hurdles in sign language AI. Sign languages are visual-spatial, non-linear, and vary regionally—ESL, for instance, draws from ASL but incorporates Arabic cultural nuances. The team employed convolutional neural networks (CNNs) for gesture detection and recurrent neural networks (RNNs) or transformers for sequence modeling, achieving low-latency processing on mobile devices.

• Gesture Recognition: Camera captures handshapes, positions, movements, non-manual features (facial expressions).
• Translation Engine: NLP converts to target language text/speech.
• Sign Generation: Avatar animation using 3D modeling for natural signing.
• Multilingual Support: Modular datasets for ASL, LSF, ESL.

Accuracy improves with user feedback loops, adapting to individual signing styles. Privacy is prioritized via on-device processing, compliant with UAE's data protection laws.

Impact on Deaf Students and Faculty in UAE Universities

For deaf students, HearMe means equal footing in lectures, seminars, and exams. A 2023 study on DHH students in UAE unis found 70% reported communication as the primary barrier to academic success. At ADU, where ~200 students with disabilities are enrolled (5% of total), the app could boost retention and graduation rates.

Faculty benefit too: no need for specialized interpreters, freeing resources. Case in point: ADU's Inclusion Advocates of Tomorrow program pairs students with mentors, now enhanced by HearMe for sign-fluent interactions.

Real-world example: During trials, a deaf IT student used HearMe to present a project, receiving instant peer feedback—previously impossible without delays.

Stakeholder Perspectives: From Deaf Community to Policymakers

The UAE Deaf community welcomes HearMe. ESL advocates note its potential to standardize signs amid dialect variations. Zayed Authority officials praised it as "a step toward 100% digital inclusion by 2031."

Experts like Dr. Ati emphasize scalability: "Future updates will integrate ESL fully, with AR glasses support." Challenges remain—varying lighting, accents—but continuous training mitigates them.

Broader UAE Higher Ed Landscape: AI for Accessibility

ADU joins peers like NYU Abu Dhabi (AI ethics research) and Khalifa University (AI Center), but HearMe is unique for sign focus. UAEU's smart campus initiatives include captioning, yet sign translation lags.

Government backing via UAE AI Strategy 2031 allocates AED 100M+ for edtech, targeting 90% digital literacy for disabled citizens.

Challenges in AI Sign Language Translation

Despite advances, issues persist: regional sign variations (ESL dialects), non-manual markers (essential for grammar), computational demands on mobiles. Ethical concerns—data privacy for vulnerable users—are addressed via federated learning.

• Accuracy drops 15-20% in noisy environments.
• Training data bias toward dominant signs.
• Integration with legacy systems in unis.

Solutions: Community-sourced datasets, edge AI optimization.

Future Outlook and Rollout Plans

ADU plans app launch Q3 2026, free for UAE unis, with partnerships like Ma'an and Key2enable. Expansion to Gulf sign languages eyes GCC-wide adoption.

Long-term: Boost deaf enrollment 20% by 2030, per national goals. As UAE aims for top global innovation, HearMe exemplifies higher ed's role.

This patent not only celebrates ADU's ingenuity but signals a inclusive future for UAE academia.

Photo by Bhavya Patel on Unsplash