Individuals with Complex Communication Needs (CCN) face difficulties in their daily life that call for creative and accessible solutions to overcome these challenges. This paper presents an Android-based Augmentative and Alternative Communication (AAC) application that uses a Visual Scene Display (VSD) interface to empower individuals with CCNs. By using personally relevant photos as communication contexts, the app allows caregivers and AAC users to create picture boards with interactive areas around elements in these photos referred to as ‘hotspots’ that trigger text-to-speech or voice recordings. A novel feature is the integration of Object Detection technology, which automates hotspot creation, thereby reducing the programming burden on caregivers and promoting user independence. Developed through a co-creation process with Speech Language Pathologists (SLPs), the app emphasizes user-centric design, accessibility, and ease of use, especially on the underserved Android platform. Initial usability evaluations suggest that the system not only enhances communication effectiveness but also streamlines the process of scene creation, marking a significant step forward in assistive communication technology.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Empowering Individuals with Speech Disabilities Through an Augmentative and Alternative Communication (AAC) App with Visual Scene Display (VSD)

  • Rianne Marie Azzopardi,
  • Peter Albert Xuereb,
  • May Agius,
  • Sharon Borg Schembri,
  • Dylan Seychell

摘要

Individuals with Complex Communication Needs (CCN) face difficulties in their daily life that call for creative and accessible solutions to overcome these challenges. This paper presents an Android-based Augmentative and Alternative Communication (AAC) application that uses a Visual Scene Display (VSD) interface to empower individuals with CCNs. By using personally relevant photos as communication contexts, the app allows caregivers and AAC users to create picture boards with interactive areas around elements in these photos referred to as ‘hotspots’ that trigger text-to-speech or voice recordings. A novel feature is the integration of Object Detection technology, which automates hotspot creation, thereby reducing the programming burden on caregivers and promoting user independence. Developed through a co-creation process with Speech Language Pathologists (SLPs), the app emphasizes user-centric design, accessibility, and ease of use, especially on the underserved Android platform. Initial usability evaluations suggest that the system not only enhances communication effectiveness but also streamlines the process of scene creation, marking a significant step forward in assistive communication technology.