Framing the Design Space of Multimodal Mid-Air Gesture and Speech-Based Interaction With Mobile Devices for Older People

Ornella Mich, Gianluca Schiavo, Michela Ferron and Nadia Mana
Additional contact information
Ornella Mich: FBK, Trento, Italy
Gianluca Schiavo: FBK, Trento, Italy
Michela Ferron: FBK, Trento, Italy
Nadia Mana: FBK, Trento, Italy

International Journal of Mobile Human Computer Interaction (IJMHCI), 2020, vol. 12, issue 1, 22-41

Abstract: Multimodal human–computer interaction has been sought to provide not only more compelling interactive experiences, but also more accessible interfaces to mobile devices. With the advance in mobile technology and in affordable sensors, multimodal research that leverages and combines multiple interaction modalities (such as speech, touch, vision, and gesture) has become more and more prominent. This article provides a framework for the key aspects in mid-air gesture and speech-based interaction for older adults. It explores the literature on multimodal interaction and older adults as technology users and summarises the main findings for this type of users. Building on these findings, a number of crucial factors to take into consideration when designing multimodal mobile technology for older adults are described. The aim of this work is to promote the usefulness and potential of multimodal technologies based on mid-air gestures and voice input for making older adults' interaction with mobile devices more accessible and inclusive.

Date: 2020
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 18/IJMHCI.2020010102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jmhci0:v:12:y:2020:i:1:p:22-41

Access Statistics for this article

International Journal of Mobile Human Computer Interaction (IJMHCI) is currently edited by Joanna Lumsden

More articles in International Journal of Mobile Human Computer Interaction (IJMHCI) from IGI Global
Bibliographic data for series maintained by Journal Editor ().