MagiThings: Gestural Interaction with Mobile Devices Based on Using Embedded Compass (Magnetic Field) Sensor

Hamed Ketabdar, Amin Haji-Abolhassani and Mehran Roshandel
Additional contact information
Hamed Ketabdar: Telekom Innovation Labs, Deutsche Telekom Laboratories, TU Berlin, Berlin, Germany
Amin Haji-Abolhassani: Centre for Intelligent Machines, McGill University, Montreal, Canada
Mehran Roshandel: Telekom Innovation Labs, Deutsche Telekom Laboratories, Berlin, Germany

International Journal of Mobile Human Computer Interaction (IJMHCI), 2013, vol. 5, issue 3, 23-41

Abstract: The theory of around device interaction (ADI) has recently gained a lot of attention in the field of human computer interaction (HCI). As an alternative to the classic data entry methods, such as keypads and touch screens interaction, ADI proposes a touchless user interface that extends beyond the peripheral area of a device. In this paper, the authors propose a new approach for around mobile device interaction based on magnetic field. Our new approach, which we call it “MagiThings”, takes the advantage of digital compass (a magnetometer) embedded in new generation of mobile devices such as Apple’s iPhone 3GS/4G, and Google’s Nexus. The user movements of a properly shaped magnet around the device deform the original magnetic field. The magnet is taken or worn around the fingers. The changes made in the magnetic field pattern around the device constitute a new way of interacting with the device. Thus, the magnetic field encompassing the device plays the role of a communication channel and encodes the hand/finger movement patterns into temporal changes sensed by the compass sensor. The mobile device samples momentary status of the field. The field changes, caused by hand (finger) gesture, is used as a basis for sending interaction commands to the device. The pattern of change is matched against pre-recorded templates or trained models to recognize a gesture. The proposed methodology has been successfully tested for a variety of applications such as interaction with user interface of a mobile device, character (digit) entry, user authentication, gaming, and touchless mobile music synthesis. The experimental results show high accuracy in recognizing simple or complex gestures in a wide range of applications. The proposed method provides a practical and simple framework for touchless interaction with mobile devices relying only on an internally embedded sensor and a magnet.

Date: 2013
References: Add references at CitEc
Citations:

Downloads: (external link)
http://services.igi-global.com/resolvedoi/resolve. ... 018/jmhci.2013070102 (application/pdf)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:igg:jmhci0:v:5:y:2013:i:3:p:23-41

Access Statistics for this article

International Journal of Mobile Human Computer Interaction (IJMHCI) is currently edited by Joanna Lumsden

More articles in International Journal of Mobile Human Computer Interaction (IJMHCI) from IGI Global
Bibliographic data for series maintained by Journal Editor ().