Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
7-2021
Abstract
Smart earbuds are recognized as a new wearable platform for personal-scale human motion sensing. However, due to the interference from head movement or background noise, commonly-used modalities (e.g. accelerometer and microphone) fail to reliably detect both intense and light motions. To obviate this, we propose OESense, an acoustic-based in-ear system for general human motion sensing. The core idea behind OESense is the joint use of the occlusion effect (i.e., the enhancement of low-frequency components of bone-conducted sounds in an occluded ear canal) and inward-facing microphone, which naturally boosts the sensing signal and suppresses external interference. We prototype OESense as an earbud and evaluate its performance on three representative applications, i.e., step counting, activity recognition, and hand-to-face gesture interaction. With data collected from 31 subjects, we show that OESense achieves 99.3% step counting recall, 98.3% recognition recall for 5 activities, and 97.0% recall for five tapping gestures on human face, respectively. We also demonstrate that OESense is compatible with earbuds’ fundamental functionalities (e.g. music playback and phone calls). In terms of energy, OESense consumes 746 mW during data recording and recognition and it has a response latency of 40.85 ms for gesture recognition. Our analysis indicates such overhead is acceptable and OESense is potential to be integrated into future earbuds.
Keywords
Human-centered computing, Ubiquitous and mobile computing systems and tools
Discipline
Artificial Intelligence and Robotics | Databases and Information Systems
Research Areas
Intelligent Systems and Optimization
Publication
Proceedings of the 19th ACM International Conference on Mobile Systems, Applications, and Services, Virtual Conference, 2021 June 24-July 2
First Page
175
Last Page
187
ISBN
9781450384438/21
Identifier
10.1145/3458864.3467680
Publisher
ACM
City or Country
Virtual Conference
Citation
MA, Dong; FERLINI, Andrea; and MASCOLO, Cecilia.
OESense: Employing occlusion effect for in-ear human sensing. (2021). Proceedings of the 19th ACM International Conference on Mobile Systems, Applications, and Services, Virtual Conference, 2021 June 24-July 2. 175-187.
Available at: https://ink.library.smu.edu.sg/sis_research/7005
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.