Publication Type
Journal Article
Version
publishedVersion
Publication Date
5-2024
Abstract
With the soaring adoption of in-ear wearables, the research community has started investigating suitable in-ear heart rate detection systems. Heart rate is a key physiological marker of cardiovascular health and physical fitness. Continuous and reliable heart rate monitoring with wearable devices has therefore gained increasing attention in recent years. Existing heart rate detection systems in wearables mainly rely on photoplethysmography (PPG) sensors, however, these are notorious for poor performance in the presence of human motion. In this work, leveraging the occlusion effect that enhances low-frequency bone-conducted sounds in the ear canal, we investigate for the first time in-ear audio-based motion-resilient heart rate monitoring. We first collected heart rate-induced sounds in the ear canal using an in-ear microphone under seven stationary activities and two full-body motion activities (i.e., walking, and running). Then, we devised a novel deep learning based motion artefact (MA) mitigation framework to denoise the in-ear audio signals, followed by a heart rate estimation algorithm to extract heart rate. With data collected from 15 subjects over nine activities, we demonstrate that hEARt, our end-to-end approach, achieves a mean absolute error (MAE) of 1.88 ± 2.89 BPM, 6.83 ± 5.05 BPM, and 13.19 ± 11.37 BPM for stationary, walking, and running, respectively, opening the door to a new non-invasive and affordable heart rate monitoring with useable performance for daily activities. Not only does hEARt outperform previous in-ear heart rate monitoring work, but it outperforms reported in-ear PPG performance.
Keywords
Earable, Heart rate, In-ear audio, Motion artefact
Discipline
Health Information Technology | Software Engineering
Research Areas
Software and Cyber-Physical Systems
Publication
Pervasive and Mobile Computing
Volume
100
First Page
1
Last Page
15
ISSN
1574-1192
Identifier
10.1016/j.pmcj.2024.101913
Publisher
Elsevier
Citation
BUTKOW, Kayla-Jade; DANG, Ting; FERLINI, Andrea; MA, Dong; LIU, Yang; and MASCOLO, Cecilia.
An evaluation of heart rate monitoring with in-ear microphones under motion. (2024). Pervasive and Mobile Computing. 100, 1-15.
Available at: https://ink.library.smu.edu.sg/sis_research/8714
Copyright Owner and License
Authors-CC-BY
Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.
Additional URL
https://doi.org/10.1016/j.pmcj.2024.101913