Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
3-2023
Abstract
With the soaring adoption of in-ear wearables, the research community has started investigating suitable in-ear heart rate (HR) detection systems. HR is a key physiological marker of cardiovascular health and physical fitness. Continuous and reliable HR monitoring with wearable devices has therefore gained increasing attention in recent years. Existing HR detection systems in wearables mainly rely on photoplethysmography (PPG) sensors, however, these are notorious for poor performance in the presence of human motion. In this work, leveraging the occlusion effect that enhances low-frequency bone-conducted sounds in the ear canal, we investigate for the first time in-ear audio-based motion-resilient HR monitoring. We first collected HR-induced sounds in the ear canal leveraging an in-ear microphone under stationary and three different activities (i.e., walking, running, and speaking). Then, we devised a novel deep learning based motion artefact (MA) mitigation framework to denoise the in-ear audio signals, followed by an HR estimation algorithm to extract HR. With data collected from 20 subjects over four activities, we demonstrate that hEARt, our end-To-end approach, achieves a mean absolute error (MAE) of 3.02 2.97 BPM, 8.12 {6.74} BPM, 11.23 {9.20} BPM and 9.39 {6.97} BPM for stationary, walking, running and speaking, respectively, opening the door to a new non-invasive and affordable HR monitoring with usable performance for daily activities. Not only does hEARt outperform previous in-ear HR monitoring work, but it outperforms reported in-ear PPG performance
Keywords
Detection system, Ear canal, Earable, Heart-rate, Heart-rate detection, Heart-rate monitoring, In-ear audio, Motion artifact, Performance, Research communities
Discipline
Software Engineering
Research Areas
Data Science and Engineering
Publication
Proceeding of the 21st International Conference on Pervasive Computing and Communications (PerCom 2023), Atlanta, March 13-20
First Page
200
Last Page
209
ISBN
9781665453783
Identifier
10.1109/PERCOM56429.2023.10099317
Publisher
IEEE
City or Country
New Jersey, USA
Citation
BUTKOW, Kayla-Jade; DANG, Ting; FERLINI, Andrea; MA, Dong; and MASCOLO.
Heart: Motion-resilient heart rate monitoring with in-ear microphones. (2023). Proceeding of the 21st International Conference on Pervasive Computing and Communications (PerCom 2023), Atlanta, March 13-20. 200-209.
Available at: https://ink.library.smu.edu.sg/sis_research/8278
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1109/PERCOM56429.2023.10099317