Publication Type

Journal Article

Version

publishedVersion

Publication Date

6-2017

Abstract

Non-speech sound-awareness is important to improve the quality of life for the deaf and hard-of-hearing (DHH) people. DHH people, especially the young, are not always satisfied with their hearing aids. According to the interviews with 60 young hard-of-hearing students, a ubiquitous sound-awareness tool for emergency and social events that works in diverse environments is desired. In this paper, we design UbiEar, a smartphone-based acoustic event sensing and notification system. Core techniques in UbiEar are a light-weight deep convolution neural network to enable location-independent acoustic event recognition on commodity smartphons, and a set of mechanisms for prompt and energy-efficient acoustic sensing. We conducted both controlled experiments and user studies with 86 DHH students and showed that UbiEar can assist the young DHH students in awareness of important acoustic events in their daily life.

Keywords

Ubiquitous and mobile computing, Human-centered computing, deaf elderly

Discipline

Software Engineering

Research Areas

Software and Cyber-Physical Systems

Publication

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Volume

1

Issue

2

First Page

17:1

Last Page

21

ISSN

2474-9567

Identifier

10.1145/3090082

Publisher

Association for Computing Machinery (ACM)

Copyright Owner and License

Publisher

Additional URL

https://doi.org/10.1145/3090082

Download

Share

COinS