Publication Type

Conference Proceeding Article

Version

acceptedVersion

Publication Date

9-2017

Abstract

This paper presents AudioSense, the system to monitor user-item interactions inside a store hence enabling precisely customized promotions. A shopper's smartwatch emits sound every time the shopper picks up or touches an item inside a store. This sound is then localized, in 2D space, by calculating the angles of arrival captured by multiple microphones deployed on the racks. Lastly, the 2D location is mapped to specific items on the rack based on the rack layout information. In our initial experiments conducted with a single rack with 16 compartments, we could localize the shopper's smartwatch with a median estimation error of 15.9 cm in 2-dimensional space.

Keywords

AoA, Audio sensing, Sound localization, TDoA, Trajectory tracking, Audio acoustics, Time difference of arrival, Wearable computers, Wearable technology, Angles of arrival, Audio sensing, Behavior analysis, Estimation errors, Layout information, Multiple microphones, Sound localization, Trajectory tracking, Ubiquitous computing

Discipline

Computer and Systems Architecture | Software Engineering

Research Areas

Software and Cyber-Physical Systems

Publication

UbiComp '17: Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing and ACM International Symposium on Wearable Computers, Maui, United States, 2017 September 11-15

First Page

488

Last Page

493

ISBN

9781450351904

Identifier

10.1145/3123024.3124440

Publisher

ACM

City or Country

New York

Copyright Owner and License

Authors

Additional URL

https://doi.org/10.1145/3123024.3124440

Download

Share

COinS