Publication Type

Conference Proceeding Article

Version

publishedVersion

Publication Date

6-2016

Abstract

We aim to develop a drumming application in which individual can play drums using multiple wearable and mobile devices. Our vision is to tap out different rythms in the air using smart watches as a virtual drum stick and smart phone would act as a drum kit. Same user interface can be visualized in smart glasses. Here, our prime target is to use multiple commodity wearable devices (non-commodity i.e. Myo arm band) and smart phones for recognizing new (or same type of here) types of multi limb gestural context and building an adaptive application interface and allow such gesture recognition and interface to be easily integrated into a new multi device applications. We describe our initial exploration of our aim in multi wrist gesture recognition. We have designed and modified the traditional HMM [2] and discussed the problems faced in multi device interaction. We explore how same type of tapping gestures in drumming context gives the technical challenges and discuss the problems of developing the application and our research direction. The combined multi device ecosystem as a whole can enable not just a variety of new applications but also radically foster new forms of user interaction.

Keywords

SmartPhone, smart watch, Hidden Markov Model (HMM)

Discipline

Computer Sciences | Software Engineering

Research Areas

Software and Cyber-Physical Systems

Publication

MobiSys '16 Companion: Proceedings of the 14th Annual International Conference on Mobile Systems, Applications, and Services Companion, Singapore, June 26-30, 2016

First Page

101

Last Page

101

ISBN

9781450344166

Identifier

10.1145/2938559.2938586

Publisher

ACM

City or Country

New York

Additional URL

http://dx.doi.org/10.1145/2938559.2938586

Download

Share

COinS