Title

LiveLabs: Initial Reflections on Building a Large-scale Mobile Behavioral Experimentation Testbed

Publication Type

Journal Article

Publication Date

10-2013

Abstract

We believe that, for successful adoption of novel mobile technologies and applications, it is important to be able to test them under real usage patterns, and with real users. To implement this vision, we present our initial effort in building LiveLabs, a large-scale mobile testbed for in-situ experimentation. LiveLabs is unique in two aspects. First, LiveLabs operates on a scale much larger than most research testbeds— it is being deployed in four different public spaces in Singapore (a university campus, a shopping mall, an airport and a leisure resort), and is expected to have a pool of over 30,000 opt-in participants. Second, LiveLabs not only instruments smartphones and the infrastructure to gather deep individual and collective context, but also provides a unique experimentation platform that automates many aspects of behavioral experimentation, such as subject selection and context-triggered delivery of interventions. We briefly describe some of the research challenges associated with building such a large-scale deep-context collection testbed, as well as the current status of LiveLabs. We then share our perspectives on the challenges of setting up and operating such testbeds, with the expectation that our experiences will prove useful to other researchers looking to build similar testbeds elsewhere.

Discipline

Software Engineering

Research Areas

Software Systems

Publication

Mobile Computing and Communications Review

Volume

17

Issue

4

First Page

47

Last Page

59

ISSN

1559-1662

Identifier

10.1145/2557968.2557975

Publisher

ACM

Additional URL

http://dx.doi.org/10.1145/2557968.2557975