Measuring and understanding the performance of mobile networks is becoming very important for end users and operators. Despite the availability of many measurement apps, their measurement accuracy has not received sufficient scrutiny. In this paper, we appraise the accuracy of smartphone-based network performance measurement using the Android platform and the network round-trip time (RTT) as the metric. We show that two of the most popular measurement apps-Ookla Speedtest and MobiPerf-have their RTT measurements inflated. We build three test apps that cover three common measurement methods and evaluate them in a testbed. We overcome the main challenge of obtaining a complete trace of packets and their timestamps by using multiple sniffers and frame-based synchronization. Our multi-layer analysis reveals that the delay inflation can be introduced both in the user space and kernel space. The long path of subfunction invocations accounts for the majority of the delay overhead in Android runtime (both Dalvik VM and ART), and the sleeping functions in the drivers are the major source of the delay overhead between the kernel and physical layer. Motivated by the findings, we propose and implement a native app to increase the accuracy of RTT measurement, and its delay inflation in the user space can be kept under 1.5ms for almost all cases.
Accuracy, Android, Atmospheric measurements, Delays, Mobile communication, Mobile computing, mobile phone, Network measurement, Particle measurements, Smart phones
Digital Communications and Networking | Software Engineering
IEEE Transactions on Mobile Computing
Institute of Electrical and Electronics Engineers (IEEE)
LI, Weichao; WU, Daoyuan; CHANG, Rocky K. C.; and MOK, Ricky K. P..
Toward accurate network delay measurement on android phones. (2017). IEEE Transactions on Mobile Computing. 17, (3), 717-732. Research Collection School Of Information Systems.
Available at: http://ink.library.smu.edu.sg/sis_research/3782
Creative Commons License
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.