Publication Type

Conference Proceeding Article

Version

publishedVersion

Publication Date

6-2018

Abstract

Recent research has demonstrated the potential of deploying deep neural networks (DNNs) on resource-constrained mobile platforms by trimming down the network complexity using different compression techniques. The current practice only investigate stand-alone compression schemes even though each compression technique may be well suited only for certain types of DNN layers. Also, these compression techniques are optimized merely for the inference accuracy of DNNs, without explicitly considering other application-driven system performance (e.g. latency and energy cost) and the varying resource availabilities across platforms (e.g. storage and processing capability). In this paper, we explore the desirable tradeoff between performance and resource constraints by user-specified needs, from a holistic system-level viewpoint. Specifically, we develop a usage-driven selection framework, referred to as AdaDeep, to automatically select a combination of compression techniques for a given DNN, that will lead to an optimal balance between user-specified performance goals and resource constraints. With an extensive evaluation on five public datasets and across twelve mobile devices, experimental results show that AdaDeep enables up to 9.8x latency reduction, 4.3x energy efficiency improvement, and 38x storage reduction in DNNs while incurring negligible accuracy loss. AdaDeep also uncovers multiple effective combinations of compression techniques unexplored in existing literature.

Discipline

Software Engineering

Research Areas

Software and Cyber-Physical Systems

Publication

MobiSys '18: Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services, Munich, Germany, June 10-15

First Page

389

Last Page

400

Identifier

10.1145/3210240.3210337

Publisher

ACM

City or Country

Munich, Germany

Additional URL

https://doi.org/10.1145/3210240.3210337

Download

Share

COinS