Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
11-2018
Abstract
Transparent solar cell is an emerging solar energy harvesting technology that allows us to see through these cells. This revolutionary discovery is creating unique opportunities to turn any mobile device screen into solar energy harvester. In this paper, we consider the possibility of using such energy harvesting screens as a sensor to detect hand gestures. As different gestures impact the incident light on the screen in a different way, they are expected to create unique energy generation patterns for the transparent solar cell. Our goal is to recognize gestures by detecting these solar energy patterns. A key uncertainty we face with transparent solar cell is that, to provide transparency, they cannot harvest from the visible spectra, which may lead to weaker energy patterns for the gestures. To study gesture recognition feasibility of transparent solar cell, we develop a 1cmx1cm organic see-through solar cell which provides high level of content visibility when placed on mobile phone screen. We then use the output current of the organic cell as the source signal for gesture pattern recognition using machine learning. Experimental results demonstrate that we can detect five hand gestures with average accuracies of 95%. We also compare gesture recognition accuracies of our prototype organic cell with those obtained from a conventional ceramic opaque solar cell, which reveals that organic solar cell can recognize some of these gestures almost as good as the opaque cells.
Keywords
Gesture Recognition, Transparent Solar Cell, Solar Energy Harvesting
Discipline
Artificial Intelligence and Robotics | Graphics and Human Computer Interfaces
Research Areas
Intelligent Systems and Optimization
Publication
Proceedings of the 12th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization, New Delhi, India, 2018 November 2
First Page
79
Last Page
88
ISBN
9781450359306
Identifier
10.1145/3267204.3267209
Publisher
ACM
City or Country
New Delhi, India
Citation
MA, Dong; LAN, Guohao; HASSAN, Mahbub; HU, Wen; UPAMA, B. Mushfika; UDDIN, Ashraf; YOUSEEF; and Moustafa.
Gesture recognition with transparent solar cells. (2018). Proceedings of the 12th International Workshop on Wireless Network Testbeds, Experimental Evaluation & Characterization, New Delhi, India, 2018 November 2. 79-88.
Available at: https://ink.library.smu.edu.sg/sis_research/7003
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Included in
Artificial Intelligence and Robotics Commons, Graphics and Human Computer Interfaces Commons