Using deep learning to bridge the gap between perception and intelligence
Publication Type
Conference Proceeding Article
Publication Date
4-2017
Abstract
We propose a method to for robot planning using deep learning to integrate object detection and natural language understanding. This is different from other techniques, such the RCTA World Model,1 which explicitly defines the interfaces between each module. These boundaries simplify the design and testing of complex robotic systems, but also introduce constraints that may reduce overall system performance. For example, perception tasks generate large amounts of data, but much of it is discarded to simplify interpretation by higher level tasks, e.g., a 3D object becomes a point in space, or a distribution over classifications is reduced to its mode. Further, errors in the robot’s overal task are not back-propagated to lower level tasks, and therefore, these tasks never adapt themselves to improve robot performance. We intend to address this by using a deep learning framework to replace these interfaces with learned interfaces that select what data is shared between modules and allow for error back-propagation that could adapt each module to the robot’s task. We will do this in a simplified system that accepts aerial orthographic images and simple commands and generates paths to achieve the command. Paths are learned from expert example via inverse optimal control. In time, we hope to evolve this simplified architecture towards something more complex and practical.
Keywords
Deep learning, Perception, Planning, Robotics, Robotics collaborative Technology alliance, Unmanned ground vehicles
Discipline
Artificial Intelligence and Robotics | Databases and Information Systems
Research Areas
Intelligent Systems and Optimization; Data Science and Engineering
Publication
Proceedings Volume 10195 SPIE Defense + Security Unmanned Systems XIX, Anaheim, California, 2017 April 9-13
Volume
10195
First Page
1
Last Page
10
ISBN
9781510608917
Identifier
10.1117/12.2262252
Publisher
SPIE
City or Country
Anaheim
Citation
SUPPE, Arne and HERBERT, Martial.
Using deep learning to bridge the gap between perception and intelligence. (2017). Proceedings Volume 10195 SPIE Defense + Security Unmanned Systems XIX, Anaheim, California, 2017 April 9-13. 10195, 1-10.
Available at: https://ink.library.smu.edu.sg/sis_research/8295
Additional URL
https://doi.org/10.1117/12.2262252