Publication Type
Conference Proceeding Article
Version
publishedVersion
Publication Date
6-2021
Abstract
HD map reconstruction is crucial for autonomous driving. LiDAR-based methods are limited due to the deployed expensive sensors and time-consuming computation. Camera-based methods usually need to separately perform road segmentation and view transformation, which often causes distortion and the absence of content. To push the limits of the technology, we present a novel framework that enables reconstructing a local map formed by road layout and vehicle occupancy in the bird's-eye view given a front-view monocular image only. In particular, we propose a cross-view transformation module, which takes the constraint of cycle consistency between views into account and makes full use of their correlation to strengthen the view transformation and scene understanding. Considering the relationship between vehicles and roads, we also design a context-aware discriminator to further refine the results. Experiments on public benchmarks show that our method achieves the state-of-the-art performance in the tasks of road layout estimation and vehicle occupancy estimation. Especially for the latter task, our model outperforms all competitors by a large margin. Furthermore, our model runs at 35 FPS on a single GPU, which is efficient and applicable for real-time panorama HD map reconstruction
Keywords
Computer vision, Roads and streets, Vehicles, Autonomous driving, Bird's eye view, Camera-based, Local map, Map reconstruction, Road layouts, Road segmentation, Road vehicles, Vehicle occupancies, View transformations
Discipline
Artificial Intelligence and Robotics | Graphics and Human Computer Interfaces
Research Areas
Intelligent Systems and Optimization
Publication
Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR)
First Page
15531
Last Page
15540
ISBN
9781665445092
Identifier
10.1109/CVPR46437.2021.01528
Publisher
IEEE
City or Country
USA
Citation
YANG, Weixiang; LI, Qi; LIU, Wenxi; YU, Yuanlong; MA, Yuexin; HE, Shengfeng; and PAN, Jia.
Projecting your view attentively: Monocular road scene layout estimation via cross-view transformation. (2021). Proceedings of the IEEE/CVF conference on computer vision and pattern recognition (CVPR). 15531-15540.
Available at: https://ink.library.smu.edu.sg/sis_research/8440
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Included in
Artificial Intelligence and Robotics Commons, Graphics and Human Computer Interfaces Commons