Publication Type
Journal Article
Version
acceptedVersion
Publication Date
6-2023
Abstract
Graph Neural Networks (GNNs) aim to extend deep learning techniques to graph data and have achieved significant progress in graph analysis tasks (e.g., node classification) in recent years. However, similar to other deep neural networks like Convolutional Neural Networks (CNNs) and Recurrent Neural Networks (RNNs), GNNs behave like a black box with their details hidden from model developers and users. It is therefore difficult to diagnose possible errors of GNNs. Despite many visual analytics studies being done on CNNs and RNNs, little research has addressed the challenges for GNNs. This paper fills the research gap with an interactive visual analysis tool, GNNLens, to assist model developers and users in understanding and analyzing GNNs. Specifically, Parallel Sets View and Projection View enable users to quickly identify and validate error patterns in the set of wrong predictions; Graph View and Feature Matrix View offer a detailed analysis of individual nodes to assist users in forming hypotheses about the error patterns. Since GNNs jointly model the graph structure and the node features, we reveal the relative influences of the two types of information by comparing the predictions of three models: GNN, Multi-Layer Perceptron (MLP), and GNN Without Using Features (GNNWUF). Two case studies and interviews with domain experts demonstrate the effectiveness of GNNLens in facilitating the understanding of GNN models and their errors.
Keywords
Graph Neural Networks, Error Diagnosis, Visualization
Discipline
Graphics and Human Computer Interfaces | Numerical Analysis and Scientific Computing
Research Areas
Data Science and Engineering
Publication
IEEE Transactions on Visualization and Computer Graphics
Volume
29
Issue
6
First Page
3024
Last Page
3038
ISSN
1077-2626
Identifier
10.1109/TVCG.2022.3148107
Publisher
Institute of Electrical and Electronics Engineers
Citation
JIN, Zhihua; WANG, Yong; WANG, Qianwen; MING, Yao; MA, Tengfei; and QU, Huamin.
GNNLens: A visual analytics approach for prediction error diagnosis of graph neural networks.. (2023). IEEE Transactions on Visualization and Computer Graphics. 29, (6), 3024-3038.
Available at: https://ink.library.smu.edu.sg/sis_research/7659
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1109/TVCG.2022.3148107
Included in
Graphics and Human Computer Interfaces Commons, Numerical Analysis and Scientific Computing Commons