Publication Type
Conference Proceeding Article
Version
acceptedVersion
Publication Date
6-2024
Abstract
This paper explores the problem of Generalist Anomaly Detection (GAD), aiming to train one single detection model that can generalize to detect anomalies in diverse datasets from different application domains without any further training on the target data. Some recent studies have showed that large pre-trained Visual-Language Models (VLMs) like CLIP have strong generalization capabilities on detecting industrial defects from various datasets, but their methods rely heavily on handcrafted text prompts about defects, making them difficult to generalize to anomalies in other applications, e.g., medical image anomalies or semantic anomalies in natural images. In this work, we propose to train a GAD model with few-shot normal images as sample prompts for AD on diverse datasets on the fly. To this end, we introduce a novel approach that learns an in-context residual learning model for GAD, termed InCTRL. It is trained on an auxiliary dataset to discriminate anomalies from normal samples based on a holistic evaluation of the residuals between query images and few-shot normal sample prompts. Regardless of the datasets, per definition of anomaly, larger residuals are expected for anomalies than normal samples, thereby enabling InCTRL to generalize across different domains without further training. Comprehensive experiments on nine AD datasets are performed to establish a GAD benchmark that encapsulate the detection of industrial defect anomalies, medical anomalies, and semantic anomalies in both one-vs-all and multi-class setting, on which InCTRL is the best performer and significantly outperforms state-of-the-art competing methods.
Keywords
Generalist anomaly detection, Machine learning, Visual-language models
Discipline
Artificial Intelligence and Robotics | Computer Sciences
Research Areas
Intelligent Systems and Optimization
Publication
2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR): Seattle, June 16-22: Proceedings
First Page
1
Last Page
17
ISBN
9798350353006
Identifier
10.1109/CVPR52733.2024.01688
Publisher
IEEE
City or Country
Pistacataway
Citation
ZHU, Jiawen and PANG, Guansong.
Toward generalist anomaly detection via in-context residual learning with few-shot sample prompts. (2024). 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR): Seattle, June 16-22: Proceedings. 1-17.
Available at: https://ink.library.smu.edu.sg/sis_research/9762
Copyright Owner and License
Authors
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-No Derivative Works 4.0 International License.
Additional URL
https://doi.org/10.1109/CVPR52733.2024.01688
