Online Conformal Anomaly Detection with Prediction-Powered Data Acquisition

Abstract:Online anomaly detection is essential in fields such as cybersecurity, healthcare, industrial monitoring, and telecommunications, where promptly identifying deviations from expected behavior can avert critical failures or security breaches. While numerous anomaly scoring methods based on supervised or unsupervised learning have been proposed, the only existing approach capable of providing assumption-free guarantees on the false discovery rate (FDR) rely on a continuous stream of real-world calibration data. To address this limitation, we introduce context-aware prediction-powered conformal online anomaly detection (C-PP-COAD), a novel principled framework that strategically leverages synthetic calibration data to mitigate data scarcity, while adaptively integrating real data based on contextual information. C-PP-COAD wraps around any existing anomaly detection method, leveraging any given anomaly score to construct active conformal p-value statistics. These statistics support online testing with formal FDR control, maintaining rigorous and reliable anomaly detection performance over time. Experiments conducted on both synthetic and real-world datasets, including thyroid dysfunction detection, O-RAN conflict detection, 5G network intrusion detection, and O-RAN UE throughput degradation detection, demonstrate that C-PP-COAD significantly reduces dependency on real calibration data without compromising guaranteed FDR control.

Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)

arXiv:2505.01783 [cs.LG]

(or arXiv:2505.01783v2 [cs.LG] for this version)

https://doi.org/10.48550/arXiv.2505.01783 Focus to learn more arXiv-issued DOI via DataCite

arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.

Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.

Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.