Knowledge Agora



Scientific Article details

Title Anomaly Detection for Reoccurring Concept Drift in Smart Environments
ID_Doc 44133
Authors Agate, V; Drago, S; Ferraro, P; Lo Re, G
Title Anomaly Detection for Reoccurring Concept Drift in Smart Environments
Year 2022
Published
DOI 10.1109/MSN57253.2022.00031
Abstract Many crowdsensing applications today rely on learning algorithms applied to data streams to accurately classify information and events of interest in smart environments. Unfortunately, the statistical properties of the input data may change in unexpected ways. As a result, the definition of anomalous and normal data can vary over time and machine learning models may need to be re-trained incrementally. This problem is known as concept drift, and it has often been ignored by anomaly detection systems, resulting in significant performance degradation. In addition, the statistical distribution of past data often tends to repeat itself, and thus old learning models could be reused, avoiding costly retraining phases on new data, which would waste computational and energy resources. In this paper, we propose a hybrid anomaly detection system for streaming data in smart environments that accounts for concept drift and minimize the number of machine learning models that need to be retrained when shifts in incoming data distribution are detected. The system is multi-tier and relies on two different concept drift detection modules and an ensemble of anomaly detection models. An extensive experimental evaluation has been carried out, using two real datasets and a synthetic one; results show the high performance achieved by the system using common metrics such as F1-score and accuracy.
Author Keywords concept drift; smart city; online anomaly detection; unsupervised learning
Index Keywords Index Keywords
Document Type Other
Open Access Open Access
Source Conference Proceedings Citation Index - Science (CPCI-S)
EID WOS:000982822400015
WoS Category Computer Science, Information Systems; Computer Science, Theory & Methods; Engineering, Electrical & Electronic; Telecommunications
Research Area Computer Science; Engineering; Telecommunications
PDF
Similar atricles
Scroll