An important aspect of environmental monitoring is anomaly detection, which allows for identifying unusual patterns that may indicate an environmental change or sensor malfunction. K-Nearest Neighbors (KNN) and Isolation Forests (IF) are used in this study to identify anomalies using hybrid algorithms. The model was applied to data obtained from Lake Macquarie City Council using environmental monitoring system (EMS) sensors developed by ARCS Group in partnership with the University of Technology, Sydney, as part of the TULIP Project, which were used by the Lake Macquarie City Council. Through the use of the Council’s Community IoT LoRaWAN Network—The Things Network, the Council was able to collect data from these sensors. Based on 56,996 data points, the hybrid model effectively identified 2872 anomalous patterns from 52,978 data points, with a detection accuracy of approximately 5.44%. Combining KNN and IF augments the detection accuracy and robustness of the hybrid model, providing valuable insight into the nature and distribution of anomalous patterns. This approach redresses limitations that may be encountered in environmental monitoring, such as computational complexity and heuristic threshold setting, and offers a reliable method of detecting anomalies that significantly contributes to the improvement of environmental data analysis and monitoring while addressing limitations.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Efficient Hybrid Anomaly Detection in Environmental Data

  • Muhammad R. Ahmed,
  • Mohammed A. Aseeri,
  • M. Y. O. Thirein,
  • M. Shamim Kaiser,
  • Ifat Al Baqee,
  • Mohammad Hamiruce Marhaban

摘要

An important aspect of environmental monitoring is anomaly detection, which allows for identifying unusual patterns that may indicate an environmental change or sensor malfunction. K-Nearest Neighbors (KNN) and Isolation Forests (IF) are used in this study to identify anomalies using hybrid algorithms. The model was applied to data obtained from Lake Macquarie City Council using environmental monitoring system (EMS) sensors developed by ARCS Group in partnership with the University of Technology, Sydney, as part of the TULIP Project, which were used by the Lake Macquarie City Council. Through the use of the Council’s Community IoT LoRaWAN Network—The Things Network, the Council was able to collect data from these sensors. Based on 56,996 data points, the hybrid model effectively identified 2872 anomalous patterns from 52,978 data points, with a detection accuracy of approximately 5.44%. Combining KNN and IF augments the detection accuracy and robustness of the hybrid model, providing valuable insight into the nature and distribution of anomalous patterns. This approach redresses limitations that may be encountered in environmental monitoring, such as computational complexity and heuristic threshold setting, and offers a reliable method of detecting anomalies that significantly contributes to the improvement of environmental data analysis and monitoring while addressing limitations.