The study presents a novel method of anomaly detection which is an extension of contemporary Isolation Forest algorithm. The proposed method is based on aggregation of results obtained by performing a series of exclusions of single attributes and their pairs from datasets. In the experimental series compared are the results of the original method, the average result excluding single attributes and the average result excluding two attributes, each performed over one hundred iterations. The method is tested on various anomaly detection datasets, mostly yielding positive results judged by five different metrics. During the calculations, a popular unsupervised anomaly detection algorithm is used, namely Isolation Forest, but it is intuitively appealing that using the proposed method for other anomaly detection algorithms could also result in improved metrics. When examining datasets with attribute exclusions, it is possible to see that the different features of the studied datasets have different effects on the classification result. It can be expected that this method will yield improvements especially when the datasets are unbalanced and most of the impact on the result is distributed among a small number of features.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Improving Anomaly Detection Methods Through Attribute Exclusion Using Isolation Forest

  • Albert Rachwał,
  • Paweł Karczmarek

摘要

The study presents a novel method of anomaly detection which is an extension of contemporary Isolation Forest algorithm. The proposed method is based on aggregation of results obtained by performing a series of exclusions of single attributes and their pairs from datasets. In the experimental series compared are the results of the original method, the average result excluding single attributes and the average result excluding two attributes, each performed over one hundred iterations. The method is tested on various anomaly detection datasets, mostly yielding positive results judged by five different metrics. During the calculations, a popular unsupervised anomaly detection algorithm is used, namely Isolation Forest, but it is intuitively appealing that using the proposed method for other anomaly detection algorithms could also result in improved metrics. When examining datasets with attribute exclusions, it is possible to see that the different features of the studied datasets have different effects on the classification result. It can be expected that this method will yield improvements especially when the datasets are unbalanced and most of the impact on the result is distributed among a small number of features.