Dendritic Cell Model Based on mRMR and Gini Importance

doi:10.19678/j.issn.1000-3428.0063892

Abstract

Abstract: The Dendritic Cell Algorithm（DCA） simulates the recognition and presentation of antigens by Dendritic Cells（DC） in the human immune system.It is a fast and effective anomaly detection method.It selects data features that represent specific input signals.However，existing signal selection methods have feature subset redundancy and high time complexity，resulting in the low effectiveness of the generated antigen signal and low running speed on high-dimensional and large-sample data sets.Considering the availability of antigen signals and time efficiency during signal selection，a DC model MRGI-DCA based on maximal Relevance Minimal Redundancy（mRMR），and Gini Importance（GI） is proposed.The most relevant feature subset is extracted quickly from the original data set through mRMR，and the redundancy of the feature subset is minimized.Based on the pre-dimensionality reduction of mRMR，according to the fast and accurate characteristics of a CART tree model，more effective antigen signals can be obtained using the GI.Experimental results show that MRGI-DCA outperforms the IG-DCA，COR-DCA，GA-DCA，and SVM-DCA.The accuracy，F1 value，and AUC average values are 6.01%，5.86%，and 9.96% higher than those of COR-DCA，respectively，for high-dimensional，low-dimensional，abnormal data sets，and the average running time is approximately 1/5 that of the COR-DCA.

Key words: Dendritic Cell Algorithm（DCA）, signal selection, maximal Relevance Minimal Redundancy（mRMR） algorithm, Gini Importance（GI）, Artificial Immune System（AIS）

摘要： 树突状细胞算法（DCA）模拟人体免疫系统中树突状细胞对抗原的识别与提呈过程，是一种快速有效的异常检测方法，其关键是从数据中选取有效特征以表示特定的输入信号。然而，现有信号选取方法存在特征子集冗余、时间复杂度高等问题，导致生成的抗原信号有效性较低，且在高维大样本数据集上运行速度较慢。考虑抗原信号的可用性与信号选取过程的时间效率，提出基于最大相关最小冗余（mRMR）与基尼重要性的树突状细胞模型MRGI-DCA。通过mRMR从原始数据集中快速地提取最相关特征子集，且最大限度地降低特征子集的冗余性。在mRMR预降维的基础上，根据CART树模型快速、准确等特点，利用基尼重要性得到更有效的抗原信号。实验结果表明，MRGI-DCA总体表现优于IG-DCA、COR-DCA、GA-DCA和SVM-DCA方法，其中，准确率、F1值和AUC在高维、低维、异常数据集上的平均值较COR-DCA分别提高6.01%、5.86%、9.96%，并且平均运行时间约为COR-DCA的1/5。

关键词: 树突状细胞算法, 信号选取, 最大相关最小冗余算法, 基尼重要性, 人工免疫系统

CLC Number:

TP391

ZHANG Kailin, DONG Hongbin. Dendritic Cell Model Based on mRMR and Gini Importance[J]. Computer Engineering, 2023, 49(5): 129-138.

张凯林, 董红斌. 基于mRMR与基尼重要性的树突状细胞模型[J]. 计算机工程, 2023, 49(5): 129-138.

/ / Recommend / Download Citations

URL: http://www.ecice06.com/EN/10.19678/j.issn.1000-3428.0063892

http://www.ecice06.com/EN/Y2023/V49/I5/129

Figures/Tables 9

References

[1] PRASHANT K,MAMTA B.Artificial immune system:state of the art approach[J].International Journal of Computer Applications,2015,120(20):25-32.
[2] TAN Y.Artificial immune system applications in computersecurity[M].Hoboken,USA:John Wiley & Sons,Inc.,2016.
[3] MATZINGER P.Tolerance,danger,and the extended family[J].Annual Review of Immunology,1994,12:991-1045.
[4] ŞAHIN C B.DCW-RNN:improving class level metrics for software vulnerability detection using artificial immune system with clock-work recurrent neural network[C]//Proceedings of International Conference on Innovations in Intelligent Systems and Applications.Washington D.C.,USA:IEEE Press,2021:1-8.
[5] PINTO R,GONÇALVES G,DELSING J,et al. Incremental dendritic cell algorithm for intrusion detection in cyber-physical production systems[M]//KACPRZYK J. Lecture notes in networks and systems.Berlin,Germany:Springer,2021:664-680.
[6] SHARAFF A,KAMAL C,PORWAL S,et al.Spam message detection using danger theory and Krill herd optimization[J].Computer Networks,2021,199:108453.
[7] ARORA K,MAHAJAN S.Detecting denial-of-service attack using dendritic cell approach[C]//Proceedings of the 2nd International Conference on Information Management and Machine Intelligence.Berlin,Germany:Springer,2021:509-516.
[8] JUNEJA K.MPMFFT based DCA-DBT integrated probabilistic model for face expression classification[J].Journal of King Saud University-Computer and Information Sciences,2020,32(5):618-633.
[9] 周天祥,董红斌,周雯.基于区域分割的混合地震预测算法[J].计算机工程,2019,45(9):310-315. ZHOU T X,DONG H B,ZHOU W.Hybrid algorithm based on region segmentation for earthquake prediction[J].Computer Engineering,2019,45(9):310-315.(in Chinese)
[10] DIEZ-OLIVAN A,ORTEGO P,DEL SER J,et al.Adaptive dendritic cell-deep learning approach for industrial prognosis under changing conditions[J].IEEE Transactions on Industrial Informatics,2021,17(11):7760-7770.
[11] GU F,GREENSMITH J,OATES R,et al.PCA 4 DCA:the application of principal component analysis to the dendritic cell algorithm[EB/OL].[2022-01-05].https://arxiv.org/ftp/arxiv/papers/1004/1004.3460.pdf.
[12] 杨信民,董红斌,谭成予,等.采用奇异值分解和信息增益的树突状细胞模型[J].计算机工程与应用,2021,57(15):156-162. YANG X M,DONG H B,TAN C Y,et al.Dendritic cell model using singular value decomposition and information gain[J].Computer Engineering and Applications,2021,57(15):156-162.(in Chinese)
[13] CHELLY Z,ELOUEDI Z.A study of the data pre-processing module of the dendritic cell evolutionary algorithm[C]//Proceedings of International Conference on Control,Decision and Information Technologies.Washington D.C.,USA:IEEE Press,2014:634-639.
[14] MOHSIN M F M,HAMDAN A R,ABU BAKAR A.An evaluation of feature selection technique for dendrite cell algorithm[C]//Proceedings of International Conference on IT Convergence and Security.Washington D.C.,USA:IEEE Press,2015:1-5.
[15] CHELLY Z,ELOUEDI Z.A survey of the dendritic cell algorithm[J].Knowledge and Information Systems,2016,48(3):505-535.
[16] GREENSMITH J,AICKELIN U,CAYZER S.Introducing dendritic cells as a novel immune-inspired algorithm for anomaly detection[C]//Proceedings of the 4th International Conference on Artificial Immune Systems.Berlin,Germany:Springer,2005:153-167.
[17] GU F,GREENSMITH J,AICKLEIN U.The dendritic cell algorithm for intrusion detection[EB/OL].[2022-01-05].https://arxiv.org/ftp/arxiv/papers/1305/1305.7416.pdf.
[18] GU F,GREENSMITH J,AICKELIN U.Further exploration of the dendritic cell algorithm:antigen multiplier and time windows[C]//Proceedings of the 7th International Conference on Artificial Immune Systems.Berlin,Germany:Springer,2008:142-153.
[19] ELISA N,CHAO F,YANG L Z.A study of the necessity of signal categorisation in dendritic cell algorithm[C]//Proceedings of Advances in Intelligent Systems and Computing.Berlin,Germany:Springer,2019:210-220.
[20] 朱文峰,于舒娟,何伟.基于IGCDmRMR的二阶段特征选择方法[J].计算机工程,2019,45(9):183-187,193. ZHU W F,YU S J,HE W.Two-stage feature selection method based on IGCDmRMR[J].Computer Engineering,2019,45(9):183-187,193.(in Chinese)
[21] RAY P,REDDY S,BANERJEE T.Various dimension reduction techniques for high dimensional data analysis:a review[J].Artificial Intelligence Review,2021,54(5):3473-3515.
[22] GORDON A D,BREIMAN L,FRIEDMAN J H,et al.Classification and regression trees[J].Biometrics,1984,40(3):874.
[23] NEMBRINI S,KÖNIG I R,WRIGHT M N.The revival of the Gini importance?[J].Bioinformatics,2018,34(21):3711-3718.
[24] REIS B,MAIA E,PRAÇA I.Selection and performance analysis of CICIDS2017 features importance[C]//Proceedings of International Symposium on Foundations and Practice of Security.Berlin,Germany:Springer,2019:56-71.
[25] COVER T M.The best two independent measurements are not the two best[J].IEEE Transactions on Systems,Man,and Cybernetics,1974,1:116-117.
[26] PIRBAZARI A M,CHAKRAVORTY A,RONG C M.Evaluating feature selection methods for short-term load forecasting[C]//Proceedings of International Conference on Big Data and Smart Computing (BigComp).Washington D.C.,USA:IEEE Press,2019:1-8.
[27] SAZZED S.An investigation of the performances of simple gene selection methodologies for cancer classification[C]//Proceedings of the 21st International Conference on Bioinformatics and Bioengineering.Washington D.C.,USA:IEEE Press,2021:1-6.
[28] ZHAO Z Y,ANAND R,WANG M.Maximum relevance and minimum redundancy feature selection methods for a marketing machine learning platform[C]//Proceedings of International Conference on Data Science and Advanced Analytics.Washington D.C.,USA.IEEE Press,2020:442-452.
[29] GU F,GREENSMITH J,AICKELIN U.Theoretical formulation and analysis of the deterministic dendritic cell algorithm[J].Biosystems,2013,111(2):127-135.
[30] SANI H M,LEI C,NEAGU D.Computational complexity analysis of decision tree algorithms[C]//Proceedings of International Conference on Innovative Techniques and Applications of Artificial Intelligence.Berlin,Germany:Springer,2018:191-197.
[31] ABDIANSAH A,WARDOYO R.Time complexity analysis of Support Vector Machines (SVM) in LibSVM[J].International Journal of Computer Applications,2015,128(3):28-34.
[32] DUA,D.AND GRAFF,C.UCI machine learning repository[EB/OL].[2022-01-05].https://archive.ics.uci.edu/ml/index.php.
[33] LI J D,CHENG K W,WANG S H,et al.Feature selection[J].ACM Computing Surveys,2018,50(6):1-45.
[34] HETTICH S,BAY S D.The UCI KDD archive[EB/OL].[2022-01-05].http://kdd.ics.uci.edu/databases/kddcup99/.
[35] KAYACIK H G,ZINCIR-HEYWOOD A N,HEYWOOD M I.Selecting features for intrusion detection:a feature relevance analysis on KDD 99 intrusion detection datasets[C]//Proceedings of the 3rd Annual Conference on Privacy,Security and Trust.Washington D.C.,USA:IEEE Press, 2005:1723-1722.

Please choose a citation manager

Content to export