Hybrid GA-mSVM: Dimensionality reduction using hybrid genetic algorithm and modified support vector machine classifier
Abstract
The expansion of technology results in the generation of enormous amounts of data in all areas. The researchers face a difficult challenge when they attempt to categorize these high-dimensional data. A method called as feature selection is used to reduce the high-dimensionality of the data. It is possible to consider selecting features as an issue of global combinatorial optimization in the field of machine learning. This minimizes on the total number of features, gets rid of data that is insignificant, noisy, or duplicative, and ultimately achieves an acceptable level of classification accuracy. For the purpose of dimensionality reduction, a unique approach known as the Hybrid Genetic Algorithm – modified Support Vector Machine Classifier (Hybrid GA-mSVM) is presented in this study. The genetic algorithm component conducts a search using the principles underlying the evolutionary process in order to find the best feature set and after that the trimmed dataset is provided to the SVMs. The results of the experiments reveal that the proposed approach efficiently minimizes the features and achieves a better classification accuracy than other feature selection methods.
Keywords
Full Text:
PDFReferences
1. Rajeswari S, Josephine MS, Jeyabalaraja V. Dimension reduction: A PSO-PCNN optimization approach for attribute selection in high-dimensional medical database. In: Proceedings of the 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI); 21–22 September 2017; Chennai, India. pp. 2306–2309.
2. Siddique MAB, Sakib S, Rahman MA. Performance analysis of deep autoencoder and NCA dimensionality reduction techniques with KNN, ENN and SVM classifiers; In: Proceedings of the 2019 2nd International Conference on Innovation in Engineering and Technology (ICIET); 23–24 December 2019; Dhaka, Bangladesh; pp. 1–6.
3. Obeidat I, Eleisah W, Magableh K. Dimensionality reduction and supervised learning for intrusion detection. In: Proceedings of the 2022 8th International Conference on Information Management (ICIM); 25–27 March 2022; Cambridge, United Kingdom. pp. 86–91.
4. Othman AA, Hasan TM, Hasoon SO. Impact of dimensionality reduction on the accuracy of data classification. In: Proceedings of the 2020 3rd International Conference on Engineering Technology and its Applications (IICETA); 6–7 September 2020; Najaf, Iraq. pp. 128–133.
5. Stiawan D, Arifin MAS, Rejito J, et al. A dimensionality reduction approach for machine learning based IoT botnet detection. In: Proceedings of the 2021 8th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI); 20–21 October 2021; Semarang, Indonesia. pp. 26–30.
6. Wang G, Lauri F, El Hassani AH. A study of dimensionality reduction’s influence on heart disease prediction. In: Proceedings of the 2021 12th International Conference on Information, Intelligence, Systems & Applications (IISA); 12–14 July 2021; Chania Crete, Greece. pp. 1–6.
7. Tulapurkar H, Banerjee B, Mohan BK. Effective and efficient dimensionality reduction of hyperspectral image using CNN and LSTM network. In: Proceedings of the 2020 IEEE India Geoscience and Remote Sensing Symposium (InGARSS); 1–4 December 2020; Ahmedabad, India. pp. 213–216.
8. AlSaeed H, Hewahi N, Ksantini R. Dimension reduction techniques for image classification. In: Proceedings of the 2022 International Conference on Innovation and Intelligence for Informatics, Computing, and Technologies (3ICT); 20–21 November 2022; Sakheer, Bahrain. pp. 358–365.
9. Geng Y, Cai S, Qin S, et al. An efficient network traffic classification method based on combined feature dimensionality reduction. In: Proceedings of the 2021 IEEE 21st International Conference on Software Quality, Reliability and Security Companion (QRS-C); 6–10 December 2021; Hainan, China. pp. 407–414.
10. Wan Y, Li T, Wang P, et al. Robust and efficient classification for underground metal target using dimensionality reduction and machine learning. IEEE Access 2021; 9: 7384–7401. doi: 10.1109/ACCESS.2021.3049308
11. Arowolo MO, Adebiyi MO, Adebiyi AA, Okesola OJ. A hybrid heuristic dimensionality reduction methods for classifying malaria vector gene expression data. IEEE Access 2020; 8: 182422–182430. doi: 10.1109/ACCESS.2020.3029234
12. Yin J, Wang Y, Hu J. A new dimensionality reduction algorithm for hyperspectral image using evolutionary strategy. IEEE Transactions on Industrial Informatics 2012; 8(4): 935–943. doi: 10.1109/TII.2012.2205397
13. Moni V, Mattipalli M, Badar AQH. Machine learning classification techniques to predict directional change of energy prices using high dimensionality reduction. In: Proceedings of the 2022 International Conference on Computer Science and Software Engineering (CSASE); 15–17 March 2022; Duhok, Iraq. pp. 247–252.
14. Li J, Zhang J, Wang J, et al. VAGA: Towards accurate and interpretable outlier detection based on variational auto-encoder and genetic algorithm for high-dimensional data. In: Proceedings of the 2021 IEEE International Conference on Big Data (Big Data); 15–18 December 2021; Orlando, FL, USA. pp. 5956–5958.
15. Zhong L, Zhong J, Lu C. A comparative analysis of dimensionality reduction methods for genetic programming to solve high-dimensional symbolic regression problems. In: Proceedings of the 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC); 17–20 October 2021; Melbourne, Australia. pp. 476–483.
16. Sivaranjani S, Ananya S, Aravinth J, Karthika R. Diabetes prediction using machine learning algorithms with feature selection and dimensionality reduction. In: Proceedings of the 2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS); 19–20 March 2021; Coimbatore, India. pp. 141–146.
17. Li J, Zhang J, Wang J, et al. Outlier detection and abnormal subspace search based on autoencoder and genetic algorithm for high-dimensional data. In: Proceedings of the 2021 7th International Conference on Computer and Communications (ICCC); 10–13 December 2021; Chengdu, China. pp. 1510–1514.
18. Raia MR, Ruba M, Nemes RO, Martis C. Artificial neural network and data dimensionality reduction based on machine learning methods for PMSM model order reduction. IEEE Access 2021; 9: 102345–102354. doi: 10.1109/ACCESS.2021.3095668
19. Yaswanthram P, Sabarish BA. Face recognition using machine learning models—Comparative analysis and impact of dimensionality reduction. In: Proceedings of the 2022 IEEE Fourth International Conference on Advances in Electronics, Computers and Communications (ICAECC); 10–11 January 2022; Bengaluru, India. pp. 1–4.
20. Islam M, Anjum A, Ahsan T, Wang L. Dimensionality reduction for sentiment classification using machine learning classifiers. In: Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI); 6–9 December 2019; Xiamen, China. pp. 3097–3103.
21. Zhang Y, Jia Z, Ge H, Wang J. Novel SVM based SMOTE integrated LPP dimensionality reduction method for imbalanced samples fault diagnosis. In: Proceedings of the 2021 CAA Symposium on Fault Detection, Supervision, and Safety for Technical Processes (SAFEPROCESS); 17–18 December 2021; Chengdu, China. pp. 1–5.
22. Reddy GT, Reddy MPK, Lakshmanna K, et al. Analysis of dimensionality reduction techniques on big data. IEEE Access 2020; 8: 54776–54788. doi: 10.1109/ACCESS.2020.2980942
23. Cutura R, Angerbauer K, Heyen F, et al. DaRt: Generative art using dimensionality reduction algorithms. In: Proceedings of the 2021 IEEE VIS Arts Program (VISAP); 24–29 October 2021; New Orleans, LA, USA. pp. 59–72.
24. Dewangan S, Rao RS, Yadav PS. Dimensionally reduction based machine learning approaches for code smells detection. In: Proceedings of the 2022 International Conference on Intelligent Controller and Computing for Smart Power (ICICCSP); 21–23 July 2022; Hyderabad, India. pp. 1–4.
25. Chen Z, Omote K. A privacy preserving scheme with dimensionality reduction for distributed machine learning. In: Proceedings of the 2021 16th Asia Joint Conference on Information Security (AsiaJCIS); 19–20 August 2021; Seoul, Korea. pp. 45–50.
26. Q. Fournier and D. Aloise. Empirical comparison between autoencoders and traditional dimensionality reduction methods. In: Proceedings of the 2019 IEEE Second International Conference on Artificial Intelligence and Knowledge Engineering (AIKE); 3–5 June 2019; Sardinia, Italy. pp. 211–214.
27. Yumeng C, Yinglan F. Research on PCA Data Dimension Reduction Algorithm Based on Entropy Weight Method. In: Proceedings of the 2020 2nd International Conference on Machine Learning, Big Data and Business Intelligence (MLBDBI); 23–25 October 2020; Taiyuan, China. pp. 392–396.
28. Varunram TN, Shivaprasad MB, Aishwarya KH, et al. Analysis of different dimensionality reduction techniques and machine learning algorithms for an intrusion detection system. In: Proceedings of the 2021 IEEE 6th International Conference on Computing, Communication and Automation (ICCCA); 17–19 December 2021; Arad, Romania. pp. 237–242.
DOI: https://doi.org/10.32629/jai.v7i3.799
Refbacks
- There are currently no refbacks.
Copyright (c) 2023 Ashish Kumar Rastogi, Swapnesh Taterh, Billakurthi Suresh Kumar
License URL: https://creativecommons.org/licenses/by-nc/4.0/