Exploring the Role of Dimensionality Reduction in Enhancing Machine Learning Algorithm Performance
John Kamwele Mutinda, Amos Kipkorir Langat
Asian Journal of Research in Computer Science · pp. 157–166 · Published 11 Mar 2024
10.9734/ajrcos/2024/v17i5445Abstract
In this study, we delve into the pivotal role of dimension reduction techniques in influencing the performance of machine learning algorithms for heart disease prediction. Through a comprehensive exploration of a dataset encompassing crucial features such as age, sex, chest pain type, blood pressure, cholesterol levels, and more, we investigate the impact of different techniques—namely, Principal Component Analysis (PCA), Kernel Principal Component Analysis (KPCA), and Linear Discriminant Analysis (LDA) on classification algorithm effectiveness. The classification algorithms considered were Logistic Regression, Support Vector Machine (SVM), k-Nearest Neighbors (KNN), Naive Bayes, and Deep Neural Network (DNN). We used K-fold cross validation to train and validate the classification algorithms. The performance of these algorithms was assessed using a range of key metrics including accuracy, F1-score, precision, recall, and specificity. The results reveals that Linear Discriminant Analysis consistently emerged as a potent method, remarkably enhancing algorithm performance across all assessed metrics. We also identified Naive Bayes and Logistic Regression as standout algorithms, demonstrating remarkable resilience and reliability across diverse scenarios. These findings collectively shed light on the intricate interplay between dimension reduction techniques and algorithm selection, offering critical insights for crafting more accurate and robust strategies in the prediction of heart disease.
References (26)
- 1 Ensemble Methods in Machine Learning [DOI]
- 2 Gaussian Processes in Machine Learning [DOI]
- 3 Support Vector Machines for Classification and Regression
- 4 An empirical study of the naive Bayes classifier
- 5 Linear discriminant analysis: A detailed tutorial [DOI]
- 6 Analysis of Dimensionality Reduction Techniques on Big Data [DOI]
- 7 Feature dimensionality reduction: a review [DOI]
- 8 Dimension Reduction by Local Principal Component Analysis [DOI]
- 9 LINEAR DISCRIMINANT ANALYSIS - A BRIEF TUTORIAL
- 10 Efficient Learning Machines: Theories, Concepts, and Applications for Engineers and System Designers [DOI]
- 11 Early Detection of Diabetic Retinopathy Using PCA-Firefly Based Deep Learning Model [DOI]
- 12 A Review of Dimensionality Reduction Techniques for Efficient Computation [DOI]
- 13 7. Naive Bayesian classifier [DOI]
- 14 Parameter selection in SVM with RBF kernel function
- 15 A performance analysis of dimensionality reduction algorithms in machine learning models for cancer prediction [DOI]
- 16 A Review of Dimension Reduction Techniques
- 17 Application of K-nearest neighbors algorithm on breast cancer diagnosis problem.
- 18 Dimension Reduction: A Guided Tour [DOI]
- 19 A manifold learning approach to dimensionality reduction for modeling data [DOI]
- 20 Utilizing machine learning dimensionality reduction for risk stratification of chest pain patients in the emergency department [DOI]
- 21 Improving Classification Performance with Statistically Weighted Dimensions and Dimensionality Reduction [DOI]
- 22 Principal component analysis [DOI]
- 23 Kernel Principal Component Analysis and its Applications in Face Recognition and Active Shape Models [DOI]
- 24 Book Review: Machine Learning Techniques for Multimedia: Case Studies on Organization and Retrieval [DOI]
- 25 Logistic regression (machine learning) [DOI]
- 26 What Is Machine Learning? [DOI]
Cited by 17
Deny Jollyta, Julianti Kasih, Pihandoko Pihandoko · 2025 International Conference on Computing and Applied Informatics (ICCAI) · 2025
Sanjay BASU, Tasneem CHHERAWALA, Alka VAIDYA · Journal of Applied Economic Sciences (JAES) · 2025
William Watasendjaja, Billy Chandra, Ito Wasito · sinkron · 2025
John Kamwele Mutinda, Amos Kipkorir Langat, Samuel Musili Mwalili · International Journal of Mathematics and Mathematical Sciences · 2025
Suvendu Kumar Jena, Taki Alrwbaye, Piyush Kumar Pareek · 2025 4th International Conference on Distributed Computing and Electrical Circuits and Electronics (ICDCECE) · 2025
Laura Suleimenova, Zhanat Umarova, Kamalbek Berkimbayev · 2025 10th International Conference on Computer Science and Engineering (UBMK) · 2025
Lesia Mochurad, Roman Kapustiak · Applied Sciences · 2025
Lionel Nkenyereye, Boon Giin Lee, Wan-Young Chung · Engineering Applications of Artificial Intelligence · 2025
Showing 8 of 17 known citations — external sources report more than can currently be individually listed.
Related research
- On Applications of Fuzzy Soft Sets in Dimension Reduction and Medical Diagnosis — shares topic coverage
- On Designing Invertible Pseudo Covariance Matrix for Undersampled Cases in Classification — shares topic coverage
- Scalable Machine Learning Algorithms for Processing High-dimensional Data: A Case Study Approach — shares topic coverage
- Local Binary Pattern and Ant Colony Optimization Based Feature Dimensionality Reduction Technique for Face Recognition Systems — shares topic coverage
- Detection of Face Recognition of Interviewee Using Transform Technique and Machinle Learning Algorithm — shares topic coverage
Article metrics
Real usage data collected on this platform.
31
Page views
0
PDF downloads
3
Outbound clicks
17
Citations
Views over time
Views by country
Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".
Traffic sources
Referring site, by host.
Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.