Comparison and Evaluation of Classification Techniques in Medical domain: A Case Study Using Heart Disease Prediction and Analysis
Abstract
Heart disease affects millions of lives every year and stands as one of the most common and life-threatening health issues faced by people around the world. Detecting it early is essential to prevent associated outcomes, and machine learning is playing a key role in making this possible. Machine learning has transformed many industries by enabling systems to analyze data, recognize patterns, and make informed predictions. In healthcare, these capabilities are being used to develop models that help diagnose diseases such as heart disease.This study focuses on comparing and evaluating five ML algorithms: RegressionByDiscretization, M5P, lazy.KStar, DecisionTable, and M5Rules for the classification of heart disease using the Weka platform. Instead of emphasizing the prediction of heart failure, the focus is on analyzing and comparing how well these models perform in processing patient data and identifying trends. The experiments utilized the UCI Heart Disease dataset comprising 918 patient records with clinical features including age, chest pain type, cholesterol levels, resting ECG, and maximum heart rate. Each model was evaluated using Mean Absolute Error (MAE), Root Mean Squared Error (RMSE), Relative Absolute Error (RAE), Relative Root Squared Error (RRSE), and Correlation Coefficient. Among all the evaluated models, the \textit{Regression by Discretization} approach exhibited the most accurate predictions, achieving the lowest MAE of 0.0999 and RMSE of 0.1016, with RAE and RRSE values of 20.69\% and 20.95\% respectively, and an exceptionally high correlation of 0.9988. By evaluating multiple techniques, this research highlights the strengths and limitations of each approach, offering insights into which models may be more effective for similar healthcare applications. The findings underline the importance of choosing the right model and suggest that even greater accuracy may be achieved by exploring more advanced techniques in the future.References
[1] Sonawane, J. S., & Patil, D. R. (2014, February). Prediction of heart disease using multilayer perceptron neural network. In International conference on information communication and embedded systems (ICICES2014) (pp. 1-6). IEEE.
https://doi.org/10.1109/ICICES.2014.7033860
[2] Hosseinzadeh, M., Ahmed, O. H., Ghafour, M. Y., Safara, F., Hama, H. K., Ali, S., ... & Chiang, H. S.
(2021). A multiple multilayer perceptron neural network with an adaptive learning algorithm for thyroid
disease diagnosis in the internet of medical things. The Journal of Supercomputing, 77(4), 3616-3637.
https://doi.org/10.1007/s11227-020-03404-w
[3] Khemphila, A., & Boonjing, V. (2011, August). Heart disease classification using neural network and feature selection. In 2011 21st international conference on systems engineering (pp. 406-409). IEEE. https://doi.org/10.1109/ICSEng.2011.80
[4] Jabbar, M. A., Deekshatulu, B. L., & Chandra, P. (2013). Heart disease classification using nearest neighbor classifier with feature subset selection. Anale. Seria Informatica, 11, 47-54. https://www.analeinformatica.tibiscus.ro/download/lucrari/11-1-06-Jabbar.pdf
[5] Khateeb, N., & Usman, M. (2017, December). Efficient heart disease prediction system using K-nearest neighbor classification technique. In Proceedings of the international conference on big data and internet of thing (pp. 21-26). https://doi.org/10.1145/3175684.3175703
[6] Shao, Y. E., Hou, C. D., & Chiu, C. C. (2014). Hybrid intelligent modeling schemes for heart disease
classification. Applied Soft Computing, 14, 47-52. https://doi.org/10.1016/j.asoc.2013.09.020
[7] Li, J. P., Haq, A. U., Din, S. U., Khan, J., Khan, A., & Saboor, A. (2020). Heart disease identification method using machine learning classification in e-healthcare. IEEE Access, 8, 107562–107582. https://doi.org/10.1109/ACCESS.2020.3001149
[8] Najafi, A., Nemati, A., Ashrafzadeh, M., & Zolfani, S. H. (2023). Multiple-criteria decision making, feature selection, and deep learning: a golden triangle for heart disease identification. Engineering Applications of Artificial Intelligence, 125, 106662.
https://doi.org/10.1016/j.engappai.2023.106662
[9] Raval, J., Verma, J. P., Islam, S. N., Jain, R., & Thakur, N. (2022, December). AI based prediction for heart disease: a comparative analysis and an improved machine learning approach. In 2022 6th Asian Conference on Artificial Intelligence Technology (ACAIT) (pp. 1-9). IEEE. https://doi.org/10.1109/ACAIT56212.2022.10137923
[10] Uddin, K. M. M., Dey, S. K., & Babu, H. M. H. (2024). A Voice assistive mobile application tool to detect cardiovascular disease using machine learning approach. Biomedical Materials & Devices, 2(2), 1246-1257. https://doi.org/10.1007/s44174-024-00170-8
[11] Reddy, K. V. V., Elamvazuthi, I., Aziz, A. A., Paramasivam, S., Chua, H. N., & Pranavanand, S. (2021). Heart disease risk prediction using machine learning classifiers with attribute evaluators. Applied Sciences, 11(18), 8352. https://doi.org/10.3390/app11188352
[12] Masethe, H. D., & Masethe, M. A. (2014, October). Prediction of heart disease using classification algorithms. In Proceedings of the World Congress on Engineering and Computer Science (Vol. 2, No. 1, pp. 25-29). https://www.iaeng.org/publication/WCECS2014/WCECS2014_pp809-812.pdf
[13] Mary, N., Khan, B., Asiri, A. A., Muhammad, F., Khan, S., Alqhtani, S., ... & Alshamrani, K. A. (2022). Heart disease risk prediction expending of classification algorithms. Computers, Materials & Continua, 73(3), 6595. https://doi.org/10.32604/cmc.2022.032384
[14] Gour, S., Panwar, P., Dwivedi, D., & Mali, C. (2022). A machine learning approach for heart attack prediction. In Intelligent Sustainable Systems: Selected Papers of WorldS4 2021, Volume 1 (pp. 741-747). Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-16-6309-3_70
[15] Rucker, D. D., McShane, B. B., & Preacher, K. J. (2015). A researcher’s guide to regression, discretization, and median splits of continuous variables. Journal of Consumer Psychology, 25(4), 666-678. https://doi.org/10.1016/j.jcps.2015.04.004
[16] Behnood, A., Behnood, V., Gharehveran, M. M., & Alyamac, K. E. (2017). Prediction of the compressive strength of normal and high-performance concretes using M5P model tree algorithm. Construction and Building Materials, 142, 199-207. https://doi.org/10.1016/j.conbuildmat.2017.03.061
[17] Wiharto, W., Kusnanto, H., & Herianto, H. (2016). Intelligence system for diagnosis level of coronary heart disease with K-star algorithm. Healthcare Informatics Research, 22(1), 30-38. https://doi.org/10.4258/hir.2016.22.1.30
[18] Kohavi, R. (1995, April). The power of decision tables. In European conference on machine learning (pp. 174-189). Berlin, Heidelberg: Springer Berlin Heidelberg. https://doi.org/10.1007/3-540-59286-5_57
[19] Duggal, H., & Singh, P. (2012). Comparative study of the performance of M5-Rules algorithm with different algorithms. Journal of Software Engineering and Applications, 5(4), 270-276. https://doi.org/10.4236/jsea.2012.54032
[20] fedesoriano. (September 2021). Heart Failure Prediction Dataset. Retrieved March 2025, from https://www.kaggle.com/fedesoriano/heart-failureprediction.
[21] Alizadehsani, R., Roshanzamir, M., Abdar, M., Beykikhoshk, A., Khosravi, A., Nahavandi, S., ... & Acharya, U. R. (2022). Hybrid geneticdiscretized algorithm to handle data uncertainty in diagnosing stenosis of coronary arteries. Expert Systems, 39(7), e12573. https://doi.org/10.1111/exsy.12573
[22] Roy, R. E., Kulkarni, P., & Kumar, S. (2022, June). Machine learning techniques in predicting heart disease : a survey. In 2022 IEEE world conference on applied intelligence and computing (AIC) (pp. 373-377). IEEE. https://doi.org/10.1109/AIC55036.2022.9848945
[23] Gheibi, M., Taghavian, H., Moezzi, R., Waclawek, S., Cyrus, J., Dawiec-Lisniewska, A., ... & Khaleghiabbasabadi, M. (2023). Design of a decision support system to operate a NO2 gas sensor using machine learning, sensitive analysis and conceptual control process modelling. Chemosensors, 11(2), 126. https://doi.org/10.3390/chemosensors11020126
[24] Wang, G. Y., Yu, H., & Yang, D. C. (2002). Decision table reduction based on conditional information entropy. Chinese Journal of Computers-Chinese Edition, 25(7), 759-766. http://cjc.ict.ac.cn/eng/qwjse/view.asp?id=1076
[25] Patro, S. P., Padhy, N., & Sah, R. D. (2022). A road map for classification of heart disease using machine learning classifier. In Next Generation of Internet of Things: Proceedings of ICNGIoT 2022 (pp. 687-702). Singapore: Springer Nature Singapore. https://doi.org/10.1007/978-981-19-1412-6_59
[26] Azmi, J., Arif, M., Nafis, M. T., Alam, M. A., Tanweer, S., & Wang, G. (2022). A systematic review on machine learning approaches for cardiovascular disease prediction using medical big data. Medical Engineering & Physics, 105(1), 103825. https://doi.org/10.1016/j.medengphy.2022.103825
[27] Krishnani, D., Kumari, A., Dewangan, A., Singh, A., & Naik, N. S. (2019, October). Prediction of coronary heart disease using supervised machine learning algorithms. In TENCON 2019-2019 IEEE Region 10 Conference (TENCON) (pp. 367-372). IEEE. https://doi.org/10.1109/TENCON.2019.8929434
[28] Saleh, B., Saedi, A., Al-Aqbi, A., & Salman, L. (2020). Analysis of weka data mining techniques for heart disease prediction system. International Journal of Medical Reviews, 7(1), 15-24. https://doi.org/10.30491/ijmr.2020.221474.1078
[29] Shah, D., Patel, S., & Bharti, S. K. (2020). Heart disease prediction using machine learning techniques. SN Computer Science, 1(6), 345. https://doi.org/10.1007/s42979-020-00365-y
[30] Arnaiz-González, Á., Díez-Pastor, J. F., Rodríguez, J. J., & García-Osorio, C. I. (2016). Instance selection for regression by discretization. Expert Systems with Applications, 54, 340-350. https://doi.org/10.1016/j.eswa.2015.12.046
[31] Annunziata, A., Cappabianca, S., Capuozzo, S., Coppola, N., Di Somma, C., Docimo, L., ... & Sansone, C. (2024). A multimodal machine learning model in pneumonia patients hospital length of stay prediction. Big Data and Cognitive Computing, 8(12), 178. https://doi.org/10.3390/bdcc8120178
[32] Austin, P. C., Tu, J. V., Ho, J. E., Levy, D., & Lee, D. S. (2013). Using methods from the data-mining and machine-learning literature for disease classification and prediction: a case study examining classification of heart failure subtypes.Journal of Clinical Epidemiology, 66(4), 398-407. https://pubmed.ncbi.nlm.nih.gov/23384592/
[33] Acharya, A. (2017). Comparative study of machine learning algorithms for heart disease prediction (Bachelor’s thesis, Metropolia University of Applied Sciences). Theseus. https://www.theseus.fi/handle/10024/124622
[34] Mohan, S., Thirumalai, C., & Srivastava, G. (2019). Effective heart disease prediction using hybrid machine learning techniques. IEEE Access, 7, 81542-81554. https://doi.org/10.1109/ACCESS.2019.2923707
[35] Benhar, H., Idri, A., & Fernández-Alemán, J. L. (2020). Data preprocessing for heart disease classification: A systematic literature review. Computer Methods and Programs in Biomedicine, 195, 105635. https://doi.org/10.1016/j.cmpb.2020.105635
[36] Ekız, S., & Erdoğmuş, P. (2017, April). Comparative study of heart disease classification. In 2017 Electric Electronics, Computer Science, Biomedical Engineerings’ Meeting (EBBT) (pp. 1-4). IEEE. https://doi.org/10.1109/EBBT.2017.7956761
[37] Budholiya, K., Shrivastava, S. K., & Sharma, V. (2022). An optimized XGBoost based diagnostic system for effective prediction of heart disease. Journal of King Saud University-Computer and Information Sciences, 34(7), 4514-4523. https://doi.org/10.1016/j.jksuci.2020.10.013
[38] Yang, J., & Guan, J. (2022). A heart disease prediction model based on feature optimization and smote-Xgboost algorithm. Information, 13(10), 475. https://doi.org/10.3390/info13100475
[39] Dhananjay, B., & Sivaraman, J. (2021). Analysis and classification of heart rate using CatBoost feature ranking model. Biomedical Signal Processing and Control, 68, 102610. https://doi.org/10.1016/j.bspc.2021.102610
[40] Hamid, M., Hajjej, F., Alluhaidan, A. S., & bin Mannie, N. W. (2025). Fine tuned CatBoost machine learning approach for early detection of cardiovascular disease through predictive modeling. Scientific Reports, 15(1), 31199. https://doi.org/10.1038/s41598-025-13790-x
[41] Dhanka, S., & Maini, S. (2021, December). Random forest for heart disease detection: a classification approach. In 2021 IEEE 2nd International conference on electrical power and energy systems (ICEPES) (pp. 1-3). IEEE. https://doi.org/10.1109/ICEPES52894.2021.9699506
[42] Pal, M., & Parija, S. (2021, March). Prediction of heart diseases using random forest. In Journal of Physics: Conference Series (Vol. 1817, No. 1, p. 012009). IOP Publishing. https://doi.org/10.1088/1742-6596/1817/1/012009
[43] Alzaharani, Mohammad Eid, and Shaikh Abdul Hannan. ”Diagnosis and Medical Prescription of Heart Disease Using FFBP, SVM and RBF.” KKU Journal of Basic and Applied Sciences Vol 5, (2019) 6-15 1. https://www.researchgate.net/publication /372909782_Diagnosis_and_Medical_Prescri ption_of_Heart_Disease_Using_FFBP_SVM_and_RBF
[44] Yang, C., An, B., & Yin, S. (2018, October). Heart-disease diagnosis via support vector machine-based approaches. In 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 3153-3158). IEEE. https://doi.org/10.1109/SMC.2018.00534
[45] Deng, L., Lu, K., & Hu, H. (2025). An interpretable LightGBM model for predicting coronary heart disease: Enhancing clinical decision-making with machine learning. PLOS One, 20(9), e0330377. https://doi.org/10.1371/journal.pone.0330377
[46] Thenmozhi, K., & Deepika, P. (2014). Heart disease prediction using classification with different decision tree techniques. International Journal of Engineering Research and General Science, 2(6), 6-11. https: //www.researchgate.net/publication/33525 9464_Heart_disease_prediction_using_cla ssification_with_different_decision_tree _techniques
[47] Omotehinwa, T. O., Oyewola, D. O., & Moung, E. G. (2024). Optimizing the light gradient-boosting machine algorithm for an efficient early detection of coronary heart disease. Informatics and Health, 1(2), 70-81. https://doi.org/10.1016/j.infoh.2024.06.001
DOI:
https://doi.org/10.31449/inf.v50i14.8815Keywords:
Weka, heart failure prediction, RegressionByDiscretization, M5P, lazy.KStar, DecisionTable, M5Rules, XGBoost, LightGBM, CatBoost, Random Forest, Support Vector MachineDownloads
Published
Issue
Section
License
Authors retain copyright in their work. By submitting to and publishing with Informatica, authors grant the publisher (Slovene Society Informatika) the non-exclusive right to publish, reproduce, and distribute the article and to identify itself as the original publisher.
All articles are published under the Creative Commons Attribution license CC BY 3.0. Under this license, others may share and adapt the work for any purpose, provided appropriate credit is given and changes (if any) are indicated.
Authors may deposit and share the submitted version, accepted manuscript, and published version, provided the original publication in Informatica is properly cited.
