Comparison of supervised machine learning classification techniques in prediction of locoregional recurrences in early oral tongue cancer

Show full item record



Permalink

http://hdl.handle.net/10138/327123

Citation

Alabi , R O , Elmusrati , M , Sawazaki-Calone , I , Kowalski , L P , Haglund , C , Coletta , R D , Mäkitie , A A , Salo , T , Almangush , A & Leivo , I 2020 , ' Comparison of supervised machine learning classification techniques in prediction of locoregional recurrences in early oral tongue cancer ' , International Journal of Medical Informatics , vol. 136 , 104068 . https://doi.org/10.1016/j.ijmedinf.2019.104068

Title: Comparison of supervised machine learning classification techniques in prediction of locoregional recurrences in early oral tongue cancer
Author: Alabi, Rasheed Omobolaji; Elmusrati, Mohammed; Sawazaki-Calone, Iris; Kowalski, Luiz Paulo; Haglund, Caj; Coletta, Ricardo D.; Mäkitie, Antti A.; Salo, Tuula; Almangush, Alhadi; Leivo, Ilmo
Contributor: University of Helsinki, HUS Abdominal Center
University of Helsinki, HUS Head and Neck Center
University of Helsinki, HUSLAB
University of Helsinki, HUS Head and Neck Center
Date: 2020-04
Language: eng
Number of pages: 8
Belongs to series: International Journal of Medical Informatics
ISSN: 1386-5056
URI: http://hdl.handle.net/10138/327123
Abstract: Background: The proper estimate of the risk of recurrences in early-stage oral tongue squamous cell carcinoma (OTSCC) is mandatory for individual treatment-decision making. However, this remains a challenge even for experienced multidisciplinary centers. Objectives: We compared the performance of four machine learning (ML) algorithms for predicting the risk of locoregional recurrences in patients with OTSCC. These algorithms were Support Vector Machine (SVM), Naive Bayes (NB), Boosted Decision Tree (BDT), and Decision Forest (DF). Materials and methods: The study cohort comprised 311 cases from the five University Hospitals in Finland and A.C. Camargo Cancer Center, Sao Paulo, Brazil. For comparison of the algorithms, we used the harmonic mean of precision and recall called F1 score, specificity, and accuracy values. These algorithms and their corresponding permutation feature importance (PFI) with the input parameters were externally tested on 59 new cases. Furthermore, we compared the performance of the algorithm that showed the highest prediction accuracy with the prognostic significance of depth of invasion (DOI). Results: The results showed that the average specificity of all the algorithms was 71% The SVM showed an accuracy of 68% and F1 score of 0.63, NB an accuracy of 70% and F1 score of 0.64, BDT an accuracy of 81% and F1 score of 0.78, and DF an accuracy of 78% and F1 score of 0.70. Additionally, these algorithms outperformed the DOI-based approach, which gave an accuracy of 63%. With PFI-analysis, there was no significant difference in the overall accuracies of three of the algorithms; PFI-BDT accuracy increased to 83.1%, PFI-DF increased to 80%, PFI-SVM decreased to 64.4%, while PFI-NB accuracy increased significantly to 81.4%. Conclusions: Our findings show that the best classification accuracy was achieved with the boosted decision tree algorithm. Additionally, these algorithms outperformed the DOI-based approach. Furthermore, with few parameters identified in the PFI analysis, ML technique still showed the ability to predict locoregional recurrence. The application of boosted decision tree machine learning algorithm can stratify OTSCC patients and thus aid in their individual treatment planning.
Subject: Artificial intelligence
Oral tongue cancer
Machine learning
Prediction
SQUAMOUS-CELL CARCINOMA
SURVIVAL
METASTASIS
MODEL
INVASION
3141 Health care science
Rights:


Files in this item

Total number of downloads: Loading...

Files Size Format View
Alabi_et_al_Com ... rly_oral_tongue_cancer.pdf 1.611Mb PDF View/Open

This item appears in the following Collection(s)

Show full item record