International Journal of Hematology and Oncology
2025, Vol 35, Num 1 Page(s): 068-074
| Back | Table of Contents | PDF | Mail to Author | |
Artificial Intelligence (ChatGPT-4o) in Adjuvant Treatment Decision-Making for Stage II Colon Cancer: A Comparative Analysis with Clinician Recommendations and NCCN/ESMO Guidelines
Fatih KUS1, Elvin CHALABIYEV1, Hasan Cagri YILDIRIM1, Ilgin KOC KUS1, Firat SIRVAN2, Omer DIZDAR1, Suayib YALCIN1
The role of artificial intelligence (AI) in oncology decision-making is rapidly expanding, yet its concordance with clinician recommendations and established guidelines remains unclear. This study evaluates the agreement between AI-generated adjuvant therapy recommendations for stage II colon cancer, clinician decisions, and international guidelines (NCCN, ESMO). We conducted a retrospective comparative analysis of 197 stage II colon cancer patients treated at Hacettepe University between 2014 and 2023. AI-generated recommendations (ChatGPT-4o) were compared with clinician decisions and NCCN/ESMO guidelines. Concordance rates were analyzed using Cohen’s kappa and McNemar’s test. Clinician adherence was highest with NCCN (89.8%) and ESMO (84.8%) guidelines. AI recommendations showed moderate agreement with clinician decisions (65.0%, κ= 0.47). Statistically significant differences were observed between AI and clinical practice (p< 0.001), suggesting AI’s more conservative approach. While AI demonstrates potential as a clinical decision-support tool, its moderate alignment with real-world decisions highlights the need for further refinement. Future improvements in AI interpretability, real-world validation, and clinician-AI collaboration are essential for its effective integration into oncology practice.
Fatih KUS1, Elvin CHALABIYEV1, Hasan Cagri YILDIRIM1, Ilgin KOC KUS1, Firat SIRVAN2, Omer DIZDAR1, Suayib YALCIN1
The role of artificial intelligence (AI) in oncology decision-making is rapidly expanding, yet its concordance with clinician recommendations and established guidelines remains unclear. This study evaluates the agreement between AI-generated adjuvant therapy recommendations for stage II colon cancer, clinician decisions, and international guidelines (NCCN, ESMO). We conducted a retrospective comparative analysis of 197 stage II colon cancer patients treated at Hacettepe University between 2014 and 2023. AI-generated recommendations (ChatGPT-4o) were compared with clinician decisions and NCCN/ESMO guidelines. Concordance rates were analyzed using Cohen’s kappa and McNemar’s test. Clinician adherence was highest with NCCN (89.8%) and ESMO (84.8%) guidelines. AI recommendations showed moderate agreement with clinician decisions (65.0%, κ= 0.47). Statistically significant differences were observed between AI and clinical practice (p< 0.001), suggesting AI’s more conservative approach. While AI demonstrates potential as a clinical decision-support tool, its moderate alignment with real-world decisions highlights the need for further refinement. Future improvements in AI interpretability, real-world validation, and clinician-AI collaboration are essential for its effective integration into oncology practice.
| Back | Table of Contents | PDF | Mail to Author | |