Performances and variability of CT radiomics for the prediction of microvascular invasion and survival in patients with HCC: a matter of chance or standardisation?

Abstract

ObjectivesTo measure the performance and variability of a radiomics-based model for the prediction of microvascular invasion (MVI) and survival in patients with resected hepatocellular carcinoma (HCC), simulating its sequential development and application.MethodsThis study included 230 patients with 242 surgically resected HCCs who underwent preoperative CT, of which 73/230 (31.7%) were scanned in external centres. The study cohort was split into training set (158 patients, 165 HCCs) and held-out test set (72 patients, 77 HCCs), stratified by random partitioning, which was repeated 100 times, and by a temporal partitioning to simulate the sequential development and clinical use of the radiomics model. A machine learning model for the prediction of MVI was developed with least absolute shrinkage and selection operator (LASSO). The concordance index (C-index) was used to assess the value to predict the recurrence-free (RFS) and overall survivals (OS).ResultsIn the 100-repetition random partitioning cohorts, the radiomics model demonstrated a mean AUC of 0.54 (range 0.44-0.68) for the prediction of MVI, mean C-index of 0.59 (range 0.44-0.73) for RFS, and 0.65 (range 0.46-0.86) for OS in the held-out test set. In the temporal partitioning cohort, the radiomics model yielded an AUC of 0.50 for the prediction of MVI, a C-index of 0.61 for RFS, and 0.61 for OS, in the held-out test set.ConclusionsThe radiomics models had a poor performance for the prediction of MVI with a large variability in the model performance depending on the random partitioning. Radiomics models demonstrated good performance in the prediction of patient outcomes.