BackgroundStroke, a leading global cause of mortality and neurological disability, is often associated with atherosclerotic carotid artery disease. Distinguishing between symptomatic and asymptomatic carotid artery disease is crucial for appropriate treatment decisions. Radiomics, a quantitative image analysis technique, and machine learning (ML) have emerged as promising tools in Ultrasound (US) imaging, potentially providing a helpful tool in the screening of such lesions.MethodsPubmed, Web of Science and Scopus databases were searched for relevant studies published from January 2005 to May 2023. The Radiomics Quality Score (RQS) was used to assess methodological quality of studies included in the review. The Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) assessed the risk of bias. Sensitivity, specificity, and logarithmic diagnostic odds ratio (logDOR) meta-analyses have been conducted, alongside an influence analysis.ResultsRQS assessed methodological quality, revealing an overall low score and consistent findings with other radiology domains. QUADAS-2 indicated an overall low risk, except for two studies with high bias. The meta-analysis demonstrated that radiomics-based ML models for predicting culprit plaques on US had a satisfactory performance, with a sensitivity of 0.84 and specificity of 0.82. The logDOR analysis confirmed the positive results, yielding a pooled logDOR of 3.54. The summary ROC curve provided an AUC of 0.887.ConclusionRadiomics combined with ML provide high sensitivity and low false positive rate for carotid plaque vulnerability assessment on US. However, current evidence is not definitive, given the low overall study quality and high inter-study heterogeneity. High quality, prospective studies are needed to confirm the potential of these promising techniques.