Background: Functional magnetic resonance imaging (fMRI) has been widely used to assess neural activity changes in gray matter (GM) in patients with multiple sclerosis (MS); however, brain function alterations in white matter (WM) relatively remain under-explored. Purpose: This work aims to identify the functional connectivity in both the WM and the GM of patients with MS using fMRI and the correlations between these functional changes and cumulative disability as well as the lesion ratio. Materials and Methods: For this retrospective study, 37 patients with clinically definite MS and 43 age-matched healthy controls were included between 2010 and 2014. Resting-state fMRI was performed. The WFU Pick and JHU Eve atlases were used to define 82 GM and 48 WM regions in common spaces, respectively. The time courses of blood oxygen level-dependent (BOLD) signals were averaged over each GM or WM region. The averaged time courses for each pair of GM and WM regions were correlated. All 82 x 48 correlations for each subject formed a functional correlation matrix. Results: Compared with the healthy controls, the MS patients had a decreased temporal correlation between the WM and the GM regions. Five WM bundles and four GM regions had significantly decreased mean correlation coefficients (CCs). More specifically, the WM functional alterations were negatively correlated with the lesion volume in the bilateral fornix, and the mean GM-averaged CCs of the WM bundles were inversely correlated with the lesion ratio (r = -0.36, P = 0.012). No significant correlation was found between WM functional alterations and the paced auditory serial addition test score, Expanded Disease Severity Scale score, and Multiple Sclerosis Severity Score (MSSS) in MS. Conclusions: These findings highlight current gaps in our knowledge of the WM functional alterations in patients with MS and may link WM function with pathological mechanisms.