Network analysis has been widely used in studying Alzheimer's disease (AD). However, how the white matter network changes in cognitive impaired patients with subjective cognitive decline (SCD) (a symptom emerging during early stage of AD) and amnestic mild cognitive impairment (aMCI) (a pre-dementia stage of AD) is still unclear. Here, structural networks were constructed respectively based on FA and FN for 36 normal controls, 21 SCD patients, and 33 aMCI patients by diffusion tensor imaging and graph theory. Significantly lower efficiency was found in aMCI patients than normal controls (NC). Though not significant, the values in those with SCD were intermediate between aMCI and NC. In addition, our results showed significantly altered betweenness centrality located in right precuneus, calcarine, putamen, and left anterior cingulate in aMCI patients. Furthermore, association was found between network metrics and cognitive impairment. Our study suggests that the structural network properties might be preserved in SCD stage and disrupted in aMCI stage, which may provide novel insights into pathological mechanisms of AD.