This study aimed to investigate the contribution of fruit and family history to esophageal cancer, among residents with abnormal esophagus discovered in screening. The study was a frequency-matched case-control design in groups of normal esophagus, abnormal esophagus but not carcinoma, and esophageal squamous cell carcinoma. Odds ratio (OR) was estimated by unconditional logistic regression. Fruit intake (OR = 0.19, 95% CI = 0.06-0.56) and positive family history of esophageal cancer (OR = 3.87, 95% CI = 1.41-10.63) were associated with esophageal cancer compared to individuals with abnormal conditions of the esophagus. In individuals who consumed fruits at least once per week, the OR for family cancer history is reduced to a nonsignificant level (OR = 1.06, 95% CI = 0.07-15.91). In the individuals with abnormal esophagus at screening, fruit intake was possibly protective against esophageal cancer, even in the ones with positive family history. Local public health strategies should focus on the improvement in fruit intake.