The association between specific fish intake and colorectal cancer risk remains controversial. This study aimed to examine the association between specific fish intake and colorectal cancer risk in Chinese population in a large case control study. During July 2010 to November 2014, 1189 eligible colorectal cancer cases and 1189 frequency-matched controls (age and sex) completed in-person interviews. A validated food frequency questionnaire was used to estimate dietary intake. Multivariate logistical regression models were used to estimate the odds ratio (OR) and 95% confidence interval (95% CI) after adjusting for various confounders. A strong inverse association was found between freshwater fish intake and colorectal cancer risk. Compared with the lowest quartile, the highest quartile intake showed a risk reduction of 53% (OR 0.47, 95% CI = 0.36-0.60, Ptrend < 0.01) after adjustment for various confounders. The inverse association were also observed for sea fish (OR 0.79, 95%CI = 0.62-0.99, Ptrend < 0.01) and fresh fish (OR 0.49, 95%CI = 0.38-0.62, Ptrend < 0.01). No statistically significant association was found between dried/salted fish and shellfish intake and colorectal cancer risk. These results indicate that higher consumption of freshwater fish, sea fish and fresh fish is associated with a lower risk of colorectal caner.