Colorectal cancer (CRC) is a highly heterogeneous disease, with well-characterized subtypes based on genome, DNA methylome, and transcriptome signatures. To chart the epigenetic landscape of CRCs, we generated a high-quality single-cell chromatin accessibility atlas of epithelial cells for 29 patients. Abnormal chromatin states acquired in adenomas were largely retained in CRCs, which were tightly accompanied by opposite changes of DNA methylation. Unsupervised analysis on malignant cells revealed two epigenetic subtypes, exactly matching iCMS classification, and key iCMS-specific transcription factors were identified, including HNF4A, PPARA for iCMS2 tumors, and FOXA3, MAFK for iCMS3 tumors. Notably, subtype-specific TFs bind to distinct target gene sets and contribute to both inter-patient similarities and diversities for both chromatin accessibilities and RNA expressions. Moreover, we identified CpG-island methylator phenotypes and pinpointed chromatin state signatures and TF regulators for CIMP-High subtype. Our work systematically revealed the epigenetic basis of the well-known iCMS and CIMP classifications of CRCs.