Phylogeographical studies that focus on the southeastern margin of the Tibetan Plateau are limited. The complex terrain and unique geological history make it a particularly unusual region of the Tibetan Plateau. We carried out a phylogeographical study of two rodent species Neodon irene and Apodemus latronum using the mitochondrial cytochrome b gene sequences. High genetic diversities and deep phylogenetic splits were detected in both rodents. Some haplotypes from one sampling region fell into different evolutionary clades, but most haplotypes from the same sampling regions were clustered together with each other. The results of isolation by distance analysis further substantiated that their genetic diversities were structured along geography. Thus, there were high levels of geographical structure for both rodents. Demographic analyses implied a relatively constant population size for all samples of N. irene and A. latronum in history. However, clade B of N. irene and clade 3 of A. latronum experienced population expansions at 105-32 and 156-47 Kya, respectively. Through comparison with previous studies, we suggest the high mitochondrial DNA diversities in them are probably not a species-specific feature, but a common pattern for small mammals in this unique area. Details of the historical demography of these rodents revealed in this study could provide new insights into how rodents and possibly other small mammals in this region responded to the geological and climatic events.