In stark contrast to other species within the Salmonidae family, phylogeographic information on European grayling, Thymallus thymallus, is virtually nonexistent. In this paper, we utilized mitochondrial DNA polymerase chain reaction-restriction fragment length polymorphism (mtDNA PCR-RFLP) and sequence variation to infer the postglacial dispersal routes of T. thymallus into and within northern Europe, and to locate geographically, potential evolutionarily distinct populations. Mitochondrial analyses revealed a total of 27 T. thymallus haplotypes which clustered into three distinct lineages. Average pairwise interlineage divergence was four and nine times higher than average intralineage divergence for RFLP and sequence data, respectively. Two European grayling individuals from the easternmost sample in Russia exhibited haplotypes more genetically diverged from any T. thymallus haplotype than T. arcticus haplotype, and suggested that hybridization/introgression zone of these two sister species may extend much further west than previously thought. Geographic division of the lineages was generally very clear with northern Europe comprising of two genetically differentiated areas: (i) Finland, Estonia and north-western Russia; and (ii) central Germany, Poland and western Fennoscandia. Average interpopulation divergence in North European T. thymallus was 10 times higher than that observed in a recent mtDNA study of North American T. arcticus. We conclude that (i) North European T. thymallus populations have survived dramatic Pleistocene temperature oscillations and originate from ancient eastern and central European refugia; (ii) genetic divergence of population groups within northern Europe is substantial and geographically distinct; and (iii) the remainder of Europe harbours additional differentiated assemblages that likely descend from a Danubian refugium. These findings should provide useful information for developing appropriate conservation strategies for European grayling and exemplify a case with a clear need for multinational co-operation for managing and conserving biodiversity.