Inter-specific competition, facilitation and predation influence herbivore assemblages, but no study has experimentally explored the interactions between large ungulates and small rodents. In a fully replicated, landscape scale experiment, we manipulated densities of domestic sheep in mountain pastures in Norway. We then determined population growth and densities of rodents by live trapping in each of the areas with different sheep densities. We found that the (summer) population growth rate and autumn density of the field vole (Microtus agrestis) was lower at high sheep density. This provides the first experimental evidence of negative interactions between an ungulate and small rodent species. There was no effect on the bank vole (Clethrionomys glareolus), whose diet differs from sheep. Sheep density, therefore, potentially alters the pattern of inter-specific population synchrony amongst voles. Our study shows that negative interactions between large ungulates and small rodents may be species-specific and negative population consequences for the rodent population appear above threshold ungulate densities.