For accurate measurements of the secondary cosmic rays by using passive dosimeters, the relative responses of the thermoluminescence dosimeter (TLD), optically stimulated luminescence (OSL) dosimeter, and radiophotoluminescent glass dosimeter (RPLGD) were studied. The cosmic-ray shower generator was used to simulate the secondary cosmic rays at the sea level. Monte Carlo simulations were performed to calculate the air kerma and absorbed doses in each kind of dosimeter. The results showed that compared with their responses to gamma rays of (137)Cs, the relative responses of the TLD, OSL, and RPLGD were 0.786, 0.707, and 0.735 to the hard component of cosmic rays, respectively, and the values were 0.904, 0.838, and 0.857 to the soft component of cosmic rays, respectively. To verify the simulations results, an in situ measurement with the three kinds of dosimeters was performed at the same place. The results indicated that the secondary cosmic rays monitored with the three kinds of dosimeters were well consistent with each other provided their relative responses were taken into account.