The duration of anti-yellow fever (YF) virus immunoglobulin M (IgM) antibodies following YF vaccination is unknown, making it difficult to interpret positive IgM antibody results in previously vaccinated travelers. We evaluated the frequency and predictors of YF IgM antibody positivity 3-4 years following YF vaccination. Twenty-nine (73%) of 40 participants had YF IgM antibodies 3-4 years postvaccination. No demographic or exposure variables were predictive of YF IgM positivity. However, persons who were YF IgM positive at 3-4 years postvaccination had earlier onset viremia and higher neutralizing antibody geometric mean titers at 1 month and 3-4 years postvaccination compared with persons who were YF IgM negative. Detection of YF IgM antibodies several years postvaccination might reflect remote YF vaccination rather than recent YF vaccination or YF virus infection.