Antigenic assessments of SARS-CoV-2 variants inform decisions to update COVID-19 vaccines. Primary infection sera are often used for assessments, but such sera are rare due to population immunity from SARS-CoV-2 infections and COVID-19 vaccinations. Here, we show that neutralization titers and breadth of matched human and hamster pre-Omicron variant primary infection sera correlate well and generate similar antigenic maps. The hamster antigenic map shows modest antigenic drift among XBB sub-lineage variants, with JN.1 and BA.4/BA.5 variants within the XBB cluster, but with five to six-fold antigenic differences between these variants and XBB.1.5. Compared to sera following only ancestral or bivalent COVID-19 vaccinations, or with post-vaccination infections, XBB.1.5 booster sera had the broadest neutralization against XBB sub-lineage variants, although a five-fold titer difference was still observed between JN.1 and XBB.1.5 variants. These findings suggest that antibody coverage of antigenically divergent JN.1 could be improved with a matched vaccine antigen.