Chronic-phase HIV and simian immunodeficiency virus (SIV) replication is reduced by as much as 10,000-fold in elite controllers (ECs) compared with typical progressors (TPs), but sufficient viral replication persists in EC tissues to allow viral sequence evolution and induce excess immune activation. Here we show that productive SIV infection in rhesus monkey ECs, but not TPs, is markedly restricted to CD4(+) follicular helper T (TFH) cells, suggesting that these EC monkeys' highly effective SIV-specific CD8(+) T cells can effectively clear productive SIV infection from extrafollicular sites, but their relative exclusion from B cell follicles prevents their elimination of productively infected TFH cells. CD8(+) lymphocyte depletion in EC monkeys resulted in a dramatic re-distribution of productive SIV infection to non-TFH cells, with restriction of productive infection to TFH cells resuming upon CD8(+) T cell recovery. Thus, B cell follicles constitute 'sanctuaries' for persistent SIV replication in the presence of potent anti-viral CD8(+) T cell responses, potentially complicating efforts to cure HIV infection with therapeutic vaccination or T cell immunotherapy.