Infections with monkeypox, cowpox and weaponized variola virus remain a threat to the increasingly unvaccinated human population, but little is known about their mechanisms of virulence and immune evasion. We now demonstrate that B22 proteins, encoded by the largest genes of these viruses, render human T cells unresponsive to stimulation of the T cell receptor by MHC-dependent antigen presentation or by MHC-independent stimulation. In contrast, stimuli that bypass TCR-signaling are not inhibited. In a non-human primate model of monkeypox, virus lacking the B22R homologue (MPXVΔ197) caused only mild disease with lower viremia and cutaneous pox lesions compared to wild type MPXV which caused high viremia, morbidity and mortality. Since MPXVΔ197-infected animals displayed accelerated T cell responses and less T cell dysregulation than MPXV US2003, we conclude that B22 family proteins cause viral virulence by suppressing T cell control of viral dissemination.