Capsicum baccatum is one of the main pepper species grown and consumed in South America. In Brazil, it is commonly cultivated by family farmers, using mostly the genotypes bishop's hat genotypes (locally cambuci) and red chili pepper (dedo-de-moça). This study had the objective of characterizing 116 C. baccatum accessions from different regions of Brazil, based on morphological fruit descriptors and AFLP (Amplified Fragment Length Polymorphisms) markers. Broad phenotypic variability among the C. baccatum accessions was detected when using morphological fruit descriptors. The Ward modified location model (Ward-MLM) discriminated five groups, based mainly on fruit shape. Six combinations of AFLP primers detected polymorphism in 97.93% of the 2466 identified bands, indicating the high genetic variability in the accessions. The UPGMA coincided with the Bayesian clustering analysis and three large groups were formed, separating the wild variety C. baccatum var. praetermissum from the other accessions. There was no relation between genetic distance and geographical origin of the accessions, probably due to the intense exchange of fruits and seeds between farmers. Morphological descriptors used together with AFLP markers proved efficient in detecting the levels of genetic variability among the accessions maintained in the germplasm collections. These results can be used as an additional source of helpful information to be exploited in C. baccatum breeding programs.