The Alzheimer's Disease Neuroimaging Initiative (ADNI) is a large multi-center study designed to develop optimized methods for acquiring longitudinal neuroimaging, cognitive, and biomarker measures of AD progression in a large cohort of patients with Alzheimer's disease (AD), patients with Mild Cognitive Impairment, and healthy controls. Detailed neuropsychological testing was conducted on all participants. We examined the factor structure of the ADNI Neuropsychological Battery across older adults with differing levels of clinical AD severity based on the Clinical Dementia Rating Scale (CDR). Confirmatory factor analysis (CFA) of 23 variables from 10 neuropsychological tests resulted in five factors (memory, language, visuospatial functioning, attention, and executive function/processing speed) that were invariant across levels of cognitive impairment. Thus, these five factors can be used as indicators of cognitive function in older adults who are participants in ADNI.