Previous theories on the effective size of age-structured populations assumed a constant environment and, usually, a constant population size and age structure. We derive formulas for the variance effective size of populations subject to fluctuations in age structure and total population size produced by a combination of demographic and environmental stochasticity. Haploid and monoecious or dioecious diploid populations are analyzed. Recent results from stochastic demography are employed to derive a two-dimensional diffusion approximation for the joint dynamics of the total population size, N, and the frequency of a selectively neutral allele, p. The infinitesimal variance for p, multiplied by the generation time, yields an expression for the effective population size per generation. This depends on the current value of N, the generation time, demographic stochasticity, and genetic stochasticity due to Mendelian segregation, but is independent of environmental stochasticity. A formula for the effective population size over longer time intervals incorporates deterministic growth and environmental stochasticity to account for changes in N.