Childhood environment, social environment and behavior, leisure time activities and life events have been hypothesized to contribute to individual differences in cognitive abilities and physical and emotional well-being. These factors are often labeled 'environmental', suggesting they shape but not reflect individual differences in behavior. The aim of this study is to test the hypothesis that these factors are not randomly distributed across the population but reflect heritable individual differences. Self-report data on Childhood Environment, Social Environment and Behavior, Leisure Time Activities and Life Events were obtained from 560 adult twins and siblings (mean age 47.11 years). Results clearly show considerable genetic influences on these factors with mean broad heritability of 0.49 (0.00-0.87). This suggests that what we think of as measures of 'environment' are better described as external factors that might be partly under genetic control. Understanding causes of individual differences in external factors may aid in clarifying the intricate nature between genetic and environmental influences on complex traits.