Recent studies demonstrated that histone methylation is not static but is dynamically regulated by histone methyltransferases and the newly discovered histone demethylases. This review discusses the chemical mechanisms for the known and potentially new classes of demethylases, the roles of these demethylases in chromatin and transcription, and their potential biological functions and connections to human diseases.