Histone lysine trimethyl states represent some of the most robust epigenetic modifications in eukaryotic chromatin. Using a candidate approach, we identified the subgroup of murine Jmjd2 proteins to antagonize H3K9me3 at pericentric heterochromatin. H3K27me3 and H4K20me3 marks are not impaired in inducible Jmjd2b-GFP cell lines, but Jmjd2b also reduces H3K36 methylation. Since recombinant Jmjd2b appears as a very poor enzyme, we applied metabolic labeling with heavy methyl groups to demonstrate Jmjd2b-mediated removal of chromosomal H3K9me3 as an active process that occurs well before replication of chromatin. These data reveal that certain members of the jmjC class of hydroxylases can work in a pathway that actively antagonizes a histone lysine trimethyl state.