JMJD3 (KDM6B) is an H3K27me3 demethylases and emerges as an important player in developmental processes. Although some evidence indicated the involvement of JMJD3 in osteoblast differentiation in vitro, its role as a whole in osteoblast differentiation and bone formation in vivo remains unknown. Here we showed that homozygous deletion of Jmjd3 resulted in severe delay of osteoblast differentiation and bone ossification in mice. By biochemical and genetical methods, we demonstrated that JMJD3 mediated RUNX2 transcriptional activity and cooperated with RUNX2 to promote osteoblast differentiation and bone formation in vivo. These results strongly demonstrated that JMJD3 is required for osteoblast differentiation and bone formation in mice.