Histone deacetylases (HDACs) are attractive chemotherapy targets, owing to their pro-proliferative activities. However, the finding that loss of HDAC1 promotes teratoma malignancy calls for caution in the use of HDAC inhibitors as cancer therapeutics.