Epigenetic regulation of gene transcription relies on an array of recurring structural domains that have evolved to recognize post-translational modifications on histones. The roles of bromodomains, PHD fingers, and the Royal family domains in the recognition of histone modifications to direct transcription have been well characterized. However, only through recent structural studies has it been realized that these basic folds are capable of interacting with increasingly more complex histone modification landscapes, illuminating how nature has concocted a way to accomplish more with less. Here we review the recent biochemical and structural studies of several conserved folds that recognize modified as well as unmodified histone sequences, and discuss their implications on gene expression.