It has long been known that epigenetic changes are inheritable. However, except for DNA methylation, little is known about the molecular mechanisms of epigenetic inheritance. Many types of stem cells undergo asymmetric cell divisions to generate self-renewed stem cells and daughter cells committed for differentiation. Still, whether and how stem cells retain their epigenetic memory remain questions to be elucidated. During the asymmetric division of Drosophila male germline stem cell (GSC), our recent studies revealed that the preexisting histone 3 (H3) are selectively segregated to the GSC, whereas newly synthesized H3 deposited during DNA replication are enriched in the differentiating daughter cell. We propose a two-step model to explain this asymmetric histone distribution. First, prior to mitosis, preexisting histones and newly synthesized histones are differentially distributed at two sets of sister chromatids. Next, during mitosis, the set of sister chromatids that mainly consist of preexisting histones are segregated to GSCs, while the other set of sister chromatids enriched with newly synthesized histones are partitioned to the daughter cell committed for differentiation. In this review, we apply current knowledge about epigenetic inheritance and asymmetric cell division to inform our discussion of potential molecular mechanisms and the cellular basis underlying this asymmetric histone distribution pattern. We will also discuss whether this phenomenon contributes to the maintenance of stem cell identity and resetting chromatin structure in the other daughter cell for differentiation.