Immunological memory allows for rapid and effective protective immunity to previously encountered pathogens. New insights in understanding specific memory differentiation and function have now indicated that in addition to providing enhanced immunity, an important purpose of immunological memory is to provide immediate protection at all sites of the body, including non-lymphoid tissues. Effector memory CD8 T cells have the capacity to reside long-term at epithelial surfaces, where they allow for rapid containment of the invading pathogens at the local entry site and prevent systemic spreading and excessive immune responses. The accumulation of tissue-specific memory T cell subsets, together with cross-reactivity of these antigen-experienced T cells even to unrelated pathogens, provides flexibility and expansion of their specificity repertoire that over time greatly surpasses that of the declining naïve T cell populations. This review will discuss new insights into T cell memory. We will focus in particular on the generation and function of effector memory CD8 T cells at the intestinal mucosa, which represents one of the largest entry sites for pathogens.