The endocrine system is an embryological diverse system consisted of a variety of glands, such as pituitary, parathyroid, thyroid, adrenal, endocrine pancreas, and the diffuse neuroendocrine system. Endocrine tumor can be presented as a sporadic event, or as part of an inherited tumor syndrome. During the past century, inherited tumor syndromes have emerged as an important group of diseases. With the growing knowledge of each inherited tumor syndrome in the molecular genetic level, many changes in clinical management have occurred. This review focuses on the endocrine tumors involving the pituitary, parathyroid, thyroid, adrenal, and endocrine pancreas, in the setting of inherited tumor syndromes. We discuss the specific clinical, molecular genetic, and pathologic features of endocrine tumor in each gland and their associated inherited tumor syndromes. By understanding the pathogenesis of inherited endocrine tumor syndromes and recognizing the unique features of pathologic findings, pathologists bear the responsibility to provide the clinicians the guidelines in terms of screening and treatment of inherited tumor syndromes.