Aging studies consistently show a relationship between decreased gray matter volume and decreased performance on working memory tasks. Few aging studies have investigated white matter changes in relation to functional brain changes during working memory tasks. Twenty-five younger and 25 older adults underwent anatomical magnetic resonance imaging (MRI) scans to measure gray matter volume, diffusion tensor imaging (DTI) to measure fractional anisotropy (FA) as a measure of white matter integrity, and functional magnetic resonance imaging (fMRI) while performing a working memory task. Significant increases in activation (fMRI) were seen in the left dorsal and ventral lateral prefrontal cortex with increased working memory load and with increased age (older showing greater bilateral activation). Partial correlational analyses revealed that even after controlling for age, frontal FA correlated significantly with fMRI activation during performance on the working memory task. These findings highlight the importance of white matter integrity in working memory performance associated with normal aging.