This study examined whether the weekly volume and frequency of moderate to vigorous physical activity (MVPA) and light walking (LW) were associated with quality of life (QOL) domains of 1,806 older women from Brazil. The WHOQOL-BREF and WHOQOL-OLD instruments were used to measure QOL, while the weekly volume and frequency of MVPA and LW were assessed by IPAQ. An ordinal logistic regression was used as a measure of association. The weekly volumes of MVPA and LW were associated with several domains of QOL. Higher frequency of MVPA was associated with better scores in 10 QOL domains. The weekly frequency of LW, in turn, was associated with all QOL domains. In conclusion, promoting active transport and encouraging physical activity in older adults, for at least 150 min and distributed several days per week, help to increase QOL.