Maternal nutrition is recognized as one of the main determinants of fetal growth. We analyzed the risk of having a Small for Gestational Age (SGA) newborn according to maternal dairy intake during pregnancy. A matched case-control study was conducted in Spain. Dietary intake during pregnancy was assessed using a validated Food Frequency Questionnaire. Odds ratios (OR) and their 95% confidence intervals (CI) were estimated using conditional logistic regression models. 518 cases (SGA) and 518 controls (adequate birth weight) were included. Most study participants did not meet the current recommendations for dairy intake (78.6% cases and 80.2% controls). Intake of dairy products was not associated with a lower frequency of SGA, aORQ4 vs. Q1 = 1.12 (95% CI 0.73, 1.70), and aORQ5 vs. Q1 = 1.44 (95% CI 0.92, 2.26). Our results suggest that a low dairy intake during pregnancy is not associated with an increased risk of SGA; possibly due to the low consumption of dairy in both groups.