While much previous work linking fertility history with late-life cognition has focused on a narrow set of cognitive measures and/or has used modest sample sizes in the analysis, our paper expands the size and scope of these linkages by analyzing cognitive function across five domains and precisely estimating gendered patterns between men and women. Results point to important gendered associations between parity and cognition: having children is likely associated with better cognitive function for fathers in all five domains. However, mothers show worse cognitive function in some domains (i.e., numeric memory, prospective memory, and fluid intelligence) than childless women. We explore the possibility of confounding in these associations and rule out the effects of genetic cognitive ability on fertility. We also find that adding controls for educational attainment differ by gender-strengthening associations between parity and cognition for men and largely eliminating them for women. The findings support previous work done on how life course contexts may link to the risk of dementia or cognitive impairment, highlighting parity as potential protective or risk factors to parents' cognitive health. The use of five cognitive domains yields variations in results, giving implications on measure selection of cognitive function and calling for replicated work covering more cognitive domains.