Dementia affects millions of individuals worldwide, yet there are no effective treatments. Alzheimer's disease, the most common form of dementia, is characterized by amyloid and tau pathology with amyloid accumulation thought to precipitate tau pathology, neurodegeneration, and dementia. The Religious Orders Study and Memory and Aging Project (ROSMAP) cohort is a unique resource with quantitative pathology from multiple brain regions, RNA sequencing, and longitudinal cognitive data. Our previous work applying machine learning to the RNA sequencing data identified lactoferrin (LTF) as the gene most predictive of amyloid accumulation with a potential amyloidogenic mechanism identified in vitro and with cell-culture models. In the present study, we examined which pathologies and genes were related to cognitive status (dementia, mild impairment, and no cognitive impairment) and rate of cognitive decline. Tau load in the anterior cingulate and ADAMTS2, encoding a metallopeptidase, were the respective regional pathology and gene most associated with cognitive decline, while PRTN3, encoding a serine protease, was the key protective feature. ADAMTS2, but not PRTN3, was related to amyloid and tau load in the previous study while LTF was not related to cognitive decline here. These findings confirm a general relationship between tau pathology and dementia, show the specific importance of tau pathology in the anterior cingulate cortex and identify ADAMTS2 as a potential target for slowing cognitive decline.