People with Down syndrome (DS) have a neurodevelopmentally distinct brain and invariably developed amyloid neuropathology by age 50. This cross-sectional study aimed to provide a detailed account of DS brain morphology and the changes occuring with amyloid neuropathology. Forty-six adults with DS underwent structural and amyloid imaging-the latter using Pittsburgh compound B (PIB) to stratify the cohort into PIB-positive (n = 19) and PIB-negative (n = 27). Age-matched controls (n = 30) underwent structural imaging. Group differences in deep gray matter volumetry and cortical thickness were studied. PIB-negative people with DS have neurodevelopmentally atypical brain, characterized by disproportionately thicker frontal and occipitoparietal cortex and thinner motor cortex and temporal pole with larger putamina and smaller hippocampi than controls. In the presence of amyloid neuropathology, the DS brains demonstrated a strikingly similar pattern of posterior dominant cortical thinning and subcortical atrophy in the hippocampus, thalamus, and striatum, to that observed in non-DS Alzheimer's disease. Care must be taken to avoid underestimating amyloid-associated morphologic changes in DS due to disproportionate size of some subcortical structures and thickness of the cortex.