Despite the reliability of intelligence measures in predicting important life outcomes such as educational achievement and mortality, the exact configuration and neural correlates of cognitive abilities remain poorly understood, especially in childhood and adolescence. Therefore, we sought to elucidate the factorial structure and neural substrates of child and adolescent intelligence using two cross-sectional, developmental samples (CALM: N = 551 (N = 165 imaging), age range: 5-18 years, NKI-Rockland: N = 337 (N = 65 imaging), age range: 6-18 years). In a preregistered analysis, we used structural equation modelling (SEM) to examine the neurocognitive architecture of individual differences in childhood and adolescent cognitive ability. In both samples, we found that cognitive ability in lower and typical-ability cohorts is best understood as two separable constructs, crystallized and fluid intelligence, which became more distinct across development, in line with the age differentiation hypothesis. Further analyses revealed that white matter microstructure, most prominently the superior longitudinal fasciculus, was strongly associated with crystallized (gc) and fluid (gf) abilities. Finally, we used SEM trees to demonstrate evidence for developmental reorganization of gc and gf and their white matter substrates such that the relationships among these factors dropped between 7-8 years before increasing around age 10. Together, our results suggest that shortly before puberty marks a pivotal phase of change in the neurocognitive architecture of intelligence.