Vitamin D deficiency and physical inactivity have been associated with bone loss and fractures, but their combined effect has scarcely been studied either in younger or older adults. Therefore, we aimed to assess the associations between physical activity, age and 25-hydroxyvitamin D (25(OH)D) status separately and in combination with the incidence of fracture risk in the EPIC-Norfolk cohort study. Baseline (1993-1998) self-reported physical activity and serum 25(OH)D concentrations at follow-up (1998-2000) were collected in 14,624 men and women (aged 42-82 y between 1998 and 2000). Fracture incidence was ascertained up to March 2015. Cox proportional hazard model was used to determine HRs of fractures by plasma 25(OH)D (<30, 30 to <50, 50 to <70, 70 to <90, >90 nmol/L), age (<65 y and >65 y) and physical activity (inactive and active) categories, by follow-up time per 20 nmol/L increase in serum 25(OH)D and to explore age-25(OH)D and physical activity-25(OH)D interactions. The age-, sex-, and month-adjusted HRs (95% CIs) for all fractures (1183 fractures) by increasing vitamin D category were not significantly different. With additional adjustment for body mass index, smoking status, alcohol intake, supplement use and history of fractures, the fracture risk was 29% lower in those participants with 50 to 70 nmol/L compared with those in the lowest quintile (<30 nmol/L). Physical inactivity based on a single baseline assessment was not associated with fracture risk. Vitamin D status appeared inversely related to fractures in middle aged adults. In older adults, the relationship between vitamin D status and fracture risk was observed to be J-shaped. Clinical and public health practice in vitamin D supplementation could partially explain these findings, although definitive conclusions are difficult due to potential changes in exposure status over the long follow up period.