Investigating the most likely causal variants identified by fine-mapping analyses may improve the power to detect gene-environment interactions. We assessed the interplay between 70 single nucleotide polymorphisms identified by genetic fine-scale mapping of susceptibility loci and 11 epidemiological breast cancer risk factors in relation to breast cancer. Analyses were conducted on up to 58,573 subjects (26,968 cases and 31,605 controls) from the Breast Cancer Association Consortium, in one of the largest studies of its kind. Analyses were carried out separately for estrogen receptor (ER) positive (ER+) and ER negative (ER-) disease. The Bayesian False Discovery Probability (BFDP) was computed to assess the noteworthiness of the results. Four potential gene-environment interactions were identified as noteworthy (BFDP < 0.80) when assuming a true prior interaction probability of 0.01. The strongest interaction result in relation to overall breast cancer risk was found between CFLAR-rs7558475 and current smoking (OR  = 0.77, 95% CI: 0.67-0.88, p  = 1.8 × 10$\mathrm{<mrow\; data-mjx-texclass="ORD">-4</mrow>}$. The interaction with the strongest statistical evidence was found between 5q14-rs7707921 and alcohol consumption (OR =1.36, 95% CI: 1.16-1.59, pint  = 1.9 × 10$\mathrm{<mrow\; data-mjx-texclass="ORD">-5</mrow>}$ in relation to ER- disease risk. The remaining two gene-environment interactions were also identified in relation to ER- breast cancer risk and were found between 3p21-rs6796502 and age at menarche (OR  = 1.26, 95% CI: 1.12-1.43, pint =1.8 × 10$\mathrm{<mrow\; data-mjx-texclass="ORD">-5</mrow>}$ and between 8q23-rs13267382 and age at first full-term pregnancy (OR  = 0.89, 95% CI: 0.83-0.95, p  = 5.2 × 10$\mathrm{<mrow\; data-mjx-texclass="ORD">-4</mrow>}$. While these results do not suggest any strong gene-environment interactions, our results may still be useful to inform experimental studies. These may in turn, shed light on the potential interactions observed.