Genetically identical individuals in bacterial populations can display significant phenotypic variability. This variability can be functional, for example by allowing a fraction of stress prepared cells to survive an otherwise lethal stress. The optimal fraction of stress prepared cells depends on environmental conditions. However, how bacterial populations modulate their level of phenotypic variability remains unclear. Here we show that the alternative sigma factor σV circuit in Bacillus subtilis generates functional phenotypic variability that can be tuned by stress level, environmental history and genetic perturbations. Using single-cell time-lapse microscopy and microfluidics, we find the fraction of cells that immediately activate σV under lysozyme stress depends on stress level and on a transcriptional memory of previous stress. Iteration between model and experiment reveals that this tunability can be explained by the autoregulatory feedback structure of the sigV operon. As predicted by the model, genetic perturbations to the operon also modulate the response variability. The conserved sigma-anti-sigma autoregulation motif is thus a simple mechanism for bacterial populations to modulate their heterogeneity based on their environment.