Genetically identical plants growing in the same conditions can display heterogeneous phenotypes. Here we use Arabidopsis seed germination time as a model system to examine phenotypic variability and its underlying mechanisms. We show extensive variation in seed germination time variability between Arabidopsis accessions and use a multiparent recombinant inbred population to identify two genetic loci involved in this trait. Both loci include genes implicated in modulating abscisic acid (ABA) sensitivity. Mutually antagonistic regulation between ABA, which represses germination, and gibberellic acid (GA), which promotes germination, underlies the decision to germinate and can act as a bistable switch. A simple stochastic model of the ABA-GA network shows that modulating ABA sensitivity can generate the range of germination time distributions we observe experimentally. We validate the model by testing its predictions on the effects of exogenous hormone addition. Our work provides a foundation for understanding the mechanism and functional role of phenotypic variability in germination time.