Developing neural circuits are influenced by activity and are especially sensitive to changes in activity during critical periods (CPs) of development. Changes occurring during a CP often become 'locked in' so that they affect the mature network. Indeed, several neurodevelopmental disorders have been linked to excessive activity during such periods. It is, therefore, important to identify those aspects of neural circuit development that are influenced by neural activity during a CP. In this study, we take advantage of the genetic tractability of Drosophila to show that activity perturbation during an embryonic CP permanently alters properties of the locomotor circuit. Specific changes we identify include increased synchronicity of motoneuron activity and greater strengthening of excitatory over inhibitory synaptic drive to motoneurons. These changes are sufficient to reduce network robustness, evidenced by increased sensitivity to induced seizure. We also show that we can rescue these changes when increased activity is mitigated by inhibition provided by mechanosensory neurons. Similarly, we demonstrate a dose-dependent relationship between inhibition experienced during the CP and the extent to which it is possible to rescue the hyperexcitable phenotype characteristic of the parabss mutation. This suggests that developing circuits must be exposed to a properly balanced sum of excitation and inhibition during the CP to achieve normal mature network function. Our results, therefore, provide novel insight into how activity during a CP shapes specific elements of a circuit, and how activity during this period is integrated to tune neural circuits to the environment in which they will likely function.