The global pandemic of COVID-19 revealed the dynamic heterogeneity in how individuals respond to infection risks, government orders, and community-specific social norms. Here we demonstrate how both individual observation and social learning are likely to shape behavioral, and therefore epidemiological, dynamics over time. Efforts to delay and reduce infections can compromise their own success, especially when disease risk and social learning interact within sub-populations, as when people observe others who are (a) infected and/or (b) socially distancing to protect themselves from infection. Simulating socially-learning agents who observe effects of a contagious virus, our modelling results are consistent with with 2020 data on mask-wearing in the U.S. and also concur with general observations of cohort induced differences in reactions to public health recommendations. We show how shifting reliance on types of learning affect the course of an outbreak, and could therefore factor into policy-based interventions incorporating age-based cohort differences in response behavior.