Semantic cognition is a complex multifaceted brain function involving multiple processes including sensory, semantic, and domain-general cognitive systems. However, it remains unclear how these systems cooperate with each other to achieve effective semantic cognition. Here, we used independent component analysis (ICA) to investigate the functional brain networks that support semantic cognition. We used a semantic judgment task and a pattern-matching control task, each with 2 levels of difficulty, to disentangle task-specific networks from domain-general networks. ICA revealed 2 task-specific networks (the left-lateralized semantic network [SN] and a bilateral, extended semantic network [ESN]) and domain-general networks including the frontoparietal network (FPN) and default mode network (DMN). SN was coupled with the ESN and FPN but decoupled from the DMN, whereas the ESN was synchronized with the FPN alone and did not show a decoupling with the DMN. The degree of decoupling between the SN and DMN was associated with semantic task performance, with the strongest decoupling for the poorest performing participants. Our findings suggest that human higher cognition is achieved by the multiple brain networks, serving distinct and shared cognitive functions depending on task demands, and that the neural dynamics between these networks may be crucial for efficient semantic cognition.