Cognitive behavior inevitably recruits activity of multiple brain regions. However, it is unclear how neuronal activity of multiple regions is temporally coordinated. Here we simultaneously recorded neuronal activity from four associative brain regions [medial prefrontal cortex (mPFC), premotor cortex (M2), medio-dorsal thalamus (MD) and dorso-medial caudate putamen (dmCP)] of mice performing olfactory working memory tasks. Global network states can be defined by correlation and trajectory analysis from neuronal activity of these regions. We found strong correlation between the baseline global states before sensory delivery and those in sensory-delivery, delay, or decision-making periods. The baseline global network state is also gradually modulated through training and the degree is correlated with behavioral performance. Furthermore, behavior-related neuronal coding and performance are impaired by optogenetic perturbation of mPFC baseline activity that can modify initial condition of global network state. Thus the baseline state of global neuronal activity is important in orchestrating global neuronal dynamics in performing cognitive behavior.