The perception of infant emotionality, one aspect of temperament, starts to form in infancy, yet the underlying mechanisms of how infant emotionality affects adult neural dynamics remain unclear. We used a social reward task with probabilistic visual and auditory feedback (infant laughter or crying) to train 47 nulliparous women to perceive the emotional style of six different infants. Using functional neuroimaging, we subsequently measured brain activity while participants were tested on the learned emotionality of the six infants. We characterized the elicited patterns of dynamic functional brain connectivity using Leading Eigenvector Dynamics Analysis and found significant activity in a brain network linking the orbitofrontal cortex with the amygdala and hippocampus, where the probability of occurrence significantly correlated with the valence of the learned infant emotional disposition. In other words, seeing infants with neutral face expressions after having interacted and learned their various degrees of positive and negative emotional dispositions proportionally increased the activity in a brain network previously shown to be involved in pleasure, emotion, and memory. These findings provide novel neuroimaging insights into how the perception of happy versus sad infant emotionality shapes adult brain networks.