Mice react differently to others’ stress depending on their own past experience of the same (but not different) stress. Corticotropin-releasing factor (CRF) neuron activity in the medial prefrontal cortex (mPFC) specifically modulates the influence of affective past experience on emotional reactions to others, which was estrus-dependent in females and dominance-dependent in males.