The detection of threat is a role that the amygdala plays well, evidenced by its increased response to fearful faces in human neuroimaging studies. A critical element of the fearful face is an increase in eye white area (EWA), hypothesized to be a significant cue in activating the amygdala. However, another important social signal that can increase EWA is a lateral shift in gaze direction, which also serves to orient attention to potential threats. It is unknown how the amygdala differentiates between these increases in EWA and those that are specifically associated with fear. Using functional magnetic resonance imaging, we show that the left amygdala distinguished between fearful eyes and gaze shifts despite similar EWA increases whereas the right amygdala was less discriminatory. Additional analyses also revealed selective hemispheric response patterns in the left fusiform gyrus. Our data show clear hemispheric differences in EWA-based fear activation, suggesting the existence of parallel mechanisms that code for emotional face information.