Lesson 6: Social Intelligence

Social cognition is at the core of human intelligence. Social interactions are the source of much of human knowledge and a large part of everyday human activity. Social behaviour also engages a large part of the neural circuitry in the brain and has driven the evolution of the human brain beyond its primate origins. In this unit, you will learn about the neural and perceptual basis of social cognition, and powerful quantitative methods for analyzing fMRI data to probe the neural mechanisms underlying tasks such as inferring the mental states of others.

image

fMRI studies conducted by Nancy Kanwisher, Rebecca Saxe, and colleagues reveals subregions of area STS in the human brain, roughly portrayed here, that are engaged in aspects of social cognition such as Theory of Mind, voice perception, language, and face analysis. (Image courtesy of Nancy Kanwisher, used with permission.)

Nancy Kanwisher touches upon research at the Center for Brains, Minds, and Machines that explores central aspects of social intelligence, such as the recognition of faces, emotions and direction of gaze; use of subtle body cues to predict an agent’s actions; and identification of specialized brain regions for social cognition.

Ken Nakayama first draws parallels between social behavior in humans and animals, and then explores in depth, the ability of humans to recognize faces and to rapidly exploit subtle visual cues to predict the actions of other agents.

In Part 1 of Rebecca Saxe’s lecture, you will learn how fMRI studies led to the discovery of a brain region that is selectively engaged in tasks that elicit thoughts about the mental states of others, so-called Theory of Mind. You will also learn about correlation based methods for analyzing fMRI data.

The second part of Rebecca Saxe’s lecture shows how recent advances in fMRI analysis methods, such as Multivariate Pattern Analysis (MVPA), may provide a more detailed picture of how the brain encodes high-level cognitive information.

Unit Activities

Useful Background

  • Introductions to neuroscience and cognitive science
  • Background on the sociality of primates and its connection to intelligence, from Winrich Freiwald’s Lecture L1.5 in Unit 1: Neural Circuits of Intelligence.
  • An introduction to machine learning is useful for Part 2 of Rebecca Saxe’s lecture. View Tutorial T3.1 Machine Learning (Part1) by Lorenzo Rosasco.
1 Like

Lesson 6.1: Introduction to Social Intelligence


Description: Social cognition is the source of much of human intelligence and a major driver of evolution of the brain. Aspects of social intelligence such as face recognition; attention and gaze; recognizing actions, emotions, and social interactions.

Instructor: Nancy Kanwisher


Click here for the lesson transcript

Click here for the lesson slides

Lesson 6.2: The Social Mind


Description: Aspects of human intelligence arising from complex social environments. Early theories of social cognition by Humphreys and Dennett, group social behaviors in animals, variation in human face recognition ability, rapid detection of human actions.

Instructor: Ken Nakayama


Click here for the lesson transcript

Click here for the lesson slides

Lesson 6.3: MVPA: Window on the Mind via fMRI Part 1


Description: Theory of Mind, thinking about others’ thoughts, using false belief tasks in moral judgments, cognitive development of belief perception and Theory of Mind, the role of the rTPJ, Multi Voxel Pattern Analysis of fMRI data with Haxby-style correlations.

Instructor: Rebecca Saxe


Click here for the lesson transcript

Click here for the lesson slides

Lecture 6.4: MVPA: Window on the Mind via fMRI Part 2


Description: Using MVPA to study the neural mechanisms underlying thinking about thoughts (Theory of Mind) and moral judgments, while assessing variation between within-condition and between-condition correlations in fMRI data.

Instructor: Rebecca Saxe


Click here for the lesson transcript

Further Study

Additional information about the speakers’ research and publications can be found at their websites:

Deen, B., K. Koldewyn, et al. “Functional Organization of Social Perception and Cognition in the Superior Temporal Sulcus.” Cerebral Cortex 25, no. 11 (2015): 4596–4609.

Duchaine, B., and K. Nakayama. “The Cambridge Face Memory Test: Results for Neurologically Intact Individuals and an Investigation of its Validity Using Inverted Face Stimuli and Prosopagnosic Participants.” Neuropsychologia 44, no. 4 (2006): 576–85.

Koster-Hale, J., and R. Saxe. This resource may not render correctly in a screen reader.“Theory of Mind: A Neural Prediction Problem.” (PDF) Neuron 79 (2013): 836–48.

Koster-Hale, J., M. Bedny, et al. This resource may not render correctly in a screen reader.“Thinking About Seeing: Perceptual Sources of Knowledge are Encoded in the Theory of Mind Brain Regions of Sighted and Blind Adults.” (PDF - 1.2MB) Cognition 133 (2014): 65–78.

Peterson, M. F., J. Lin, et al. This resource may not render correctly in a screen reader.“Individual Differences in Face Looking Behavior Generalize from the Lab to the World.” (PDF - 62.7MB) Journal of Vision 16, no. 7 (2016): 1–18.

Skerry, A. E., and R. Saxe. This resource may not render correctly in a screen reader.“Neural Representations of Emotion are Organized Around Abstract Event Features.” (PDF - 2.1MB) Current Biology 15 (2015): 1–10.

Vaziri-Pashkam, M., S. Cormiea, et al. This resource may not render correctly in a screen reader.“Predicting Actions Before They Occur.” (PDF - 1.4MB) Center for Brains, Minds & Machines , Memo No. 038 (2015).