Readings

LEC # TOPICS READINGS
1 Course introduction, visitors welcome  
2 Technologies for recognizing affect-related information

Buy at Amazon Picard, R. W. "Introduction, Chapter 1, and Chapter 3." In Affective Computing. Cambridge, MA: MIT Press, 2000. ISBN: 9780262661157.

Optional reading

Bechara, A., et al. "Deciding Advantageously Before Knowing the Advantageous Strategy." Science 275, no. 5304 (February 1997): 1293-1295. [doi: 10.1126/science.275.5304.1293]

3 Empathy and its measurement

Buy at Amazon Davis, M. H. "Empathy." In Handbook of the Sociology of Emotions. Edited by J. E. Stets, and J. H. Turner. New York, NY: Springer, 2006. ISBN: 9780387307138.

Marci, C. D., J. Ham, E. Moran, and S. P. Orr. "Physiologic Correlates of Perceived Therapist Empathy and Social-emotional Process During Psychotherapy." The Journal of Nervous and Mental Disease 195, no. 2 (2007): 103-111. (This resource may not render correctly in a screen reader.PDF)

Marci, C. D., E. K. Moran, and S. P. Orr. "Physiologic Evidence for the Interpersonal Role of Laughter During Psychotherapy." The Journal of Nervous and Mental Disease 192, no. 10 (2004): 689-695. (This resource may not render correctly in a screen reader.PDF)

Bargh, J., and T. L. Chartrand. "The Unbearable Automaticity of Being." American Psychologist 54, no. 7 (1999): 462-79.

4 How do you build empathetic technology? What happens when technology appears to show empathy? Picard leading

Bickmore, T., and D. Schulman. "Practical Approaches to Comforting users with Relational Agents." In CHI '07 Extended Abstracts on Human Factors in Computing Systems. New York, NY: ACM, 2007, pp. 2291-2296. ISBN: 9781595936424. [doi: 10.1145/1240866.1240996]

Klein, J., Y. Moon, and R. W. Picard. "This Computer Responds to User Frustration." In CHI '99 Extended Abstracts on Human Factors in Computing Systems. New York, NY: ACM, 1999, pp. 242-243. ISBN: 9781581131581. [doi: 10.1145/632716.632866]

Nass, C., et al. "Improving Automotive Safety by Pairing Driver Emotion and Car Voice Emotion." In CHI '05 Extended Abstracts on Human Factors in Computing Systems. New York, NY: ACM, 2005, pp. 1973-1976. ISBN: 9781595930026. [doi: 10.1145/1056808.1057070]

Picard, R. W., and K. K. Liu. "Relative Subjective Count and Assessment of Interruptive Technologies Applied to Mobile Monitoring of Stress." Int J Hum-Comput Stud 65, no. 4 (2007): 361-375. [doi: 10.1016/j.ijhcs.2006.11.019]

Supplemental readings

McQuiggan, S. W., and J. C. Lester. "Modeling and Evaluating Empathy in Embodied Companion Agents." Int J Hum-Comput Stud 65, no. 4 (2007): 348-360. (This resource may not render correctly in a screen reader.PDF)

Brave, S., C. Nass, and K. Hutchinson. "Computers that Care: Investigating the Effects of Orientation of Emotion Exhibited by an Embodied Computer Agent." Int J Hum-Comput Stud 62, no. 2 (2005): 161-178. [doi: 10.1016/j.ijhcs.2004.11.002]

5 Multi-modal affect recognition and recognition from facial expression

el Kaliouby, Rana. "Background." Chapter 2 in Mind-reading Machines: Automated Inference of Complex Mental States. PhD Thesis, University of Cambridge, 2005. (This resource may not render correctly in a screen reader.PDF - 23.8 MB)

Baron-Cohen, S., et al. "The 'Reading the Mind in the Eyes' Test Revised Version: A Study with Normal Adults, and Adults with Asperger Syndrome or High-Functioning Autism." J Child Psychol Psychiat 42, no. 2 (2001): 241-251. (This resource may not render correctly in a screen reader.PDF) [And take the associated eyes test.]

Wagner, J., et al. "From Physiological Signals to Emotions: Implementing and Comparing Selected Methods for Feature Extraction and Classification." Proceedings of ICME 2005: IEEE International Conference on Multimedia and Expo.

Pantic, M., and L. J. M. Rothkrantz. "Toward an Affect-Sensitive Multimodal Human-computer Interaction." Proceedings of the IEEE 91, no. 9 (September 2003): 1370-1390.

Supplemental readings

Kapoor, Ashish, Winslow Burleson, and Rosalind W Picard. "Automatic Prediction of Frustration." International Journal of Human-Computer Studies 65, no. 8 (August 2007): 724-736. [doi:10.1016/j.ijhcs.2007.02.003]

6 Reading emotions from facial expressions and emotion as a constructed process

Russell, J. A. "Is There Universal Recognition of Emotion from Facial Expression? A Review of the Cross-Cultural Studies." Psychol Bull 115, no. 1 (1994): 102-41. (This resource may not render correctly in a screen reader.PDF - 4.6 MB)

———. "Core Affect and the Psychological Construction of Emotion." Psychol Rev 110, no. 1 (2003): 145-72. (This resource may not render correctly in a screen reader.PDF)

Buy at Amazon Russell, J. A., and J. M. F. Dols. "What Does a Facial Expression Mean?" Chapter 1 in The Psychology of Facial Expression. New York, NY: Cambridge University Press, 1997. ISBN: 9780521587969. [Preview this chapter in Google Books.]

Carroll, J. M., and J. A. Russell. "Do Facial Expressions Signal Specific Emotions? Judging Emotion from the Face in Context." J Pers Soc Psychol 70, no. 2 (1996): 205-18. (This resource may not render correctly in a screen reader.PDF - 1.9 MB)

Carroll, J., and J. Russell. "Facial Expressions in Hollywood's Portrayal of Emotion." Journal of Personality and Social Psychology 72, no. 1 (1997): 164-176. (This resource may not render correctly in a screen reader.PDF - 1.3 MB)

7 Emotion regulation

Mauss, I. B., C. L. Cook, and J. J. Gross. "Automatic Emotion Regulation During an Anger Provocation." Journal of Experimental Social Psychology 43 (2007): 698-711. (This resource may not render correctly in a screen reader.PDF)

Tamir, M., C. Mitchell, and J. J. Gross. "Hedonic and Instrumental Motives in Anger Regulation." Psychological Science. (This resource may not render correctly in a screen reader.PDF) (in press).

Butler, E. A., F. H. Wilhelm, and J. J. Gross. "Respiratory Sinus Arrhythmia, Emotion, and Emotion Regulation During Social Interaction." Psychophysiology 3 (2006): 612-622. (This resource may not render correctly in a screen reader.PDF)

McRae, K., K. N. Ochnser, I. B. Mauss, J. J. D. Gabrielli, and J. J. Gross. "Gender Differences in Emotion Regulation: An fMRI study of Cognitive Reappraisal." Group Processes and Intergroup Relations. (This resource may not render correctly in a screen reader.PDF) (in press).

Allen, J. B., E. Harmon-Jones, and J. H. Cavender. "Manipulation of Frontal EEG Asymmetry Through Biofeedback Alters Self-reported Emotional Responses and Facial EMG." Psychophysiology 38 (2001): 685-693.

Supplemental readings

Lieberman, M. D., N. I. Eisenberger, M. J. Crockett, S. M. Tom, J. H. Pfeifer, and B. M. Way. "Putting Feelings in Words: Affect Labeling Disrupts Amygdala Activity to Affective Stimuli." Psychological Science 18 (2007): 421-428. (This resource may not render correctly in a screen reader.PDF)

Note: Don't stress too much about the fMRI data analysis sections in McRae et al. and Lieberman et al.

8 Cognitive-affective influences; creativity; detection of subtle affect

Forgas, J. P., and S. Moylan. "After the Movies: Transient Mood and Social Judgements." Personality and Social Psychology Bulletin 13, no. 4 (1987): 467-477.

Lerner, J. S., D. A. Small, and G. Loewenstein. "Heart Strings and Purse Strings: Carryover Effects of Emotions on Economic Decisions." (This resource may not render correctly in a screen reader.PDF)

Isen, A. M., K. A. Daubman, and G. P. Nowicki. "Positive Affect Facilitates Creative Problem Solving" Journal of Personality and Social Psychology 52 (1987): 1122-1131.

Isen, A. M., A. S. Rosenzweig, and M. J. Young. "The Influence of Positive Affect on Clinical Problem Solving." Medical Decision Making 11 (1991): 221-227.

Larson, K., and R. W. Picard. "The Aesthetics of Reading." (PDF) (Courtesy of Kevin Larson. Used with permission.)

Picard, R. W., and S. B. Daily. "Evaluating Affective Interactions: Alternatives to Asking What Users Feel." Presented at CHI 2005 Workshop on Evaluating Affective Interfaces: Innovative Approaches. (PDF)

9 Affect in patient-physician interactions

Frankel, R. M. "Emotion and the Physician-Patient Relationship." Motivation and Emotion 19, no. 3 (1995): 163-173.

Slack, W. V., and L. J. Van Cura. "Patient Reaction to Computer-based Medical Interviewing." Comput Biomed Res 1, no. 5 (May 1968): 527-31.

Robinson R, and R. West. "A Comparison of Computer and Questionnaire Methods of History-taking in a Genito-urinary Clinic." Psychol Health 6 (1992): 77-84.

Bickmore, T., A. Gruber, and R. Picard. "Establishing the Computer-Patient Working Alliance in Automated Health Behavior Change Interventions." Patient Educational Counseling 59, no. 1 (2005): 21-30. (This resource may not render correctly in a screen reader.PDF)

10 Potential concerns of affective computing research

Picard, R. W., and J. Klein. "Computers that Recognise and Respond to user Emotion: Theoretical and Practical Implications." Interacting with Computers 14 (2002): 141-169.

a. The "Little Emotional Controller" Story. I and A Research, Inc. February 19, 2001.

b. Desktop Computers to Counsel Users to Make Better Decisions. Sandia National Laboratories, January 22, 2004.

Tsiamyrtzis, P., J. Dowdall, D. Shastri, I. Pavlidis, M.G. Frank, and P. Eckman. "Lie Detection - Recovery of the Periorbital Signal through Tandem Tracking and Noise Suppression in Thermal Facial Video." Proceedings of SPIE ThermoSense 2005: Sensor Technologies, Orlando, Florida, March 27-30, 2005.

Picard, R. W. "Potential Concerns." Chapter 4 in Affective Computing.

Buy at Amazon Dumit, Joseph. "Ways of Seeing Brains as Expert Images." Chapter 4 in Picturing Personhood: Brain Scans and Biomedical Identity. Princeton, NJ: Princeton University Press, 2003, pp. 109-133. ISBN: 9780691113982.

Buy at Amazon Hacking, Ian. "Madness: Biological or constructed?" Chapter 4 in The Social Construction of What? Cambridge, MA: Harvard University Press, 2000, pp. 100-124. ISBN: 9780674004122.

Please choose to watch either one of these films

a. 2001: A Space Odyssey (148 mins.)
[Instead of watching the whole movie, you may read: Buy at Amazon Picard, R. W. "Does Hal Cry Digital Tears? Emotion and Computers." In Hal's Legacy. Edited by David G. Stork. Cambridge, MA: MIT Press, 1998. ISBN: 9780262692113.]

b. Artificial Intelligence: AI (145 mins.)
[If you wish, you can stop this one after 45-60min.]

11 New affective technology research directions

Please read these before the next class meeting. There is no written assignment this week in order to give you more time to focus on your class project.

Riskind, J. H. "They Stoop to Conquer: Guiding and Self Regulatory Functions of Physical Posture after Success and Failure." Journal of Personality and Social Psychology 47 (1984): 479-493.

Niedenthal, P. M., et al. "Embodying Emotion." Science 316 (2007): 1002-1005.

Ahn, H. I., A. Teeters, A. Wang, C. Breazeal, and R. W. Picard. "Stoop to Conquer: Posture and Affect Interact to Influence Computer users' Persistence." In The 2nd International Conference on Affective Computing and Intelligent Interaction. September 12-14, 2007, Lisbon, Portugal. (PDF)

12 Project presentations