CS 3710 / ISSP 3565: ADVANCED TOPICS IN ARTIFICIAL INTELLIGENCE (Fall 2012)

NATURAL LANGUAGE PROCESSING FOR EXTRACTING SOCIAL AND INTERACTIONAL MEANING (CS 3710 / ISSP 3565: Advanced Topics in Artificial Intelligence, Fall 2012)
Instructor	Diane Litman
Where & When	Tuesday and Thursdays 11:30-12:45, SENSQ 6329 (Board Room) *NOTE ROOM CHANGE*
Office Hours	After class or by appointment
Description	Many interactions are increasingly recorded online in text and speech. This course introduces computational methods for analyzing social and interactional meaning from natural language data. Topics to be studied included the detection of emotion (angry, happy), personality (extrovert, introvert), medical states (depressed), style (flirtatious, polite), power (supervisor, employee), intention (deception). Data to be examined will come from online reviews, blogs, email, twitter, dating sites and other social media, as well as from more traditional communication modes. Students will lead one or more class discussions, participate in the other discussions, and complete a group (2-3 people) course project. Prerequisites: Natural Language Processing OR consent of the instructor *NOTE CHANGE*
Required Work	Group Course Project (45%): proposal/progress: 10%, presentation: 10%, report: 25% Class Presentations of Topics (25%): leading 2 classes 20%, presenting 2 optional papers: 5% Commentaries on other Readings (25%): due 11:00am the day before Homeworks (5%): due 11:59pm the night before

` `

Date/Lead	Materials	Topic and Readings
August 28 Litman	NB (CHI 2012) Homework	Welcome and Adminstration Emiel Krahmer. 2010. Last Words: What Computational Linguists Can Learn from Psychologists (and Vice Versa). Computational Linguistics 36:2.
August 30 Litman	Slides	Speech: Fundamentals Jurafsky and Martin. 2009. Speech and Language Processing: Acoustics (Sections 7.4.1-7.4.3, pages 230-235), Prosody (Section 8.3, pages 262-271), and ASR Feature Extraction (Section 9.3 introduction, page 295)
September 4 Litman	Homework Commentary Instructions Optional Paper Instructions Presentation Instructions	Speech: Fundamentals (continued)
September 6 Litman	Slides Homework	Emotion: Theory, and Case Studies in Speech Scherer, K. R. 2003. Vocal communication of emotion: A review of research paradigms. Speech Communication 40:1-2, 227-256. J. Ang, R. Dhillon, A. Krupski, E. Shriberg, and A. Stolcke. 2002. Prosody-Based Automatic Detection of Annoyance and Frustration in Human-Computer Dialog. In INTERSPEECH-02. Optional: Ekman, Paul. 1993. Facial Expressions Of Emotion. American Psychologist 48:384-392.
September 11 No class (Interspeech Conference)	Work on homework	Lab for Praat, Twitter, Linguistic Inquiry Word Count Praat: http://www.fon.hum.uva.nl/praat/ http://www.fon.hum.uva.nl/praat/manual/Intro.html Optional PRAAT resources: http://www.helsinki.fi/~lennes/praat-scripts/ http://uk.groups.yahoo.com/group/praat-users/ http://www.linguistics.ucla.edu/faciliti/facilities/acoustic/praat.html Twitter APIs Lexical resources: LIWC WordNet-Affect Optional LIWC Readings: Pennebaker, J.W., Booth, R.E., & Francis, M.E. 2007. Linguistic Inquiry and Word Count: LIWC2007 - Operator's manual. Pennebaker, J.W., Chung, C.K., Ireland, M., Gonzales, A., & Booth, R.J. 2007.The development and psychometric properties of LIWC2007. NPR's Health Blog, 2012. To Predict Dating Success, The Secret's In The Pronouns.
September 13 Conrad	Interspeech 2010 Paralinguistic Challenge	Emotion: Recent Work in Speech and Text Jeon, Je Hun / Xia, Rui / Liu, Yang. 2010. Level of interest sensing in spoken dialog using multi-level fusion of acoustic and lexical evidence. Proc. INTERSPEECH, pp. 2802-2805. S. Mohammed. 2012. Portable Features for Classifying Emotional Text. Proc. Conf. of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 587-591. Optional (Pham): Braun, Angelika and Matthias Katerbow. 2005. Emotions in dubbed speech: An intercultural approach with respect to F0. Interspeech 2005.
September 18 Rahimi	Short paper review form	Sarcasm Tepperman, Joseph, David Traum, and Shrikanth Narayanan. 2006. Yeah right: Sarcasm recognition for spoken dialogue systems. ICSLP 2006. D. Davidov, O. Tsur, and A. Rappoport. 2010. Semi-supervised recognition of sarcastic sentences in Twitter and Amazon. Proc. of the Fourteenth Conference on Computational Natural Language Learning, pp. 107-116. Optional (Hashemi): R. Gonzalez-Ibanez, S. Muresan, and N. Wacholder. 2011. Identify Sarcasm in Twitter: A Closer Look. Proc. of the 49th Annual Meeting of the Association for Computational Linguistics:shortpapers, pp. 581-586.
September 20 Pham		Psychological Word Use Approaches; Computational Approaches to Medical State: Depression Pennebaker, J., Mehl, M., and Niederhoffer, K. 2003. Psychological Aspects of Natural Language Use: Our Words, Our Selves. Annu. Rev. Psychol 54, 547-77. Ramirez-Esparza, N., Chung, C.K., Kacewicz, E. and Pennebaker, J.W. 2008. The psychology of word use in depression forums in English and in Spanish: Testing two text analytic approaches. International Conference on Weblogs and Social Media, Seattle, WA. Optional (Nguyen): Jha and Elhadad. 2010. Cancer stage prediction based on patient online discourse. Workshop on Biomedical Natural Language Processing
September 25 Deng	Alcohol Language Corpus Interspeech 2011 Intoxication and Sleepiness Challenge	Computational Approaches to Medical States/Mood J. Hirschberg, A. Hjalmarsson, and N. Elhadad. 2010. "You're as Sick as You Sound": Using Computational Approaches for Modeling Speaker State to Gauge Illness and Recovery. Advances in Speech Recognition: Mobile Environments, Call Centers, and Clinics, A. Neustein (ed.). Krisztian Balog; Gilad Mishne; Maarten de Rijke. 2006. Why Are They Excited? Identifying and Explaining Spikes in Blog Mood Levels. 11th Conference of the European Chapter of the Association for Computational Linguistics. Optional (Zhang): Michael Levit , Richard Huber , Anton Batliner , Elmar Noth. 2001. Use of prosodic speech characteristics for automated detection of alcohol intoxication. Proc. of the Workshop on Prosody and Speech Recognition.
September 27 Mayfield	Project Instructions More evidence that sarcasm recognition is hard	Other Medical States Kai Hong; Christian G. Kohler; Mary E. March; Amber A. Parker; Ani Nenkova. 2012. Lexical Differences in Autobiographical Narratives from Schizophrenic Patients and Healthy Controls. Proc. Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning Jun-Ming Xu; Kwang-Sung Jun; Xiaojin Zhu; Amy Bellmore. 2012. Learning from Bullying Traces in Social Media. Proc. Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Optional (Choi): Colin Cherry, Saif Mohammad, and Berry de Bruijn. 2012. Binary Classifiers and Latent Sequence Models for Emotion Detection in Suicide Notes. Journal of Biomedical Informatics Insights, 5 (Suppl. 1), pp. 147-154.
October 2 Thomason		Interpersonal Stance Rajesh Ranganath, Dan Jurafsky, and Dan McFarland. 2012. Detecting friendly, flirtatious, awkward, and assertive speech in speed-dates. Computer Speech and Language, in press proof. Optional (Conrad): D. Bracewell, M. Tomlinson, H. Wang. 2012. A Motif Approach for Identifying Pursuits of Power in Social Discourse. ICSC.
October 4 Zhang		Charisma and Speaker Traits Andrew Rosenberg and Julia Hirschberg. 2009. Charisma Perception from Text and Speech. Speech Communication, 51-7, pp. 563-656. Optional (Mayfield): Kim, Kuman, Tsiartas, Li, and Narayanan. 2012. Intelligibility Classification of Pathological Speech Using Fusion of Multiple Subsystems, Interspeech Speaker Trait Challenge
October 9		No Class (Pitt Monday classes on Tuesdays)
October 11 Choi	Homework Predicting Suicide Intent DARPA Workshop	Personality in Text and Conversation F. Mairesse, M. Walker, M. Mehl, and R. Moore. 2007. Using linguistic cues for the automatic recognition of personality in conversation and text. Journal of Artificial Intelligence Research (JAIR), 30:457-500. Optional (Wang): Jon Oberlander; Scott Nowson. 2006. Whose Thumb Is It Anyway? Classifying Author Personality from Weblog Text. Proc. 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics
October 16 Thomason		Accommodation (one of many terms) Jennifer S. Pardo. 2006. On phonetic convergence during conversational interaction. JASA 119 (4) 2382-2393. Optional (Deng): Niederhoffer, Kate G. and James W. Pennebaker. 2002. Linguistic Style Matching in Social Interaction. Journal of Language and Social Psychology 21, 4: 337-360. For your reference: Howard Giles, Justine Coupland, and Nikolas Coupland. 1991. Accommodation theory: Communication, context, and consequences. In Accommodation theory: Communication, context, and consequences. Cambridge University Press. Read pages 7-21.
October 18 Luo	Map Task Homepage	Accommodation (mostly text): Computational Approaches Danescu-Niculescu-Mizil, Cristian, Michael Gamon, and Susan Dumais. 2011. Mark my words! Linguistic style accommodation in social media. Proceedings of WWW. Christopher M. Mitchell; Kristy Elizabeth Boyer; James C. Lester. 2012. From Strangers to Partners: Examining Convergence within a Longitudinal Study of Task-Oriented Dialogue. Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue. Optional (Conrad) David Reitter and Johanna D. Moore. 2007. Predicting success in dialogue. Proc. 45th Annual Meeting of the Association of Computational Linguistics, pages 808-815.
October 23 Nguyen		Accommodation (mostly speech): Computational Approaches Rivka Levitan; Agustin Gravano; Laura Willson; Stefan Benus; Julia Hirschberg; Ani Nenkova. 2012. Acoustic-Prosodic Entrainment and Social Behavior . Proc. Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies Mahaveer Jain; John McDonough; Gahgene Gweon; Bhiksha Raj; Carolyn Penstein Rose. 2012. An Unsupervised Dynamic Bayesian Network Approach to Measuring Speech Style Accommodation. Proc. 13th Conference of the European Chapter of the Association for Computational Linguistics. Optional (Thomason) H. Friedberg, D. Litman, and S. Paletz. 2012 (to appear). Lexical Entrainment and Success in Student Engineering Groups. Proceedings Fourth IEEE Workshop on Spoken Language Technology (SLT).
October 25 Mayfield		Positioning and Authority: Power Cristian Danescu-Niculescu-Mizil, Lillian Lee, Bo Pang and Jon Kleinberg. 2012. Echoes of power: Language effects and power differences in social interaction. Proceedings of WWW. N. Garg, S. Favre, H. Salamin, D. Hakkani-Tur, and A. Vinciarelli. 2008. Role recognition for meeting participants: an approach based on lexical information and social network analysis. Proc. ACM International Conference on Multimedia, 693-696. Optional (Luo) S. Paletz and C. Schunn. 2011. Assessing group-level participation in fluid teams: Testing a new metric. Behav Res 43:522-536.
October 30 Conrad	Enron Corpus	Positioning and Authority: Power P. Bramsen, M. Escobar-Molano, A. Patel and R. Alonso, 2011. Extracting Social Power Relationships from Natural Language, Proc. ACL HLT. Vinodkumar Prabhakaran; Owen Rambow; Mona Diab. 2012. Predicting Overt Display of Power in Written Dialogs. Proc. Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Optional (Deng) Martin, Zhang, Ostendorf. 2011. Detecting Forum Authority Claims in Online Discussions. Proc. LSM.
November 1 Wang		Influence (Positioning and Authority, continued); Virality/Memorability Cha, Meeyoung, Hamed Haddadi, Fabricio Benevenuto, and Krishna P. Gummadi. 2010. Measuring user influence in Twitter: The million follower fallacy. Proc. ICWSM. Yoav Artzi; Patrick Pantel; Michael Gamon. 2012. Predicting Responses to Microblog Posts . Proc. Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Optional (Choi) Bakshy, Eitan, Jake M. Hofman, Winter A. Mason, and Duncan J. Watts. 2011. Everyone's an influencer: Quantifying influence on Twitter. Proceedings of WSDM.
November 6 Hashemi	MemeTracker	Influence (Positioning and Authority, continued); Virality/Memorability Or Biran, Sara Rosenthal, Jacob Andreas, Kathleen McKeown, and Owen Rambow. 2012. Detecting influencers in written online conversations. Proc. of the Language in Social Media 2012 Workshop. Cristian Danescu-Niculescu-Mizil; Justin Cheng; Jon Kleinberg; Lillian Lee. 2012. You Had Me at Hello: How Phrasing Affects Memorability. Proc. 50th Annual Meeting of the Association for Computational Linguistics. Optional (Nguyen) Danescu-Niculescu-Mizil, Cristian, Kossinets, Gueorgi, Kleinberg, Jon, and Lee, Lillian. 2009. How opinions are received by online communities: A case study on Amazon.com helpfulness votes. Proc. WWW. pp. 141-150.
November 8 Zhang		Business or Personal? (genre as formality) Sanaz Jabbari; Ben Allison; David Guthrie; Louise Guthrie. 2006. Towards the Orwellian Nightmare: Separation of Business and Personal Emails Proc. 21st International Conference on Computational Linguistics and 44th Annual Meeting of the Association for Computational Linguistics. Anthony Stark; Izhak Shafran; Jeffrey Kaye. 2012. Hello, Who is Calling?: Can Words Reveal the Social Nature of Conversations?. Proc Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. Optional (Pham): Peterson, Hohensee, and Xia. 2011. Email Formality in the Workplace: A Case Study on the Enron Corpus. Proc. LSM.
November 13 Choi		Politeness Manaal Faruqui; Sebastian Pado. 2012. Towards a model of formal and informal address in English.. Proc. 13th Conference of the European Chapter of the Association for Computational Linguistics. William Yang Wang; Samantha Finkelstein; Amy Ogan; Alan W. Black; Justine Cassell. 2012. "Love ya, jerkface": Using Sparse Log-Linear Models to Build Positive and Impolite Relationships with Teens. Proc. 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue. Optional (Wang): W. Lewis Johnson and Paola Rizzo. 2004. Politeness in Tutoring Dialogs: "Run the Factory, That's What I'd Do". Proc. ITS.
November 15 Luo	CSC corpus	Deception: An Introduction, and Speech B. DePaulo, J. Lindsay, B. Malone, L. Muhlenbruck, K. Charlton, and H. Cooper. 2003. Cues to Deception. Psychological Bulletin 19:1, pp. 74-118. Julia Hirschberg, Stefan Benus, Jason M. Brenier, Frank Enos, Sarah Friedman, Sarah Gilman, Cynthia Girand, Martin Graciarena, Andreas Kathol, Laura Michaelis, Bryan Pellom, Elizabeth Shriberg, Andreas Stolcke. 2005. Distinguishing deceptive from non-deceptive speech. Proc. Eurospeech. Optional (Zhang) J. Hirschberg. 2010. Deceptive Speech: Clues from Spoken Language. Speech Technology. 79-88.
November 20 Pham	Workshop on Computational Approaches to Deception Detection, EACL 2012 Workshop on Vision(s) on Deception and Non-Cooperation, FG 2013	Deception in Text Joan Bachenko; Eileen Fitzpatrick; Michael Schonwetter. 2008. Verification and Implementation of Language-Based Deception Indicators in Civil and Criminal Narratives. Proc. 22nd International Conference on Computational Linguistics (Coling). Rada Mihalcea; Carlo Strapparava. 2009. The Lie Detector: Explorations in the Automatic Recognition of Deceptive Language. Proc. Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP. (Short Papers) Optional (Rahimi) Christie M. Fuller, David P. Biros, Dursun Delen. 2011. An investigation of data and text mining methods for real world deception detection. Expert Systems with Applications.
November 27 Nguyen	Don't Rely on Web Reviews of Hotels NY Times	Deception in Text Myle Ott; Yejin Choi; Claire Cardie; Jeffrey T. Hancock. 2011. Finding Deceptive Opinion Spam by Any Stretch of the Imagination. Proc. 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies. Song Feng; Ritwik Banerjee; Yejin Choi. 2012. Syntactic Stylometry for Deception Detection. Proc. 50th Annual Meeting of the Association for Computational Linguistics (Short Papers). Optional (Luo): M. Newman, J. Pennebaker, D. Berry, and J. Richards. 2003. Lying words: Predicting deception from linguistic styles. Personality and Social Psychology Bulletin, 29:665--675.
November 29 Wang		Biographic Attributes: Gender Boulis and M. Ostendorf, 2005. A quantitative analysis of lexical differences between genders in telephone conversations, Proc. ACL. John D. Burger; John Henderson; George Kim; Guido Zarrella. 2011. Discriminating Gender on Twitter. Proc. Conference on Empirical Methods in Natural Language Processing. Optional (Mayfield) Philip Gianfortoni, David Adamson, and Carolyn Rose. 2011. Modeling of Stylistic Variation in Social Media with Stretchy Patterns. EMNLP 2011 workshop
December 4 Rahini		Other Biographic (Age) and Demographic Attributes Sara Rosenthal and Kathleen McKeown. 2011. Age prediction in blogs: A study of style, content, and online behavior in pre- and post-social media generations. Proc. ACL-HLT. Jacob Eisenstein, Noah A. Smith, and Eric P. Xing. 2011. Discovering Sociolinguistics Associations with Structured Sparsity. Proc. Annual Meeting of the Association for Computational Linguistics. Optional (Hashemi): Mukherjee, A. and Liu, B. 2010. Improving gender classification of blog authors. Proc. conference on Empirical Methods in Natural Language Processing.
December 6 Deng		Other Biographic (Age) and Demographic Attributes N. Garera and D. Yarowsky. 2009. Modeling Latent Biographic Attributes in Conversational Genres. Proc. 47th ACL and 4th IJCNLP. K. Georgila, M. Wolters, J. Moore. 2010. Learning Dialogue Strategies from Older and Younger Simulated Users. Proc. Sigdial. Optional (Thomason) J. Schler, M. Koppel, S. Argamon, and J. Pennebaker. 2006. Effects of age and gender on blogging. Proceedings of the AAAI Spring Symposia on Computational Approaches to Analyzing Weblogs.
December 11 Hashemi		Biographic Attributes: Gender Katja Filippova. 2012. User Demographics and Language in an Implicit Social Network . Proc. Joint Conference on Empirical Methods in Natural Language Processing and Computational Natural Language Learning. Adam Vogel; Dan Jurafsky. 2012. He Said, She Said: Gender in the ACL Anthology. ACL Special Workshop on Rediscovering 50 Years of Discoveries. Optional (Rahimi) Ruchita Sarawgi; Kailash Gajulapalli; Yejin Choi. 2011. Gender Attribution: Tracing Stylometric Evidence Beyond Topic and Genre. Proc. Fifteenth Conference on Computational Natural Language Learning.
December 13		Project Presentations

Acknowledgements: Inspiration for this course came from the syllabi of Profs. Hirschberg, Jurafsky and Lee.