Papers
Swapna Somasundaran (2010). Discourse-Level Relations for Opinion Analysis. PhD Dissertation, Department of Computer Science, University of Pittsburgh.
Theresa Wilson (2008). Fine-Grained Subjectivity Analysis. PhD Dissertation, Intelligent Systems Program, University of Pittsburgh.
2012
Cem Akkaya, Janyce Wiebe, and Rada Mihalcea (2012). Utilizing Semantic Composition in Distributional Semantic Models for Word Sense Discrimination and Word Sense Disambiguation. Sixth IEEE International Conference on Semantic Computing (IEEE ICSC2012).
John P. Pestian, Pawel Matykiewicz, Michelle Linn-Gust, Brett South, Ozlem Uzuner, Jan Wiebe, Kevin B. Cohen, John Hurdle, Christopher Brew, Sentiment Analysis of Suicide Notes: A Shared Task. Biomedical Informatics Insights 2012:5 (Suppl. 1) 3-16
Mowery DL, Wiebe J, Visweswaran SH, Harkema H, Chapman WW. Building An Automated SOAP Classifier. Journal of Biomedical Informatics 45(1) (2012).
Conrad,Alexander, Wiebe, Janyce, and Hwa, Rebecca (2012). Recognizing Arguing Subjectivity and Argument Tags. ACL Workshop on Extra-propositional aspects of Meaning.
2011
Janyce Wiebe, Ellen Riloff, "Finding Mutual Benefit between Subjectivity Analysis and Information Extraction," IEEE Transactions on Affective Computing, pp. 175-191, October-December, 2011
Carmen Banea, Rada Mihalcea, and Janyce Wiebe (2011). Multilingual Sentiment and Subjectivity. In Multilingual Natural Language Processing, editors Imed Zitouni and Dan Bikel, Prentice Hall, 2011.
Cem Akkaya, Janyce Wiebe, Alexander Conrad, and Rada Mihalcea (2011). Improving the Impact of Subjectivity Word Sense Disambiguation on Contextual Opinion Analysis. CoNLL 2011.
Carmen Banea, Rada Mihalcea and Janyce Wiebe (2011). Sense-level Subjectivity in a Multilingual Setting. IJCNLP-2011 Workshop: Sentiment Analysis where AI meets Psychology 2011.
2010
Carmen Banea, Rada Mihalcea, and Janyce Wiebe. (2010). Multilingual Subjectivity: Are More Languages Better? COLING 2010.
Cem Akkaya, Alexander Conrad, Janyce Wiebe , and Rada Mihalcea (2010). Amazon Mechanical Turk for Subjectivity Word Sense Disambiguation. NAACL-HLT 2010 Workshop on Creating Speech and Language Data With Amazon's Mechanical Turk.
Swapna Somasundaran and Janyce Wiebe. (2010). Recognizing Stances in Ideological On-Line Debates. NAACL-HLT 2010 Workshop on Computational Approaches to Analysis and Generation of Emotion in Text.
2009
Cem Akkaya, Janyce Wiebe, and Rada Mihalcea. (2009). Subjectivity Word Sense Disambiguation EMNLP 2009.
Swapna Somasundaran, Galileo Namata, Janyce Wiebe and Lise Getoor (2009). Supervised and Unsupervised Methods in Employing Discourse Relations for Improving Opinion Polarity Classification EMNLP 2009.
Swapna Somasundaran and Janyce Wiebe (2009). Recognizing Stances in Online Debates. ACL-IJCNLP 2009.
Yaw Gyamfi, Janyce Wiebe, Rada Mihalcea, and Cem Akkaya (2009). Integrating Knowledge for Subjectivity Sense Labeling. HLT-NAACL 2009.
Theresa Wilson, Janyce Wiebe, and Paul Hoffmann (2009). Recognizing Contextual Polarity: an exploration of features for phrase-level sentiment analysis. Computational Linguistics 35(3).
Swapna Somasundaran, Galileo Namata, Lise Getoor and Janyce Wiebe, (2009). Opinion Graphs for Polarity and Discourse Classification, TextGraphs-4: Graph-based Methods for Natural Language Processing, 7th August 2009, Singapore
O'Hara, Thomas and Wiebe, Janyce (2009). Exploiting Semantic Role Resources for Preposition Disambiguation. Computational Linguistics 35 (2)
2008
Swapna Somasundaran, Janyce Wiebe, and Josef Ruppenhofer (2008). Discourse Level Opinion Interpretation. The 22nd International Conference on Computational Linguistics (COLING-2008).
Carmen Banea, Rada Mihalcea, Janyce Wiebe, Samer Hassan (2008). Multilingual Subjectivity Analysis Using Machine Translation. Conference on Empirical Methods in Natural Language Processing (EMNLP 2008).
Carmen Banea, Rada Mihalcea, Janyce Wiebe (2008). A Bootstrapping Method for Building Subjectivity Lexicons for Languages with Scarce Resources. The Sixth International Conference on Language Resources and Evaluation (LREC 2008).
Josef Ruppenhofer, Swapna Somasundaran, and Janyce Wiebe (2008). Finding the Sources and Targets of Subjective Expressions. The Sixth International Conference on Language Resources and Evaluation (LREC 2008).
Swapna Somasundaran, Josef Ruppenhofer, and Janyce Wiebe (2008). Discourse Level Opinion Relations: An Annotation Study. SIGdial Workshop on Discourse and Dialogue, Columbus, Ohio, June 2008.
2007
Rada Mihalcea , Carmen Banea , & Janyce Wiebe (2007). Learning Multilingual Subjective Language via Cross-Lingual Projections 45th Annual Meeting of the Association for Computational Linguistics (ACL-2007) .
Swapna Somasundaran, Theresa Wilson, Janyce Wiebe & Veselin Stoyanov (2007). QA with Attitude: Exploiting Opinion Type Analysis for Improving Question Answering in On-line Discussions and the News. International Conference on Weblogs and Social Media (ICWSM-2007) .
Swapna Somasundaran, Josef Ruppenhofer & Janyce Wiebe (2007) Detecting Arguing and Sentiment in Meetings , SIGdial Workshop on Discourse and Dialogue, Antwerp, Belgium, September 2007.
2006
Janyce Wiebe and Rada Mihalcea (2006). Word Sense and Subjectivity. Joint conference of the International Committee on Computational Linguistics and the Association for Computational Linguistics. (COLING-ACL 2006). Here are presentation slides. The gold standard manual annotations are available here The definitions of those words from WordNet 2.0 are here
Theresa Wilson , Janyce Wiebe, & Rebecca Hwa (2006). Recognizing strong and weak opinion clauses. Computational Intelligence 22 (2): 73-99.
Ellen Riloff , Siddharth Patwardhan and Janyce Wiebe (2006). Feature Subsumption for Opinion Analysis. Conference on Empirical Methods in Natural Language Processing (EMNLP-2006)
Wei-Hao Lin, Theresa Wilson, Janyce Wiebe and Alexander Hauptmann (2006). Which Side are You on? Identifying Perspectives at the Document and Sentence Levels. Conference on Computational Natural Language Learning (CoNLL-2006).
Swapna Somasundaran, Janyce Wiebe, Paul Hoffmann, & Diane Litman (2006). Manual Annotation of Opinion Categories in Meetings. COLING-ACL Workshop: Frontiers in Linguistically Annotated Corpora .
2005
Theresa Wilson , Janyce Wiebe, and Paul Hoffmann (2005). Recognizing Contextual Polarity in Phrase-Level Sentiment Analysis. Joint Human Language Technology Conference and the Conference on Empirical Methods in Natural Language Processing (HLT-EMNLP-2005). Here are presentation slides.
Veselin Stoyanov , Claire Cardie , and Janyce Wiebe (2005). Multi-Perspective Question Answering Using the OpQA Corpus. Joint Human Language Technology Conference and the Conference on Empirical Methods in Natural Language Processing (HLT-EMNLP-2005). Here is a version with a correction. Here are presentation slides.
Ellen Riloff, Janyce Wiebe, and William Phillips (2005). Exploiting subjectivity classification to improve information extraction. 20th National Conference on Artificial Intelligence (AAAI-2005). Here are presentation slides.
Janyce Wiebe, Theresa Wilson , and Claire Cardie (2005). Annotating expressions of opinions and emotions in language. Language Resources and Evaluation, volume 39, issue 2-3, pp. 165-210.
Theresa Wilson and Janyce Wiebe (2005). Annotating attributions and private states. Proc. ACL Workshop on Frontiers in Corpus Annotation II: Pie in the Sky.
Janyce Wiebe and Ellen Riloff (2005). Creating subjective and objective sentence classifiers from unannotated texts. Sixth International Conference on Intelligent Text Processing and Computational Linguistics (CICLing-2005) (Invited paper.)
Wiebe, Janyce, O'Hara, Tom, Ohrstrom-Sandgren, Thorsten, & McKeever, Kenneth (2005). An empirical approach to temporal reference resolution. In I. Mani, J. Pustejovsky, R. Gaizauskas (eds), The Language of Time: A Reader. Oxford University Press. Reprint of Wiebe, O'Hara, Ohrstrom-Standgren, and McKeever 1998.
2004
Theresa Wilson , Janyce Wiebe, and Rebecca Hwa (2004). Just how mad are you? Finding strong and weak opinion clauses. Proc. 19th National Conference on Artificial Intelligence (AAAI-2004). Here are presentation slides.
Janyce Wiebe, Theresa Wilson , Rebecca Bruce , Matthew Bell , and Melanie Martin (2004). Learning subjective language. Computational Linguistics 30 (3).
Veselin Stoyanov, Claire Cardie , Diane Litman and Janyce Wiebe (2004). Evaluating an Opinion Annotation Scheme Using a New Multi-Perspective Question and Answer Corpus. AAAI Spring Symposium on Exploring Attitude and Affect in Text: Theories and Applications.
2003
Ellen Riloff and Janyce Wiebe
(2003).
Learning Extraction Patterns for Subjective Expressions.
Conference on Empirical Methods in Natural Language Processing (EMNLP-03).
ACL SIGDAT. Pages 105-112. Here are presentation
slides.
Ellen Riloff, Janyce Wiebe, and Theresa Wilson (2003). Learning Subjective Nouns Using Extraction Pattern Bootstrapping. Seventh Conference on Natural Language Learning (CoNLL-03). ACL SIGNLL. Pages 25-32.
Theresa Wilson and Janyce
Wiebe (2003).
Annotating Opinions in the World
Press.
4th SIGdial Workshop on Discourse and Dialogue
(SIGdial-03). ACL SIGdial.
Here is a corrected version
of the paper that appears in the proceedings.
Here is the original.
Here are presentation slides.
Janyce Wiebe, Eric Breck, Chris
Buckley, Claire Cardie ,
Paul Davis, Bruce Fraser, Diane Litman, David Pierce,
Ellen Riloff, Theresa Wilson , David Day, Mark
Maybury (2003).
Recognizing and Organizing Opinions Expressed in the World Press.
2003 AAAI Spring Symposium on New Directions in
Question Answering.
Claire Cardie , Janyce Wiebe, Theresa
Wilson, and Diane Litman (2003).
Combining Low-Level and Summary Representations of Opinions for
Multi-Perspective Question Answering.
2003 AAAI Spring Symposium on New Directions in
Question Answering.
2002
Wiebe, J. & Wilson, T. (2002).
Learning to disambiguate potentially subjective expressions.
Sixth Conference on Natural Language Learning
(CoNLL-2002). ACL SIGNLL.
Taipei, Taiwan, August, 2002.
Pustejovsky, J., Wiebe, J., & Maybury, M. (2002).
Multi-perspective and temporal question answering.
Third International Conference on Language Resources
and Evaluation (LREC 2002) Workshop on
Question Answering: Strategy and Resources, Canary Islands, Spain, May
2002.
Wiebe, J. (2002).
Instructions for Annotating Opinions in Newspaper Articles.
Department of Computer Science Technical Report TR-02-101 ,
University of Pittsburgh, Pittsburgh, PA.
Soller, A., Wiebe J., & Lesgold, A. (2002).
A machine learning approach to assessing knowledge
sharing
during collaborative learning activities.
International Conference on
Computer Support for
Collaborative Learning (CSCL-2002).
Boulder, Colorado, January, 2002.
2001
Wiebe, J., Bruce, R., Bell, M., Martin, M., & Wilson, T. (2001).
A Corpus Study of Evaluative and Speculative Language.
Proc. 2nd ACL SIGdial Workshop on Discourse and Dialogue.
Aalborg, Denmark, September, 2001.
The data are available by clicking here.
Janyce Wiebe, Theresa Wilson , &
Matthew Bell (2001)
Identifying Collocations for Recognizing Opinions.
Proc. ACL 01 Workshop on Collocation.
Toulouse, France, July 2001.
2000
Janyce Wiebe (2000).
Learning Subjective Adjectives from Corpora.
Proc. 17th National Conference on Artificial Intelligence
(AAAI-2000). Austin,
Texas, July 2000. Presentation slides and
lists of adjectives learned using the process are
available by clicking here .
Hatzivassiloglou, Vasileios and Janyce Wiebe (2000).
Effects of Adjective Orientation and Gradability on
Sentence Subjectivity.
International Conference on Computational
Linguistics (COLING-2000). Lists of positive, negative,
gradable, and dynamic adjectives are available
by clicking here .
Before 2000
Bruce, Rebecca F. & Janyce Wiebe M. (1999). Recognizing
subjectivity:
a case study in manual tagging.
Natural Language Engineering 5 (2).
Janyce Wiebe M., Bruce, Rebecca F., & O'Hara, Thomas P. (1999).
Development and use of a gold standard data set for subjectivity
classifications.
In Proc. 37th Annual
Meeting of the Assoc. for Computational Linguistics (ACL-99).
Association for Computational Linguistics, University of Maryland,
June, pp. 246-253. The Coding manual and data are available
by clicking here
Wiebe, Janyce, O'Hara, Tom, Ohrstrom-Sandgren, Thorsten, & McKeever,
Kenneth (1998). An empirical approach to temporal reference resolution.
Journal of Artificial Intelligence Research 9: 247-293. Pontelli, Enrico, Gupta, Gopal, Wiebe, Janyce,
& Farwell, David. (1998). Natural language multiprocessing: a case
study. In Proc. 15th National Conference on Artificial Intelligence
(AAAI-98). American Association for Artificial Intelligence, Madison,
WI., July 1998, pp. 76-82.
Bruce, Rebecca & Wiebe, Janyce. (1998).
Word sense distinguishability and inter-coder agreement. In Proc. 3rd
Conference on Empirical Methods in Natural Language Processing (EMNLP-98).
Association for Computational Linguistics SIGDAT, Granada, Spain,
June, pp. 53-60.
Wiebe, Janyce, McKeever, Kenneth, & Bruce,
Rebecca. (1998). Mapping collocational properties into machine learning
features. Proc. 6th Workshop on Very Large Corpora (WVLC-98). Association
for Computational Linguistics SIGDAT, Montreal, Quebec, Canada, August
1998, pp. 225-233.
The coding manual for the event categorization manual annotations
is available here
Janyce Wiebe & McKeever, Kenneth
(1998). Collocational properties in probabilistic classifiers for discourse
categorization. Proc. AAAI-98 Spring Symposium Series Workshop on Applying
Machine Learning to Discourse Processing, Stanford, California, March
1998.
Wiebe, Janyce, Bruce, Rebecca, & Duan,
Lei. (1997).
Probabilistic event categorization. In Recent Advances in Natural
Language Processing (RANLP-97). Tsigov Chark, Bulgaria,
Sept. 1997,
pp. 163-170.
The coding manual for the manual annotations
is available here
Rapaport, William J., Shapiro, Stuart
C., & Janyce Wiebe M. (1997). Quasi-indicators and knowledge reports.
Cognitive Science 21 (1), 63-107.
Wiebe, Janyce, O'Hara, Tom, McKeever, Kenneth,
and Öhrström-Sandgren, Thorsten (1997).
An empirical approach to temporal reference resolution. In Proc. 2nd
Conference on Empirical Methods in Natural Language Processing (EMNLP-97).
Association for Computational Linguistics SIGDAT, Providence, R.I., August
1997, pp. 174-186.
Wiebe, Janyce, Maples, Julie, Duan, Lei,
& Bruce, Rebecca (1997). Experience in WordNet sense tagging in
the Wall Street Journal. In Proc. ANLP-97 Workshop, Tagging Text with
Lexical Semantics: Why, What, and How? Association for Computational
Linguistics SIGLEX, Washington, D.C., April 1997, pp. 8-11.
Wiebe, Janyce, Hirst, Graeme, & Horton,
Diane (1996). Language use in context. Communications of the ACM
(Special issue on natural language processing), 39 (1): 102-111.
Guillén, Rocio, Farwell, David, and
Wiebe, Janyce (1996). Handling temporal relations in scheduling dialogues
for an MT system. In Proc. of Third International Workshop on Temporal
Representation and Reasoning (TIME-96). IEEE Computer Society Press,
pp. 217-221.
Janyce Wiebe & Bruce, Rebecca (1995).
Probabilistic classifiers for tracking point of view. In Proc. Symposium
on Empirical Methods in Discourse Interpretation and Generation, AAAI 1995
Spring Symposium Series, pp. 181-187.
Janyce Wiebe M. (1994).
Tracking point of view in narrative. Computational Linguistics 20
(2): 233-287.
Here is the word-sense data used
in Bruce, Rebecca & Wiebe, Janyce (1994).
Word-sense disambiguation using decomposable models. In Proc. 32nd Annual
Meeting of the Assoc. for Computational Linguistics (ACL-94),
pp. 139-146. Janyce Wiebe M. (1993). Issues in linguistic segmentation. In Proc.
1993 SIG ACL workshop, Intentionality and Structure in Discourse Relations,
pp. 148-151.
Janyce Wiebe M. (1991). References in
narrative text. Noûs (Special issue on Cognitive Science and
AI) 25 (4): 457-486.
Japkowicz, Nathalie & Wiebe, Janyce M. (1991).
Translating spatial
prepositions using conceptual information. In Proc. 29th Annual Meeting
of the Assoc. for Computational Linguistics (ACL-91), pp. 153-160.
Janyce Wiebe M. (1991). Point of view and discourse processing. Working
Notes of the 1991 AAAI Fall Symposium on Discourse Structure in Natural
Language Understanding and Generation, pp. 136-137.
Paper (short)
or
Transparencies (more complete).
Janyce Wiebe M. (1990).
Identifying subjective characters in narrative.
In Proc. 13th International Conference on Computational Linguistics
(COLING-90), pp. 401-408.
Bruder, Gail A. & Janyce Wiebe M. (1990). A psychological test
of an algorithm for recognizing subjectivity in narrative text. In Proc.
12th Annual Conference of the Cognitive Science Society, pp. 947-952.
Janyce Wiebe M. & Rapaport, William J. (1988).
A computational
theory of perspective and reference in narrative. In Proc. 26th Annual
Meeting of the Assoc. for Computational Linguistics (ACL-88), pp. 131-138.
Janyce Wiebe M. & Rapaport, William J. (1986). Representing De
Re and De Dicto belief reports in discourse and narrative. Proceedings
of the IEEE (Special Issue on Knowledge Representation) 74:
1405-13.
Here are the annotation
instructions used to prepare the data in the papers.
Sample annotations are available in
this directory.
Dissertation
Janyce Wiebe M. (1990). Recognizing Subjective Sentences: A Computational Investigation of Narrative Text. (Ph.D. dissertation) Technical Report 90-03. (Buffalo: SUNY Buffalo Dept. of Computer Science).
Book Chapters
Cardie, C., Wiebe, J., Wilson, T., & Litman, D. (2004). Low-Level Annotations and Summary Representations of Opinions for Multi-Perspective Question Answering. M. Maybury (ed.) New Directions in Question Answering . AAAI Press.
Wiebe, J. & Bruce, R. Probabilistic Classifiers for Tracking Point of View (2001). Barnet, George A. (ed.) New Directions in Computer Content Analysis. New York: Ablex, Advances in Communication Research Series. Revised version of Wiebe & Bruce 1995.
Rapaport, William J., Shapiro, Stuart C., & Janyce Wiebe M. (1998). Quasi-indicators and knowledge reports. In F. Orilia and W.J. Rapaport (eds.), Thought, Language, and Ontology, Netherlands, Kluwer Academic, pp. 235-294. Reprint of Rapaport, Shapiro, & Wiebe 1997.
Janyce Wiebe (1995). References in narrative text. In Judy Duchan, Gail Bruder, and Lynne Hewitt (eds.) Deixis in Narrative: A Cognitive Science Perspective. Lawrence Erlbaum Associates. Reprint of Wiebe 1991a.
Bruder, Gail & Janyce Wiebe (1995). Recognizing subjectivity and identifying subjective characters in third-person fictional narrative. In Judy Duchan, Gail Bruder, and Lynne Hewitt (eds.) Deixis in Narrative: A Cognitive Science Perspective. Lawrence Erlbaum Associates.