================================ EUROLAN 2007 Monday, July 30 Working Session ================================ Exercise 1: In this exercise, we'll work with the MPQA subjectivity annotation scheme. Your task will be to find the direct-subjective, objective-speech-event, and expressive-subjective-element expressions and their nested sources. Following are the types of annotations to choose from. Don't try to fill in the spans. Instead, for this exercise, we'll write the words in the text anchors at the end of the line. Note that the following are the "bones" of the annotations, and some fields are not shown. The answer key will show additional information. GATE_objective-speech-event: (span) nested-source= implicit= [words in the span] GATE_direct-subjective (span) intensity= expression-intensity= nested-source= [words in the span] GATE_expressive-subjectivity (697, 701) nested-source= intensity= [words in the span] Note that annotations attributed to the writer are often implicit, meaning that the source is not explicitly referred to (The writer does not write 'I write that...'). This is indicated with "implicit=true". Also, we anchor annotations corresponding to the entire sentence on the first character of the sentence. For example: GATE_objective-speech-event (599, 599) nested-source=w implicit=true [] This means that the entire sentence is an objective speech event attributed to the writer, though the source of the speech event is implicit. ==Sentence 1 [docid=non_fbis/08.40.56-18707 span=599,778] The State Department's annual human rights report, which was published Monday, said Russia had a poor record regarding the independence and freedom of the media and in Chechnya. Hint: there is one of each type of annotation for this sentence. ==Sentence 2 docid=non_fbis/08.40.56-18707 span=270,595 "One gets the impression that its writers simply used old drafts, as if nothing had happened in either Russia or the United States in recent years, as if the events of Sept. 11, 2001 had not occurred and the international community had not closed ranks in the battle against terrorism," the ministry said in a statement. After entering the basic annotations, think about what attitude-type and target annotations could be added. ==Sentence 3 Here's a juicy one! Note: a word can be included in the text span/anchor of multiple annotations. docid=non_fbis/08.40.56-18707 span=50,266 The Foreign Ministry said Thursday that it was "surprised, to put it mildly" by the U.S. State Department's criticism of Russia's human rights record and objected in particular to the "odious" section on Chechnya. ==Sentence 4 Note: more than one type of attitude can be connected to a direct-subjective annotation. docid=temp_fbis/21.37.46-9337 span=1215,1317 The United States has not only made a procedural mistake, but the facts are incorrect, officials said. ============================================================================= ============================================================================= Exercise 2: Now we turn to annotating word senses for subjectivity. We annotated the nouns in the Senseval-3 English lexical sample task plus some other nouns and some verbs. Below are a subset of the words we annotated. Part 1: Below you are given the synsets, glosses, examples, and hypernyms of senses in WordNet. For each, please decide if it is "subjective", "objective" or "both" and, if "subjective" or "both", if it is "positive", "negative", "both" or "neutral". === Synonyms/Hypernyms (Ordered by Estimated Frequency) of noun alarm 4 senses of alarm Sense 1 alarm, dismay, consternation -- (fear resulting from the awareness of danger) => fear, fearfulness, fright -- (an emotion experienced in anticipation of some specific pain or danger (usually accompanied by a desire to flee or fight)) Sense 2 alarm, warning device, alarm system -- (a device that signals the occurrence of some undesirable event) => device -- (an instrumentality invented for a particular purpose; "the device is small enough to wear on your wrist"; "a device intended to conserve water") Sense 3 alarm, alert, warning signal, alarum -- (an automatic signal (usually a sound) warning of danger) => signal, signaling, sign -- (any communication that encodes a message; "signals from the boat suddenly stopped") Sense 4 alarm clock, alarm -- (a clock that wakes sleeper at preset time) => clock -- (a timepiece that shows the time of day) === Synonyms/Hypernyms (Ordered by Estimated Frequency) of noun assault 4 senses of assault Sense 1 assault -- (close fighting during the culmination of a military attack) => battle, conflict, fight, engagement -- (a hostile meeting of opposing military forces in the course of a war; "Grant won a decisive victory in the battle of Chickamauga"; "he lost his romantic ideas about war when he got into a real engagement") Sense 2 assault -- (a threatened or attempted physical attack by someone who appears to be able to cause bodily harm if not stopped) => attack, attempt -- (the act of attacking; "attacks on women increased last year"; "they made an attempt on his life") Sense 3 Assault -- (thoroughbred that won the triple crown in 1946) => thoroughbred -- (a racehorse belonging to a breed that originated from a cross between Arabian stallions and English mares) Sense 4 rape, violation, assault, ravishment -- (the crime of forcing a woman to submit to sexual intercourse against her will) => sexual assault, sexual abuse, sex crime, sex offense -- (a statutory offense that provides that it is a crime to knowingly cause another person to engage in an unwanted sexual act by force or threat; "most states have replaced the common law definition of rape with statutes defining sexual assault") === Synonyms/Hypernyms (Ordered by Estimated Frequency) of verb assault 3 senses of assault Sense 1 assail, assault, set on, attack -- (attack someone physically or emotionally; "The mugger assaulted the woman"; "Nightmares assailed him regularly") Sense 2 rape, ravish, violate, assault, dishonor, dishonour, outrage -- (force (someone) to have sex against their will; "The woman was raped on her way home at night") => assail, assault, set on, attack -- (attack someone physically or emotionally; "The mugger assaulted the woman"; "Nightmares assailed him regularly") Sense 3 attack, round, assail, lash out, snipe, assault -- (attack in speech or writing; "The editors of the left-leaning paper attacked the new House Speaker") => knock, criticize, criticise, pick apart -- (find fault with; express criticism of; point out real or perceived flaws; "The paper criticized the new movie"; "Don't knock the food--it's free") === Synonyms/Hypernyms (Ordered by Estimated Frequency) of noun blow 7 senses of blow Sense 1 blow -- (a powerful stroke with the fist or a weapon; "a blow on the head") => stroke -- (a single complete movement) Sense 2 bump, blow -- (an impact (as from a collision); "the bump threw him off the bicycle") => impact -- (the striking of one body against another) Sense 3 reverse, reversal, setback, blow, black eye -- (an unfortunate happening that hinders of impedes; something that is thwarting or frustrating) => happening, occurrence, natural event -- (an event that happens) Sense 4 shock, blow -- (an unpleasant or disappointing surprise; "it came as a shock to learn that he was injured") => surprise -- (a sudden unexpected event) Sense 5 gust, blast, blow -- (a strong current of air; "the tree was bent almost double by the gust") => wind, air current, current of air -- (air moving (sometimes with considerable force) from an area of high pressure to an area of low pressure; "trees bent under the fierce winds"; "when there is no wind, row"; "the radioactivity was being swept upwards by the air current and out into the atmosphere") Sense 6 coke, blow, nose candy, snow, C -- (street names for cocaine) => cocaine, cocain -- (a narcotic (alkaloid) extracted from coca leaves; used as a surface anesthetic or taken for pleasure; can become powerfully addictive) Sense 7 blow, puff -- (forceful exhalation through the nose or mouth; "he gave his nose a loud blow"; "he blew out all the candles with a single puff") => exhalation, expiration, breathing out -- (the act of expelling air from the lungs) === 3 senses of adoration Sense 1 worship, adoration -- (a feeling of profound love and admiration) => love -- (a strong positive emotion of regard and affection; "his love for his work"; "children need a lot of love") Sense 2 adoration, idolization, idolisation -- (the act of admiring strongly) => admiration, appreciation -- (a favorable judgment; "a small token in admiration of your works") Sense 3 adoration, latria -- (worship given to God alone) => worship -- (the activity of worshipping) === Synonyms/Hypernyms (Ordered by Estimated Frequency) of noun bomb 3 senses of bomb Sense 1 bomb -- (an explosive device fused to denote under specific conditions) => explosive device -- (device that bursts with sudden violence from internal energy) => weaponry, arms, implements of war, weapons system, munition -- (weapons considered collectively) Sense 2 bomb calorimeter, bomb -- (strong sealed vessel for measuring heat of combustion) => calorimeter -- (a measuring instrument that determines quantities of heat) Sense 3 turkey, bomb, dud -- (an event that fails badly or is totally ineffectual; "the first experiment was a real turkey"; "the meeting was a dud as far as new business was concerned") => flop, bust -- (a complete failure; "the play was a dismal flop") === Synonyms/Hypernyms (Ordered by Estimated Frequency) of noun catch 10 senses of catch Sense 1 catch -- (a hidden drawback; "it sounds good but what's the catch?") => drawback -- (the quality of being a hindrance; "he pointed out all the drawbacks to my plan") Sense 2 catch, haul -- (the quantity that was caught; "the catch was only 10 fish") => indefinite quantity -- (an estimated quantity) Sense 3 catch, match -- (a person regarded as a good matrimonial prospect) => adult, grownup -- (a fully developed person from maturity onward) Sense 4 catch -- (anything that is caught (especially if it is worth catching); "he shared his catch with the others") => object, physical object -- (a tangible and visible entity; an entity that can cast a shadow; "it was full of rackets, balls and other objects") Sense 5 catch -- (a break or check in the voice (usually a sign of strong emotion)) => manner of speaking, speech, delivery -- (your characteristic style or manner of expressing yourself orally; "his manner of speaking was quite abrupt"; "her speech was barren of southernisms"; "I detected a slight accent in his speech") Sense 6 catch, stop -- (a restraint that checks the motion of something; "he used a book as a stop to hold the door open") => restraint, constraint -- (a device that retards something's motion; "the car did not have proper restraints fitted") Sense 7 catch -- (a fastener that fastens or locks a door or window) => fastener, fastening, holdfast, fixing -- (restraint that attaches to something or holds something in place) Sense 8 catch -- (a cooperative game in which a ball is passed back and forth; "he played catch with his son in the backyard") => game -- (an amusement or pastime; "they played word games"; "he thought of his painting as a game that filled his empty time"; "his life was all fun and games") Sense 9 catch, grab, snatch, snap -- (the act of catching an object with the hands; "Mays made the catch with his back to the plate"; "he made a grab for the ball before it landed"; "Martin's snatch at the bridle failed and the horse raced away"; "the infielder's snap and throw was a single motion") => touch, touching -- (the act of putting two things together with no space between them; "at his touch the room filled with lights") Sense 10 apprehension, arrest, catch, collar, pinch, taking into custody -- (the act of apprehending (especially apprehending a criminal); "the policeman on the beat got credit for the collar") => capture, gaining control, seizure -- (the act of forcibly dispossessing an owner of property) === Synonyms/Hypernyms (Ordered by Estimated Frequency) of noun atmosphere 6 senses of atmosphere Sense 1 atmosphere, ambiance, ambience -- (a particular environment or surrounding influence; "there was an atmosphere of excitement") => condition, status -- (a state at a particular time; "a condition (or state) of disrepair"; "the current status of the arms negotiations") Sense 2 standard atmosphere, atmosphere, atm, standard pressure -- (a unit of pressure: the pressure that will support a column of mercury 760 mm high at sea level and 0 degrees centigrade) => pressure unit -- (a unit measuring force per unit area) Sense 3 atmosphere, air -- (the mass of air surrounding the Earth; "there was great heat as the comet entered the atmosphere"; "it was exposed to the air") => region, part -- (the extended spatial location of something; "the farming regions of France"; "religions in all parts of the world"; "regions of outer space") Sense 4 atmosphere, atmospheric state -- (the weather or climate at some place; "the atmosphere was thick with fog") => weather, weather condition, atmospheric condition -- (the meteorological conditions: temperature and wind and clouds and precipitation; "they were hoping for good weather"; "every day we have weather conditions and yesterday was no exception") Sense 5 atmosphere -- (the envelope of gases surrounding any celestial body) => gas -- (a fluid in the gaseous state having neither independent shape nor volume and being able to expand indefinitely) Sense 6 air, aura, atmosphere -- (a distinctive but intangible quality surrounding a person or thing; "an air of mystery"; "the house had a neglected air"; "an atmosphere of defeat pervaded the candidate's headquarters"; "the place had an aura of romance") => quality -- (an essential and distinguishing attribute of something or someone; "the quality of mercy is not strained"--Shakespeare) Part 2: We have found that positive/negative/both/neutral judgments are more difficult for objective than subjective senses. Go back through the definitions above and discuss annotating the polarity of the objective senses. Part 3: Google "WordNet" to get the on-line version of WordNet. Type in some obvious positive and negative nouns (e.g., "love", "good", "hate", "terrify"). Click on the "S" and then on "inherited hypernyms". What happens with subjectivity and polarity as you go to higher levels of hypernyms? Part 4: What additional properties related to subjectivity would you like to add to senses?