*SEM 2013: The Second Joint Conference on Lexical and Computational Semantics Volume 1: Proceedings of the Main Conference and the Shared Task: Semantic Textual Similarity June 13-14, 2013 Atlanta, Georgia, USA ProductionandManufacturingby Omnipress,Inc. 2600AndersonStreet Madison,WI53707 USA Sponsoredinpartby: TheUSDefenseAdvancedResearchProjectsAgency(DARPA) Organizedandsponsoredinpartby: TheACLSpecialInterestGroupontheLexicon(SIGLEX) TheACLSpecialInterestGrouponComputationalSemantics(SIGSEM) (cid:13)c 2013TheAssociationforComputationalLinguistics OrdercopiesofthisandotherACLproceedingsfrom: AssociationforComputationalLinguistics(ACL) 209N.EighthStreet Stroudsburg,PA18360 USA Tel: +1-570-476-8006 Fax: +1-570-476-0860 [email protected] ISBN978-1-937284-48-0(Volume1) ISBN978-1-937284-49-7(Volume2) ii Introduction to *SEM 2013 BuildingonthemomentumgeneratedbythespectacularsuccessoftheJointConferenceonLexicaland Computational Semantics (*SEM) in 2012, bringing together the ACL SIGLEX and ACL SIGSEM communities, we are delighted to bring to you the second edition of the conference, as a top-tier showcase of the latest research in computational semantics. We accepted 14 papers (11 long and 3 short) for publication at the conference, out of a possible 45 submissions (a 31% acceptance rate). Thisisonparwithsomeofthemostcompetitiveconferencesincomputationallinguistics,andweare confidentwillsetthestageforascintillatingconference. This year, we started a tradition that we intend to maintain in all future iterations of the conference in integratingasharedtaskintotheconference. Thesharedtaskwasselectedbyanindependentcommittee comprising members from SIGLEX and SIGSEM, based on an open call for proposals, and revolved around Semantic Textual Similarity (STS). The task turned out to be a huge success with 34 teams participating,submittingatotalof103systemruns. *SEM2013featuresanumberofhighlightevents: DayOne,June13th: • A timely and impressive panel on Towards Deep Natural Language Understanding, featuringthefollowingpanelists: – KevinKnight(USC/InformationSciencesInstitute) – ChrisManning(StanfordUniversity) – MarthaPalmer(UniversityofColoradoatBoulder) – OwenRambow(ColumbiaUniversity) – DanRoth(UniversityofIllinoisatUrbana-Champaign) • A Reception and Shared Task Poster Session in the evening, thanks to the generous sponsorshipoftheDARPADeftprogram. DayTwo,June14th: • Inthemorning,akeynoteaddressbyDavidForsythfromtheComputerScienceDepartment at the University of Illinois at Urbana Champagne on issues of Vision and Language. It promisestobeanextremelystimulatingspeech,andisnottobemissed. • In the early afternoon, a panel on the relation between and future of *SEM, the *SEM SharedTask,SemEvalandothereventsoncomputationalsemantics. Inthispanel,wewill attempttoclarifyandexplainaswellasdeviseplansforthesedifferententities. • Finally, at the end of the day, an award ceremony for the Best Long Paper and Best Short Paper. iii Asalways,*SEM2013wouldnothavebeenpossiblewithouttheconsiderableeffortsofourareachairs and an impressive assortment of reviewers, drawn from the ranks of SIGLEX and SIGSEM, and the computationalsemanticscommunityatlarge. Wewouldalsoliketoacknowledgethegeneroussupport fortheSTSTaskfromtheDARPADeftProgram. Wehopeyouenjoy*SEM2013,andlookforwardtoengagingwithallofyou, MonaDiab(TheGeorgeWashingtonUniversity,GeneralChair) TimothyBaldwin(TheUniversityofMebourne,ProgramCommitteeCo-Chair) MarcoBaroni(UniversityofTrento,ProgramCommitteeCo-Chair) iv Introduction to SemEval The Semantic Evaluation (SemEval) series of workshops focus on the evaluation and comparison of systems that can analyse diverse semantic phenomena in text with the aim of extending the current state-of-the-art in semantic analysis and creating high quality annotated datasets in a range of increasinglychallengingproblemsinnaturallanguagesemantics. SemEvalprovidesanexcitingforum forresearcherstoproposechallengingresearchproblemsinsemanticsandtobuildsystems/techniques toaddresssuchresearchproblems. SemEval-2013 is the seventh workshop in the series. The first three workshops, SensEval-1 (1998), SensEval-2 (2001), and SensEval-3 (2004), were focused on word sense disambiguation, each time growing in the number of languages offered in the tasks and in the number of participating teams. In 2007 the workshop was renamed SemEval and in the next three workshops SemEval-2007, SemEval- 2010 and SemEval-2012 the nature of the tasks evolved to include semantic analysis tasks outside of wordsensedisambiguation. Startingin2012SemEvalturnedintoayearlyeventassociatedwith*SEM. This volume contains papers accepted for presentation at the SemEval-2013 International Workshop on Semantic Evaluation Exercises. SemEval-2013 is co-organized with the *SEM-2013 The Second Joint Conference on Lexical and Computational Semantics and co-located with The 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies(NAACLHLT). SemEval-2013includedthefollowing12tasksforevaluation: • TempEval-3TemporalAnnotation • SentimentAnalysisinTwitter • SpatialRoleLabeling • FreeParaphrasesofNounCompounds • EvaluatingPhrasalSemantics • TheJointStudentResponseAnalysisand8thRecognizingTextualEntailmentChallenge • Cross-lingualTextualEntailmentforContentSynchronization • ExtractionofDrug-DrugInteractionsfromBioMedicalTexts • Cross-lingualWordSenseDisambiguation • EvaluatingWordSenseInduction&DisambiguationwithinAnEnd-UserApplication • MultilingualWordSenseDisambiguation • WordSenseInductionforGradedandNon-GradedSenses v About 100 teams submitted more than 300 systems for the 12 tasks of SemEval-2013. This volume contains both Task Description papers that describe each of the above tasks and System Description papers that describe the systems that participated in the above tasks. A total of 12 task description papersand101systemdescriptionpapersareincludedinthisvolume. We are indebted to all program committee members for their high quality, elaborate and thoughtful reviews. The papers in this proceedings have surely benefited from this feedback. We are grateful to *SEM 2013 and NAACL-HLT 2013 conference organizers for local organization and the forum. We most gratefully acknowledge the support of our sponsors, the ACL Special Interest Group on the Lexicon(SIGLEX)andtheACLSpecialInterestGrouponComputationalSemantics(SIGSEM). WelcometoSemEval-2013! SureshManandharandDenizYuret vi Organizers: GeneralChair: MonaDiab(GeorgeWashingtonUniversity) ProgramCommitteeChairs: TimBaldwin(UniversityofMelbourne) MarcoBaroni(UniversityofTrento) STSSharedTaskCommitteeChairs: AnnaKorhonen(UniversityofCambridge) MalvinaNissim(UniversityofBologna) SemEvalChairs: SureshManandhar(UniversityofYork,UK) DenizYuret(KocUniversity,Turkey) PublicationsChair: YuvalMarton(Microsoft) SponsorshipChair: BernardoMagnini(FondazioneBrunoKessler) Panelorganizer: MarthaPalmer(UniversityofColorado,Boulder) AreaChairs: ShaneBergsma(JohnsHopkinsUniversity) ChrisBiemann(TUDarmstadt) EduardoBlanco(LymbaCorporation) GemmaBoleda(UniversityofTexas,Austin) FrancisBond(NanyangTechnologicalUniversity) PaulCook(UniversityofMelbourne) Amac¸ Herdagdelen(Facebook) LauriKarttunen(StanfordUniversity) DianaMcCarthy(UniversityofCambridge) RoserMorante(UniversityofAntwerp) SmaraMuresan(RutgersUniversity) PreslavNakov(QatarComputingResearchInstitute) RobertoNavigli(SapienzaUniversityofRome) HweeTouNg(NationalUniversityofSingapore) BeckyPassonneau(ColumbiaUniversity) LauraRimell(UniversityofCambridge) CarolineSporleder(UniversityofTrier) FabioMassimoZanzotto(UniversityofRomeTorVergata) vii ProgramCommitteeforVolume1: NabilAbdullah(UniversityofWindsor),EnekoAgirre(UniversityoftheBasqueCountry),NicholasAsher (CNRSInstitutdeRechercheenInformatiquedeToulouse),EserAygu¨n,TimothyBaldwin(TheUniversity ofMelbourne),EvaBanik(ComputationalLinguisticsLtd),MarcoBaroni(UniversityofTrento),Alberto Barro´n-Ceden˜o(UniversitatPolite`cnicadeCatalunya),RobertoBasili(UniversityofRoma,TorVergata), MiroslavBatchkarov(UniversityofSussex),CosminBejan,SabineBergler(ConcordiaUniversity),Shane Bergsma (Johns Hopkins University), Steven Bethard (University of Colorado Boulder), Ergun Bicici (Centre for Next Generation Localisation), Chris Biemann (TU Darmstadt), Eduardo Blanco (Lymba Corporation),GemmaBoleda(TheUniversityofTexasatAustin),FrancisBond(NanyangTechnological University),PaulBuitelaar(DERI,NationalUniversityofIreland,Galway),RazvanBunescu(OhioUniver- sity),HarryBunt(TilburgUniversity),AljoschaBurchardt(DFKI),DavideBuscaldi(LIPN,Universite´Paris 13),OliviaBuzek(JohnsHopkinsUniversity),NicolettaCalzolari(ILC-CNR),AnnalinaCaputo(Dept. ComputerScience-Univ. ofBariAldoMoro),SandraCarberry(UniversityofDelaware),MarineCarpuat (NationalResearchCouncil),IreneCastellon(UniversityofBarcelona),JulioCastillo(NationalUniversity of Cordoba), Daniel Cer (Stanford University), Yee Seng Chan (Raytheon BBN Technologies), David Chen(Google),ColinCherry(NRC),JackieChiKitCheung(UniversityofToronto),ChristianChiarcos, Sung-PilChoi,GrzegorzChrupała(TilburgUniversity),PhilippCimiano(Univ. Bielefeld),DaoudClarke, BobCoecke(OxfordUniversity),PaulCook(TheUniversityofMelbourne),BonaventuraCoppola(IBM Research),DaniloCroce(UniversityofRoma,TorVergata),MontseCuadros(Vicomtech-IK4),Walter Daelemans(UniversityofAntwerp,CLiPS),IdoDagan(Bar-IlanUniversity),AvishekDan(IndianInstitute ofTechnologyBombay),KareemDarwish(QatarComputingResearchInstitute,QatarFoundation),Dipan- janDas(GoogleInc.),Marie-CatherinedeMarneffe(TheOhioStateUniversity),GerarddeMelo(ICSI Berkeley),PascalDenis,MonaDiab(GWU),GeorgianaDinu(UniversityofTrento),BillDolan(Microsoft Research),RebeccaDridan(UniversityofOslo),KevinDuh(NaraInstituteofScienceandTechnology), MichaElsner(TheOhioStateUniversity),DavidElson(Google),StefanEvert(FAUErlangen-Nu¨rnberg), DanFlickinger(Stanford),AnetteFrank(HeidelbergUniversiy),AndreFreitas(DERI,NationalUniversity ofIreland,Galway),ClaireGardent(CNRS/LORIA,Nancy),SpandanaGella(UniversityofMelbourne), MatthewGerber(UniversityofVirginia),EugenieGiesbrecht(KarlsruheInstituteofTechnology),Kevin Gimpel(ToyotaTechnologicalInstituteatChicago),ClaudioGiuliano(FBK),DanGoldwasser(University ofMaryland),EdwardGrefenstette(UniversityofOxfordDepartmentofComputerScience),WeiweiGuo (ColumbiaUniversity),IrynaGurevych(UbiquitousKnowledgeProcessing(UKP)Lab),YoanGutie´rrez (UniversityofMatanzas),NizarHabash(ColumbiaUniversity),BoHan(UniversityofMelbourne),Lushan Han(UniversityofMaryland,BaltimoreCounty),ChikaraHashimoto(NICT),MikeHeilman(Educational TestingService),IrisHendrickx(CenterforLanguageStudies,RadboudUniversityNijmegen),Verena Henrich(UniversityofTu¨bingen),AurelieHerbelot(Universita¨tPotsdam),AmacHerdagdelen(Facebook), VeroniqueHoste(GhentUniversity),DirkHovy(USC’sInformationSciencesInstitute),NancyIde(Vassar College),AdrianIftene(Al. I.CuzaUniversityofIasi),DianaInkpen(UniversityofOttawa),SambhavJain (LTRC,IIITHyderabad),SnehaJha,SergioJimenez(NationalUniversityofColombia),RichardJohansson (UniversityofGothenburg), DavidJurgens(UniversityofCalifornia, LosAngeles), DimitriKartsaklis (UniversityofOxford),LauriKarttunen(StanfordUniversity),SophiaKatrenko(UtrechtUniversity),Bill Keller(TheUniversityofSussex),DouweKiela(UniversityofCambridgeComputerLaboratory),SuNam Kim,AlexandreKlementiev(SaarlandUniversity),ValiaKordoni(HumboldtUniversityBerlin),Ioannis Korkontzelos(NationalCentreforTextMining,TheUniversityofManchester),ZornitsaKozareva(USC InformationSciencesInstitute),IvanaKruijff-Korbayova,ManLan(ECNU),JeyHanLau(Universityof Melbourne),YoongKeokLee(MIT),AlessandroLenci(UniversityofPisa),MariaLiakata(Universityof viii Warwick),TingLiu,NitinMadnani(EducationalTestingService),NikolaosMalandrakis(SignalAnalysis andInterpretationLaboratory(SAIL),USC,LosAngeles,CA90089,USA),SureshManandhar(University ofYork),DanielMarcu(SDL),ErwinMarsi(NorwegianUniversityofScienceandTechnology(NTNU)), ToniMarti(UniversityofBarcelona),DianaMcCarthy(UniversityofCambridge(DTAL)),JohnMcCrae (UniversityBielefeld),RadaMihalcea(UniversityofNorthTexas),ShacharMirkin(XeroxResearchCentre Europe), Ray Mooney (University of Texas at Austin), Roser Morante (University of Antwerp), Paul Morarescu(SyracuseUniversity),MathieuMorey(Aix-MarseilleUniversite´),AlessandroMoschitti(DIS, UniversityofTrento),RutuMulkar,SmarandaMuresan(RutgersUniversity),PreslavNakov(QatarCom- putingResearchInstitute,QatarFoundation),ViviNastase(FBK),RobertoNavigli(SapienzaUniversity ofRome),AniNenkova(UniversityofPennsylvania),HweeTouNg(NationalUniversityofSingapore), ShengjianNi(CollegeofChineseLanguageandLiterature,WuhanUniversity),JohnNiekrasz,malvina nissim(UniversityofBologna), DiarmuidO´ Se´aghdha(UniversityofCambridge), BrendanO’Connor (CarnegieMellonUniversity),KemalOflazer(CarnegieMellonUniversity-Qatar),AkiraOhtani(Osaka Gakuin University), Manabu Okumura (Tokyo Institute of Technology), Lubomir Otrusina (Faculty of InformationTechnology,BrnoUniversityofTechnology),SebastianPado(HeidelbergUniversity),Alexis Palmer(SaarlandUniversity),MarthaPalmer(UniversityofColorado),RebeccaJ.Passonneau(Columbia University),MichaelJ.Paul(JohnsHopkinsUniversity),AnselmoPen˜as(NLP&IRGroup,UNED),Sasa Petrovic,MohammadTaherPilehvar(SapienzaUniversityofRome),ManfredPinkal(SaarlandUniversity), EmilyPitler(UniversityofPennsylvania),LauraPlaza,MassimoPoesio(UniversityofEssex),Tamara Polajnar(UniversityofCambridge), SimonePaoloPonzetto(UniversityofMannheim), HoifungPoon (MicrosoftResearch),octavianpopescu(FBK-irst),MattPost(JohnsHopkinsUniversity),Alexandros Potamianos(TechnicalUniversityofCrete),RichardPower,VinodkumarPrabhakaran(ColumbiaUniver- sity),StephenPulman(OxfordUniversity),UweQuasthoff,CarlosRamisch(Universite´ JosephFourier), DelipRao(JohnsHopkinsUniversity),ReinhardRapp(Aix-MarseilleUniversite´),JonathonRead(Univer- sityofOslo),MartaRecasens(StanfordUniversity),SivaReddy(UniversityofEdinburgh),InesRehbein (PotsdamUniversity),JosephReisinger,AntonioReyes(LaboratoriodeTecnolog´ıasLingu¨´ısticas,Instituto SuperiordeInte´rpretesyTraductores),HannesRieser,GermanRigau(UPV/EHU),EllenRiloff(University ofUtah),LauraRimell(UniversityofCambridge),AlanRitter(UniversityofWashington),HoracioRo- driguez(UPC),CarolynRose(CarnegieMellonUniversity),AndrewRosenberg(CUNYQueensCollege), PaoloRosso(UniversitatPolite`cnicadeVale`ncia),JosefRuppenhofer,patricksaint-dizier(IRIT-CNRS), MarkSammons(UniversityofIllinoisatUrbana-Champaign),FernandoSa´nchez-Vega(Laboratoriode Tecnolog´ıas del Lenguaje, Instituto Nacional de Astrof´ısica, O´ptica y Electro´nica, Puebla, Estado de Me´xico), MarinaSantini, ChristinaSauper, RoserSaur´ı(BarcelonaMedia), HansenAndrewSchwartz (UniversityofPennsylvania),AliakseiSeveryn(UniversityofTrento),EhsanShareghi(ConcordiaUni- versity-Master’sStudent),EyalShnarch(BarIlanUniversity),NirajShrestha(KUL),EkaterinaShutova (UniversityofCaliforniaatBerkeley),RaviSinha,GabrielSkantze(KTHSpeechMusicandHearing),Aitor Soroa(assistantlecturer),CarolineSporleder(TrierUniversity),ManfredStede(UniversityofPotsdam), HermanStehouwer(MaxPlanckforPsycholinguistics),BennoStein,MatthewStone(RutgersUniversity), VeselinStoyanov(Facebook),MichaelStrube(HITSgGmbH),LVSubramaniam(IBMResearchIndia), Md. Sultan(UniversityofColorado-Boulder),Gyo¨rgySzarvas(NuanceCommunicationsAG),Stefan Thater (Universita¨t des Saarlandes), Kristina Toutanova (Microsoft Research), Yulia Tsvetkov (CMU), TimVandeCruys(IRIT&CNRS),AntalvandenBosch(RadboudUniversityNijmegen),EvaVecchi (CIMeC - University of Trento), Paola Velardi, Erik Velldal, Noortje Venhuizen, Sriram Venkatapathy (XeroxResearchCentreEuropel),YannickVersley(UniversityofTuebingen),DarnesVilarin˜o(Beneme´rita UniversidadAuto´nomadePuebla), AlineVillavicencio(InstituteofInformatics, FederalUniversityof RioGrandedoSUl),VeronikaVincze(UniversityofSzeged),VinodVydiswaran(UniversityofIllinois), ix RuiboWANG(ShanxiUniv. WuchengRoad92,Taiyuan,Shanxi),SaiWang(ShanxiUniversity),Xinglong Wang,Yi-ChiaWang(CarnegieMellonUniversity),BonnieWebber(UniversityofEdinburgh),JulieWeeds (University of Sussex), Ben Wellner (The MITRE Corporation), Jan Wiebe (University of Pittsburgh), MichaelWiegand(SaarlandUniversity),TheresaWilson(JHUHLTCOE),KristianWoodsend(University ofEdinburgh),DekaiWu(HKUST),StephenWu(MayoClinic),FeiyuXu(DFKILTLab),JianXu(The HongKongPolytechnicUniversity),EricYeh(SRIInternational),MichaelYip(TheHongKongInstitute ofEducation),DenizYuret(KocUniversity),RobertoZamparelli(Universita` diTrento),FabioMassimo Zanzotto(UniversityofRome”TorVergata”),LukeZettlemoyer(UniversityofWashington),andHermann Ziak(Know-CenterGmbH). ProgramCommitteeforVolume2: AmeetaAgrawal(YorkUniversity),ItziarAldabe(UniversityoftheBasqueCountry(UPV/EHU)),Marianna Apidianaki(LIMSI-CNRS),PedroBalageFilho(UniversityofSa˜oPaulo),AlexandraBalahur(European Commission Joint Research Centre), Timothy Baldwin (The University of Melbourne), Marco Baroni (University of Trento), Osman Baskaya (Koc University), Emanuele Bastianelli (University of Roma, TorVergata),WesleyBaugh(UniversityofNorthTexas),LeeBecker(AvayaLabs),SatyabrataBehera (IIT Bombay), Luisa Bentivogli (Fondazione Bruno Kessler), Steven Bethard (University of Colorado Boulder),ErgunBicici(CentreforNextGenerationLocalisation),JariBjo¨rne(UniversityofTurku),Tamara Bobic(FraunhoferSCAI),LornaByrne(UniversityCollegeDublin),MarineCarpuat(NationalResearch Council),GiuseppeCastellucci(UniversityofRoma,TorVergata),TawunratChalothorn(Universityof NorthumbriaatNewcastle),NateChambers(USNavalAcademy),AngelChang(StanfordUniversity), Karan Chawla (Indian Institute of Technology Bombay), Colin Cherry (NRC), Md. Faisal Mahbub Chowdhury (University of Trento, Italy and FBK-irst, Italy), Sam Clark (Swarthmore College), Kevin Cohen(ComputationalBioscienceProgram,U.ColoradoSchoolofMedicine),PaulCook(TheUniversity of Melbourne), Francisco M Couto (University of Lisbon), Leon Derczynski (University of Sheffield), Mohamed Dermouche (AMI Software R&D / Universite´ de Lyon, ERIC (Lyon 2)), ALBERTO DIAZ (UniversidadComplutensedeMadrid),MyroslavaDzikovska(UniversityofEdinburgh),MicheleFilannino (UniversityofManchester),Joa˜oFilgueiras(INESC-ID),Bjo¨rnGamba¨ck(NorwegianUniversityofScience andTechnology),MartinGleize(LIMSI-CNRS),YvetteGraham(TheUniversityofMelbourne,Centrefor NextGenerationLocalisation),TobiasGu¨nther(UniversityofGothenburg),YoanGutie´rrez(Universityof Matanzas),HussamHamdan(AMU),QiHan(IMS,UniversityofStuttgart),ViktorHangya(University of Szeged), Mike Heilman (Educational Testing Service), David Hope (University of Sussex), Diana Inkpen(UniversityofOttawa),HarshitJain(InternationalInstituteofInformationTechnology,Hyderabad), SergioJimenez(NationalUniversityofColombia),DavidJurgens(UniversityofCalifornia,LosAngeles), IoannisKlapaftis,NadinKo¨kciyan(BogaziciUniversity),OleksandrKolomiyets(KULeuven),Ioannis Korkontzelos(NationalCentreforTextMining,TheUniversityofManchester),MilenKouylekov(CELI S.R.L.), AmitavaKundu(JadavpurUniversity), ManLan(ECNU),NatsudaLaokulrat(TheUniversity ofTokyo),AlbertoLavelli(FBK-irst),ElsLefever(LT3,HogeschoolGent),ClementLevallois(Erasmus University Rotterdam), Omer Levy (Bar-Ilan University), Nikolaos Malandrakis (Signal Analysis and InterpretationLaboratory(SAIL),USC,LosAngeles,CA90089,USA),SureshManandhar(University of York), Morgane Marchand (CEA-LIST / CNRS-LIMSI), Eugenio Mart´ınez-Ca´mara (University of Jae´n),SaifMohammad(NationalResearchCouncilCanada),PreslavNakov(QatarComputingResearch Institute, Qatar Foundation), Roberto Navigli (Sapienza University of Rome), Sapna Negi (University ofMalta),MatteoNegri(FondazioneBrunoKessler),DiarmuidO´ Se´aghdha(UniversityofCambridge), IFEYINWAOKOYE(UniversityofColoradoatBoulder),ReynierOrtegaBueno(CERPAMID,Cuba), NielsOtt(EberhardKarlsUniversita¨tTu¨bingen),Prabupalanisamy(Serendio),JohnPavlopoulos(Athens x