Cognitive Neuroscience of Natural Language Use When wethink ofeveryday language use, thefirst things thatcome to mindincludecolloquialconversations,readingandwritingemails,send- ingtextmessagesorreadingabook.Butcanwestudythebrainbasisof languageasweuseitinourdailylives?Asatopicofstudy,thecognitive neuroscience of language is far removed from these language-in-use examples. However, recent developments in research and technology have made studying the neural underpinnings of naturally occurring language much more feasible. In this book a range of international experts provide a state-of-the-art overview of current approaches to makingthecognitiveneuroscienceoflanguagemore‘natural’andcloser to language use as it occurs in real life. The chapters explore topics including discourse comprehension, the study of dialogue, literature comprehensionandtheinsightsgainedfromlookingatnaturalspeech inneuropsychology. roel willems isaseniorresearcherattheDondersInstituteforBrain, CognitionandBehaviourandMaxPlanckInstituteforPsycholinguistics, Nijmegen,TheNetherlands. Cognitive Neuroscience of Natural Language Use Editedby Roel M. Willems UniversityPrintingHouse,CambridgeCB28BS,UnitedKingdom CambridgeUniversityPressispartoftheUniversityofCambridge. ItfurtherstheUniversity’smissionbydisseminatingknowledgeinthepursuitof education,learningandresearchatthehighestinternationallevelsofexcellence. www.cambridge.org Informationonthistitle:www.cambridge.org/9781107042018 ©CambridgeUniversityPress2015 Thispublicationisincopyright.Subjecttostatutoryexception andtotheprovisionsofrelevantcollectivelicensingagreements, noreproductionofanypartmaytakeplacewithoutthewritten permissionofCambridgeUniversityPress. Firstpublished2015 PrintedintheUnitedKingdombyClays,StIvesplc AcataloguerecordforthispublicationisavailablefromtheBritishLibrary LibraryofCongressCataloguinginPublicationdata Cognitiveneuroscienceofnaturallanguageuse/editedbyRoelM.Willems. p. ; cm. Includesbibliographicalreferencesandindex. ISBN978-1-107-04201-8(hardback) 1. Biolinguistics. 2. Neurolinguistics. 3. Languageandlanguages– Origin. 4. Naturallanguageprocessing. I. Willems,RoelM.,1980–, editor.[DNLM: 1. Language. 2. Cognition–physiology. 3. Neuropsychology.P107] P132.C64 2014 401–dc23 2014032247 ISBN978-1-107-04201-8Hardback CambridgeUniversityPresshasnoresponsibilityforthepersistenceoraccuracyof URLsforexternalorthird-partyinternetwebsitesreferredtointhispublication, anddoesnotguaranteethatanycontentonsuchwebsitesis,orwillremain, accurateorappropriate. Contents Listofplates pagevii Listoffigures ix Listofcontributors x Listofabbreviations xii 1 Cognitiveneuroscienceofnaturallanguageuse: introduction 1 roel m. willems 2 fMRImethodsforstudyingtheneurobiologyof languageundernaturalisticconditions 8 michael andric & steven l. small 3 Whystudyconnectedspeechproduction? 29 sharon ash & murray grossman 4 Situationmodelsinnaturalisticcomprehension 59 christopher a. kurby & jeffrey m. zacks 5 Languagecomprehensioninrichnon-linguistic contexts:combiningeye-trackingandevent-related brainpotentials 77 pia knoeferle 6 TheNOLBmodel:amodelofthenatural organizationoflanguageandthebrain 101 jeremy i. skipper 7 Towardsaneurocognitivepoeticsmodelofliterary reading 135 arthur m. jacobs 8 PuttingBroca’sregionintocontext:fMRIevidence foraroleinpredictivelanguageprocessing 160 line burholt kristensen & mikkel wallentin v vi Contents 9 Towardsamulti-brainperspectiveon communicationindialogue 182 anna k. kuhlen, carsten allefeld, silke anders, & john-dylan haynes 10 Onthegenerationofsharedsymbols 201 arjen stolk, mark blokpoel, iris van rooij, & ivan toni 11 Whatarenaturalisticcomprehensionparadigms teachingusaboutlanguage? 228 uri hasson & giovanna egidi Index 256 Plates Thecolorplatesectionappearsattheendofthebook. 3.1 Correlationsofcorticalatrophywithspeechratein naPPA,svPPAandbvFTD. 3.2 Correlationofgraymatteratrophywithspeechratein lvPPA. 3.3 Overlapofcorrelationsofmeasuresoflanguage productionandneuropsychologicaltestperformance withcorticalatrophyinLewybodyspectrumdisorder. 3.4 CorrelationofatrophywithnounphrasepausesinsvPPA. 3.5 Correlationofgraymatteratrophywithwell-formed sentencesinlvPPA. 3.6 Graymatteratrophyandreducedwhitematterfractional anisotropyinprimaryprogressiveaphasia,and regressionsrelatinggrammaticalitytoneuroimaging. 4.1 RegionsthatinYarkonietal.(2008)showedasignificant changeinactivityacrosstimebystorycondition,andtheir correspondingtimecourses.Reproducedwith permission. 4.2 FromEzzyatandDavachi(2011).(A)Regionsshowing anincreaseinactivityateventboundaries.(B)Regions showinganincreaseinactivityaseventsunfoldedacross time.Reproducedwithpermission. 4.3 FromEzzyatandDavachi(2011).(A)Within-event bindinginmemoryperformancewascorrelatedwith threeregionsthatincreasedinactivityaseventsunfolded. (B)Memoryforinformationineventboundarieswas correlatedwiththreeregionsthatincreasedinactivityat eventboundaries.Reproducedwithpermission. 4.4 Regions showing modality-specific imagery effects in Kurby and Zacks (2013). Reproduced with permission. vii viii Listofplates 6.1 Languageuseissupportedbymostofthebrain.Activity inlanguagecomprehensionnetworksisshownacrossall levelsandunitsoflinguisticanalysisasdeterminedbya neuroimagingmeta-analysis(Lairdetal.,2011). 6.2 CaricatureoftheNOLBmodelasappliedtoalistener whowaslookingatamovingobjectintheskyandwhois asked“Isitanairplaneorabird?”byavisibleinterlocutor. 8.1 MapofBroca’sregionbasedonthedistributionof receptorsofneurotransmittersandmodulators. Reprintedwithpermissionfromtheauthorsandfromthe publisher(Amunts&Zilles,2012,figure4). 8.2 EffectsinBroca’sareainsentenceprocessing. 10.1 TacitCommunicationGame.Reproducedwith permissionfromStolketal.(2013). 10.2 Generatingandunderstandingnovelsharedsymbols duringlivecommunicativeinteractionsinducedneural upregulation(of55–85Hzgamma-bandactivity)over righttemporalandventromedialbrainregions. ReproducedwithpermissionfromStolketal.(2013). 10.3 Asequenceofanalogicalinferencescangiverisetoan inferrednewmeaningofanovelsymbolsuchasthe “wiggle.” 10.4 Functionalimagingdata,supportedbyobservationof consequencesfollowingbraininjury,highlighta fundamentalroleforrighttemporalandventromedial prefrontalbrainregionsinthecoordinationofconceptual knowledgeincommunication. 11.1 Thekeyholeerror:theworldappearsshapedlikea keyholewhenviewedthroughone.AviewofRome throughakeyholeontheAventineHill.CopyrightClive Harris,photosoul.co.uk,usedwithpermission. 11.2 Alanguagenetwork?RegionswhereBOLDactivity trackedstory-relatedarousalinWallentinetal.(2011a). WethankM.Wallentinformakingavailablethedataused tocreatethisfigure.