PSYCHOLOGY LIBRARY EDITIONS: COGNITIVE SCIENCE Volume 22 CONNECTIONIST APPROACHES TO NATURAL LANGUAGE PROCESSING This page intentionally left blank CONNECTIONIST APPROACHES TO NATURAL LANGUAGE PROCESSING Edited by RONAN G. REILLY AND NOEL E. SHARKEY Firstpublishedin1992byLawrenceErlbaumAssociatesLtd. Thiseditionfirstpublishedin2017 byRoutledge 2ParkSquare,MiltonPark,Abingdon,OxonOX144RN andbyRoutledge 711ThirdAvenue,NewYork,NY10017 RoutledgeisanimprintoftheTaylor&FrancisGroup,aninformabusiness ©1992byLawrenceErlbaumAssociatesLtd. Allrightsreserved.Nopartofthisbookmaybereprintedorreproducedorutilised inanyformorbyanyelectronic,mechanical,orothermeans,nowknownor hereafterinvented,includingphotocopyingandrecording,orinanyinformation storageorretrievalsystem,withoutpermissioninwritingfromthepublishers. Trademarknotice:Productorcorporatenamesmaybetrademarksorregistered trademarks,andareusedonlyforidentificationandexplanationwithoutintentto infringe. BritishLibraryCataloguinginPublicationData AcataloguerecordforthisbookisavailablefromtheBritishLibrary ISBN:978-1-138-19163-1(Set) ISBN:978-1-315-54401-4(Set)(ebk) ISBN:978-1-138-64006-1(Volume22)(hbk) ISBN:978-1-315-63686-3(Volume22)(ebk) Publisher’sNote Thepublisherhasgonetogreatlengthstoensurethequalityofthisreprintbut pointsoutthatsomeimperfectionsintheoriginalcopiesmaybeapparent. Disclaimer Thepublisherhasmadeeveryefforttotracecopyrightholdersandwouldwelcome correspondencefromthosetheyhavebeenunabletotrace. Connectionist Approaches to Natural Language Processing edited by Ronan G. Reilly Department of Computer Science, University College Dublin, Ireland Noel E. Sharkey Department of Computer Science, University of Exeter, U.K. MA LAWRENCE ERLBAUM ASSOCIATES, PUBLISHERS fl^/A EA Hove (UK) Hillsdale (USA) Copyright © 1992 by Lawrence Erlbaum Associates Ltd. All rights reserved. No part of this book may be reproduced in any form, by photostat, microform, retrieval system, or any other means without the prior written permission of the publisher. Lawrence Erlbaum Associates Ltd., Publishers 27 Palmeira Mansions Church Road Hove East Sussex, BN3 2FA U.K. British Library cataloguing in Publication Data Connectionist approaches to natural language processing I. Reilly, Ronan G., 1955- II. Sharkey, N.E. (Noel E) 006.35 ISBN 0-86377-179-3 Typeset by DP Photosetting, Aylesbury, Bucks. Printed and bound by BPCC Wheatons, Exeter. We dedicate this book to our daughters Aifric Reilly and Autumn Sharkey who were bom while we were preparing it. This page intentionally left blank Contents List of Contributors xii Preface xiv 1 Connectionist Natural Language Processing 1 Noel E. Sharkey and Ronan Reilly Introduction 1 Overview of chapters 5 Acknowledgements 9 References 9 PARTI SEMANTICS Introduction 15 2 Distributed Symbol Discovery through Symbol Recirculation: Toward Natural Language Processing in Distributed Connectionist Networks 21 Michael G. Dyer, Margot Flowers, and Yih-Jih Alan Wang Introduction 21 Natural language processing: Constraints from the task domain 22 Dynamic vs. static symbol representations 25 Symbol recirculation 27 Encoding semantic networks in DUAL: A distributed connectionist architecture 29 Other symbol recirculation methods 38 Open problems 40 vii