Perspectives in Neural Computing Springer London Berlin Heidelberg NewYork Barcelona HongKong Milan Paris SantaClara Singapore Tokyo Alsointhisseries J.G.Taylor ThePromiseofNeuralNetworks 3-540-19773-7 MariaMarinaroandRobertoTagliaferri(Eds) NeuralNets-WIRNVIETRI-96 3-540-76099-7 AdrianShepherd Second-OrderMethodsforNeuralNetworks 3-540-76100-4 JasonKingdon IntelligentSystemsandFinancialForecasting 3-540-76098-9 DimitrisC.Dracopoulos EvolutionaryLearningAlgorithmsforNeuralAdaptiveControl 3-540-76161-6 M.Karny,K.WarwickandV.Ku.rkova(Eds) DealingwithComplexity:ANeuralNetworksApproach 3-540-76160-8 JohnA. Bullinaria,DavidW. GlasspoolandGeorgeHoughton(Eds) 4thNeuralComputationandPsychologyWorkshop,London, 9-11April1997:ConnectionistRepresentations 3-540-76208-6 MariaMarinaroandRobertoTagliaferri(Eds) NeuralNets-WIRNVIETRI-97 3-540-76157-8 L.J.LandauandJ.G.Taylor(Eds) ConceptsforNeuralNetworks: ASurvey 3-540-76163-2 GustavoDecoandDraganObradovic AnInformation-TheoreticApproachtoNeuralComputing 0-387-94666-7 ThomasLindbladandJasonM. Kinser ImageProcessingusingPulse-CoupledNeuralNetworks 3-540-76264-7 L.Niklasson,M.BodenandT. Ziemke(Eds) ICANN98 3-540-76263-9 Maria Marinaro and Roberto Tagliaferri (Eds) Neural Nets WIRN VIETRI-98 Proceedingsofthe 10thItalianWorkshop on Neural Nets,Vietrisul Mare,Salerno,Italy,21-23 May1998 SocietaItalianaRetiNeuroniche{SIREN) • InternationalInstituteforAdvancedScientificStudies UE.R.Caianiellou {IIASS) • IEEENNC • INNS-SIGltalia • DepartmentofComputerScienceandApplications, "R.M.Capocelli",UniversityofSalerno • DepartmentofInformationScience,UniversityofMilan • DepartmentofPhysicsUE.R.Caianiello",UniversityofSalerno • ElsagBailey(Genova) • IstitutoltalianopergliStudiFilosofici(Napies) • ProvinciadiSalerno Springer ProfessorMariaMarinaro DipartimentodiScienzeFisiche"E.R.Caianiello" UniversitadiSalemo,84081Baronissi(SA),ltaly DrRobertoTagliaferri DipartirnentodiInformaticaedApplicazioni"R.M.Capocelli" UniversitadiSalemo,84081Baronissi(SA),ltaly SeriesEditor J.G.Taylor,BA,BSc,MA,PhD,FlnstP CentreforNeuralNetworks, DepartmentofMathematics,King'sCollege, Strand,LondonWC2R2LS,UK ISBN-13: 978-1-4471-1208-2 Springer-Verlag London Berlin Heidelberg BritishLibraryCataloguinginPublicationData AcataloguerecordforthisbookisavailablefromtheBritishLibrary LibraryofCongressCataloging-in-PublicationData ItalianWorkshoponNeuralNets(10th: 1998 : VietrisulMare,Italy) Neuralnets,WIRNVietri-98 : TenthItalianWorkshoponNeural Nets,VietrisulMare,Salerno,21-23May1998 / MariaMarinaroand RobertoTagliaferri,eds. ; [jointlyorganizedbylSocietaitaliana retineuroniche(SIREN)...letal.l. p. cm. -- (Perspectivesinneuralcomputing) Includesbibliographicalreferences. ISBN-13:978-1-4471-1208-2 e-ISBN-13:978-1-4471-0811-5 DOI:10.1007/978-1-4471-0811-5 1.Neuralnetworks(Computerscience)--Congresses. I.Marinaro, M. 11.Tagliaferri,Roberto. III.Societaitalianareti neuroniche. IV.Series. QA76.87.I85 1998 98-38064 006.3'2--dc21 CIF Apart from any fair dea1ing for the purposes ofresearch or private study, or criticism or review, as permittedundertheCopyright,DesignsandPatentsAct 1988,thispublicationmayonlybereproduced, storedortransmitted,inanyformorbyanymeans,withthepriorpermissioninwritingofthepublishers, or in the case ofreprographic reproduction in accordance with the terms oflicences issued by the CopyrightLicensingAgency. Enquiriesconcerningreproductionoutsidethosetermsshouldbesenttothe publishers. ©Springer-VerlagLondonLimited1999 SoftcoverreprinrofthehardcoverIsredition1999 Theuseofregisterednames,trademarksetc.inthispublicationdoesnotimply,evenintheabsenceofa specificstatement,thatsuchnamesareexemptfromtherelevantlawsandregulationsandthereforefree forgeneraluse. Thepublishermakesnorepresentation,expressorimplied,withregardtotheaccuracyoftheinformation containedinthisbookandcannotacceptanylegalresponsibilityorliabilityforanyerrorsoromissions thatmaybemade. Typesetting:Camerareadybycontributors 34/3830-543210Printedonacid-freepaper Preface ThisvolumecontainstheProceedingsofthe 10thItalian Workshop onNeuralNets WIRN VIETRI-98, jointly organized by the International Institute for Advanced Scientific Studies "Eduardo R. Caianiello" (HASS), the Societa Italiana Reti Neuroniche(SIREN),theIEEENNCItalianRIGandtheItalianSIGoftheINSS. This volume is dedicated to Marco Protasi, a leading scientist in the fields of Algorithmics, Computability, Discrete Mathematics and Neural Networks, who died on 1stFebruary 1998. Abiographical sketch ofProfessor ProtasibyStefano Fanelliisincluded. Following the tradition ofprevious years, we invited two foreign scientists to the workshop, Professor P. Baldi and Professor D. Saad, who respectively presented the lectures "Software Foundation Libraries for Intelligent Systems" and "Theoretical Approaches to On-Line Learning in Smooth Multilayer Networks". In addition, a review talk was presented, dealing with a very up-to-date topic: "Combining Neural Networks and Hidden Markov Models for Speech Recognition". Alarge partofthe book contains original contributions approved bythe referees as oral or poster presentations which have been assembled for reading convenience into 3sections: Architectures andAlgorithms, MathematicalModels, PatternRecognitionandSignalProcessing. Theeditorswouldliketothanktheinvitedspeakers,thereviewlecturerandall the contributors whose highly qualified papers helped with the success of the workshop. Finally,specialthanksgototherefereesfortheiraccuratework. MariaMarinaro RobertoTagliaferri Organizing-ScientificCommittee: B. Apolloni (Univ. Milano) A. Bertoni (Univ. Milano), N.A. Borghese (CNR Milano), P. Carnpadelli (Univ. Milan0), D.D. Caviglia (Univ. Genova), A. Colla (ELSAG BAILEY - Genova), A. Esposito (IIASS), M. Frixione (IlASS), C. Furlanello (IRST - Trento) M. Gori (Univ. Siena), G.M. Guazzo (IlASS), F. Lauria (Univ. Napoli), M. Marinaro (Univ. Salerno - IIASS), F. Masulli (Univ. Genova), F.C. Morabito (Univ. Reggio Calabria), P. Morasso (Univ. Genova), G. Orlandi (Univ. Roma), T. Parisini (Univ. Trieste), E. Pasero (Politecnico Torin0), A. Petrosino (INFM), V. Piuri (Politecnico di Milano), S. Rampone (IlASS), R. Serra (CRA Montecatini - Ravenna), F. Sorbello (Univ. Palermo), R. Tagliaferri (Univ. Salerno). Referees: Apolloni B.) Bertoni A.) Biella G.) Borghese N.A.) Burattini E.) Burrascano P.) Campadelli P.) Caviglia D.) Chella A.) Colla A.M.) Costa M.) De Gregorio M.) Di Claudio E.D.) Esposito A.) Frattale Mascioli F.M.) Frisone F.) Frixione M.) Furlanello C.) Giuliani D.) Gori M., Lauria F.) Malcheoni D., Marinaro M., Masulli F., Morabito F.C.) Morasso P., Orlandi G.) Palmieri F.) Parisi R., Parisini T.) Pasero E.) Petrosino A.) Piuri V,) Rampone S., Serra R.) Sperduti A.) Tagliaferri R. Thesponsorshipandsupportof: • Societa Italiana Reti Neuroniche (SIREN) • International Institute for Advanced ScientificStudies "E.R. Caianiello" (HASS) • IEEENNC • INNS - SIGItalia • DepartmentofComputerScience and Applications, "R.M. Capocelli", UniversityofSalerno • Department ofInformationScience, UniversityofMilan • DepartmentofPhysics "E.R. Caianiello", UniversityofSalerno • EisagBailey(Genova) • Istituto Italianoper gli Studi Filosofici (Napies) • Provinciadi Salerno aregratefullyacknowledged Contents Sedion1-MarcoProtasiLedures 1 InMemoryofMarcoProtasi S.Fanelli 3 ComputationalSuspiciousnessofLearninginArtificialNeuralNets S.Fanelli,P.Frasconi,M. Gori,M.Protasi 9 Sedion2.InvitedPapers 17 SoftwareFoundationLibrariesforIntelligentSystems P.Baldi, Y. Chauvin, V. Mittal-Henkle 19 TheoreticalApproachestoOn-LineLearninginSmoothMultilayerNets D.Saad,M.Rattray 40 Section3-ReviewPaper 61 CombiningNeuralNetworksandHiddenMarkovModelsforSpeech Recognition E. Trentin,M.Gori 63 Sedion4-EduardoR.CaianielloLecture 81 CellularNeuralNetworks: AnApproachtoCircuitDesignandInformation Proces~ing. ' . G.Settz,P. Thzran, C.Serpzco 83 Section5.MathematicalModels 101 CorrelationCollapseUnderPersistentInputDerangementintheNervous System. FittingpRAMModelsforThalamo-CorticalCircuits B.Apolloni,D.deFalco,S.Iamundo, G.Biella,M.L. Sotgiu, T. Clarkson,I.G. Taylor 103 ANewIncrementalStrategyforFunctionApproximationbyRadialBasis FunctionNeuralNetworks A.Esposito,M.Marinaro,D.Oricchio,S.Scarpetta 113 Soft-CompetitiveVersusEMLearninginCorticalMapModeling F.Frisone,P.G.Morasso 120 Spatio-TemporalCorticalActivityPatternsinCognitiveTasksUsingfMRI F. Frisone,P.G.Morasso, G.Ianno,M.Marongiu,P. Vitali, G.Rodriguez 126 SupportVectorMachineforNonparametricBinaryHypothesisTesting D.Mattera,F.Palmieri 132 VIII LearningtheAmplitudeofActivationFunctionsinLayeredNetworks E. Trentin 138 TheBRAINLearningAlgorithm S.Rampone 145 TrainingDataSelectionforOptimalGeneralizationwithNoiseVariance ReductioninNeuralNetworks S. Vijayakumar,M.Sugiyama, H. Ogawa 153 Sedion6·PatternRecognitionandSignalProcessing 167 AstronomicalObjectRecognitionbyMeansofNeuralNetworks R. Tagliaferri, G.Longo,S.Andreon,S.Zaggia,N. Gapuano, G. Gargiulo 169 LearningtoBalanceaPoleonaMovableCartThroughRL: WhatCanBe GainedUsingAdaptiveNN? N.A. Borghese, G.Biemmi,F.LoMonaco 179 Mean-FieldNeuralNetworksforAntennaArrayDiagnostics G. Gastaldi, V. Pierro,I.M. Pinto 185 IntitialLetterSpottingasaComplementaryFeatureforLexicalFilteringof CursiveWords A.M.Golla,A.Lorenzon 195 VisualPersonLocalizationwithDynamicNeuralFields:TowardsaGesture RecognitionSystem A.Gorradini, U.D.Braumann,A.Brakensiek,M.Krabbes,H.-].Boehme, H.-M. Gross 201 PhonemeClassificationUsingaRasta-PLPPreprocessingAlgorithmanda TimeDelayNeuralNetwork:PerformanceStudies A.Esposito,E.G.Ezin 207 ANeuralSystemforRemoteSensingMultispectralImageClassification M.L. Gonfalves 218 InvarianceofWNNsPerformanceforPatternRecognitionTesting TranslatedImageInputSpaces S.Laurin,R.MitchelI........................................................................................................ 224 TheCALMAProject:ComputerAssistedLibraryforMAmmography V.M. Marzulli 230 ExploitationofFuzzyInformationforTokamakPlasmaShapeRecognition F.G.Morabito,M. Versaci 236 NewResultsinImageCompressionThroughM.A.LA.NeuralNetworks G.Pappalardo,D.Rosaci,G.M.L.Same 242 TheEffectofPublicSectorontheFinancialSector:AnNNApproachina ViewofComplexity M.R. Alfano,M.Salzano 248 IX AHybridFrarneworkforIndoorRobotNavigation E. Trentin,R. Cattoni 255 Sedion7-ArchiteduresandAigorithms 265 TrainingFeedforwardNeuralNetworks:ConvergenceandRobustness Analysis A.Alessandri,M.Maggiore,M.Sanguineti 267 SolvingtheTravellingSalesmanProblemUsingtheKohonenNetwork IncorporatingExplicitStatistics B.]. Oommen,N.Aras,I.K.Altinel................................................................................. 273 BoostingLearningAlgorithmsfortheColorimetricCharacterizationof ColorPrinters A.Artusi,P. Campadelli,R.Schettini 283 HandwrittenCharacterRecognitionwithanAnalogFeatureExtraction Module G.M.Bo,D.D. Caviglia,M. Valle 290 AHighPerformancesandHighVersatilityReconfigurableSystemforFast PrototypingofDigitalNeuralNetworkBasedonFPGA M. Costa,D.Palmisano,E.Pasero,L.BovioFerassa,A.DiLello 296 AL-BasedEnergyFunctionforSEPrediction A.I.Cristea, T. Okamoto 304 RobustProcessingofVisualEvokedPotentials E.D.DiClaudio, G.Falvo,R.Parisi,R.Perilli, G.Orlandi 310 ConvergencePropertiesoftheCircularCascadeCorrelationAlgorithm G.P.Drago,S.Ridella 319 NeuralLearningandWeightFlowonStiefelManifold S.Fiori,A. Uncini,F. Piazza 325 FromBehaviortoVHDL: ACADEnvironmentforSPNNs W. Fornaciari, V. Piu'ri,F.Salice 334 IncrePlentalMin-MaxNetwork.Part2:ContinuousandDiscreteSpaces F.M. FrattaleMascioli,M.Biancavilla,A.Rizzi 340 AnAdaptableBooleanNeuralNetObtainedbyConnectingSevenNode Assemblies F.E.Lauria,R.Prevete,M.Milo, S. Visco 347 AComparativeEvaluationofConstructiveSequentialMethods M.Muselli 353 AUnifiedApproachtoSequentialConstructiveMethods M.Muselli 359 SOMLib:ADistributedDigitalLibrarySystemBasedonSelf-Organizing Maps A.Rauber c......................................................... 365 x IncrementalMin-MaxNetwork. Part1:ContinuousSpaces A.Rizzi,M.Biancavilla,F.M.FrattaleMascioli 371 TangentModels:ComparingtheTD-NeuronConstructiveAlgorithm VersusSVDBasedAlgorithms D.Sona,A.Sperduti,A.Starita 377 ANeuralMulti-AgentArchitectureforanAutonomousMobileRobot Control S. Vitabile, F. Torterolo, F.Sorbello 383 AuthorIndex 389