Studies in Systems, Decision and Control 192 Mohammad Ali Nematollahi Samaneh Shahbazi Nashid Nabian Computer Vision and Audition in Urban Analysis Using the Remorph Framework Studies in Systems, Decision and Control Volume 192 Series editor Janusz Kacprzyk, Polish Academy of Sciences, Warsaw, Poland e-mail: [email protected] The series “Studies in Systems, Decision and Control” (SSDC) covers both new developments and advances, as well as the state of the art, in the various areas of broadly perceived systems, decision making and control–quickly, up to date and withahighquality.Theintentistocoverthetheory,applications,andperspectives on the state of the art and future developments relevant to systems, decision making,control,complexprocessesandrelatedareas, asembeddedinthefieldsof engineering,computerscience,physics,economics,socialandlifesciences,aswell astheparadigmsandmethodologiesbehindthem.Theseriescontainsmonographs, textbooks, lecture notes and edited volumes in systems, decision making and control spanning the areas of Cyber-Physical Systems, Autonomous Systems, Sensor Networks, Control Systems, Energy Systems, Automotive Systems, Biological Systems, Vehicular Networking and Connected Vehicles, Aerospace Systems, Automation, Manufacturing, Smart Grids, Nonlinear Systems, Power Systems, Robotics, Social Systems, Economic Systems and other. Of particular valuetoboththecontributorsandthereadershiparetheshortpublicationtimeframe and the world-wide distribution and exposure which enable both a wide and rapid dissemination of research output. More information about this series at http://www.springer.com/series/13304 Mohammad Ali Nematollahi Samaneh Shahbazi Nashid Nabian (cid:129) Computer Vision and Audition in Urban Analysis Using the Remorph Framework 123 Mohammad Ali Nematollahi NashidNabian Tehran Urban Innovation Center(TUIC) Tehran Urban Innovation Center(TUIC) Tehran,Iran Tehran,Iran Samaneh Shahbazi Tehran Urban Innovation Center(TUIC) Tehran,Iran ISSN 2198-4182 ISSN 2198-4190 (electronic) Studies in Systems,DecisionandControl ISBN978-981-13-3542-6 ISBN978-981-13-3543-3 (eBook) https://doi.org/10.1007/978-981-13-3543-3 LibraryofCongressControlNumber:2018963031 ©SpringerNatureSingaporePteLtd.2019 Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpart of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission orinformationstorageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilar methodologynowknownorhereafterdeveloped. The use of general descriptive names, registered names, trademarks, service marks, etc. in this publicationdoesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfrom therelevantprotectivelawsandregulationsandthereforefreeforgeneraluse. The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication. Neither the publisher nor the authorsortheeditorsgiveawarranty,expressorimplied,withrespecttothematerialcontainedhereinor for any errors or omissions that may have been made. The publisher remains neutral with regard to jurisdictionalclaimsinpublishedmapsandinstitutionalaffiliations. ThisSpringerimprintispublishedbytheregisteredcompanySpringerNatureSingaporePteLtd. Theregisteredcompanyaddressis:152BeachRoad,#21-01/04GatewayEast,Singapore189721, Singapore This book is dedicated to those who are dedicated to production of knowledge. Preface Heterogeneous, dynamic, multi-layer, and complex network structuresof cities are challenging architects and urban scientists when it comes to understanding, pre- dicting, planning, and designing the urban environment. To understand complex urban systems applying AI technologies is going to be inevitable.Amongmany possible computational solutions,this bookisfocusedon practical aspects of computer vision and computer audition as analytical tools for registration and understanding of urban phenomena. To best of our knowledge, this book might be the first multidisciplinary effort between urban scientists and AI experts to qualitatively and qualitatively decode and better understand urban dynamics. The book builds on the outcome of a series of workshops targeting under- standing the space of the city using computer vision and audition. Coined as Remorph workshops, the series followed a pedagogical framework tailored for post-graduate researchers, interested in matters pertaining to urban studies. This book is written to cover possible applications of computer vision and computeraudition inurban studies and,itissuitableforbeginners whodon’thave any information about AI concepts. Its technical language would be simple for architects,urbanplannersandurbandesignerswithnopriorknowledgeincomputer vision and audition. Overallconceptsandapplicationtechniquesforcomputervisionandauditionare discussedinseparatechapters.Assuch,thebookisstructuredandorganizedinsuch awaythatreaderscanchoosetofocusonstandalonechaptersthatareofinterestto their researchagenda.In each chapter,references areprovided for furtherstudies. Although the authors have tried to provide an expansive classification of tech- niquesandtrendsinthebeginningofeachchapter,theydeclarethatthereisalwaysa possibility for improvement of the provided classifications. Therefore, suggestions fromaudienceforenhancingthebook’sstructureandcontentwillbemostwelcomed. Tehran, Iran Mohammad Ali Nematollahi September 2018 Samaneh Shahbazi Nashid Nabian vii Acknowledgements WewouldliketorecordmygratitudetooureditorsDr.LoyolaDSilvaandMr.Ravi Vengadachalamfortheirguidance,advice,andcontinuoussupportduringtheentire course ofthis book. We also would like to express our special thanks to Tehran Urban Innovation Center(TUIC)forprovidingabeautiful,peaceful,andcalmacademicenvironment for research and study that went to production of this book. Tehran, Iran Mohammad Ali Nematollahi September 2018 Samaneh Shahbazi Nashid Nabian ix About This Book Remorph: A Framework for Application of Computer Vision and Audition in Urban Analysis ArtificialIntelligent(AI)isbeingadoptedbyallscientificdisciplines.However,due to conservative nature of disciplines that are engaged with spatial practices, including architecture, urban design and urban planning, adapting theories of AI includingcomputer visionand computer audition hasbeen achallengetothis day. This book is a try in overcoming this challenge using a conceptual framework, which is merging computer vision and audition to urban studies based on the outcome of a series of workshops, called, Remorph, developed and ran by Tehran Urban Innovation Center (TUIC), between September 2017 and June 2018. Thebookcovershighlevelconcepts,applicationsandtechniquesandtheoretical discussionsofcomputervisionandauditionastheycanrelatetourbanstudiesand analysis of urban built form. In conclusion of the book, a future trend of “Smart” urban analysis is discussed. August 2018 Mohammad Ali Nematollahi Samaneh Shahbazi Nashid Nabian xi Contents 1 Application of AI in Urban Design. . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.1 Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.2 Book Structure . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1 1.3 Situating the Question in the General Field of Inquiry . . . . . . . . 2 1.4 Remorph as an Analytical Tool for Urban Studies . . . . . . . . . . . 4 1.4.1 ComputerVisionandItsApplicationinUrbanPlanning and Design . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 1.4.2 A Brief History of Computer Audition and Its Application in Urban Planning and Design . . . . . . . . . . . 7 1.4.3 ABriefHistoryofDataVisualizationinUrbanPlanning and Design . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 1.4.4 A Brief History of City as a Cybernetic Mechanism and Application of Data-Driven Analysis in Urban Planning and Design . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 2 Computer Audition in Urban Studies: Theory, Techniques and Rules of Application. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 2.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 2.2 Disambiguation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 2.3 Finding a Question, Identifying Perfect Strategy of Auditory Data Collection and Urban Sonification . . . . . . . . . . . . . . . . . . . 15 2.3.1 Single Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.3.2 Multi Array of Sensors. . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.3.3 Pointwise Sound Acquisition . . . . . . . . . . . . . . . . . . . . . 17 2.3.4 Linear Sound Acquisition. . . . . . . . . . . . . . . . . . . . . . . . 17 2.4 Understanding Theory, Techniques and Rules of Producing Urban Soundscapes. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 2.4.1 Spatial Soundscapes. . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 2.4.2 Temporal Soundscapes. . . . . . . . . . . . . . . . . . . . . . . . . . 21 2.5 Understanding Theory, Techniques and Rules of Audio- Metrication. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21 xiii