Mohamed Chetouani Jeffrey Cohn Albert Ali Salah (Eds.) 7 Human Behavior 9 9 9 S Understanding C N L 7th International Workshop, HBU 2016 Amsterdam, The Netherlands, October 16, 2016 Proceedings 123 Lecture Notes in Computer Science 9997 Commenced Publication in 1973 Founding and Former Series Editors: Gerhard Goos, Juris Hartmanis, and Jan van Leeuwen Editorial Board David Hutchison Lancaster University, Lancaster, UK Takeo Kanade Carnegie Mellon University, Pittsburgh, PA, USA Josef Kittler University of Surrey, Guildford, UK Jon M. Kleinberg Cornell University, Ithaca, NY, USA Friedemann Mattern ETH Zurich, Zurich, Switzerland John C. Mitchell Stanford University, Stanford, CA, USA Moni Naor Weizmann Institute of Science, Rehovot, Israel C. Pandu Rangan Indian Institute of Technology, Madras, India Bernhard Steffen TU Dortmund University, Dortmund, Germany Demetri Terzopoulos University of California, Los Angeles, CA, USA Doug Tygar University of California, Berkeley, CA, USA Gerhard Weikum Max Planck Institute for Informatics, Saarbrücken, Germany More information about this series at http://www.springer.com/series/7412 Mohamed Chetouani Jeffrey Cohn (cid:129) Albert Ali Salah (Eds.) Human Behavior Understanding 7th International Workshop, HBU 2016 Amsterdam, The Netherlands, October 16, 2016 Proceedings 123 Editors MohamedChetouani Albert Ali Salah UniversitéPierre etMarie Curie BogaziciUniversity Paris Bebek,Istanbul France Turkey Jeffrey Cohn University of Pittsburgh Pittsburgh, PA USA ISSN 0302-9743 ISSN 1611-3349 (electronic) Lecture Notesin Computer Science ISBN 978-3-319-46842-6 ISBN978-3-319-46843-3 (eBook) DOI 10.1007/978-3-319-46843-3 LibraryofCongressControlNumber:2016952516 LNCSSublibrary:SL6–ImageProcessing,ComputerVision,PatternRecognition,andGraphics ©SpringerInternationalPublishingAG2016 Thisworkissubjecttocopyright.AllrightsarereservedbythePublisher,whetherthewholeorpartofthe material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storageandretrieval,electronicadaptation,computersoftware,orbysimilarordissimilarmethodologynow knownorhereafterdeveloped. Theuseofgeneraldescriptivenames,registerednames,trademarks,servicemarks,etc.inthispublication doesnotimply,evenintheabsenceofaspecificstatement,thatsuchnamesareexemptfromtherelevant protectivelawsandregulationsandthereforefreeforgeneraluse. Thepublisher,theauthorsandtheeditorsaresafetoassumethattheadviceandinformationinthisbookare believedtobetrueandaccurateatthedateofpublication.Neitherthepublishernortheauthorsortheeditors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissionsthatmayhavebeenmade. Printedonacid-freepaper ThisSpringerimprintispublishedbySpringerNature TheregisteredcompanyisSpringerInternationalPublishingAG Theregisteredcompanyaddressis:Gewerbestrasse11,6330Cham,Switzerland Preface The HBU workshops gather researchers dealing with the problem of modeling human behavior under its multiple facets (expression of emotions, display of complex social andrelationalbehaviors,performanceofindividualorjointactions,etc.).Thisyear,the seventhedition oftheworkshop was organized withchallenges ofdesigning solutions with children in mind, with the cross-pollination of different disciplines, bringing together researchers of multimedia, robotics, HCI, artificial intelligence, pattern recognition, interaction design, ambient intelligence, and psychology.The diversityof humanbehavior,therichnessofmulti-modaldatathatarisesfromitsanalysis,andthe multitude of applications that demand rapid progress in this area ensure that the HBU workshops provide a timely and relevant discussion and dissemination platform. The HBU workshops were previously organized as satellite events to the ICPR (Istanbul,Turkey,2010),AMI(Amsterdam,TheNetherlands,2011),IROS(Vilamoura, Portugal, 2012), ACM Multimedia (Barcelona, Spain, 2013), ECCV (Zurich, Switzerland, 2014) and UBICOMP (Osaka, Japan, 2015) conferences, with different focus themes. The focusthemeofthisyear’sHBUworkshopwas“BehaviorAnalysis and Multimedia for Children.” With each passing year, children begin using computers and related devices at youngerandyoungerages.Theinitialageofcomputerusageissteadilygettinglower, yettherearemanyopenissuesinchildren’suseofcomputersandmultimedia.Inorder to tailor multimedia applications to children, we need smarter applications that understand and respond to the users’ behavior, distinguishing children and adults if necessary. Collecting data from children and working with children in interactive applicationscallforadditionalskillsandinterdisciplinarycollaborations.Subsequently, this year’s workshop promoted research on the automatic analysis of children’s behavior. Specifically, the call for papers solicited contributions on age estimation, detection of abusive and aggressive behaviors, cyberbullying, inappropriate content detection, privacy and ethics of multimedia access for children, databases collected from children, monitoring children during social interactions, and investigations into children’s interaction with multimedia content. The keynote speakers of the workshop were Dr. Paul Vogt (Tilburg University), with a talk entitled “Modelling Child Language Acquisition in Interaction from Cor- pora”andDr.IsabelaGranic(RadboudUniversityNijmegen),withatalkon“Bridging Developmental Science and Game Design to Video Games That Build Emotional Resilience.” We thank our keynotes for their contributions. This proceedings volume contains the papers presented at the workshop. We received 17 submissions, of which 10 were accepted for oral presentation at the workshop (the acceptance rate is 58 %). Each paper was reviewed by at least two membersoftheTechnical Program Committee.Thepaperssubmittedbytheco-chairs were handled by other chairs both during reviewing and during decisions. The Easy- Chair system was used for processing the papers. The present volume collects the VI Preface accepted papers, revised for the proceedings in accordance with reviewer comments, and presented at the workshop. The papers are organized into thematic sections on “Behavior Analysis During Play,” “Daily Behaviors,” “Vision-Based Applications,” and “Gesture and Movement Analysis.” Together with the invited talks, the focus theme was covered in one paper session as well as in a panel session organized by Dr. Rita Cucchiara (University of Modena and Reggio Emilia). We would like to take the opportunity to thank our Program Committee members and reviewers for their rigorous feedback as well as our authors and our invited speakers for their contributions. October 2016 Mohamed Chetouani Jeffrey Cohn Albert Ali Salah Organization Conference Co-chairs Mohamed Chetouani Université Pierre et Marie Curie, France Jeffrey Cohn Carnegie Mellon University and University of Pittsburgh, USA Albert Ali Salah Boğaziçi University, Turkey Technical Program Committee Elisabeth André Universität Augsburg, Germany Lisa Anthony University of Florida, USA Oya Aran Idiap Research Institute, Switzerland Antonio Camurri University of Genoa, Italy Marco Cristani University of Verona, Italy Abhinav Dhall University of Canberra, Australia Hamdi Dibeklioğlu Delft University of Technology, The Netherlands Weidong Geng Zhejiang University, China Hatice Gunes University of Cambridge, UK Sibel Halfon Bilgi University, Turkey Zakia Hammal Carnegie Mellon University, USA Dirk Heylen University of Twente, The Netherlands Andri Ioannou Cyprus University of Technology, Cyprus Mohan Kankanhalli National University of Singapore, Singapore Alexey Karpov SPIIRAS, Russia Heysem Kaya Namık Kemal University, Turkey Cem Keskin Microsoft Research, USA Hatice Kose Istanbul Technical University, Turkey Ben Kröse University of Amsterdam, The Netherlands Matei Mancas University of Mons, Belgium Panos Markopoulos Eindhoven University of Technology, The Netherlands Louis-Philippe Morency Carnegie Mellon University, USA Florian Mueller RMIT, Australia Helio Pedrini University of Campinas, Brazil Francisco Florez Revuelta Kingston University, UK Stefan Scherer University of Southern California, USA Ben Schouten Eindhoven University of Technology, The Netherlands Suleman Shahid University of Tilburg, The Netherlands Reiner Wichert AHS Assisted Home Solutions, Germany Bian Yang Norwegian University of Science and Technology, Norway VIII Organization Additional Reviewers Necati Cihan Camgöz Irtiza Hasan Giorgio Roffo Ahmet Alp Kındıroğlu Contents Behavior Analysis During Play EmoGame: Towards a Self-Rewarding Methodology for Capturing Children Faces in an Engaging Context. . . . . . . . . . . . . . . . . . . . . . . . . . . 3 Benjamin Allaert, José Mennesson, and Ioan Marius Bilasco Assessing Affective Dimensions of Play in Psychodynamic Child Psychotherapy via Text Analysis. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 Sibel Halfon, Eda Aydın Oktay, and Albert Ali Salah Multimodal Detection of Engagement in Groups of Children Using Rank Learning. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 Jaebok Kim, Khiet P. Truong, Vicky Charisi, Cristina Zaga, Vanessa Evers, and Mohamed Chetouani Daily Behaviors Anomaly Detection in Elderly Daily Behavior in Ambient Sensing Environments. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 51 Oya Aran, Dairazalia Sanchez-Cortes, Minh-Tri Do, and Daniel Gatica-Perez Human Behavior Analysis from Smartphone Data Streams. . . . . . . . . . . . . . 68 Laleh Jalali, Hyungik Oh, Ramin Moazeni, and Ramesh Jain Gesture and Movement Analysis Sign Language Recognition for Assisting the Deaf in Hospitals . . . . . . . . . . 89 Necati Cihan Camgöz, Ahmet Alp Kındıroğlu, and Lale Akarun Using the Audio Respiration Signal for Multimodal Discrimination of Expressive Movement Qualities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102 Vincenzo Lussu, Radoslaw Niewiadomski, Gualtiero Volpe, and Antonio Camurri Spatio-Temporal Detection of Fine-Grained Dyadic Human Interactions. . . . . 116 Coert van Gemeren, Ronald Poppe, and Remco C. Veltkamp