cast01 // living in mixed realities netzspannung.org event September 21 – 22, 2001 Schloss Birlinghoven D – 53754 Sankt Augustin (near Bonn) http://netzspannung.org Conference on artistic, cultural and scientific aspects of experimental media spaces MARS Exploratory Media Lab http://imk.fraunhofer.de/mars 1 imprint Proceedings: cast01 // living in mixed realities netzspannung.org/journal The magazine for media production and inter-media research. Special issue A project of the MARS - Exploratory Media Lab, FhG.IMK Publishing and Distribution: FhG – Institut Medienkommunikation (IMK) German Federal Ministry of Education and Research (bmb+f) Chief Editors: Monika Fleischmann, Wolfgang Strauss Editorial Staff: Andrea Helbach, Dr. Ingrid Leonie Severin Coordination: Felix Schmitz-Justen (information management) Dr. Ingrid Leonie Severin Print Production: Werner Magar (Design) Assisted by: Felix Schmitz-Justen, Tabea Lurk Online Production: Martina Pohl (Flash – Design) Assisted by: Tabea Lurk, Nina Zschocke Proofreading: Ursula Bernhard Print: FhG – ZPS, Schloss Birlinghoven ISSN Number: 1617-6855, german /1618-1379, english (Print) 1617-6863, german / 1618-1387, english (Internet) Copyright: © for images: FhG and the contributors © for all contributions: FhG– Institute for Media Communication (IMK) reprint only with permission. Number of print copies: 300 Special issue, second magazine of netzspannung.org/journal 2 conference cast01 // living in mixed realities // september 21-22, 2001 cast01 Organizer: MARS Exploratory Media Lab FhG – Institut Medienkommunikation (IMK) German Federal Ministry of Education and Research (bmb+f) cast01 Conference Chairs: Monika Fleischmann, Wolfgang Strauss cast01 Conference Management: Claudia Valle (event manager/conference office) Ulrike Boecking (press) Dr. Ute Gärtel (press) Felix Schmitz-Justen (information management) Lena Spoo (office assistance) Michaela Dasbach (general assistance) cast01 Technical Realisation: Jasminko Novak (system coordination) Stefan Paal (database and system architecture) Predrag Peranovic (technical coordination, streaming services) Martin Hammel, Thomas Unger (programming) Martin Schneider, Christoph Seibert (technical assistance) cast01 Online Production: Boris Müller, Agnes Grüb (web-design) Jasminko Novak, Boris Müller, Martin Schneider, Gabriele Blome (knowledge map) Martina Pohl (proceedings flash design) Martin Rollmann (digital sparks flash design) Roland Ernst, Tabea Lurk, Nina Zschocke (editorial assistance) Lina Lubig (video production) cast01 Print Production: Andrea Helbach, Dr. Ingrid Leonie Severin (proceedings/ editorial office) Werner Magar (design) Felix Schmitz-Justen, Tabea Lurk (production assistance) 3 4 content Imprint 2 Editorial 7 Chairs Preface 8 Welcome address 10 Leon van Noorden, Martin Reiser Keynotes 12 Roy Ascott, Bill Buxton, Manfred Faßler, Hiroshi Ishii, Natalie Jeremijenko Themes paper poster Theme 1 Understanding mixed reality // Spaces for emergent communication 026 193 Theme 2 The information society landscape // New formats of expression in EU/IST projects 046 215 Theme 3 Networked living // Connected citizens 094 235 Theme 4 netzspannung.org // From digital archives to mobile units 118 255 Theme 5 Tools and strategies for intermedia production 130 271 Theme 6 Performative perception // The body as instrument 158 297 Theme 7 Media art education // Teaching new media 188 329 Digital sparks 387 Screenings 391 Committees and Reviewers 398 Author’s index 400 5 6 editorial living in mixed realities Starting into a new millenium, the ongoing discussions Intermedia-Production, 6) Performative Perception/ The Body and research around Mixed Realities are a current challenge: as Instrument, 7) Media Art Education /Teaching New Media. they offer new ways of perceiving, new means of applications, new mixtures of awareness for scientists, artists and the The presentation of the conference results online is an public. After the conference on Mixed Reality in Yokohama, in integral part of the conception of this volume. Japan in March 2001, the conference „living in mixed realities“ The papers and posters collected here are recent projects broadens the aspects of Mixed Reality that are under by outstanding scientists, artists, architects and designers. The discussion. In contrast to the categories and topic developed artistic and scientific committee had the very challenging task there, the contribution of this conference in Schloss of choosing among 450 submissions. The electronic workspace Birlinghoven is in the areas of artistic productions, mixed of netzspannung.org was used as a platform to organize the reality environments, awareness, memory space and entire submission and review process, the careful selection of knowledge discovery, agents and narrative intelligence, papers, posters and screenings. performative interfaces as well as the areas of architectures for the web, hypermedia formats (XML, VRML, MPEG-4, The proceedings present all the scientific and artistic MPEG-7), tracking and vision systems. projects within the seven main themes of this conference. An online version is integrated into and represented by a These proceedings are the second, and a very special knowledge discovery map, which allows navigation through issue of the magazine netzspannung.org/journal. They this compilation of knowledge. represent the broad range of issues that are examined by scientists and artists in this domain. Among the events around the conference are the presentation of the results of >digital sparks< competition, the The goal of the conference „Living in Mixed Realities“ is launch of the internet media lab netzspannung.org, the mobile to give a representative overview on recent projects in the unit, projects to enhance the awareness of the public for the field of Mixed Reality research on an international level. dynamics of productions in this field. The following topics are in the core of this conference: 1) Understanding Mixed Reality? Spaces for emergent communication, 2) The Information Society Landscape/ New Enjoy reading! Formats of Expression in EU/IST projects, 3) Networked Living/ Connected Citizen, 4) netzspanung.org/ From digital netzspannung.org/journal editors Archives to Mobile Units, 5) Tools and Strategies for Andrea Helbach, Dr. Ingrid Leonie Severin 7 chairs preface cast01// communication of art, science and technology Monika Fleischmann, Wolfgang Strauss MARS Exploratory Media Lab, Fraunhofer Institute for Media Communication For the first time, the conference cast01// communication Information Interface (I3)3 programme support interdis- of art, science and technology is taking place in September ciplinary co-operation in art, design and technology. The 2001. The intention of the conference is to present the status planned ART-IST newsletter is to report on themes which of research, theory and teaching on the subject of "Living in concentrate on European programs, international co- Mixed Realities" from such different perspectives as media art operation projects and issues like Tools for the Art of and interface design, as well as information technology and Tomorrow.4 media communications. The dialogue among researchers, artists, and designers is intended to stimulate intercultural co- The cast01 conference presents results of projects of the operation to reflect on and improve life in a digital networked European IST program, as well as international contributions society. from media art and interface design. It is not easy to compare the selected contributions in terms of their aesthetics, design "The dependence of society on knowledge is concepts and technical developments since they address accompanied by the decay of the authority of experts. That different contexts. This mirrors the main problem of the creates space for global and local networks of distributed knowledge society: How can invisible connections between alternative knowledge", writes the Heinrich Böll foundation in different disciplines be made perceivable? their online education portal.1 Life in the knowledge society presupposes that diverse disciplines develop ideas together. The cast01 conference demonstrates practical How are such networks structured? How does information developments and different positions of those who followed become knowledge? How does knowledge become public? our call to submit a contribution to “Living in Mixed Realities”. Which knowledge is important for the individual in society? Not only research, developments and applications are How are journalists, instructors or curators involved in the presented, but also digital sparks in new media teaching. The process of intermediation? What examples are there for a student works give an insight into media curricula practised at culture of networking, for the linking of public and electronic German colleges. space? Which meaning has electronic surveillance, the control of space, local and global communication for our society? Which new models and formats does Mixed Reality space offer for discussion, exhibition and production? On the European level, the Information Society Technologies (IST)2 programme and its constituent Intelligent 1S e e : P o r ta l d e r H e i n r ic h B ö l l S ti f t u n g z u r B il d u ng 2010: Bildung in 3 E u r o p e a n N e tw o r k fo r I n t e ll i g e n t I n f o r m a ti o n I n terfaces, 2 Tdheer WFifstshe nEsugreospeellasnch Caoftm, hmttupn:/i/twy wFwra.bmiledwunorgk2 0P1r0o.gdera/mme covering 4 hTtotpo:l/s/ wfowr wth.ei3 Anert .ofr gT/omorrow is the website for a final presentation Research, Technological Development and Demonstration activities, from a three-year research project, eRENA. Members of the eRENA http://europa.eu.int/information_society/newsroom/istevent/progra consortium are the ZKM, Iluminations, EPFL, GMD/FhG-MARS Lab, mme/index_en.htm KTH, MIRALab,… http://www.erena.kth.se/ 8 Living in Mixed Realities, Fleischmann&Strauss Artists Talk/Physics Room, Christchurch, New Zealand The most important prerequisite for making the The perfect Mixed Reality display – the Retina Scanner – 5 resources of our research system useful is the successful co- has been developed since 1991 by Tom Furness. Refractive operation of artists, computer scientists, designers, media and reflective optics direct the light beam into the viewer’s theorists and cultural researchers. The project eye, projecting an image through the viewer’s pupil onto the 6 10 netzspannung.org - supported by the German Ministry of retina. Thereby the viewer perceives a superimposed Education and Research (bmb+f) - is intended to energize co- real/virtual image. This notion of Mixed Reality, oriented to operation between media art, information technology and computer graphics and visual communication, is shifting to a business. With the cast01 conference we launch the notion of sensual communication, social interaction and 11 netzspannung.org online platform, a digital archive and media awareness of the individual. Early awareness concepts can laboratory in the Internet. netzspannung.org is at the same be found in telematic art projects ranging from »Hole in time a model for a new type of knowledge space, connecting Space« by Kit Galloway and Sherrie Rabinowitz to »Telematic its associative and reconfigurable contents semantically in Dreaming« by Paul Sermon. Mobile communication is the emergent contexts. All conference contributions are main generator for dissolution of space. Mobility and 7 represented in a semantic map online and arranged there domestics interlace in a new day-to-day space. according to similarities. The Knowledge Discovery Tool is cast01 presents examples addressing Mixed Reality that based on a neural network that contextualises the mapping of communicate information and locate the user in a situation of the projects depending on user selection. presence and awareness. Only then is true interactivity Living in Mixed Realities enabled. Telecommunication and information technology, the As hosts of the conference, we thank the international Internet and mobile communication produce a globally scientific and artistic committee for its valuable cooperation in interlaced space, thereby changing our understanding of reviewing and commenting the more than 450 contributions space. The notion of Mixed Reality was mentioned for the first sent in for cast01 and digital sparks. time in 1994 by Paul Milgram in his paper on Mixed Reality 8 visual displays aiming to enhance the limited research field of Virtual Reality. According to Steve Mann, wearable 9 computing promises ubiquity any time anywhere. 5 10 Edelgard Bulmahn - the federal minister for education and research http://www.mvis.com/corpoverview.htm 11 - concludes that „the substantial resources of our research system See article on awareness: are not used effecitvely enough, and the opportunities for http://netzspannung.org/journal/issue0/awareness_en.html combining competences are not sufficiently utilized.” Press conference on research in Berlin, September 4, 2001. http://www.bmbf.de/presse01/463.html 6 http://netzspannung.org 7 http://netzspannung.org/tools/ 8 Paul Milgram, A Taxonomy of Mixed Reality Visual Displays in: IEICE Transactions on Information Systems, Volume E77-D, Nr. 12, December 1994. http://vered.rose.utoronto.ca/people/paul_dir/IEICE94/ieice.html 9 Wearable computing: A first step toward personal imaging. http://about.eyetap.org/library/weekly/aa012301a.shtml 9