ISSN: 2037-2256
n° 73 | year VII
Autumn 2012
Edited by: Marco Mancuso
73
PLACES AND SPACES
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
1
DIGIMAG JOURNAL
Issue 73
November 2012
Editor-in-Chief:
Marco Mancuso
Advisory Board:
Lucrezia Cippitelli, Claudia D’Alonzo, Marco Mancuso, Bertram Niessen,
Roberta Buiani
Editing:
Roberta Buiani, Berna Ekim, Marco Mancuso
Cover:
Jonathan Harris - The Whale Hunt (http://thewhalehunt.org/)
Contributing Authors:
Alessandro Barchiesi, Martin Conrads, Laura Plana Gracia, Miriam La Rosa, Nina
Leo, Donata Marletta, Janet Marles, Melinda Sipos, Selena Savicic, Judson Wright
Publisher:
Digicult - Digital Art, Design & Culture
Largo Murani 4, 20122 Milano
http://www.digicult.it
Editorial Press registered at Milan Court, number N°240 of 10/04/06.
ISSN Code: 2037-2256
Licenses:
Creative Commons, Attribution-NonCommercial-NoDerivs Creative Commons
2.5 Italy (CC BY-NC-ND 2.5)
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
2
46 .
IMMATERIAL PUBLIC SPACE
CONTENT
The emperor’s new architecture
Digimag Journal 73
November 2012
By Selena Savicic
57 .
LOOKING FORWARD
From augmented reality to augmented
museums
By Miriam La Rosa
65 .
EXCELLENT LOCATION
6.
SEARCHING NEW SPACES
In Berlin Mitte, property near the Forein
Office”. Real-estate Prose as a Locational
Disadvantage
For unstable media
By Donata Marletta
12 .
CONSTRUCTING NON-SELF
Language, Trance and Space
By Martin Conrads
72 .
SPATIAL AESTHETICS
By Judson Wright
An investigation into the art and space
22 .
THE POLITICS OF SMELL
By Laura Plana Gracia
How scent technologies are affecting the
way we experience space, sense of place
and one another
By Nina Leo
79 .
DATABASE NARRATIVES
Possibility Spaces: Shape-shifting and
interactivity in digital documentary
By Janet Marles
32 .
TRANSNATIONAL,
COLLABORATIVE ARTISTS IN
RESIDENCY PROGRAMMES
A practice-led evaluation with suggestions
and recommendations
95 .
SINLAB
A new Renaissance
By Alessandro Barchiesi
By Annet Dekker, Gisela Domschke, Angela Plohman,
Clare Reddington, Melinda Sipos, Victoria Tillotson, Annette
Wolfsberger
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
3
WHAT IS DIGIMAG
Driven by the above experience and stemming from the monthly magazine Digimag, 72 issues in 7
years Digimag Journal is a new interdisciplinary peer-reviewed online publication, seeking highstandard articles and reviews at the intersection between digital art and contemporary art production,
the impact of the last technological and scientific developments on modern society, economy, design,
communication and third millennium creativity.
-------------------Digimag has been changing, year after year, issue after issue it has morphed into a hybrid instrument
able to reflect the complexity of contemporary artistic and cultural production. The magazine has quickly
become a cultural instrument, a tool for academics, reseachers, students, artists, designers, geeks
and practioners who constantly break the disciplinary boundaries of different media technologies. This
is the reason why we decided to transform Digimag into a scholarly Journal based on articles spanning
a wide range of contemporary digital and scientific fields.create private and social experiences through
interactions between humans and their artworks
-------------------Digimag Journal wishes to be an innovative form of cultural product that moves beyond classical
cultural definitions, thus avoiding strict productive and creative labels. This means that it seeks to
overcome traditional cultural production models based on institutional economic support or private
funding, going beyond the limits that other independent productions have been sometimes affected by,
becoming, in this way, a professional reality of international importance.
--------------------Digicult was born to give voice and visibility to a new generation of interdisciplinary authors, expand
their circuits into an international context, and simultaneously break the existing inflexible publishing
rules of the press, by exploiting potentialities of the Web, and its free networks in order to grow, to
survive and to spread. The new Digimag journal is our voice. We hope you will appreciate our work as
you alwys did in the last years. Have a good read
Marco Mancuso , Lucrezia Cippitelli, Claudia D’Alonzo, Bertram Niessen, Roberta Buiani
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
4
“PLACES AND SPACES”
The birth, growth and development of spaces open to the creative and experimental use of Media and
Digital technologies have affected the production and dissemination of contents, have enriched the
art system and its boundaries, have provided new methodologies of production, modes of art display
and creative practices (and the daily work of individuals engaged in the field). These groundbreaking
pr actices span visual art and design, science and technology innovation, social studies and polit àics,
ecology and economy, music and architecture. The context where they take place is hybrid: hacklabs and
bureau of research; mailing lists; virtual and physical exhibition spaces; media centers and museums.
This call for contributions wishes to assess these emergent places of innovations and this rich
proliferation of research, critical thinking and radical praxis based on horizontal cooperation.
--------------------The call considered, but was not limited to, the following questions:
- How have the reciprocal relationship between spaces, research and creative/artistic processes been
transformed? Is it possible to map the historical contexts that gave rise to spaces involved in creative
practices based on Media?
- How to describe, from a critical perspective, the tension between public and private, institutional and
independent space?
- What kind of economies have emerged from these spaces working with new media creative practices?
What are the links (if any) between these spaces and contemporary art, culture markets and immaterial
culture and the city? The institutionalization of independent spaces and their long term development
has been in most cases supported by public fundings. Given the recent cuts, what new strategies of
survival are available?
- How has Media culture affected mainstream culture and its spaces? And in turn, how have spaces
been affected by issues of production and dissemination of art and knowledge? Are there new objectives
and strategies to be followed by spaces and institutions involved in these fields?
- What spaces could (and can today) be considered most relevant to the development of production,
exhibition, research and archiving of Media Art? How are methodologies and practices of archiving,
preserving and disseminating Media Art evolved? What displaying techniques created by institutional
and independent spaces can be considered the most significant and experimental?
- How has Media culture affected mainstream culture and its spaces? And in turn, how have spaces
been affected by issues of production and dissemination of art and knowledge? Are there new objectives
and strategies to be followed by spaces and institutions involved in these fields?
- What spaces could (and can today) be considered most relevant to the development of production,
exhibition, research and archiving of Media Art? How are methodologies and practices of archiving,
preserving and disseminating Media Art evolved? What displaying techniques created by institutional
and independent spaces can be considered the most significant and experimental?
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
5
Cybernetic Serendipity, Exhibition View, ICA London 1968 http://cyberneticserendipity.net/
SEARCHING NEW SPACES
For unstable media
by Donata Marletta
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
6
This essay explores the current issues related
to the uneasy relationship between presentation
spaces and New Media Art. The terrific outburst
of new media art projects during the last decades
is challenging traditional curatorial models in
relation to space, and redefining the relationship
between artists, curators, and audiences. Owing
to its intrinsic characteristics of immateriality,
interactivity, participatory and process-oriented
art, new media practices require more appropriate
presentation spaces that go beyond the
conventional white cube/black box settings.
to the fact that several media art festivals are
frequently linked to public funding and cultural
institutions, the main issue with these events is
that some of them are losing the critical attitude in
their approach and the analytical focus that were
the key elements when they first appeared in the
art scene. Many of the more established media
art festivals have changed since their inception,
becoming mere celebratory events whose central
aim is to entertain the audience instead of
questioning technology and its sociological and
political impact.
In his paper “An Inventory of Media Art Festivals”
(2006), artistic curator and critic Krajewski
claims that in the early 1980s media art first
encountered its audience through dedicated
festivals. These festivals emerged as a cultural
phenomenon in order to respond to a need of new
presentation spaces for new media art projects.
Most of media arts festivals take place both within
metropolitan areas and in small towns outside
the conventional inner-city spaces. These events
offer a wide selection of settings, ranging from old
disused factories (e.g. Usine C, Montreal, CA) and
abandoned industrial buildings to old churches
(e.g. St. George’s Hall, Liverpool, UK) and hyper
technological venues (e.g. Ars Electronica Center,
Linz, AT). In his book “Avant-Garde Performance:
Live Events and Electronic Technologies” (2005),
Berghaus argues that contemporary art centres
and festivals fostering avant-garde experimental
artworks have started to develop and proliferate in
order to present and give recognition to innovative
forms of expression.
In the early 1990s new media art projects found
another important platform in the emerging
Networking culture and Web-based communities.
Through these virtual spaces artists were able
to present, distribute and discuss their projects,
bypassing conventional exhibition spaces. Scholz
(2006) argues that today venues for new media art
are not predominantly festivals or museums but
virtually distributed communities. In particular,
the author refers to extreme sharing networks
that he defines as conscious, loosely knit groups
based on commonalities and shared ethics. These
groups function as nodes of users/producers and
provide alternative platforms of production and
distribution of cultural practices.
Within these extreme sharing networks researchers,
artists, and activists share their works and
knowledge. A few examples of these units are
groups such as the Australian network Fibreculture
(http://www.fibreculture.org/), a forum for the
exchange of ideas that encourages debates around
issues related to information technology, and
the media research centre Institute of Network
Cultures
(INC)
(http://networkcultures.org/
wpmu/portal/), founded in 2004 by media theorist
and activist Geert Lovink. The INC organises
conferences, publishes books and fosters online
dialogue between researchers committed to
the study of network systems. Extreme sharing
networks play a critical role functioning as
connective cultural nodes for critical debates and
the mutual sharing of knowledge.
Today, new media art festivals flourish worldwide,
providing access to a kaleidoscopic variety of
spaces. Festivals such as Ars Electronica (Linz,
Austria), Transmediale (Berlin, Germany), and
Elektra (Montreal, Canada), just to name a few,
celebrate art and technology and represent
alternative platforms for the presentation of
media art projects, allowing people to meet in
physical spaces in order to share, discuss and
collaborate on an international level. A central
element within these festivals is the organisation
of satellite events and talks that encourage critical Within such a dynamic context the role of the
debates and cross-boarder collaboration between curator has changed, becoming more and more
artists, curators, and experts in the field. Owing committed to mediation and interpretation.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
7
Cybernetic Serendipity Exhibition Poster http://www.medienkunstnetz.de/exhibitions/serendipity/
It is approximately from the 1960s onward that
we can speak on the advent of the neo avantgarde and the increasing use of new technological
media, which created new meanings and new
conceptions of time and space. Art generated with
a computer resides in no place and time, enabling
the collapse of the barriers of past, present,
and future. Artists engaged with technology
explore, and often exploit, both the critical and
technological potentials of the new media.
Early examples of computer art exhibitions date
back in 1968 when Jasia Reichardt curated the
influential exhibition Cybernetic Serendipity at
the Computer Art Society (CAS) in London. The
principal idea was to examine the role of cybernetics
in contemporary arts. The exhibition aimed to
explore the relationships between technology and
creativity, and showed how persistent the use of
computers had become in the creative process
itself. Reichardt recalls: “The exhibition included
robots, poetry, music and painting machines,
as well as all sorts of works where chance was
an important ingredient. It was an intellectual
exercise that became a spectacular exhibition in
Digimag Journal
n° 73 | year VII
the summer of 1968.” (Media Art Net: “Cybernetic
Serendipity”). Cybernetic Serendipity was the first
exhibition that aimed to demonstrate all aspects
of computer-aided creative activity: art, music,
poetry, dance, sculpture, and animation.
A few decades later, in 1985, philosopher of
postmodernism Jean-François Lyotard curated
the exhibition Les Immatériaux at the Centre
Pompidou in Paris. The exhibition intended to
show the cultural effects of new technologies and
the experience of overexposure and dispersion in
postmodern culture. In his article “Overexposure:
Les Immatériaux” (1986) Birringer describes
the exhibition space as a labyrinth of sounds
and sights, or hanging islands, evoking “(…)
a temporal multi-sensory experience of an
author-less, discontinuous, placeless world of
invisible interfaces between heterogeneous
objects, artefacts, industrial products, and complex
theoretical constructs” (Birringer, 1986). All these
early attempts for presentation of computergenerated artworks have certainly formed the
basis for future experiments, both in terms
of curatorial models and in the selection of
Quarterly
November 2012
8
appropriate exhibition spaces.
Today, the interactive and immaterial nature of
several new media art projects entails that curators
need to establish a connection between physical
and virtual spaces, emphasising the participatory
nature of the artworks and the active role of the
audience. In the opinion of Paul (2008) curators
engaging with new media frequently mediate
between the artist and the institution, between
the artwork and the audience, and between the
artwork and the critics, creating new collaborative
models of production and presentation. Nowadays,
new media art and multimedia art creations
have gained an important role in contemporary
art production. It is worth noting that major art
institutions, galleries and museums worldwide
run online and virtual exhibition spaces which, in
addition to calendars about current exhibitions
and information for the visitors, showcase
experimental digital art projects and Internetbased art exclusively available for online users.
A few examples are the online exhibition space
Gallery 9, affiliated with the Walker Art Center
in Minneapolis http://gallery9.walkerart.org/; the
online gallery space Artport, launched by the
Whitney Museum in New York http://whitney.org/
Exhibitions/Artport/, and the Rhizome ArtBase,
an online archive of new media art http://rhizome.
org/artbase/.
Cyberspace enables the appearance of new forms
of social aggregations through which individuals
meet and build new connections. Several scholars
(Mitchell, 1995; Ostwald, 1997; Crang, 2000) have
adopted architectural metaphors to theorise
cyberspace and its virtual environments. In order
to emphasise its main characteristics of electronic
social space and point of exchange many studies
associate cyberspace with the Greek agora. Today
a new form of intangible space has emerged, the
digital agora, a virtual space for collaboration,
interaction and connectivity (Marletta, 2012).
With the emergence of mailing lists, websites,
and online archives ideas are able to freely
circulate and the line between artists, theorists
and curators is rapidly dissolving. According
to the recent transformations in terms of art
production, the traditional role of the curator has
been reshaped and readapted to the new context.
Digimag Journal
n° 73 | year VII
Paul (2006) argues that curators need to
emphasise and develop new strategies for
documentation of artworks, which are collectively
created by several authors and time-based. Owing
to the collaboration between different actors,
the production and presentation processes are
becoming more flexible, and for this reason
require a strong awareness of the process itself. As
a consequence of the popularisation of networked
mobile devices – such as PDA, smartphones, and
tablets, the involvement of the audience in the
curatorial process is leading to what Paul (2006)
describes as ‘public curation’ that entails new
horizontal and participatory forms of filtering.
Fig: The Beauty and the East http://www.ljudmila.
org/~vuk/nettime/
De Souza e Silva (2006) defines networked mobile
devices as ‘social interfaces’. A ‘social interface’
intermediates interactions between multiple
users, reshaping both communication relationships
and the space in which these interactions take
place. ‘Social Interfaces’ foster the emergence of
the so-called ‘hybrid spaces’ (De Souza e Silva,
2006), which are mobile spaces created by the
continuous movement of users who carry portable
devices constantly connected to the Internet. The
‘always-on’ connection entails that users do not
feel the perception of ‘entering’ cyberspace; as a
consequence the distinction between physical and
digital spaces becomes blurred. A hybrid space
occurs when it is no longer necessary to step out
of a physical space to connect to other people
located in different geographical areas. This
merging in terms of spaces and actors enables
the creation of open virtual spaces that foster new
collaborative models for the collective creation of
culture.
One of the most prominent examples of networking
virtual spaces is certainly the Nettime group
http://www.nettime.org/, co-founded by artist
Pit Schultz and media theorist Geert Lovink in
1995. The name Nettime itself evokes the idea
of a network specific time that is different from
geotime, the time of clocks. Nettime is a collective
entity that offers an alternative form of social
organisation in opposition to individual cultural
practices.
Quarterly
November 2012
9
Rhizome ArtBase http://rhizome.org/ include both
Since its inception the list has aimed to
connect different disciplines and the crossboarder collaboration between artists, curators
and intellectuals stepping out from the digital
realm through real life gatherings. Through
the organisation of seminal meetings such as
the “Beauty and the East” held in Ljubljana
(Slovenia) in 1997 http://www.ljudmila.org/~vuk/
nettime/, and the ‘Hybrid WorkSpace’ (HWS)
organised during the exhibition of contemporary
art Documenta X, in Kassel (Germany) in 1997
http://www.medialounge.net/lounge/workspace/,
the Nettime group encourages and promotes the
diffusion of informal production units. Events such
as “Temporary Media Labs”, “unconferences” and
“BarCamps” seem to offer alternative spaces
for the sharing and distribution of information
and content. The idea of “Temporary Media Labs”
emerged from the desire to cover different events,
such as conferences, festivals, and exhibitions, by
building bridges between real and virtual spaces.
art continue to animate the myriad of online
discussion groups. Such online discussions
nurture the advancement of a culture based
on the free circulation of ideas, and foster the
perpetuation of collective processes and mutual
sharing. We are realistically moving towards hybrid
forms of spaces, at the intersection between real
and virtual, and collaborative models of content
creation are becoming a critical element of
cultural production. Computer networks provide
a kaleidoscopic range of new contexts in which
people take active roles, offering more appropriate
settings for the extension of what sociologist
Bauman (1993) defines as ‘cognitive space’.
Cognitive space is structured intellectually and
defines our knowledge of others. Within such a
space ‘others’ become interesting and fascinating,
and diversity is celebrated as a central element of
postmodernity.
References
In conclusion, it could be argued that although many
questions remain unanswered, debates around the Bauman, Zygmunt. 1993. Postmodern Ethics.
quest for new presentation spaces for new media Oxford, UK, Blackwell.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
10
Berghaus, Günter. 2005. Avant-Garde
Performance: Live Events and Electronic
Technologies. Basingstoke, Palgrave Macmillan.
Birringer, Johannes. 1986. “Overexposure: Les
Immatériaux”. Performing Arts Journal 10 (2):
6-11.
Crang, Michael. 2000. “Public Space, Urban
Space and Electronic Space: Would the Real City
Please Stand Up?”. Urban Studies Journal
37(301): 301-317.
De Souza e Silva, Adriana. 2006. “From Cyber
to Hybrid: Mobile Technologies as Interfaces of
Hybrid Spaces”. Space and Culture 9 (3): 261278.
Cube and Beyond. Berkeley: University of
California Press.
Reichardt, Jasia. 2005. Cybernetic Serendipity
<http://www.medienkunstnetz.de/exhibitions/
serendipity/>. Rev. 2012-10-24.
Scholz, Trebor. “The Participatory Challenge”. In
Curating Immateriality: The Work of the Curator
in the Age of Network Systems, edited by Krysa
Joasia. Autonomedia, 2006.
_______________
Donata Marletta
Donata holds a PhD in cultural studies from
Typically these events are organised and promoted Leeds Metropolitan University (Leeds, UK). She
through the Internet, and driven by the principles is a freelance writer and her interests rotate
of ‘open source culture’, according to which around the social implications of new media
technologies in contemporary culture and how
content is publicly available to users.
these media are reshaping the creative act. Her
main interests include the study of new media art
festivals and how these events create moments
Krajewski, Piotr. “An Inventory of Media Art
of collective sociability. In addition her interests
Festivals”. In Curating Immateriality: The Work
focus on the concept of ‘remix’ as a collective
of the Curator in the Age of Network Systems,
process for the creation of culture, and the role of
edited by Krysa Joasia. Autonomedia, 2006.
online networks in the advancement of Networked
Culture. Donata has presented her papers at several
Marletta, Donata. 2012. ‘Sharing Bits’: Creating
international academic conferences and attended
Sociability in the Age of the Digital Agora. PhD
the International Marketplace for Digital Arts (IMDA)
Thesis (Not Published).
held in Montreal during the Elektra International
Mitchell, William. 1995. City of Bits: Space, Place Digital Arts Festival. In 2008 she joined the network
Digicult, and has been a regular contributor
and the Infobahn. Cambridge, MA, MIT Press.
with articles, festival reviews, and interviews.
Ostwald, Michael. “Virtual Urban Futures”.
In Virtual Politics: Identity and Community in
Cyberspace, edited by David Holmes. London,
SAGE, 1997.
Paul, Christiane. “Flexible Contexts, Democratic
Filtering and Computer-Aided Curating: Models
for Online Curatorial Practice”. In Curating
Immateriality: The Work of the Curator in the
Age of Network Systems, edited by Krysa Joasia.
Autonomedia, 2006.
Paul, Christiane. 2008. New Media in the White
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
11
Image of mirror neurons
CONSTRUCTING NON-SELF
Language, Trance and Space
by Judson Wright
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
12
in the interest of a more adequate perception”
(Dewey, 1934, 311). Participating meaningfully in
Space thus becomes something more than a void the world provided by contextualization requires
in which to roam about, dotted here and there with that new members negotiate between personal
dangerous things and things that satisfy the ap- interpretations and conceptualizations, and those
petite. It becomes a comprehensive and enclosed of the older, established members (Cobb, 2005;
scene within which are ordered the multiplicity of Sfard, 2008, 115–116, 259 –260).
doings and undergoings in which man engages.
Certainly, Marshall McLuhan (1964) famously ex(Dewey, 1934, 23, see also p. 190)
plains how our understanding of media might be
The space we occupy, particularly the border broadened. But even his view is rather limited to
concrete, clearly labelbetween self and enviled objects, implying a
ronment, is a byproduct
Platonistic perspective.
of associations, trialBe that as it may, there
and-error experimenis another approach to
tation, and sensory stimedia as a ‘medium’ of
muli, all within the rigid
any sort of appropriacontext of our prioritition. To begin, the many
zed needs (Metzinger,
discrepancies between
2009, 77). This is not to
the self/medium that
say that the objects that
is ultimately communiconstitute space do not
cated, and the self/meexist, but that we candium that is initially denot assume that these
sired, does indeed have
objects constitute space
both cultural (learned)
in similar ways outside
and neurological (innaof the human mind. If
te) bases (Etcoff 1999).
one takes the constructivist view of modeling
At the same time, we
the environs, the theomight also consider isry further explains that
sues such as gender,
construction, at least,
tends to be socially morace, sexuality, etc... stutivated.
dies as forms of appropriation (Brody, 1999,
Fig: These images
201; Goffman, 1959).
underscore difference
This fractal appropriabetween setting and
tion occurs at micro
location.
and macrocosmic levels. While mythological pantheons remain reThe attitudes of a culture plays an important role lative to a culture (Campbell, 1949; Campbell &
in how we understand the things we perceive, Moyers, 1988) – just as communication is relative
including the self we simultaneously present to to media. The message, always necessarily apothers (Goffman, 1959; Milgram, 1974; Langer, propriated, is ultimately a conceptual abstraction
1998), not to mention how culture is symbiotical- that only becomes embodied as a medium, and
ly, particularly in this case, tied to perception (as subject to transformations of physical energy,
described in the classic text by Howard Gardner, such as electrical current or smoke signals. We
1983, 321 – 327). “It cannot be safely assumed at can learn much from, at least temporarily, discarthe outset that judgement is an act of intelligence ding the arbitrary conception that messages abperformed upon the matter of direct perception solutely must be concrete objects. Originally, we
Sensorial Estrangement
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
13
Originally, we might critique fashion magazines
for portraying some overtly sexual image,
selling our culture on particular aspirations and
standards. However, insofar as Jung shows
that the archetype Aphrodite serves a universal,
psychological conceptualization function, in
order to understand ones environment as nonchaotic, some aspect of that environment must be
interpreted as an instance of Aphrodite-ness.
There is an underlying psychological issue
(James, 1892, 149 – 151, 174 – 209), that when
considered from a constructivist view (Boes et al.,
2010), reveals that an aspect of the external world,
the way that world is described by our brains, to
our brains, is entirely idiosyncratic and entirely a
reflection of our uniquely constructed self. The
critique becomes not one of a scantily clothed
model, not of which icon she might evoke, but of
what that icon’s role is in the ongoing construction
of self. Our point is not at all a philosophical
one, but that deep-rooted philosophies are a
symptomatic byproducts of a mental strategy,
likely orchestrated in the prefrontal cortex.
Creating Space
To an infant, ground and subject are really just one
thing. The distinction is not innate, but learned.
Imagining such contextualizing frames is an
essential part of perception (Gregory, 1966/1997,
161–162). Physiologically, shapes, colors and
edges arrive, and are processed at independent
schedules. But even motion detection still need
not imply space exists. A full discussion of the
independent process in the brain that identify
locations and motion, quite unlike the fames
described above, goes well beyond our scope
(interested readers are referred to Baars & Gage,
2010).
Without any non-subjective means of verification,
might space be another such associatively
projected property? A frog may detect the motion
of the fly, aiming its tongue at that spot, without
ever considering that the motion observed is of a fly
or even a subject. This response merely results in
alleviating hunger, often enough (Millikan, 2005).
Without this explicit data linking the elements of
certain sequential frames, generalizations need
Digimag Journal
n° 73 | year VII
to be projected onto the image, to group and
prioritize sensation into meaningful and irrelevant
features, including ground. Incidentally, this
initial scheme is roughly how computers/cameras
see the world (Gonzales & Wintz, 1977; Myler &
Weeks, 1993; Levin, 2006). For robots to see as we
do, they must develop their own sense of space,
not simply coordinates dictated explicitly, as in
figure 2. This sense is an essential byproduct of a
sense of self.
Virtual Space
This leads us to discuss virtual space – as if there
is non-virtual space (Greene, 2004, 181–182).
Space is roughy defined by the purposes of the
occupants. But more importantly, it can recede in
importance such that, no attention being lavished
on the background, as strictly defined by context.
Spaces can easily take on other non-spacial
meanings (Dennett, 1991, 389–398; Exploratorium,
2004; Solso, 2003, 230). A white wall means
something different to a contractor who has to
buy the precise shade of paint, than a curator
who is thinking about how gallery traffic will flow
and rest with various arrangements of paintings.
Metaphors exist precisely because previously
constructed concepts have proven sturdy, and fit
well enough with novel contextualized sensations,
to be slightly modified for renewed use. A
description of this learning process, about space
on the web, occurs in Shirky (1995, 3). Reading
about a scene and its accompanying sensations
activates what are commonly called mirror
neurons (also called “monkey-see-monkey-do”
neurons in Millikan, 1995). If we recognize some
behavior, this is understood as if we are physically
using our own muscles. Spacial metaphors are
used in the same way to “explain” stimuli to the
consciousness. Hence, by noting a change in the
focus of our environment, we “travel” to a web site
via mirror neurons.
Furthermore, space is essentially that which
is not self, self being a gradually refined and
learned notion (Gopnick & Meltzoff, 2006). In
child development, the progression from infancy
to adulthood, is a very cumulative process of
differentiating modal impulses (Piaget, 1929/1952,
38).
Quarterly
November 2012
14
This is a diagram of two epistemologies, Platonism and constructivism, are not quite as different as they may seem from a philosophical standpoint. In the former scheme, experience of reality is
apprehended in the mind, where a model is created. In the latter scheme, the model in the mind, is projected onto experience. However, in the former scheme, there is no explanation as to why this
might occur, and thus epistemology is philosophical supposition, whereas the latter case is a theory as to why and how this modeling might occur, with no claims about the existence of reality, accept as
a extremely common, philosophical consideration for the sake of deep-rooted Platonistic beliefs. Though, looking at the diagram, one may note that aside from the extremely subjective arrows indicating
the vectors of conceptualization, these epistemologies merely describe different aspects of a system that may just as well include both.
Initially, sensations are ambiguous and the causal
sources difficult to distinguish, for instance a
mother’s smile. Infants must come to decide that
some sensations are internal, such as hunger, and
some external, such as the shape of a toy. These
decisions are generally resolutions of cognitive
conflicts (Devries & Zan, 2005). Young children
tend to believe that the sun is somehow a part of
themselves, semi-consciously manipulated, as a
cat’s tail might be. Piaget and many others stress
that this egocentrism is not precisely solipsism.
Children at this stage have not yet developed a
Theory of Mind (ToM) that they will take for granted
as adults (Gopnick & Meltzoff, 2006; Fodor, 2000,
62–64). Moreover, these children do not recognize
their own minds as even being theirs, which would
initially require a somewhat developed sense of
self. Are we correct that there are other minds?
The most we can say is that culturally we are
pressured to believe in multiple minds, as
interaction ultimately allows for categorization
of sensory and conceptual impulses into frames
(Searle, 1994, 196–191).
Digimag Journal
n° 73 | year VII
The real root of the frame problem lies in treating
humans and machines as organisms that are
both engaged in producing an objective analysis
of reality. This viewpoint is not limited to workers
in AI... We saw that many psychologists concerned
with category perception take a similar view of
humans.
Now, we may manufacture objects aimed at
producing an objective analysis of reality, but
evolution manufactures creatures aimed at
maximizing their life-chances. We may choose to
assume that relevant information is information
relevant to a particular task. But for evolved
creatures, relevant information is information
relevant to a particular type of organism... We can
even distinguish between what makes it difficult
and what makes it impossible. The difficulty lies
in furnishing the robot [or primate] with all that
eons of evolution have given us. The impossibility
lies in teaching a robot what is relevant and what
isn’t, when there is no autonomous entity there
for things to be relevant or irrelevant to. (author’s
emphasis, Bickerton, 1990, 204, 205).
Quarterly
November 2012
15
Metaphor
The basic mappings in the event structure
metaphor include the following; Causes are forces.
States are locations (bounded regions in space.
Changes are movements (into or out of bounded
regions. Actions are self-propelled movements.
Purposes are destinations. Means are paths (to
destinations. Difficulties are impediments to motion.
Expected progress is a travel schedule; a schedule
is a virtual traveler, who reaches a prearranged
destination at a prearranged time. (Feldman,
2008, 207)
Metaphor is not only applied on the personal
mentation level, as described by George Lakoff et
al., but also to myths, at a universal cultural level
Joseph Campbell describes (see also Campbell &
Moyers, 1988). The organism and its culture both
have a symbiotic need to nurture the other, for
the sake of survival. Trance-induced rituals, even
ones that insight members to stab themselves
(Becker, 2004), are a means to keep the culture’s
membership thriving. The physical aspect of trance
literally alters brain waves, allowing the trancer
to engage in extra-human activity, particularly
engagement with a spirit world (Alderage,
2006). This supernatural interaction ultimately
allows members of that culture to concretely
apply mythology to their lives, in ways that are
unavailable to the ordinary human. Surely, this
trance state is often an act. But even in many of
these cases, this state coincides with verifiable
changes in physiognomy, within the brain –
somewhat like a placebo. Embodiment is key to
metaphor, and in a trance state, the perception of
that body – the self – is altered radically.
We speak of time as though it resembles space
– as when a listeners wonders when the speaker
will get to some point. Also, we often think of time
as a fluid that’s “running out.” and we talk about
our friendships in physical terms, as in “Carol and
Joan are close.” (Minsky, 2006, 343)
of location. Likewise, we can imagine animals,
possibly the nematode worm (Enquist & Ghirlanda,
2005, 164–165), who do not have the spacial
modeling abilities afforded to our neuroanatomy,
but conceivably only require a two dimensional
view of the universe in order to survive. How
are we to say that three is the correct number of
dimensions to depict reality? Why would color be
more accurately described by three types of color
receptor cells in humans, than four primaries in
pigeons (Dennett, 1991, 350; see also Gregory,
1966/1997, 121) or the seventeen cones types in
some shrimp? A further discussion of spacial
orientation in animals without language occurs
in (Vallortigara, 2009; see also Dahaene, 1997;
Lakoff & Núñez, 2000).
... Animals probably possess a rudimentary sense
of geometry that provides the foundation for the
fully developed, and unique, human knowledge of
geometry when it meets the possibility offered by
the symbolic representations allowed by verbal
language, which enable cognitive prostheses for
spacial cognition such as maps, charts, and the
like. (101)
I/O Functions
Visualization is one useful shorthand way of
mapping our mental reconstructions of the
environment, such that we avoid bumping into
walls and such. Chaotic bursts of impulses,
when organized as images, create coherence for
us (Bach-y-Rita, 1972, 70–72; Bevelier & Neville,
2002). Having determined the usefulness of
adopting this scheme, the brain will tend to use
optical impulses for sights rather than sounds,
strengthening the synaptic paths (Grossberg,
1973/1988).
But this is not innate, and the impulses could
easily be interpreted in some other way, given
another training history. An alternative theory is
that the brain may use every impulse in every way
possible, but processes that are not successfully
Spacial language, used to describe some concept, reinforced by recognition in the cortex, or are
constructed in the mind, implies dimensionality. beaten in a Darwinian 2006).
Even the notion that space is three dimensional
is not an absolutely certain assumption, but is
explainable given our metaphorical understanding
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
16
competition of possible thoughts (building on
theories in Minsky, 1985; Calvin, 1999; Minsky,
Noting the difference between input/output and
transduction/actuation is helpful, though indeed
subtle. The relationship between a light switch, and light
emitted from a bulb, is described using either model.
The light is essentially a linear system, reducible to
a single bit (on or off). The dissimilarity becomes
more clear with more complex systems, which can
not be entirely and precisely formulated digitally
from any “God’s eye” point-of-view (Edelman,
2004, 140; see also “an ideal judge” in James,
1891, 188). The input/output scheme implies that
there is a static relationship between the input
and output. When we speak of qualia, we are
easily confused.
really is no possible way to enumerate sources
for our impulses. Recognition of a walk employs
different processes from recognition of a face.
When we have been waiting in line and become
impatient, with which organ do we ‘feel’ the time
passing? We must take a broader view of the
senses, including a sense of our location in space.
Transduction and actuation relate nonlinearly.
An initial step is to re-conceptualize colors, not
as input but as output that is exclusively for a
particular context, and not generally recognized
as such by the rest of the universe (again, Dennett,
1991, 389–398; particularly relevant is Pylyshyn’s
discussion of the engineering term transduction,
1984). Qualia is exuded from the mind that creates
it. In a sense, some sort of transformation of
‘energy’ emitted outward, does ensue indirectly,
from mentation to language. But transduction
is hardly limited to any single visual property.
Though we often say there are five senses, there
Likewise, even Chomsky has continually held
that the Language Acquisition Device (LAD) was
not specifically designed for language, but has
merely been employed with the result of language
(Chomsky, 1975; 1980; 2002). The LAD may well be
useful to conceptualize music, trance and space,
among other mental tools. Also of note, in Ruth
Millikan’s pushmi-pullyu representation (PPR)
scheme (1995) , the role of linguistic intention, can
be to simultaneously define expectations, as well
as perform them. Though she speaks of language
and utterances, there is no reason to restrict the
PPR from spaces, such as art galleries, churches
Frogs react quickly and effectively to bugs that
fly past them, but this by no means implies that
they have a concept of ‘bug’. Indeed, we can be
pretty sure that they do not, or at best that their
concept of ‘bug’ both under- and over-generalizes
to a rather gross extent. For instance, they will
overgeneralize by snapping at bug-sized pellets
that are flipped past them, but will undergeneralize
by totally ignoring motionless bugs even when no
Flowers display their beautiful colours which give other food source is available. (Bickerton, 1990,
pleasure to us, however they are not made for us, 27–28).
but for flying insects. Those insects involuntarily
fertilise plants carrying pollen from flower Conclusion
to flower... So some plants evolved to attract
insects and in that way plants reproduce and Contrary to popular belief, stimuli to different
continue living on the planet Earth. So insects modalities is not processed solely by any one
evolved to distinguish flowers among the whole module. For instance, visual stimulus is chiefly
electromagnetic radiation that gets to their eyes processed in the visual cortex, but visualization
coming from the Earth’s surface, as patches of takes paths all over the neuroanatomy (Baars
definite colours. Thus, eyes have appeared and & Gage, 2010, 158, 170–172). Nonetheless, the
evolved as a filter for those chains of events … For impulses from the various sensory organs, as well
instance, electromagnetic radiations are filtered as the cortical modules of the brain to which these
by eyes, in chains which end at perceptions we are sent, are all essentially the same (Dennett and
call colours. But if the radiation wavelength is in Hawkins expounding on Vernon Mountcastle’s
the ultraviolet zone, some insects will see it, but neurological hypotheses, 1991, 262; 2005, 49–52).
in our case we will not[.] (Herrero, 2005; For a It is merely a series of phenotypical accidents
further explanation “Why are there colors?,” see that we construct mental images, sensorially or
Dennett, 1991, 375–383)
conceptually, as we do.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
17
The image underscores difference between setting and location.
and court rooms, which also both signify expected
behaviors, as well as serve those behaviors.
In fact, it is useful as a model to reconsider the
senses, including the ‘sense’ of space as potential
meaning detection systems. Sacred spaces are thus
a notation device as to the appropriate behavior
expected by a given culture (Campbell & Moyers,
1988 , 92 – 98). These too are media! Mediatypes, which include instances of locations and
personalities, are entirely arbitrary. Walter Benjamin
argues that the media-type is crucial, but goes on
to describe their fundamental interchangeability
(1935/2008). Marshall McLuhan points out specific
cases, such as the initial lighting of the Eiffel
Tower, where “the medium is the message”
(discussed in Marvin, 1988, 158). He does refer
to a rather poignant event in history, but the vast
number of messages are not nearly designed to
astound.
However, we often see messages and either
take no notice of, or cannot ascertain the media
employed. By updating our “Synaptic Selves” (LeDoux,
2002) continually, we customize previous
conceptualizations to appropriately account for
Digimag Journal
n° 73 | year VII
novel experiences. We can only, therefore, assume
that the concept which we entertain of space and
media are types of protocols, developed by and for
the brain, in the process of maintaining the survival
of the host body. The space we navigate, therefore,
is ultimately much like a highly idiosyncratic finger
print – of a self. Not that the object of experience
is necessarily illusory, we can never know, but
the sensation of that experience absolutely is.
Indeed our dubious report of that object does
indirectly influences subsequent sensations, in a
very concrete way, which we radically organize into
experience (further discussion in Hundert, 1995).
Hence confusions arise. A simplified example is the
desire to become wealthy. There is no static value
that can be described by everyone as “enough.”
However, once wealth is considered a medium,
we must acknowledge that the interpretation of
all media is profoundly relative to a self. If art is
anything the artist chooses to describe as ‘art’,
how can there be any possible discussion of a
budget? Only reconstruction of self can alter the
perception of message, can illicit an interpretation
of self as wealthy. The same is true, though far less
evident, for how we understand space. Speaking
Quarterly
November 2012
18
we understand space. Speaking metaphorically,
there are no destinations, only larger airports.
Faces. Novato, CA: New World Library
References
Campbell, J. and Moyers, B. 1988. The Power of
Myth. New York, NY: Doubleday
Alderage, D. 2006. “Music , Consciousness,
and Altered States.” In, eds. Alderage, D. and
Fachner, J., 9—15, Music and Altered States:
Consciousness, Transcendence, Therapy, and
Addictions. London, England: Jessica Kingsley
Publishers and Germany: University of WittenHerdecke
Chomsky, N. 1957. Syntactic Structures. Berlin,
Germany: Walter Gruyter GMBH
_____. 1975. Reflections on Language. New York,
NY: The New Press
_____. 2002. New Horizons in the Study of
Language and Mind. Cambridge, England:
Cambridge University Press
Baars, B. and Gage, N. 2010. Cognition, Brain,
and Consciousness. San Diego, CA:Academic
Press
Cobb, P. 2005. “Where Is the Mind? A
Coordination of Sociocultural and Cognitive
Constructivist Perspectives.” In, ed. Fosnot,
39–57, Constructivism: Theory, Perspectives,
and Practice. New York, NY: Teachers College,
Columbia University
Bach-y-Rita P. 1972. Mechanisms in Sensory
Substitution. New York, NY: Academic Press
Bavelier D and Neville H. 2002. Cross-Modal
Plasticity: Where and How. Rochester, NY:
Department of Brain and Cognitive Sciences,
University of Rochester
Becker, J. 2004. Deep Listeners. Bloomington, In,
Indiana University Press
Benjamin, W. 1935/2008. Art in the Age of
Mechanical Reproducibility and Other Essays.
Cambridge, MA: Harvard University Press
Bickerton, D. 1990. Language and Species.
Chicago, IL: University of Chicago Press
Brody, L. 1999. Gender, Emotion and the Family.
Cambridge, MA: Harvard University Press
Boes, L., Magolda, M. and Buckley, J. 2010.
“Foundational Assumptions and ConstructiveDevelopmental Theory: Self-Authorship
Narratives.” In: eds. Magolda, M., Creramer,
E. and Meszaros, P., 3 – 24, Development and
Assessment of Self-Authorship. Sterling, VA:
Stylus Publishing
Calvin, W. 1999. How Brains Think. New York, NY:
Basic Books
Campbell, J. 1949. The Hero with a Thousand
Digimag Journal
n° 73 | year VII
Cohen, D. 2006. “Perception and Response
to Schemata in Different Cultures: Western
and Arab Music.” In, eds. Alderage, D. and
Fachner, J., 60—73, Music and Altered States:
Consciousness, Transcendence, Therapy, and
Addictions. London, England: Jessica Kingsley
Publishers and Germany: University of WittenHerdecke
Dahaene, S. 1997. The Number Sense. New York,
NY: Oxford University Press
DeVries, R. and Zan, B. 2005. “A Constructivist
Perspective on the Role of Sociomoral
Atmosphere in Promoting Children’s
Development. In, Fosnot, 132–149,
Constructivism: Theory, Perspectives, and
Practice. New York, NY: Teachers College,
Columbia University
Dewey, J. 1934. Art as Experience. New York, NY:
The Berkeley Publishing Group
Edelman, G. 2004. Wider than the Sky: The
Phenomenal Gift of Consciousness. New Haven,
CT: Yale University Press
Eliot, L. 1999. What’s Going On in There?: How
the Brain and Mind Develop in the First Five
Years of Life. New York, NY: Bantam Books
Quarterly
November 2012
19
Enquist, M. and Ghirlanda, S. 2005. Neural
Networks and Animal Behavior. Princeton, NJ:
Princeton University Press
Etcoff, N. 1999. Survival of the Prettiest. New
York, NY: Anchor Books
Exploratorium. 2004. “Finding significance.”
in, Finding Significance. San Francisco, CA:
Exploratorium
Feldman J. 2008. From Molecule to Metaphor: A
Neural Theory of Language. Cambridge, MA: MIT
Press
Grossberg, S. 1973/1988. “A Neural Model of
Attention, Reinforcement and Discrimination
Learning. In, 232–295, Studies of Mind and
BraIn, Neural Principles of Learning, Perception,
Development, Cognition and Motor Control.
Boston Studies in the Philosophy of Science.
Dordrecht, Holland: D. Reidel Publishing
Company
Hawkins, J. 2005. On Intelligence. New York, NY:
Owl Books
Fodor, J. 2000. The Mind Doesn’t Work that
Way: The Scope and Limits of Computational
Psychology. Cambridge, MA: MIT Press
Herrero, J. 2005. “A Scientific Point of View on
Perceptions. In, eds. Mira, J and Álvarez, J,
416–426, Mechanisms, Symbols, and Models
Underlying Cognition. First International WorkConference on the Interplay Between Natural
and Artificial Computation. Springer
Gardner, H. 1983. Frames of Mind: The Theory
of Multiple Intelligences. New York, NY:
HarperCollins
Hill, R. and Castro, E. 2009. Healing Young
Brains. Charlottesville, VA: Hampton Roads
Publishing Co.
Goffman, E. 1959. The Presentation of Self in
Everyday Life. New York, NY: Anchor Books
Hundert, E. 1995. Lessons from an Optical
Illusion: On Nature and Nurture, Knowledge and
Values. Cambridge, MA: Harvard University Press
Goodall, J. 1968. “Chimpanzee Locomotor Play.”
In, ed. Bruner, J., Jolly A. and Sylva, K., 156—160,
Play: Its Role in Development and Evolution. New
York, NY: Basic Books
James, W. 1891. Psychology: A Briefer Course.
New York, NY: Henry Holt Publishing
Kern, S. 1983. The Culture of Time and Space
1890–1912. Cambridge, MA: Harvard University
Gopnick, A. and Meltzoff, A. 2006. “Minds, Bodies, Press
and Persons: Young Children’s Understanding
Lakoff, G. and Johnson, M. 1980. Metaphors We
of the Self and Others as Reflected in Imitation
Live By. Chicago, IL: The University of Chicago
and Theory of Mind Research.” In, eds. Parker,
Press
S., Mitchel, R. and Boccia, M., 166—186,
Self-awareness in Animals and Humans:
Lakoff, G. and Núñez, R. 2000. Where
Developmental Perspectives. Cambridge,
Mathematics Comes from: How the Embodied
England: Cambridge University Press
Mind Brings Mathematics into Being. New York,
NY: Perseus Books
Gonzales, R. and Wintz, P. 1977. Graphics
Programming. Reading, MA: Addison Wesley
Langer, J. 1998. “Phylogenetic and Ontogenetic
Origins of Cognition: Classification.” In, eds.
Greene, R. 2004. Internet Art. New York, NY:
Thames and Hudson World of Art
Langer, J. and Killen, M., 33– 54, Piaget,
Evolution, and Development. Mahwah, NJ:
Gregory, R. 1966/1997. Eye and Brain: The
Lawrence Erlbaum, Assoc., Inc.
Psychology of Seeing. Princeton, NJ: Princeton
University Press
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
20
LeDoux, J., 2002. The Synaptic Self: How Our
Brains Become Who We Are. NY: Penguin Books
Levin, G. 2006. “Computer Vision for Artists and
Designers: Pedagogic Tools and Techniques for
Novice Programmers.” Flong
Levitin, D. 2006. This Is Your Brain on Music. New
York, NY: Penguin Books
Marvin, C. 1988. When Old Technologies Were
New: Thinking about Electric Communication in
the Late Nineteenth Century. Oxford, UK: Oxford
University Press
McLuhan, M. 1964. Understanding Media.
Cambridge, MA: MIT Press.
Metzinger, T. 2009. The Ego Tunnel: The Science
of the Mind and the Myth of the Self. New York,
NY: Basic Books
Milgram, S. 1974. Obedience to Authority: An
Experimental View. NY: Perennial Classics.
Millikan, R. 1995. “Pushmi-pullyu
Representations.” In, eds. Nuccetelli, S and
Seay, G., 363–376, Philosophy of Language:
Central Topics. Plymouth, England: Rowman and
Littlefield Publishers, Inc.
Minsky, M. 1985. Society of Mind. New York, NY:
Simon and Schuster
_____. 2006. The Emotion Machine. New York,
NY: Simon and Schuster
Myler, H. and Weeks, A. 1993. The Pocket
Handbook of Image Processing Algorithms in C.
Upper Saddle River, NJ: Prentice Hall
Patel, A. 2008. Music, Language, and the Brain.
New York, NY: Oxford University Press
Piaget, J. 1929/1952. The Child’s Concept of the
World. New York, NY: Rowman and Littlefield
Publishers, Inc.
_____. 1962. Play, Dreams, and Imitation in
Childhood. New York: W.W. Norton and Co.
Cambridge, MA: MIT Press
Ramachandran, V. 2004. A Brief Tour of Human
Consciousness from Imposter Poodles to Purple
Numbers. New York, NY: Pi Press
Robbins, J. 2000. A Symphony in the Brain. New
York, NY: Grove Press
Rouget, G. 1980/1985. Music and Trance.
Chicago, IL: University of Chicago Press
Roseman, M. 1991. Healing Sounds from
the Malaysian Rainforest. Los Angeles, CA:
University of California Press
Schildt, H. 2003. C++: The Complete Reference.
Berkeley, CA: McGraw-Hill
Searle, J. 1994. The Rediscovery of the Mind.
Cambridge, MA: MIT Press
_____. 2001. Rationality in Action. Cambridge,
MA: MIT Press
Sfard, A. 2008. Thinking as Communicating:
Human Development, the Growth of Discourse,
and Mathemetizing. New York, NY: Cambridge
University Press
Shirky, C. 1995. Voices from the Net. Emryville,
CA: Ziff-Davis Press
Solso, R. 2003. The Psychology of Art and the
Evolution of the Human Brain. Cambridge, MA:
MIT Press.
Wright, J. 2010. “Neuroacoustics: Integrating the
Strengths of Computer Technology and Human
Biology through Music.” Sonic Ideas/Ideas
Sónicas. The Mexican Center for Music and Sonic
Arts. Vol 3, #1
Vallortigara, G. 2009, Animals as Natural
Geometers.” In, eds. Tommasi, L., Peterson,
M. and Nadel, L. 83 – 104. Cognitive Biology:
Evolutionary and Developmental Perspectives on
Mind, Brain, and Behavior. Cambridge, MIT Press
Pylyshyn, Z. 1984. Computation and Cognition.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
21
Sissel Tolaas, Smell of fear, http://crossjack.blogspot.ca/img1.png
THE POLITICS OF SMELL
How scent technologies are affecting the way we
experience space, sense of place and one another
by Nina Leo
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
22
Isolation continues to be manufactured, yet now
the means through which we access and expeEstrangement from the senses and from the na- rience intimacy are becoming redesigned as well.
tural world they enable us to perceive charts a
long history. One could say that the path was set As our reliance upon heavily ocular centric technowith the development of written alphabetic lan- logies evolve, and our daily interactions become
guage, for this form of communication began to more deeply immersed in remote, fractured, ofreplace the sentient means of transmitting and ten-virtual experience, our reliance upon and relareceiving meaning (such as body language, non- tionship with our senses devolve. And while these
verbal sounds, touch, taste and smell) of which technologies are, on the one hand, literally at our
fingertips, offering the impression that everything
our natural world was a part.
is close and that we are
able as never before to
As communications beconfigure our own indicame increasingly wordvidual experiences, they
based they began to
are, on the other hand,
exclude the surrounding
highly mediated, homoenvironment—rendegeneous, and stripped
ring Nature more inaniof direct multi-sensomate object than living,
rial richness.
breathing and communicating — and altering
Here as never before,
our social relationships.
the media responsiYet, while written lanble for connecting us
guage may have marked
so effectively to one
the beginning of our seanother also inherenparation from the natutly prescribes physiral world and sentient
cal and psychological
engagement, it was with
estrangement. And at
the onset of the modern
the same time that our
industrial age (and with
technologies distance
factory labor) that capius from sentient expetalist agendas began to
rience, they enable us
break down heterogeto more effectively dupe
neous, multi-sensorial,
the senses - creating
lived experiences of dufully fabricated images,
ration and rebuild them
sounds, smells and tainto the homogeneous,
stes. Experiences are
reproducible fragments
no longer simply methat speed and profitadiated but can now be manufactured to reside debility inherently demanded.
eply within our sense memory.
Our experiences became increasingly stripped
of all that made them unique, fluid and intimate, creating a longing that needed to be filled and The Vulnerability of Smell
making us vulnerable; In the age of industry, this
need was filled through object consumption. In While all of our senses become increasingly suthe contemporary age of media and technology sceptible to manipulation within this contempohowever, this consumption extends well beyond rary condition, smell may actually be among the
most vulnerable. The perfume industry
objects and into our most intimate social fabric.
Sensorial Estrangement
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
23
has a long history of enhancing or altering our
body’s natural odors to make them more attractive
- masking the smells we don’t like with ones that
we do. And while this is not new, as Constance
Classen notes in her book Aroma, “smell is hardly
ever considered as a medium for the expression of
class allegiances and struggles” (Classen, 1994a,
161) nor is it seen to have the power of sight or
sound to serve as a political vehicle. While it is one
of the most emotionally potent senses, and thought
to be one of the strongest triggers for memory,
it remains the least considered. As experiences
become more fractured and we become less
familiar with and tolerant of the natural smells
around us, olfactory simulation technologies
continue to advance. Now they are being developed
and utilized not simply by the perfume industry
to make us smell better, but by corporations as
a subversive marketing tool and by governments
to facilitate war. And, as they embark on some
of the most advanced research into smell, these
technologies are also changing and challenging
artistic practice, as artists begin to question and
counter with research and agendas of their own.
as a potent reminder of the sentient nature of our
being, but perhaps also as a means for exposing
our estrangement from this nature within daily
experience. For, while the vast, industrial space of
the Armory in which Anthropodino is housed is alltoo familiar, within the close, lush, fleshy, smelly
interiors of the work we are somewhat displaced.
Intellectually elusive and emotionally potent
smell, more than any other sense (save taste,
which functions together with smell) has the
ability to elicit feelings that are intensely visceral.
A smell can trigger a deeply embedded memory
we may not even “remember remembering”
because odor memories accumulate “outside of
awareness” (Gilbert, 2008, 201). And this bank
of smell memories develops even without our
conscious knowing; we need not intend to smell
smells or be attentive to their presence, yet
they build up and are stored with every breath:
Etymologically speaking, a breath is not neutral
or bland— it’s cooked air; we live in a constant
simmering. There is a furnace in our cells, and
when we breathe we pass the world through our
Ernesto Neto, quickly becoming one of Brazil’s bodies, brew it lightly, and turn it loose again, gently
most important artists, creates immersive altered for having known us (Ackerman, 1990a, 6).
environments meant to reacquaint us with our
physical selves and with sentient experience. The nature of our response to smell operates
He constructs large installations that reference outside of language. “Our sense of smell can be
the body’s interior. Often made from thin, semi- extraordinarily precise, yet it’s almost impossible
translucent, stretchable fabrics that recall human to describe how something smells to someone who
flesh, they, at times, also include intensely hasn’t smelled it. Smell is the mute sense, the one
aromatic spices that fill portions of the material without words, lacking in vocabulary”(Akerman,
and hang down like giant organs, releasing their 1990b: 6). These smells that we draw in can
scents into the air. Visitors are invited to move subconsciously evoke responses that are deeply
inside these spaces and to experience the work emotional. They can trigger feelings of comfort, yet
more than view it. With installations such as equally quickly set off a kind of squeamish disgust,
Anthropodino, housed in the Park Avenue Armory and this forms one of the predominant aspects of
in New York in 2009, and The Edges of the World smell. This inherently visceral response opens an
at the Hayward Gallery in London, 2010, Neto says even greater vulnerability as our culture becomes
he was much more interested in the air inside the ever more obsessed with purification for, while we
sculpture than in anything else - that his passages are drawn to smells that are ‘good’, nothing serves
privilege the air1. In an interview about the work he to keep us in a state of isolation and remoteness
noted the importance of re-engaging the senses more than the fear of the unclean. Ivan Illich in his
within a culture of remoteness “I wanted to touch essay The Dirt of Cities, The Aura of Cities, The
people with smell because it is very dangerous to Smell of the Dead and Utopia of an Odorless City
[physically] touch people”2, alluding to both the notes how our tolerance and attitude toward bodily
desire for and resistance against direct human smells began to shift as we became more deeply
closeness. In this way, Neto not only uses smell acquainted with the process of death and decay.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
24
[The living] demanded a special apartheid between
live bodies and corpses at just the time when the
innards of the live human body were beginning to
be visualized as a machine whose elements were
prepared for inspection on the dissecting table. The
dead became more visible and less awesome[...]
The presence of the dead was suddenly perceived
as a danger to the living[…] For the first time in
history the utopia of the odorless city appears[…]
Space had to be stripped of its aura once aura
had been identified with stench (Illich, 2003, 251).
The Smell of Commerce
Corporations understand and are increasingly
capable of making specific use of this olfactory
vulnerability. The perfume industry was developed
to feed a growing desire to the mask odors
(specifically body odors) that came to be defined
as unpleasant, and soon we began to equate
‘good smell’ with status—the better you smelled,
the richer you were. That has changed over the
years however; as ever more intimate interactions
reside within increasingly remote technologies
and we become further obsessed with purification.
“The olfactory social scale is the reverse of what it
was in earlier ages in the West[…] Now, however,
power resides not with perfumed potentates, but
with inodorous businessmen” (Classen 1994b,
168). The burgeoning, and much more recent airfreshener and de-odorizing industry preys upon
our fear of the unclean and fuels the belief that
some smells need to be eradicated altogether. It
is no longer enough to mask a foul odor so as to
make it tolerable; it has now become necessary
to kill a dangerous one in order to make it safe.
Norwegian artist Sissel Tolaas is one of the first
and most significant artists to work with smell.
With a background in mathematics, linguistics
and chemical science she became interested in
working with smell as a means of communication,
and to see what can be learned when it is distilled
and decoded. Tolaas embarked on some of the
most advanced research into chemically simulated
smell and in 2004 established the research lab IFF
re_searchLab Berlin for smell & communication.
In her project the FEAR of smell—the smell of
FEAR (presented in several different iterations
in exhibitions including the Tirana Biennale in
Digimag Journal
n° 73 | year VII
2005 and at MIT’s Visual Art Centre in 2006)3 she
used smell to situate viewers directly between the
conditions our techno/human interface prescribes
us to inhabit; the need for intimacy within the
experience of remoteness, and the utopic vision of
purification within the inescapable reality of stench.
In this project Tolaas collected the sweat from 14
- 25 men in various parts of the world, all of whom
are prone to anxiety and panic. She developed a
tool that, when placed under the arm during an
attack captures sweat molecules and records
their smell. Tolaas then took those smells into
her lab where they were broken down into their
various chemical components and recreated. The
simulated versions of each individual’s scent were
then reprocessed into molecules and embedded
into a special paint that would release the smell
upon touching4. For the exhibition, the artist
prepared a freshly painted white room, devoid
of any visual stimulus and fully reliant upon
our senses of touch and smell to engage. The
gallery space presented a utopian vision - pure,
white, and unsullied. The simple act of touching
however was enough to break the veil of purity and
expose the odor of the body. Once released, these
smells elicit an experience in the viewer that is
involuntary and anti-intellectual, as our response
to smell is inherently subconscious and visceral.
And this response, different for each individual,
could reveal much about where each of us resides
within the techno/ human condition. For some the
initial white room may have appeared comforting
and clean, while for others, cold and unsettling—
and the smell of the bodies? Some visitors
reported being overwhelmed by feelings of nausea
and disgust, while others (such as a woman who
returned to the exhibition daily and spoke to the
scent of one particular man) found the smells to
be familiar and intimate5. Not only were visitors
affected in some way by the experiences their
touch and smell afforded, but they also affected the
space in return, contributing traces of themselves
as the oils from their hands became overlaid onto
the ghost scents and built up upon the surface.
While Tolaas’ makes use of the long-standing
tradition of the white cube very specifically in this
work, her choice of bodily odor (as opposed to any
other smell) also holds particular significance.
Quarterly
November 2012
25
Sissel Tolaas, Fear 8, Image via: http://www.olfactorialist.com/?tag=sissel-tolaasimg4.png
There are many different kinds of smells that can
evoke disparate individual responses ranging
somewhere between the pleasant and the
putrid, but our response to the smell of the body
is particular. Carolyn Korsmeyer, in her book
Savouring Disgust notes that disgust is an aesthetic
affect (Korsmeyer, 2011) that can only be elicited
in response to organic material experience—in
response to living matter. This is because disgust
is a feeling that alerts us “to the presence of
danger indicated by decomposing vegetable or
animal matter” (Mather, 2008b, 58). Disgust is
elicited when we are pushed up against the reality
of our decomposing nature. The more difficult
this becomes to reconcile—the further removed
we become from the notion that we are mortal
beings bound to decay—the greater our fear and
disgust in the face of it, and the greater our desire
for, and comfort in, an eternal state of purity.
Korsmeyer explains the phenomenon in this way:
life is mortal, we are living organisms that will
live out our allotted time and then pass from
existence. Part of that passing away is a stage
where the remainder of our corporeal selves
will suffer disintegration and putrefaction. No
one is surprised to make this discovery. But like
so many existential truths, its magnitude slips
through the mind and cannot be held. The sublate
aspect of aesthetic disgust permits a moment
of sustained recognition, providing a time to
dwell upon mortality from a particularly intimate
and fragile perspective (Korsmeyer, 2011,158)
In the FEAR of smell - the smell of FEAR, Tolaas
uses simulated smell to reconnect us back to the
reality of the body. She has noted that, with the
constant bombardment of perfumes, deodorants
and sterilizers in the atmosphere (arising from our
desire to banish the smell of our mortality), we no
longer even know what our bodies truly smell like.
Her work to collect, dissect, decode and recreate
The aesthetic affect [of sublate disgust] gains these smells is in an effort to go back to zero to
intensity from the hallmark visceral repulsion bring us back to the origins of what we no longer
of disgust, which registers the inescapable, smell6. And in the contemporary environment, not
dolorous frailty of material experience[…] organic only are the smells that we deem unpleasant being
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
26
masked by something more desirable, but more We are sensorial beings bound to our physical
and more we are learning to erase the smells we nature. We perceive our environment though our
don’t want and replace them with ones we do want. senses and this perception forms the basis for
our understanding of self and of our place in the
The fast-growing air freshener and de-odorizing world - and smell, more so than any other sense,
industries were built upon and perpetuate a can elicit strong, deeply engrained responses
growing fear of the unclean. Now we are not to what we perceive. The government soon
simply covering over unpleasant odors, we are began to recognize that the responses triggered
sterilizing a dangerous environment. The more in soldiers by the smell of war were running
fearful we become of our corporeal condition, and directly counter to those required to carry it out.
of the contaminated environments that threaten When Sissel Tolaas exhibited her FEAR project in
it, the more products we consume to protect us. New York City, the New York Times published an
And at the same time that we buy products to rid article on her exhibition and research. Tolaas said
our surroundings of bad smells, we are inspired to that soon after, the U.S. Government contacted her
shop for others through the infusion of good ones. about the possibility of working together7. They
As consumers become increasingly savvy about were particularly interested in the advancements
artificial scents, corporations work to develop she was making in chemical olfactory simulation.
more convincing simulations of the real. Where The U.S. Army and Department of Defense had
we once smelled perfume with an undertone of already begun working with other artists and
the original unpleasant odor we can now smell scientists on research and developments of their
coffee where there are tires, or lilies where own. In 1999, they formed a strategic partnership
there are over-worked bodies. Smells are being (ICT) with the University of Southern California
simulated and orchestrated to such a degree that and several major entertainment industry leaders
we can now be completely duped. They no longer (including Disney, DreamWorks and Time Warner)
relate to the existence or presence of something, (Macedonia, 2000) specifically focused on olfactory
as they no longer require any point of origin; research. The Institute for Creative Technologies
something that exists need not smell, and a smell (ICT) developed the first Scent Collar prototype
need not come from something that exists. A for the military in 2002 (Vlahos, 2006) for which it
McDonalds french-fry, no longer cooked in beef won the patent in 20098. This collar is specifically
fat can, through chemical simulation, still smell designed for use with soldiers in virtual
(and taste) as if it was (Schlosser, 2002, 120). And simulation training. Troops can be trained to
this simulation will also assure that every french- fight strategically through virtual video game-like
fry, no matter how good the potato crop, will smell recreations of the battlefield but once deployed
exactly the same - every new car, shopping mall they are ill prepared to deal with their intense and
bathroom or florist’s rose can, through chemical involuntary responses to smell. The Scent Collar,
simulation, have its smell exactly determined and designed to wrap around the neck during training
precisely duplicated. In this way, even smell is sessions, delivers overwhelming simulations of
being broken down and rebuilt into homogeneous, the real smells they will encounter in battle in an
reproducible, mediated fragments. This ability to attempt to acclimatize them to the smell of war:
chemically reproduce, manipulate and control
smell, known to so effectively and elusively The smell/memory/emotion connection is
influence us, offers it up to corporations as a most tantalizing to military simulation experts[...]
effective marketing tool. And it may also offer it Veterans cannot forget the odors and newly
up to governments to advance their agenda of war. deployed soldiers are often so overwhelmed by
the olfactory assault that it distracts them from
The Smell of War
the task at hand. To prepare troops, the Army and
Marines use simulations that expose soldiers to
The efficacy and potency of smell has also become of noxious odors— melting plastic, rotting flesh—
great interest and concern to the U.S. government. before deployment, where the smells may be
encountered for real (Vlahos, 2006, 76-93).
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
27
The Scent Collar is designed to train soldiers
to override the very instinct that their olfactory
triggers alert. Olfactory simulation affords the
military the opportunity to rewire soldiers’ inherent
responses to smells such as decomposing matter
and death - those of fear and disgust that alert them
to danger or inspire human empathy - so that they
may fight more effectively. The ability to manipulate
and circumvent our natural responses to smell
is becoming an invaluable tool in war precisely
because the senses are our understanding of
mortality - they enable compassion and empathy
and bind us in a shared human experience.
The Smell of Community
Dutch artist Birthe Leemeijer, began work on The
Essence of Mastenbroek in 2005. This project
elucidates how central the ability to engage with and
experience the (unmediated) smells that surround
us - those we have become most disconnected
from—is in building our sense of self, defining
our sense of place and developing our sense of
community. Undertaken in a late-medieval Dutch
polder in the province of Overijssel, Mastenbroek
has a rich farming history. Leemeijer began
working with the residents there who expressed
a desire to create a visceral expression of their
deep relationship to the land and community that
are now coming under pressure from urban and
industrial development. It was decided that this
could be communicated most potently through
smell. This led to the development of the Essence
Club; the purpose of this club was to meet, discuss
and develop the scent, or more importantly
the combinations of scents, that embody the
experience of Mastenbroek. Club members
frequently met to share experiences, recount
memories and pour over photographs9 as a
means for excavating and articulating the complex
olfactory landscape in which they were immersed.
The group was interested to find the smell that
could convey their shared experiences, one that
could provoke something meaningful for each of
them and signify their bond. They discussed the
importance and impact of the changing seasons
on various smells, and developed an archive of
those they felt most prominent such as fresh
cut grass in the silo, shearing sheep in autumn,
stables, fresh milk, ditches, hay etc. Once all of
Digimag Journal
n° 73 | year VII
the smells had been discussed and recorded,
they began working with perfumer Alessandro
Gualtieri10. The group then convened to sniff
samples, hone in on essential smells, and work
through combinations and balances until they felt
they found the one that embodied and recalled
Mastenbroek. Because of the complex and
ephemeral nature of olfaction, smell allowed the
group to create a potent reminder of this specific
place, without reducing it down to any singular
vision. The smell could be drawn from some
common place - convey something commonplace,
yet evoke for each individual that smelled it
their own unique feelings and experience something familiar yet layered and indefinable.
the smells had been discussed and recorded,
they began working with perfumer Alessandro
Gualtieri10. The group then convened to sniff
samples, hone in on essential smells, and
work through combinations and balances until
they felt they found the one that embodied and
recalled Mastenbroek. Because of the complex and
ephemeral nature of olfaction, smell allowed the
group to create a potent reminder of this specific
place, without reducing it down to any singular
vision. The smell could be drawn from some
common place - convey something commonplace,
yet evoke for each individual that smelled it
their own unique feelings and experience something familiar yet layered and indefinable.
Now, the smell is being distributed throughout the
community and to the surrounding urban centers
that threaten it. Perhaps it is in the hope that it
may inspire a connection to place and community
even for those who do not live there. Or perhaps
it is a memorial of sorts, for a land and a lifestyle
that may soon be obsolete. Many of the farms
are being sold as urban communities begin to
encroach and younger generations become less
likely to work them. Every resident who leaves
Mastenbroek is given a bottle of the fragrance as a
memento of their experiences there, and owners of
the perfume are invited to refill their bottles from
the large communal container known as De Bron
(The Source) housed in the local visitors centre11.
Quarterly
November 2012
28
USC Scent Collar, http://skydeas.smugmug.com/Professional/Morie-USC-Scent-Collar/17611389_8hcR4z/1341914470_qrcCPVP#!i=1341915751&k=MRvddjximg3.png
likely to work them. Every resident who leaves
Mastenbroek is given a bottle of the fragrance as a
memento of their experiences there, and owners of
the perfume are invited to refill their bottles from
the large communal container known as De Bron
(The Source) housed in the local visitors centre11.
The past decade has given rise to major advancements in smell simulation technologies. Research
labs have made great strides in the development
and integration of chemically remanufactured
smell however this industry has, for the most part,
maintained a proprietary and hermetic profile.
Ubiquitous in its applications; from food fragranThe club even designed the containers and ces (and flavorings); to environmental augmentapackaging for the scent and, not unlike Ernesto tions; to corporate marketing strategies; to war
Neto’s lush Anthropodino, housed inside the stark, simulation training, smell technologies have gone
industrial Armory, L’Essence de Mastenbroek largely unnoticed and most certainly under-concomes in a clean white box with spare black sidered, altering our environment and influencing
script. Once opened, the smell is released and our experience.
colorful images of the rich, pastoral landscape
from which it comes are revealed inside. And not Drawing our attention to the impact of smell
unlike the smells of bodies that fill Sissel Tolaas’ through unexpected means, artists are exploring
pure white gallery space some may find the our visceral and complex relationship with the olsmell comforting and familiar while others may factory sense, as this terrain becomes ever more
find it unpleasantly pungent. But with each whiff fractured and disorienting. They have begun to rewill come an emotional and visceral response spond to, and in some cases lead, developments
that reveals much more about the smeller’s in these areas, creating new hybrid forms of pracown experience and understanding of being in tice capable to question, elucidate and challenand amongst the world than anything else - ge larger social and political considerations and
such is the nature of our relationship to smell. agendas.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
29
Elusive, invisible and emotionally potent, smell
seeps into our consciousness and, whether we
are aware of it or not, with each breath informs
our understanding and experience of space, our
sense of place and one another.
Fig: Birthe Leemeijer, The Essence of Mastenbroek, Photo: Renate Boere
http://classic.skor.nl/artefact-296-nl.html
ty Press, 2011), 158.
David Abram, The Spell of the Sensuous. (New
York: First Vintage Books, 1990).
Diane Akerman, A Natural History of the Senses.
(New York, Vintage Books, 1990), 6.
Eric Schlosser, Fast Food Nation, (New York:
Harper Perennial, 2002), 120.
He threw the window wide open, delighted to take George Mather, Foundations of Sensation and
a bath of fresh air… [T]
Perception. (Psychology
hese scattered whiffs of
Press; 2 edition, 2008),
perfume came together,
58.
and the familiar scent
of frangipane, the eleIvan Illich, “The Dirt
ments of which his senof Cities”, and “The
se of smell had detected
Aura of Cities”, “The
Smell of the Dead”, and
and recognized, spread
“Utopia o an Odorless
from the valley[…]assaiCity.” In, ed. Malcolm
ling his jaded nostrils,
Miles, Tim Hall and Iain
shaking anew his shatteBorden, 249 - 252. (The
red nerves and throwing
City Cultures Reader.
him into such a state of
London: Routledge; 2
prostration the he fell
edition, 1986)
fainting, almost dying,
across the window-sill.
James Vlahos, The
Smell of War, (Popular
Joris-Karl Huysmans,
Science. August., 2006),
Against the Grain ( A
76-93.
Rebours), 1884
Joris-Karl Huysmans,
Against Nature (A
Rebours). (London,
England: Penguin
Books., 2003).
References
Avery Gilbert, What the
Nose Knows: The Science of Scent in Everyday
Life. (New York: Crown
Publishing, 2008), 201.
Constance Classen, Aroma: The Cultural History
of Smell. (New York: Routledge; 1 edition, 1994),
161.
Michael Macedonia,
U.S. Army Simulation, Training and Instrumental
Control (STRICOM): pg 37 (Entertainment
Technology and Virtual Environments for Military
Training and Education, 2000).
Carolyn A Jones, Sensorium: Embodied Experience, Technology and Contemporary Art. (Massachusetts, First MIT Press, 2006).
Carolyn Korsmeyer, Savoring Disgust: The Foul
and the Fair in Aesthetics. (USA, Oxford Universi-
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
30
Notes:
1 Available online: http://www.youtube.com/
watch?v=q9AzsgStb0A
2 ibid
3 Available online: http://www.wired.com/wired/
archive/15.05/posts_odor.html
4 Available online: http://www.youtube.com/
watch?v=46EL1DQxcSo
5 Ibid
6 ibid
7 ibid
8 Available online: http://ict.usc.edu/news/ictscent-collar-wins-patent/
9 Available online: http://www.behindthescene.
org/article-190-en.html
10 ibid
11 Available online: http://www.skor.nl/artefact296-en.html
Nina Leo
Nina Leo is a Canadian multi-disciplinary artist
working primarily in drawing, installation and public
practice. Her work examines how the contemporary
media and technology-rich environment may affect us
phenomenological as experiences and interactions
become ever more accessible yet divested of direct
multi-sensorial richness. She specifically explores
how this otherwise redesigned intimacy may alter
our interactions, influence our sense of self and
shape our socio-political perceptions.Leo holds an
MFA in Emerging Practices from the University at
Buffalo and has shown widely in Canada and the
United States, as well as in Mexico. She currently
teaches critical theory and studio practice at OCAD
University (CAN).
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
31
We Are Forests © Duncan Speakman and Émilie Grenier 2011
TRANSNATIONAL,
COLLABORATIVE ARTISTS IN
RESIDENCY PROGRAMMES
A practice-led evaluations with suggestions and
recommendations
by Annet Dekker, Gisela Domschke, Angela Plohman, Clare Reddington, Melinda Sipos,
Victoria Tillotson, Annette Wolfsberger
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
32
A residency is a conceptual space that typically sits within the physical space and networks of
an organization. The residency itself is intangible,
yet exists through a structure of time, discussion,
thought, action and proclamation. The residency
provides space for creative practitioners to develop ideas within a supported environment, outside
of their usual context. It enables immersion within
different culture, exploration of practice with new
people and a safe space to take risks. Practiced
worldwide, the residency has become an invaluable resource for artists
and the development of
new work - but is its potential much greater? As
producing organizations,
can we work together to
connect our individual residency spaces? Can we
use this connection to
increase value to artists
and the development
of art? Can we offer a
more diverse cultural contribution? Can we open
up our practice to new
audiences? And in this
unpredictable, global financial climate, can we
offer greater stability by
combining (often limited) resources?
xel and Sander Veenhof), were produced between
NIMk and Vivo ARTE.MOV in São Paulo (BR). Each
programme was unique in structure, but each
worked across countries and cultures, to support
research and development of new artistic ideas.
Each was initiated by NIMk, but were produced and
developed with mutual responsibility and equal
sharing of the workload. This article sets out to
share key learning from these programmes, with
an aim to inform design of future schemes and reflect on the potential of the residency space.
What is a residency?
The residency should
be continually re-imagined, but inherent
shared characteristics
within Naked on Pluto,
We Are Forests, Narrative Navigation and You
Are The Protocol, were:
· Time and space for
artist(s) to reside at each
lab to research and develop a new work
· A modest artist fee
· Production budget
(including support of
travel and accommodation)
Fig: Naked on Pluto,
screenshots
In 2010, Netherlads Media Arts Institute (NIMk)
led the set-up of three
transnational collaborative artists in residence
programmes. The first, Naked on Pluto (developed by Dave Griffiths, Aymeric Mansoux and
Marloes de Valk), was collaboratively produced
between Baltan Laboratories, NIMk, and Piksel.
The second, We Are Forests (developed by Duncan Speakman and Émilie Grenier), was similarly
produced between NIMk, 5 Days Off festival (NL),
Pervasive Media Studio (UK) and Kitchen Budapest (HU). During the third, two projects, Narrative Navigation and You Are The Protocol (by VJ Pi-
Digimag Journal
n° 73 | year VII
· Regularly scheduled
conceptual and technical
critiques with lab communities
· Online documentation of project process
· Testing opportunities
· Public presentation of research
In terms of structure, the projects were developed within different time frames, from an intense
three-month period, to a number of short sprints.
Quarterly
November 2012
33
For each set-up, the needs of the artists, the
nature of the project and the flexibility of the
budget was taken into consideration. It’s important
to determine a clear definition of the expected
outcomes of the residency. Residencies often focus
on the production of a new work or commission.
However, a focus on research and development
can be extremely valuable. R&D frames the
residency as a safe lab-style space for taking
risks on new ideas. This brings a wider scope for
experimentation that significantly benefits future
practice and production. It also gives rise to new
forms of collaboration, creation and cooperative
culture. Since completing these programmes, the
project teams have discussed possible formats
beyond artists, such as ‘idea in residence’. These
could include curators, researchers or producers
in residence, or wider staff exchanges.
on several key learning points which we defined
as: 1) Focus; 2) Preparation, Planning & Duration;
3) Communication. These three areas shared
common characteristics between the residencies
and could also be used to bring to light more
general issues.
Focus
The focus in all three residencies was very
different, from working towards a presentation
within a pre-set exhibition theme, to a research
period, and creating an interactive project for
a mobile situation. Although this difference in
focus was not anticipated beforehand, it proved
beneficial because it meant that different strategies
could be experimented with: in terms of content,
collaboration with multiple organisations in
various countries, and choosing various working
What is the added value of collaborative, shared methods (single projects, collaborative projects).
residencies?
Preparation, Planning & Duration
Collaborative residency programmes, particularly
those that are transnational, hold increased The structure and timing of the development
value for both participating artists and producing period was built around the first proposals that
organisations. For artists, shared residencies were accepted. Nevertheless we felt with each
offer a context that’s more than simply time residency that time was always too short, but
and space to work. By residing at each partner it also became clear that each residence very
organisation, time and space is multiplied across much required its own planning and structure,
locations; and each location brings it’s own culture because people work in different ways, have
to the work. Whether through working methods, varying skills, and need various ways of guidance
language, conceptual interpretations or other or assistance from the organisation, all of which
cultural factors, a place and time can significantly can shift during the period of the residence. It is
influence thinking and deepen complexity of only during the process of the residency that the
a work. For organisations, shared residencies needs and necessities of resident artists and their
mean shared resources. This multiplies the offer project become clear. This was clearly reflected
to the artist and distributes workload in terms of with the second case study, We Are Forests. Early
administration and organisation. We also found in the development of the residency structure, the
that it allows stronger relationships to form partners had intended the outcome to be a finalised
between organisations and individual producers piece, exhibited during an exhibition or festival.
working within them. In our experience, this However, as we were looking to commission an
encouraged valuable knowledge sharing in terms experimental work, emphasis was shifted to R&D.
of working practices; and the formation of new We still wanted to work with a festival, and 5 Days
transnational opportunities, collaboration and Off were keen to provide support for the artists to
cultural capital.
test ideas at the festival during the development
period.
Evaluation points
However, rather than using it as a platform to
When evaluating the individual projects and exhibit a final work, we all felt the creation of a
comparing them to each other we decided to focus lab-type space within a festival, was a much more
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
34
‘Mock-up shots from You Are the Protocol’, Sander Veenhof
useful and valuable approach.
work things out.
The attitude of going with the flow is even more
important in cases where people who don’t
know each other beforehand are asked to work
together, or if the artists are in the early stages of
their career and are less experienced. The latter
is in some ways an advantage for the organisation,
because it is easier to keep track of the working
process. This is often more distanced in the case
of more experienced artists who are more likely to
take decisions on their own. For example, with the
Naked on Pluto residence, the planned duration
of the residency was initially set to three months,
but since the artists came from different countries
and time planning was an issue, it was decided to
extend this to a six-month residency period during
which half of the time was actual working time.
Furthermore, due to time and availability constraints
it was decided to make a set up of ‘sprints’: During
a period of one week the artists would visit one
of the media labs and work together on the
development of the project. The sprints turned
out to be very productive, especially for the artists
since it gave them a very intense time together to
“The sprint format really suited this project. There
were parts of it that required the three of us to be
together physically, to get our heads together for
intense sessions of brainstorming, scriptwriting,
game-world design and concept development.
The sprints provided us with the time, space and
focus to accomplish this. Other parts of the project
required more isolation and longer stretches
of individual work, such as the implementation
of the interface design, writing the server and
client-side code, and writing the texts for the
game. Those parts were done remotely, with a
bug tracker, a Wiki, and lots of video calls to sync
our actions. Besides the creative and productive
benefits of this format, there are also practical
issues to consider. None of us could have left our
home for months on end, for example. We have
families and other work obligations to consider.
This way we could collaborate over a long period
of time (six months), with a big distance between
us (1500 km) on a project that otherwise would
have been impossible to realise.”
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
35
Marloes de Valk in “Interview with Dave Griffiths, commitments, a substantial lead-in time is
Aymeric Mansoux and Marloes de Valk”, A Blueprint recommended. The intensity of the residency
for a Lab of the Future, Baltan Laboratories, 2011 period and the wish to concentrate on the project
during this time leaves little headspace for other
The format of week-long sprints was perhaps not projects. Being physically separate from the usual
the most ideal for the media labs, as it gave them working environment was a further contributing
little time to engage with the project or with the factor. One way of dealing with this is to build
artists since they were always extremely busy (of breaks into the residency period. Breaks make it
course) with the project. A period of at least two possible to catch up with other work commitments,
weeks would have been more beneficial. However, and provide time for distance and reflection. If the
with the third case study, Narrative Navigation artists do not know the labs beforehand, it would
and You Are The Protocol, we concluded that an be useful to provide information and context about
even longer residence period was required. In them in the lead-up to the residency. This could
this case the cultural differences between the be provided by the labs/producers and by previous
countries, the Netherlands and Brazil, as well artists in residence, who could describe the lab
as the different level of experience and expertise environment from an artist’s point of view.
of the two artists necessitated a longer period
of adjusting, conceptualising and developing the Planning a return visit to the initial lab where
projects.
the residency started proved also to be a good
idea: a final meeting/presentation at the first lab
It was agreed by all resident artists that working closes the residency cycle, and gives the first lab
between different labs and countries was extremely the opportunity to experience the final results of
beneficial. The change of environment, visiting the the residency (taking into account that the initial
different labs with their different backgrounds and research can be very different to the final output).
contexts, also proved very beneficial for the artists.
They liked the new environments and each one Communication
provided them with new energy and inspiration.
Communication and knowledge transfer inside
“What’s important to me in these residencies an organisation is important, but can be less
that you’ve set up is that they give us more frequent than meetings with producers/artists and
focus. The presence of a physical location and between producers of the different organisations.
an opportunity to meet different people who are However organisational meetings with artists is
doing other things, to meet, talk, discuss and recommended, as it strengthens connections, opens
possibly exchange is very important. For example, unforeseen exchanges and builds confidence.
the act of having to give presentations during the
residency, which at first might seem annoying, is Although there are cost implications, regular faceactually very beneficial. It forces you to explain to-face meetings between all producers/labs and
what you’re doing, to reflect on the things that artists are beneficial not only to the artists, but
have been in your head, or that have come up also to the producers/labs. Face-to-face meetings
between the three of us, and to make some sense allow producers to better understand the working
of it again.”
methods of the other labs and stay more closely in
touch with project development. Although process
Dave Griffiths in “Interview with Dave Griffiths, could be followed on the online project journal
Aymeric Mansoux and Marloes de Valk”, A Blueprint and blog, and tools such as Skype were utilised,
for a Lab of the Future, Baltan Laboratories, 2011. we found face-to-face meetings could not be
replaced. They strengthen our relationships and
Nevertheless, the spread between different countries, significantly increased opportunities for future
and different working environments, create a collaboration.
number of major shifts for artists. To enable
artists to fully prepare and manage other work
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
36
and recorded the final presentation in Bristol,
http://www.dshed.net/we-are-forests. In the case
During the evaluation process of the projects we of Naked on Pluto, as described above, the artists
distinguished several common issues that we maintained a very extensive project blog that was
believe can be generalised to other (kinds of) updated regularly throughout the process and
continues to be a rich source of information and
collaborative residences:
reflection on the issues raised in the artwork,
http://pluto.kuri.mu.
Trust:
Common issues
While it is important for the artists to understand
the roles and the context of the different labs
involved, it is also important for the labs to
understand the working methods of the artists.
Within previous (transnational) residencies it has
proven an advantage if at least one of the labs are
familiar with the resident artist(s). This raises
questions of openness: whilst open calls create
a ‘way in’ for artists outside of the labs networks
and equally provides an opportunity for the labs to
discover interesting work that was not previously
on their radars, solicited applications are often a
reality.
It is essential to build in moments for discussion
and reflection. During each residency we
organised presentations, workshops and test
sessions, some of which were scheduled from the
outset, some of which were ad hoc in response
to the needs of the project. For example, Baltan
Laboratories organised a play testing session
during the Naked on Pluto sprint in Eindhoven
with a group of Game Design students from the
Fontys University of Applied Sciences and the
Technical University Eindhoven.
“This resulted in a lot of valuable feedback on
interface and game mechanics, and a mountain
Trust between labs and the artist(s), and the labs of new bug reports. This session was followed by
several one-on-one play-tests that focused more
themselves, is an essential commodity.
on the individual game experience and narrative.”
David Griffiths, Aymeric Mansoux and Marloes de
Collaborations are built on:
Valk, “Naked on Pluto” in A Blueprint for a Lab of
the Future. Baltan Laboratories, 2011.
· The quality and profile of labs
· How their offer contributes to the collaboration
As part of We Are Forests, a final presentation
· How they compliment partner labs
took place within each residency block in each
However, the success or failure of a collaboration location (Bristol, Amsterdam, Budapest). The
presentations were open to potential audience,
often depends on the people within them.
other artists and those with expertise relevant to
Finding producers and collaborators with a can- artists’ practice. In Brazil, the artists were able to
do attitude, an open approach and an ability to test different stages of “Narrative Navigation” in
previously defined places where the actions could
learn from failure is imperative.
take place, considering different zones in the city
with lack of digital art accessibility. Amongst the
Documentation & reflection:
selected areas, three of them hosted Labmovel
It is crucial the residency is documented throughout. activities during the residency: public square in
Sharing process and findings as the work is Freguesia do Ó, Public Library Mario de Andrade
developed, allows others to easily follow the project and Centro Cultural São Paulo.
and comment where useful. Documenting the
journey also facilitates valuable reflection and As part of the third case study we conducted a
evaluation at the end of the residency. During thorough analysis of the impact of documentation
We Are Forests, the artists regularly updated an methods that were used during the development
online project journal that was shared on partner process of the residences.1 For all the residences
sites; the labs also created short videos interviews we used a blog to document the development.2
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
37
‘Mock-up shots from You Are the Protocol’, Sander Veenhof
One of the pitfalls of a standard blog is that
the structure influences the outcome of the
documentation, for example it is chronological,
always showing the last post that is created.
Another difficulty was setting the goal(s) of the
blog: the audience you’re writing for influences
what you will be writing. Although all the artists
were open to sharing their experiences during the
process, it quickly became apparent that there are
very different ways to document a process. Some
artists preferred to use video statements, others
captured the development in photography, some
used informal and personal narrative techniques,
again someone else would focus on technical steps
that were made. Furthermore, the information on
a blog is very contextual but the content can be
accessed, copied and shared by anyone as soon as
a post is published. It happened a few times that
information or interviews were posted on other
websites without reference or information that
would explain the views expressed.
methods that are being developed for the
restoration and preservation of contemporary
art.3 Rather than only serving the purpose of
reconstruction, these models prove to be flexible
and therefore open to different usages, creating
an interesting point of departure to experiment
and analyse the documentation of artistic working
processes. The main focus of these models is doing
interviews with the artists during the whole
process at set times and around specific issues.
The documentation models proved to be valuable
guides for posing questions and addressing
specific issues. The interviews clearly showed the
changes in the artists’ thinking and their decisionmaking processes. A more in-depth analysis could
provide other artists, developers, researchers
and organisers with interesting insights and
useful information regarding creative and artistic
working processes
On going questions:
Next to an evaluation of the content and use of Should the role of the labs be defined within the
the blogs, with the third residence we compared residency? In both cases, the role of ‘facilitating
the documentation strategy with documentation making and thinking’ was present at each location.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
38
However each lab had a unique emphasis, drawn
from the expertise within their communities. It’s
therefore important to define not necessarily the
role of the labs, but the specialist qualities of each
lab and what their communities offer. This enables
artists to efficiently plan and maximise project development at each location.
complimentary values yet unique offers, who
advocate open, collaborative approaches
· Consider western and non-western ways of working and producing residencies
· Research phase: Select an artist who also advocates an open, collaborative approach. Engage in
How can we best keep each other updated about subsequent discussions regarding the project and
process and facilitate communication betwe- possible needs and begin sourcing collaborators
en labs? We have continuing discussions on etc.
this point. Online tools
· Manage
expectawere utilised frequentions: it’s important to
tly throughout the resiget this right from the
dency, but as previously
outset and get it right
mentioned, the imporwith everyone involved,
tance of face-to-face
including artists, labs,
meetings should not be
underestimated.
partners, collaborators
etc.
Fig: You Are the Protocol’, Sander Veenhof,
· Define the scope, rephotos by Lucas Gersources, goals and idenvilla
tify the adjustable variables
Is there a necessity to
match-make and sup· Identify the opportuport networking of arnities to work with and
tists? This is important
learn from partner orand as individual labs
ganisations and where
we often provide this
possible, build these op‘service’ within our conportunities into the prostituencies.
However,
gramme from the outset
there is a great opportunity to escalate this
· Is the residency an
by facilitating cross-lab
exchange or not? - Ennetworking.
sure everyone has a
shared understanding
Conclusion: the resiand attitude
dency life cycle
During:
The life cycle of a collaborative residency begins
before commencing the development period and · Encourage curiosity through regular critiques
continues for a short while afterwards. From the and (in terms of technology augmented projects)
experience of producing the different projects, we testing of the work
recommend considering the following4:
· Maximise the relation to local context
Before:
· Build the collaboration: identify partners with
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
39
Naked on Pluto, screenshots
· Residencies contribute to making the lab into and between project partners. Also consider how
what it is - consider how to keep traces of that and to continue the exchange of knowledge.
share it
· Consider how to measure the outcome
· Be aware of the everyday life dimension of the qualitatively and quantitativelyConsider how to
residency - the human, informal dimension - it’s support the work beyond the residency period: is
essential
there scope for touring? Or informal advice you
can offer on opportunities such as project grants,
· Flexibility can be an issue, find a cohesive way to or other residencies the artists could access, to
accommodate it
further develop the work?
· Get deep into other partners ways of working
The potential impact of the transnational
collaborative residency is great. It makes space
for ideas and reflections that would not otherwise
· Document and share the process throughout
be possible. It creates focus, accelerates project
Afterwards:
development and exposes process. As producing
organisations, we’ve found that we can work
· When does the residency end? Bring it to a together to connect place and space, link our
networks, and share resources and knowledge.
celebratory close
· Disseminate the ‘story’ (public and other) and
present work-in-progress
Through this cooperation, we have multiplied
support for artists, offered diverse cultural
contributions, archived process and increased our
· Share key learninConsider how to continue engagement with audiences worldwide. And in the
fostering relationships between host and artists; present, unpredictable, global financial climate,
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
40
USC Scent Collar, http://skydeas.smugmug.com/Professional/Morie-USC-Scent-Collar/17611389_8hcR4z/1341914470_qrcCPVP#!i=1341915751&k=MRvddjximg3.png
we believe this model does offer increased stability
for artists and participating organisations, and unlocks
potential that we simply hadn’t imagined when we
began.
exhibition aims were to make such an ‘obscure’
technological object as software, open, palpable
and approachable, bridging a gap between ‘serious’
production such as technology and ‘non-serious’
production such as different forms of art. The
Case Study #1: Naked on Pluto
exhibition had a few distinct threads: games; ASCII;
Collaborative AiR between NIMk, Baltan
code art; a few vectors of AI; computers in popular
Laboratories & Piksel
culture; spyware, conceptual software, hardware
modification, hacker/virus approaches, sound,
The set-up:
software modification, pranks, participatory web.
And as software is intertwined with the hardware
Baltan Laboratories in Eindhoven (NL), Netherlands it runs upon and the networks that construct the
Media Art Institute (NIMk) in Amsterdam (NL) and society in which it rules, the exhibition featured
Piksel in Bergen (NO) launched an open call for a lot of projects dealing explicitly with computer
proposals as part of the exhibition project Funware. hardware or the materiality of hardware as well
We were looking for interesting new software art as engaging projects experimenting with sound.
projects that could be developed in the period of
June – November 2010 through a shared residency. The project:
The new work would be presented in the Funware
exhibition at MU in Eindhoven (November 2010 – Naked on Pluto is a Multiplayer Text Adventure on
Facebook developed by Dave Griffiths (UK), Aymeric
January 2011).
Mansoux (F) and Marloes de Valk (NL). Naked on
The Funware exhibition (curated by Olga Goriunova) Pluto proposes a playful yet disturbing online
demonstrated the trajectory of humour and affect game world, developed with Free/ Libre Open
as constitutional to software and computing. The Source Software, which parodies the insidiously
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
41
invasive traits of much “social software”. The city
of “Elastic Versailles” is animated by the quirky
combinatorial logics of a community of fifty-seven
AI bots that glean Facebook data from subscribers
to the game. Naked on Pluto’s bot crew, which are
hard to distinguish from other agents in this textbased environment, are dysfunctional gatekeepers
whose access-control means are broken by the
participants only to be elastically “healed” by
the bots. Players attempt to override the game’s
restrictions, teaming up in order to ultimately
crash and escape from the system. Reporting
on activities via a blog and Twitter, and issuing
a constant stream of incitation to click, declare,
poke and buy, the bots run havoc with one’s own
and one’s friends’ data, generating more or less
spurious links with chillingly escalating speed.
Disconcertingly familiar faces and information
from one’s personal and associated profiles
are indiscriminately blended in a brash prosumer
landscape which, like the original Versailles, is
designed for promotional parades of inseparable
personal and ideological attributes. No player
information is shared, stored, or relayed back to
Facebook in this malleable social ecosystem where
all that counts are glimpses of fleeting visibility.
Naked on Pluto caricatures the proliferation of
virtual agents that harvest our personal data to
insidiously reshape our online environments and
profiles, highlighting the ambivalent hallmarks
of major social networks: friends as quantifiable
and commodifiable online assets, personas
carefully fashioned contrived to impart a sense
of “intimacy”, and disingenuous publishing of
“private” data as self-advertising. The emergence
of intelligence in this game is ultimately, hopefully,
that of the players who manage to escape from it.
time and space to research projects at the
intersection of art, mobility and culture. The
programme was set up to support early stage
ideas that utilised pervasive technologies, free/
open source software and involved audience
participation. It was designed to be a valuable
opportunity for artists to explore process and
develop experimental works within four unique
collaborative environments. Artists were not
pressurised to produce a finalised piece, but were
asked to present work in progress within a public
arena and/or festival environment.
The project:
Duncan Speakman and Émilie Grenier were
commissioned to research and develop a new
participatory sound work entitled We Are Forests:
In a social environment full of micro-blogging and
continuous status updates communicated through
text and image, what happens to the emotional
weight of the human voice? We Are Forests was
a participatory sound work that used everyday
and emergent mobile technologies to ask, ‘What
would you whisper into a stranger’s ear’?
To find out more about the project you can read the
artists journal: http://nimk.nl/blog/weareforests/
Case Study #3: Narrative Navigation & You Are
The Protocol. Collaborative AiR between NIMk
and Vivo arte.mov
The set-up:
Netherlands Media Art Institute (NIMk) in
Amsterdam (NL) and Vivo ARTE.MOV in São Paulo
(BR) launched an open call for proposals as part
http://pluto.kuri.mu
of the cultural funding programme Central de
http://naked-on-pluto.net/
Cultura, created to intensify cultural exchange
between The Netherlands and Brazil. The aim of
Case Study #2: We Are Forests
this program is to lead to long-term cooperation
Collaborative AiR between NIMk, 5 Days Off, between artists between the two countries. The
Kitchen Budapest (KIBU) & Pervasive Media fund that has committed to our project is the
Studio
Mondriaan Fund. We were looking for proposals
from artists or curators to develop an art project
The set-up:
or workshop programme for a mobile lab &
presentation platform that could be used and
NIMk, 5 Days Off, KIBU & Pervasive Media Studio adapted by both organisations.
advertised a global, open call for artists seeking
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
42
are undertaken to safeguard the collection,
archive, distribution and presentation, there is
yet no concrete plan for the continuation of the
artist in residence programme. The coordinators
responsible for this programme, Annet Dekker
and Annette Wolfsberger, are seeking other ways
to organise collaborative residencies. http://
aaaan.net.
The projects:
Narrative Navigation is an open structure for geolocated narratives about the city. Anyone can use
it to add its personal narrative to a city, or simply
to navigate through the stories that are already
in the system. It can be a memory related story
or an idea for the future, a real fact or a simple
quotation. The project expands the idea of mobility
beyond devices and instruments, and encourages Collaborating producers of Naked on Pluto:
the user to actually walk through the navigation,
Baltan Laboratories (Eindhoven, NL) initiates,
creating new routes of narratives.
mediates and shares innovative research and
You Are The Protocol is a communication network development at the intersection of art, design and
based on dynamically generated QR-codes, which technological culture. Baltan sees the laboratory
contain multiple messages each. It works like as a way of working. It is both a network and
the IP-protocol (which powers the internet) but a methodology for creating and sharing new
in this case you are responsible for the traffic concepts, tools and knowledge. Baltan is a
of messages, which are carried around in the flexible, collaborative platform for future thinking
offline cache of your smartphone. You Are The that places art and design research at the core of
Protocol is useful in cases of incidental network its activities.
loss, deliberate political deactivation of networks
or in situations/countries with minimal online Angela Plohman was director of Baltan Laboratories
connectivity. Whether you are an activist, a hidden until June 2012. She is now grant manager at the
storyteller or just a communication addict - this Mozilla Foundation in Toronto, Canada. Olga Mink
offline dynamic messaging system allows you to is the new director of Baltan Laboratories and is
keep on communicating. http://youaretheprotocol. continuing the artist-in-residence programme.
http://www.baltanlaboratories.org
net/
Narrative Navigation and You Are The Protocol Piksel is an annual event for artists and
developers working with free and open source
were developed by VJ Pixel and Sander Veenhof.
software, hardware and art. Part workshop, part
festival, it is organised in Bergen, Norway, and
Biographies of the labs
involves participants from more than a dozen
Netherlands Media Art Institute (NIMk) stimulates countries exchanging ideas, coding, presenting
the free development and propagation of art and software projects, doing workshops,
contemporary art, in particular on the basis performances and discussions on the aesthetics
of technology. Art works are developed under and politics of free and open source software.
commission and in collaboration. The works are
shown via the Internet, at national and international Gisle Frøysland is director of Piksel and for this
festivals, events, exhibitions at diverse art project we also collaborated with Elisabeth Nesheim.
institutions and for educational purposes. The NIMk http://www.piksel.no/
follows a non-individual promotional policy for
media art in which completed works are presented Collaborating producers of We Are Forests:
to professionals, institutes and contacts.
Kitchen Budapest (KIBU) is a place of witchcraft
Errata: As of January 2013 NIMk will not receive and inspiration. It is an innovation lab where the
any more funding from the national government fields of art, research work, start up development
and the organisation decided to discontinue its and education complete and support each other.
current activities. Although several other initiatives
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
43
This creative milieu was founded by Magyar Telekom in 2007, and it has two fundaments: openmindedness and team-work. The team spirit is
further enhanced by our colleagues’ and resident
artists’ constant curiosity and desire to discover
something new. Based on the interdisciplinary
thinking of these young engineers, artists, designers and sociologists our objective is to find the
connection points of society, arts, science, urban
space, mobile communication, the internet, digital culture and startups.We aim to give answers
within an international
context, and also to ask
questions from KIBU’s
unique point of view.
5 Days Off festival annually showcases the latest developments surrounding electronic music.
Within the arts programme of the festival called
5 Days On, and more specifically its exhibition,
Cloud Sounds, the festival explores the culture of
electronic music and culture, with a focus on remix culture and Web2.0 participatory procedures
such as crowdsourcing and (re-) appropriation of
social media for the arts processes and purposes.
Jan Hiddink is coordinator of the 5 Days Off
festival in Amsterdam
and works as programmer at Melkweg in Amsterdam. http://www.
melkweg.nl
Fig: Naked on Pluto,
screenshots
Melinda Sipos worked
at KIBU until February
2012, currently she is
freelance designer, cultural producer. http://
www.kitchenbudapest.
hu
Collaborating producers of Narrative Navigation and You Are The
Protocol:
Pervasive Media Studio
is Watershed’s city-centre research lab, bringing together artists,
technologists and academics to explore the
future of mobile and wireless media. Research
projects are both cultural and commercial and
span gaming, projections,
location-based media,
digital displays and new forms of performance.
Run in partnership with Bristol University and the
University of the West of England’s Digital Cultures Research Centre, the studio has a great workspace, an open ethos and a can-do attitude.
Clare Reddington is Director of iShed and Pervasive Media Studio, and Victoria Tillotson is iShed
Producer at Pervasive Media Studio in Bristol.
http://www.watershed.co.uk/ished // http://www.
pmstudio.co.uk
Digimag Journal
n° 73 | year VII
Labmóvel is a Lab of
mobile media for the
production of art residencies, workshops
and cultural events. Because of its nomad character, the programme
aims to create temporary venues that instigate
curiosity and increase
access outside the institutional structures,
encouraging a cultural,
social and economic
crossing encounters.
The mediation acts as a key-role in the interaction between this structure and its public. This
program is coordinated by Lucas Bambozzi and
Gisela Domschke and is supported by Programa
Arte e Tecnologia from Fundação Telefônica (in
cooperation with Vivo arte.mov).
Gisela Domschke is freelance and independent
curator/producer http://www.giselad.com, she
was the Brazilian coordinator for this project. Lucas Bambozzi is director of Vivo arte.mov.
Quarterly
November 2012
44
Notes:
Angela Plohman
1 Thanks to Julia Bac who coordinated the
documentation of the third residence and started
the research.
Angela Plohman has worked for many years in
the field of art and technology. From 2008-2012
she was the director of Baltan Laboratories in
Eindhoven. She recently relocated to Toronto and
is the Grant Manager at the Mozilla Foundation
2 For Naked on Pluto a special technical blog
was created which described the technical
development, key decision points and the
programming code that was used.
3 In particular we focused on a documentation
model that was designed for the performance
Extra Dry by the internationally renowned
Amsterdam based dance company Emio
Greco|PC. This documentation model was
developed in the context of the two-year Inside
Movement Knowledge (2008-2010) research
project lead by the Art Practice and Development
Research Group in cooperation with the
dance company. For more information: http://
insidemovementknowledge.net (accessed June
2012). About the use of documentation models
see Van Saaze and Dekker (forthcoming 2012).
4 These reflections were also elaborated and
discussed during the working group “Lab as
Residency” at the LabtoLab network meeting in
Nantes in June 2011. http://www.labtolab.org
Clare Reddington
Clare Reddington is director of The Pervasive
Media Studio, part of Watershed in Bristol, UK.
Her role is to develop talent, share knowledge
and produce collaborative research in the creative
technology space.
Melinda Sipos
Melinda Sipos is a Budapest-based free lance
designer and cultural producer who works locally
and internationally. She initiates, co-ordinates and
participates in various projects and workshops
at the intersection of art, design and technology.
http://www.melindasipos.net
Victoria Tillotson
Victoria Tillotson is a Producer at Watershed
where she designs and delivers artistsʼ residency
programmes, international programmes and
creative technology projects
___________
Annette Wolfsberger
Annet Dekker
Annet Dekker is an independent curator and
researcher, based in Amsterdam. Currently writing
a Ph.D. research on strategies for documenting
net art at Goldsmiths University. http://aaaan.net
Gisela Domschke
Annette Wolfsberger, is an Austrian-born producer
and curator based in Amsterdam. She is producer
and part of the curatorial team of Sonic Acts (NL) &
Kontraste (AT), and manages a European exchange
programme for Trans Europe Halles (TEH). www.
aaaan.net; www.sonicacts.com www.kontraste.at;
www.teh.net
Gisela Domschke is a Brazilian media artist and
curator. She is a guest lecturer at FAAP, PUC and
Escola São Paulo and works as an independent .
curator in collaboration with British Council,
AHRC, Virtuel Platform, Netherlands Media Art
Institute, Vivo Arte.mov, FutureEverything
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
45
Mapping the strength of the Wi-Fi signal across the State Library of Queensland in 3D; Courtesy of Dan Hill
IMMATERIAL PUBLIC SPACE
The emperor’s new architecture
by Selena Savicic
Globalization theorists argued throughout the
1990s that in compressed space distances play
no role any more (Soja, 2003). Thus, virtual was
recognized as some kind of real. Just as Manuel
Castells rightly argued that reality has always
been perceived through symbols (Castells, 1996),
virtual reality functions as a mediated experience.
Virtual realities that became prominent in the
1990s had a real impact on space and time. Today,
we are facing another kind of impact. Space of
wave propagation is physical. What happens
instead of compression of time and space is
a distribution of communication devices that
augment locations. Mobile phones and “onlineness” make social space more distributed. Without
having to go somewhere to meet someone, more
spaces become a potential meeting place. At
Digimag Journal
n° 73 | year VII
the same time, there is even more expectation
for connectivity at all times. The authors of Net
Locality (Gordon and de Souza e Silva, 2011)
argue that the current reconfiguration of space
recomposes social interactions. A paradigmshift away from virtual reality that “attempts
to make a world inside the computer” (Weiser,
1991) was confirmed by the ACM (Association
for Computing Machinery) with the launch of
their publication Ubiquity in 2000, and a plenary
conference After Cyberspace (McCullough, 2004).
This is a significant change of concepts about
the role of technology in creation and mediation
of space. Once envisioned as a tool to depict the
non-existent environment and immerse a person
in it, computing is now tuned onto processing
the environment. The key aspect of this change
Quarterly
November 2012
46
technology is situated in a physical environment,
operated by people on the move. Location becomes
important. The physical experience is augmented,
rather than cut off by technology. Because of
the increasing saturation of the environment
with computing, we are easily blinded by overinformation. In his work on pervasive technologies,
Weiser recognized this problem early.
ubiquitous computing, connecting diverse mobile
devices through the same network protocol.
My main interest lies with the area of wireless
spatiality, the hybrid space that is created on
the intersection of technology and physical
space where it is contained. What are the mutual
impacts of pervasive communication technology
in mediating physical space; and of the built space
(architecture) on communication - as an obstacle
for propagation of wireless signals, but also its
infrastructure with the intention to bring more
awareness of their presence, I will look into the
physicality of wireless signals, and their possible
architectural qualities.
He suggested a new way of focusing on computing,
which gave way to the concept of ubiquity. With
the construction of a U-city in South Korea and
similar contemporary developments, the word
ubiquitous came into the popular discourse.
Coined by Weiser in 1991, the term ubiquitous
came to stand for computational capacities of
technology that is built into our environment and Aesthetic Approach
goes by mostly unnoticed.
We are organizing the space with technology. This
Weiser described this phenomenon as “computers space is public, or at least shared, as technology is
that are disappearing...” (Weiser, 1991) referring used here to enable communication and exchange.
at the same time to the power of ‘blending in’ that Like every other public sphere, this space has
happens because we have learned it sufficiently its architectural and political characteristics. On
well; and the anxiety reflected in the dystopian the architectural side, we recognize utilitarian
Philip K. Dick novel “Ubik”. According to Weiser, concerns like accessibility, stability and security
ubiquity is diametrically opposed to virtual reality, of the network infrastructure. On the political
because it “invisibly enhances the world that side, we have issues of ownership and control, as
already exists” rather than trying to “make a well as participation and accessibility by different
world inside the computer” (Weiser, 1991). It is parties. The discourse on the latter is often
clear that we cannot pay attention to all processes coloured by a dose of paranoia about the social
at once, but we are good (and getting better) at consequences of ubiquitous technology.
switching focus. This focus switching has become
the key aspect in the design of interaction with Although it is necessary to keep a critical
the environment. With different degrees of attitude towards this saturation with sensors and
interactivity, “the disciplines of architecture and microchips (Thackara, 2002) the current debate
interaction design both address how contexts often overlooks everything outside the instrumental
shape action [...] these processes are ambient.” use of waves. This kind of criticism is unlikely
(McCullough, 2004).
to produce any relevant design challenge or
spur innovative thinking. I would like to propose
New interfaces are emerging to embed a different approach, one that engages with the
information processing into the physical realm. presence of wireless signals in an innovative
They are mobile, networked and intuitive. Thus, rather than conservative way.
“architecture has acquired a digital layer.”
(McCullough, 2004). Computing happens in the My intention is to focus on the aesthetic potential
periphery, but includes physical architecture, of specific areas of electromagnetic radiation,
which literally gives space to different levels of cutting away from the instrumentalist debate.
accessibility and makes interaction more intuitive. Treating wireless signals as aesthetic phenomena, I
hope to engage in a critical debate on another level.
The current omnipresence of accessible Wi-Fi
signals in the city is actualizing the potential for
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
47
Looking for the origins of parametricism: Relief of the doubly periodic function “cn u for k=0.8” [Eugen Jahnke and Fritz Emde, Tablse of Functions with Formulae and Curves] obtained by Le Corbusier
from the director of ETH Zurich in October 1956, in his search for a ‘catalogue of forms’ for his design of the Philips pavilion at the Brussels World Expo in 1958
Spatial theory:
from Network Society to Net Locality
“The Internet of Things is happening, and it’s
being built right here on Cosm.” they proudly
announce on the website of the Cosm platform
(Cosm-previously known as Pachube - 2012).
Previously, Adam Greenfield discussed ubiquity
in his book Every ware (Greenfield, 2006),
marking a significant point in recognition of the
phenomenon and its impact on space. In his short
book “The Internet of Things” Rob van Kranenburg
(2008) discussed some consequences of ubiquitous
computing on our environment with a critical
perspective towards the actual improvements it
brings.In “The Rise of the Network Society”, Castells
introduced the concept of ‘space of flows’ which
is not a placeless space, because “it does have a
territorial configuration related to the nodes of
the communication networks.” (Castells 1996).
It clings on the idea of time-space compression
discussed in the context of globalization by
theorists such as Paul Virilio (Virilio, 1997; Virilio,
2000). However, it deflects from its negation of
relevance of physical space, thus recognizing the
Digimag Journal
n° 73 | year VII
ultimate importance of location and spatiality
within the network. In a later research report
titled “The Mobile Communication Society”,
Castells et al. suggest that there is an on going
shift from already-decentralized, stand-alone
computers towards entirely pervasive computing
(Castells et al. 2004).Edward Soja describes the
term ‘spatiality’ in a footnote in Postmodern
Geographies (Soja, 1989) as a “formative structure
created by society” with an “inherently social
quality”. Soja argues for importance of spatiality,
pertaining to Lefebvre’s views of space as his
primary interpretive viewpoint. Soja recognized
an increased spatial consciousness – the ‘spatial
turn’ in the form of significant reinsertion of space
in the humanities and social sciences or the ‘turn’
of academia’s attention to space.
What is common to spatial thought from Lefebvre,
Soja and Castells to recent books like Net
Localities and Code/Space, is the idea that space
is a result of some form of social interaction. Soja’s
view of space as “a social product - that (it) arises
from purposeful social practice” (Soja, 1989) is
confirmed in Castells’s writing:
Quarterly
November 2012
48
“Space is the expression of society” (Castells, 1996)
“. In Digital Ground, McCullough recognizes the
new character of information technology, which
“has become ambient social infrastructure”,
(McCullough, 2004) while Kitchin and Dodge
discuss how “social is inherently temporal and
spatial” in Code/Space (2011). Eric Gordon and
Adriana de Souza e Silva refer back to Lefebvre’s
view of space as inherently social (Lefebvre,
1991), to conclude that “reconfiguring spaces
means reframing the social interactions within
them.” (Gordon and de
Souza e Silva, 2011)
Fig: Immaterials: light
painting WiFi by Timo
Arnall, Jørn Knutsen
and Einar Sneve
Martinussen, 2011;
Courtesy Timo Arnall
problem is discussed in detail for example in the
book Splintering Urbanism through a broad range
of examples of uneven development of infrastructures making “physically close spaces ... relationally severed” (Graham and Marvin, 2001).
Because the physical network infrastructure is
not evenly distributed, network also does not distribute evenly throughout the world. Fiber-optic
cables are laid along the London’s financial district and Wall Street to avoid any possible delay in
the execution of trading
algorithms; at the same
time, in many African
and some South American countries, dial-up
modem speeds are still
a standard (Index 2012)
So far we have examined
the 1990’s theory of the
network shift, the increased connectedness of
individuals and organizations throughout the
world. We are talking
here mainly about cable-facilitated networks. What, if anything,
changes with the introduction of wireless?
It might be true that
“wireless communication homogenizes space” (Castells et al. 2004)
because of the way it
connects people independently from their
location. Or it might be
just difficult to break
with this seductive idea
embraced by the theorists in the 1990s, who
argued that space becomes equal to place,
places being condensed
with connectivity.
According to Adrian
Mackenzie, “Wi-Fi connections, intermittent,
unstable, and uneven
as they often are, act as
a kind of patch or infill
at the edges and gaps
However, already in
1996 Castells recognized that in a process which in telecommunications and network infrastructu“connects advanced services and provider cen- res” (Mackenzie 2010).
tres... territories surrounding these nodes play
an increasingly subordinate function, someti- Their distribution is sporadic and the topography
mes becoming irrelevant or even dysfunctional” of the wireless network infrastructure is rather
(Castells, 1996). More recently, Castells wrote scattered. Because Wi-Fi access points are most
more on the structure and meaning of the space commonly installed and managed individually by
of flows, which he finds to be “not related to any their users, the spatiality of Wi-Fi infrastructure
place but to the relationships constructed in and follows no particular spatial logic. Its coverage is
around the network processing the specific flows unpredicted and changeable.
of communication.” (Castells et al. 2004) This
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
49
With the rise of urban computing technology, Ava
Fatah gen. Schieck recognizes the emergence of
interaction spaces between urban environment
and pervasive computing systems which “are
not limited to architectural spaces but also
include spaces that are created by the mobile
artefacts.” (Fatah, Penn, and Neill 2008)
The authors of Net Locality are looking at
changes in the use of space that came together
with the increasing use of location-aware
networked devices. The authors claim “Net locality
has transformed immersion from a function of
large screens and virtual reality to a function of
small screens and the representation of located
information networks.” (Gordon and de Souza e
Silva 2011). Thus, social networks turned out to
be more immersive than virtual environments.
How public is the ‘hertzian’ space?
Wireless communication both occupies and
distributes within public space. Some of it’s
spatial features are therefore necessarily
political. With Jacque Ranciere’s definition of the
“distribution of the sensible” – as a system of
common facts that delimit the respective parts,
visible and invisible within a particular aestheticpolitical regime, we find a clue for analysing this
political aspect. What is the relevant political
regime for distributed wireless communication?
Most of information we daily access is served
wirelessly using radio waves – from FM radio,
through satellite signals and mobile phones,
to wireless Internet. First wireless information
served was radio broadcast, coupled with home
radio receivers. Since the Maxwell’s radio-wave
theorem in 1864 and the creation of the first radio
transmitter some 20 years later by Marconi, radio
technology was developed to allow transmission
of information (in the form of modulated audio
signal) between two relatively distanced points.
The topology of this network was static and
therefore the change of the use of space was not
great, though radio signal did cross-big distances
and connect the receivers with remote broadcasts.
While radio broadcasting is a one-way centralized
transmission, with only licensed stations allowed
to broadcast at a specific frequency, some
contemporary wireless communication systems
allow for a more horizontal exchange. Particularly
Digimag Journal
n° 73 | year VII
in the unlicensed spectrum, it is possible to
transmit from any location, and also share the
spectrum across different protocols. (Peha, 1998)
The unlicensed spectrum allows any device
(granted equipment compatibility) to transmit and
receive information. Most commonly used license
free frequencies are at 900 MHz and 2.4 GHz. Some
regulations do apply, like for example in the power
allotment (EIRP), which is ten times higher in the
US (30dbm or 1000mW) (Federal Communications
Commission, Washington, D.C 1999) than in the
EU (20dbm or 100mW) (European Commission
2010) for devices broadcasting at 2.4GHz.
Commercial high-speed Internet services also
use parts of the unlicensed spectrum. WiFi technology (Wireless Fidelity, a technology
standard for wireless data exchange) uses radio
waves on the frequencies of 2.4GHz or 5GHz
to transmit information between devices. WiFi enabled devices most commonly operate in
the range between 2.4GHz and 2.5GHz, split
in 14 channels to decrease interference with
other electric devices which share the same
frequency range - the microwave, Bluetooth gadgets,
Baby phone and wireless surveillance cameras.
Wi-Fi technology has the capacity to communicate
multiple types of media over the same protocol:
text, voice, images and video. Just as radioamateurs from the beginning of the 20th century
experimented with radio equipment to extend its
range and performance, Wi-Fi users are tinkering
with their routers and antennas to extend and
improve functionality of their networks (Bar
and Galperin, 2004). Because these radio waves
propagate through the air freely, this traffic is
physically available to everyone with a Wi-Fi
enabled device. Yet, wireless networks mostly
appear as secured, using WEP or WPA encryption
integrated in the traffic itself, for the reasons of
privacy and security. This makes it impossible
for anyone not knowing the code to take part in
communication, although they are physically
participating.
The share ability of the Wi-Fi infrastructure was
interestingly reflected in the cases of several
cities like Taipei (Taiwan) and London (UK) who
decided to launch citywide wireless Internet
access projects. These would provide constant
access to the Internet and location-based services
Quarterly
November 2012
50
to all users (for the price of agreeing to the central
network provider’s terms and conditions). This
strategy was not picked up by many cities, as
the city-provided wireless Internet access failed
to take on a significant role in user connectivity
(Mackenzie 2010). Because of network security and
otherwise convenience, users preferred to secure
their own network access, occupying public space
with wireless signals protected with passwords.
So what is the future of wireless Internet? On
one hand we had the utopian dream of a “cyberrevolution”. In the spirit of Barlow’s Declaration
of The Independence of the Cyberspace (1996)
many thinkers still believe that mere accessibility
will evoke different modes of social organization.
For example, Bar and Galperin (2004) discuss
the possibility for dynamic, peer-to-peer Wi-Fi
networks to replace wired network infrastructures,
as they are scalable and more easily distributed.
Aware of the limitations put on by the existing
legal environment (equipment power restrictions,
frequency range for operation and restrictive
agreements by current broadband providers)
they advocate the extension of this decentralized
infrastructure to another level. Because the
infrastructure is built bottom-up and because
technically, Wi-Fi clients can act as Wi-Fi access
points, thus “all Wi-Fi devices can be programmed
to detect other devices within their range and create
ad-hoc connections” (Bar and Galperin, 2004),
mesh networks could spontaneously emerge
when enough Wi-Fi devices are present in an area.
On the other hand, the competition between
communication technologies does not lead to
multiplicity and equal distribution, because
“electronic intermediary services providers
are populating the new markets and deploying
strategies that are no less informed by
monopolization strategies than in the past. “
(Mansell, 1999, 3). New technologies evolve within
an existing institutional context that moulds
them to established social and market practices
(Bar and Galperin, 2004). Thus the centralized
approach to wireless networking reflected in the
UMTS service might well win over the distributed
AP mesh structure. Because every single byte can
be charged to each user, this model is much more
interesting to commercial companies than building
an overall Wi-Fi meshed network, which they
would be well capable of too. On the other hand,
Digimag Journal
n° 73 | year VII
UMTS providers would need to collaborate on a
much more global level to make up for the comfort
Wi-Fi technology provides to users outside of their
countries of residence. Because Wi-Fi access
points depend only on hardware compatibility,
it would be necessary that UMTS connections
provide the same service to the user independent
from their current location (whether on a trip,
holiday or at home). It is therefore most likely
that both will continue to coexist for some time.
to all users (for the price of agreeing to the
central network provider’s terms and conditions).
This strategy was not picked up by many cities, as
the city-provided wireless Internet access failed
to take on a significant role in user connectivity
(Mackenzie 2010). Because of network security and
otherwise convenience, users preferred to secure
their own network access, occupying public space
with wireless signals protected with passwords.
Urban Computing and Locative Media
Instead of a dark room with a screen, mouse
and keyboard, we are more likely to be online
in a café, scrolling down the touch screen of
a smart phone. It is typical of a ‘neo-nomad’ to
live the ‘Starbucks lifestyle’, relying on mobile
technology while relocating around the world
(Abbas, 2011). Problems of ‘neo-nomadism’
are many, as described in detail by Yasmine
Abbas, but they are a group of users who were
‘liberated’ by mobile technology. Exactly this is
the point of Net Locality: contrary to the general
prejudice about technology’s alienation effect
on the physical experience of the world (which
is justified by the way we used to connect to the
web in the 90s), new technologies are making
us aware of locations, and making locations
aware of us (Gordon and de Souza e Silva, 2011).
Because “games provide a logic for user
interaction” (Gordon and de Souza e Silva
2011), they have been widely used to simulate
behaviours and situations. The Familiar Stranger
(Paulos, e. &Goodman, 2002) and Umbrella.net
(Moriwaki, K. & Brucker-Cohen, 2002) made use
of Bluetooth connections between mobile phones,
to discover the position of other players. Further
on, Can You See Me Now (Blast Theory and Lab
2001) is an interesting example that combines
Quarterly
November 2012
51
mapping with real-time communication between
participants, local and remote. Botfighters (2001)
and Mogi (2003) engaged the players to consider
their everyday urban experience as part of the
game, having to change their usual paths (take
the bus instead of the metro) in order to stay online – and thus in the game.
Fig: RKNFG. Interactive installation developed
during a summer residency at Atelierhaus Salzamt, Linz in September 2012, by Selena Savic
In the Cityware project,
Ava Fatah gen. Schieck
analysed
interaction
spaces generated by
Bluetooth devices. The
researchers observed
the usage practices in
order to come up with
new forms of humanto-human interaction.
The team considered
different methods for
mapping the physical
and digital flow and the
digital co- presence. The
looked for design strategies for different experiences in the city or at
least an understanding
of existing city behaviours.
emergent social interactions”, and even become
“a motivation to change the way they communicate and engage with others.” (Fatah, Penn, and
Neill, 2008).
In order to achieve a better understanding of the
urban landscape augmented with the digital landscape of a city, we need to expand and adapt our
understanding and practice of design. Looking at
the urban environment as an integrated system
made of both the built environment and pervasive
computing systems, design can offer dynamic
solutions that engage
with both.
Shaping The Waves
Malcolm McCullough
writes in Digital Ground:
“Whenever goods, people, or electronic communications flow, space forms around them.
(...) Places emerge at
crossovers between infrastructures.” (McCullough, 2004)
Physical properties of
wireless signal propagation - the range, signal strength and possible obstacles determine
their presence in the
At the time of writing,
environment. The space
Bluetooth
technology
provided more inforformed by these waves
mation on movement
is sometimes referred
and interaction than
to as hertzian, because
the typically static Wi-Fi access points. “Within it consists of waves oscillating on frequencies exCityware, we are extending Space Syntax conside- pressed in Hz (SI unit of frequency named after
ration of the architectural spaces created by the Heinrich Rudolf Hertz).
built environment to include the wireless interaction spaces created by Bluetooth enabled devices. This term is also used to describe “a holistic view
“ (Fatah, Penn, and Neill, 2008). In the meantime, of the electronic device and its cultural interacBluetooth saw a fall in popularity, while Wi-Fi and tions” (Dunne, 2005). The problem with physicality
3G technology (3rd generation mobile pones, that of the hertzian space is that it is extremely difficult
provide mobile Internet access) became more to (accurately) perceive and represent, leaving us
pervasive. However, they concluded, “[communi- with a vague idea about how it actually ‘looks’ like.
cation] technology can be appropriated to support
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
52
Quadricone, a model for an interactive environment, part of the Emperor’s New Architecture research developed within the Sinlab, EPFL, Switzerland, by Selena Savic
“We prefer to think of the electromagnetic
spectrum as an inhabitable landscape, with its own
electro climate and electro geography.” (Dunne
and Raby 2001). This statement of the design duo
Dunne&Raby marks an innovative attitude towards
the aesthetic and critical possibilities for dealing with
hertzian space. As part of their research in ‘secret
life of electronic objects’, they produced a series of
Placebo objects that responded to electromagnetic
activity in the environment. Eight prototype objects
were placed in volunteers’ peoples’ homes,
instigating them to develop narratives to explain and
relate to electronic technologies.
Marc Shepard published and edited several
publications on the subject of hertzian space. He
reminds: “Hertzian space is all around us, (…) how
might we begin to think about how to shape these
environments?” (Shepard, 2010).
The presence of wireless signals was tackled by
numerous artistic projects that aspire to design with
waves in mind. The team of the Touch research
project applied ‘light painting’ photographic
technique to visualize the Wi-Fi terrain within
Digimag Journal
n° 73 | year VII
several city blocks near the Oslo School of
Architecture and Design. With a special interest
in the Near Field Communication (NFC) and other
intangible phenomena that have implications
for design, they produced a 4m Wi-Fi measuring
rod, containing 80 lights that respond to the
Received Signal Strength (RSSI) of a particular
Wi-Fi network. Walking with this rod, they could
produce long-exposure photographs of network
activity on the way.
In a project developed for the Graduate Design
Research Studio, a horizontal tent-like structure
was proposed to represent real-time activity on
the public library network. Part of the Situated
Technologies Research Group, University at
Buffalo with Marc Shepard as Assistant Professor,
this project is an interesting play with the metaphor
of an invisible canopy and its visible counterpart
materialized in the tent.
Swiss-based designer Carina Ow proposed a
series of Wi-Fi-active installations, in form of
dynamic OLED surfaces that display the current
use of public city networks.
Quarterly
November 2012
53
use of public city networks.A lot has been said and
done in the area of interactive spaces - places where
visitors would interact with (parts of) the environment,
the environment typically responding by movement,
change of light and colours or sounds. On the other
hand, as shown above, quite some research has
gone into visualizing the immaterial signals of WiFi, RFID, etc. Still, Shepard rightfully argues, “little
work has been done to place these technological
developments within the larger context of urban
architecture”. This lack, however, is not answered in
his text either.
Conclusions
Designing electromagnetic environments involves
thinking about space in non-visual ways. It
also understands overcoming the dominant
instrumentalist debate about technology and the
solely materialist practice tradition in architecture.
Yet, there are indications that contemporary
networked pervasive technology has already
contributed to a spatial change, intensifying the
way people engage with places and spaces. Marc
Shepard finds that this might actually result in
participative and adaptable designs, the goals
that architecture and urban design have set
for themselves for decades (Shepard, 2010).
Thinking about technology is always linked to
thinking about it’s future, trying to forecast the next
‘big thing’. How will wirelessness ‘look’ in 10 or 20
years? Bluetooth was still a promising technology
in 2007; next year it was pushed back to the
headset industry, while Wi-Fi standard took over
wireless exchange of data. As Norman wrote in The
Invisible Computer, “we tend to overestimate the
immediate impact and underestimate the longterm impact” while at the same time placing the
emphasis “on the technologies themselves, when
it is really the social impact and cultural change
that will be most dramatic.” (Norman, 1999)
Today, Wi-Fi is competing in popularity and
convenience with the UMTS service. Just 6 years
ago, The New York Times was speculating that
Wi-Fi telephony (such as voice over IP) might
displace the current business model used by cell
phone providers (Richtel, 2006). In the meantime,
cellular telephony has diffused rapidly through the
world. With the release of 3G phones that provide
mobile Internet access, mobile phones became
Digimag Journal
n° 73 | year VII
a popular interface for location-aware computing
and applications. Taking the usual browser access
to a more personal level and allowing for a mobile
experience of the Internet, smart phones threaten to
render Wi-Fi protocols obsolete. This development
is interestingly convenient for ISP providers,
whose clients could easily share their networks
with no compensation. To the contrary, cellular
networks provided by cell towers and base stations
allow users to roam seamlessly between cells,
for a fixed price paid by each user. Considering
previous indications, it might become even more
difficult to ‘tap in’ the new centralized protocols of
electromagnetic environments.
References
Yasmine Abbas, Neo-nomadisme : Mobilité,
Partage, Identité, Transofrmations UrbainesSes Conséquences Et Ransformations Sur Notre
Manière De Travailler Et De Vivre | FYP Editions Editeur De L’innovation. (Fyp editions, 2011).
François, Bar and Hernan Galperin “Building the
Wireless Internet Infrastructure: From Cordless
Ethernet Archipelagos to Wireless Grids.”
COMMUNICATIONS & STRATEGIES 2nd quarter
2004 (no. 54): 45–68. http://www.idate.fr/fic/
revue_telech/348/CS54_BAR_GALPERIN.pdf.
John Perry Barlow, 1996. “A Declaration of the
Independence of Cyberspace.” https://projects.
eff.org/~barlow/Declaration-Final.html.
Blast Theory, and Mixed Reality Lab. 2001. Can
You See Me Now? http://www.blasttheory.co.uk/
bt/work_cysmn.html.
Manuel Castells, The Rise of the Network
Society: Information Age, Economy, Society and
Culture. (Blackwell Publishers Ltd, 1996).
Manuel Castells, Meireia Fernandez-Ardevol,
Jack Linchuan Qui, and Araba Sey. 2004. “The
Mobile Communication Society A Cross-cultural
Analysis of Available Evidence on the Social Uses
of Wireless Communication Technology.” In The
Mobile Communication Society. University of
Southern California.
Quarterly
November 2012
54
Cosm (previously known as Pachube). 2012.
Cosm - Internet of Things Platform Connecting
Devices and Apps for Real-Time Control and Data
Storage. https://cosm.com/.
Anthony Dunne, Hertzian Tales. Vol. Rev. (MIT
Press, 2005).
Anthony Dunne and Fiona Raby, Design Noir:
The Secret Life of Electronic Objects. (Vol. 1.
Birkhäuser, 2001).
European Commission. 2010. “EUR-Lex 32010D0267 - Access to European Union Law.”
http://eur-lex.europa.eu/LexUriServ/LexUriServ.
do?uri=CELEX:32010D0267:EN:NOT.
Ava Fatah, Alan Penn, and Eamonn O Neill, 2008.
“Mapping , Sensing and Visualising the Digital
Co-presence in the Public Arena.” In Mapping,
Sensing and Visualising the Digital Co-presence
in the Public Arena, 38–58. http://discovery.ucl.
ac.uk/7546/.
Federal Communications Commission,
Washington, D.C. 1999. “FCC NOTICE OF
PROPOSED RULE MAKING.” http://transition.
fcc.gov/Bureaus/Engineering_Technology/
Notices/1999/fcc99149.txt.
Eric Gordon and Adriana de Souza e Silva, Net
Locality. (Chichester, UK: Wiley-Blackwell, 2011).
Stephen Graham and Simon Marvin, Splintering
Urbanism: Networked Infrastructures,
Technological Mobilities, and the Urban
Condition. (Routledge, 2001).
Adam Greenfield, 2006. Everyware: The Dawning
Age of Ubiquitous Computing. Vol. 0.
New Riders. http://www.amazon.com/
dp/0321384016.
Index, Net. 2012. Net Index by Ookla. http://www.
netindex.com/.
Rob Kitchin and Martin Dodge, Code/space.
Software Studies. (MIT Press, 2011).
Digimag Journal
n° 73 | year VII
Rob van Kranenburg, The Internet of Things.
Network No. (Institute of Network Cultures,
2008).
Henri Lefebvre, The Production of Space.
(Blackwell, 1991).
Adrian Mackenzie, Wirelessness: Radical
Empiricism in Network Cultures. (The MIT Press,
2010).
R. Mansell, 1999. “New Media Competition and
Access: The Scarcity-Abundance Dialectic.”
New Media & Society 1 (2) (August 1):
155–182. doi:10.1177/14614449922225546.
http://nms.sagepub.com/cgi/
doi/10.1177/14614449922225546.
Malcolm McCullough, Digital Ground:
Architecture, Pervasive Computing, and
Environmental Knowing. (The MIT Press, 2004).
Katherine Moriwaki and Jonah Brucker-Cohen,
2002. UMBRELLA.net: Exploring Coincidence
Ad-Hoc Networks. http://undertheumbrella.net/
system.htm.
Donald A Norman, The Invisible Computer. (MIT
Press, 1999).
Eric Paulos and Elizabeth Goodman, 2002.
Familiar Stranger. http://www.paulos.net/
research/intel/familiarstranger/index.htm.
Jon M Peha, 1998. “Spectrum Management
Policy Options.” Communications Surveys &
Tutorials, IEEE 1 (1): 2–8. http://ieeexplore.ieee.
org/stamp/stamp.jsp?tp=&arnumber=5340403.
Matt Richtel, 2006. “The Wi-Fi in Your Handset.”
New York Times, July 29. http://www.nytimes.
com/2006/07/29/technology/29phones.html?_r=1
&ei=5090&en=f4e35ba52faa0380&ex=131182560
0&pagewanted=print.
Marc Shepard, 2010. “On Hertzian Space
and Urban Architecture.” Vague Terrain 16:
Architecture/Action (Winter 2010) (February
1). http://vagueterrain.net/journal16/markshepard/01.
Quarterly
November 2012
55
Edward Soja, Postmodern Geographies. (Verso,
1989).
Edward Soja, 2003. “Writing the City Spatially.”
City 7 (3): 269–280. doi:10.1080/13604810320001
57478.
John Thackara, 2002. “Welcome to the space
of flows”. Conference introduction by John
ThackaraConference introduction presented at
the Conference: Doors of Perception 7: Flow,
Amsterdam. http://flow.doorsofperception.com/
jt_intro.html.
Paul Virilio, Open Sky. (Verso, 1997).
Paul Virilio, The Information Bomb. (Verso, 2000).
Mark Weiser, The Computer for the 21st Century
(Scientific American:1991) 94–104
_______________
Selena Savicic
Selena Savic is an architect, artist and researcher,
interested in architectural qualities of wireless
communication and the way technology mediates
the space we inhabit. Selena graduated from the
Faculty of Architecture, University of Belgrade
in 2006, where she later worked on urban
planning and research. She continued her studies
in Media Design, graduating from Networked Media
at the Piet Zwart Institute in Rotterdam, The
Netherlands in 2010. Since September 2011 she
is a doctoral candidate at the Federal Technical
Institute in Lausanne, Switzerland (EPFL) and
the Instituto Superior Técnico in Lisbon, Portugal
(IST), and a grantee of the FCT, Portugal. Besides
architecture, Selena actively pursues a critical
media practice, treating the questions of the city,
its architecture and technology integrated with
the built space and its users.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
56
ARtotheque, Stedelijk Museum, Lowlands Festival, Amsterdam, 2010
LOOKING FORWARD
From Augmented Reality to Augmented Museums
by Miriam La Rosa
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
57
The act of thinking of (a future event) with pleasurable will be able to offer?”
and eager anticipation because something is going
to happen, is generally expressed in the English In the above mentioned lecture of Facing Forward,
language with the idiomatic form looking forward. the German art historian and theorist Hans Belting
pointed out the question “What kind of museum
Looking forward to the future is the projection to the do we want?” (Belting, 2012). This question was
future of hopes and desires, mixed together with to be assumed as a new guideline for further
predictions and speculations. Looking forward to debates. To follow this line, the answer will be a
the future is a natural tendency of people and a projection of hopes and desires, mixed together
goal of society. In other words, looking forward is with predictions and speculations. In other words,
a goal of museums.
the answer will be “looking forward”. Additionally,
in this “looking forward” mentality, the economic
From December 2011 to May 2012 a public factor will be left, for a moment, apart. The aim is
series of lectures organized by the Stedelijk to challenge and stimulate evolution; it is not to
Museum, University of Amsterdam, and de Appel discourage the development since its birth.
Arts Centre, W139, Stedelijk Museum Bureau
Amsterdam and Metropolis M took place in Coming back to the question of Belting, an attempt
Amsterdam with the aim of debating the hottest of reply should be found in considering a bi-focal
topics at the moment floating around the cultural perspective: the one of museum professionals
field. The title of the program was a manipulation and the one of society. At present time, within the
of the above mentioned looking forward idiom. It museological field some of the most popular issues
was skillfully transformed in a more provocative are found within inclusion and participation, tension
and challenging version: Facing Forward: Art between private and public, intangible heritage and
and Theory from a Future Perspective. The focus sustainability. Within society and its development the
of the lectures was an invitation to look at the biggest evolutionary key is certainly the technological
future instead of the past and to better deal with progress and its cutting-edge tools, moving together
the contemporary meaning of art and culture. with a growing attention to environmental concerns.
Furthermore, a specific debate was meant to
discuss the current situation of museums and in Thus the strict interrelations between museological
trends and society are evident: the tendency
particular, their future perspectives.
toward sustainability is the consequence of a
Taking into consideration the present occurrences better understanding of the needs of the planet.
in society and more specifically in the cultural The bio-eco system is now seen as the only way
sector, e.g., the general funds cuts in Europe, the of redemption. A testimony of this theory can be
easiest way to visualize the future of museums is found, for instance, in the ecomuseum model,
through the shape of a big question mark. This developed in France at the beginning of the ‘70s
is not a joke: this is for real. During the Facing by Hugues de Varine and George Henri Rivière:
Forward conference as well as in most of other a sort of ecologic museum based on a holistic
debates related to the same topic, the point quickly interpretation of cultural heritage and aiming at
seemed to move from discussing THE future OF the deployment of the local resources of specific
museums to reclaiming a future FOR museums.
communities (Davis, 2011).
This is not going to be the point of this paper. What
the future will be, nobody can define it as a whole,
neither considering the difficulty of the current
economic crisis, nor completely ignoring it. But a
future will surely be. Thus the question “Is there
a future for museums?” should be replaced with
“What do we want from future museums?” Better
still “What kind of experience future museums
Digimag Journal
n° 73 | year VII
A museum, that basically looks beyond the
traditional understanding of collection and
the collecting practices. Moreover, the need
of inclusion can be related to the economic
and technological gaps that are responsible of
individualism and exclusion, in addition to that
intolerance toward differences partly determined
by the globalization.
Quarterly
November 2012
58
In the first volume The Rise of the Network Society of the series “The Information age: Economy, Society and Culture”, 2009, the Catalonian
sociologist Manuel Castells extensively defines
causes and consequences of globalization, while
formulating his theory of flows. This is a brilliant
attempt to explain the society organization through a division in layers where the internet and the
technological progress play a crucial role. The
whole theory is built around the use of the internet and new technologies as a synonym of a real
virtual-dimension of a
humans’ life, where the
virtual rapidly assumes
the features of the real
(Castells, 2009). People
surf the web and interact
with each other in the
virtual space, flowing
together their activities
and interests.
Fig: The Street Museum, London, 2010
Dropping the subject of
some criticism regards
this virtual life’s inconsistence and furthermore assuming it as
an important ground of
social exchanges in the
second millennium, museums should position
themselves in the flow,
as well. They already
accepted the challenge
with the use of, for instance, the Web 2.0 as
a participative way of interaction with the public,
or the implementation of iPhone/Smartphone applications to improve communication. However,
the frenetic technologies’ development requires
continuous updating for them to remain relevant.
One of the last updates is commonly known as AR
(Augmented Reality). This is described by Wikipedia as “a live, direct or indirect, view of a physical, real-world environment whose elements are
augmented by computer-generated sensory input
such as sound, video, graphics or GPS data” (Wi-
Digimag Journal
n° 73 | year VII
kipedia.org, June 20, 2012.) and it is a new evolving concept in the hi-tech world.
A more concise but interesting definition is the
one of Lev Manovich, Professor of Visual Art Department at the University of California, who
explains AR with the following statement: “Augmented space is the physical space overlaid with
dynamically changing information. This information is likely to be in multimedia form and it is often localized for each user” (Manovich, 2002, 2).
This extension of Virtual
Reality (VR) makes possible an enlargement of
the regular possibilities
of elements’ visualization in the space, giving
birth to an exciting interaction between the
real and virtual world,
where the former becomes action ground for
the latter. But what is
the connection between
AR and museums? And
in which way, if a way
exists, can AR be useful
for future museums?
Several projects, some
of which have been
quite successful, have
already been launched
from museums in relation to AR, mainly within
the field of mobile applications - including
Powerhouse Museum
in Sydney, Australia, the
Street App of the London Museum in England, as
well as the Netherlands and the city of Rotterdam
with the UAR (Urban Augmented Reality). This app
of the NAI (Netherlands Institute of Architecture)
enables visitors to visualize augmented realities
of historical buildings located throughout the city.
Another recent project is the one of the Stedelijk
Museum in Amsterdam, where development took
place between 2009 and 2011 and that was divided into three different sections: ARtours, ARtotheque, AR(t).
Quarterly
November 2012
59
AR(t). They respectively treated an aspect of AR,
i.e. the interaction between virtuality (virtual
reality) and reality through a physical space; a
new concept of ownership: a virtual and at the
same time real ownership of a piece of collection;
and the use of AR as canvas for artists. Margriet
Schavemaker, head of collection and research at
the Stedelijk Museum said about the ARtotheque
project: “The Stedelijk Museum holds thousands
of artworks in its collection, so why not lend them
to the general public? Augmented reality posed
the solution. Instead of the real thing, a visitor to
the Lowlands festival could borrow a replica in AR.
In order to make it an interesting user experience,
the visitor could download the artwork to his/
her Smartphone and position it anywhere on the
festival premises” (museumsandtheweb.com,
June 19, 2012). The Stedelijk AR project aimed to
investigate some of the possibilities offered by AR,
while involving the museum collection, inviting
young artists and designers to share their own
works and turning the visitors in AR curators/
narrators in themselves.
a passion for fine art, and Sebastian Cwilich, a
former executive at Christie’s Auction House and
Haunch of Venison Gallery. Art.sy’s Senior Advisor
is John Elderfield, Chief Curator Emeritus of
Painting and Sculpture at the Museum of Modern
Art, New York” (Art.sy, June 15, 2012). Though the
focus of the website is exclusively related to art,
art.sy is a great example of the innovative way of
democratization and sharing of collections, whilst
merging the public and the private together.
However, there is also a step further.
Reimagining museums is the title of an article
published on the 30th of May 2012 in Museums
Association, a network for museum professionals
that begins its argumentation with the following
provoking question: “Our schools and libraries are
being radically re-imagined for the digital age, but
what about our museums?” (Museumassociation.
org, June 1, 2012). The aim is to present and
explain the functionality of the last born in the
Google family: the Google Art Project. This is a
website that enables visitors to explore the whole
art world simply by sitting in front of their own
Bringing an AR artist within the museum walls computer.
furthermore means to bridge both physical and
virtual world in the museum setting. A future “A small team based in London persuaded more
museum could become, in this way, an additional than 150 museums from around the world to share
layer to live an experience. During the previously more than 32,400 high-resolution images beyond
mentioned conference of Facing Forward: Future their own institutional boundaries. This is a really
of Museums, an animated discussion arose around big deal. For the first time in history it is easy for
the possibility for museums to totally disappear, non-specialists to explore and closely examine
because of the increment of virtual reality and the art from museums across the globe on a single
digitalization of, for instance, museum collections. website. There have been other initiatives that
have moved in this direction, but never with the
An example of digitalization that supports this scope or functionality of the Google Art Project.
virtual access to collections independently from The Art Project isn’t finished. It needs more
museums is the Art.sy website. “Art.sy is a new museums and more art. It needs improved search
way to discover art you’ll love, featuring work and filtering tools. And the public needs better
from leading galleries, museums and private ways to discover and contribute new narratives
collections around the world. Art.sy is powered by about art’s history. Despite these weaknesses,
“The Art Genome Project”, an ongoing study of the the educational potential is tremendous”
characteristics that distinguish and connect works (Museumassociation.org, June 1, 2012).
of art. Art.sy evaluates artworks across 800+
characteristics (we call them genes) - such as art- The importance of the Google Art Project is clear
historical movements, subject matter, and formal as well as its participative character and it wants
qualities - to create a powerful search experience to be an attempt to answer to both the needs of
that reflects the multifaceted aspects of works of inclusion in large scale and the future of museums.
art. Art.sy is led by Carter Cleveland, a Computer
Science Engineer from Princeton University with
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
60
Google Art Project, 2012
On the other hand, is this going to be the real
landing place of future museums? Is this one the
museum’s model that we really want? A completely
virtual platform where walking just moving a
mouse around? A museum with no physical walls?
Case study on this regard is the MINI Museum of
XXI Century Arts. Also known as MMAXXI, it is
an absolutely original model of museum that
does not have any walls and does not have any
fixed location. The MMAXXI is a sort of pop-up
museum for excellence, conceived to go over
the traditional museum’s definition itself. The
project director is Italian contemporary art critic
and curator, Domenico Quaranta, well known in
the international world of New Media and Video
art as one of the major experts of the sector. The
metaphorical building of the MINI Museum is “a
7’’ digital photo frame bought on eBay equipped
with a 4GB pen drive. […] It has been designed to
store and display the art of the XXI century - that is
art that takes, has taken or can take digital form,
at some time in its life, and can thus be stored
on a USB pen drive and displayed on a digital
photo frame. The MINI Museum will travel from
node to node around a network of artists, and will
Digimag Journal
n° 73 | year VII
host temporary solo shows by the artist owning
it at the time. All the artworks shown in the MINI
Museum will enter the permanent collection of
the Museum itself. The Museum will return to
the Director when there is no more storage space
left” (Theminimuseum.org, June 15, 2012). At a
first and not very attentive analysis, the message
launched by the MINI Museum seems to be
that museums in general (and art museums in
particular), no longer have reasons to exist in the
technological era and, especially, in relation to the
most contemporary expressions of art. The MINI
Museum of Domenico Quaranta seems to point
out that museums no longer are the right places
for the showing and sharing of contemporary art.
However, a deeper reflection highlights how this
previous conclusion can be just partly true. In
fact, as the already quoted German art historian
and theorist Belting wrote in his publication
Contemporary Art and the Museum in the Global
Age, the definition of contemporary art is more
frequently reduced to the Western art world, with no
attention to the non-Western art and its intangible
practices, far away from the latest technologies’
expressions (Belting, 2006).
Quarterly
November 2012
61
ARtours, Stedelijk Museum, 2010
Nevertheless, the technological progress cannot
be stopped, neither ignored, although its diffusion
regards the Western world more than the nonWestern world. The tendency towards the virtual
reality to the detriment of the physical reality
is a factual date, but being afraid of a total
disappearing of museums is quite extreme. Thus,
in occasion of the previously mentioned Facing
Forward conference, Iwona Blazwick, director of
the Whitechapel Gallery in London, wisely said
that museums do not have reasons to disappear
just because of the growth of virtual reality: the
act of going to museums still represents the
physical act to meet other people as well as to
orient ourselves in a city that, for instance, is not
our own (Blazwick, 2012).
This is an interesting statement though it could be
argued that not everyone needs to meet others in
a physical space and that virtual reality is easily
taking the place of reality, leaving institutions
such as museums to slowly disappear. Here the
Augmented Reality concept shows its importance.
AR is not fake reality. AR, as the definition itself
suggests, is an augmentation of the reality and
Digimag Journal
n° 73 | year VII
it needs the presence of a physical space to
be applied. Already in 2002 Lev Manovich had
predicted that museums and artists would take a
lead in testing out the augmented future space,
claiming that “having stepped outside the picture
frame into the white cube walls, floor, and the
whole space, artists and curators should feel
at home taking yet another step: treating this
space as layers of data. This does not mean that
the physical space becomes irrelevant; on the
contrary, […] it is through the interaction of the
physical space and the data that some of the
most amazing art of our time is being created”
(Manovich, 2002, 27). In addition, AR in museums
can undoubtedly be implemented in different manners.
For instance, can AR be a way to create a
wider inclusion? As the Stedelijk AR project
demonstrated, the use of Augmented Reality
enabled visitors to concretely play with the
museum collection and create new personal
stories in relation to it.. AR could be a way to reach
new visitors outside of the museum space, while
inviting them to use the museum setting as a
playground for their own AR performances.
Quarterly
November 2012
62
Furthermore, the contribution to the Experience
Economy theory that AR can bring is unlimited.
The theory, in fact, developed by B. Joseph Pine
II and James H. Gilmore at the end of the ‘90s is a
service oriented theory based on consumers’ participation and focused on consumers’ need, operating across physical and virtual worlds where
services look like commodities. Experience Economy has been recently applied to the museum
field with the aim of involving the public through
the benefit of the experience’s value. Moreover,
AR in museums could
work as support as well
as artifact in itself. AR is
augmentation of reality
and, at the same time, it
is one of the latest shapes of contemporary art.
The Mini Museum of
XXI Art, 2010. Image
courtesy Link Art Center
The potential of AR is
huge and its link to the
art world is relevant.
However, will the AR’s
implementation cause
a more solipsistic approach to the all museums’ services? Will
visitors start to act in a
more individualistic way
in the learning and living
of their own museum
experience? In addition,
will visitors be reached
in a really inclusive way?
Not everyone owns the proper devices that enable the AR fruition. Borrowing again the Castells’
theory of flows and looking at the other side of the
coin, the danger for those people that cannot have
an easy and direct access to the “new augmented world. theory of flows and looking at the other
side of the coin, the danger for those people that
cannot have an easy and direct access to the “new
augmented world” is to become increasingly disconnected. And what about the traditional mu-
Digimag Journal
n° 73 | year VII
seum functions? Could the implementation of AR
threaten one of the strongest museum pillars, i.e.
the value of collection, leaving the stage to a new
dimension, such as the one of non-collecting institutions? Will, in substance, the implementation
of AR, change the museum’s structure in itself?
The research field on this regard is stimulating
and wide. Within the big panorama of contemporary practice and approaches to art, AR is a weak
signal for a new revolution. It is a looking forward:
from augmented reality to augmented museums.
_______________
Miriam La Rosa
Miriam La Rosa is
a Master student of
“Museology” at the
Reinwardt Academy in
Amsterdam, the Netherlands.
Since September 2012.
In August 2011 Miriam
moved to Amsterdam
to start her museological career at the
Reinwardt Academy.
Between 2011 and 2012
she attended several
workshops and clinics organized by the
Reinwardt Academy.
From May to July 2012
Miriam did her Curatorial Internship at the
Van Abbemuseum in
Eindhoven. Miriam is a
Curatorial and Research Intern at the Stedelijk
Museum in Amsterdam where she currently lives
and works on her next research project for the
Master thesis.”
Quarterly
November 2012
63
References
Anna McCarthy, Ambient Television: Visual
Culture and Public Space (Console-ing Passions,
2001). (Durham:Duke University Press, 2002.)
University of Oxford, Department of Engineering
Science, Active Vision Group (2008) Parallel
Tracking and Multiple Mapping. 2008. 22 June
2012 http://www.robots.ox.ac.uk/ActiveVision/
Research/Projects/2008bob_ptamm/project.html
Hans Belting, Contemporary Art and the Museum Web sources
in the Global Age, in Weible, P., and Buddensieg,
A., 2006 ed., Contemporary Art and the Museum. “Art.sy”, 2012, http://www.art.sy
(A Global Perspective, Germany, ZKIII, 2007), 16“Future of Museums”, 2012 www.
38.
futureofmuseums.org
Hans Belting, Future Museum Conference.
“Metropolism”, 2012 www.metropolism.com
Facing Forward: Art & Theory from a Future
Perspective (Amsterdam, De Oude Lutherse
“ Museumas Association”, 2012 www.
Kerk, 2012).
museumassociation.org
Iwona Blazwick, Future Museum Conference.
“ Museum and The Web”, 2012 www.
Facing Forward: Art & Theory from a Future
museumandtheweb.com
Perspective (Amsterdam, De Oude Lutherse
Kerk., 2012).
“The Mini Museum”, 2012 www.theminimuseum.
org
James H. Gilmore and B.Joseph Pine II, The
Experience Economy (Boston, HBSB,1999).
“Wikipedia”, 2012 www.wikipedia.org
Lev Manovich, “The Poetics of Augmented
Space” 2002 last updated 2005, 22 June 2012,
http://manovich.net/DOCS/Augmented_2005.doc
Manuel Castells, The Rise of the Network
Societies’ in The Information age: Economy,
Society and Culture, (Willey Blackwell, 2009).
Margriet Schavemaker, et al., ‘Augmented
Reality and the Museum Experience’ In J. Trant
and D. Bearman (eds). Museums and the Web
2011: Proceedings. Toronto: Archives & Museum
Informatics. Published March 31, 2011. 19 June
2012 http://conference.archimuse.com/mw2011/
papers/augmented_reality_museum_experience
Mistry Pranav, The thrilling potential of
SixthSense technology. 2009. 22 June 2012,
http://www.ted.com/talks/pranav_mistry_the_
thrilling_potential_of_sixthsense_technology.
html
Peter Davis, Ecomuseums: a sense of place
(Continuum International Publishing Group Ltd.;
2nd Revised edition edition, 2011).
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
64
Skulpturenpark Berlin_Zentrum”, 2008 © KUNSTrePUBLIK
“EXELENT LOCATION”
In Berlin Mitte, property near the Forein Office.
Real-estate Prose as a Locational Disadvantage
by Martin Conrads
residents...” These were strange voices, like a foreign
language, especially because their concerns were
Later, as he sat on his balcony eating the wild outdated and no longer relevant to the present day.
boar, Dr. Maitland reflected on the unusual events
that had taken place within this huge area during Between Luisenstadt, Spittelmarkt and the Köpnicker
Quarter, nature had re-conquered just about
the previous three months.
everything. What remained were ruins, old
The wasteland lay under the morning sun. Dr. ones and new ones, and the librettos. “Urban
Maitland stood at the balustrade surveying the development requires time,” he thought and
plants and wildlife. From the building’s top stories, chuckled. Dr. Maitland recalled a brochure that
one could faintly hear the sounds of trailing he had once received in the office mail: “...when
librettos (Bizet! “Carmen”!) emanating from the you consider the strip of land cleared for the Wall,
scorched auto wrecks: “... downtown wastelands and realize that 20 years after its collapse only a
must never be developed again. Municipal real few properties have been resolved in the sense of
estate must take into account the needs of its a permanent urban and architectural solution...”
I.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
65
a prose has emerged in recent years which,
needlessly and more explicitly than anywhere
That was 20 years after the Wall. And now? The else, points to how the locational advantages of
area had resolved itself a permanent solution as if the culture business and those of the real estate
business overlap—a development which has
of its own volition. Almost.
otherwise been swept under the carpet in a coy,
The delicious boar meat began to have an effect, strategic, naive, or calculated way.
triggering Dr. Maitland’s memory. The final sentence
of the text came back to him: “It is astonishing that Hence, one can find descriptions in the usual
some areas only now, 20 years after the Wall, are portals (or on the property pages of real estate
being given a definitive planning solution.” -Ephraim developers), in which quality of life and distinction
is to be addressed and created through urban
Gothe, City Councilor for Urban Development.
exclusivity, on the one hand, and proximity to
culture, on the other – and if not in the sense of a
Although...
benevolence taking both the culture business and
the real estate business into consideration, then
II.
at least for the purpose of a system-stabilizing
The cold wind that carried the old, familiar voices win-win situation.”
to Dr. Maitland’s ear blew a newspaper onto the
balcony. Dr. Maitland picked it up, a weekend Bollocks. Cultural lingo of yesteryear. Dr. Maitland
supplement dated xx/xx/20xx. He leafed through, looked up and let his eyes wander across the
coming upon a photo of a building that vaguely vista. His memory came back in fragments. He
reminded him of days past. It accompanied a recalled his commission, the language, and office
that had been “resolved as part of the permanent
column, which he read in a low voice:
solution.” Dr. Maitland was one of eight staff
“One would really like to know how many genuine members of the Liegenschaftsfonds [Real Estate
requests were sent in response to the particular Fund], a department misleadingly disguised as
ad, which just a few days after being published “KUNSTrePUBLIK e.V.,” which was crouched in
was removed from the Internet. In autumn of the showroom of the Fellini Residences. Its task
2009, the Temporäre Kunsthalle Berlin appeared was to inspect international real estate ads, and
as a property in Berlin real estate portals. It was assess whether they contained information and
advertised as an “Artful, inspiring loft in prime strategies that could be beneficial to the Urban
location, BLN Mitte. Room 822.00 m2, EUR, Development-Senate Administration.
Schlossplatz 1, 10178 Berlin.” This offer was either
a resourceful PR move geared at overcoming a Outwardly, the impression of an artists’ group was
conceptual, curatorial and communications crisis, conveyed. They played with this camouflage with
which via a strategic detour attempted to lure both a program of exhibitions and accompanying press
Mitte-loving seekers of lofts and inspiration, and texts that were often deemed absurd by their
journalists with affinities for the Internet, to the audience: “Located in a field of tension between the
Fellini Residences showroom, a model of a luxury
Kunsthalle’s events and exhibitions.
condo, and the construction site of a commercial
Or, it was the result of a quasi-interventionist high-rise, the artist will organize the building of a
practice in the tradition of net-activism, which scale model of Skulpturenpark Berlin_Zentrum’s
referred to specific problems of location policies. vacant land. The miniature replica will be built onIf a combination of these possibilities is at all site in a temporary, modular container by workers
conceivable, it is because in the form of a real from the Job Center’s One-Euro-Worker program,
estate ad that advertises a cultural and locational a city initiative that sets unemployed residents to
advantage, a terrain of current profit agreements the task of constructing a miniature park version
was chosen that, analytically speaking, had hardly of Berlin. The installation will be accompanied
been taken into account. For in real estate portals, with interviews with the workshop’s staff.”
Ok... and then what?
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
66
Albeit fun, these actions were intended only for
keeping up appearances. The primary focus of Dr.
Maitland’s undercover department was on gaining
insights into the relationships between the bourgeoisie, architecture, and religion as hinted in
real estate advertisements. For the Liegenschaftsfonds, interpretations of these blurbs promised
to shed light on the current market situation – information that could not be statistically attained,
and to which collaborative cultural workers, socalled creatives such as Dr. Maitland, had been
engaged. The task of Dr.
Maitland’s department
was to crack the code of
these ads, from which
the Liegenschaftsfonds
and Senate Administration promised to reap
billions.
howlers and quasi-Freudian typing errors belong
to the standard of this new prose. One can also
find examples that get their lines right, but they
appear all the more decisionistic:”
At least this much was true, Dr. Maitland recollected.
The Monbijou Park was just a few steps away
and the cultural hotspots such as the German
Staatsoper Unter den Linden, Museumsinsel, and
Lustgarten were all in
the immediate vicinity.
The proximity to public
transport was exemplary; nearly every place
in the city could be reached within a short period of time.
Skulpturenpark Berlin_Zentrum”, 2008 ©
KUNSTrePUBLIK
The sounds from the
wrecked cars brought
him back to the balcony.
He continued to read:
The copy for these ads
included offers that were,
for example, ideal for
those who prefer a quiet
night’s rest, but desire to be only a stone’s
throw away from the action, with its attractive,
cultivated, and half-authentic restaurants, museums, operas, symphony halls, and of course,
the always popular,
luxury department store and pleasure temple,
Lafayette.
“The intertwining interests of the spheres
of culture and the real
estate business are particularly conspicuous
with the now trendy
principle of cultural
“theme real-estate”, as
the advertising prose of
the “Musikerhaus” [Musicians’ House] seeks to
demonstrate with simple examples:”
The rest was missing, torn out of the newspaper.
Dr. Maitland thought about what the author might
With the convenience of accessible public tran- have been arguing at the time. The following thousport, they could be everywhere quickly, from Ka- ghts mingled with his memories: The political,
DeWe, the other luxury department store, to the as well as historical center, could be reached by
airport and back again. Friends would visit them foot in 7 to 12 minutes (City Hall, Embassies and
often, and they could enjoy their well-earned lei- Ministries, Staatsoper, Komische Oper, Jewish
Museum, various corporate headquarters, Gansure time.
darmenmarkt, Friedrichstraße, Museum Island,
Dr. Maitland continued reading the paper, but Nikolai Quarter and the Cathedral).
had difficulty concentrating on the text: “Stylistic
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
67
Berlin-Mitte offered many reasons for which to
purchase a piece of it.
For example, the energy-saving buildings like
those at Neue Grünstrasse 15/16 had certainly
been a sensible investment in the future; and if they
proved to be in a prime location, the investment
was securer than gold. Additionally, if one lived in a
theme-oriented property like the “Musikerhaus”,
surrounded by the pleasant company of cultural
workers and creative people, this was another
argument in favor of their offers. One could feel
free to pursue his or her musical pleasures at
any hour of the day. No noise or decibel could
lead neighbors to reach for their broomsticks –
nor would street noise disturb their work. They
lived their ideas spontaneously. Thus, they were
located in the best of neighborhoods. They shared
and enjoyed their residential community with
other creative people, who not only placed great
demands on their art, but also on their real estate.
Demands for which the “Musikerhaus” was built.
And not least, they benefited from the rise in
property values due to the revitalization of the
Spittelmarkt quarter.
Via brennende-staedte.com:
- 08/11/2007: Alte Jakobstraße: Opel Meriva
- 12/08/2007: Neue Grünstraße: Mercedes
- 08/11/2007: Neue Jakobstraße: Renault Megane
- 04/25/2008: Alte Jakobstraße: Mercedes
- 12/06/2009: Sebastianstraße: Audi
- ...
- ...
These portal applications added the accumulated
data from older apps such as the Berliner
Mietspiegel, the Sozialatlas, the Umweltatlas,
Immobilienscout24, Brennende-Autos.de,
Rottenneighbor, Crimeblips, Blaulicht-Kurier, and
more. Together they destroyed, algorithmically and
in actuality, the suspected connections between
the bourgeoisie, architecture, and religion. They
also rendered Dr. Maitland’s department, which
had been dedicated to interpreting the texts,
redundant.
From this point on, Dr. Maitland’s department
wrote the very same real estate prose it was
commissioned to interpret.
III.
IV.
Dr. Maitland tried to recall when the prose of
the advertisements took a different turn, when
other topics crept into the sales pitch – contents
that caused the Liegenschaftsfonds and Senate
Administration headaches:
Dr. Maitland summed up the recent history. Over a
longer period of time, desolate but desirable lots
with exceptional ground plans were more often
perceived as unattractive locations alongside
shopping malls and service roads, rather than as
shared and collectively owned space. Since 1989,
Berlin had been an exception. But when the rest
of Europe recognized the use of collectively owned
vacant lots in the first third of the 21st Century,
Berlin lagged behind for decades, clinging to
the compulsive building tendencies of its urban
development policies. This unfortunate aberration
was recognized late, but not too late. Despite
intentions to build, almost nothing had changed
regarding the “wasteland-vacancy” of the former
Wall strip. It therefore came as no surprise that the
main reason given by the governing mayor for the
reconstruction of vacant land in this area, “in the
context of CreativeCityBerlin,” was suddenly an
urban-aesthetic choice. It was to “revive a gap and
create a visual closure for ribbon development.”
U-Bahn station practically at your doorstep. The
car in the underground parking lot accessible
via lift. A quiet street in Berlin-Mitte with a large
garden courtyard and from the penthouses a view
all the way to Potsdamer Platz. You are welcome
to compare the prices of our penthouses with
those of our competitors (i.e. Fellini Residences).
Texts like this must have been written at the time
when Google Maps mash-up portals began to replace
newspapers once and for all. It was when locative
portal applications, such as brennende-staedte.com
[burning-cities.com], tended to reveal more about
the potential dangers posed to limousines, which
with due negligence did not take the elevator to the
basement parking lot:
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
68
Skulpturenpark Berlin_Zentrum”, 2008 © KUNSTrePUBLIK
Dr. Maitland termed this the “urban development of
aesthetic appearance.” Now of all times, when lots
stood vacant, Berlin contemplated reconstructing
them.
A few months after the mayor’s speech, a razed
Potsdamer Platz was renamed the “Wall Strip
Project”. On the land where SONY Center once
stood was now the “Wall Strip Center”. sections
included: “The Wall Garden” along Chausseestraße,
“Wall Strip Quarter Mitte”, and the “Wall Strip
Promenade”. Once again, undeveloped and left to
nature. Other sections included: “The Wall Garden”
along Chausseestraße, “Wall Strip Quarter Mitte”,
and the “Wall Strip Promenade”. Once again,
undeveloped and left to nature.
Only the former “Fellini Residences” (now the
“Berlin Wall Strip Wasteland Memorial”) were
preserved in remembrance of a time when one
might still attempt to develop an abandoned lot.
Dr. Maitland was one of 750 game wardens who
now patrolled the reclaimed wilderness. He
always found it an ironic twist of fate that he, of all
people, lived in the residences. In the first place,
Digimag Journal
n° 73 | year VII
the residences were built in order to prevent the
cover of Maitland’s department from being blown.
Critics doubted that the cultural activities of
“KUNSTrePUBLIK e.V.” would actually enhance
the surrounding area of the allegedly planned
“Fellini Residences”. There had been a threat that
the entire operation would be exposed, thus forcing
the Senate Administration to erect the 70 luxury
apartments with their historicizing facade, more or
less, overnight. The public outrage incited by this
inane building led to the appearance of hundreds
of wrecked cars, and forced the Senate to conform
to European guidelines for the reconstruction of
vacant lands. The “Berlin wasteland development
policy” was upended.
Only the eight employees of Dr. Maitland’s
department were aware that all the advertising
copy for the “Fellini Residences” originated from
them. In order to fuel public resentment against
this unplanned and entirely fictitious complex,
Dr. Maitland’s department altered the online
apps operated by the bogus company behind the
residences (a front for the Senate), to such an
exaggerated degree and without consulting their
Quarterly
November 2012
69
Skulpturenpark Berlin_Zentrum”, 2008 © KUNSTrePUBLIK
client (also the Senate), that a revolt was all but – it promises a high increase in value in one of the
preprogrammed. Internally, the department most dynamic property markets in Europe.”
dubbed their method with a touch of in-house
humor, “The Vespa Promise”: “Discover Italy.
Dr. Maitland continued reading the paper, but
had espresso bars evoke an Italian feeling. Only
In the Middle of Berlin. Hardly any other metropolis one thing is still missing: the Fellini, a luxurious
in Europe has been so strongly influenced by block of apartments with an Italian way of life.
Italy in its architecture as Berlin. Many poets and It closes a gap, architecturally, historically and
architects of the 19th century allowed themselves culturally. In its shape and colour, its appearance
to be inspired in Italy and made the city on the is reminiscent of elegant Italian townhouses. The
Spree into an “Italian enclave”. This can still be curved court façade is inspired by the auditorium
sensed today. The densely rowed series of richly of a theatre. In its centre, there stands a splendid
decorated facades, rattling Vespas and the many stone fountain. The inhabitants are participants
espresso bars evoke an Italian feeling. Only one in this atmosphere and enjoy the relaxed Italian
thing is still missing: the Fellini, a luxurious block charm of their surroundings. The quality and
of apartments with an Italian way of life. It closes a first-class location of this property also provides
gap, architecturally, historically and culturally. In relaxation – it promises a high increase in value
its shape and colour, its appearance is reminiscent in one of the most dynamic property markets in
of elegant Italian townhouses. The curved court Europe.” As the official game warden of the “La
façade is inspired by the auditorium of a theatre. Dolce Vita”, the section of the Wall strip now
In its centre, there stands a splendid stone surrounding the residences, Dr. Maitland felt
fountain. The inhabitants are participants in this deeply satisfied about being the only inhabitant of
atmosphere and enjoy the relaxed Italian charm the memorial. This was also true in regard to his
of their surroundings. The quality and first-class passion for wild boar. When he had eaten it would
location of this property also provides relaxation be time to rest, and to tell his stories.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
70
Sources:
Martin Conrads
Ballard, J. G. 2000. High-Rise. London: Flamingo.
Martin Conrads is an author and artist who lives in
Berlin. Since the mid 1990’s he has produced and
Ballard, J. G. 1994. Concrete Island. London:
internationally presented works individually and
Vintage.
as a member of collectives and groups with a bias
on conceptual and critical media concepts and has
Bezirksamt Mitte von Berlin. Abteilung
written for numerous publications and magazines
Stadtentwicklung; Architekten- und Ingenieur(Cabinet, mute, Springerin, Texte zur Kunst etc.).
Verein zu Berlin AIV (ed.): „Aktuelle Bau- und
Currently he holds the position of a teaching assistant
Planungsvorhaben am ehemaligen Mauerstreifen / assistant professor at the Berlin University of the
im Bezirk Mitte von Berlin“. Berlin, 2009.
Arts’ Institute for Transmedia Design.
“In der Mischung liegt die Mitte. Städtebau des
ästhetischen Scheins: Der Architekturhistoriker
Wolfgang Pehnt spricht mit dem Tagesspiegel
über die Debatte um Berlins Zentrum”.Interview
by Christiane Peitz. Tagesspiegel, June 10, 2009.
Accessed August 29, 2012 http://www.
tagesspiegel.de/kultur/Wolfgang-PehntMitte;art772,2819096
Pollack, Sydney. 1975. Three Days of the Condor.
Lanchester, John. „Short Cuts“. London Review
of Books 31 (7), April 9, 2009.
Accessed August 29, 2012 http://www.lrb.co.uk/
v31/n07/john-lanchester/short-cuts
KUNSTrePUBLIK e.V.: Land’s End. Texts of the
premiere on January 24, 2010.
skulpturenpark.org
fellini-residences.com
Immobilienscout24.de
Immonet.de
wuestenrot-stiftung.de
foursquare.com
Brennende-Autos.de
Rottenneighbor.com
crimeblips.informatik.fh-kl.de/apache2-default
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
71
Telenoika Audiovisual Mapping @ Macau Arts Festival - (China) - http://www.telenoika.net/
SPATIAL AESTHETICS
An investigation into the art and space
by Laura Plana Gracia
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
72
Influenced by Adorno and Benjamin (Benjamin
2002), this paper focuses on the Politics of Space.
In particular, it concerns Psichogeography, defined
by Guy Debord (Debord 1977; Anon. 1960) as the
study of the precise laws and specific effects
of the geographical environment– intentional,
organised, or not– on the emotions and behaviour
of individuals. Ian Sinclair (Sinclair 2010) is one of
the most recent and contemporary critical theorists
in psichogeography based in London. His projects
have analyzed new landscape and the Olympic
zone, resulting in one of the most critical works
today.
urbanism, but it also represented the beginning
of political culture.
PART I
SPATIAL AESTHETICS.
The ideology inside the city. Landscape versus
public space.
Cityscape, anti-monument, public and social
sphere are concepts that define contemporary
artistic practices concerned with the development
of the public image of the city. The sculpture and
public software are influencing the ideology and
the education on the citizens. That necessity to
As a researcher based in cartography, mapping transmit knowledge and communication generates
and geopolitics, I have concluded that aesthetics practices of appropriation of public space. At
is required to describe this particular art. In this point, public art programmes let social and
that sense, it is urgent to build, construct and artistic practices to recover the historical and local
spread a new way of thinking about art. I have memory working with buildings and monuments
found that Spatial Aesthetics is one of the best that have a value.
ways to think critically about the situation of
contemporary society. Following this, as Benjamin Those practices are based in praxis and also in
did in his Passages (Benjamin 2002), each place strategies of communication through a direct
is considered a space characterized by a specific experience. Other branches of this historical and
actor (citizens, tourist, walkers …) or a non-actor social aspects of the current artistic discourse
(defined by Joana Erbel in Critical Cities, Ideas, is one that develops from the psychogeography,
Knowledge and Agitation, Emerging Urbanist cartography or anti-monument. Strategic actions,
(2009), as the “factors in public space that are not models or utopian construction of public space,
human but determine the structure of the place”). as well as atypical figures in the museum space
Also, Spatial Aesthetics could be defined as the make the ancient artistic practice of landscape
sense of place as material, like in Saskia Sassen being a model of knowledge for the development
(S. Sassen 1999), when she describes capitalism and improvement of the society. This practice of art
as potential earth buyer. Because each place will be deciding how to preserve the heritage and
memory. There is a fact that the social landscape
holds an actor, and furthermore a material.
is built as a fictitious imitation of nature through
After this common sense consideration of how architecture and, even more, through screens and
to think critically of our contemporary society, electronic surfaces (Erbel 2009).
I wish to provide a discussion on where this
art theory departs from. The notion of public Julian Oliver
space in the definition of classic sculpture or
monuments is actually very far from the idea of In the way they are built, they face us to a daily
the renaissance artist as a builder of the city. confusion. The support and surface where
Contemporary mapping, cartography, geopolitics media and the advertisements are inserted are
and psichogeography have built an urgent need expression of daily life existence. But, as Adorno
to think art after the avant-guard, abstraction (Adorno 2004) observes, when the subject, inside
and performance art, and also cinema; the the landscape, decontextualizes their images, they
urgent need to understand society under the acquire the significance of ideology. Media and
influence of machinery, electronics and the advertisements build the ideology of the masses,
evolution of communication tools and devices. expressing the significance of contemporary life.
Psichogeography was a movement of critical In that way, the participation in the construction
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
73
Skulpturenpark Berlin_Zentrum”, 2008 © KUNSTrePUBLIK
of the collective imagination as a landscape
is a metaphor and symbolism of the real
society, the tasks of artists among other social
agents. All must agree that the representation
of the collective imagination is influenced by
the consumer society, through the strategy of
seduction. This simulacrum of reality consists on
an appropriation of techniques of advertising and
tourism.What Adorno described as the process
of constructing the psychology of masses by the
identification of the product (the symbol or image
of power through propaganda and reproduction
technique), is currently defined by Baudrillard as
simulacrum (Baudrillard 1991; Baudrillard 1995).
Here, the proposal is to treat art as a document of
reality, not a simulacrum, a palliative method for
certain social practices.
power (Foucault 1995), and representing the
monumental forms and hegemonic discourse of
power in history. Along with advertising panels,
security cameras and devices of control build
an urban landscape dominated by surveillance,
where the subject is denied to question and define
a nature of society (Deleuze and Guattari 1988).
In that order, Critical Urbanism challenges the
traditional monuments of history and public policy
in defining monuments. The arch of triumph, the
public sculpture or the media installation in open
zones are ideological illustration for the social
participation for the construction of the city.
Stanza
Following Saskia Sassen (Sassen 2011), the place
as a material becomes the paradigm to read the
The concept of art as a document of reality focuses inside of the city. The most valuable material is
on the memory and information of the site, to what Negri describes as immaterial work (data
create environments where the documentary and information producing a new digital order).
falsification and speculation are excluded. In the Outside post-cities, outside borders of capitalism,
last century, the public space has been invaded material research and mines are re-discovered by
by security systems (mainly cameras) that are financial giants. In that way, when you deal with
used as devices that act as coercive effect of Spatial Aesthetics you consider a work of art that
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
74
belongs to the city, post-city or any other place, but
you are dealing with a cultural policy, defending
the communal interest of art inside the public
voices of society. The agora publica, where the rescogitas of the common citizens (the senso comune
of citizens) is expressed thorough newspaper
and fences that where conquered years ago by
advertisements and brands. Conversely, artists are
pushing against this simplification of commodity
benefits and consumerism habits. It is thought
the res-cogitans as material thought, a neuronal
network. According to Roy Ascott and Peter
Weibel, citizens, artists and public institutions
have to build this social network, the noosphère
(de Chardin 2010), based on neuroscience as
the energy of thought. Using big screen, data
projection and public networks, public space will
be soon invaded by de-constructed electronic
surfaces expressing the global embodiment.
Saaskia Sassen to Bourdieu (Marcuse 1987; S.
Sassen 2001). For them, the theory of the politics
of the sign aligned language to the order of
capitalism as a system of production of goods. As
Marx states, there is a need for a critical practice
outside of the cycle of mass production and that
is critical and improves massive movements. The
post-city is the actual moment. One of its main
goals is the use of New Media Electronics. As
capitalism meets a resistance, there is a common
movement based on the idea of the D.I.Y. (do it
yourself). Several artists are appropriating social
practices from engineering, design, architecture
or media communications and are becoming
creative workers.
They use workshop facilities at centres such
as the V2 in Rotterdam, Medialab Madrid, FACT
Liverpool, Constant in Bruxelles, etc,… where
they are able to distribute and produce tools and
devices for the development of tools to improve
PART II
communications, environment, data collection,
TRANSITORY PRACTICES IN EUROPE.
urbanism, environment. They are all mainly
Translocal Europa. Borders in the community.
against the massive production and Microsoft
The rapid urban transformation in Square Mile monopoly. Lots of them are involved in mapping and
London is an example of how it is turning into cartography, but also in the creation of databases,
the Silicon Valley II. The new centre of the city e-phone applications, robotics, internet, etc.
is turning into a digital city, characterized by the
digital generation. For Žižek (Žižek 2002; Žižek 2005), Telenoika
this belongs to the idea of the end of capitalism,
the Post-city, that is, establishing a new order Žižek declares that the end of capitalism could
centred on the financial district. But the trouble have started 20 years ago with the disintegration
remains, as Adorno and Horkheimer argued of communism in 1989 (Sassen 2001). After this
(Horkheimer and Adorno 2007). The homogenised period, the eastern bloc had a financial boom, that
landscape of capitalism doesn’t let other voices reached as far as the UK. Those were also the times
be heard. Now, the digital post-city is done with of the explosion of digital technologies. French
capitalism, but the same features remain. One sociologist Lefevre connects that period with the
of them is the homogenization under ideological expansion of urbanism thanks to capitalism.
code. The digital city, the post-city is initiating
a new digital economic order. There have been Also the psichogeographers, The International
critics to the new architecture as it is not enough Situationiste and Debord (Debord 2008) declared
sustainable. Massive buildings have been detected that the shape of the state come over life,
as precarious for the basic needs they require.
building their form. The Eastern European postcommunist countries suffered a spatial and
social reconfiguration. Neoliberalism started
Asymptote
the privatization of public space during at 90s
Later in the sixties and until the beginning of 21st and the neo-liberal economy of the 21st century
century, capitalism represented the homogenization created new heterogeneous urban actors, artists
of liberalism and neo-liberalism. The counter- and public art projects. Old communist landscape
resistance had alternatives from Marcuse and made of large-scale buildings rapresenting
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
75
intellectual politicians gained interest from private companies and local authorities. Others were
destroyed to avoid concepts such as memory and
amnesia. In that situation, the notion of border,
nation or country is also being re-signified. For
example Greece and the Balkans are ethno-territories, full of minorities, with no borders because their community is spread all over. They used
to be marginalised and delegitimized by religious
nationalism.
After communism, the
end of capitalism and
with the rise of the postcity, concepts such as
Transnationalism,
Internationalism, Globalism, Nation-states, Localism, Post-socialism,
Post-nationalism, Localism are becoming common. Each of them is
a different notion to be
categorised, but all are
movements after communism and form of
Spatial Aesthetics. For
instance, Europe tends
to define all-comprising
territories: the Eurozone, the Eurocentrism,
Eurasia, Mediterranean
Europe. All of them are
involved in the construction of European policies
for a true internationalism.
PART III
ARTIST
Ballettikka Internettikka by Igor Stromajer &
Brane Zorman. An
example of Transitory
Art in Europe
A series of tactical art
projects began in 2001
with the exploration of Internet ballet. This project
explores wireless Internet ballet performances
combined with guerrilla
tactics and mobile live
Internet broadcasting
strategies.
Fig: Roy Ascott. The
image of the future city. LPDT (Le Plasir du Text).
Second Life installation.http://www.asquare.
org/networkresearch/2010/lpdt2
http://lpdt2.wordpress.com/
From Nietzsche to Orwell, Europa has been the
main theme for discussion by intellectuals and
writers, artists and citizens. It could be said that
translocalism comes altogether with the postcity characterised by new media electronics that
give us the sense of immateriality, ubiquity, de-
Digimag Journal
territorialism of communication, allowing to work
abroad and in non-places. This should allow more
freedom and better communications and economic wealth; it could also provide a way to deal
with sustainability and the ecological and climate
change problems that machines and technology
are promoting.
n° 73 | year VII
The 10-years project ends
in 2011. It’s a series of
interventions in public
spaces: right now it is
intensively being prepared for the final Ballettikka Internettikka action
in Antarctica, November 2011. The relation
between the project itself and the public space is multilateral. Its
actions consist of invasions, mostly illegal guerrilla actions (but not all
of them), where the artists enter the specific public
space and do the artistic action there, a ballet (at
the beginning with our own bodies, later with robots). It has illegally invaded various public institutions and public places/structures, like the Bolshoi
in Moscow (BI Ballet Net), La Scala in Milan (BI
Illegallikka Robottikka), Ljubljana Beltway - Motorway Ring (BI Autto Mobillikka), National Theatre
in Belgrade (BI BEO Guerrillikka), Volksbühne toilet in Berlin (BI VolksNetBallet), City Hall toilet for
Quarterly
November 2012
76
Stanza - The facade presents the emotional real time state of the city of Trondheim is by using live data, and CCTV images to represent the Nova Building as a living breathing entity.
disabled people (BI RenminNetBallet) plus the
Lippo Centre twin-towers (BI Stattikka) in Hong
Kong, a factory in Slovenia (and broadcasted live
to Plaza del Rey in Madrid: BI Hydraullikka), and
construction site of the new shopping mall in Seoul,
where a robot was buried (BI Intermenttikka).
Lately, robots have been abandoned as far north as
they could go (Svalbard, Arctic ocean; BI Norddikka),
and as far east (Japanese island Minami Torishima
in Pacific Ocean; BI Nipponnikka).
References
Adorno, Theodor W. 2004. Teoría estética.
Ediciones AKAL.
Anon. 1960. Constant: Konstruktionen und
Modelle; 9. Jan.-9. Febr. Galerie van de Loo.
Baudrillard, jean. Citoyenneté Et Urbanité
by BAUDRILLARD & AL. http://www.renaudbray.com/books_product.aspx?id=181879
This year the 10-years project is going to end by &def=Citoyennet%c3%a9+et+urbanit%c3%
abandoning the last robot as far south as possible: a9%2cBAUDRILLARD+%26+AL%2c29092
in Antarctica (BI Antarcttikka). One BI action was 10030&utm_campaign=partage-réseauxalso done in relation to the ceremony of igniting sociaux&utm_medium=réseaux-sociaux&utm_
the olympic torch in Greece (BI Olymppikka), and source=facebook-like.
in the Port of Hamburg (with two insect robots; BI
Insecttikka). Some smaller BI actions were done Baudrillard, Jean. 1995. Simulacra and
in places that were not always considered not- Simulation. Trans. Sheila Faria Glaser. University
so-public. So, the basic starting point was: if they of Michigan Press.
don’t let us go somewhere in a legal way, we go
illegally, guerrilla style. Later, this guerrilla style Benjamin, Walter. 2002. The Arcades Project. Ed.
changed into a more intimate form (abandoning Rolf Tiedemann. Trans. Howard Eiland and Kevin
the robots, leaving them in several extreme places McLaughlin. 1st ed. Belknap Press of Harvard
forever).
University Press
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
77
Chardin, Pierre Teilhard de. 2010. cartas a
edouard le roy (1921 - 1946): L. Trotta.
Debord, Guy. 1977. The Society of the Spectacle.
http://library.nothingness.org/articles/SI/en/
pub_contents/4.
———. 2008. Correspondence: The Foundation of
the Situationist International (June 1957--August
1960) (Semiotex. Trans. Stuart Kendall and John
McHale. Semiotext(e).
Deleuze, G., and F. Guattari. 1988. A Thousand
Plateaus : Capitalism and Schizophrenia.
London: Athlone Press.
Erbel, Joana. 2009. “From Market Place to Empty
Space and Back: Transformations of Urban Logic
in Polish Cities After 1989 |.” In Critical Cities:
Ideas, Knowledge and Agitation from Emerging
Urbanists: 1, ed. Deepa Naik and Trenton
Oldfield. 1st ed. Myrdle Court Press.
Foucault, Michel. 1995. Discipline & Punish: The
Birth of the Prison. REP. Vintage.
Laura Plana Gracia
BA History of Art, UB University of Barcelona, 2006.
MA Curating New Media Art, MECAD Barcelona
2007. Certificate in Curating, Communication
and Criticism, University of Arts London 2009.
MA Media Art Histories, Vienna, Austria 2010.
Forthcoming PhD Visual Global Cultures UB. Has
participated at study/work programme at Media Art
Histories where Editor, Archiver and Researcher
for Database of Virtual Art are. Has exhibited: Field,
Interim Camp, Experimental Generative Animation,
Pebbledash Gallery, London 2009. Cartographies
of non- site, Espai D’arts, Barcelona 2009. Joe
Sola, Arco Cinema, Madrid 2010. Aggtelek, Solo
Exhibition, Crisp London Los Angeles, London
2010. Language-Code, Conservas, Barcelona 2011.
Has been a speaker at a panel discussion about
Cartographies, Mapping & Database Visualization
at ISEA Conference Dortmund Germany 2010. Is
curator invited by MOTA Museum of Transitory
Art to participate in an International Forum about
Hipermobility and New Media Art, Belgrade, Serbia
2011. Has been awarded by MACBA as Researcher
in Residence at Centre d’Estudis Barcelona.
Horkheimer, Max, and Theodor Adorno. 2007.
Dialectic of Enlightenment. Stanford Un. Press.
Marcuse, Herbert. 1987. Eros and Civilization.
Taylor & Francis.
Sassen, Saskia. 1999. Globalization and Its
Discontents: Essays on the New Mobility of
People and Money. First ed. New Press, The.
———. 2001. The Global City: New York, London,
Tokyo. 2nd ed. Princeton University Press.
Sassen, Saskia J. 2011. Cities in a World
Economy. Fourth ed. Sage Publications, Inc.
Sinclair, Iain. 2010. Hackney, That Rose-Red
Empire: A Confidential Report. Penguin.
Žižek, Slavoj. 2002. Welcome to the Desert of the
Real!: Five Essays on September 11 and Related
Dates. Verso.
———. 2005. Bienvenidos Al Desierto De Lo
Real -. Ediciones AKAL. http://www.akal.
com/libros/Bienvenidos-al-desierto-de-loReal/9788446020387.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
78
The Whale Hunt, , 2007, Jonathan Harris and Andrew Moore - Mosaic. Mosaic mode shows all 3,214 photos simultaneously, arranged chronologically in a large colorful grid. This mode reveals coloration
patterns in the photographs over time, signaling the changing environment from New York City, to airplanes, to Barrow, to the Arctic Ocean. Any photo can be clicked and selected.
DATABASE NARRATIVES
Possibility Spaces: Shape-shifting and interactivity in
digital documentary
by Janet Marles
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
79
Any new medium must resolve its place in relation Documentary form is being radically re-shaped as
to narrative (Toffs 2005, 104).
it responds to the digital revolution in recording,
editing and the emergence of new media
Working digitally allows the “conventional” platforms that have allowed for more diverse uses
documentary narrative form to shift from of documentary production and distribution. Hight
temporal to spatial, from horizontal to vertical, (2008) suggests with increased capacity, cheaper
from sequential to concurrent. Digitality also costs, and faster production of digital recording
provides interactivity. With interactivity comes and editing and the subsequent explosion of
a potentially spontaneous, engaged and active content distribution and exhibition networks
audience able to choose how they receive the via the Internet, documentary has begun to be
content. Yet, documentaries need to convey quintessentially transformed.
crucial pieces of their narrative for their story to
be comprehensible to their audience. The critical Similarly, historian and new media researcher,
question for documentary makers, then, is how to Paul Arthur (2008) has identified digital history
incorporate these new digital technologies, with productions, as benefiting from the “diversification
their potential for innovative narrative structures, of modes of public access and delivery” (187)
and still make a factual story understandable to brought about by the digital revolution. Further,
he claims that digital technologies have facilitated
their audience.
a “democratization of history enabling everyone
Identifying the Internet as the primary site that has to become possible contributors to the ongoing
opened up space for digital storytelling Lundby process of shaping and reshaping history” (188).
(2008) says,
Sorenssen (2008) also advocates the democratic
(The Internet) offered new options to share the potential of digital media. Citing the example of
“classical” small-scale stories created in story an eighty-two year old British man who became
circles at various corners of the globe. The a YouTube® sensation with his regular video
World Wide Web also gave rise to new forms, blog geriatric1927. Sorenssen shows how this
Blogging, in text only or with video, as well as octogenarian, regularly engaging with a medium
the social networking sites on the web offer new considered by many to be the domain of the young
opportunities to share short personal stories (3). fulfills Alexandre Astruc”s belief from 1948 that
new media forms would democratise, rejuvenate
Examples of these online story spaces will be and liberate media forms, especially film.
explored in this paper, along with early television
forms, computer specific forms, gallery specific For digital documentary audiences this added
forms and performative forms. This selection of spatial dimension allows them access to
work illustrates the experimentation with digital additional tiers of content. It also provides a
form that Manovich in “The Language of New new position within the documentary as active
Media” (2001) terms “database narrative” and participant, not simply as passive receiver. Some
Hayles (2005) calls “possibility space”. Both terms documentary makers have adapted quickly to
help to define the territory in which the form of these developments, which, while providing new
documentary is shape-shifting as a result of the layers of content for exploration of the form, have
revolution in digital technology.
also required the acquisition of new skill sets
and the confrontation of technical and practical
Shape-shifting: documentary”s changing form
issues. Further, there are the added constraints
that the digital and online environment brings,
By the end of the 1990s the aesthetics of for instance considerations regarding file size for
interaction, grounded in the video game paradigm, storage and playback.
had become a familiar way of doing things in the
name of culture. The age of interaction had arrived
(Toffs 2005, 8).
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
80
through structural temporal devices. “Linear
succession, cause-and-effect, is what allows the
reader/user to “relax” into the tale. … The reader/
user is left with the satisfaction of an experience
with beginnings, middles and ends” (143-4). Le
Grice (2001) also acknowledges the importance
of temporal form in linear narrative and says
“narrative is a method by which events – real
or imaginary – are given coherence through the
representation of sequential connections”(290).
Manovich (2002) agrees, stating “cinema …
The challenge for producers is to engage with the replaced all other modes of narration with a
new skills of the digital revolution yet ensure their sequential narrative; an assembly line of shots
audience receives the parts of the narrative that which appear on the screen one at a time”(69).
makes their story comprehensible. Documentary
makers must adapt and stay in tune with the shape- Consequently, temporal linear narrative became
shifting taking place in the digital documentary the primary mode of cinematic story telling, yet
form.
representing sequential linear time in film does
not necessarily equate to chronological story
“We are entering an age of narrative chaos, where telling. As Rieser (2002) explains “the very linearity
traditional frameworks are being overthrown of film stimulated a number of conventions to
by emergent experimental and radical attempts counteract its effect. Flashbacks, jump-cuts, etc.
to remaster the art of storytelling in developing reintroduced fluidity to a rigid medium” (147-8).
technologies” (Rieser and Zapp 2002, xxv).
These conventions may have varied the order
of time in the narrative. However, they did not
Perhaps what is needed for digital documentary change the intrinsic temporality of the product.
to take advantage of the new spatial forms and The linear, horizontal, sequential and temporal
interactivity that the digital and online platforms features nevertheless remain.
provide, whilst also remaining understandable to
audiences, is a combination of narrative modes Emerging spatial non-linear narrative
- linear and non-linear, temporal and spatial,
interactive and passive.
In our digital era this linear temporality is now
being challenged in a more significant way. As
Traditional temporal linear narrative
Le Grice (2001) points out, the very essence of
digital forms is non-linear and in addition the way
Classical narratives predominantly follow the a computer stores data does not require a linear
Aristotelian model of revealing dramatic events, process or understanding. He says “the computer,
whether they are factual or fictitious, in a realistic which is fundamentally based on what is called
fashion using characters as tools to create Random Access Memory … is the designation
identification in the audience. As Zapp (2002) says, of the non-sequentiality of memory addressing
– intrinsically opens up the condition of nonThe viewer is taking on the role of a voyeur, witness linearity”(296). Further,
or emotional judge. He or she is immersed in the
story by emotional means of identification, as the Solid state electronic systems (machines) achieve
plot aims to provoke sympathy or antipathy with all their connections, do all their work, by electronic
the characters or draws possible parallels to the pulses; even if hierarchic, they are fundamentally
viewer”s subjective reality (78).
non-linear. Whatever is conceived as the unit of
data, its storage and retrieval is substantially freed
Dovey (2002) describes this audience identification from a predetermined sequence derived from
as a type of transportation, which is achieved the physically linear conditions of a mechanical
Specifically, as digital documentary changes in form
and audience members become active participants
in the process of viewing the production, can
the documentary producer be confident that
their audience will receive vital aspects of the
documentary content? If the audience is able to skip
around the story space, cherry picking the pieces
they want to access, how can the documentary
maker be certain they will access crucial parts of
the story?
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
81
The Shoebox (2010), the Bill’s Gully panoramic scene plays in the central viewing frame, over this two yellow squares blink on and off indicating they are active hotspots, below this the Timeline shows
one embedded media clip has been played.
medium (both film and video are locked into the
mechanics of the linear sequence of the recording
medium). Through the Random Access Memory
(RAM) structure of the computer, the sequence of
retrieval does not have to match the sequence of
storage and all address locations are effectively
equidistant (282).
Yet Le Grice (2001) also recognises that simply
because a film is produced using digital processes,
this does not necessarily make it non-linear. He
claims, “the current fashionability of the term nonlinear creates some problem of definition” (289),
because although film-makers are now using
non-linear systems more and more, particularly
non-linear editing systems, these systems are
only non-linear in the way they store and retrieve
data, however, “the principles on which they (the
edited segments) are combined in the finished
product conform to linear narrative concepts. The
technology allows non-linearity – the concepts
remain linear”. As Hales (2002) puts it “in this
case the technology is not leading to a change in
thinking simply a way of getting things done more
efficiently and more economically”(105).
Digimag Journal
n° 73 | year VII
Cubitt (2002) highlights the increase in narrative
forms through “the rise of the popular press, film,
radio and television”, yet marvels at the longevity
of linear narratives in this digital era stating,
The remarkable persistence of narrative in
twentieth-century media can only be apprehended
as remarkable if we apprehend the environment
in which it is now performed, a landscape of other
modes of documentation and dissemination.
Crucial among them are forms of data storage
and retrieval that are not structures in time, as is
the narrative, but in space (105).
Manovich (2006) explains this perseverance of
traditional narrative as the predisposition for
new technology to mirror the technology it is
replacing. He says “one way in which change
happens in nature, society, and culture is inside out.
The internal structure changes first, and this change
affects the visible skin only later” (2). Hence the first
car resembled a horse drawn carriage and new
media forms continue the use of temporal linear
narrative within their spatial non-linear domain.
Manovich refers to the inside out phenomenon
Quarterly
November 2012
82
Bystander - Kate Richards & Ross Gibson - interactive installation - 2007Part of the Life After Wartime suite, Bystander is a 5-channel interactive software system. The work is installed in a 7-metrewide pentagonal frame comprised of five projection-screens and surround sound audio which visitors enter – up to 10 at once.
as “uneven development” and claims it hinders
our appreciation “that new media does represent
a new avant-garde of information society even
though it often uses old modernist forms”. Further
he says,
abilities to classify database records according to
different dimensions, to sort through records, to
quickly retrieve any record, as well as to “stream” a
number of different records continuously one after
another (Manovich 2002, 66-7).
If the 1920s avant-garde came up with new forms
for new media of their time (photography, film,
new printing and architectural technologies), the
new media avant-garde introduces radically new
ways of using already accumulated media. In other
words, the “new avant-garde” is the computerbased techniques of media access, manipulation
and analysis (2).
So a work does not become non-linear simply by
using digital applications or digital storage and
retrieval systems, there has to be a change in the
structure of the work from one based on time to
one based on space. It is the added ability to move
around within the work, to navigate vertically as
well as horizontally, to explore spatial relationships
as well as temporal relationships and to have
access to media components in a simultaneous
Manovich gives as an early example of this new as well as a sequential way that changes it from
media avant-garde the work of a group of graduate linear to non-linear. As Dovey (2002) says,
students from Helsinki’s University of Art and
Design. He describes their interactive late-night Hypertextual ways of working… invite us both
television program Akvaario (Aquarium) (2000), as authors and users to experience information
created for the Finnish national broadcasting as a spatial arrangement. We are called upon to
navigate the database in order to make sense of
company Channel 1, as a “database narrative”
what is stored within. Knowledge that may once
It is … a narrative, which fully utilizes many features have been transmitted in narrative form, as a
of a database’s organization of data. It relies on our story, novel, report, essay or article, can now be
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
83
accessed through a network of links in which a may not consider themselves to be documentary
spatial relation between component parts can be producers, all the selected projects have a factual
documentary basis on which their content depends.
preserved (140).
For a comparative breakdown of each project see
In “The Language of New Media Manovich” (2001) Table 1.
explains the conflict between database and
narrative; databases are spatial and concurrent, Ross Gibson and Kate Richards “(LAW) Life
narratives are linear and sequential. He claims After Wartime” (2003) and “Bystander” (2004-9)
all new media works are primarily databases Australia
and that while a database “can support narrative,
there is nothing in the logic of the medium itself Ross Gibson and Kate Richards constitute an
example of collaborative artists engaging with
which would foster its generation” (201).
Cubitt’s (2002) new “forms of data storage and
Hayles (2005) challenges Manovich’s analysis retrieval” within landscapes “of documentation
explaining neither database, nor narrative are terms and dissemination” (2) and Manovich’s (2004)
that are adequate to explain the phenomenon of “new ways of using already accumulated media”
interactive digital media. For Hayles both terms, (2).
individually and in combination, are too confined.
She prefers the term “possibility space”, which Accessing an archive of crime scene photographs
opens up the arena for “a flexible, wide-ranging taken between 1945 and 1960 by the New South
framework” through which to position such Wales Police Service in Sydney Australia, Gibson,
Richards and their team have created five distinct
interactive digital works (1).
works between 1998 and the present. These
Hayles’ thesis is that computer generated, database include live performances; gallery installations;
narratives (non-linear and linear) are not at web portals; and a CD-ROM with the intriguing
odds with each other or considered to be in a titles of Darkness Loiters, Crime Scene, (LAW)
competitive relationship with one another, despite Life After Wartime, LAW Live with the Necks, and
Manovich declaring “why do narratives still exist Bystander. In this instance I shall refer only to the
in digital media?” (cited in Hayles 2005, 2). Hayles CD-ROM (LAW) Life After Wartime (2003) and the
argues that the definition of narrative needs to gallery installation Bystander (2004-9).
be expanded to the concept of “possibility space”
allowing for “known-knowns, known-unknowns, (LAW) Life After Wartime (2003), referred to
and unknown-unknowns” to coexist within the here as (LAW), is a computer specific work that
same project space (4-5).
combines portions of the database of crime scene
photographs with haiku-like texts, sound effects,
Database Narratives/Possibility Spaces
and music files into random sequences initiated
by the user. Ross Gibson (2005, 5) says the
The following discussion uses both Manovich’s operating system underpinning (LAW) is designed
and Hayles’ terms as an overarching category as a “speculation engine… throwing batches of
to analyse a range of projects representative of pictures forward in turbulent patterns” and that
shape-shifting in documentary form. All of the “the system gains cohesion according to the
selected productions are taking advantage of the history of each investigator”s interaction with the
spatial dimensions of non-linear narrative, and all database”.
are maintaining a dimension of temporal linear
narrative, even if this is regarded as quite small.
Over time, a set of micro-narratives and moodmodulations accrue until eventually a kind of
The delivery and exhibition platforms vary from debatable meta-narrative builds up to account for
project to project. However, all productions are the entire image-world of the archive. Crucially,
digital and all organise their content from an each investigator will gather up a different set of
originating database. While some of the producers micro-narratives and moods and each investigator
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
84
will tend toward a larger story in idiosyncratic and
The two-way digital mechanism of Bystander
personally stamped ways (Gibson 2005, 5).
responds to the presence of audience members.
(LAW) is what Gibson calls a “dramatic database” As the number of people situated within the
which explores the non-linear, vertical, spatial installation space increases the faster the images
relationships opened up by the digital revolution. are delivered. Additionally, as the audience
Additionally, he sees the user/viewer engaging members move through the space their actions
with (LAW) as “not a reader or a receiver of this are fed-back into the computer system, which
artwork” rather as “implicated as an investigator” responds by sending samples of data to match
whose interactivity enables them to participate in the activity of the audience. If audience members
are moving slowly data will be sent to them
the pace and delivery choice of the process.
slowly, if they increase their pace the computer
This random accessing of images, sound effects, responds likewise. Bystander is a good example
and poetic texts works to place (LAW) as an of an interactive digital documentary production
artwork partially using historical, documentary that fulfills both Manovich’s database narrative
content rather than a documentary production criteria as well as Hayles’ definition of possibility
per se. This may have been the creative choice of space.
the producers who had access only to the crime
scene photographs. Most of the narrative details Jonathan Harris “The Whale Hunt” (2007) U.S.A.
useful to documentary makers - the who, when,
where, what and how descriptors - were not filed Jonathan Harris approaches the temporal
and spatial dimensions of database narrative/
with the photographs. Gibson (2005) explains,
possibility space from another tangent. Describing
…(The) crime-scene images are filed in small his work The Whale Hunt (2007) as “experimental
manila envelopes full of variously-sized negatives; interface of human storytelling” Harris combines
registered on every envelope there are the elements of computer science, anthropology,
names of an investigating detective and a police visual art, and narrative in this online documentary
photographer plus a date and description for the photographic work.
particular crime being documented. And that”s it;
that”s the extent of the interpretive cues offered Harris and his collaborator, Andrew Moore, recorby the archive. Although each image is full of ded on large format (Moore) and digital (Harris)
stories, hardly any files are “authenticated” with still cameras the experience of participating in a
official interpretations. There are no detectives” whale hunt with an Inupiat Eskimo family in Barnotebooks, no court reports, no charge sheets, row, Alaska. The annual whale hunt is a thousandjudgements or newspaper articles. The archive is year-old tradition for the Inupiat whom today are
therefore an unruly almanac of Sydney, a jumble of permitted by international law to hunt twenty-two
evidence associated with actual people who have whales per year.
been caught in painfully real outbreaks of fate,
desire or rage. The pictures lie there awaiting The Whale Hunt database is organized into an online
their users. But how to use them when they tell so platform around four themed subsets, the cast, the
little that is conclusively true (5)?
concept, the context, the cadence. Each subset allows the viewer to filter the database through the
Using the same database of crime scene photographs chosen constraint. Cast selects photographs that
and haiku-like texts as (LAW), Bystander (2004-9) contain subjects such as Abe, Ahmakak, 1st whale
shape-shifts the concepts initiated in (LAW) into an and so on.
interactive installation form within a gallery space.
The work morphs into an “immersive environment” Concept selects photographs according to themes
with rear and front projection onto multiple screens such as blood, boats, buildings and so on. Context
positioned to create an enclosed viewing space that enables the viewer to filter the photographs based
the audience can occupy.
on the location they were taken such as New York
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
85
City, Barrow, Alaska, the Patkotak family house
and so on. Finally, cadence filters the photographs
based on the excitement level experienced at the
time the photograph was taken such as slow, relaxed, fast, frantic, and racing.
Shot over a continuous seven-day period at no
more than five-minute intervals (with the use of
a chronometer while sleeping) the database consists of 3,214 still images. The emphasis on continuous recording enables this database narrative/
possibility space to contain a tangible temporal element. Meadows
(2003) claims such inclusions are critical for
any narrative to be readable and understandable to other people.
Speaking about interactive narrative Meadows
says,
taken, and consequently the higher the heartbeat
graphic to illustrate this activity.
The Whale Hunt interface can also be viewed in another three modes; mosaic, timeline, or pinwheel.
Each mode gives a tiny thumbnail of each image
– represented as the average pixel colour for that
photograph. In mosaic mode every photograph is
arranged simultaneously, in chronological order,
as one large coloured grid. Rolling over the grid a
magnifier effect isolates individual images, which
when clicked can to be
viewed as a full image
on the screen.
Timeline mode displays
all the photograph’s
thumbnails, chronologically, in a column representing each thirty-minute period of time. The
height of each column
indicates the number of
photographs taken during that half hour period.
Selecting any coloured
box by clicking retrieves
a full sized version of that
photograph.
Stories seem to be a
way in which we report
to one another on the
events of life. We don’t
need machines to do
that. We need individual
opinion and perspective
(29-30).
Similar to timeline mode,
pinwheel mode displays
all 3,214 photographs
chronologically separated into twenty-minute
intervals.
Fig: The Whale Hunt,
Jonathan Harris and
Andrew Moore, 2007, a
storytelling experiment.
Clicking on any coloured box retrieves its
corresponding photograph. By experimenting
with these four presentation modes as well as the
four themed subsets, Harris has combined linear and non-linear narrative as well as the users”
interactivity into the architectural design of The
Whale Hunt. Consequently, the user/viewer can
Accentuating this approach the entire database of access the database narrative/possibility space of
photographs is represented by a human heartbeat The Whale Hunt from a variety of narrative pergraphic along the bottom edge of the screen. The spective points.
more excitement experienced during the whale hunt event corresponds to more photographs
With the temporal layer
in The Whale Hunt we
are given Harris’ point of view (literally) at least
twelve times an hour over seven consecutive days.
During situations of heightened excitement or
activity Harris’ perspective is provided even more
frequently.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
86
Improvised Empathetic Device - I.E.D. (2005), demonstrated by S.W.A.M.P. collaborator Matthew Kenyon at (DIME-Arts, October 2006) photograph taken by Author
S.W.A.M.P. Matthew Kenyon and Douglas
Easterly “Improvised Empathetic Device - I.E.D”
(2005) U.S.A.
Another project to add to this list of database
narratives/possibility spaces as an example of
shape-shifting documentary is a performance piece
I observed at the first international conference of
Digital Interactive Media Entertainment and Arts
(DIME Arts) held at Rangsit University Bangkok,
Thailand in October 2006.
Selected to present at the conference under the
category of human computer interaction I.E.D. is
included here as a documentary in the sense that
the primary data for the work is “evidence” which
has been “data mined” from the United States of
America casualty statistics of US soldiers killed
in the war in Iraq. Specifically, the data refers to
soldiers killed by I.E.Ds. (Improvised Explosive
Devices) which commonly use a cellular phone or
text pager as a remote trigger for ignition.
mimics the name as a means to emphasise this
connection.
The data is “mined” from icasulaty.org, which
collates casualty data from the United States
Department of Defence, sitcom, and other
sources. Each time a US soldier’s name is added
to the casualty database a text message is sent to
a receiver embedded in the I.E.D. armband. The
armband is equipped with a needle poised above
the skin of the upper arm of the wearer. With each
casualty name the performer/documentarist/
new-media-artist wearing the armband is jabbed
once by the needle indicating the death of one US
soldier in Iraq. Simultaneously a computer screen
displays personal information concerning the
casualty - the individual’s name, rank, cause of
death, location of death, and hometown in the U.S.
One surprising outcome of this performative piece
has been the performers’ growing awareness of
when the data of U.S. soldiers would be released
into the public realm. Matthew Kenyon says,
The performance piece named I.E.D. (Improvised So just like with some of our other projects some
Empathetic Device) uses similar technology and patterns began to emerge which became visible,
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
87
Improvised Empathetic Device - I.E.D. (2005), close-up of armband showing needle, photograph taken by Author at DIME-Arts, October 2006.
became evident in tangible ways for instance
the timing of the release of casualty statistics…
we became aware very quickly, finding that the
government tends to release this information late
on Fridays to avoid the news cycle. So we would
find that on Friday afternoon we would feel a
growing apprehension and anxiety of the potential
of receiving the injections.
that connect the human subject directly to the
data and from that human computer interaction a
narrative is performed.
Bill Lamin and Harry Lamin “WWI, Experiences
of an English Soldier” (2006-12) U.K.
An example of documentary adapting to the online
distribution platform of the Internet blog is the
The collaborators of S.W.A.M.P., Matthew Kenyon remarkably well thought through blogsite of Harry
and Douglas Easterly, may be surprised to be Lamin, a British soldier in WWI, who regularly
included in a discussion of digital documentary wrote letters home to his family in England. Each
narrative forms however I regard this work as a of Harry’s letters is transcribed and appears as a
performative documentary using database and blog entry exactly ninety years (to the day) after
non-linear narrative and as a clear illustration of Harry wrote them. Harry’s blogsite explains,
Hayles’ notion of “possibility space”. Hayles says,
The first letter is dated from the postmark as 7th
I cannot imagine a human world without narrative, February 1917. As promised, the letter from the
but I can imagine narratives transformed and training camp will be published on the evening of
enriched by their interactions with possibility Wednesday 7th February 2007 - Exactly 90 years
space in the complex ecologies of contemporary after it was written. (7th February 1917 was also a
media and culture (29).
Wednesday, so the days of the week will coincide.)
The data or content of I.E.D. is documentary evidence Harry Lamin’s blogsite is the creation of Harry’s
mediated through electronic and mechanical devices grandson Bill Lamin.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
88
A retired teacher, Bill, uploads entries, maintains
the website, replies to comments, and makes
additions to the content of the letters for historical
accuracy and clarity. Bill sees himself as a
facilitator for Harry’s story. Because the audience
can read Harry’s blog in any order they choose,
even skipping whole sections, a brief synopsis
on the front page of Harry”s blog ends with the
following suggestion,
To find out Harry’s fate, follow the blog!
This sentence states Harry’s blogsite intention to
be read as a journey, for the reader to follow in
real-time the unfolding of events as they happened
to British Private Harry Lamin during WWI, just as
Harry’s relatives would have followed via Harry’s
letters home ninety years earlier.
and the last comment (at the time of writing) is
dated 29 August 2012, indicating the audience
for Harry’s blog has been ongoing and increasing
over time. In fact, the whole blogsite has received
so much audience interest Bill Lamin, and more
recently his daughter Catherine, have created a
secondary blogsite just to handle feedback and
comments.
As a further testament to its popularity, Harry’s
blog has been picked up as a news worthy item
by traditional media outlets. Bill Lamin has been
interviewed for newspapers, radio, and television
in Canada, U.S.A., Germany and the U.K. Some
of these media stories have lead new readers to
Harry’s blog. Other readers have stumbled onto
Harry’s blog through Web surfing, as I did while
researching information regarding World War I.
People from New Zealand, Australia, Argentina,
Spain, Portugal, Holland, the United States, and
the United Kingdom have all commented on
Harry’s blog, a testament to its truly global appeal.
The by-line of each entry identifies the blog
author as Harry. Bill Lamin’s involvement is as
facilitator. Hartley (2008) describes a similar
relationship between facilitator and blog subject
in the production of the blogsite The Life of Riley. In May 2009 Bill Lamin published a book based on
Harry’s blog. Titled Letters From The Trenches,
Created by documentary filmmaker Mike Rubbo A Soldier of the Great War it is an expanded
The Life of Riley is the blogsite of 107-year-old version of Harry’s blog with additions of further
blogger Olive Riley. Olive’s blog is a flow on project information and historical research. The book is
from the documentary film All About Olive (2006) a tangible indication of the continued slippage of
that Mike Rubbo made about Olive Riley’s life. Mike Harry’s blog back into mainstream media.
refers to himself on Olive’s blogsite as “Mike the
helper”; he records Olive’s dialogue, transcribes Yet the book publication has created an interesting
it, uploads the text onto the blogsite interspersed situation for some of Harry’s blog readers who
with old and new photographs, and video clips. Mike have purchased the book. They are placed in a
also replies to readers’ comments and provides dilemma regarding the temporal nature of the
additional information for clarity in italics. Olive blog. Many do not want to read the book until it is
died in 2008, aged 108-years-old. Mike continued revealed by the blog in real-time what becomes of
to update and maintain Olive’s blogsite until 2010. Harry. The majority of Harry’s blog readers appear
Hartley (2008) identifies this type of Rubbo/Riley to have subscribed wholeheartedly to the daily
collaboration as a new hybrid form, part blog diary unfolding of the narrative of Harry’s blog.
(since it uses first person although it is written
by someone else), part DST (digital storytelling) A number of readers have commented on this
transcript, part multiplatform publishing (205).
aspect of the blog and although they have now
bought the book they still want to maintain the
This approach appears to be very popular with suspense set up by the temporal arrangements
readers, both Olive’s and Harry’s blogsites receive of the blog and don’t want to know the end until
a high volume of audience feedback. Harry’s it is revealed from Harry’s letters. The following
“Introduction” blog entry, alone, has received are some of the blog comments regarding Harry’s
eighty-seven comments from readers. The first audience’s response to the book versus the blog,
comment on Harry’s blog is dated 22 August 2006
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
89
Louise Lewis said...The problem is that we book
buyers have been following the blog in “real tima”
(sic) for some years, and we don”t wnat (sic) to
learn the ending in “advance”. My book is waiting
on the shelf ready to be read and appreciated in
the future when the blog finishes. Nevertheless, I
can say how much I appreciate the work and effort
you have put into the project and a glance at the
book shows it to be handsome indeed. Thank you
for all you have done.
May 07, 2009
Anonymous said...You just keep this going. I have
been watching this from almost the beginning
here in Illinois USA. I will buy the book for my son
AFTER this blog is finished because I don”t want
to know the end, yet. This is part of my morning
ritual. BTW, I looked up the General Beauman,
...interesting dude. April 23, 2009
Once a clip has been viewed an icon representing
the visited clip drops into a timeline at the base
of the screen. After a precise number of clips
have been accessed the timeline fills with the
remaining icons and becomes active. The timeline
can now be played as a traditional linear movie
with scripted beginning, middle and end. This
interactive architecture, named “memoradic
narrative”, was designed to mimic our process of
autobiographical memory recall.
Susan Engel (1999) describes memory as a
reconstructive process whereby “one creates the
memory at the moment one needs it, rather than
merely pulling out an intact item, image or story”
(6). This implies says Engel “that each time we
say or imagine something from our past we are
putting it together from bits and pieces that may
have, until now, been stored separately.”
Researchers such as Engel (1999) and
McNally (2003) have found that memory is an
amalgamation of activities that utilize a number
of sites and cognitive processes in the brain, and
these processes are much more complicated,
more fragmented, and more subjective than we
are inclined to presume. Whilst we tend to think
of the process of memory as being similar to
Janet Marles’ “The Shoebox” (2010) Australia.
recording and playing back a scene in the same
My exploration of shape shifting in digital way a video camera operates, it is in fact more akin
documentary is “The Shoebox” (2010) a recreation to the processes of capture, storage, and retrieval
of a memory story complete with gaps and absences, that a hypermedia platform such as memoradic
inconsistencies and mysteries prompting the user/ narrative employs.
viewer to engage as both a participant and a
With memoradic narrative the user/viewer intespectator.
ractively chooses fragments of embedded media
“The Shoebox” uses six 360-degree panoramic from a number of story spaces. Once viewed these
scenes to place the documentary elements in fragments are reconfigured into a linear timeline
time and place. Each scene describes a location that, when played, “tells” the biographical story
as well as an era from the protagonist’s story. as a “traditional” documentary film. This conflaStyled as a biography that employs interviews, tion of non-linear and linear narrative mimics the
voice-over narration, re-enactments, animated process of autobiographical memory recall, which
stills, and primary source documents “The pieces together fragments of stored memories to
Shoebox” compels the user/viewer to engage construct a story by which the person remembewith fragments of memory embedded in each ring communicates experiences.
panoramic scene that become the threads from
which the life story is woven. The user/viewer is
able to navigate between these scenes and can
randomly choose embedded clips to view.
Harry’s blog exemplifies how non-linear spatial
narrative, audience interaction, and linear temporal
narrative forms may not simply coexist in the
same production, but may, each in their own way,
actually contribute exponentially to the entire
narrative.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
90
Selected Database Narrative / Possibility Space
comparative breakdown
The following table (Table 1) breaks down the
components of each of the previous examples of
database narrative/possibility space indicating
whether, and to what degree (high, medium, low),
each project has employed non-linear and linear
narrative devices.
Table 1 also identifies the type of interactivity
each project has employed, if any. It divides
this interaction into two
types. Firstly, audience
interaction into the narrative selections or the
audience member’s ability to navigate through
the project at will. The
second type of interaction I have identified is
audience feedback to
the narrative content or
the ability for audience
members to have input
into the narrative content.
non-linear and linear narratives are binary opposites cancelling each other out and whether narration and interactivity are antithetical (Manovich
2001; Wand 2002). Also, there has been debate as
to whether these modes are new or, in fact, have
been displayed in different mediums throughout
time. Rieser (2002) gives a concise summary
when he says:
The frequent assertion that interactive narrative
is “a contradiction in terms” centres on the argument that the diegetic space of narrative
is compromised or destroyed by interactive
engagement with the
story; … this argument
is based on a misunderstanding of narrative
mechanisms. The active participation of audience is not new nor is
it disruptive of narrative
diegesis; it is merely incompatible with certain
narrative conventions,
which have become unduly emphasised by historical accident (146).
The only project (from my
What is becoming cleselection) that incorpoar to commentators,
rates this second type of
documentary producers,
interaction is Ross Giband digital media artists
son and Kate Richards’
alike, is that interactive
Bystander (2004-9). In
media is most underthis case this interaction
standable to users when
only changes the deliveit incorporates a mixture
ry speed of data to the
of non-linear and lineaudience. The audience
do not have any input into the type of data they ar narrative devices. This is especially true when
will receive and likewise they cannot change the the story content is factual and key aspects of the
narrative must be conveyed to the audience for
narrative content itself.
the story to be comprehensible.
Conclusion
As Dovey (2002, 143) states, not only do new meThese examples of shape-shifting documentaries dia change the narrative from one of a horizontal
are a selection of works by documentary makers temporal type to a vertical spatial type but both
and digital media artists experimenting with non- should be functioning for a piece to be considelinear narrative, linear narrative, and interactivity. red understandable. Acknowledging this trend,
Much discussion has taken place as to whether Wand (2002), quotes Ulrich Weinberg, a Professor
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
91
The Shoebox (2010), an embedded media clip plays over its panoramic scene, Bill’s Gully, in the central viewing frame below this the Timeline remains inactive and empty
at the academy of Film and Television Studies in
Potsdam, who says, “Linear media are becoming
part of the content of the world of non-linear
entertainment” (167). Ross Gibson (2004) explaining
his process with (LAW) states;
Most of my work entails finding historical fragments
in the aftermath of some cultural “breakage” or
violence and then offering narrative or dramatic
“backfill” to explain the existence of the evidence.
More and more, I am interested in how searchable
databases, as well as, linear storytelling, can be
used for such imaginative rather than didactic
experiences.
linear is based on spatial arrangements using
examples from documentary makers and digital
media artists we can see how these producers
have engaged with temporal, horizontal and
sequential as well as spatial, vertical and
concurrent narratives and how these two seemly
opposed techniques, rather than acting as binary
opposites are in fact operating in a complimentary
way within the same piece.
The non-linear techniques provide the hypertextual
nodes and links that permit the spatial domain to
be navigated interactively by the user, while the
linear sections provide the traditional narrative
devices to bring together the fragments into an
understandable story.
For Hayles, (2005) incorporating all the variations
available means the definition of narrative needs
to be expanded into the concept of “possibility References
space” which allows for “known knowns, known
unknowns, and unknown unknowns to coexist within Arthur, Paul Longley. 2008. “Participating in the
the same production space” (4-5).
past: Recording lives in digital environments”
Cultural Studies Review 14(1): 187-201.
In describing the structural difference between
linear and non-linear narrative and demonstrating
that the linear is based on temporal and the non-
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
92
Cubitt, Sean. 2002. “Spreadsheets, Sitemaps and
Search Engines: Why Narrative is Marginal to
Multimedia and Networked Communication, and
Why Marginality is More Vital than Universality”
in ed. Martin Rieser and Andrea Zapp, 3-8. New
Screen Media: Cinema / Art / Narrative, London:
British Film Institute.
Cubitt, Sean. 2001. “Preface: The Colour of Time”
in ed. Martin Le Grice, vii – xvii. Experimental
Cinema in the Digital Age, London: British Film
Institute.
Dolan, Ethel Avery and Shawn Pease. 2007-12.
Soldier”s Mail: Letters Home From A Yankee
Doughboy 1916 – 1919, accessed October 2012
http://worldwar1letters.wordpress.com/aboutsgt-samuel-e-avery/.
Dovey, Jon. 2002. “Notes Towards a Hypertextual
Theory of Narrative” in ed. Martin Rieser and
Andrea Zapp, 135-145. New Screen Media:
Cinema / Art / Narrative, London: British Film
Institute.
Engel, Susan. 1999. Context is Everything: The
Nature of Memory, New York: W.H. Freeman and
Company.
Gibson, Ross, and Kate Richards 2004-9.
Bystander, Interactive Gallery Installation, The
Performance Space, Sydney Australia http://
katerichards.net/art/bystander/
Gibson, Ross. 2005. The Rise of Multimedia
Systems, Accessed June 2012, www.tate.neat.
tas.edu.au/word/gibson2.doc 2005.
Gibson, Ross. 2004. Dramatic Databases: Life
After Wartime-Crime Scenes 1945-1960, lecture
at COFA Sydney, ACM SIGGRAPH.
Gibson, Ross, and Kate Richards. 2003. Life After
War Time. (LAW), Interactive CD-ROM. www.
lifeafterwartime.com Sydney, Australian Film
Commission.
Hales, Christopher. 2002. “New Paradigms <
> New Movies - Interactive Film and Narrative
Interfaces” in ed. Martin Rieser and Andrea
Zapp, 105-119. New Screen Media: Cinema / Art /
Digimag Journal
n° 73 | year VII
Narrative, London: British Film Institute.
Harris, Jonathan. 2007. The Whale Hunt,
Interactive Online Narrative. www.thewhalehunt.
org
Hartley, John. 2008. “Problems of expertise
and scalability in self-made media” in, ed. Knut
Lundby, 197-211. Digital Storytelling, Mediated
Stories: Self Representations in New Media, New
York: Peter Lang Publishing.
Hayles, N. Katherine. 2005. “Narrating Bits:
Encounters between Humans and Intelligent
Machine”, Vectors (1): 1-38.
Hight, Craig. 2008. “The field of digital
documentary: a challenge to documentary
theorists”, Studies in Documentary Film 2(1):
3-7.
Kenyon, Matthew. 2006. “Conference
Presentation” to First International Conference
of Digital Interactive Media in Entertainment and
Arts (DIMEA 2006) Rangsit University Bangkok
Thailand.
Kenyon, Matthew, and Douglas Easterly 2005.
Improvised Empathetic Device (I.E.D.), S.W.A.M.P.
http://www.swamp.nu
Lamin, Bill. 2009. Letters from the Trenches: A
Soldier of the Great War, Michael O”Mara Books.
Lamin, Bill, and Harry Lamin 2006-9. WW1:
Experiences of an English Soldier, accessed
October 2012. http://wwar1.blogspot.com/
Le Grice, Malcolm. 2001. Experimental Cinema in
The Digital Age, London: British Film Institute.
Lundby, Knut. 2008. “Introduction: Digital
storytelling, mediated stories” in ed. Knut
Lundby, 1-20. Digital Storytelling, Mediated
Stories: Self Representations in New Media, New
York: Peter Lang Publishing.
McNally, Richard, J. 2003. Remembering
Trauma, Cambridge Massachusetts: The Belknap
Press of Harvard University Press.
Quarterly
November 2012
93
Manovich, Lev. 2006. “Uneven Development” in
Image Future, accessed October 2012 http://
www.manovich.net/articles.html.
Alexandre Astruc’s camera-stylo: the new avantgarde in documentary realized?” Studies in
Documentary Film 2(1): 47-59.
Manovich, Lev. 2004. “Info-Aesthetics” accessed
October, 2012. http://www.manovich.net/IA/.
Toffs, Darren. 2005. Interzone: Media Arts in
Australia. Victoria: Craftsman House.
Manovich, Lev. 2002. “Spatial Computerisation
and Film Language” in ed. Martin Rieser and
Andrea Zapp, 64-76. New Screen Media: Cinema
/ Art / Narrative, London: British Film Institute.
Zapp, Andrea. 2002. “net.drama://myth/mimesis/
mind_mapping/” in ed. Martin Rieser and Andrea
Zapp, 77-89. New Screen Media: Cinema / Art /
Narrative, London: British Film Institute.
Manovich, Lev. 2001. The Language of New
Media, Cambridge: MIT Press.
_______________
Marles, Janet. 2010. “The Shoebox” accessed
October, 2012. http://www.memoradicnarrative.
com
Meadows, Mark Stephen. 2003. Pause and Effect:
the art of interactive narrative, Indianapolis: New
Riders.
Oakley, Peter. 2009. “geriatric1927” accessed
October 2012. http://www.youtube.com/user/
geriatric1927 and http://www.askgeriatric.com/.
Pellinen, Teijo. 2000. Akvaario (Aquarium),
www.mlab.uiah.fi Helsinki, Finnish National
Broadcasting Company Channel 1
Rieser, Martin and Andrea Zapp. 2002. “Forward:
An Age of Narrative Chaos?” in ed. Martin Rieser
and Andrea Zapp, xxv-xxxii. New Screen Media:
Cinema / Art / Narrative, London: British Film
Institute.
Janet Marles
Dr. Janet Elizabeth Marles gained her Ph.D. in
interactive digital media, combining the academic
fields of Information Technology and Humanities.
Her interactive digital documentary “The Shoebox”
conflates linear and non-linear narrative in a way
that mimics autobiographical memory recall via
a technique she calls “memoradic narrative”.
Janet”s current digital documentary project is
an immersive interactive installation exploring
Brunei Darussalam”s unique natural and cultural
heritage.
Rieser, Martin. 2002. “The Poetics of Interactivity:
The Uncertainty Principle” in ed. Martin Rieser
and Andrea Zapp, 146-162. New Screen Media:
Cinema / Art / Narrative, London: British Film
Institute.
Rubbo, Michael. 2004. Personal Documentary
Forum. Sydney: 51st Sydney Film Festival.
Rubbo, Michael. 2006-10 “All About Olive”
accessed January 8, 2010, http://www.
allaboutolive.com.au
Sorenssen, Bjorn. 2008. “Digital video and
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
94
Sinlab Logo
SINLAB
A new Renaissance
by Alessandro Barchiesi
The arbitrary division of domains of knowledge
and the request for specialization is a relatively
recent phenomenon. During the Renaissance, one
of the great eras of exuberant creativity, people
did not divide the world into art and science.
Instead they saw them as a seamless continuum.
Michelangelo was a sculptor, architect, painter,
engineer, poet and anatomist; Leonardo was an
inventor, painter, engineer, sculptor and anatomist;
great naturalists, such as Charles Darwin, made
discoveries that we call “science” while trying to
understand the beauty and order of the natural
world. Our current educational system hardly
integrate art and science, failing in an important
aspect of generating creativity in people. I
personally experienced during my work in the
Physics department of the La Sapienza University
Digimag Journal
n° 73 | year VII
and during my work as a researcher in Fermilab,
P.S.I. and CERN that it’s pretty difficult to conciliate
a creative professional career (I started first
attending fine arts class in the art academy of
Rome, then teaching in it during my PhD in Particle
Physics) and a professional research position in
a scientific field like Physics. The two worlds are
disconnected in academia even if a large dose of
creativity is required in both.
We need a Hybrid Culture
The common perception of the scientific process
is in terms of objectivity, experiments, facts.
Scientific articles appear a perfect reflection of
real world. While the Arts can be profound, they
are always imaginary.
Quarterly
November 2012
95
This vision of science as the mediator of everything
depends upon one silent assumption: art
cycles with fashions, while scientific knowledge
proceeds by linear ascent. The history of science
is perceived as a simple equation: time + data =
understanding. There is the conviction that one day
science will solve everything. The deeper we know
about reality the deeper we perceive paradoxes.
Take, for example, the history of physics. The
physicists thought they had the key to understand
the universe. Then came Einstein with relativity,
altering the classical notions of time and space;
then came Heisenberg’s uncertainty principle
and the beautiful counter intuitive revelations of
quantum physics; string theorists started talking
about eleven dimensions to reconcile theoretical
gaps...
which lead to new works of art and so on.
Instead of ignoring each other, or competing, or
collaborating in superficial ways, science and art
will truly impact each other. The old intellectual
boundaries will disappear. Art will become a real
source of scientific ideas. This will lead us to take
an “enlarged” view of truth.
Right now, science is widely considered our unique
source of Truth, with a capital “T.” Bringing our
two cultures together will allow us to judge our
knowledge not by its origins, but in terms of its
usefulness. What does this novel or experiment or
poem teach us about ourselves? How does it help
in understanding who we are, or what the universe
is made of? What kind of new way of thinking and
communicating could quantum mechanics bring
when deeply understood? If we are open-minded
Scientists seek to solve the oldest and most epic in our answers to these questions, we will discover
of unknowns: what is the universe? Who are that poems and paintings can help advance our
we? Before we can understand these mysteries experiments and theories. Art can make science
science must go a step further in expanding its better and vice versa.
possibilities. How can we make this happen?
We need to find a place for the artist within the Until now only single individuals dare to cross the
experimental process, to rediscover what Bohr borders of the cultures and it’s easy to think to the
observed when he looked at the cubist paintings cornerstones of the performative art world: people
seeing electrons not like little planets, but like one like John Cage for the experimental music, Nam
of Picasso’s deconstructed guitars: superposition June Paik for the video or Merce Cunningham
of states. The current constraints of science for dance. There is a growing tendency towards
make it clear that the separation between our a movement that deliberately crosses cultural
two cultures is not merely an academic problem, borders and seeks to create relationships between
rather a practical problem. If we want answers to the arts and the sciences.
the most essential questions/equations we need
to bridge our cultural divide. By paying attention SINLAB: towards an alliance between
to the wisdom of the arts, science can gain the performing arts and science
new insights and perspectives that are the
seeds of scientific progress. We needed a “third The natural first step towards the path of the
culture”, to say it in the words of Snow (1993), hybrid culture passes through technology. With
which would close the “communications gap”. the emergence of new technologies our culture
We’ll need even a further step: to create a new is undergoing changes – the manner and ways
academic movement that deliberately trespasses in which we perceive space, how we experience
on our cultural boundaries and seeks to create our body, how we communicate, how we produce
relationships between the arts and the sciences. sense and meaning. History has proved time and
again that technological innovation leads to new
The point from where we need to move further in cultural practices, new ways of communicating,
building such movement, we can call it a hybrid new ways of sense-making, and new ways
culture to use the words of J. Lehrer (2012), is in which we see and perceive the culture.
that neither culture can exist by itself. Its goal will
be to cultivate a positive feedback loop, in which Traditionally, one of the prominent cultural sites
works of art lead to new scientific experiments, where the impact of technological invention is
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
96
reflected is theatre. As a metaphor and microcosm of reality theatre has always made use of
technological tools; even the development of new
cultural techniques went into the realization and
aesthetics of the theatre and of the stage (broadly
speaking). With the digital revolution the gap has
gradually widened between increasingly complex
and specialized technology on the one hand, and
artistic practices on the other.
enhance our capability to express ourselves and
question our own modernity. This has been the
first step towards the construction of the liason
between the creative world and the scientific one.
A new project called SINLAB has been created as
a new interdisciplinary research platform: a living
laboratory that can be seen as a virtual extension
of all participating labs and institutions in one
physical location.
Fig: Choreophony. SINLAB research project
2012 - idea, concept
development: Pablo
Ventura - interaction
design, software, video:
Chris Ziegler dance:
Unita Gaye Galiluyo,
Deborah Hofstetter
Participants in this project include the following
schools and universities: École Polytechnique Fédérale de Lausanne (EPFL) and four
of its laboratories; the
Colour Light Centre
(CLC) at the Zurich University of the Arts (ZhdK)
and the ZHdK Master
scenography program;
the HETSR-Haute École de Théâtre de Suisse
Romande–La Manufacture, Lausanne; LMULudwig
MaximiliansUniversity Munich (D),
which bring a worldwide famous expertise. As
artistic partner, we are
in touch with artists on
an international level.
The project is funded
by the Swiss National Science Foundation
(SNF). The objectives of
this project are: to fundamentally challenge
and renew existing means of expression, and put them at disposition for
live experimentation in the theatre; to offer science and technology a new field of experimentation;
to foster a critical discourse on the uses of new
media in the performing arts, and open up new
forms of theatre; to start creating a tradition of
cooperation between scientific and arts-oriented
universities and gradually build centers of competencies at a national and international level; to
sensitize future generations of artists and researchers in education and research, and to create
Most advancements in
the use of technology for
theatre that we experience today were initiated by artists, and were
primarily cross-applications of technologies
originally developed for
other fields. Accordingly, these applications
have been unique solutions that generally fail
to push the boundaries
of the techno logical,
aesthetic, and cultural
envelope. This situation
has undermined true
experimentation and innovation, and made difficult for the performing
arts to explore novel possibilities of expression,
and deprived science of a potentially exciting opportunity for experimentation and progress. To
overcome this situation, it has become necessary
to organize a process that facilitates systematic
encounters between theatre artists and scientists, and that encourages scientific and technological research that is in tune with the needs of
performing arts. Perhaps the new narratives that
will emerge, desperately needed by a society longing for sense and meaning, will empower us and
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
97
hybrid PhD of EPFL coming from different artistic
and scientific backgrounds constitute the core
of SINLAB. The research team is continuously
It is articulated around three main research areas: involved in the development and reflection process,
frequently supplemented by EPFL-researchers
- Transformation of time and space perception and ZHDK from the collaborating Labs, a senior
philosopher from ZHDK, dr. Jens Badura, together
and experience within stage-settings,
with LMU professors and the topic-related selected
- Intermediality as a dimension for expression and researchers and artists in residence.
experimentation on stage,
Ok but what’s going on in the SINLAB?
- Man-machine relations as a field for the
The SINLAB was inaugurated on Valentine’s Day,
exploration of human self-understanding.
2012. The project will be devoted to PhD students
Digital performance and the “Entanglement” of that will be in a loop of thinking, making, sharing
Performing Arts and Scientific research are by also stimulated by the presence of an artist in
consequence seen as a particularly fruitful setting residence every 6 months. One of the historical
figures in Swiss choreography and technology
for a mutual inspiration.
panorama, Pablo Ventura, recently completed his
The starting point for our proposed project is the residence, working together with one of the PhDs,
premise that we understand the theatre stage Chris Ziegler, on generating a polyphony through
as a platform for interdisciplinary and trans- choreography: a Choreophony as he called it.
disciplinary research, and as a discursive vehicle
for art within society. This means that theatre This is an element of the Choreography of Space
becomes a place and a medium by means of he is working on: together with SINLAB he focused
which we reflect the changes taking place in mainly on the composition of sound layers by
our ways of communicating, our social behavior means of dancers’ movements captured through
as well as our living spaces. This is the reason motion tracking technologies and mapped to
why we are dealing with the development of new sound files. It is important to understand that this
technical tools, testing new artistic processes as is not an attempt to compose music, but a research
well as reflecting on the aesthetics and discursive based on how dance dynamics and rhythms can
relevance of these developments in a scientific affect sounds and on investigating the possibility of
manner. In this project, technology developers, music landscapes, texturing the space with sound.
artists, theatre studies experts, dramaturges,
cultural scientists as well as representatives of The new and key aspect in this is in the perception
of the dancer and of the choreography, which is
the theatre universities are participating.
not to be devised in order to generate specific
The new lab is also intended as a space to initiate the mapped sounds, but retains its independence
creation of new types of PhDs that are at the same and validity as dance composition in itself. The
time Scientists and Artists. This is a cornerstone dancer retains the freedom to interpret set
to turn what was only done by individuals into a choreographies affected by the sounds produced
movement that can dialogue within the academic in a loop of feedback and is not transformed in the
world, making it possible to really make an impact search for imaginary buttons that would generate
on the cultural world, and finally bridging the a sound composition for a composer. In the
two cultures in a more formalized and durable meantime, several projects are ongoing, dealing
fashion.Prof. Jeffrey Huang is the main proponent with the creation of experiential environments,
of the project and the director of the SINLAB, dr. immaterial architecture, augmented performative
Alex Barchiesi, a creative physicist with several capabilities of expression through commercial
years of experience in LHC-CERN experiments, technologies.
is the LAB head and together with a team of
a sustainable process for bringing the universe of
science and arts closer together.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
98
Sinlab - Project from the first art residency
An open source software framework, SINK has been the lights of the space, opening new modes of
released as a alpha version few weeks ago by Andrew communication for the participants.
Sempere, one of the PhD students of SINLAB, to
facilitate the usage of kinect sensors technology.
It is important to point out that this is all happening
under the umbrella of the Swiss National Science
One of the most important art festivals in Lausanne, Foundation and inside (or with the collaboration
“Les Urbaines festival” (30 Nov - 2 Dec), will host of) university institutions, namely EPFL, HETSR,
several works-in-progress of SINLAB. Among LMU, Tsinghua University, ZHDK.
them there will be Quadricone, a prototype of an
interactive suspended structure, reacting to Wi-Fi These institutions will work together to achieve
networks data flow and dynamically transforming the previously mentioned bridging of the cultures
itself. Moody Lights: an interactive experience of without the need to compromise with production
emboding the lights is inserted in the reflection or market constraints. The mixed background of
of immaterial architecture by PhD student Selena the team will eventually create a playground to
Savic.
move towards a really hybrid culture that aims
to move beyond the mere technological level of
In this context, embodied communication reveals engagement, and to add a conceptual perspective
the ways in which people’s senses and bodies to favor a new renaissance.
can be utilized to transfer meanings between one
another through technological “augmentation” References
of the space of means of communication in their
environments. Alex Barchiesi, together with the Lehrer, Jonah. 2012. Imagine: How Creativity
PhD student Andrew Sempere, will create an Works. Export & Airside ed. Canongate Books.
interactive stage light environment where people’s
interactions and movements are reflected in
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
99
Alessandro Barchiesi
Head of the Project SINLAB dr. PhD, creative
Physicist, studied Particle Physics in Rome La
Sapienza University, fellow in Fermi Institute Chicago.
PhD in Paul Sherrer Institute (PSI) and La Sapienza
University of Rome. Researcher at European Spatial
Agency (ESA) and at Italian National Institute for
Nuclear Physics (INFN). Researcher at European
Organization for Nuclear Research (CERN ATLAS
experiment). Lecturer at La Sapienza Rome
University. Associate professor of new media art
and informatics at Art Academy of Rome; founder
of the bLuELab art project. His artistic work has
been presented around Europe including IRCAM
Centre Pompidou Paris and Auditorium Parco della
Musica in Rome and received international awards.
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
100
PLACES
AND
SPACES
WWW.DIGICULT.IT
Digimag Journal
n° 73 | year VII
Quarterly
November 2012
99