What is
Multimodal?
A text may be defined as
multimodal when it combines two
or more semiotic systems. There
are five semiotic systems in total:
Linguistic,
Visual,
Five of
Aural,
modes:
Gestural And
Spatial.
Linguistic
: comprising aspects
such as vocabulary,
generic structure and
the grammar of oral
and written language
Visual:
comprising aspects
such as color, vectors
and viewpoint in still
and moving images
Audio:
comprising aspects
such as volume, pitch
and rhythm of music
and sound effects
Gestural
comprising aspects such
as movement, speed and
stillness in facial
expression and body
language
Spatial
comprising aspects such
as proximity, direction,
position of layout and
organization of objects in
space.
A multimodal text
can be paper – such
as books, comics,
posters.
A multimodal text can
be digital – from slide
presentations,
virtual museums, e-books,
blogs, e-posters, web pages,
and social media, through to
animation, fi lm and video
games.
A multimodal text can
be live – a performance
or an event.
And, a multimodal text can
be transmedia– where the story is told
using ‘multiple delivery
channels’ through a combination of
media platforms, for example, book,
comic, magazine, fi lm, web series, and
video game mediums all working as
part of the same story.