Multimodal
Communication situation or not?
material regularities (pixels with colors, images, and ink on paper, written
language/numbers)
community of users (where, postal senders)
shared knowledge/interpretation scheme (numbers indicate value or representation
of handwashing)
Analysis
Usually, we need 3 aspects:
Multimodal 1
, the semiotic modes (expressive forms)
the communicative situation
genre
So for the semiotic modes: spatial arrangement (if we talk about the subway or people's
position in a theater as a canvas), spoken/written language, moving images, sound,
music, animation, title, colors, figures, layout, graphics, diagrams, logos, the
combination of the modes, shapes/forms, typography, bare code - they create meaning
together, not separately, a submode of a photo could be the arrangement of objects in
it/perspective - subjective/objective
So for the communicative situation/canvas:
extra-diegetic, externalized, distance VS. diegetic, immersed, involved:
static or dynamic? → representation in time
2D or 3D? → representation in space
permanent or fleeting (skipping slides, conversations)? → transience
observer or participant? → role
canvas:
linear - the text in this case tries its hardest just to appear as a linear string
of items, reading/listening
micro-ergodic - composition (ikea flyer), not a fixed way of achieving the
composition pag 115
immutable ergodic - both 2D and 3D micro-ergodic materials to participate
(online catalog, Wikipedia page)
mutable ergodic - reader/viewer/user/player may themselves alter the
organization or content of the text, f2f interactions
Multimodal 2
Communication situation or not?
material regularities (pixels with colors, images, and ink on paper, written
language/numbers)
community of users (where, postal senders)
shared knowledge/interpretation scheme (numbers indicate value or representation
of handwashing)
Analysis
Usually, we need 3 aspects:
Multimodal 1
, the semiotic modes (expressive forms)
the communicative situation
genre
So for the semiotic modes: spatial arrangement (if we talk about the subway or people's
position in a theater as a canvas), spoken/written language, moving images, sound,
music, animation, title, colors, figures, layout, graphics, diagrams, logos, the
combination of the modes, shapes/forms, typography, bare code - they create meaning
together, not separately, a submode of a photo could be the arrangement of objects in
it/perspective - subjective/objective
So for the communicative situation/canvas:
extra-diegetic, externalized, distance VS. diegetic, immersed, involved:
static or dynamic? → representation in time
2D or 3D? → representation in space
permanent or fleeting (skipping slides, conversations)? → transience
observer or participant? → role
canvas:
linear - the text in this case tries its hardest just to appear as a linear string
of items, reading/listening
micro-ergodic - composition (ikea flyer), not a fixed way of achieving the
composition pag 115
immutable ergodic - both 2D and 3D micro-ergodic materials to participate
(online catalog, Wikipedia page)
mutable ergodic - reader/viewer/user/player may themselves alter the
organization or content of the text, f2f interactions
Multimodal 2
