Multimodal Texts

Kelli McGraw defines multimodal texts as, "A text may be defined as multimodal when it combines two or more semiotic systems." and she adds, "Multimodal texts can be delivered via different media or technologies. They may be live, paper, or digital electronic."

She lists five semiotic systems (from her article)


 * 1) Linguistic: comprising aspects such as vocabulary, generic structure and the grammar of oral and written language
 * 2) Visual: comprising aspects such as colour, vectors and viewpoint in still and moving images
 * 3) Audio: comprising aspects such as volume, pitch and rhythm of music and sound effects
 * 4) Gestural: comprising aspects such as movement, speed and stillness in facial expression and body language
 * 5) Spatial: comprising aspects such as proximity, direction, position of layout and organisation of objects in space.

Examples of multimodal texts are:


 * a picture book, in which the textual and visual elements are arranged on individual pages that contribute to an overall set of bound pages


 * a webpage, in which elements such as sound effects, oral language, written language, music and still or moving images are combined


 * a live ballet performance, in which gesture, music, and space are the main elements.

REFERENCES