City Research Online

The voice, text, and the visual as semiotic companions: an analysis of the materiality and meaning potential of multimodal screen feedback

Tyrer, C. ORCID: 0000-0001-7720-6523 (2021). The voice, text, and the visual as semiotic companions: an analysis of the materiality and meaning potential of multimodal screen feedback. Education and Information Technologies, 26(4), pp. 4241-4260. doi: 10.1007/s10639-021-10455-w


The gap between how learners interpret and act upon feedback has been widely documented in the research literature. What is less certain is the extent to which the modality and materiality of the feedback influence students’ and teachers’ perceptions. This article explores the semiotic potential of multimodal screen feedback to enhance written feedback. Guided by an “Inquiry Graphics” approach, situated within a semiotic theory of learning edusemiotic conceptual framework, constructions of meaning in relation to screencasting feedback were analysed to determine how and whether it could be incorporated into existing feedback practices. Semi-structured video elicitation interviews with student teachers were used to incorporate both micro and macro levels of analysis. The findings suggested that the relationship between the auditory, visual and textual elements in multimodal screen feedback enriched the feedback process, highlighting the importance of form in addition to content to aid understanding of written feedback. The constitutive role of design and material artefacts in feedback practices in initial teacher training pertinent to these findings is also discussed.

Publication Type: Article
Additional Information: This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit
Publisher Keywords: Multimodal feedback, Semiotics, Inquirygraphics, Design, Sociomaterial, Digital artefacts
Subjects: H Social Sciences > HM Sociology
L Education > LB Theory and practice of education > LB2300 Higher Education
Departments: Professional Services > Learning, Enhancement and Development
SWORD Depositor:
[thumbnail of The voice text and the visual as semiotic companions.pdf]
Text - Published Version
Available under License Creative Commons: Attribution International Public License 4.0.

Download (919kB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login