City Research Online

Audience evaluations of news videos made with various levels of automation: A population-based survey experiment

Thurman, N. ORCID: 0000-0003-3909-9565, Stares, S. ORCID: 0000-0003-4697-0347 & Koliska, M. (2024). Audience evaluations of news videos made with various levels of automation: A population-based survey experiment. Journalism, doi: 10.1177/14648849241243189


The use of automation in news content creation is expanding from the written to the audio-visual medium with news organizations including Reuters turning to video automation services provided by companies such as Wibbitz. Although researchers have explored audience perceptions of text-based news automation, to date no published study has examined how news consumers perceive automated news videos. We conducted a between-subjects online survey experiment to compare how a socio-demographically representative sample ( n = 4200) of online news consumers in the UK perceived human-made, partly automated, and highly automated short-form online news videos on 14 different story topics. Our findings show that human-made videos received on average more favourable responses on some evaluation variables, although the differences were not large. We also found some significant differences in the relative evaluation of automated and human-made news videos across different individual stories. For practitioners our results suggest partly automated news videos with post-automation human editing can be well received. For researchers our results show the need to use reasonably large sets of experimental stimuli, and suggest that ensuring socio-demographic variation within samples of respondents is worthwhile.

Publication Type: Article
Publisher Keywords: AI, audience, automated journalism, news videos, perception, reception study, survey experiment, video automation
Subjects: H Social Sciences > HM Sociology
H Social Sciences > HN Social history and conditions. Social problems. Social reform
P Language and Literature > PN Literature (General)
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Policy & Global Affairs
School of Policy & Global Affairs > Sociology & Criminology
School of Communication & Creativity
School of Communication & Creativity > Journalism
SWORD Depositor:
[thumbnail of thurman-et-al-2024-audience-evaluations-of-news-videos-made-with-various-levels-of-automation-a-population-based-survey.pdf]
Text - Published Version
Available under License Creative Commons Attribution Non-commercial.

Download (2MB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login