City Research Online

The News Feed is not a Black Box: A Longitudinal Study of Facebook’s Algorithmic Treatment of News

McNally, N. & Bastos, M. ORCID: 0000-0003-0480-1078 (2025). The News Feed is not a Black Box: A Longitudinal Study of Facebook’s Algorithmic Treatment of News. Digital Journalism, doi: 10.1080/21670811.2025.2450623

Abstract

This study examines the effects of a series of significant algorithm changes within Facebook’s News Feed on user engagement with news content on the platform between 2011-2020. By tracking public announcements, industry research, and leaks to the press, we constructed a timeline of algorithm changes and collected data on 1 million news articles from The Guardian over the 10-year period, alongside their associated Facebook engagement metrics (likes, comments, shares, etc.) using the CrowdTangle API. Using time series analysis techniques including cross-correlation, Granger causality, and anomaly detection, we modeled this data to test for the relationship between significant algorithmic ranking updates to Facebook’s News Feed algorithms and user engagement with Guardian articles on the platform. Our results show that strategic interventions to the News Feed algorithm significantly impacted engagement with hard news items, whereas opinion, lifestyle, sports, and arts content were less affected. This study challenges the notion of algorithms as ‘black boxes’ by demonstrating how Facebook’s deliberate adjustments influence user engagement with news content. We conclude by outlining the limitations and challenges for systemic auditing of social media algorithms, advocating for greater data access, and discussing the opportunities afforded by the EU’s Digital Services Act to advance this research agenda.

Publication Type: Article
Additional Information: This is an Accepted Manuscript of an article that will be published by Taylor & Francis in Digital Journalism, available at: www.tandfonline.com/journals/rdij20
Publisher Keywords: Algorithms, Facebook, News, Guardian, News Feed, Strategic Interventions
Subjects: H Social Sciences > H Social Sciences (General)
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Communication & Creativity
School of Communication & Creativity > Media, Culture & Creative Industries
SWORD Depositor:
[thumbnail of The News Feed is not a Blackbox.pdf] Text - Accepted Version
This document is not freely accessible due to copyright restrictions.

To request a copy, please use the button below.

Request a copy

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login