City Research Online

Large Language Models as Oracles for Ontology Alignment

Lushnei, S., Shumskyi, D., Shykula, S. , Jiménez-Ruiz, E. ORCID: 0000-0002-9083-4599 & d'Avila Garcez, A. (2026). Large Language Models as Oracles for Ontology Alignment. Paper presented at the The 19th Conference of the European Chapter of the Association for Computational Linguistics (EACL), 24-29 Mar 2026, Rabat, Morocco.

Abstract

There are many methods and systems to tackle the ontology alignment problem, yet a major challenge persists in producing high-quality mappings among a set of input ontologies. Adopting a human-in-the-loop approach during the alignment process has become essential in applications requiring very accurate mappings. However, user involvement is expensive
when dealing with large ontologies. In this paper, we analyse the feasibility of using Large Language Models (LLM) to aid the ontology alignment problem. LLMs are used only in the validation of a subset of correspondences for which there is high uncertainty. We have conducted an extensive analysis over several tasks of the Ontology Alignment Evaluation Initiative (OAEI), reporting in this paper the performance of several state-of-the-art LLMs using different prompt templates. Using LLMs as Oracles resulted in strong performance in the OAEI 2025, achieving the top-2 overall rank in the bio-ml track.

Publication Type: Conference or Workshop Item (Paper)
Additional Information: ACL materials are Copyright © 1963–2026 ACL. Materials are licensed on a Creative Commons Attribution 4.0 International License.
Publisher Keywords: ontology matching, large language models, LLM, OAEI, knowledge graphs, knowledge graph alignment
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
Departments: School of Science & Technology
School of Science & Technology > Department of Computer Science
SWORD Depositor:
[thumbnail of EACL_2026_LLMs_Oracles_Ontology_Alignment.pdf]
Preview
Text - Accepted Version
Download (5MB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login