City Research Online

Neurosymbolic Reasoning and Learning with Restricted Boltzmann Machines

Tran, S. N. & Garcez, A. (2023). Neurosymbolic Reasoning and Learning with Restricted Boltzmann Machines. In: Williams, B., Chen, Y. & Neville, J. (Eds.), Proceedings of the AAAI Conference on Artificial Intelligence. 37th AAAI Conference on Artificial Intelligence, 7-14 Feb 2023, Washington, D.C., USA. doi: 10.1609/aaai.v37i5.25806

Abstract

Knowledge representation and reasoning in neural networks has been a long-standing endeavour which has attracted much attention recently. The principled integration of reasoning and learning in neural networks is a main objective of the area of neurosymbolic Artificial Intelligence. In this paper, a neurosymbolic system is introduced that can represent any propositional logic formula. A proof of equivalence is presented showing that energy minimization in restricted Boltzmann machines corresponds to logical reasoning. We demonstrate the application of our approach empirically on logical reasoning and learning from data and knowledge. Experimental results show that reasoning can be performed effectively for a class of logical formulae. Learning from data and knowledge is also evaluated in comparison with learning of logic programs using neural networks. The results show that our approach can improve on state-of-the-art neurosymbolic systems. The theorems and empirical results presented in this paper are expected to reignite the research on the use of neural networks as massively-parallel models for logical reasoning and promote the principled integration of reasoning and learning in deep networks.

Publication Type: Conference or Workshop Item (Paper)
Publisher Keywords: KRR: Other Foundations of Knowledge Representation & Reasoning, KRR: Applications, ML: Deep Neural Architectures, ML: Relational Learning, ML: Transparent, Interpretable, Explainable ML
Subjects: H Social Sciences > HN Social history and conditions. Social problems. Social reform
Q Science > QA Mathematics > QA75 Electronic computers. Computer science
R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry
Departments: School of Science & Technology
School of Science & Technology > Computer Science
SWORD Depositor:
[thumbnail of LBMv4 (2).pdf]
Preview
Text - Accepted Version
Download (1MB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login