Symbolic Knowledge Extraction and Distillation into Convolutional Neural Networks to Improve Medical Image Classification
Ngan, K. H., Phelan, J., Townsend, J. & Garcez, A. D. ORCID: 0000-0001-7375-9518 (2024). Symbolic Knowledge Extraction and Distillation into Convolutional Neural Networks to Improve Medical Image Classification. In: 2024 International Joint Conference on Neural Networks (IJCNN). 2024 International Joint Conference on Neural Networks (IJCNN), 30 Jun - 5 Jul 2024, Yokohama, Japan. doi: 10.1109/ijcnn60899.2024.10650683
Abstract
Convolutional Neural Networks (CNNs) have achieved outstanding performance in radiology tasks. However, CNNs lack the transparency and explainability necessary to enable their practical clinical adoption. This paper introduces a neural-symbolic approach allowing domain experts to intervene in the training of CNNs. Following extraction and expert validation of meaningful symbolic knowledge from a trained CNN, such knowledge is distilled back into a streamlined CNN. The approach is shown to enhance user control over conventional CNN training by combining interpretable symbolic representations into a simplified CNN, allowing domain experts to control the decision making process. The kernels in a given CNN layer are mapped to symbolic knowledge representations in the form of logic programming rules. Extracted knowledge is evaluated against known radiomics features, allowing doctors to decide based on best practice which kernels to keep or reject. Expert intervention takes place through relevant knowledge distillation back into a more compact CNN. Our results show that a student CNN can learn successfully even from multiple teachers (different knowledge-bases) to replicate the selected relevant kernels and corresponding classification results. The proposed approach delivers a trainable parameter reduction of at least 56.3% while achieving high cosine similarity for kernel replication and a fidelity score of 99.2%. Expert validation highlights the importance of this approach at fostering greater trust in AI-driven medical decision making.
Publication Type: | Conference or Workshop Item (Paper) |
---|---|
Additional Information: | © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. |
Publisher Keywords: | Training, Decision making, Process control, Back, Radiology, Feature extraction, Convolutional neural networks |
Subjects: | Q Science > QA Mathematics > QA75 Electronic computers. Computer science R Medicine > RC Internal medicine |
Departments: | School of Science & Technology School of Science & Technology > Computer Science |
SWORD Depositor: |
Download (16MB) | Preview
Export
Downloads
Downloads per month over past year