City Research Online

ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation

Rondao, D. ORCID: 0000-0001-9438-0267, Aouf, N. ORCID: 0000-0001-9291-4077 & Richardson, M. A. (2023). ChiNet: Deep Recurrent Convolutional Learning for Multimodal Spacecraft Pose Estimation. IEEE Transactions on Aerospace and Electronic Systems, 59(2), pp. 937-949. doi: 10.1109/taes.2022.3193085


This article presents an innovative deep learning pipeline, which estimates the relative pose of a spacecraft by incorporating the temporal information from a rendezvous sequence. It leverages the performance of long short-term memory units in modeling sequences of data for the processing of features extracted by a convolutional neural network (CNN) backbone. Three distinct training strategies, which follow a coarse-to-fine funneled approach, are combined to facilitate feature learning and improve end-to-end pose estimation by regression. The capability of CNNs to autonomously ascertain feature representations from images is exploited to fuse thermal infrared data with electrooptical red-green-blue inputs, thus mitigating the effects of artifacts from imaging space objects in the visible wavelength. Each contribution of the proposed framework, dubbed ChiNet, is demonstrated on a synthetic dataset, and the complete pipeline is validated on experimental data.

Publication Type: Article
Additional Information: © 2024 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Subjects: Q Science > QA Mathematics > QA75 Electronic computers. Computer science
T Technology > TL Motor vehicles. Aeronautics. Astronautics
Departments: School of Science & Technology
School of Science & Technology > Engineering
SWORD Depositor:
[thumbnail of ChiNet_deep_recurrent_convolutional_learning-2022.pdf]
Text - Accepted Version
Download (1MB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login