TY - JOUR
T1 - Morphological classification of radio galaxies: Capsule networks versus convolutional neural networks
AU - Lukic, V.
AU - Brüggen, Marcus
AU - Mingo, B.
AU - Croston, J. H.
AU - Kasieczka, G.
AU - Best, P. N.
N1 - © 2019 The Author(s) Published by Oxford University Press on behalf of the Royal Astronomical Society.
PY - 2019/8/1
Y1 - 2019/8/1
N2 - Next-generation radio surveys will yield an unprecedented amount of data, warranting analysis by use of machine learning techniques. Convolutional neural networks are the deep learning technique that has proven to be the most successful in classifying image data. Capsule networks are a more recently developed technique that use capsules comprised of groups of neurons that describe properties of an image including the relative spatial locations of features. This work explores the performance of different capsule network architectures against simpler convolutional neural network architectures, in reproducing the classifications into the classes of unresolved, FRI, and FRII morphologies. We utilize images from a LOFAR survey which is the deepest, wide-area radio survey to date, revealing more complex radio-source structures compared to previous surveys, presenting further challenges for machine learning algorithms. The four- and eight-layer convolutional networks attain an average precision of 93.3 per cent and 94.3 per cent, respectively, compared to 89.7 per cent obtained with the capsule network, when training on original and augmented images. Implementing transfer learning achieves a precision of 94.4 per cent, which is within the confidence interval of the eight-layer convolutional network. The convolutional networks always outperform any variation of the capsule network, as they prove to be more robust to the presence of noise in images. The use of pooling appears to allow more freedom for the intra-class variability of radio galaxy morphologies, as well as reducing the impact of noise.
AB - Next-generation radio surveys will yield an unprecedented amount of data, warranting analysis by use of machine learning techniques. Convolutional neural networks are the deep learning technique that has proven to be the most successful in classifying image data. Capsule networks are a more recently developed technique that use capsules comprised of groups of neurons that describe properties of an image including the relative spatial locations of features. This work explores the performance of different capsule network architectures against simpler convolutional neural network architectures, in reproducing the classifications into the classes of unresolved, FRI, and FRII morphologies. We utilize images from a LOFAR survey which is the deepest, wide-area radio survey to date, revealing more complex radio-source structures compared to previous surveys, presenting further challenges for machine learning algorithms. The four- and eight-layer convolutional networks attain an average precision of 93.3 per cent and 94.3 per cent, respectively, compared to 89.7 per cent obtained with the capsule network, when training on original and augmented images. Implementing transfer learning achieves a precision of 94.4 per cent, which is within the confidence interval of the eight-layer convolutional network. The convolutional networks always outperform any variation of the capsule network, as they prove to be more robust to the presence of noise in images. The use of pooling appears to allow more freedom for the intra-class variability of radio galaxy morphologies, as well as reducing the impact of noise.
KW - instrumentation: miscellaneous
KW - methods: data analysis, surveys
KW - methods: miscellaneous
KW - radio continuum: galaxies
KW - radio continuum: general
UR - http://www.scopus.com/inward/record.url?scp=85075256717&partnerID=8YFLogxK
U2 - 10.1093/mnras/stz1289
DO - 10.1093/mnras/stz1289
M3 - Article
AN - SCOPUS:85075256717
SN - 0035-8711
VL - 487
SP - 1729
EP - 1744
JO - Monthly Notices of the Royal Astronomical Society
JF - Monthly Notices of the Royal Astronomical Society
IS - 2
ER -