Robustness of Neural Networks for CMB Polarization Foreground Removal

Abstract

The detection of Cosmic Microwave Background primordial $B$-mode polarization would constitute a ``smoking gun" signal of primordial gravitational waves. However, this measurement requires accurate removal of polarized Galactic foregrounds to avoid systematic biases when estimating the tensor-to-scalar ratio. Methods based on Machine Learning techniques (ML), such as Convolutional Neural Networks (CNNs), have recently been proposed as alternative foreground cleaning techniques, but their applicability to real data relies on their ability to generalize beyond the models assumed during training. In this work, we focus on a variety of foreground models (FMs) used for training and conduct a systematic study of the generalization properties of a CNN-based method. We train various CNN architectures on simulations generated from different Galactic FMs, and test their performance on models not used during the training. By characterizing the statistical properties of the FMs using variance, skewness, and Shannon entropy, we define a statistical complexity hierarchy among them. We show that training on the more complex FMs reduces bias and improves precision when testing on unseen FMs, whereas training on the simplest model could introduce systematic errors. These results evidence that a lack of generalization is a relevant source of systematic uncertainty, and emphasize the importance of understanding the impact of the models assumed during training in ML-based methods before applying them to real data.