Why does latent-space compression retain discovery power for unseen signal types beyond training scenarios?

This is a thoughtful question, but it sits at the boundary of what the archive directly addresses. Let me unpack what these preprints do tell us about latent-space generalization.

What the archive shows about latent-space robustness

The key insight comes from understanding *how* latent spaces organize themselves. When a variational autoencoder (VAE) or tensor-network model compresses data, it doesn't just randomly squash everything—it learns the underlying *structure* [AG-2025.04-1387]. Symmetries in the data cause the latent space to self-organize along a reduced set of meaningful directions, effectively capturing what physicists call "intrinsic dimensionality." This matters because: if the compressed representation captures the true generative structure (symmetries, constraints) rather than surface patterns, it can extrapolate to unseen data.

For cosmological data, this principle has been directly tested. A conditional VAE trained on standard cosmology successfully reconstructs power spectra even for "beyond-ΛCDM scenarios" under parameter extrapolation—cases not in the training set [AG-2025.10-1676]. The latent space learns a physically meaningful geometry that mirrors actual cosmological parameters and their degeneracies, not just memorized examples.

More generally, deep networks appear to learn in two distinct phases: rapid curve-fitting followed by slower *compression or coarse-graining* [AG-2025.04-1127]. The second phase involves "principled forgetting"—stripping away non-essential details—which the paper argues is critical for generalization. This suggests that latent spaces that emerge from genuine compression may generalize precisely *because* they've discarded noise and learned only the essential correlations.

The limits of what we know

However, your question asks specifically about *why* compression retains discovery power for signal types entirely outside the training regime. The provided preprints demonstrate *that* it happens and offer mechanistic clues (symmetry alignment, two-phase learning, correlation structure), but they don't provide a formal theory predicting *when* or *how far* this generalization should extend. The archive covers frontier machine learning and compression, but doesn't directly address extrapolation to truly novel signal classes.