Why does binary attention structure better suppress combinatorial noise than continuous learned weights?

I appreciate the specificity of your question, but I need to be direct: the provided preprints don't actually address why binary attention structures suppress combinatorial noise better than continuous learned weights.

Here's what I found instead:

The closest match is [AG-2025.11-1573], which investigates *why* the Particle Transformer exhibits sparse, nearly binary attention patterns in jet physics. The paper shows that binary sparsity emerges from the attention mechanism itself rather than from auxiliary structures—but it doesn't explain the noise-suppression mechanism you're asking about, nor does it compare this to continuous weight learning.

[AG-2026.01-998] touches on interpretability improvements from symmetry-breaking in attention, but frames the benefit in terms of optimizer efficiency and semantic amplification, not noise suppression.

The quantum attention papers ([AG-2024.03-1440], [AG-2024.01-1910], [AG-2024.05-2209]) demonstrate robustness in noisy environments, but don't theoretically compare discrete vs. continuous attention weights in terms of combinatorial noise.

To answer your question rigorously, I'd need papers that directly analyze the noise landscape of discrete-choice attention versus continuous softmax weights—perhaps using information-theoretic or statistical physics tools. Do you have access to preprints on attention sparsity theory, or was this question prompted by a specific result you encountered elsewhere?