Would enforcing dimensional homogeneity during training—rather than just at initialization—prevent models from learning spurious correlations?

Your question asks about a constraint from physics—dimensional homogeneity (the requirement that all terms in an equation have the same units)—applied as a regularizer during neural network training to prevent spurious correlations.

This is a clever idea, but the provided preprints don't directly address it. They explore related territory:

What they do cover:

[AG-2026.02-849] and [AG-2026.01-998] discuss symmetry reduction and symmetry breaking in transformers, showing that eliminating redundant degrees of freedom can improve training and interpretability. This is philosophically adjacent—both approaches use structural constraints to filter out noise—but neither invokes dimensional analysis.

[AG-2024.01-576] identifies weak correlations between parameter gradients as the mechanism that linearizes neural network dynamics during training, which could be relevant to understanding how constraints propagate through learning, but doesn't address dimensional homogeneity explicitly.

[AG-2025.10-750] studies how weight distributions remain approximately Gaussian throughout training under certain conditions, which touches on what structure persists during learning, but again doesn't examine dimensional constraints.

The gap:

Whether enforcing dimensional homogeneity *during* training (not just at init) suppresses spurious correlations is an open question in this archive.