Does the model learn different sparse patterns when trained on different particle physics tasks or datasets?

This is a great question about whether neural networks learn task-specific or universal patterns in particle physics—but the preprints provided don't directly address it.

The closest relevant result is that the Particle Transformer exhibits *sparse, nearly binary attention patterns* across multiple benchmark datasets [AG-2025.11-1573], suggesting some consistency in learned structure. However, that paper focuses on *why* sparsity emerges (from the attention mechanism itself), not whether different tasks learn fundamentally different sparse patterns.

The other preprints compare model architectures (DNNs vs. GNNs) on different classification tasks [AG-2024.11-1157, AG-2024.02-1203] or explore latent space representations across theories [AG-2024.07-1501], but none systematically investigate whether the *same model trained on jet tagging, anomaly detection, and parameter estimation* develops task-specific versus shared sparsity patterns.

To properly answer your question, you'd want papers that:

• Train identical architectures on 3+ distinct particle physics tasks
• Directly compare the learned sparse connectivity or attention weights
• Show whether certain subnetworks or attention heads specialize vs. generalize

The archive doesn't quite have that comparison yet.