How does simulation-based inference avoid the polynomial explosion problem that traditional bump hunts face?

How Simulation-Based Inference Sidesteps the Polynomial Explosion

A traditional "bump hunt" in particle physics works by binning data into histograms and looking for anomalous excesses. The problem: as detector resolution improves and you add more observables (energy, angle, momentum, etc.), the number of bins explodes exponentially—a phenomenon called the curse of dimensionality. You quickly run out of events to fill the bins meaningfully.

Simulation-based inference (SBI) avoids this by flipping the inference problem around [AG-2024.07-1503]. Instead of asking "what does the data look like in observable space?" it asks "given these observed events, what model parameters would produce them?" The key insight is that you train a neural network directly on the relationship between model parameters and simulated data, bypassing the need to construct explicit high-dimensional histograms.

Here's the concrete win: at the LHC, when detector resolution is poor and you cannot reliably reconstruct a simple high-level observable (like a diphoton mass), a traditional bump hunt fails. But SBI methods use the full, low-level features of events—raw detector measurements in high dimensions—to infer which parameter values are consistent with the data [AG-2024.07-1503]. The network learns to compress all that information without binning, so dimensionality is no longer a bottleneck.

For global analyses combining multiple processes simultaneously, SBI again outperforms traditional histogram-based methods because it extracts information from unbinned, high-dimensional event features in a unified framework [AG-2025.09-1245]. You're not fighting exponential bin proliferation; you're using neural density estimation to learn the posterior distribution over parameters directly.

When simulators themselves are expensive (many forward-model evaluations needed), multilevel techniques further reduce computational cost by smartly combining cheap approximate simulations with expensive accurate ones [AG-2025.06-087], ensuring you spend your simulation budget where it matters most.

The archives provided don't directly explain the mathematical basis of why polynomial explosion is avoided—only that SBI empirically does so—so I'd recommend looking for work on curse-of-dimensionality in neural density estimation if you want the deeper theory.