Could learned surrogates ever completely replace traditional solvers, or do they fundamentally need periodic recalibration?

This is a great question that cuts to the heart of whether machine learning can eventually become fully autonomous in scientific computing.

The short answer from these papers: learned surrogates need periodic retraining, but not necessarily constant recalibration. The distinction matters.

The Case for Loop-Based Retraining

The clearest example comes from gravitational wave detector design [AG-2025.11-530]. The authors explicitly build a feedback loop: they train a neural surrogate of the physics simulator Finesse, use it to propose new candidate designs, then *verify those designs with the slow simulator itself* and feed those results back into retraining. This isn't a one-time calibration—it's an iterative cycle. The key insight is that this approach is still vastly faster than running the slow simulator millions of times, because the neural net does the heavy lifting of exploration.

Similarly, in quantum circuit optimization [AG-2024.04-1499], a classical surrogate (a fast CPU/GPU state vector simulator) is used to guide optimization of a quantum processor, but the actual quantum hardware or exact simulator validates key steps. The surrogate accelerates; validation prevents drift.

Why Complete Replacement Fails

Two fundamental reasons emerge from the papers:

1. Distribution shift. In jet tagging [AG-2025.11-1399], the authors show that even sophisticated generative surrogates can *unphysically exaggerate* performance when they diverge from the true data distribution. Without periodic grounding in real data or exact simulators, surrogates can confidently extrapolate into nonsense.

2. Hyperparameter fragility. Black hole merger surrogates [AG-2025.01-653] demonstrate that neural network accuracy depends sensitively on architecture, hyperparameters, and training set size. The authors propose a "systematic optimization strategy" to navigate this, but this requires *iterative validation* against the exact numerical relativity simulation to ensure the network hasn't drifted in performance.

The Practical Sweet Spot

What emerges across these applications is a human-in-the-loop hybrid workflow: use the surrogate for rapid exploration and design iteration, but periodically (not constantly) validate against the gold-standard simulator. The validation is expensive but selective—you're not replacing the surrogate; you're spot-checking it and retraining when needed.

In quantum networks [AG-2024.07-2351], for instance, surrogates eliminate the need to run thousands of slow network simulations, but the algorithm still trusts the exact function for final validation before deployment.

The Open Question

None of these papers directly address whether surrogates could *eventually* be accurate enough to run unsupervised for months or years without revalidation. What they show is that today's approach requires periodic recalibration—not because neural nets are fundamentally limited, but because we don't yet have ways to certify that a surrogate won't drift outside its training distribution during autonomous exploration.