The special issue of Statistics and Computing dedicated to probabilistic numerics carries the article “A modern retrospective on probabilistic numerics” by Chris Oates and myself, which gives a historical overview of the field and some perspectives on future challenges.
C. J. Oates and T. J. Sullivan. “A modern retrospective on probabilistic numerics.” Statistics and Computing 29(6):1335–1351, 2019.
Abstract. This article attempts to place the emergence of probabilistic numerics as a mathematical–statistical research field within its historical context and to explore how its gradual development can be related both to applications and to a modern formal treatment. We highlight in particular the parallel contributions of Sul′din and Larkin in the 1960s and how their pioneering early ideas have reached a degree of maturity in the intervening period, mediated by paradigms such as average-case analysis and information-based complexity. We provide a subjective assessment of the state of research in probabilistic numerics and highlight some difficulties to be addressed by future works.
The special issue of Statistics and Computing dedicated to probabilistic numerics carries the article “Strong convergence rates of probabilistic integrators for ODEs” by Han Cheng Lie, Andrew Stuart, and myself on the convergence analysis of randomised perturbation-based time-stepping methods for the solution of ODE initial value problems.
H. C. Lie, A. M. Stuart, and T. J. Sullivan. “Strong convergence rates of probabilistic integrators for ordinary differential equations.” Statistics and Computing 29(6):1265–1283, 2019.
Abstract. Probabilistic integration of a continuous dynamical system is a way of systematically introducing discretisation error, at scales no larger than errors introduced by standard numerical discretisation, in order to enable thorough exploration of possible responses of the system to inputs. It is thus a potentially useful approach in a number of applications such as forward uncertainty quantification, inverse problems, and data assimilation. We extend the convergence analysis of probabilistic integrators for deterministic ordinary differential equations, as proposed by Conrad et al. (2016), to establish mean-square convergence in the uniform norm on discrete- or continuous-time solutions under relaxed regularity assumptions on the driving vector fields and their induced flows. Specifically, we show that randomised high-order integrators for globally Lipschitz flows and randomised Euler integrators for dissipative vector fields with polynomially bounded local Lipschitz constants all have the same mean-square convergence rate as their deterministic counterparts, provided that the variance of the integration noise is not of higher order than the corresponding deterministic integrator. These and similar results are proven for probabilistic integrators where the random perturbations may be state-dependent, non-Gaussian, or non-centred random variables.
It is a great pleasure to announce that a special issue of Statistics and Computing (vol. 29, no. 6) dedicated to the theme of probabilistic numerics is now fully available online in print. This special issue, edited by Mark Girolami, Ilse Ipsen, Chris Oates, Art Owen, and myself, accompanies the 2018 Workshop on Probabilistic Numerics held at the Alan Turing Institute in London.
The special issue consists of a short editorial and ten full-length peer-reviewed research articles:
- “De-noising by thresholding operator adapted wavelets” by G. R. Yoo and H. Owhadi
- “Optimal Monte Carlo integration on closed manifolds” by M. Ehler, M. Gräf, and C. J. Oates
- “Fast automatic Bayesian cubature using lattice sampling” by R. Jagadeeswaran and F. J. Hickernell
- “Symmetry exploits for Bayesian cubature methods” by T. Karvonen, S. Särkkä, and C. J. Oates
- “Probabilistic linear solvers: a unifying view” by S. Bartels, J. Cockayne, I. C. F. Ipsen, and P. Hennig
- “Strong convergence rates of probabilistic integrators for ordinary differential equations” by H. C. Lie, A. M. Stuart, and T. J. Sullivan
- “Adaptive step-size selection for state-space based probabilistic differential equation solvers” by O. A. Chkrebtii and D. A. Campbell
- “Probabilistic solutions to ordinary differential equations as non-linear Bayesian filtering: A new perspective” by F. Tronarp, H. Kersting, S. Särkkä, and P. Hennig
- “On the positivity and magnitudes of Bayesian quadrature weights” by T. Karvonen, M. Kanagawa, and S. Särkkä
- “A modern retrospective on probabilistic numerics” by C. J. Oates and T. J. Sullivan