Speaker
Description
Laplacian operators drive the physics-informed training of neural PDE solvers, where exact second derivatives cost time and memory growing quadratically with the input dimension d. The Stochastic Taylor Derivative Estimator (STDE) replaces the Hessian trace by an average of N second directional derivatives, each from one Taylor-mode forward pass. We characterise STDE along three axes. Scalability: the dense Hessian of a multilayer perceptron exceeds 8 GB at d = 5.1e4, whereas STDE reaches d = 1.6e6 within 3.2 GB, with cost linear in d, orders of magnitude below exact evaluation, and sparse directions three to eight times cheaper than Hutchinson probes at equal accuracy. Variance: the estimator is unbiased for sparse and dense directions; its variance, computed from the Hessian, predicts the measured dispersion within 4% with no fitted parameter, and analytic test functions at d = 1e6 confirm the 1/sqrt(N) law with relative errors from 1e-7 to 1e-1 depending on how the directions match the Hessian structure. Fault tolerance: when worker processes are killed at Weibull-distributed times, the pooled estimate stays unbiased and its scatter follows the surviving-sample fraction through sqrt(1/|A| - 1/N), with an observed-to-predicted ratio of 1.06. STDE is a practical Laplacian primitive for failure-prone compute environments.