References#
Harold Abelson, Gerald Jay Sussman, and Julie Sussman. Structure and Interpretation of Computer Programs. MIT Press, Cambridge, Massachusetts, 2 edition, 1996. ISBN 978-0-262-51087-5.
Robert A. Adams and John J. F. Fournier. Sobolev Spaces. Volume 140 of Pure and Applied Mathematics. Elsevier/Academic Press, Amsterdam, 2 edition, 2003. ISBN 978-0-12-044143-3.
Robert J. Adler and Jonathan E. Taylor. Random Fields and Geometry. Springer Monographs in Mathematics. Springer, New York, 2007. doi:10.1007/978-0-387-48116-6.
Alen Alexanderian. Optimal experimental design for infinite-dimensional Bayesian inverse problems governed by PDEs: a review. Inverse Problems, 37(4):043001, 2021. doi:10.1088/1361-6420/abe10c.
Christophe Andrieu, Arnaud Doucet, and Roman Holenstein. Particle Markov chain Monte Carlo methods. Journal of the Royal Statistical Society: Series B, 72(3):269–342, 2010. doi:10.1111/j.1467-9868.2009.00736.x.
Leonardo S. Bastos and Anthony O'Hagan. Diagnostics for Gaussian process emulators. Technometrics, 51(4):425–438, 2009. doi:10.1198/TECH.2009.08019.
Simon Batzner, Albert Musaelian, Lixin Sun, Mario Geiger, Jonathan P. Mailoa, Mordechai Kornbluth, Nicola Molinari, Tess E. Smidt, and Boris Kozinsky. E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials. Nature Communications, 13:2453, 2022. doi:10.1038/s41467-022-29939-5.
Albert S. Berahas, Jorge Nocedal, and Martin Takáč. A multi-batch L-BFGS method for machine learning. In Advances in Neural Information Processing Systems, volume 29, 1055–1063. Curran Associates, Inc., 2016. URL: https://proceedings.neurips.cc/paper/2016/hash/8ebda540cbcc4d7336496819a46a1b68-Abstract.html.
Michael Betancourt. A conceptual introduction to Hamiltonian Monte Carlo. 2017. URL: https://arxiv.org/abs/1701.02434, arXiv:1701.02434, doi:10.48550/arXiv.1701.02434.
Michael Betancourt and Mark Girolami. Hamiltonian Monte Carlo for hierarchical models. In Satyanshu K. Upadhyay, Umesh Singh, Dipak K. Dey, and Appaia Loganathan, editors, Current Trends in Bayesian Methodology with Applications, pages 79–101. Chapman and Hall/CRC, 2015. doi:10.1201/b18502-5.
Wolfgang Betz, Iason Papaioannou, and Daniel Straub. Numerical methods for the discretization of random fields by means of the Karhunen–Loève expansion. Computer Methods in Applied Mechanics and Engineering, 271:109–129, 2014. doi:10.1016/j.cma.2013.12.010.
Nicola Beume, Boris Naujoks, and Michael Emmerich. SMS-EMOA: multiobjective selection based on dominated hypervolume. European Journal of Operational Research, 181(3):1653–1669, 2007. doi:10.1016/j.ejor.2006.08.008.
Ilias Bilionis. orthojax: orthogonal bases in JAX. Python package, version 0.1.5, 2024. URL: https://pypi.org/project/orthojax/0.1.5/.
Ilias Bilionis. Introduction to Scientific Machine Learning for Engineering Students. World Scientific, first edition, 2026. ISBN 9789819832484. Forthcoming.
Ilias Bilionis, Nicholas Zabaras, Bledar A. Konomi, and Guang Lin. Multi-output separable Gaussian process: towards an efficient, fully Bayesian paradigm for uncertainty quantification. Journal of Computational Physics, 241:212–239, 2013. doi:10.1016/j.jcp.2013.01.011.
Christopher M. Bishop. Pattern Recognition and Machine Learning. Information Science and Statistics. Springer, New York, first edition, 2006. ISBN 978-0-387-31073-2. URL: https://link.springer.com/book/9780387310732.
Géraud Blatman and Bruno Sudret. Adaptive sparse polynomial chaos expansion based on least angle regression. Journal of Computational Physics, 230(6):2345–2367, 2011. doi:10.1016/j.jcp.2010.12.021.
David M. Blei, Alp Kucukelbir, and Jon D. McAuliffe. Variational inference: a review for statisticians. Journal of the American Statistical Association, 112(518):859–877, 2017. doi:10.1080/01621459.2017.1285773.
Steven L. Brunton and J. Nathan Kutz. Data-Driven Science and Engineering: Machine Learning, Dynamical Systems, and Control. Cambridge University Press, 2019. doi:10.1017/9781108380690.
Steven L. Brunton, Joshua L. Proctor, and J. Nathan Kutz. Discovering governing equations from data by sparse identification of nonlinear dynamical systems. Proceedings of the National Academy of Sciences, 113(15):3932–3937, 2016. doi:10.1073/pnas.1517384113.
Jenný Brynjarsdóttir and Anthony O'Hagan. Learning about physical parameters: the importance of model discrepancy. Inverse Problems, 30(11):114007, 2014. doi:10.1088/0266-5611/30/11/114007.
Alberto Cabezas, Adrien Corenflos, Junpeng Lao, Rémi Louf, Antoine Carnec, Kaustubh Chaudhari, Reuben Cohn-Gordon, Jeremie Coullon, Wei Deng, Sam Duffield, Gerardo Durán-Martín, Marcin Elantkowski, Dan Foreman-Mackey, Michele Gregori, Carlos Iguaran, Ravin Kumar, Martin Lysy, Kevin Murphy, Juan Camilo Orduz, Karm Patel, Xi Wang, and Rob Zinkov. BlackJAX: composable Bayesian inference in JAX. 2024. URL: https://arxiv.org/abs/2402.10797, arXiv:2402.10797, doi:10.48550/arXiv.2402.10797.
Olivier Cappé, Eric Moulines, and Tobias Rydén. Inference in Hidden Markov Models. Springer, 2005. doi:10.1007/0-387-28982-8.
Alex D. Casey, Steven F. Son, Ilias Bilionis, and Brian C. Barnes. Prediction of energetic material properties from electronic structure using 3D convolutional neural networks. Journal of Chemical Information and Modeling, 60(10):4457–4473, 2020. doi:10.1021/acs.jcim.0c00259.
Ricky T. Q. Chen, Yulia Rubanova, Jesse Bettencourt, and David Duvenaud. Neural ordinary differential equations. Advances in Neural Information Processing Systems, 2018. URL: https://proceedings.neurips.cc/paper/2018/hash/69386f6bb1dfed68692a24c8686939b9-Abstract.html.
Tianping Chen and Hong Chen. Universal approximation to nonlinear operators by neural networks with arbitrary activation functions and its application to dynamical systems. IEEE Transactions on Neural Networks, 6(4):911–917, July 1995. doi:10.1109/72.392253.
Hyungjin Chung, Jeongsol Kim, Michael T. McCann, Marc L. Klasky, and Jong Chul Ye. Diffusion posterior sampling for general noisy inverse problems. In The Eleventh International Conference on Learning Representations. 2023. URL: https://openreview.net/forum?id=OnD9zGAGT0k.
Taco Cohen and Max Welling. Group equivariant convolutional networks. In Proceedings of the 33rd International Conference on Machine Learning, volume 48 of Proceedings of Machine Learning Research, 2990–2999. PMLR, 2016. URL: https://proceedings.mlr.press/v48/cohenc16.html.
Simon L. Cotter, Masoumeh Dashti, and Andrew M. Stuart. Approximation of Bayesian inverse problems for PDEs. SIAM Journal on Numerical Analysis, 48(1):322–345, 2010. doi:10.1137/090770734.
Chris Cremer, Xuechen Li, and David Duvenaud. Inference suboptimality in variational autoencoders. In Proceedings of the 35th International Conference on Machine Learning, volume 80 of Proceedings of Machine Learning Research, 1078–1086. PMLR, 2018. URL: https://proceedings.mlr.press/v80/cremer18a.html.
Andreas C. Damianou and Neil D. Lawrence. Deep Gaussian processes. In Proceedings of the Sixteenth International Conference on Artificial Intelligence and Statistics, volume 31 of Proceedings of Machine Learning Research, 207–215. 2013. URL: https://proceedings.mlr.press/v31/damianou13a.html.
Bernard Delyon, Marc Lavielle, and Eric Moulines. Convergence of a stochastic approximation version of the EM algorithm. The Annals of Statistics, 27(1):94–128, 1999. doi:10.1214/aos/1018031103.
Arthur P. Dempster, Nan M. Laird, and Donald B. Rubin. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society: Series B, 39(1):1–38, 1977. doi:10.1111/j.2517-6161.1977.tb01600.x.
Arnaud Doucet, Nando de Freitas, and Neil Gordon, editors. Sequential Monte Carlo Methods in Practice. Springer, 2001. doi:10.1007/978-1-4757-3437-9.
John Duchi, Elad Hazan, and Yoram Singer. Adaptive subgradient methods for online learning and stochastic optimization. Journal of Machine Learning Research, 12(61):2121–2159, 2011. URL: https://jmlr.org/papers/v12/duchi11a.html.
Albert Einstein. Über die von der molekularkinetischen theorie der wärme geforderte bewegung von in ruhenden flüssigkeiten suspendierten teilchen. Annalen der Physik, 322(8):549–560, 1905. doi:10.1002/andp.19053220806.
Michael T. M. Emmerich, André H. Deutz, and Jan Willem Klinkenberg. Hypervolume-based expected improvement: monotonicity properties and exact computation. In 2011 IEEE Congress of Evolutionary Computation, 2147–2154. IEEE, 2011. doi:10.1109/CEC.2011.5949880.
Torsten A. Enßlin, Mona Frommert, and Francisco S. Kitaura. Information field theory for cosmological perturbation reconstruction and nonlinear signal analysis. Physical Review D, 80(10):105005, 2009. doi:10.1103/PhysRevD.80.105005.
Robert Eymard, Thierry Gallou"et, and Raphaële Herbin. Finite volume methods. In Solution of Equation in R$^n$ (Part 3), Techniques of Scientific Computing (Part 3), volume 7 of Handbook of Numerical Analysis, pages 713–1020. Elsevier, 2000. doi:10.1016/S1570-8659(00)07005-8.
Peter I. Frazier, Warren B. Powell, and Savas Dayanik. The knowledge-gradient policy for correlated normal beliefs. INFORMS Journal on Computing, 21(4):599–613, 2009. doi:10.1287/ijoc.1080.0314.
Walter Gautschi. Algorithm 726: ORTHPOL—a package of routines for generating orthogonal polynomials and Gauss-type quadrature rules. ACM Transactions on Mathematical Software, 20(1):21–62, 1994. doi:10.1145/174603.174605.
Mario Geiger and Tess Smidt. E3nn: euclidean neural networks. 2022. URL: https://arxiv.org/abs/2207.09453, arXiv:2207.09453, doi:10.48550/arXiv.2207.09453.
Alan E. Gelfand and Adrian F. M. Smith. Sampling-based approaches to calculating marginal densities. Journal of the American Statistical Association, 85(410):398–409, 1990. doi:10.1080/01621459.1990.10476213.
Andrew Gelman, John B. Carlin, Hal S. Stern, David B. Dunson, Aki Vehtari, and Donald B. Rubin. Bayesian Data Analysis. Chapman and Hall/CRC, 3 edition, 2013. doi:10.1201/b16018.
Andrew Gelman and Donald B. Rubin. Inference from iterative simulation using multiple sequences. Statistical Science, 7(4):457–472, 1992. doi:10.1214/ss/1177011136.
Xavier Glorot and Yoshua Bengio. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the Thirteenth International Conference on Artificial Intelligence and Statistics, volume 9 of Proceedings of Machine Learning Research, 249–256. PMLR, 2010. URL: https://proceedings.mlr.press/v9/glorot10a.html.
Ian Goodfellow, Yoshua Bengio, and Aaron Courville. Deep Learning. MIT Press, 2016. URL: https://www.deeplearningbook.org/.
Neil J. Gordon, David J. Salmond, and Adrian F. M. Smith. Novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE Proceedings F: Radar and Signal Processing, 140(2):107–113, 1993.
Jerrad Hampton and Alireza Doostan. Basis adaptive sample efficient polynomial chaos (BASE-PC). Journal of Computational Physics, 371:20–49, 2018. doi:10.1016/j.jcp.2018.03.035.
Atharva Hans, Sayantan Bhattacharya, Ilias Bilionis, and Pavlos P. Vlachos. Stochastic volumetric reconstruction. In Proceedings of the 15th International Symposium on Particle Image Velocimetry. San Diego, California, 2023. URL: https://scholarworks.calstate.edu/downloads/c247f068s.
W. K. Hastings. Monte Carlo sampling methods using Markov chains and their applications. Biometrika, 57(1):97–109, 1970. doi:10.1093/biomet/57.1.97.
Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. Delving deep into rectifiers: surpassing human-level performance on ImageNet classification. In Proceedings of the IEEE International Conference on Computer Vision, 1026–1034. 2015. doi:10.1109/ICCV.2015.123.
James Hensman, Nicolò Fusi, and Neil D. Lawrence. Gaussian processes for big data. In Proceedings of the Twenty-Ninth Conference on Uncertainty in Artificial Intelligence, 282–290. AUAI Press, 2013. URL: https://auai.org/uai2013/prints/papers/244.pdf.
James Hensman, Alexander G. de G. Matthews, and Zoubin Ghahramani. Scalable variational Gaussian process classification. In Proceedings of the Eighteenth International Conference on Artificial Intelligence and Statistics, volume 38 of Proceedings of Machine Learning Research, 351–360. 2015. URL: https://proceedings.mlr.press/v38/hensman15.html.
Jon Herman and Will Usher. SALib: an open-source python library for sensitivity analysis. Journal of Open Source Software, 2(9):97, 2017. doi:10.21105/joss.00097.
Geoffrey E. Hinton, Nitish Srivastava, and Kevin Swersky. Neural networks for machine learning: lecture 6e, RMSProp: divide the gradient by a running average of its recent magnitude. Coursera course lecture slides, 2012. URL: https://www.cs.toronto.edu/~hinton/coursera/lecture6/lec6.pdf.
Matthew D. Hoffman, David M. Blei, Chong Wang, and John Paisley. Stochastic variational inference. Journal of Machine Learning Research, 14(40):1303–1347, 2013. URL: https://jmlr.org/papers/v14/hoffman13a.html.
Matthew D. Hoffman and Andrew Gelman. The No-U-Turn sampler: adaptively setting path lengths in Hamiltonian Monte Carlo. Journal of Machine Learning Research, 15:1593–1623, 2014. URL: https://jmlr.org/papers/v15/hoffman14a.html.
Toshimitsu Homma and Andrea Saltelli. Importance measures in global sensitivity analysis of nonlinear models. Reliability Engineering & System Safety, 52(1):1–17, 1996. doi:10.1016/0951-8320(96)00002-6.
Takuya Iwanaga, William Usher, and Jonathan Herman. Toward SALib 2.0: advancing the accessibility and interpretability of global sensitivity analyses. Socio-Environmental Systems Modelling, 4:18155, 2022. doi:10.18174/sesmo.18155.
Robert A. Jacobs. Increased rates of convergence through learning rate adaptation. Neural Networks, 1(4):295–307, 1988. doi:10.1016/0893-6080(88)90003-2.
Harold Jeffreys. An invariant form for the prior probability in estimation problems. Proceedings of the Royal Society of London. Series A, 186(1007):453–461, 1946. doi:10.1098/rspa.1946.0056.
Stephen Joe and Frances Y. Kuo. Constructing Sobol' sequences with better two-dimensional projections. SIAM Journal on Scientific Computing, 30(5):2635–2654, 2008. doi:10.1137/070709359.
Kaitlyn E. Johnson, Grant Howard, William Mo, Michael K. Strasser, Ernesto A. B. F. Lima, Sui Huang, and Amy Brock. Cancer cell population growth kinetics at low densities deviate from the exponential growth model and suggest an Allee effect. PLOS Biology, 17(8):e3000399, 2019. doi:10.1371/journal.pbio.3000399.
Donald R. Jones, Matthias Schonlau, and William J. Welch. Efficient global optimization of expensive black-box functions. Journal of Global Optimization, 13(4):455–492, 1998. doi:10.1023/A:1008306431147.
Jari Kaipio and Erkki Somersalo. Statistical and Computational Inverse Problems. Springer, 2005. doi:10.1007/b138659.
Jari P. Kaipio and Erkki Somersalo. Statistical inverse problems: discretization, model reduction and inverse crimes. Journal of Computational and Applied Mathematics, 198(2):493–504, 2007. doi:10.1016/j.cam.2005.09.027.
Sharmila Karumuri and Ilias Bilionis. Learning to solve Bayesian inverse problems: an amortized variational inference approach using Gaussian and flow guides. Journal of Computational Physics, 511:113117, 2024. doi:10.1016/j.jcp.2024.113117.
Sharmila Karumuri, Zachary D. McClure, Alejandro Strachan, Michael Titus, and Ilias Bilionis. Hierarchical Bayesian approach to experimental data fusion: application to strength prediction of high entropy alloys from hardness measurements. Computational Materials Science, 217:111851, 2023. doi:10.1016/j.commatsci.2022.111851.
I. Katsounaros, M. Dortsiou, C. Polatides, S. Preston, T. Kypraios, and G. Kyriacou. Reaction pathways in the electrochemical reduction of nitrate on tin. Electrochimica Acta, 71:270–276, 2012. doi:10.1016/j.electacta.2012.03.154.
Marc C. Kennedy and Anthony O'Hagan. Predicting the output from a complex computer code when fast approximations are available. Biometrika, 87(1):1–13, 2000. doi:10.1093/biomet/87.1.1.
Marc C. Kennedy and Anthony O'Hagan. Bayesian calibration of computer models. Journal of the Royal Statistical Society: Series B (Statistical Methodology), 63(3):425–464, 2001. doi:10.1111/1467-9868.00294.
Patrick Kidger. On Neural Differential Equations. PhD thesis, University of Oxford, 2021. doi:10.5287/ora-r5kybrozr.
Diederik P. Kingma and Jimmy Ba. Adam: a method for stochastic optimization. In International Conference on Learning Representations. 2015. URL: https://arxiv.org/abs/1412.6980.
Diederik P. Kingma and Max Welling. Auto-encoding variational Bayes. In International Conference on Learning Representations. 2014. URL: https://arxiv.org/abs/1312.6114, doi:10.48550/arXiv.1312.6114.
Peter E. Kloeden and Eckhard Platen. Numerical Solution of Stochastic Differential Equations. Springer, 1992. doi:10.1007/978-3-662-12616-5.
Nikola Kovachki, Zongyi Li, Burigede Liu, Kamyar Azizzadenesheli, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar. Neural operator: learning maps between function spaces with applications to PDEs. Journal of Machine Learning Research, 24(89):1–97, 2023. URL: https://jmlr.org/papers/v24/21-1524.html.
Erwin Kreyszig. Introductory Functional Analysis with Applications. John Wiley & Sons, New York, 1978. ISBN 978-0-471-50459-7.
Alp Kucukelbir, Dustin Tran, Rajesh Ranganath, Andrew Gelman, and David M. Blei. Automatic differentiation variational inference. Journal of Machine Learning Research, 18(14):1–45, 2017. URL: https://jmlr.org/papers/v18/16-107.html.
Loïc Le Gratiet and Josselin Garnier. Recursive co-kriging model for design of computer experiments with multiple levels of fidelity. International Journal for Uncertainty Quantification, 4(5):365–386, 2014. doi:10.1615/Int.J.UncertaintyQuantification.2014006914.
Zongyi Li, Nikola Kovachki, Kamyar Azizzadenesheli, Burigede Liu, Kaushik Bhattacharya, Andrew Stuart, and Anima Anandkumar. Fourier neural operator for parametric partial differential equations. In International Conference on Learning Representations. 2021. URL: https://openreview.net/forum?id=c8P9NQVtmnO.
Zongyi Li, Hongkai Zheng, Nikola Kovachki, David Jin, Haoxuan Chen, Burigede Liu, Kamyar Azizzadenesheli, and Anima Anandkumar. Physics-informed neural operator for learning partial differential equations. arXiv preprint arXiv:2111.03794, 2021. URL: https://arxiv.org/abs/2111.03794, doi:10.48550/arXiv.2111.03794.
William A. Link and Mitchell J. Eaton. On thinning of chains in MCMC. Methods in Ecology and Evolution, 3(1):112–115, 2012. doi:10.1111/j.2041-210X.2011.00131.x.
Zicheng Liu, Dominique Lesselier, Bruno Sudret, and Joe Wiart. Surrogate modeling based on resampled polynomial chaos expansions. Reliability Engineering & System Safety, 202:107008, 2020. doi:10.1016/j.ress.2020.107008.
Gabriel J. Lord, Catherine E. Powell, and Tony Shardlow. An Introduction to Computational Stochastic PDEs. Cambridge Texts in Applied Mathematics. Cambridge University Press, 2014. doi:10.1017/CBO9781139017329.
Dimitrios Loukrezis, Armin Galetzka, and Herbert De Gersem. Robust adaptive least squares polynomial chaos expansions in high-frequency applications. International Journal of Numerical Modelling: Electronic Networks, Devices and Fields, 33(6):e2725, 2020. doi:10.1002/jnm.2725.
Lu Lu. DeepONet: learning nonlinear operators. Zenodo, December 2020. Software, version 1.0.0. URL: https://doi.org/10.5281/zenodo.4319385, doi:10.5281/zenodo.4319385.
Lu Lu, Pengzhan Jin, Guofei Pang, Zhongqiang Zhang, and George Em Karniadakis. Learning nonlinear operators via DeepONet based on the universal approximation theorem of operators. Nature Machine Intelligence, 3(3):218–229, 2021. doi:10.1038/s42256-021-00302-5.
David J. C. MacKay. Information-based objective functions for active data selection. Neural Computation, 4(4):590–604, 1992. doi:10.1162/neco.1992.4.4.590.
Nicholas Metropolis, Arianna W. Rosenbluth, Marshall N. Rosenbluth, Augusta H. Teller, and Edward Teller. Equation of state calculations by fast computing machines. The Journal of Chemical Physics, 21(6):1087–1092, 1953. doi:10.1063/1.1699114.
Anna M. Michalak and Peter K. Kitanidis. A method for enforcing parameter nonnegativity in Bayesian inverse problems with an application to contaminant source identification. Water Resources Research, 39(2):1033, 2003. doi:10.1029/2002WR001480.
Radford M. Neal. Slice sampling. The Annals of Statistics, 31(3):705–767, 2003. doi:10.1214/aos/1056562461.
Radford M. Neal. MCMC using Hamiltonian dynamics. In Steve Brooks, Andrew Gelman, Galin L. Jones, and Xiao-Li Meng, editors, Handbook of Markov Chain Monte Carlo, pages 113–162. Chapman and Hall/CRC, 2011. doi:10.1201/b10905-6.
Jorge Nocedal and Stephen J. Wright. Numerical Optimization. Springer Series in Operations Research and Financial Engineering. Springer, New York, 2 edition, 2006. doi:10.1007/978-0-387-40065-5.
Art B. Owen. Scrambling Sobol' and Niederreiter–Xing points. Journal of Complexity, 14(4):466–489, 1998. doi:10.1006/jcom.1998.0487.
Piyush Pandita, Ilias Bilionis, Jitesh H. Panchal, B. P. Gautham, Amol Joshi, and Pramod Zagade. Stochastic multiobjective optimization on a budget: application to multipass wire drawing with quantified uncertainties. International Journal for Uncertainty Quantification, 8(3):233–249, 2018. doi:10.1615/Int.J.UncertaintyQuantification.2018021315.
Benjamin Peherstorfer, Karen Willcox, and Max Gunzburger. Survey of multifidelity methods in uncertainty propagation, inference, and optimization. SIAM Review, 60(3):550–591, 2018. doi:10.1137/16M1082469.
Paris Perdikaris, Maziar Raissi, Andreas Damianou, Neil D. Lawrence, and George Em Karniadakis. Nonlinear information fusion algorithms for data-efficient multi-fidelity modelling. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 473(2198):20160751, 2017. doi:10.1098/rspa.2016.0751.
Paris Perdikaris, Daniele Venturi, Johannes O. Royset, and George E. Karniadakis. Multi-fidelity modelling via recursive co-kriging and Gaussian–Markov random fields. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 471(2179):20150018, 2015. doi:10.1098/rspa.2015.0018.
Du Phan, Neeraj Pradhan, and Martin Jankowiak. Composable effects for flexible and accelerated probabilistic programming in NumPyro. 2019. URL: https://arxiv.org/abs/1912.11554, arXiv:1912.11554, doi:10.48550/arXiv.1912.11554.
Thomas Pinder and Daniel Dodd. GPJax: a gaussian process framework in JAX. Journal of Open Source Software, 7(75):4455, 2022. doi:10.21105/joss.04455.
Nasim Rahaman, Aristide Baratin, Devansh Arpit, Felix Draxler, Min Lin, Fred Hamprecht, Yoshua Bengio, and Aaron Courville. On the spectral bias of neural networks. In Proceedings of the 36th International Conference on Machine Learning, volume 97 of Proceedings of Machine Learning Research, 5301–5310. PMLR, 2019. URL: https://proceedings.mlr.press/v97/rahaman19a.html.
Maziar Raissi, Paris Perdikaris, and George Em Karniadakis. Physics-informed neural networks: a deep learning framework for solving forward and inverse problems involving nonlinear partial differential equations. Journal of Computational Physics, 378:686–707, 2019. doi:10.1016/j.jcp.2018.10.045.
Carl Edward Rasmussen and Christopher K. I. Williams. Gaussian Processes for Machine Learning. MIT Press, Cambridge, MA, 2006. ISBN 9780262182539. doi:10.7551/mitpress/3206.001.0001.
Andreas Raue, Clemens Kreutz, Thomas Maiwald, Julie Bachmann, Marcel Schilling, Ursula Klingmüller, and Jens Timmer. Structural and practical identifiability analysis of partially observed dynamical models by exploiting the profile likelihood. Bioinformatics, 25(15):1923–1929, 2009. doi:10.1093/bioinformatics/btp358.
Gareth O. Roberts and Richard L. Tweedie. Exponential convergence of Langevin distributions and their discrete approximations. Bernoulli, 2(4):341–363, 1996. doi:10.2307/3318418.
Murray Rosenblatt. Remarks on a multivariate transformation. The Annals of Mathematical Statistics, 23(3):470–472, 1952. doi:10.1214/aoms/1177729394.
Donald B. Rubin. Estimation in parallel randomized experiments. Journal of Educational Statistics, 6(4):377–401, 1981. doi:10.3102/10769986006004377.
Abhijit Sahu, Dionysios Aliprantis, and Ilias Bilionis. Quantification and propagation of uncertainty in the magnetic characteristic of steel and permanent magnets of a synchronous machine drive. IEEE Transactions on Energy Conversion, 35(4):1926–1934, 2020. doi:10.1109/TEC.2020.2998142.
Andrea Saltelli. Making best use of model evaluations to compute sensitivity indices. Computer Physics Communications, 145(2):280–297, 2002. doi:10.1016/S0010-4655(02)00280-1.
Andrea Saltelli, Paola Annoni, Ivano Azzini, Francesca Campolongo, Marco Ratto, and Stefano Tarantola. Variance based sensitivity analysis of model output. Design and estimator for the total sensitivity index. Computer Physics Communications, 181(2):259–270, 2010. doi:10.1016/j.cpc.2009.09.018.
Robert H. Shumway and David S. Stoffer. An approach to time series smoothing and forecasting using the EM algorithm. Journal of Time Series Analysis, 3(4):253–264, 1982. doi:10.1111/j.1467-9892.1982.tb00349.x.
Sergey A. Smolyak. Quadrature and interpolation formulas for tensor products of certain classes of functions. Soviet Mathematics Doklady, 4:240–243, 1963.
Ilya M. Sobol. Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates. Mathematics and Computers in Simulation, 55(1–3):271–280, 2001. doi:10.1016/S0378-4754(00)00270-6.
Vivek Sree, Xiaoxu Zhong, Ilias Bilionis, Arezoo Ardekani, and Adrian Buganza Tepole. Optimizing autoinjector devices using physics-based simulations and Gaussian processes. Journal of the Mechanical Behavior of Biomedical Materials, 140:105695, 2023. doi:10.1016/j.jmbbm.2023.105695.
Andrew M. Stuart. Inverse problems: a Bayesian perspective. Acta Numerica, 19:451–559, 2010. doi:10.1017/S0962492910000061.
Shengyang Sun, Jiaxin Shi, Andrew Gordon Wilson, and Roger B. Grosse. Scalable variational Gaussian processes via harmonic kernel decomposition. In Marina Meila and Tong Zhang, editors, Proceedings of the 38th International Conference on Machine Learning, volume 139 of Proceedings of Machine Learning Research, 9955–9965. PMLR, 2021. URL: https://proceedings.mlr.press/v139/sun21d.html.
Ilya Sutskever, James Martens, George Dahl, and Geoffrey Hinton. On the importance of initialization and momentum in deep learning. In Proceedings of the 30th International Conference on Machine Learning, volume 28 of Proceedings of Machine Learning Research, 1139–1147. PMLR, 2013. URL: https://proceedings.mlr.press/v28/sutskever13.html.
Matthew Tancik, Pratul P. Srinivasan, Ben Mildenhall, Sara Fridovich-Keil, Nithin Raghavan, Utkarsh Singhal, Ravi Ramamoorthi, Jonathan T. Barron, and Ren Ng. Fourier features let networks learn high frequency functions in low dimensional domains. In Advances in Neural Information Processing Systems, volume 33, 7537–7547. Curran Associates, Inc., 2020. URL: https://proceedings.neurips.cc/paper/2020/hash/55053683268957697aa39fba6f231c68-Abstract.html.
Luke Tierney and Joseph B. Kadane. Accurate approximations for posterior moments and marginal densities. Journal of the American Statistical Association, 81(393):82–86, 1986. doi:10.1080/01621459.1986.10478240.
Michalis K. Titsias. Variational learning of inducing variables in sparse Gaussian processes. In Proceedings of the Twelfth International Conference on Artificial Intelligence and Statistics, volume 5 of Proceedings of Machine Learning Research, 567–574. 2009. URL: https://proceedings.mlr.press/v5/titsias09a.html.
Panagiotis Tsilifis, Ilias Bilionis, Ioannis Katsounaros, and Nicholas Zabaras. Computationally efficient variational approximations for Bayesian inverse problems. Journal of Verification, Validation and Uncertainty Quantification, 1(3):031004, 2016. doi:10.1115/1.4034102.
Oldrich Vasicek. An equilibrium characterization of the term structure. Journal of Financial Economics, 5(2):177–188, 1977. doi:10.1016/0304-405X(77)90016-2.
Aki Vehtari, Andrew Gelman, Daniel Simpson, Bob Carpenter, and Paul-Christian Bürkner. Rank-normalization, folding, and localization: an improved $\widehat R$ for assessing convergence of MCMC. Bayesian Analysis, 16(2):667–718, 2021. doi:10.1214/20-BA1221.
Pauli Virtanen and others. SciPy 1.0: fundamental algorithms for scientific computing in Python. Nature Methods, 17:261–272, 2020. doi:10.1038/s41592-019-0686-2.
Xiaoliang Wan and George Em Karniadakis. An adaptive multi-element generalized polynomial chaos method for stochastic differential equations. Journal of Computational Physics, 209(2):617–642, 2005. doi:10.1016/j.jcp.2005.03.023.
Sifan Wang, Shyam Sankaran, and Paris Perdikaris. Respecting causality for training physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 421:116813, 2024. doi:10.1016/j.cma.2024.116813.
Sifan Wang, Shyam Sankaran, Hanwen Wang, and Paris Perdikaris. An expert's guide to training physics-informed neural networks. arXiv preprint arXiv:2308.08468, 2023. URL: https://arxiv.org/abs/2308.08468, doi:10.48550/arXiv.2308.08468.
Sifan Wang, Yujun Teng, and Paris Perdikaris. Understanding and mitigating gradient flow pathologies in physics-informed neural networks. SIAM Journal on Scientific Computing, 43(5):A3055–A3081, 2021. doi:10.1137/20M1318043.
Sifan Wang, Hanwen Wang, and Paris Perdikaris. On the eigenvector bias of fourier feature networks: from regression to solving multi-scale PDEs with physics-informed neural networks. Computer Methods in Applied Mechanics and Engineering, 384:113938, 2021. doi:10.1016/j.cma.2021.113938.
Ziqi Wang, Marco Broccardo, and Junho Song. Hamiltonian Monte Carlo methods for subset simulation in reliability analysis. Structural Safety, 76:51–67, 2019. doi:10.1016/j.strusafe.2018.05.005.
Greg C. G. Wei and Martin A. Tanner. A Monte Carlo implementation of the EM algorithm and the poor man's data augmentation algorithms. Journal of the American Statistical Association, 85(411):699–704, 1990. doi:10.1080/01621459.1990.10474930.
Norbert Wiener. Differential-space. Journal of Mathematics and Physics, 2(1–4):131–174, 1923. doi:10.1002/sapm192321131.
C. F. Jeff Wu. On the convergence properties of the EM algorithm. The Annals of Statistics, 11(1):95–103, 1983. doi:10.1214/aos/1176346060.
Dongbin Xiu and George Em Karniadakis. The Wiener–Askey polynomial chaos for stochastic differential equations. SIAM Journal on Scientific Computing, 24(2):619–644, 2002. doi:10.1137/S1064827501387826.
Liu Yang, Xuhui Meng, and George Em Karniadakis. B-PINNs: bayesian physics-informed neural networks for forward and inverse PDE problems with noisy data. Journal of Computational Physics, 425:109913, 2021. doi:10.1016/j.jcp.2020.109913.
Manzil Zaheer, Satwik Kottur, Siamak Ravanbakhsh, Barnabás Póczos, Ruslan R. Salakhutdinov, and Alexander J. Smola. Deep sets. In Advances in Neural Information Processing Systems, volume 30, 3391–3401. Curran Associates, Inc., 2017. URL: https://papers.nips.cc/paper/2017/hash/f22e4747da1aa27e363d86d40ff442fe-Abstract.html.
Xiaoxu Zhong, Ilias Bilionis, and Arezoo M. Ardekani. A framework to optimize spring-driven autoinjectors. International Journal of Pharmaceutics, 617:121588, 2022. doi:10.1016/j.ijpharm.2022.121588.
Bernt Øksendal. Stochastic Differential Equations: An Introduction with Applications. Springer, 6 edition, 2003. doi:10.1007/978-3-642-14394-6.
Federal Reserve Bank of St. Louis. FRED: federal reserve economic data. Data portal, n.d. Accessed 2026-09-20. URL: https://fred.stlouisfed.org/.
Predictive Science Laboratory. DAX: dynamical systems in JAX. Software repository, n.d. Accessed 2026-09-20. URL: PredictiveScienceLab/dax.