Modeling Fast Diffusion Processes in Time Integration of Stiff Stochastic Differential Equations

Expand
  • 1. Department of Mathematics and Statistics, Auburn University, 221 Parker Hall, Auburn, AL, 36849, USA;
    2. Sandia National Laboratories, P. O. Box 969, Livermore, CA, 94551, USA

Received date: 2021-09-26

  Revised date: 2022-01-23

  Online published: 2022-09-26

Supported by

The authors acknowledge technical discussions with Prof. Mauro Valorani from Sapienza University of Rome, that helped with the development of ideas. This work was partially supported by the Simons Foundation (Collaboration Grants for Mathematicians No. 419717), and by the US Department of Energy (DOE), Office of Basic Energy Sciences (BES) Division of Chemical Sciences, Geosciences, and Biosciences. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology and Engineering Solutions of Sandia, LLC., a wholly owned subsidiary of Honeywell International, Inc., for the U.S. Department of Energy's National Nuclear Security Administration under contract DE-NA-0003525. This paper describes objective technical results and analysis. Any subjective views or opinions that might be expressed in the paper do not necessarily represent the views of the U.S. Department of Energy or the United States Government.

Abstract

Numerical algorithms for stiff stochastic differential equations are developed using linear approximations of the fast diffusion processes, under the assumption of decoupling between fast and slow processes. Three numerical schemes are proposed, all of which are based on the linearized formulation albeit with different degrees of approximation. The schemes are of comparable complexity to the classical explicit Euler-Maruyama scheme but can achieve better accuracy at larger time steps in stiff systems. Convergence analysis is conducted for one of the schemes, that shows it to have a strong convergence order of 1/2 and a weak convergence order of 1. Approximations arriving at the other two schemes are discussed. Numerical experiments are carried out to examine the convergence of the schemes proposed on model problems.

Cite this article

Xiaoying Han, Habib N. Najm . Modeling Fast Diffusion Processes in Time Integration of Stiff Stochastic Differential Equations[J]. Communications on Applied Mathematics and Computation, 2022 , 4(4) : 1457 -1493 . DOI: 10.1007/s42967-022-00188-z

References

1. Abdulle, A.:Explicit methods for stiff stochastic differential equations. In:Engquist, B., Runborg, O., Tsai, Y.-H.R. (eds) Numerical Analysis of Multiscale Computations, pp. 1-22. Springer, Berlin Heidelberg (2012)
2. Abdulle, A., Li, T.:S-ROCK methods for stiff Itô SDEs. Commun. Math. Sci. 6, 845-868 (2008)
3. Ahn, T.H., Sandu, A., Han, X.:Implicit simulation methods for stochastic chemical kinetics. J. Appl. Anal. Comput. 5, 420-452 (2015)
4. Arnold, L.:Stochastic Differetial Equations:Theory and Applications. Wiley, USA (1974)
5. Bunker, D.L., Garrett, B., Kleindienst, T., Long, G.S.:Discrete simulation methods in combustion kinetics. Combust. Flame 23, 373-379 (1974)
6. Cao, Y., Gillespie, D.T., Petzold, L.R.:Accelerated stochastic simulation of the stiff enzyme-substrate reaction. J. Chem. Phys. 123, 144917 (2005)
7. Cao, Y., Gillespie, D.T., Petzold, L.R.:The slow-scale stochastic simulation algorithm. J. Chem. Phys. 122, 014116 (2005)
8. Cao, Y., Petzold, L.R., Rathinam, M., Gillespie, D.T.:The numerical stability of leaping methods for stochastic simulation of chemically reacting systems. J. Chem. Phys. 121, 12169-12178 (2004)
9. Contou-Carrere, M.N., Daoutidis, P.:Decoupling of fast and slow variables in chemical Langevin equations with fast and slow reactions. In:2006 American Control Conference, pp. 6, IEEE, USA (2006)
10. Gillespie, D.:A general method for numerically simulating the stochastic time evolution of coupled chemical reactions. J. Comput. Phys. 22, 403-434 (1976)
11. Gillespie, D.:Exact stochastic simulation of coupled chemical reactions. J. Phys. Chem. 81, 2340-2361 (1977)
12. Gillespie, D.T.:The chemical Langevin equation. J. Chem. Phys. 113, 297-306 (2000)
13. Gillespie, D.T.:Approximate accelerated stochastic simulation of chemically reacting systems. J. Chem. Phys. 115, 1716-1734 (2001)
14. Gillespie, D.T.:The chemical Langevin and Fokker-Planck equations for the reversible isomerization reaction. J. Phys. Chem. A 106, 5063-5071 (2002)
15. Gillespie, D.T.:Stochastic simulation of chemical kinetics. Annu. Rev. Phys. Chem. 58, 35-55 (2007)
16. Goussis, D.A., Valorani, M., Creta, F., Najm, H.N.:Inertial manifolds with CSP. in:Bathe, K. (ed) Computational Fluid and Solid Mechanics 2003, volume 2, pp. 1951-1954. Elsevier Science, Cambridge, MA (2003)
17. Goussis, D.A.:Quasi steady state and partial equilibrium approximations:their relation and their validity. Combust. Theor. Model. 16, 869-926 (2012)
18. Goutsias, J.:Quasiequilibrium approximation of fast reaction kinetics in stochastic biochemical systems. J. Chem. Phys. 122, 184102 (2005)
19. Guo, Q., Liu, W., Mao, X., Yue, R.:The truncated Milstein method for stochastic differential equations with commutative noise. J. Comput. Appl. Math. 338, 298-310 (2018)
20. Hadjinicolaou, M., Goussis, D.A.:Asymptotic solutions of stiff PDEs with the CSP method:the reaction-diffusion equation. SIAM J. Sci. Comput. 20, 781-810 (1999)
21. Han, X., Valorani, M., Najm, H.:Explicit time integration of the stiff chemical Langevin equations using computational singular perturbation. J. Chem. Phys. 150, 194101 (2019)
22. Haseltine, E.L., Rawlings, J.B.:Approximate simulation of coupled fast and slow reactions for stochastic chemical kinetics. J. Chem. Phys. 117, 6959-6969 (2002)
23. Higham, D.J.:Modeling and simulating chemical reactions. SIAM Rev. 50, 347-368 (2008)
24. Higham, D., Khanin, R.:Chemical master versus chemical Langevin for first-order reaction networks. Open Appl. Math. J. 2, 59-79 (2008)
25. Higham, D.J., Mao, X., Stuart, A.M.:Strong convergence of Euler-type methods for nonlinear stochastic differential equations. SIAM J. Numer. Anal. 40, 1041-1063 (2002)
26. Hu, Y.:Semi-implicit Euler-Maruyama scheme for stiff stochastic equations. In:Körezliouglu, H., Oksendal, B., Üstünel, A.S. (eds) Stochastic Analysis and Related Topics V, pp. 183-202. Birkhäuser Boston, Boston, MA (1996)
27. Hu, L., Li, X., Mao, X.:Convergence rate and stability of the truncated Euler-Maruyama method for stochastic differential equations. J. Comput. Appl. Math. 337, 274-289 (2018)
28. Kim, J.K., Josić, K., Bennett, M.R.:The validity of quasi-steady-state approximations in discrete stochastic simulations. Biophys. J. 107, 783-793 (2014)
29. Kloeden, P.E., Platen, E.:Numerical Solution of Stochastic Differential Equations. Applications of Mathematics (New York), vol. 23. Springer-Verlag, Berlin (1992)
30. Kloeden, P., Neuenkirch, A.:Convergence of numerical methods for stochastic differential equations in mathematical finance. In:Gerstner, T., Kloeden, P. (eds) Recent Developments in Computational Finance, pp. 49-80. World Sci. Publ, Hackensack, NJ (2013)
31. Kloeden, P.E., Platen, E.:Higher-order implicit strong numerical schemes for stochastic differential equations. J. Stat. Phys. 66, 283-314 (1992)
32. Lam, S.H.:Singular perturbation for stiff equations using numerical methods. In:Casci, C. (ed) Recent Advances in the Aerospace Sciences, pp. 3-19. Plenum Press, New York (1985)
33. Lam, S.H., Goussis, D.A.:Understanding complex chemical kinetics with computational singular perturbation. Proc. Comb. Inst. 22, 931-941 (1988)
34. Lam, S.H., Goussis, D.A.:Computational Singular Perturbation; Theory and Applications, Report 1986-MAE, Princeton Univ., USA (1991a)
35. Lam, S.H., Goussis, D.A.:The CSP method for simplifying kinetics. Int. J. Chem. Kinet. 26, 461-486 (1994)
36. Li, T., Abdulle, A.:Effectiveness of implicit methods for stiff stochastic differential equations. Commun. Comput. Phys. 3, 295-307 (2008)
37. Mao, X.:Stochastic Differential Equations and Applications. Horwood, New York (1997)
38. Milstein, G.N., Platen, E., Schurz, H.:Balanced implicit methods for stiff stochastic systems. SIAM J. Num. Anal. 35, 1010-1019 (1998)
39. Nguyen, D.T., Nguyen, S.L., Hoang, T.A., Yin, G.:Tamed-Euler method for hybrid stochastic differential equations with Markovian switching. Nonlinear Anal. Hybrid Syst. 30, 14-30 (2018)
40. Oksendal, B.:Stochastic Differential Equations:an Introduction with Applications. Springer-Verlag, Berlin/Heidelberg (2003)
41. Rao, C.V., Arkin, A.P.:Stochastic chemical kinetics and the quasi-steady-state assumption:application to the Gillespie algorithm. J. Chem. Phys. 118, 4999-5010 (2003)
42. Rathinam, M., Petzold, L.R., Cao, Y., Gillespie, D.T.:Stiffness in stochastic chemically reacting systems:the implicit tau-leaping method. J. Chem. Phys. 119, 12784-12794 (2003)
43. Reams, R.:Hadamard inverses, square roots and products of almost semidefinite matrices. Linear Algebra Appl. 288, 35-43 (1999)
44. Salis, H., Kaznessis, Y.:Accurate hybrid stochastic simulation of a system of coupled chemical or biochemical reactions. J. Chem. Phys. 122, 54103-54111 (2005)
45. Salloum, M., Alexanderian, A., Le Maître, O., Najm, H.N., Knio, O.:Simplified CSP analysis of a stiff stochastic ODE system. Comput. Methods Appl. Mech. Eng. 217-220, 121-138 (2012)
46. Sotiropoulos, V., Contou-Carrere, M., Daoutidis, P., Kaznessis, Y.N.:Model reduction of multiscale chemical Langevin equations:a numerical case study. IEEE/ACM Trans. Comput. Biol. Bioinf. 6, 470-482 (2009)
47. Székely, T., Burrage, K.:Stochastic simulation in systems biology. Comput. Struct. Biotechnol. J. 12, 14-25 (2014)
48. Ta, C., Wang, D., Nie, Q.:An integration factor method for stochastic and stiff reaction-diffusion systems. J. Comput. Phys. 295, 505-522 (2015)
49. Thomas, P., Straube, A.V., Grima, R.:The slow-scale linear noise approximation:an accurate, reduced stochastic description of biochemical networks under timescale separation conditions. BMC Syst. Biol. 6, 39 (2012)
50. Tian, T., Burrage, K.:Implicit Taylor methods for stiff stochastic differential equations. Appl. Numer. Math. 38, 167-185 (2001)
51. Valorani, M., Goussis, D.A., Najm, H.N.:Using CSP to analyze computed reactive flows. In:8th SIAM Int. Conf. on Numerical Combustion, Amelia Island, FL (2000)
52. Valorani, M., Najm, H.N., Goussis, D.:CSP analysis of a transient flame-vortex interaction:time scales and manifolds. Combust. Flame 134, 35-53 (2003)
53. Valorani, M., Goussis, D.A., Creta, F., Najm, H.N.:Higher order corrections in the approximation of low dimensional manifolds and the construction of simplified problems with the CSP method. J. Comput. Phys. 209, 754-786 (2005)
54. Valorani, M., Creta, F., Goussis, D.A., Lee, J.C., Najm, H.N.:Chemical kinetics simplification via CSP. Combust. Flame 146, 29-51 (2006)
55. Wang, W., Gan, S., Wang, D.:A family of fully implicit milsterin methods for stiff stochastic differential equations with multiplicative noise. BIT Num. Math. 52, 741-772 (2012)
56. Weinan, E., Liu, D., Vanden-Eijnden, E.:Nested stochastic simulation algorithms for chemical kinetic systems with disparate rates. J. Chem. Phys. 123, 194107 (2005)
57. Yin, Z., Gan, S.:An error corrected Euler-Maruyama method for stiff stochastic differential equations. Appl. Math. Comput. 256, 630-641 (2015)
58. Zagaris, A., Kaper, H.G., Kaper, T.J.:Analysis of the CSP reduction method for chemical kinetics. In:SIAM Conference on Applications of Dynamical Systems, May 27-31, 2003 at Snowbird, Utah (2003)
59. Zagaris, A., Kaper, H.G., Kaper, T.J.:Analysis of the CSP reduction method for chemical kinetics. Nonlinear Sci. 14, 59-91 (2004)
Options
Outlines

/