SCIENTIA SINICA Mathematica, Volume 47 , Issue 12 : 1693-1702(2017) https://doi.org/10.1360/N012017-00154

Stochastic dynamics: Models for intrinsic and extrinsic noises and their applications

More info
  • ReceivedJul 12, 2017
  • AcceptedSep 16, 2017
  • PublishedNov 1, 2017


Mathematical modeling for complex systems and processes requires concepts from and techniques for stochastic dynamics. The theory of stochastic dynamics has two different mathematical representations: Stochastic processes and random dynamical systems. The latter is a more refined mathematical description of reality; it provides not only a stochastic trajectory following one initial condition, but also describes how the entire phase space, with all initial conditions, changes with time. The former represents the stochastic motion of individual systems with intrinsic noise while the latter describes many systems experiencing a common deterministic law of motion which is changing with time due to environmental fluctuations. We call these two situations with intrinsic and extrinsic noises; both have wide applications in chemistry and biology. The recently developed, graph $G(\mathscr{V},\mathscr{E})$ based probabilistic Boolean networks is precisely a class of random dynamical systems (RDS) with discrete state space $\{0,1\}^{\mathscr{V}}$. This paper introduces discrete-time RDS with discrete state space as well as discusses its applications in estimating a rate of convergence in hidden Markov model inference.


[1] Ge H, Qian H. Thermodynamic limit of a nonequilibrium steady-state: Maxwell-type construction for a bistable biochemical system. {Phys Rev Lett,} 2009, {103}: 148103. Google Scholar

[2] Ge H, Qian H, Xie X S. Stochastic phenotype transition of a single cell in an intermediate region of gene state switching. {Phys Rev Lett,} 2015, {114}: 078101. Google Scholar

[3] Kurtz T G. The relationship between stochastic and deterministic models for chemical reactions. {J Chem Phys}, 1972, {57}: 2976-2978. Google Scholar

[4] Ethier S N, Kurtz T G. {Markov Processes: Characterization and Convergence.} New York: John Wiley & Sons, 2005. Google Scholar

[5] Qian H. Cellular biology in terms of stochastic nonlinear biochemical dynamics: Emergent properties, isogenetic variations and chemical system inheritability. {J Stat Phys,} 2010, {141}: 990-1013. Google Scholar

[6] Huang S, Li F, Zhou J X, et al. Processes on the emergent landscapes of biochemical reaction networks and heterogeneous cell population dynamics-Differentiations in living matters. {J R Soc Interfaces,} 2017, {14}: 20170097. Google Scholar

[7] Kifer Y. {Ergodic Theory of Random Transformations}. Basel: Birkhäuser, 1986. Google Scholar

[8] Diaconis P, Freedman D. Iterated random functions. {SIAM Rev,} 1999, {41}: 45-76. Google Scholar

[9] Kifer Y, Liu P D. Random dynamics. In: {Handbook of Dynamical Systems}, vol. 1B. Amsterdam: Elsevier, 2006, 379-499. Google Scholar

[10] Ye F X F, Wang Y, Qian H. Stochastic dynamics: Markov chains and random transformations. {Discrete Contin Dyn Syst Ser B}, 2016, {21}: 2337-2361. Google Scholar

[11] Lasota A, Mackey M C. {Chaos, Fractals, and Noise: Stochastic Aspects of Dynamics}, 2nd ed. New York: Springer-Verlag, 1998. Google Scholar

[12] Jiang D Q, Qian M, Qian M P. {Mathematical Theory of Noneqilibrium Steady States}. Lecture Notes in Mathematics, vol. 1833. New York: Springer, 2004. Google Scholar

[13] 钱紘. 信息与熵力: 生物细胞的物理描述--化学反应动力学和信息论. 中国科学: 生命科学, 2017, {47}: 257-261. Google Scholar

[14] Kloeden P E, Pötzsche C. {Nonautonomous Dynamical Systems in the Life Sciences.} Lecture Notes in Mathematics, vol. 2102. New York: Springer, 2013. Google Scholar

[15] Lin K K, Shea-Brown E, Young L S. Spike-time reliability of layered neural oscillator networks. {J Comput Neurosci,} 2009, {27}: 135-160. Google Scholar

[16] Arnold L, Crauel H. {Lyapunov Exponents}. Berlin: Springer, 1991. Google Scholar

[17] Hopfield J J. Neural networks and physical systems with emergent collective computational abilities. {Proc Natl Acad Sci USA}, 1982, {79}: 2554-2558. Google Scholar

[18] Li F, Long T, Lu Y, et al. The yeast cell-cycle network is robustly designed. {Proc Natl Acad Sci USA}, 2004, {101}: 4781-4786. Google Scholar

[19] Wang R S, Saadatpour A, Albert R. Boolean modeling in systems biology: An overview of methodology and applications. {Phys Biol,} 2012, {9}: 055001. Google Scholar

[20] Kauffman S A. The large scale structure and dynamics of genetic control circuits: An ensemble approach. {J Theoret Biol,} 1974, {44}: 167-190. Google Scholar

[21] Ackley D H, Hinton G E, Sejnowski T J. A learning algorithm for Boltzmann machines. {Cognitive Sci,} 1985, {9}: 147-169. Google Scholar

[22] Qian M P, Gong G L, Clark J W. Relative entropy and learning rules. {Phys Rev A (3)}, 1991, {43}: 1061-1070. Google Scholar

[23] Zhang Y, Qian M P, Ouyang Q, et al. Stochastic model of yeast cell-cycle network. {Phys D}, 2006, {219}: 35-39. Google Scholar

[24] Ge H, Qian H, Qian M. Synchronized dynamics and non-equilibrium steady states in a stochastic yeast cell-cycle network. {Math Biosci,} 2008, {211}: 132-152. Google Scholar

[25] Shmulevich I, Dougherty E R. {Probabilistic Boolean Networks: The Modeling and Control of Gene Regulatory Networks.} Philadelphia: SIAM Publishing, 2010. Google Scholar

[26] Liu J S. {Monte Carlo Strategies in Scientific Computing.} New York: Springer, 2004. Google Scholar

[27] Ma Y A, Fox E B, Chen T, et al. Irreversible samplers from jump and continuous Markov processes. {Stat Comput}, submitted, 2017. Google Scholar

[28] Vucelja M. Lifting--A non-reversible Markov chain Monte Carlo algorithm. {Amer J Phys,} 2016, {84}: 958-968. Google Scholar

[29] Qian H, Kjelstrup S, Kolomeisky A B, et al. Entropy production in mesoscopic stochastic thermodynamics: Nonequilibrium steady state cycles driven by chemical potentials, temperatures, and mechanical forces, {J Phys Cond Matt,} 2016, {28}: 153004. Google Scholar

[30] Welling M, Teh Y W. Bayesian learning via stochastic gradient Langevin dynamics. In: {Proceedings of the 28th International Conference on Machine Learning (ICML'11)}. Bellevue, 2011, 681-688. Google Scholar

[31] Ma Y A, Chen T, Fox E B. A complete recipe for stochastic gradient MCMC. {Adv Neural Inf Process Syst}, 2015, {28}: 2899-2907. Google Scholar

[32] Ding N, Fang Y, Babbush R, et al. Bayesian sampling using stochastic gradient thermostats. {Adv Neural Inf Process Syst}, 2014, {27}: 3203-3211. Google Scholar

[33] Shang X, Zhu Z, Leimkuhler B, et al. Covariance-controlled adaptive Langevin thermostat for large-scale Bayesian sampling. {Adv Neural Inf Process Syst}, 2015, {28}: 37-45. Google Scholar

[34] Ma Y A, Foti N J, Fox E B. Stochastic Gradient MCMC Methods for Hidden Markov Models. In: Proceedings of the 34th International Conference on Machine Learning. Sydney, 2017, 2265-2274. Google Scholar

[35] Edwards S F, Anderson P W. Theory of spin glasses. {J Phys F Metal Phys,} 1975, {5}: 965-974. Google Scholar

[36] Garel T, Orland H. Mean-field model for protein folding. {Europhys Lett EPL,} 1988, {6}: 307-310. Google Scholar

[37] Talagrand M. {Mean Field Models for Spin Glasses}. New York: Springer, 2011. Google Scholar

[38] Atar R, Zeitouni O. Lyapunov exponents for finite state nonlinear filtering. {SIAM J Control Optim,} 1997, {35}: 36-55. Google Scholar

[39] Ye F X F, Ma Y A, Qian H. Estimate exponential forgetting in HMM and its applications. ArXiv:1710.06078, 2017. Google Scholar

[40] Qian H, Ao P, Tu Y, et al. A framework towards understanding mesoscopic phenomena: Emergent unpredictability, symmetry breaking and dynamics across scales. {Chem Phys Lett,} 2016, {665}: 153-161. Google Scholar

[41] 葛颢, 钱紘. 数学动力学模型在生物物理和生物化学中的应用. 北京: 北京大学出版社, 2017. Google Scholar

Copyright 2020  CHINA SCIENCE PUBLISHING & MEDIA LTD.  中国科技出版传媒股份有限公司  版权所有

京ICP备14028887号-23       京公网安备11010102003388号