SCIENCE CHINA Information Sciences, Volume 60, Issue 12: 120203(2017) https://doi.org/10.1007/s11432-017-9138-6

Entropy optimization based filtering for non-Gaussian stochastic systems

More info
  • ReceivedApr 18, 2017
  • AcceptedJun 13, 2017
  • PublishedNov 9, 2017


This paper is concerned with the entropy optimization based filter design for a class of multivariate dynamic stochastic systems with simultaneous presence of non-Gaussian process noise and measurement noise. The filter consists of time update and measurement update two steps, where the selection of the filter gain in the measurement update equation is a key issue to be addressed. Different from the classic Kalman filter theory, entropy rather than variance is employed as the filtering performance criterion due to the non-Gaussian characteristic of the estimation error. Following the establishment of the relationship between the probability density functions of random noises and estimation error, two kinds of entropy based performance indices are provided. On this basis, the corresponding optimal filter gains are obtained respectively by using the gradient optimization technique. Finally, some numerical simulations are provided to demonstrate the effectiveness of the proposed filtering algorithms.


This work was supported by National Natural Science Foundation of China (Grant Nos. 61320106010, 61573019, 61627810). The authors would like to thank the anonymous reviewers for their constructive comments which helped to improve the quality and presentation of this paper significantly.


[1] Kalman R E. A new approach to linear filtering and prediction problems. Trans ASME J Basic Eng, 1960, 82: 35--45. Google Scholar

[2] Anderson B D, Moore J B. Optimal Filtering. Englewood Cliffs: Prentice Hall, 1979. Google Scholar

[3] Simon D. Optimal State Estimation: Kalman, $H_\infty$, and Nonlinear Approaches. New York: Wiley, 2006. Google Scholar

[4] Ding D, Wang Z, Ho D W C. Distributed recursive filtering for stochastic systems under uniform quantizations and deception attacks through sensor networks. Automatica, 2017, 78: 231-240 CrossRef Google Scholar

[5] Ding D, Wei G, Zhang S. On scheduling of deception attacks for discrete-time networked systems equipped with attack detectors. Neurocomputing, 2017, 219: 99-106 CrossRef Google Scholar

[6] Fridman E, Shaked U. An Improved Delay-Dependent $H_\infty$ Filtering of Linear Neutral Systems. IEEE Trans Signal Process, 2004, 52: 668-673 CrossRef ADS Google Scholar

[7] Wang Z, Liu Y, Liu X. $H_\infty$ filtering for uncertain stochastic time-delay systems with sector-bounded nonlinearities. Automatica, 2008, 44: 1268-1277 CrossRef Google Scholar

[8] Yang F, Li Y, Liu X. Robust Error Square Constrained Filter Design for Systems With Non-Gaussian Noises. IEEE Signal Process Lett, 2008, 15: 930-933 CrossRef ADS Google Scholar

[9] Wei G, Wang Z, Shen B. Error-constrained filtering for a class of nonlinear time-varying delay systems with non-Gaussian noises. IEEE Trans Automat Contr, 2010, 55: 2876-2882 CrossRef Google Scholar

[10] Hong Yue , Hong Wang . Minimum entropy control of closed-loop tracking errors for dynamic stochastic systems. IEEE Trans Automat Contr, 2003, 48: 118-122 CrossRef Google Scholar

[11] Guo L, Wang H. Minimum Entropy Filtering for Multivariate Stochastic Systems With Non-Gaussian Noises. IEEE Trans Automat Contr, 2006, 51: 695-700 CrossRef Google Scholar

[12] Zhou J, Zhou D, Wang H. Distribution function tracking filter design using hybrid characteristic functions. Automatica, 2010, 46: 101-109 CrossRef Google Scholar

[13] Saridis G N. Entropy formulation of optimal and adaptive control. IEEE Trans Automat Contr, 1988, 33: 713-721 CrossRef Google Scholar

[14] Petersen I R, James M R, Dupuis P. Minimax optimal control of stochastic uncertain systems with relative entropy constraints. IEEE Trans Automat Contr, 2000, 45: 398-412 CrossRef Google Scholar

[15] Zhang J, Chu C C, Munoz J. Minimum entropy based run-to-run control for semiconductor processes with uncertain metrology delay. J Process Control, 2009, 19: 1688-1697 CrossRef Google Scholar

[16] Yang Yi , Lei Guo , Hong Wang . Adaptive statistic tracking control based on two-step neural networks with time delays.. IEEE Trans Neural Netw, 2009, 20: 420-429 CrossRef PubMed Google Scholar

[17] Jinliang Ding , Tianyou Chai , Hong Wang . Offline modeling for product quality prediction of mineral processing using modeling error PDF shaping and entropy minimization.. IEEE Trans Neural Netw, 2011, 22: 408-419 CrossRef PubMed Google Scholar

[18] Liu Y, Wang H, Guo L. Observer-Based Feedback Controller Design for a Class of Stochastic Systems With Non-Gaussian Variables. IEEE Trans Automat Contr, 2015, 60: 1445-1450 CrossRef Google Scholar

[19] Wang H. Bounded Dynamic Stochastic Systems: Modeling and Control. London: Springer-Verlag, 2000. Google Scholar

[20] Guo L, Wang H. Stochastic Distribution Control System Design: a Convex Optimization Approach. London: Springer-Verlag, 2010. Google Scholar

[21] Papoulis A. Probability, Random Variables and Stochastic Processes. 3rd ed. New York: McGraw-Hill, 1991. Google Scholar

[22] Lei Guo , Liping Yin , Hong Wang . Entropy optimization filtering for fault isolation of nonlinear non-Gaussian stochastic systems. IEEE Trans Automat Contr, 2009, 54: 804-810 CrossRef Google Scholar

[23] Afshar P, Hong Wang P, Tianyou Chai P. An ILC-based adaptive control for general stochastic systems with strictly decreasing entropy.. IEEE Trans Neural Netw, 2009, 20: 471-482 CrossRef PubMed Google Scholar

[24] Renyi A. A Diary on Information Theory. New York: Wiley, 1987. Google Scholar

[25] Ren M, Zhang J, Wang H. Minimized Tracking Error Randomness Control for Nonlinear Multivariate and Non-Gaussian Systems Using the Generalized Density Evolution Equation. IEEE Trans Automat Contr, 2014, 59: 2486-2490 CrossRef Google Scholar

[26] Kárny M. Towards fully probabilistic control design. Automatica, 1996, 32: 1719-1722 CrossRef Google Scholar

[27] Yin L, Zhang H, Guo L. Data driven output joint probability density function control for multivariate non-linear non-Gaussian systems. IET Control Theor Appl, 2015, 9: 2697-2703 CrossRef Google Scholar

[28] Yu Liu , Hong Wang , Chaohuan Hou . Sliding-mode control design for nonlinear systems using probability density function shaping.. IEEE Trans Neural Netw Learning Syst, 2014, 25: 332-343 CrossRef PubMed Google Scholar

Copyright 2020 Science China Press Co., Ltd. 《中国科学》杂志社有限责任公司 版权所有

京ICP备18024590号-1       京公网安备11010102003388号