CN103888100A - Method for filtering non-Gaussian linear stochastic system based on negentropy - Google Patents
Method for filtering non-Gaussian linear stochastic system based on negentropy Download PDFInfo
- Publication number
- CN103888100A CN103888100A CN201410124598.5A CN201410124598A CN103888100A CN 103888100 A CN103888100 A CN 103888100A CN 201410124598 A CN201410124598 A CN 201410124598A CN 103888100 A CN103888100 A CN 103888100A
- Authority
- CN
- China
- Prior art keywords
- msub
- mrow
- function
- msup
- msubsup
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000001914 filtration Methods 0.000 title claims abstract description 35
- 238000000034 method Methods 0.000 title claims abstract description 28
- 239000011159 matrix material Substances 0.000 claims abstract description 27
- 238000005259 measurement Methods 0.000 claims description 4
- 238000012886 linear function Methods 0.000 claims description 3
- 239000013598 vector Substances 0.000 claims description 3
- 230000008569 process Effects 0.000 claims description 2
- 238000012546 transfer Methods 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims description 2
- 230000007704 transition Effects 0.000 claims description 2
- 239000004576 sand Substances 0.000 claims 1
- 238000005309 stochastic process Methods 0.000 abstract 1
- 238000009826 distribution Methods 0.000 description 11
- 238000005070 sampling Methods 0.000 description 6
- 238000013459 approach Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 230000036461 convulsion Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000009833 condensation Methods 0.000 description 1
- 230000005494 condensation Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
Images
Landscapes
- Complex Calculations (AREA)
Abstract
A method for filtering a non-Gaussian linear stochastic system based on the negentropy comprises the steps that firstly, a filter is designed according to a common linear stochastic system; secondly, due to the fact that an error equation is a non-Gaussian stochastic process, an indicator function is selected as a linear combination of a covariance matrix and the negentropy of an evaluated error, and the probability statistic characteristic of the evaluated error is represented as complete as possible; secondly, a probability density function of the evaluated error is worked out according to the characteristic of a characteristic function, and therefore a negentropy expression of the evaluated error is obtained; finally, a filter gain of the filter is solved and the indicator function is minimized. According to the method, the linear stochastic system state influenced by non-Gaussian noise can be estimated and the method can be applied to the fields of inertial navigation, a guiding system, target tracking, signal processing and the like.
Description
Technical Field
The invention relates to a non-Gaussian linear random system filtering method based on negative entropy, in particular to a filtering method when a probability density function for random input has strong non-Gaussian characteristics of asymmetry, multi-peak value and the like.
Background
In recent years, with the development of aerospace technology, the requirements on autonomy and rapid response capability of an aircraft are higher and higher, which means that many complex estimation tasks must be solved quickly and effectively. The filtering theory is a key technology for solving the problems. By adopting the filtering method, the system state is estimated from the perspective of optimal probability statistics, and on the basis of the existing hardware conditions, the method has important significance for improving the control and navigation precision of the aircraft, and is an important guarantee for the success of various tasks. In the 60 s of the 20 th century, the Kalman filtering successfully solves the problem of multi-navigation sensor combined navigation in the American Apollodenum, and draws wide attention of the engineering world. The Kalman filtering is a recursive filtering algorithm, the estimation value of the current state can be calculated as long as the estimation value of the last moment and the observation value of the current state are obtained, the historical information of observation or estimation does not need to be recorded, and the real-time requirement is met, so that the Kalman filtering is generally applied to a navigation system. The Kalman filtering method fully utilizes the relevant information and the physical characteristics of the estimated quantity, is superior to a least square estimation method, but is only suitable for a linear system with noise subjected to Gaussian distribution. Because the navigation system has a complex operating environment and a high degree of uncertainty, it generally operates in a non-gaussian noise environment. In this case, if the kalman filtering method is still used, the navigation accuracy is reduced.
In response to the above problems, many advanced filtering methods are in succession based on kalman filtering theory. In 1993, the Monte Carlo filtering algorithm proposed by Grodon et al was rooted in a Bayesian filtering framework as the Kalman filtering algorithm, but does not require that the posterior distribution satisfy the form of Gaussian distribution, and thus can handle non-Gaussian filtering problems. Condensation, particle filtering, bootstrap filtering and the like are names of Monte Carlo filtering algorithms in different fields, the core idea of the method is that a random sample obtained by sampling a certain probability distribution and corresponding probability distribution are used for representing posterior distribution to be solved, when the number of samples tends to infinity, the algorithm approaches to real distribution infinitely, and the obtained result approaches to an optimal solution infinitely. However, in practice, the optimal sampling distribution is difficult to obtain, so that the monte carlo filtering algorithm is not high in precision, complex, large in calculation amount and poor in real-time performance. In summary, the existing filtering methods either assume that random noise follows gaussian distribution or require a large number of sampling samples, and such processing methods have the following disadvantages: for systems affected by non-gaussian noise, much information is contained within the higher order statistics, and the variance has not been able to fully characterize its probabilistic statistics. The Kalman filtering method takes the minimum variance of estimation errors as a criterion, and the precision is inevitably reduced; the monte carlo filtering algorithm needs a large number of sampling samples to obtain a good result, but because an actual system is subjected to various restrictions, an optimal sampling sample is difficult to obtain, and statistical information of noise is not fully utilized.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: aiming at a non-Gaussian linear random system, the method overcomes the defects of the prior art, fully utilizes the statistical information of random input, provides a filtering method based on negative entropy, solves the filtering problem of the non-Gaussian linear random system, and improves the filtering precision of the system.
The technical solution of the invention is as follows: a non-Gaussian linear stochastic system filtering method based on negative entropy comprises the following implementation steps:
firstly, designing a filter:
for a general discrete-time linear non-gaussian random system:
xk+1=Akxk+Gkωk
yk=Ckxk+υk
a filter of the form:
wherein x isk∈RnIs the system state, yk∈RmOutputting for measurement; a. thek∈Rn×nFor a known state transition matrix, Gk∈Rn×sFor a known interference transfer matrix, Ck∈Rm×nIs a known output matrix;is the system state xkEstimated value of, Lk∈Rn×mIs the filter gain to be determined; omegak∈Rs,υk∈Rmnon-Gaussian process noise and measurement noise which are respectively zero mean, bounded, mutually independent and known by probability density functions which are respectivelyInitial vector x0And omegak,υkIndependently of each other, a probability density function ofα1,β1,α2,β2Is a known real number; r represents a real number domain;
ek+1=(I-LkCk+1)(Akek-Gkωk)+Lkυk+1
wherein I is an nxn dimensional identity matrix;
secondly, selecting an index function as follows:
wherein, ck+1Representing the estimation error ek+1Of the covariance function, γ ek+1(x) And gammak+1(x) Respectively representing the estimation errors ek+1And ek+1Probability density functions of gaussian random variables having the same covariance matrix; r1k,R2kIs a known weight matrix;
thirdly, solving an estimation error covariance matrix and a probability density function:
the covariance matrix and the characteristic function of the error equation respectively satisfy the following two formulas:
wherein,respectively representing random noise omegak,υkThe covariance matrix of (a) is obtained,respectively representing random noise omegak,υkIs a characteristic function ofAnd a characteristic function representing estimation error, wherein t is a time variable and has a value range of (- ∞, infinity) and infinity.
Since the characteristic function and the probability density function are uniquely determined to each other, the estimation error ek+1The probability density function of (a) can be found by inverse fourier transformation as follows:
and the estimated error ek+1The probability density function of gaussian random variables with the same covariance matrix is: <math>
<mrow>
<msub>
<mi>γ</mi>
<mrow>
<mi>k</mi>
<mo>+</mo>
<mn>1</mn>
</mrow>
</msub>
<mrow>
<mo>(</mo>
<mi>x</mi>
<mo>,</mo>
<msub>
<mi>L</mi>
<mi>k</mi>
</msub>
<mo>)</mo>
</mrow>
<mo>=</mo>
<mfrac>
<mn>1</mn>
<msqrt>
<msup>
<mrow>
<mo>(</mo>
<mn>2</mn>
<mi>π</mi>
<mo>)</mo>
</mrow>
<mi>n</mi>
</msup>
<mo>|</mo>
<msub>
<mi>c</mi>
<mrow>
<mi>k</mi>
<mo>+</mo>
<mn>1</mn>
</mrow>
</msub>
<mo>|</mo>
</msqrt>
</mfrac>
<msup>
<mi>e</mi>
<mrow>
<mo>-</mo>
<mfrac>
<mn>1</mn>
<mn>2</mn>
</mfrac>
<msup>
<mi>x</mi>
<mi>T</mi>
</msup>
<msubsup>
<mi>c</mi>
<mrow>
<mi>k</mi>
<mo>+</mo>
<mn>1</mn>
</mrow>
<mrow>
<mo>-</mo>
<mn>1</mn>
</mrow>
</msubsup>
<mi>x</mi>
</mrow>
</msup>
</mrow>
</math>
step four, solving the gain of the filter:
since the index function is a non-linear function, it is generally impossible to solve the function by solving itTo obtain LkSo here the filter gain is found by the gradient algorithm:
Lk=Lk-1+λkdk
wherein d iskIs from Lk-1Search direction of departure, i.e.λkIs from Lk-1Starting in direction dkStep size of the one-dimensional search performed.
Compared with the prior art, the invention has the advantages that: the method utilizes the randomly input statistical information, and the selected index function represents the probability statistical characteristic of the estimation error as completely as possible. A traditional filtering method based on the minimum variance is popularized to a filtering method based on the minimum negative entropy and the variance, the application range of Kalman filtering is expanded, and the precision is improved. And the probability density function of the estimation error is obtained through the property of the characteristic function, so that the calculation amount is reduced.
Drawings
FIG. 1 is a design flow chart of a non-Gaussian filtering method based on negative entropy according to the present invention.
Detailed Description
As shown in fig. 1, the implementation steps of the present invention are as follows (taking a moving body moving along a straight line as an example to illustrate the implementation of the method):
1. designing filters
When the moving body moves linearly, the following kinetic equation can be obtained:
the position observations are:
yk=sk+υk
wherein s isk,vk,akRespectively representing the displacement, the speed and the acceleration of the moving body at the moment k, wherein T is a sampling period; y iskOutputting for observation; omegakFor jerk, jerk ω is given to a tracker of a moving bodykIs a random quantity, which is assumed here to be in the interval [ -0.5,0.5 [ ]]Uniformly distributing the upper layer; upsilon iskTo observe noise, the probability density function is:
taking state vectors The kinetic equation of the linear motion of the moving body can be converted into the following form:
xk+1=Axk+Gωk
yk=Cxk+υk
wherein:
ωk,υkfor mutually independent non-Gaussian random variables, the probability density function is known, and the characteristic functions can be simply obtained, namelyThe initial value of the state is taken as x0=a0Then its characteristic function is
For the discrete-time linear non-gaussian random system, a filter of the following form is constructed:
wherein,as an estimate of xk, Lk is the filter gain to be determined, which is found in the following step 4. Defining estimation errorThe error equation satisfies:
where I is a 3X 3 dimensional identity matrix.
2. The index function is selected as:
wherein, ck+1Representing the estimation error ek+1The covariance matrix of (a) is determined,and gammak+1(x) Respectively representing the estimation errors ek+1And ek+1Probability density functions of gaussian distributions having the same covariance matrix; r1k,R2kIs a known weight matrix.
3. And (3) solving an estimation error covariance matrix and a probability density function:
since the index function is a function of the probability density function and the covariance of the estimation error, the covariance of the estimation error and the expression of the probability density function need to be obtained first.
Due to the fact that
e1=(I-L0C)Ae0-(I-L0C)Gω0+L0υ1
ek+1=(I-LkC)(Aek-Gωk)+Lkυk+1
Can see ekIs formed by e0;ω0,ω1,…,ωk-1;υ1,…,υkThe equal linear combination is carried out; at the same time, because e0,ωi,υi+1(i =0, 1.. k) are independent of each other, so ek,ωk,υk+1Are independent of each other. Thus estimating the errorThe covariance function can be obtained by the following equation:
Since the feature function and the probability density function are uniquely determined from each other, the probability density function can be obtained by using the feature function of the estimation error. For mutually independent random variables, the characteristic function expression of the sum is as follows:
whereinRespectively representing random noise omegak,υkThe characteristic function of (2). It is assumed here thatInitial value of estimation error
Knowing the expression of the characteristic function of the estimation error, the probability density function can be found by the following inverse fourier transform:
and the estimated error ek+1The probability density function of a gaussian distribution with the same covariance is:
4. solving the gain of the filter:
since the index function is a non-linear function, it is generally impossible to solve the function by solving itTo obtain LkSo here the filter gain is found by the gradient algorithm:
Lk=Lk-1+λkdk
wherein d iskIs from Lk-1Search direction of departure, i.e.λkIs from Lk-1Starting in direction dkStep size of the one-dimensional search performed.
Those skilled in the art will appreciate that the invention may be practiced without these specific details.
Claims (1)
1. A non-Gaussian linear stochastic system filtering method based on negative entropy is characterized by comprising the following steps: firstly, aiming at a general discrete time linear random system, a filter is designed; secondly, selecting the index function as a linear combination of a covariance function of an estimation error and a negative entropy; thirdly, the probability density function of the estimation error is obtained by utilizing the property of the characteristic function; finally, solving the gain of the filter and minimizing an index function; the method comprises the following specific steps:
firstly, designing a filter:
for a general discrete-time linear non-gaussian random system:
xk+1=Akxk+Gkωk
yk=Ckxk+υk
a filter of the form:
wherein x isk∈RnIs the system state, yk∈RmOutputting for measurement; a. thek∈Rn×nFor a known state transition matrix, Gk∈Rn×sFor a known interference transfer matrix, Ck∈Rm×nIs a known output matrix;is the system state xkEstimated value of, Lk∈Rn×mIs the filter gain to be determined; omegak∈RsAnd upsilonk∈Rmnon-Gaussian process noise and measurement noise which are respectively zero mean, bounded, mutually independent and known by probability density functions which are respectivelyInitial vector x0And omegak,υkIndependently of each other, a probability density function ofα1,β1,α2,β2Is a known real number; r represents a real number domain;
ek+1=(I-LkCk+1)(Akek-Gkωk)+Lkυk+1
wherein I is an nxn dimensional identity matrix;
secondly, selecting an index function as follows:
wherein, ck+1Representing the estimation error ek+1The covariance function of (a) of (b),and gammak+1(x) Respectively representing the estimation errors ek+1And ek+1Probability density functions of gaussian random variables having the same covariance matrix; r1k,R2kIs a known weight matrix;
thirdly, solving an estimation error covariance matrix and a probability density function:
the covariance matrix and the characteristic function of the error equation respectively satisfy the following two formulas:
wherein,respectively representing random noise omegak,υkThe covariance matrix of (a) is obtained,respectively representing random noise omegak,υkIs a characteristic function ofA characteristic function representing estimation error, wherein t is a time variable, and the value range is (- ∞, infinity), and infinity is represented by infinity;
since the characteristic function and the probability density function are uniquely determined to each other, the estimation error ek+1The probability density function of (a) can be found by inverse fourier transformation as follows:
and the estimated error ek+1The probability density function of gaussian random variables with the same covariance matrix is:
step four, solving the gain of the filter:
since the index function is a non-linear function, it is generally impossible to solve the function by solving itTo obtain LkSo here the filter gain is found by the gradient algorithm:
Lk=Lk-1+λkdk
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410124598.5A CN103888100B (en) | 2014-03-29 | 2014-03-29 | A kind of non-gaussian linear stochaastic system filtering method based on negentropy |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410124598.5A CN103888100B (en) | 2014-03-29 | 2014-03-29 | A kind of non-gaussian linear stochaastic system filtering method based on negentropy |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103888100A true CN103888100A (en) | 2014-06-25 |
CN103888100B CN103888100B (en) | 2016-10-26 |
Family
ID=50956842
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410124598.5A Active CN103888100B (en) | 2014-03-29 | 2014-03-29 | A kind of non-gaussian linear stochaastic system filtering method based on negentropy |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103888100B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108549221A (en) * | 2018-03-30 | 2018-09-18 | 广东工业大学 | A kind of filtering method and relevant apparatus of linear stochaastic system |
CN108599737A (en) * | 2018-04-10 | 2018-09-28 | 西北工业大学 | A kind of design method of the non-linear Kalman filtering device of variation Bayes |
CN109002576A (en) * | 2018-06-11 | 2018-12-14 | 北京航空航天大学 | A kind of solution of power series of Linear Higher-Order ratio guidance system miss distance |
CN111211760A (en) * | 2020-01-15 | 2020-05-29 | 电子科技大学 | Feedback particle filtering method based on distributed diffusion strategy |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103438879A (en) * | 2013-09-02 | 2013-12-11 | 北京航空航天大学 | Atomic spin gyroscope and magnetometer tightly-integrated attitude determination method based on ant colony PF (Particle Filter) algorithm |
US20140088450A1 (en) * | 2012-09-27 | 2014-03-27 | Samsung Electronics Co., Ltd. | Method and system for determining qrs complexes in electrocardiogram signals |
-
2014
- 2014-03-29 CN CN201410124598.5A patent/CN103888100B/en active Active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140088450A1 (en) * | 2012-09-27 | 2014-03-27 | Samsung Electronics Co., Ltd. | Method and system for determining qrs complexes in electrocardiogram signals |
CN103438879A (en) * | 2013-09-02 | 2013-12-11 | 北京航空航天大学 | Atomic spin gyroscope and magnetometer tightly-integrated attitude determination method based on ant colony PF (Particle Filter) algorithm |
Non-Patent Citations (3)
Title |
---|
LEI GUO: "Minimum Entropy Filtering for Multivariate Stochastic Systems with Non-Gaussian Noises", 《2005 AMERICAN CONTROL CONFERENCE》, 10 June 2005 (2005-06-10) * |
LEI GUO: "Minimum Entropy Filtering for Multivariate Stochastic Systems With Non-Gaussian Noises", 《IEEE TRANSACTIONS ON AUTOMATIC CONTROL》, vol. 51, no. 4, 30 April 2006 (2006-04-30) * |
刘云龙等: "一种基于广义优化的非线性随机模型参数估值方法", 《PROCEEDINGS OF THE 31ST CHINESE CONTROL CONFERENCE》, 27 July 2012 (2012-07-27) * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108549221A (en) * | 2018-03-30 | 2018-09-18 | 广东工业大学 | A kind of filtering method and relevant apparatus of linear stochaastic system |
CN108549221B (en) * | 2018-03-30 | 2020-11-10 | 广东工业大学 | Filtering method and related device of linear stochastic system |
CN108599737A (en) * | 2018-04-10 | 2018-09-28 | 西北工业大学 | A kind of design method of the non-linear Kalman filtering device of variation Bayes |
CN108599737B (en) * | 2018-04-10 | 2021-11-23 | 西北工业大学 | Design method of nonlinear Kalman filter of variational Bayes |
CN109002576A (en) * | 2018-06-11 | 2018-12-14 | 北京航空航天大学 | A kind of solution of power series of Linear Higher-Order ratio guidance system miss distance |
CN109002576B (en) * | 2018-06-11 | 2021-11-02 | 北京航空航天大学 | Power series solution of miss distance of linear high-order proportional guidance system |
CN111211760A (en) * | 2020-01-15 | 2020-05-29 | 电子科技大学 | Feedback particle filtering method based on distributed diffusion strategy |
CN111211760B (en) * | 2020-01-15 | 2023-04-11 | 电子科技大学 | Feedback particle filtering method based on distributed diffusion strategy |
Also Published As
Publication number | Publication date |
---|---|
CN103888100B (en) | 2016-10-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Wang et al. | An adaptive Kalman filter estimating process noise covariance | |
Bilik et al. | Maneuvering target tracking in the presence of glint using the nonlinear Gaussian mixture Kalman filter | |
Niedfeldt et al. | Recursive RANSAC: Multiple signal estimation with outliers | |
CN103888100B (en) | A kind of non-gaussian linear stochaastic system filtering method based on negentropy | |
CN111181529B (en) | Smooth constraint extended Kalman filtering method applied to nonlinear Gaussian model | |
CN101975575A (en) | Multi-target tracking method for passive sensor based on particle filtering | |
Choi et al. | Lifted relational kalman filtering | |
CN103973263B (en) | Approximation filter method | |
CN108444471A (en) | A kind of accelerometer signal denoising method based on particle filter and wavelet transformation | |
CN103714045A (en) | Information fusion estimation method for asynchronous multi-rate non-uniform sampled observation data | |
Huo et al. | A new adaptive Kalman filter by combining evolutionary algorithm and fuzzy inference system | |
CN107994885A (en) | Distributed fused filtering method that is a kind of while estimating Unknown worm and state | |
CN106482896A (en) | A kind of contactless factor of inertia discrimination method of arbitrary shape rolling satellite | |
Sithiravel et al. | The spline probability hypothesis density filter | |
Malleswaran et al. | IMM-UKF-TFS model-based approach for intelligent navigation | |
Bugallo et al. | Particle filtering in high-dimensional systems with Gaussian approximations | |
Li et al. | Improved interactive multiple model filter for maneuvering target tracking | |
CN113030945B (en) | Phased array radar target tracking method based on linear sequential filtering | |
Nakabayashi et al. | An extension of the ensemble Kalman filter for estimating the observation error covariance matrix based on the variational bayes’s method | |
CN111582159B (en) | Maneuvering target tracking method facing monitoring system | |
Singh et al. | Design of Kalman filter for wireless sensor network | |
Choppala et al. | Soft systematic resampling for accurate posterior approximation and increased information retention in particle filtering | |
Liu et al. | The square-root unscented information filter for state estimation and sensor fusion | |
Liu et al. | A new method based on the Polytopic Linear Differential Inclusion for the nonlinear filter | |
Zhichao et al. | Properties of Gauss-Newton filter in linear cases |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |