CN114070262A - Additional disturbance integrated hybrid ensemble Kalman filtering weather forecast assimilation method and device thereof - Google Patents
Additional disturbance integrated hybrid ensemble Kalman filtering weather forecast assimilation method and device thereof Download PDFInfo
- Publication number
- CN114070262A CN114070262A CN202111250600.XA CN202111250600A CN114070262A CN 114070262 A CN114070262 A CN 114070262A CN 202111250600 A CN202111250600 A CN 202111250600A CN 114070262 A CN114070262 A CN 114070262A
- Authority
- CN
- China
- Prior art keywords
- kalman gain
- estimated
- assimilation
- kalman
- ensemble
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03H—IMPEDANCE NETWORKS, e.g. RESONANT CIRCUITS; RESONATORS
- H03H17/00—Networks using digital techniques
- H03H17/02—Frequency selective networks
- H03H17/0248—Filters characterised by a particular frequency response or filtering method
- H03H17/0255—Filters based on statistics
- H03H17/0257—KALMAN filters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01W—METEOROLOGY
- G01W1/00—Meteorology
- G01W1/10—Devices for predicting weather conditions
Abstract
The invention discloses an additional disturbance integrated hybrid ensemble Kalman filtering weather forecast assimilation method and device. The weather forecast assimilation method estimates a static background error covariance matrix through a set of climate state set disturbances, and therefore a mixed Kalman gain matrix is obtained. Compared with the commonly used mixing method for averaging the Kalman gains obtained by the covariance of the static and flow related background errors, the method adopts the mixed Kalman gain to update the posterior set mean valueUpdating posterior ensemble perturbations with blended Kalman gain reductions. Mixture number with ensemble perturbation updated by ensemble Kalman filtering in generalCompared with the assimilation method, the method can update the set disturbance by using the hybrid Kalman gain, overcomes the problem of inconsistency of a separated hybrid assimilation system and an integrated Kalman filtering system, and can further reduce the error after assimilation under the condition that the mixing weight and other assimilation parameters are properly selected.
Description
Technical Field
The invention relates to a numerical weather forecast assimilation method, belonging to a variation assimilation and collective assimilation-based mixed assimilation method and a device thereof.
Background
Data assimilation is a technology for finding the optimal estimation of the system state by combining the prior information and observation of the power system.
Common data assimilation methods are the variational and collective assimilation methods. In order to combine the advantages of collective and variational assimilation while minimizing the disadvantages of both methods, a hybrid collective-variational assimilation method is proposed. Previous studies have shown that the mixed ensemble-variational assimilation approach is superior to the variational or ensemble approach alone, and has been widely used for regional and global model numerical weather forecasting.
The hybrid ensemble-variational assimilation method typically uses a variational framework to solve for the hybrid analysis deltas, while the ensemble members are updated using ensemble kalman filtering, making the ensemble average equal to the analysis field solved by the hybrid method. The mixed mode uses a mixed method to update the ensemble average under the variation framework, but the posterior ensemble disturbance is updated by using a separate ensemble Kalman filtering system. The inconsistencies present in such separate hybrid assimilation systems and the ensemble kalman system may result in non-optimal results.
Therefore, chinese patent 202010646132.7 discloses a method for assimilating data in numerical weather forecast based on triple multi-layer perceptron, which is based on the traditional analysis period, obtains a training data set composed of a background field and an observation sequence, optimizes the results of two types of analysis fields by using a first perceptron model and a second perceptron model, and optimizes the outputs of the first perceptron and the second perceptron by using a third perceptron model, and couples the three-dimensional variation data assimilation method with the analysis field of the kalman filter data assimilation method, so that the data assimilation effect in numerical weather forecast is better, thereby ensuring that the assimilation performance of the method is effectively improved compared with the traditional method. The difficulty in introducing neural network learning algorithms during assimilation is how to guarantee the effectiveness of the training data set, which generally depends on the number of labeled samples and the training period.
Therefore, the dilemma faced by the developers is how to develop a hybrid assimilation method, which can realize hybrid assimilation under a single ensemble kalman filtering framework to solve the inconsistency problem caused by the separated assimilation systems.
Disclosure of Invention
The invention provides an integrated hybrid assimilation algorithm for calculating analysis increment by using an ensemble Kalman filtering framework instead of a variation framework aiming at the defects of the prior art. The newly proposed integrated mixed ensemble Kalman filtering assimilation method (IHGEnKF) with additional disturbance estimates a static background error covariance matrix through a set of climate state ensemble disturbance, and therefore a mixed Kalman gain matrix is obtained. In contrast to conventional hybrid methods that combine static and flow-dependent background error covariances to obtain a Kalman gain, the integrated hybrid assimilation method may utilize the information of the estimated static background error covariance plus the flow-dependent background error covariance to update both the ensemble mean and the ensemble perturbation (specifically, the hybrid Kalman gain is used to update the posterior ensemble mean)Updating posterior ensemble perturbations with blended Kalman gain reductions). Compared with the EVIL which generates the posterior set from the minimization process, the integrated hybrid assimilation algorithm does not need a large number of iterations and is easily applied to the existing set Kalman filtering system. And the problem of inconsistency of a separated hybrid assimilation system and an integrated Kalman filtering system is solved, and the errors after assimilation can be further reduced under the condition that the hybrid weight and other assimilation parameters (such as a local parameter and an expansion parameter) are properly selected.
In order to achieve the technical purpose, the invention adopts the following technical scheme:
an integrated mixed ensemble Kalman filtering weather forecast assimilation method with additional disturbance is carried out under the framework of ensemble Kalman filtering, and comprises the following steps:
step one, a set of forecast sets and observation data required to be assimilated are given
Acquiring the circulation set disturbance of a given prediction set, and calculating the corresponding background error covariance based on the acquired circulation set disturbance;
step two, extracting climate state set disturbance
2.1, integrating the forecast set at a given moment for a period of time before after assimilation observation based on the forecast set at the given moment, and obtaining a climate state time sequence after continuous cycle assimilation;
2.2, randomly extracting a group of data from the climate state time sequence acquired in the step 2.1 to form climate state set disturbance;
2.3, according to the climate state set disturbance obtained in the step 2.2, calculating the corresponding climate state background error covariance by referring to the calculation mode of the background error covariance in the step one;
step three, calculating the mixed Kalman gain and the mixed reduced Kalman gain
3.1, at the moment that the assimilation observation is needed, respectively calculating an estimated Kalman gain and an estimated Kalman reduction gain based on the background error covariance obtained in the first step, and respectively and correspondingly calculating the estimated climate state Kalman gain and the estimated climate state Kalman reduction gain based on the climate state background error covariance obtained in the second step by referring to the calculation modes of the estimated Kalman gain and the estimated Kalman reduction gain;
3.2, after the estimated Kalman gain and the estimated climate state Kalman gain obtained in the step 3.1 are weighted and averaged, the mixed Kalman gain can be calculated; after the estimated Kalman gain reduction and the estimated climate state Kalman gain reduction obtained in the step 3.1 are weighted and averaged, the mixed Kalman gain reduction can be calculated;
step four, using the mixed Kalman gain matrix and the mixed reduced Kalman gain assimilation observation data
For a given observation to be assimilated in step (3.2), the mean of the posterior set is updated during the assimilation process using the Kalman gain obtained in stepUpdating the posterior set disturbance by the mixed Kalman gain reduction obtained in step 3.2;
Step five, obtaining a posterior cycle set
Perturbing the updated posterior setAnd updated posterior aggregate meanAdding to obtain posterior cyclic set members corresponding to the prior cyclic set members one by one; the a posteriori loop set members are used to integrate into the next assimilation loop.
Preferably, in step two, random extraction is carried out from the climate state time sequenceN c Data to form said disturbance set of climatic states:
Preferably, in extracting from the time series of climatic statesN cBefore the disturbance of each climate state set, an expansion coefficient suitable for a given forecast set is selected to expand the dispersion of the given forecast set.
Preferably, in step 3.1, the estimated kalman gain is:
the estimated reduced kalman gain is:
estimated climate state kalman gain:
estimated climate state reduction kalman gain:
in the formula:Xa cyclic ensemble perturbation representing a forecast ensemble;representing a climate state set disturbance;representing the background error covariance;representing the covariance of the climate background error, H1Is a Jacobian matrix for observing the partial derivatives of the mode variables,represents the product of Shuer; y is a given observation to be assimilated and R is an error covariance matrix for the given observation to be assimilated.
Preferably, in step 3.2, the hybrid kalman gain is:
the hybrid reduced kalman gain is:
in the formula: k is the estimated kalman gain,(ii) is an estimated climate state kalman gain;reducing the kalman gain for the estimation;reducing a Kalman gain for the estimated climate state; 1-Weighting coefficients in the hybrid Kalman gain for the estimated Kalman gain or weighting coefficients in the hybrid reduced Kalman gain for the estimated reduced Kalman gain;for the weight coefficients of the estimated climate state Kalman gain in the hybrid Kalman gain or the weight coefficients of the estimated climate state reduced Kalman gain in the hybrid reduced Kalman gain,is a localized matrix of the image data that is,representing the schuler product.
In the formula: 1-Weighting coefficients in the hybrid Kalman gain for the estimated Kalman gain or weighting coefficients in the hybrid reduced Kalman gain for the estimated reduced Kalman gain;an ensemble average representing the ensemble of forecasts,representing aggregate perturbations;weighting coefficients of the estimated climate state Kalman gain in the hybrid Kalman gain or weighting coefficients of the estimated climate state reduced Kalman gain in the hybrid reduced Kalman gain; k is the estimated kalman gain,(ii) is an estimated climate state kalman gain;reducing the kalman gain for the estimation;reducing a Kalman gain for the estimated climate state;H 2 is an observation operator, H is a Jacobian matrix of observing the mode variables to make partial derivatives,is a localized matrix of the image data that is,represents the product of Shuer; y is a given observation to be assimilated and R is an error covariance matrix for the given observation to be assimilated.
Another technical object of the present invention is to provide an additional disturbance integrated hybrid ensemble kalman filter weather forecast assimilation device, including:
the acquisition module is used for acquiring observation data needing assimilation;
an assimilation module built based on an assimilation framework of ensemble Kalman filtering and updating the mean value of the posterior ensemble by adopting a mixed Kalman gainUpdating posterior ensemble perturbations with blended Kalman gain reductionsTo perform uniform mixing and assimilation processing on the observed data;
the hybrid Kalman gain is calculated after weighted averaging of the estimated Kalman gain and the estimated climate state Kalman gain, and the hybrid reduced Kalman gain is calculated after weighted averaging of the estimated reduced Kalman gain and the estimated climate state Kalman gain;
the estimated Kalman gain and the estimated reduced Kalman gain are respectively obtained by calculating the background error covariance at the moment of assimilation observation, and the estimated climate state Kalman gain and the estimated climate state reduced Kalman gain are respectively obtained by calculating the climate state background error covariance at the moment of assimilation observation;
the background error covariance is given by a set size ofNIs obtained by calculating the forecast set, the climate state background error covariance is obtained by the set sizeN c The climate state set disturbance is obtained by calculation, and the climate state set disturbance is obtained by random extraction from a period of climate state time sequence; the climatic time series is given by a set size ofNThe forecast set of (2) is integrated for a period of time before the time when the observation needs to be assimilated, and is obtained by continuous cyclic assimilation.
It is still another technical object of the present invention to provide an electronic apparatus, comprising: at least one processor, at least one memory, a communication interface, and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for information transmission between the electronic equipment and communication equipment of other electronic equipment; the memory stores program instructions executable by the processor, which when called by the processor are capable of performing the methods described above.
A fourth technical object of the present invention is to provide an electronic device, a non-transitory computer-readable storage medium storing computer instructions for causing the computer to perform the method described above.
According to the technical scheme, compared with the prior art, the invention has the following beneficial effects:
the method approximates the static background error covariance by estimating the background error covariance through the climate state disturbance set, can realize a mixed assimilation method in the frame of the ensemble Kalman filtering, and adopts the mixed Kalman gain to update the posterior ensemble mean valueUpdating posterior ensemble perturbations with blended Kalman gain reductions. Compared with the conventional mixed data assimilation method for updating the set disturbance by the ensemble Kalman filtering, the method can update the set disturbance by the mixed Kalman gain, overcome the problem of inconsistency of a separated mixed assimilation system and the ensemble Kalman filtering system, and further reduce the errors after assimilation under the condition that the mixed weight and other assimilation parameters (such as a localization parameter and an expansion parameter) are properly selected.
Drawings
FIG. 1 is a schematic flow chart of the present invention.
In fig. 2: (a) shows that model II has a first mode error ofFIf =16, each assimilation method [ ensemble square root filter (EnSRF), mixed covariance assimilation: (HCDA), additional disturbance integrated mixed set Kalman filtering assimilation method (IHGEnKF)]RMSE time series of (a); (b) shows that model II has a second mode error ofF=18, methods for assimilation [ ensemble square root filter (EnSRF), mixed covariance assimilation (HCDA), disturbance-added Integrated Mixed ensemble Kalman Filter assimilation method (IHGEnKF)]RMSE time series of (a); (c) shows that model III has a first mode error ofF=16, methods of assimilation [ ensemble square root filter (EnSRF), mixed covariance assimilation (HCDA), Integrated Mixed ensemble Kalman Filter assimilation with additional perturbation (IHGEnKF)]RMSE time series of (a); (d) shows that model III has a second mode error ofF=18, methods for assimilation [ ensemble square root filter (EnSRF), mixed covariance assimilation (HCDA), disturbance-added Integrated Mixed ensemble Kalman Filter assimilation method (IHGEnKF)]RMSE time series of (1).
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the invention, its application, or uses. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. Meanwhile, it should be understood that the sizes of the respective portions shown in the drawings are not drawn in an actual proportional relationship for the convenience of description. Techniques, methods, and apparatus known to those of ordinary skill in the relevant art may not be discussed in detail but are intended to be part of the specification where appropriate. In all examples shown and discussed herein, any particular value should be construed as merely illustrative, and not limiting. Thus, other examples of the exemplary embodiments may have different values.
As shown in FIG. 1, the weather forecast assimilation method of the augmented disturbance integrated hybrid ensemble Kalman filter provided by the invention extracts the climate state ensemble disturbance in the frame of the ensemble Kalman filter, and updates the ensemble mean and the ensemble disturbance by using the mixed background error covariance obtained by calculation of the climate state ensemble disturbance and the cycle ensemble disturbance, thereby realizing hybrid assimilation. The mixed assimilation method can be used for further improving the forecast. The method comprises the following specific steps:
step one, a group of forecast sets and observations are given
1.1. Given a set of forecast sets
Given a set of collection sizesNForecast collection}, the ensemble average may be computedOf 1 atiA member of a setSet of disturbances of. To facilitate calculation of background error covariance for assimilation, aggregate perturbations can be written in the form of the square root of background error covarianceThen background error covariance。
Given observations requiring assimilation
Given an observation y with an error covariance matrix R, it is generally assumed that the observation errors are uncorrelated, R is a diagonal matrix with diagonal elements being the error variances of the observation variables.
Step two, extracting climate state set disturbance before assimilation observation
And forward integration is carried out on the ensemble forecasting members, the prior ensemble is disturbed and expanded at the moment of needing assimilation observation to enlarge the dispersion, a proper localization scheme is selected in advance to be applied to assimilation, and the climate state ensemble disturbance is extracted to calculate the covariance of the mixed background error.
Covariance dilation spread
And selecting a proper expansion coefficient, and applying to prior set disturbance before assimilation to enlarge set dispersion and prevent filter divergence.
Selecting an appropriate localization scheme
The impact of observations is localized by selecting appropriate localization functions to reduce spurious correlations between observations and state variables, commonly used localization functions such as Gaspari and Cohn (GC; Gaspari and Cohn 1999) functions, determined by a single feature scale parameter. The localization function is applied to the kalman gain matrix as shown in step (4.1) at the time of assimilation.
Extracting climate state set disturbances
At the time of need of assimilation observation, extracting from a climate state time sequenceN c Disturbing chinese continental county state setWritten as the square root of the background error covariance:
Step three, calculating a hybrid Kalman gain matrix
Calculate byNKalman gain (in English: Kalman gain) estimated by members of ensemble prediction:
estimated reduced Kalman gain (in English: reduced Kalman gain):
calculating to obtain an estimated climate state Kalman gain according to the covariance of the climate state background error:
similar climate state reduction kalman gains are:
kalman gain of the hybrid of
Hybrid Kalman gain reduction of
Weight ofThe same as the expansion coefficient, localized parameters need to be adjusted to be optimal.
In the above formula, the first and second carbon atoms are,andas such, all represent a disturbance in the set of climate states.
Step four, using mixed Kalman gain assimilation observation
The hybrid assimilation is based on a collective square root filtering system. By observation operatorsH 2 Is that the observation operator maps the mode variables to the observation space, H1Is a Jacobian matrix for observing the partial derivatives of the mode variables,is a localized matrix of the image data that is,representing the schuler product.
Updating ensemble averages
Updating posterior ensemble averages with hybrid Kalman gainEquivalent to mixed analytical increments:
4.2. update set perturbation
Updating the posterior set perturbation with the hybrid kalman gain:
step five, obtaining a posterior cycle set
5.1. Obtaining a posterior cyclic set
The average of posterior set and the disturbance of posterior set are added to obtainNA posteriori cycle set membership. This is achieved byNThe members of the posterior cycle set are integrated to the next cycle of assimilation.
Evaluation of assimilation test results
The time series of root mean square errors were obtained after completion of the assimilation experiments and the results of the assimilation experiments were evaluated using the RMSE average over the selected analysis period as a standard.
Example 1
The performance of the method is tested by using a mixed Kalman gain assimilation observation under the framework of integrated square root filtering, taking a Lorenz (2005) model as an example, in single-scale and double-scale modes and mode errors with different degrees, and compared with error results of the integrated square root filtering and mixed Kalman gain assimilation (HGDA, Penny 2014) method. The sensitivity test result shows that the method is superior to the traditional mixed assimilation method in different set sizes, swelling degrees and localization scales.
Step one, a group of forecast sets and observations are given
The Lorenz (2005) model has two scales to choose from, single scale mode II only contains one large scale slow process variable, double scale mode III contains fast and slow process variables. Is provided withFor slow process variables, the single-scale mode II can be written as:
wherein the content of the first and second substances,denotes the time of day, subscriptnRepresents the number of the lattice point and the number of the lattice point,Kis a constant number of times, and is,F is a forcing term.
The advection entry is written as:
whereinIs a special summation operator, which is the same as the general summation operator except that the first term and the last term are divided by 2.KWhen it is even numberJ=K/2,;KWhen it is oddJ=(K-1)/2,。
wherein the content of the first and second substances,is a mode integral variable. Coefficient of performanceb=10 determinesRelative toFrequency and amplitude of (d). Coefficient of couplingc=3 determineAndthe coupling strength of (2). ByDeconstructedAndcomprises the following steps:
total number of lattice pointsN=960, smooth scaleISelection of 12, constantKAnd 32 is selected. Constant numberαAndβthe values of (a) need to satisfy: when in useIn thatn-IAndn+Iwhen the angle changes quadratically between the two,is equal toThen, thenαTaken as the sum of the values of 0.1241,βthis was taken to be 0.0137. By forcing the termFDifferent values of (c) can introduce different degrees of mode errors, and the embodiment makes the forcing term F of the value be 15 and the forcing term F of the experiment be 16 and 18, wherein the assignment of the two forcing terms F during the experiment means that the forcing term F =16 corresponds to a smaller mode error (first mode error) experiment and the forcing term F =18 corresponds to a larger mode error (second mode error) experiment.
Given a set of forecast sets
The truth value and the initial condition of the set member are obtained by extracting from a set composed of a plurality of independent states. Setting a group of forecast collectionOf a set size ofN. Ensemble averagingOf 1 atiA member of a setSet of disturbances of. For the convenient calculation of background error covariance during assimilation, the aggregate perturbation is written in the form of the square root of the background error covarianceThen background error covariance。
Given observations requiring assimilation
Given an observation y with an error covariance matrix R, it is generally assumed that the observation errors are uncorrelated, R is a diagonal matrix with diagonal elements being the error variances of the observation variables. Obey normal distribution by adding to truthN(0,R) To make observations. The default observation error variance size is 1.0. The default observation network is one observation for every 4 grid points (240 observation grid points total). One observation is generated every 50 integration time steps (-6 h).
Step two, extracting climate state set disturbance before assimilation observation
And forward integration is carried out on the ensemble forecasting members, the prior ensemble is disturbed and expanded at the moment of needing assimilation observation to enlarge the dispersion, a proper localization scheme is selected in advance to be applied to assimilation, and the climate state ensemble disturbance is extracted to calculate the covariance of the mixed background error. Default number of sets of climate state disturbancesN c Is 800.
Covariance dilation spread
Constant expansion coefficients (Anderson and Anderson 1999) are used to expand the set dispersion to prevent filter divergence. And selecting a proper expansion coefficient, and applying to prior set disturbance before assimilation.
Selecting an appropriate localization scheme
Gaspari and Cohn (GC; Gaspari and Cohn 1999) functions are used as localization functions, determined by a single feature scale parameter. The localization function is applied to the kalman gain matrix as shown in step (4.1) at the time of assimilation. The characteristic scale of the GC function requires the selection of appropriate values to obtain the best results.
Extracting climate state set disturbances
The climate time series was obtained by 1 year integration at any initial condition. At the moment of need of assimilation observation, from climateDecimation in a time series of statesN c Disturbing chinese continental county state setWritten as the square root of the background error covariance:
Step three, calculating a hybrid Kalman gain matrix
Calculate byNKalman gain estimated by members of the ensemble prediction:
estimated reduced kalman gain:
calculating to obtain an estimated climate state Kalman gain according to the covariance of the climate state background error:
the estimated climate state reduction kalman gain is:
kalman gain of the hybrid of
Hybrid Kalman gain reduction of
Weight ofThe same as the expansion coefficient, localized parameters need to be adjusted to be optimal. The parameters used for the adjustment of this example are as follows:
the upper row is model II, the lower row is model III, the left column is parameter F =16, and the right column is F = 18.
Step four, using mixed Kalman gain assimilation observation
The hybrid assimilation is based on a collective square root filtering system. By observation operatorsH 2 Mapping mode variables to observation space, H1Is a Jacobian matrix for observing the partial derivatives of the mode variables,is a localized matrix of the image data that is,representing the schuler product.
Updating ensemble averages
Updating posterior ensemble averages with hybrid Kalman gainEquivalent to mixed analytical increments:
4.2. update set perturbation
Updating the posterior set perturbation with the hybrid kalman gain:
step five, obtaining a posterior cycle set
5.1. Obtaining a posterior cyclic set
The average of posterior set and the disturbance of posterior set are added to obtainNA posteriori cycle set membership. This is achieved byNThe members of the posterior cycle set are integrated to the next cycle of assimilation.
Evaluation of assimilation test results
The time series of root mean square errors were obtained after completion of the assimilation experiments and the results of the assimilation experiments were evaluated using the RMSE average over the selected analysis period as a standard. Each data assimilation method was performed for 360 days, and some assimilation parameters (expansion coefficient, localization and mixing weight) were changed according to the experiment, except for some default parameters. The first 10 days were discarded to avoid the effect of error desaturation, and the last 350 days were used to obtain optimal assimilation parameters and to evaluate assimilation performance.
FIG. 2 shows the RMSE time series for each assimilation method for models II and III with different modal errors. When only slow process variables are present, the RMSE of the hybrid data assimilation method (HGDA) is smaller than the ensemble square root filter (EnSRF), as shown in both (a) and (b) of fig. 2. This demonstrates the advantage of updating the ensemble mean using mixed background error covariance compared to using pure sampled background error covariance. The integrated hybrid integrated Kalman filter with additional perturbation (IHGEnKF) yields a similar RMSE and is smaller than the HGDA. This demonstrates the advantage of updating the set disturbance with the hybrid kalman gain by additional climate disturbances. Similar results were obtained when fast process variables were included, as shown in fig. 2 (c), (d), indicating that there is still an advantage in updating the ensemble perturbation using the hybrid kalman gain in the presence of fast process variables.
Example 2
The embodiment discloses an integrated mixed ensemble Kalman filtering weather forecast assimilation device with additional disturbance, which comprises: the device comprises an acquisition module and an assimilation module which are mutually connected in a communication manner; wherein:
the acquisition module is used for acquiring observation data needing assimilation;
an assimilation module built based on an assimilation framework of ensemble Kalman filtering and updating the mean value of the posterior ensemble by adopting a mixed Kalman gainUpdating posterior ensemble perturbations with blended Kalman gain reductionsTo perform uniform mixing and assimilation processing on the observed data;
the hybrid Kalman gain is calculated after weighted averaging of the estimated Kalman gain and the estimated climate state Kalman gain, and the hybrid reduced Kalman gain is calculated after weighted averaging of the estimated reduced Kalman gain and the estimated climate state Kalman gain;
the estimated Kalman gain and the estimated reduced Kalman gain are respectively obtained by calculating the background error covariance at the moment of assimilation observation, and the estimated climate state Kalman gain and the estimated climate state reduced Kalman gain are respectively obtained by calculating the climate state background error covariance at the moment of assimilation observation;
the background error covariance is given by a set size ofNThe climate state background error covariance is obtained by calculating a climate state set disturbance, and the climate state set disturbance is obtained by randomly extracting from a period of climate state time sequence; the climatic time series is given by a set size ofNThe forecast set of (2) is integrated for a period of time before the time when the observation needs to be assimilated, and is obtained by continuous cyclic assimilation.
Example 3
The present embodiment provides an electronic device, including: at least one processor, at least one memory, a communication interface, and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for the electronic equipment andinformation transmission between communication devices of other electronic devices; the memory stores program instructions executable by the processor, and the processor calls the program instructions to execute the method of the above embodiment. Examples include: under the framework of ensemble Kalman filtering, acquiring observation data to be assimilated, and acquiring a set of forecast ensembles. At the time needing assimilation observation, respectively calculating and obtaining a background error covariance and a climate state time sequence on the basis of a given forecast set, and randomly extracting a group of data from the climate state time sequence to form climate state set disturbance; and then calculating the climate state background error covariance by referring to a calculation mode of the background error covariance on the basis of the disturbance of the climate state set. In addition, the estimated Kalman gain and the estimated reduced Kalman gain can be respectively calculated according to the background error covariance, the estimated climate state Kalman gain and the estimated climate state reduced Kalman gain are respectively calculated according to the climate state background error covariance, the mixed Kalman gain is calculated according to the estimated Kalman gain and the estimated climate state Kalman gain, and the mixed reduced Kalman gain is calculated according to the estimated reduced Kalman gain and the estimated climate state reduced Kalman gain. Finally, updating the posterior set mean value according to the mixed Kalman gainUpdating the posterior aggregate perturbation based on the blended reduced Kalman gainTo finally obtain the posterior set members.
The above-described embodiments of the electronic device and the like are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may also be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Example 4
The present embodiments disclose a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, the computer is capable of performing the methods provided by the above embodiments, for example, comprising: acquiring observation data to be assimilated, and acquiring a set of forecast sets. At the time needing assimilation observation, respectively calculating and obtaining a background error covariance and a climate state time sequence on the basis of a given forecast set, and randomly extracting a group of data from the climate state time sequence to form climate state set disturbance; and then calculating the climate state background error covariance by referring to a calculation mode of the background error covariance on the basis of the disturbance of the climate state set. In addition, the estimated Kalman gain and the estimated reduced Kalman gain can be respectively calculated according to the background error covariance, the estimated climate state Kalman gain and the estimated climate state reduced Kalman gain are respectively calculated according to the climate state background error covariance, the mixed Kalman gain is calculated according to the estimated Kalman gain and the estimated climate state Kalman gain, and the mixed reduced Kalman gain is calculated according to the estimated reduced Kalman gain and the estimated climate state reduced Kalman gain. Finally, updating the posterior set mean value according to the mixed Kalman gainUpdating the posterior aggregate perturbation based on the blended reduced Kalman gainTo finally obtain the posterior set members.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Claims (10)
1. An integrated hybrid ensemble Kalman filtering weather forecast assimilation method with additional disturbance is characterized by being carried out under the frame of ensemble Kalman filtering and comprising the following steps:
step one, a set of forecast sets and observation data required to be assimilated are given
Acquiring the circulation set disturbance of a given prediction set, and calculating the corresponding background error covariance based on the acquired circulation set disturbance;
step two, extracting climate state set disturbance
2.1, integrating a period of time in the forward direction at the moment needing assimilation observation based on a given forecast set, and continuously and circularly assimilating to obtain a climate state time sequence;
2.2, randomly extracting a group of data from the climate state time sequence acquired in the step 2.1 to form climate state set disturbance;
2.3, according to the climate state set disturbance obtained in the step 2.2, calculating the corresponding climate state background error covariance by referring to the calculation mode of the background error covariance in the step one;
step three, calculating the mixed Kalman gain and the mixed reduced Kalman gain
3.1, at the moment that the assimilation observation is needed, respectively calculating an estimated Kalman gain and an estimated Kalman reduction gain based on the background error covariance obtained in the first step, and respectively and correspondingly calculating the estimated climate state Kalman gain and the estimated climate state Kalman reduction gain based on the climate state background error covariance obtained in the second step by referring to the calculation modes of the estimated Kalman gain and the estimated Kalman reduction gain;
3.2, after the estimated Kalman gain and the estimated climate state Kalman gain obtained in the step 3.1 are weighted and averaged, the mixed Kalman gain can be calculated; after the estimated Kalman gain reduction and the estimated climate state Kalman gain reduction obtained in the step 3.1 are weighted and averaged, the mixed Kalman gain reduction can be calculated;
step four, using the mixed Kalman gain matrix and the mixed reduced Kalman gain assimilation observation data
For the observation data required to be assimilated given in the step, updating the mean value of the posterior set by using the hybrid Kalman gain obtained in the step 3.2, and updating the disturbance of the posterior set by using the hybrid reduced Kalman gain obtained in the step 3.2 in the assimilation process;
Step five, obtaining a posterior cycle set
2. The method according to claim 1, wherein in step one, the given set of predictions is aOf a set size ofN;
4. The perturbed integrated hybrid ensemble Kalman filter weather forecast assimilation method of claim 3, characterized in that it is extracted from the time series of climatic statesN cBefore disturbance of each climate state set, the expansion coefficient suitable for the given forecast set is selected to expand the given forecast setThe dispersion of (2).
5. The additively perturbed integrated hybrid ensemble kalman filtering weather forecast assimilation method according to claim 1 or 3, characterized in that in step 3.1, the estimated kalman gain is:
the estimated reduced kalman gain is:
estimated climate state kalman gain:
estimated climate state reduction kalman gain:
in the formula:Xa cyclic ensemble perturbation representing a forecast ensemble;representing a climate state set disturbance;representing the background error covariance;representing the covariance of the climate background error, H1Is a Jacobian matrix for observing the partial derivatives of the mode variables,represents the product of Shuer; y is a given observation to be assimilated and R is an error covariance matrix for the given observation to be assimilated.
6. The method for integrating additive disturbance and Kalman filtering weather forecast assimilation according to claim 1 or 5, is characterized in that in step 3.2, the Kalman gain is as follows:
the hybrid reduced kalman gain is:
in the formula: k is the estimated kalman gain,(ii) is an estimated climate state kalman gain;reducing the kalman gain for the estimation;reducing a Kalman gain for the estimated climate state; 1-Weighting coefficients in the hybrid Kalman gain for the estimated Kalman gain or weighting coefficients in the hybrid reduced Kalman gain for the estimated reduced Kalman gain;kalman augmentation of estimated climate statesA weight coefficient in a hybrid Kalman gain or a weight coefficient of an estimated climate state reduced Kalman gain in a hybrid reduced Kalman gain;is a localized matrix of the image data that is,representing the schuler product.
7. The perturbed integrated HYBRID AGAINST WEA method according to claim 6, wherein the posterior ensemble mean is updated with the HYBRID Kalman gain:
In the formula: 1-Weighting coefficients in the hybrid Kalman gain for the estimated Kalman gain or weighting coefficients in the hybrid reduced Kalman gain for the estimated reduced Kalman gain;presentation forecastThe set average of the set is then determined,representing aggregate perturbations;weighting coefficients of the estimated climate state Kalman gain in the hybrid Kalman gain or weighting coefficients of the estimated climate state reduced Kalman gain in the hybrid reduced Kalman gain; k is the estimated kalman gain,(ii) is an estimated climate state kalman gain;reducing the kalman gain for the estimation;reducing a Kalman gain for the estimated climate state;H 2 is an observation operator, and the operator is,is a localized matrix of the image data that is,represents the product of Shuer; y is a given observation to be assimilated and R is an error covariance matrix for the given observation to be assimilated.
8. An integrated hybrid ensemble Kalman filter weather forecast assimilation device with additional disturbance, comprising:
the acquisition module is used for acquiring observation data needing assimilation;
an assimilation module built based on an assimilation framework of ensemble Kalman filtering and updating the mean value of the posterior ensemble by adopting a mixed Kalman gainUpdating posterior ensemble perturbations with blended Kalman gain reductionsTo perform uniform mixing and assimilation processing on the observed data;
the hybrid Kalman gain is calculated after weighted averaging of the estimated Kalman gain and the estimated climate state Kalman gain, and the hybrid reduced Kalman gain is calculated after weighted averaging of the estimated reduced Kalman gain and the estimated climate state Kalman gain;
the estimated Kalman gain and the estimated reduced Kalman gain are respectively obtained by calculating the background error covariance at the moment of assimilation observation, and the estimated climate state Kalman gain and the estimated climate state reduced Kalman gain are respectively obtained by calculating the climate state background error covariance at the moment of assimilation observation;
the background error covariance is given by a set size ofNIs obtained by calculating the forecast set, the climate state background error covariance is obtained by the set sizeN c The climate state set disturbance is obtained by calculation, and the climate state set disturbance is obtained by random extraction from a period of climate state time sequence; the climatic time series is given by a set size ofNThe forecast set of (2) is integrated for a period of time before the time when the observation needs to be assimilated, and is obtained by continuous cyclic assimilation.
9. An electronic device, comprising: at least one processor, at least one memory, a communication interface, and a bus; the processor, the memory and the communication interface complete mutual communication through the bus; the communication interface is used for information transmission between the electronic equipment and communication equipment of other electronic equipment; the memory stores program instructions executable by the processor, the processor invoking the program instructions to perform the method of claim 1.
10. A non-transitory computer-readable storage medium storing computer instructions that cause a computer to perform the method of claim 1.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111250600.XA CN114070262B (en) | 2021-10-26 | 2021-10-26 | Additional disturbance integrated hybrid set Kalman filtering weather forecast assimilation method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111250600.XA CN114070262B (en) | 2021-10-26 | 2021-10-26 | Additional disturbance integrated hybrid set Kalman filtering weather forecast assimilation method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN114070262A true CN114070262A (en) | 2022-02-18 |
CN114070262B CN114070262B (en) | 2022-06-21 |
Family
ID=80235730
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111250600.XA Active CN114070262B (en) | 2021-10-26 | 2021-10-26 | Additional disturbance integrated hybrid set Kalman filtering weather forecast assimilation method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN114070262B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115587629A (en) * | 2022-12-07 | 2023-01-10 | 中国科学院上海高等研究院 | Covariance expansion coefficient estimation method, model training method and storage medium terminal |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140067892A1 (en) * | 2012-08-31 | 2014-03-06 | The Government Of The United States Of America, As Represented By The Secretary Of The Navy | Estimation of Hidden Variance Distribution Parameters |
CN104899448A (en) * | 2015-06-09 | 2015-09-09 | 哈尔滨工程大学 | Adaptive compensation method for static localization scheme of ensemble Kalman filter |
CN104992057A (en) * | 2015-06-25 | 2015-10-21 | 南京信息工程大学 | Quasi-ensemble-variation based mixed data assimilation method |
US20170140079A1 (en) * | 2014-06-30 | 2017-05-18 | Cgg Services Sas | Ensemble-based multi-scale history-matching device and method for reservoir characterization |
CN111181529A (en) * | 2020-01-17 | 2020-05-19 | 中山大学 | Smooth constraint extended Kalman filtering method applied to nonlinear Gaussian model |
CN111259324A (en) * | 2020-01-07 | 2020-06-09 | 南京大学 | Satellite data assimilation vertical direction adaptive localization method and integrated Kalman filtering weather assimilation forecasting method |
CN113360854A (en) * | 2021-08-10 | 2021-09-07 | 中国人民解放军国防科技大学 | Data assimilation method based on adaptive covariance expansion |
-
2021
- 2021-10-26 CN CN202111250600.XA patent/CN114070262B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140067892A1 (en) * | 2012-08-31 | 2014-03-06 | The Government Of The United States Of America, As Represented By The Secretary Of The Navy | Estimation of Hidden Variance Distribution Parameters |
US20170140079A1 (en) * | 2014-06-30 | 2017-05-18 | Cgg Services Sas | Ensemble-based multi-scale history-matching device and method for reservoir characterization |
CN104899448A (en) * | 2015-06-09 | 2015-09-09 | 哈尔滨工程大学 | Adaptive compensation method for static localization scheme of ensemble Kalman filter |
CN104992057A (en) * | 2015-06-25 | 2015-10-21 | 南京信息工程大学 | Quasi-ensemble-variation based mixed data assimilation method |
CN111259324A (en) * | 2020-01-07 | 2020-06-09 | 南京大学 | Satellite data assimilation vertical direction adaptive localization method and integrated Kalman filtering weather assimilation forecasting method |
CN111181529A (en) * | 2020-01-17 | 2020-05-19 | 中山大学 | Smooth constraint extended Kalman filtering method applied to nonlinear Gaussian model |
CN113360854A (en) * | 2021-08-10 | 2021-09-07 | 中国人民解放军国防科技大学 | Data assimilation method based on adaptive covariance expansion |
Non-Patent Citations (3)
Title |
---|
李扬: "基于深度学习改进数值天气预报模式和预报的研究及挑战", 《气象科技进展》 * |
雷荔傈: "基于全球集合预报的西北太平洋热带气旋预报的评估和改进", 《中国科学:地球科学》 * |
马旭林: "基于卡尔曼滤波递减平均算法的集合预报综合偏差订正", 《气象学报》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115587629A (en) * | 2022-12-07 | 2023-01-10 | 中国科学院上海高等研究院 | Covariance expansion coefficient estimation method, model training method and storage medium terminal |
CN115587629B (en) * | 2022-12-07 | 2023-04-07 | 中国科学院上海高等研究院 | Covariance expansion coefficient estimation method, model training method and storage medium terminal |
Also Published As
Publication number | Publication date |
---|---|
CN114070262B (en) | 2022-06-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
Han et al. | A deep learning method for bias correction of ECMWF 24–240 h forecasts | |
Frei et al. | Bridging the ensemble Kalman and particle filters | |
Sang et al. | Covariance approximation for large multivariate spatial data sets with an application to multiple climate model errors | |
WO2019167883A1 (en) | Machine learning device and method | |
CN104462015B (en) | Process the fractional order linear discrete system state updating method of non-gaussian L é vy noises | |
CN109584557B (en) | Traffic flow prediction method based on dynamic decomposition mode and matrix filling | |
CN107015248B (en) | Efficient covariance matrix update | |
CN111612055A (en) | Weather situation typing method, air pollution condition prediction method and device | |
CN109212631B (en) | Satellite observation data three-dimensional variation assimilation method considering channel correlation | |
CN114070262B (en) | Additional disturbance integrated hybrid set Kalman filtering weather forecast assimilation method and device | |
Cosme et al. | Implementation of a reduced rank square-root smoother for high resolution ocean data assimilation | |
CN107292337A (en) | Ultralow order tensor data filling method | |
CN116451553A (en) | Improved variation modal decomposition and BiGRU fusion water quality prediction method | |
Chakrabarti et al. | Disaggregation of remotely sensed soil moisture in heterogeneous landscapes using holistic structure-based models | |
CN106067165A (en) | High spectrum image denoising method based on clustering sparse random field | |
CN112464567B (en) | Intelligent data assimilation method based on variational and assimilative framework | |
CN104517121A (en) | Spatial big data dictionary learning method based on particle swarm optimization | |
CN116453096A (en) | Image foreign matter detection method, device, electronic equipment and storage medium | |
CN104376198B (en) | Self adaptation MRI parallel imaging method utilizing and device | |
CN107730512B (en) | Concurrent structure texture image processing method | |
CN113538239B (en) | Interpolation method based on space-time autoregressive neural network model | |
CN105426911A (en) | Dirichlet process mixture model based TAC clustering method | |
CN114048433B (en) | Mixed assimilation system and method based on ensemble Kalman filtering framework | |
CN115810148A (en) | Crop type image generation method and device | |
CN114781207A (en) | Heat source layout temperature field prediction method based on uncertainty and semi-supervised learning |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |