CN103279030A - Bayesian framework-based dynamic soft measurement modeling method and device - Google Patents

Bayesian framework-based dynamic soft measurement modeling method and device Download PDF

Info

Publication number
CN103279030A
CN103279030A CN2013100735501A CN201310073550A CN103279030A CN 103279030 A CN103279030 A CN 103279030A CN 2013100735501 A CN2013100735501 A CN 2013100735501A CN 201310073550 A CN201310073550 A CN 201310073550A CN 103279030 A CN103279030 A CN 103279030A
Authority
CN
China
Prior art keywords
centerdot
model
impulse response
parameter
formula
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN2013100735501A
Other languages
Chinese (zh)
Other versions
CN103279030B (en
Inventor
黄德先
尚超
高莘青
吕文祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201310073550.1A priority Critical patent/CN103279030B/en
Publication of CN103279030A publication Critical patent/CN103279030A/en
Application granted granted Critical
Publication of CN103279030B publication Critical patent/CN103279030B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a Bayesian framework-based dynamic soft measurement modeling method and a Bayesian framework-based dynamic soft measurement modeling device. The method comprises the following steps of: A, establishing a first-order impulse response model and a support vector model; B, measuring and inputting uk(ellipsis,t)(k=1,ellipsis,m), calculating a state variable x(t) and calculating y(t); and C, outputting the y(t).

Description

Dynamic soft measuring modeling method and device based on Bayesian frame
Technical field
The present invention relates to computer realm, relate in particular to dynamic soft measuring modeling method and device based on Bayesian frame in the industrial processes.
Background technology
In the commercial production control procedure, quality variable normally is made of the index relevant with the quality of product, for example the doing of diesel oil, polyacrylic melting index, the pH value in the chemical reactor etc.Yet, quality variable can't carry out on-line measurement usually, be merely able to chemically examine to obtain by the lab analysis that reaches several hours, and that the analysis data in laboratory postpones is too big, can't be used as the feedback signal of control loop, high-quality control requires to be not being met; Even if some quality variable has alternative online analytical instrument, but the common expensive and later maintenance expense height of these instruments.For these reasons, in fields such as chemical process, bio-pharmaceuticals, iron and steel forgings, generally adopt flexible measurement method to set up model by the mathematical relation of setting up between secondary variable and the quality variable, realize difficulty is surveyed the real-time prediction output of variable.
Present flexible measurement method, be applied in the soft sensor modeling, and obtained certain achievement as principal component analysis (PCA) (PCA), offset minimum binary (PLS), artificial neural network (ANN), support vector machine large quantities of modeling methods based on Statistical Learning Theory such as (SVM).But there is following problem:
First: only consider the process data point with mass number strong point sequential coupling usually, yet actual industrial processes great majority all are in the middle of the dynamic change, certain state of current time system must be by the state decision of a period of time before, rather than the independent decision of the state of some time points, so measurement result is accurate inadequately;
Second: even if ignored the process time delay or considered the factor of process time delay, the simple method of using certain process data point to carry out modeling, owing to lack the description to dynamic characteristic of the course, make the applicability of soft-sensing model only be confined under the steady state condition, take place in case changing operate-point or disturbance occur, the tracking power of model can reduce significantly.The process data that is utilized only accounts for the very little part of total data, and major part contains the direct discard processing of data quilt of enriching procedural information, so measurement result is accurate inadequately;
The 3rd, because quality variable also can acute variation when secondary variable generation acute variation for static soft-sensing model, therefore from the angle of control, when the output of soft measurement during as the feedback signal of control loop, control performance has deterioration by a relatively large margin, the feedback result that final influence is measured.
Summary of the invention
(1) goal of the invention
The present invention aims to provide a kind of dynamic soft measuring modeling method and device based on Bayesian frame of high-precision measurement result.
(2) technical scheme
For reaching above-mentioned purpose, the present invention is based on the dynamic soft measuring modeling method of Bayesian frame, may further comprise the steps:
Steps A: set up single order impulse response model and supporting vector machine model;
Described single order impulse response model is:
x ( t ) = x 1 ( t ) x 2 ( t ) · · · x m ( t ) = g → ( α 1 , τ 1 ) T u 1 ( · · · , t ) g → ( α 2 , τ 2 ) T u 2 ( · · · , t ) · · · g → ( α m , τ m ) T u m ( · · · , t ) - - - ( 1 )
Wherein, x (t) is the m dimension state variable of sampling instant t discretize; u k(..., t) (k=1 ..., m) for k component of input variable each cycle sampled value composition length in L sampling period before sampling time t is the vector of L, x k(t) (k=1 ..., be that k component of state variable is at the value of sampling time t, model m)
Figure BDA00002895186300022
Be single order impulse response template; And
Figure BDA00002895186300031
Wherein, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period, τ k0 the number that/Δ T zeros represents;
Described supporting vector machine model is
y ( t ) = Σ i = 1 l ( α i * - α i ) exp { - | | x ( t ) - x i sv | | 2 2 σ 2 } + b - - - ( 3 )
Wherein
Figure BDA00002895186300033
With b be the support vector machine parameter, σ is the RBF nuclear parameter,
Figure BDA00002895186300034
Be support vector, l is the number of support vector;
Step B: measure u k(..., t) (k=1 ..., m) and import the single order impulse response model, calculate state variable x (t) and x (t) be input to and calculate y (t) in the supporting vector machine model;
Step C: output y (t).
Preferably, described steps A also comprises following concrete steps:
Steps A 1: make up described about u as formula (1) and formula (3) k(..., t) (k=1 ..., m) and the system architecture of y (t) relation;
Steps A 2: obtain and u k(..., t) (k=1 ..., m) corresponding data U k(..., t) (k=1 ..., m) and and U k(..., t) (k=1 ..., the m) data sample that constitutes of the Y (t) of mapping mutually, and form the time series that increases progressively by the sampling time;
Steps A 3: the data in the data sample are carried out standardization, so that data have zero-mean and unit variance in each dimension;
Steps A 4: the initial parameter α that sets the training of single order impulse response model and supporting vector machine model k, τ k, impulse response sequence length L, training parameter ε, C, RBF nuclear parameter σ and iteration stopping threshold value μ:
Steps A 5: with the u in the data sample k(..., t) (k=1 ..., m) input formula (1), and the result of formula (1) imported formula (3), relatively output and the Y (t) of formula (3), and according to the parameter of comparative result updating formula (1) and formula (3).
For reaching above-mentioned purpose, the present invention is based on the dynamic soft measuring model building device of Bayesian frame, described dynamic soft measuring model building device based on Bayesian frame comprises that at least model sets up unit, data acquisition computing unit and data output unit;
Described model is set up the unit, in order to single order impulse response model and supporting vector machine model;
Described single order impulse response model is:
x ( t ) = x 1 ( t ) x 2 ( t ) · · · x m ( t ) = g → ( α 1 , τ 1 ) T u 1 ( · · · , t ) g → ( α 2 , τ 2 ) T u 2 ( · · · , t ) · · · g → ( α m , τ m ) T u m ( · · · , t ) - - - ( 1 )
Wherein, x (t) is the m dimension state variable of sampling instant t discretize; u k(..., t) (k=1 ..., m) for k component of input variable each cycle sampled value composition length in L sampling period before sampling time t is the vector of L, x k(t) (k=1 ..., be that k component of state variable is at the value of sampling time t, model m)
Figure BDA00002895186300042
Be single order impulse response template; And
Figure BDA00002895186300043
Wherein, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period, τ k0 the number that/Δ T zeros represents;
Described supporting vector machine model is
y ( t ) = Σ i = 1 l ( α i * - α i ) exp { - | | x ( t ) - x i sv | | 2 2 σ 2 } + b - - - ( 3 )
Wherein
Figure BDA00002895186300052
With b be the support vector machine parameter, σ is the RBF nuclear parameter,
Figure BDA00002895186300053
Be support vector, l is the number of support vector;
Described data acquisition computing unit is in order to gather online measured value u k(..., t) (k=1 ..., m), and be input to that the single order impulse response model calculates state variable x (t) and x (t) be input to and calculate y (t) in the supporting vector machine model.
Further, described model is set up the unit and is comprised:
Structure is set up module, and is described about u as formula (1) and formula (3) in order to make up k(..., t) (k=1 ..., m) and the system architecture of y (t) relation;
The sample data acquisition module is in order to obtain and u k(..., t) (k=1 ..., m) corresponding data U k(..., t) (k=1 ..., m) and and U k(..., t) (k=1 ..., the m) data sample that constitutes of the Y (t) of mapping mutually, and form the time series that increases progressively by the sampling time;
The data sample standardized module is in order to carry out standardization to the data in the data sample, so that data have zero-mean and unit variance in each dimension;
The initial parameter setting module is in order to set the initial parameter α of single order impulse response model and supporting vector machine model training k, τ k, impulse response sequence length L, RBF nuclear parameter σ and iteration stopping threshold value μ:
The parameter training module is in order to the U in the data sample k(..., t) (k=1 ..., m) input formula (1), and the result of formula (1) imported formula (3), relatively output and the Y (t) of formula (3), and according to the parameter of comparative result updating formula (1) and formula (3).
(3) the present invention is based on the dynamic soft measuring modeling method of Bayesian frame and the beneficial effect of device
First: the dynamic soft measuring modeling method and the device that the present invention is based on Bayesian frame, by the combination with single order impulse response model and supporting vector machine model, the vector of forming with the employing in one period continuous sampling cycle be input, thereby having broken classic method and device, only to calculate the difficult leading variable of surveying with independent time point be the limitation of quality variable y (t), thereby can effectively describe the multidate information of process, utilized the multidate information in the production run, to compare estimated accuracy higher with traditional method and device, also has fine control performance more when implementing close-loop feedback control;
Second: dynamic soft measuring modeling method and device based on Bayesian frame of the present invention, take full advantage of supporting vector machine model self to the time response of the dynamic adjustment of time delay and vector, thereby can carry out intelligent optimizing to output time delay, dynamic parameter, reduced existing algorithm for the dependence of the dynamic prior imformation of process, solved existing partial dynamic soft-sensing model because output time delay information can't be obtained and caused the problem that to use;
The the 3rd: dynamic soft measuring modeling method and device based on Bayesian frame of the present invention, training to single order impulse response and supporting vector machine model can be on the basis that does not rely on the traditional test data set, according to all kinds of parameters in the training of objective criteria preference pattern, automatically the model of punishment over-fitting improves effectively because the nonlinear data driving model is crossed the model generalization performance issue that study causes.
Description of drawings
Fig. 1 is the schematic diagram of the described dynamic soft measuring modeling method based on Bayesian frame of the embodiment of the invention one;
Fig. 2~Fig. 5 is the measurement result of the described dynamic soft measuring modeling method based on Bayesian frame of the embodiment of the invention three and the comparison diagram of measurement result;
Fig. 6 is the described dynamic soft measuring model building device structural representation based on Bayesian frame of second embodiment of the invention.
Embodiment
Below in conjunction with Figure of description and embodiment the dynamic soft measuring modeling method that the present invention is based on Bayesian frame is described further.
Embodiment one:
Present embodiment may further comprise the steps based on the dynamic soft measuring modeling method of Bayesian frame:
Steps A: set up single order impulse response model and supporting vector machine model;
Described single order impulse response model is:
x ( t ) = x 1 ( t ) x 2 ( t ) · · · x m ( t ) = g → ( α 1 , τ 1 ) T u 1 ( · · · , t ) g → ( α 2 , τ 2 ) T u 2 ( · · · , t ) · · · g → ( α m , τ m ) T u m ( · · · , t ) - - - ( 1 )
Wherein, x (t) is the m dimension state variable of sampling instant t discretize; u k(..., t) (k=1 ..., m) for k component of input variable each cycle sampled value composition length in L sampling period before sampling time t is the vector of L, x k(t) (k=1 ..., be that k component of state variable is at the value of sampling time t, model m)
Figure BDA00002895186300072
Be single order impulse response template; And
Figure BDA00002895186300073
Wherein, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period; Described single order impulse response model is dynamic system, be used for input from system's dynamic variable of actual measurement, and the process variable that this variable is normally measured easily, and with the form input of vector, thereby can characterize the interior measured intrasystem variation of continuous a period of time; State variable x (t) in the middle of obtaining by formula (1) again is in order to import follow-up supporting vector machine model; τ k/ Δ T zeros representative be 0 the number that the braces position comprises;
Described supporting vector machine model is
y ( t ) = Σ i = 1 l ( α i * - α i ) exp { - | | x ( t ) - x i sv | | 2 2 σ 2 } + b - - - ( 3 )
Wherein
Figure BDA00002895186300082
With b be the support vector machine parameter, σ is the RBF nuclear parameter,
Figure BDA00002895186300083
Be the support vector of support vector machine, l is the number of support vector; Supporting vector machine model is nonlinear static model, and its input is the vector of m dimension, and the calculating by formula (3) will draw the leading variable y (t) that is difficult to measure, and y (t) is generally quality variable;
Step B: Input Online measured value u k(..., t) (k=1 ..., m), calculate state variable x (t) and x (t) be input to and calculate y (t) in the supporting vector machine model;
Step C: output y (t).In concrete practice process, what y (t) was written to the most at last usually is in the distributed display system of DCS, work system or staff is arranged again with reference to input, is used for practical operation and control.
The schematic diagram of the described dynamic soft survey model based on single order impulse response and support vector machine of the present embodiment that Fig. 1 then represents.
The described dynamic soft measuring modeling method based on Bayesian frame of present embodiment, the single order impulse response model is combined with supporting vector machine model, discrete variable with the measurement of one period continuous time in the system under test (SUT) when asking for y (t) is input, thereby try to achieve output and only be not single time state spot correlation connection, thereby more realistic production run, thereby degree of accuracy is higher, controls more accurate; Take full advantage of supporting vector machine model self in addition and considered the characteristic of time delay and the time response of vector input, even if thereby having solved ignoring the process time delay or having considered the factor of process time delay in the middle of the prior art, the measurement result that the method for using certain process data point to carry out modeling merely causes is accurate shortcoming inadequately.
Embodiment two:
Present embodiment has been specialized described steps A on the basis of embodiment one;
Steps A 1: make up described about u as formula (1) and formula (3) k(..., t) (k=1 ..., m) and the system architecture of y (t) relation;
Steps A 2: obtain and u k(..., t) (k=1 ..., m) corresponding data U k(..., t) (k=1 ..., m) and and U k(..., t) (k=1 ..., the m) data sample that constitutes of the Y (t) of mapping mutually, and form the time series that increases progressively by the sampling time; Usually gathering described U k(..., t) (k=1 ..., abide by Shannon's theorems in the time of m);
Steps A 3: the data in the data sample are carried out standardization, so that data have zero-mean and unit variance in each dimension;
Steps A 4: the initial parameter α that sets the training of single order impulse response model and supporting vector machine model k, τ k, impulse response sequence length L, training parameter ε, C, RBF nuclear parameter σ and iteration stopping threshold value μ:
Steps A 5: with the U in the data sample k(..., t) (k=1 ..., m) input formula (1), and the result of formula (1) imported formula (3), relatively output and the Y (t) of formula (3), and according to the parameter of comparative result updating formula (1) and formula (3).
By the parameter in training adjustment formula (1) and the formula (3), the computation model that draws can be used for the calculating of the difficult leading variable y (t) that surveys accurately.
Embodiment three:
Present embodiment on the basis of embodiment two, detailed further steps A.
As shown in Figure 2, step S1: make up a difficult system architecture relation of surveying between leading variable and a plurality of easy survey auxiliary variable on the basis of production run Analysis on Mechanism or practical experience, namely
u k(..., t) (k=1 ..., m) and the system architecture between the y (t) relation; And provide the restriction on the parameters scope of system.
System architecture is closed: the output y of system (t) represents the difficult leading variable of surveying, the input u of system k(..., t) (k=1 ..., m) the relevant easy survey auxiliary variable of representative.System is in series by dynamic link and nonlinear Static link, and dynamic link shows as the form of single order impulse response model:
Wherein, m is the dimension of input variable, also is the dimension of state variable x (t); For input becomes
x ( t ) = x 1 ( t ) x 2 ( t ) · · · x m ( t ) = g → ( α 1 , τ 1 ) T u 1 ( · · · , t ) g → ( α 2 , τ 2 ) T u 2 ( · · · , t ) · · · g → ( α m , τ m ) T u m ( · · · , t )
K component of amount vector of the sampled value composition of every employing cycle sampled data composition in L sampling period before sampling time t, x k(t) (k=1 ..., be that k component of state variable is in the value of sampling time t m).Model
Figure BDA00002895186300102
Be single order impulse response template, namely
Figure BDA00002895186300103
Wherein, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period of process.Requirement provides the pure time delay constant τ of each process subsystem according to priori k Approximate range 0≤τ k≤ d k, d kBe k the maximum delay that input channel may occur.
The nonlinear Static link shows as the form of supporting vector machine model:
y ( t ) = f ( x ( t ) ) = Σ i = 1 l ( α i * - α i ) exp { - | | x ( t ) - x i sv | | 2 2 σ 2 } + b
Wherein
Figure BDA00002895186300105
With b be the support vector machine parameter, σ is the RBF nuclear parameter,
Figure BDA00002895186300106
Support vector for support vector machine.
Step S2: finish the collection of related data sample.From the database of online acquisition and off-line analysis data storehouse, collect relevant easy survey auxiliary variable and constitute one group of data sample with the difficult leading variable data of surveying, and form corresponding time series by the order that the sampling time increases progressively.
Difficult survey leading variable sampling time sequence table is shown: [y (P 1), y (P 2) ..., y (P l)]
If the number of samples of gathering is l, P iI off-line sampled data of awkward survey leading variable
u k(..., P i)=[u k(P i-L+1), u k(P i-L+2) ..., u k(P i)], i=1 ..., l, k=1 ..., m sampling instant, y (P i) (i=1, L, l) awkward i off-line sampled data of leading variable of surveying, the sampling period is generally longer, and has atypical characteristic usually.
Easily surveying the sequence table of auxiliary variable sampling time for m is shown:
U wherein k(P i) be k easily survey auxiliary variable P iOn-line sampling data constantly, the sampling period should be satisfied Shannon's sampling theorem.
Step S3: the input sample data is carried out standardization, make the input data have zero-mean and unit variance in each dimension.
Step S4: the initial parameter of setting model training: the α of all dynamic subsystem k, τ kAll be made as 0, characterize static soft measurement.Impulse response sequence length L is set, surveys variation range and the accuracy requirement of variable according to difficulty and set suitable support vector machine training parameter ε, C and RBF nuclear parameter σ; Iteration stopping threshold value μ is set, initialization iterations ite=0.
Step S5: utilize this group data sample after handling, based on impulse response sequence computing mode variable x (t), utilize initial parameter training support vector machine.
Step S6: make ite=ite+1.Upgrade optimum support vector machine punishment parameters C MP according to following formula.
C MP = Σ i = 1 l Σ j = 1 l ( α i * - α i ) ( α j * - α j ) exp { - | | x ( P i ) - x ( P j ) | | 2 2 σ 2 } γ
And the computing method of γ are as follows:
γ = Σ i = 1 l ρ i 1 / C + ρ i
ρ wherein iBe matrix
Figure BDA00002895186300113
Eigenwert, matrix
Figure BDA00002895186300114
For l * l ties up matrix, being calculated as follows of the element of the capable j of i row:
r i exp { - | | x ( P i ) , x ( P j ) | | 2 2 σ 2 }
R wherein i=r (y i-f (x i)-ε)+r (f (x i)-y i-ε), r (u)=u[1-2s (u)]+2}s (u) [1-s (u)], s (u) is sigmoid function 1/ (1+e -u).
Step S7: utilize updated parameters training support vector machine.
Step S8: calculate optimum nuclear parameter σ according to following formula MP, and after utilize new ginseng
&theta; MP = &eta; &theta; , 0 < &eta; < 1 &eta;&theta; , &eta; &GreaterEqual; 1
Number CMP carries out training once again:
θ=1/σ,,σ MP=1/θ MP
The calculating formula of η is as follows
&eta; = | &lambda; MP &Sigma; i , j = 1 l ( a i - a j ) ( a i * - a j * ) ( x ( P i ) - x ( P j ) ) 2 &times; exp ( - &theta; 2 ( x ( P i ) - x ( P j ) ) 2 / 2 ) &lambda; MP / ( l - &lambda; MP trace ( A &OverBar; - 1 ) ) &times; trace ( A &OverBar; - 2 ( &PartialD; K &OverBar; / &PartialD; &theta; ) ) + trace ( A &OverBar; - 1 ( &PartialD; K &OverBar; / &PartialD; &theta; ) ) / &theta; |
Wherein,
A &OverBar; = 1 C I l &times; l + K &OverBar;
Matrix
Figure BDA00002895186300124
Definition see step B6.
Step S10: the dynamic parameter of asking for m sub-system optimal according to following method respectively { &alpha; k MP , &tau; k MP } , k = 1 , &CenterDot; &CenterDot; &CenterDot; , m :
The definition loss function is as follows:
F ( &alpha; k , &tau; k ) = &Sigma; i = 1 l [ y ( P i ) - f ( x - ( P i ) ) ] 2 , 0 &le; &alpha; k < 1 , k = 1 , &CenterDot; &CenterDot; &CenterDot; , m
x ( P i ) = x 1 ( P i ) x 2 ( P i ) &CenterDot; &CenterDot; &CenterDot; x m ( P i ) = g &RightArrow; ( &alpha; 1 , &tau; 1 ) T u 1 ( &CenterDot; &CenterDot; &CenterDot; , P i ) g &RightArrow; ( &alpha; 2 , &tau; 2 ) T u 2 ( &CenterDot; &CenterDot; &CenterDot; , P i ) &CenterDot; &CenterDot; &CenterDot; g &RightArrow; ( &alpha; m , &tau; m ) T u m ( &CenterDot; &CenterDot; &CenterDot; , P i )
For j subsystem (j=1 ..., m), its pure time delay parameter by even distributed collection 0,1 ..., d jDetermine, wherein.For each possible pure time delay
Figure BDA00002895186300133
Utilize Fibonacci method at 0≤α kOptimize loss function in<1 scope
Figure BDA00002895186300134
The searching optimum
Figure BDA00002895186300135
And obtaining After, optimum
Figure BDA00002895186300137
Determined by following formula:
&tau; k MP = arg min 0 &le; &tau; &OverBar; k &le; d k F ( &alpha; k MP ( &tau; &OverBar; k ) , &tau; &OverBar; k )
Step S11: utilize updated parameters training support vector machine.
Step S12: utilize following formula to calculate its evidence:
evid ( ite ) = - 1 C &Sigma; i = 1 l &Sigma; j = 1 l ( &alpha; i * - &alpha; i ) ( &alpha; j * - &alpha; j ) exp { - | | x ( P i ) - x ( P j ) | | 2 2 &sigma; 2 } - &Sigma; i = 1 l ( 1 + C &rho; i )
ρ wherein iBe matrix Eigenwert, matrix
Figure BDA000028951863001311
Definition see step B2.
Step S13: stop iteration when evid (ite)-evid (ite-1)<μ or evid (ite)<evid (ite-1), the model of this moment is the dynamic soft sensor model of asking; Otherwise, return step B6 and continue iteration.
In the present embodiment, employing has utilized Bayesian frame, can be on the basis that does not rely on the traditional test data set, according to all kinds of parameters in the training of objective criteria preference pattern, automatically the model of punishment over-fitting improves effectively because the nonlinear data driving model is crossed the model generalization performance issue that study causes.
Below the effect that further specifies the dynamic soft measuring modeling method based on Bayesian frame of the present invention, carry out a case verification;
Selected three inputs-single generative process system that exports needs the object of emulation as this example, and has known state equation and the output equation of the system of this three inputs-single output, and is distributed as:
x 1 ( s ) = 3 600 s + 1 e - 5 s u 1 ( s ) x 2 ( s ) = 2 125000 s 2 + 750 s + 1 u 2 ( s ) x 3 ( s ) = 1 60 s + 1 u 3 ( s )
y ( t ) = 2 x 1 ( t ) + 3 x 2 ( t ) + x 3 ( t ) - 9
With Matlab simulation software simulated training data sample: three are easily surveyed auxiliary variables is the continuous sampling input, input type is for evenly distributing at random, the analog sampling cycle is one minute, produces one group of sequence (simulating 250 hours sampled data) of 15000 points, as model input u 1(k), u 2(k), u 3(k) its correspondence described in this method
Figure BDA00002895186300143
State equation, output equation according to above-mentioned three groups of groups input and simulation object, its correspondence of process subsystem output sequence y (k) that obtains 15000 points the y described in this method (t), and corresponding sequence of points added 10% random noise v (k), this group output sequence is carried out sparse sampling, sampling period is P=60 minute or 70 minutes, produce one group of sequence of 211 points, as model output y (Pi), be used for simulation off-line sampled data.Wherein, 149 data samples are used for modeling, remain 62 samples and are used for that institute's established model is carried out precision and estimate and extensive performance test.The error measurement index is that square error is weighed
RMSE = 1 62 &Sigma; i = 1 62 [ o ( P i ) - y ( P i ) ] 2 .
Stipulate in three groups of experiments impulse response length L=40,60,80.The pure time delay optimizing scope of three input subsystems be 0,1 ..., 8}.
Wherein, Fig. 2~Fig. 5 is the comparison diagram of result of calculation and the measurement result of the described method of present embodiment, can find out from diagram, adopts this law to carry out the high advantage of monitoring accuracy of quality variable.When L=80, the training precision of this method is the highest in this example.Test result based on the dynamic soft measuring modeler model of Bayesian frame (adopting the bayes method modeling): RMSE=0.0721; Test result based on the static soft-sensing model of support vector machine (adopting the bayes method modeling): RMSE=0.1660.Test result shows that this model compares with traditional static state modeling method, has advantage of high precision.
Below in conjunction with Figure of description and embodiment the dynamic soft measuring model building device that the present invention is based on Bayesian frame is described further.
First embodiment:
Present embodiment comprises at least that based on the dynamic soft measuring model building device of Bayesian frame model sets up unit, data acquisition computing unit and data output unit;
Described model is set up the unit, in order to single order impulse response model and supporting vector machine model;
Described single order impulse response model is:
x ( t ) = x 1 ( t ) x 2 ( t ) &CenterDot; &CenterDot; &CenterDot; x m ( t ) = g &RightArrow; ( &alpha; 1 , &tau; 1 ) T u 1 ( &CenterDot; &CenterDot; &CenterDot; , t ) g &RightArrow; ( &alpha; 2 , &tau; 2 ) T u 2 ( &CenterDot; &CenterDot; &CenterDot; , t ) &CenterDot; &CenterDot; &CenterDot; g &RightArrow; ( &alpha; m , &tau; m ) T u m ( &CenterDot; &CenterDot; &CenterDot; , t ) - - - ( 1 )
Wherein, x (t) is the m dimension state variable of sampling instant t discretize; u k(..., t) (k=1 ..., m) forming length for k component of input variable each cycle sampled value in L sampling period before sampling time t is the capable vectorial of L, x k(t) (k=1 ..., be that k component of state variable is at the value of sampling time t, model m) Be single order impulse response template; And
Figure BDA00002895186300153
Wherein,
Figure BDA00002895186300154
For
Figure BDA00002895186300155
Transposition, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period of process;
Described supporting vector machine model is
y ( t ) = &Sigma; i = 1 l ( &alpha; i * - &alpha; i ) exp { - | | x ( t ) - x i sv | | 2 2 &sigma; 2 } + b - - - ( 3 )
Wherein With b be the support vector machine parameter, σ is the RBF nuclear parameter,
Figure BDA00002895186300163
Support vector for support vector machine;
Described data acquisition computing unit is in order to gather online measured value u k(..., t) (k=1 ..., m), and be input to that the single order impulse response model calculates state variable x (t) and x (t) be input to and calculate y (t) in the supporting vector machine model;
Described data output unit is in order to export y (t).
The described dynamic soft measuring model building device based on Bayesian frame of present embodiment is generally the online forecasting device.
At first, present embodiment is based on the dynamic soft measuring model building device of Bayesian frame, by the combination with single order impulse response model and supporting vector machine model, the vector of forming with the employing in one period continuous sampling cycle be input, thereby having broken classic method and device, only to calculate the difficult leading variable of surveying with independent time point be the limitation of quality variable y (t), thereby can effectively describe the multidate information of process, utilized the multidate information in the production run, to compare estimated accuracy higher with traditional method and device, also has fine control performance more when implementing close-loop feedback control;
Secondly, the described dynamic soft measuring model building device based on Bayesian frame of present embodiment, take full advantage of dynamic adjustment and the vectorial time response to time delay of supporting vector machine model self, thereby can carry out intelligent optimizing to output time delay, dynamic parameter, reduced existing algorithm for the dependence of the dynamic prior imformation of process, solved existing partial dynamic soft-sensing model because output time delay information can't be obtained and caused the problem that to use;
Again, the described dynamic soft measuring model building device based on Bayesian frame of present embodiment, training to single order impulse response and supporting vector machine model can be on the basis that does not rely on the traditional test data set, according to all kinds of parameters in the training of objective criteria preference pattern, automatically the model of punishment over-fitting improves effectively because the nonlinear data driving model is crossed the model generalization performance issue that study causes.
Second embodiment:
As shown in Figure 6, the dynamic soft measuring model building device based on Bayesian frame is characterized in that, described dynamic soft measuring model building device based on Bayesian frame comprises that at least model sets up unit, data acquisition computing unit and data output unit;
Described model is set up the unit, in order to single order impulse response model and supporting vector machine model;
Described single order impulse response model is:
x ( t ) = x 1 ( t ) x 2 ( t ) &CenterDot; &CenterDot; &CenterDot; x m ( t ) = g &RightArrow; ( &alpha; 1 , &tau; 1 ) T u 1 ( &CenterDot; &CenterDot; &CenterDot; , t ) g &RightArrow; ( &alpha; 2 , &tau; 2 ) T u 2 ( &CenterDot; &CenterDot; &CenterDot; , t ) &CenterDot; &CenterDot; &CenterDot; g &RightArrow; ( &alpha; m , &tau; m ) T u m ( &CenterDot; &CenterDot; &CenterDot; , t ) - - - ( 1 )
Wherein, x (t) is the m dimension state variable of sampling instant t discretize; u k(..., t) (k=1 ..., m) for k component of input variable each cycle sampled value composition length in L sampling period before sampling time t is the vector of L, x k(t) (k=1 ..., be that k component of state variable is at the value of sampling time t, model m)
Figure BDA00002895186300172
Be single order impulse response template; And
Figure BDA00002895186300173
Wherein, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period;
Described supporting vector machine model is
y ( t ) = &Sigma; i = 1 l ( &alpha; i * - &alpha; i ) exp { - | | x ( t ) - x i sv | | 2 2 &sigma; 2 } + b - - - ( 3 )
Wherein
Figure BDA00002895186300182
With b be the support vector machine parameter, σ is the RBF nuclear parameter,
Figure BDA00002895186300183
Support vector for support vector machine;
Described data acquisition computing unit in order to gathering online measured value, and is input to that the single order impulse response model calculates state variable x (t) and x (t) is input to and calculate y (t) in the supporting vector machine model;
Described data output unit is in order to export y (t).
Described model is set up the unit and is comprised:
Structure is set up module, and is described about u as formula (1) and formula (3) in order to make up k(..., t) (k=1 ..., m) and the system architecture of y (t) relation;
The data sample acquisition module is in order to obtain and u k(..., t) (k=1 ..., m) corresponding data U k(..., t) (k=1 ..., m) and and U k(..., t) (k=1 ..., the m) data sample that constitutes of the Y (t) of mapping mutually, and form the time series that increases progressively by the sampling time;
The data sample standardized module is in order to carry out standardization to the data in the data sample, so that data have zero-mean and unit variance in each dimension;
The initial parameter setting module is in order to set the initial parameter α of single order impulse response model and supporting vector machine model training k, τ k, impulse response sequence length L, training parameter ε, C, RBF nuclear parameter σ and iteration stopping threshold value μ:
The parameter training module is in order to the U in the data sample k(..., t) (k=1 ..., m) input formula (1), and the result of formula (1) imported formula (3), relatively output and the Y (t) of formula (3), and according to the parameter of comparative result updating formula (1) and formula (3).
Above embodiment only is used for explanation the present invention; and be not limitation of the present invention; the those of ordinary skill in relevant technologies field; under the situation that does not break away from the spirit and scope of the present invention; can also make a variety of changes and modification; therefore all technical schemes that are equal to also belong to category of the present invention, and scope of patent protection of the present invention should be defined by the claims.

Claims (4)

1. the dynamic soft measuring modeling method based on Bayesian frame is characterized in that, said method comprising the steps of:
Steps A: set up single order impulse response model and supporting vector machine model;
Described single order impulse response model is:
x ( t ) = x 1 ( t ) x 2 ( t ) &CenterDot; &CenterDot; &CenterDot; x m ( t ) = g &RightArrow; ( &alpha; 1 , &tau; 1 ) T u 1 ( &CenterDot; &CenterDot; &CenterDot; , t ) g &RightArrow; ( &alpha; 2 , &tau; 2 ) T u 2 ( &CenterDot; &CenterDot; &CenterDot; , t ) &CenterDot; &CenterDot; &CenterDot; g &RightArrow; ( &alpha; m , &tau; m ) T u m ( &CenterDot; &CenterDot; &CenterDot; , t ) - - - ( 1 )
Wherein, x (t) is the m dimension state variable of sampling instant t discretize; u k(..., t) (k=1 ..., m) for k component of input variable each cycle sampled value composition length in L sampling period before sampling time t is the vector of L, x k(t) (k=1 ..., be that k component of state variable is at the value of sampling time t, model m)
Figure FDA00002895186200012
Be single order impulse response template; And
Figure FDA00002895186200013
Wherein, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period, τ k0 the number that/Δ T zeros represents;
Described supporting vector machine model is
y ( t ) = &Sigma; i = 1 l ( &alpha; i * - &alpha; i ) exp { - | | x ( t ) - x i sv | | 2 2 &sigma; 2 } + b - - - ( 3 )
Wherein With b be the support vector machine parameter, σ is the RBF nuclear parameter, Be support vector, l is the number of support vector;
Step B: measure u k(..., t) (k=1 ..., m) and import the single order impulse response model, calculate state variable x (t) and x (t) be input to and calculate y (t) in the supporting vector machine model;
Step C: output y (t).
2. the dynamic soft measuring modeling method based on Bayesian frame according to claim 1 is characterized in that described steps A also comprises following concrete steps:
Steps A 1: make up described about u as formula (1) and formula (3) k(..., t) (k=1 ..., m) and the system architecture of y (t) relation;
Steps A 2: obtain and u k(..., t) (k=1 ..., m) corresponding data U k(..., t) (k=1 ..., m) and and U k(..., t) (k=1 ..., the m) data sample that constitutes of the Y (t) of mapping mutually, and form the time series that increases progressively by the sampling time;
Steps A 3: the data in the data sample are carried out standardization, so that data have zero-mean and unit variance in each dimension;
Steps A 4: the initial parameter α that sets the training of single order impulse response model and supporting vector machine model k, τ k, impulse response sequence length L, training parameter ε, C, RBF nuclear parameter σ and iteration stopping threshold value μ:
Steps A 5: with the u in the data sample k(..., t) (k=1 ..., m) input formula (1), and the result of formula (1) imported formula (3), relatively output and the Y (t) of formula (3), and according to the parameter of comparative result updating formula (1) and formula (3).
3. the dynamic soft measuring model building device based on Bayesian frame is characterized in that, described dynamic soft measuring model building device based on Bayesian frame comprises that at least model sets up unit, data acquisition computing unit and data output unit;
Described model is set up the unit, in order to single order impulse response model and supporting vector machine model;
Described single order impulse response model is:
x ( t ) = x 1 ( t ) x 2 ( t ) &CenterDot; &CenterDot; &CenterDot; x m ( t ) = g &RightArrow; ( &alpha; 1 , &tau; 1 ) T u 1 ( &CenterDot; &CenterDot; &CenterDot; , t ) g &RightArrow; ( &alpha; 2 , &tau; 2 ) T u 2 ( &CenterDot; &CenterDot; &CenterDot; , t ) &CenterDot; &CenterDot; &CenterDot; g &RightArrow; ( &alpha; m , &tau; m ) T u m ( &CenterDot; &CenterDot; &CenterDot; , t ) - - - ( 1 )
Wherein, x (t) is the m dimension state variable of sampling instant t discretize; u k(..., t) (k=1 ..., m) for k component of input variable each cycle sampled value composition length in L sampling period before sampling time t is the vector of L, x k(t) (k=1 ..., be that k component of state variable is at the value of sampling time t, model m)
Figure FDA00002895186200032
Be single order impulse response template; And
Wherein, α k(k=1 ..., m) being single order impulse response parameter, its scope satisfies 0≤α k<1; Nonnegative integer τ kPure time delay parameter for single order impulse response; Δ T is the sampling period, τ k0 the number that/Δ T zeros represents;
Described supporting vector machine model is
y ( t ) = &Sigma; i = 1 l ( &alpha; i * - &alpha; i ) exp { - | | x ( t ) - x i sv | | 2 2 &sigma; 2 } + b - - - ( 3 )
Wherein
Figure FDA00002895186200035
With b be the support vector machine parameter, σ is the RBF nuclear parameter,
Figure FDA00002895186200036
Be support vector, l is the number of support vector;
Described data acquisition computing unit is in order to gather online measured value u k(..., t) (k=1 ..., m) and be input to that the single order impulse response model calculates state variable x (t) and x (t) is input to and calculate y (t) in the supporting vector machine model;
Described data output unit is in order to export y (t).
4. the dynamic soft measuring model building device based on Bayesian frame according to claim 3 is characterized in that, described model is set up the unit and comprised:
Structure is set up module, and is described about u as formula (1) and formula (3) in order to make up k(..., t) (k=1 ..., m) and the system architecture of y (t) relation;
The sample data acquisition module is in order to obtain and u k(..., t) (k=1 ..., m) corresponding data U k(..., t) (k=1 ..., m) and and U k(..., t) (k=1 ..., the m) data sample that constitutes of the Y (t) of mapping mutually, and form the time series that increases progressively by the sampling time;
The data sample standardized module is in order to carry out standardization to the data in the data sample, so that data have zero-mean and unit variance in each dimension;
The initial parameter setting module is in order to set the initial parameter α of single order impulse response model and supporting vector machine model training k, τ k, impulse response sequence length L, RBF nuclear parameter σ and iteration stopping threshold value μ:
The parameter training module is in order to the U in the data sample k(..., t) (k=1 ..., m) input formula (1), and the result of formula (1) imported formula (3), relatively output and the Y (t) of formula (3), and according to the parameter of comparative result updating formula (1) and formula (3).
CN201310073550.1A 2013-03-07 2013-03-07 Dynamic soft measuring modeling method and device based on Bayesian frame Active CN103279030B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201310073550.1A CN103279030B (en) 2013-03-07 2013-03-07 Dynamic soft measuring modeling method and device based on Bayesian frame

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201310073550.1A CN103279030B (en) 2013-03-07 2013-03-07 Dynamic soft measuring modeling method and device based on Bayesian frame

Publications (2)

Publication Number Publication Date
CN103279030A true CN103279030A (en) 2013-09-04
CN103279030B CN103279030B (en) 2016-05-18

Family

ID=49061594

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201310073550.1A Active CN103279030B (en) 2013-03-07 2013-03-07 Dynamic soft measuring modeling method and device based on Bayesian frame

Country Status (1)

Country Link
CN (1) CN103279030B (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107290965A (en) * 2017-08-01 2017-10-24 浙江大学 Adaptive soft-sensor Forecasting Methodology based on local weighted Bayesian network
CN107464017A (en) * 2017-08-01 2017-12-12 浙江大学 Based on the adaptive soft-sensor Forecasting Methodology with time difference Bayesian network
CN108764295A (en) * 2018-04-28 2018-11-06 江南大学 A kind of soft-measuring modeling method based on semi-supervised integrated study
CN109884893A (en) * 2019-02-28 2019-06-14 西安理工大学 Dynamic lag estimation method between a kind of multi-process variable
CN112541558A (en) * 2020-09-18 2021-03-23 江苏师范大学 Bayesian semi-supervised robust PPLS soft measurement method based on incomplete data

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1769861A (en) * 2005-10-21 2006-05-10 清华大学 Support vector machine method for measuring overflow granularity distribution of hydrocyclone for solid-liquid separation
CN1916792A (en) * 2006-09-12 2007-02-21 浙江大学 Soft measuring method of industrial process under condition of small sample
CN101050971A (en) * 2007-05-11 2007-10-10 清华大学 Dynamic soft measuring and form establishing method base pulse response formwork and parameter optumization
CN101776531A (en) * 2010-02-10 2010-07-14 东北大学 Soft sensing method for load parameter of ball mill
CN102243672A (en) * 2011-06-22 2011-11-16 浙江大学 Gushing operation condition soft sensing modeling method based on hybrid multiple models in shield tunneling process

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1769861A (en) * 2005-10-21 2006-05-10 清华大学 Support vector machine method for measuring overflow granularity distribution of hydrocyclone for solid-liquid separation
CN1916792A (en) * 2006-09-12 2007-02-21 浙江大学 Soft measuring method of industrial process under condition of small sample
CN101050971A (en) * 2007-05-11 2007-10-10 清华大学 Dynamic soft measuring and form establishing method base pulse response formwork and parameter optumization
CN101776531A (en) * 2010-02-10 2010-07-14 东北大学 Soft sensing method for load parameter of ball mill
CN102243672A (en) * 2011-06-22 2011-11-16 浙江大学 Gushing operation condition soft sensing modeling method based on hybrid multiple models in shield tunneling process

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
郑小霞 等: "基于支持向量机的在线建模方法及应用", 《信息与控制》, vol. 34, no. 5, 31 October 2005 (2005-10-31), pages 636 - 640 *
马勇 等: "动态软测量建模方法初探", 《化工学报》, vol. 56, no. 8, 31 August 2005 (2005-08-31), pages 1516 - 1519 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107290965A (en) * 2017-08-01 2017-10-24 浙江大学 Adaptive soft-sensor Forecasting Methodology based on local weighted Bayesian network
CN107464017A (en) * 2017-08-01 2017-12-12 浙江大学 Based on the adaptive soft-sensor Forecasting Methodology with time difference Bayesian network
CN107290965B (en) * 2017-08-01 2019-11-08 浙江大学 Adaptive soft-sensor prediction technique based on local weighted Bayesian network
CN108764295A (en) * 2018-04-28 2018-11-06 江南大学 A kind of soft-measuring modeling method based on semi-supervised integrated study
CN108764295B (en) * 2018-04-28 2021-05-28 江南大学 Method for predicting concentration of butane at bottom of debutanizer tower based on soft measurement modeling of semi-supervised ensemble learning
CN109884893A (en) * 2019-02-28 2019-06-14 西安理工大学 Dynamic lag estimation method between a kind of multi-process variable
CN112541558A (en) * 2020-09-18 2021-03-23 江苏师范大学 Bayesian semi-supervised robust PPLS soft measurement method based on incomplete data

Also Published As

Publication number Publication date
CN103279030B (en) 2016-05-18

Similar Documents

Publication Publication Date Title
CN101863088B (en) Method for forecasting Mooney viscosity in rubber mixing process
CN100507460C (en) Dynamic soft measuring and form establishing method base pulse response formwork and parameter optumization
CN103399281B (en) Based on the ND-AR model of cycle life deterioration stage parameter and the cycle life of lithium ion battery Forecasting Methodology of EKF method
CN103106535B (en) Method for solving collaborative filtering recommendation data sparsity based on neural network
US20220083839A1 (en) Accuracy compensation method for discharge caustic alkali concentration measuring device in evaporation process
CN103279030A (en) Bayesian framework-based dynamic soft measurement modeling method and device
CN109615860A (en) A kind of signalized intersections method for estimating state based on nonparametric Bayes frame
CN106773693A (en) A kind of sparse causality analysis method of Industry Control multi-loop oscillation behavior
CN102880809A (en) Polypropylene melt index on-line measurement method based on incident vector regression model
CN104462850A (en) Multi-stage batch process soft measurement method based on fuzzy gauss hybrid model
CN104317269A (en) Comprehensive forecast and iterative learning control method based on 2D theory
CN103885867B (en) Online evaluation method of performance of analog circuit
CN105320987A (en) Satellite telemetry data intelligent interpretation method based on BP neural network
CN102601881A (en) Method for monitoring on-line quality and updating prediction model of rubber hardness
CN111122811A (en) Sewage treatment process fault monitoring method of OICA and RNN fusion model
CN107272412A (en) A kind of identifying approach of intermittent wind tunnel flow field control
CN115438726A (en) Device life and fault type prediction method and system based on digital twin technology
CN110222825B (en) Cement product specific surface area prediction method and system
CN103344740B (en) Based on the glutamic acid production concentration online soft sensor method of multi input Wiener model
CN103389360B (en) Based on the debutanizing tower butane content soft measuring method of probability principal component regression model
CN101916394A (en) Knowledge fusion-based online soft measurement method
CN103353295A (en) Method for accurately predicating vertical deformation of dam body
CN105488335A (en) Lyapunov exponent based power system load prediction method and apparatus
CN105868918A (en) Similarity index computing method of harmonic current type monitoring sample
CN103543637B (en) A kind of tool environment temperature Analytic modeling method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant