CN106683185A - High accuracy surface modeling method based on big data - Google Patents
High accuracy surface modeling method based on big data Download PDFInfo
- Publication number
- CN106683185A CN106683185A CN201710013712.0A CN201710013712A CN106683185A CN 106683185 A CN106683185 A CN 106683185A CN 201710013712 A CN201710013712 A CN 201710013712A CN 106683185 A CN106683185 A CN 106683185A
- Authority
- CN
- China
- Prior art keywords
- hasm
- equations
- equation group
- point
- equation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/20—Finite element generation, e.g. wire-frame surface description, tesselation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/05—Geographic models
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/30—Polynomial surface description
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Software Systems (AREA)
- Geometry (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Mathematical Analysis (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Physics (AREA)
- Mathematical Optimization (AREA)
- Algebra (AREA)
- Remote Sensing (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Complex Calculations (AREA)
Abstract
The invention relates to a high accuracy surface modeling method based on big data. The method comprises the following steps: creating geographic coordinate information and to-be-tested variable sampling values of all sampling points; turning a to-be-tested regional space into a grid point form through discretization, and establishing a sampling equation; conducting high order difference discretization on a partial differential equation set of a surface, obtaining a corresponding algebraic system, combining the algebraic system and the sampling equation to form an equality constrain least squares problem, converting the problem into a solve cross cutting object function minimum value problem, and then converting the minimum value problem into a solve symmetry indeterminate equation set; randomly selecting iteration initial values; blocking a coefficient matrix, and storing the block matrixes after decomposition; solving an HASM equation set through a block line projection iterative method, and determining whether a solving result is convergent; determining whether a solution meets demands of a Gauss and C.odazzi equation set; and outputting a high accuracy simulation surface model. Large-scale problems can be solved, the needed storage space is small, and defects of HASM for solving large-scale problems are prevented.
Description
Technical field
The present invention relates to be related to a kind of method that space curved surface for extensive problem is modeled, can be used for big data background
The fields such as generation, meteorology, Biomass, the spatial distribution simulation of soil of lower digital elevation model, it is also possible to be considered as curved surface grid
A kind of method approached, can be used for the surface modeling of the aspects such as large-scale physics, chemistry, medical science.
Background technology
In order to perplex the error problem and Issues On Multi-scales of curved surface modeling since solving half a century, we are several with differential
What principle and optimal control opinion are theoretical basiss, establish one with approximate data of overall importance (including remotely-sensed data and global mould
Type coarse resolution analog data) be for driving field, with local high accuracy data (including monitoring network data and investigation sampled data)
High Accuracy Surface Modeling (High Accuracy Surface Modelling, the be abbreviated as HASM) method of optimal control condition,
And widely applied in more than 20 years on Research foundation, refinement defines epigeosphere modeling philosophy.
HASM can finally be converted into an equality constraint least square problem (Equality by ground sampling constraints
constraint least squares problem:LSE), in order to sample ensureing that the sample point analogue value is equal to
Under conditions of value, keep overall simulation error minimum.Make full use of sample information, be also ensure iteration level off to best simulation effect
The effective means of fruit.Although HASM methods have very big improvement than traditional interpolation method on simulation precision, table is studied
Bright, current HASM can only process small-scale problem, and above-mentioned solution procedure is that LSE problems are converted into into normal equation system to solve.One
Aspect, the equation group condition number of coefficient matrix after conversion is very big, causes the sensitivity and pathosis of problem, and this causes to solve
The alternative manner convergence rate of equation group is very slow, or does not restrain, and thereby results in and can cannot get the approximate of former Solve problems
Solution;On the other hand, currently employed preconditioning conjugate gradient solves HASM equation group to be needed equation group coefficient matrix whole
Disposable input internal memory, with the increase of Solve problems scale, its memory space can rise appreciably, for extensive problem work as
Front solution strategies are not used.Current HASM often processes plan for the simulation of national 1km resolution datas using burst
Slightly, the error at partition boundaries is which increased, so as to reduce the overall precision of analog result.
The content of the invention
Defect of the present invention for existing HASM models in extensive problem is solved, there is provided a kind of improved
HASM, required memory space is little, can solve extensive problem in the case where precision is ensured.
The technical scheme that the present invention solves above-mentioned technical problem is as follows:A kind of High Accuracy Surface Modeling side based on big data
Method, comprises the following steps:
Step 1:The geographic coordinate information and variable sampled value to be measured of each sampled point are created, is wrapped in the geographic coordinate information
Include the longitude information of sampled point and the latitude information of sampled point;
Step 2:Mesh point form is turned to by regional space to be measured is discrete, mesh point centrifugal pump is obtained, according to geographical coordinate
Information and variable sampled value to be measured set up sampling equation, and the sampling equation is used to whether judge sampled point in mesh point, its
In, if sampled point is on the mesh point, the value of the mesh point is variable sampled value to be measured;If sampled point is in grid
Approximation sample value that is interior, then will being obtained using Taylor expansion on the nearest mesh point of the sampled point on the mesh point;
Step 3:First kind fundamental quantity E, F, G and second of each mesh point of region to be measured is calculated according to mesh point centrifugal pump
Class fundamental quantity L, M, N, wherein first fundamental quantity be used for represent simulation Curves on surfaces length, simulation curved surface area and
The curvature of simulation Curves on surfaces, the second fundamental quantity is used to represent the local buckling intensity of variation of simulation curved surface, will be with the
It is discrete that the partial differential equations of the curved surface that one fundamental quantity and second fundamental quantity are represented carry out higher difference, obtains discrete equation group pair
The algebra system answered, equality constraint least square problem is combined into by the algebra system with the sampling equation;
Step 4:Equality constraint least square is converted into into solution for topic and blocks object function minimum problem;
Step 5:Object function minimum problem is blocked in solution and is converted into the symmetrical Indeterminate Equation Group of solution, it is described it is symmetrical not
Equation group is determined for High Accuracy Surface Modeling HASM equation group;
Specifically,
Step 6:Randomly select the iterative initial value of HASM equation group;
Step 7:Coefficient matrix in HASM equation group is entered into every trade piecemeal, and the block matrix after decomposing to coefficient matrix enters
Row storage;
Step 8:Kuai Hang projection iterative methods are adopted to iterative initial value, HASM equation group is solved, and whether judges solving result
Convergence;
Step 9:When solving result is not restrained, Kuai Hang projection iterative methods are adopted again to solving result, solve HASM side
Journey group, and judge whether solving result restrains, if convergence, execution step 10 otherwise, re-executes step 9;
Step 10:When HASM solution of equations is restrained, determine whether whether HASM solution of equations meets Gauss section
Up to neat equation group, if being unsatisfactory for, execution step 6;If meeting, exported with regard to variable to be measured according to HASM solution of equations
High-precision analog surface model.
Present invention seek to address that the big data problem in space curved surface modeling field, has the advantage that:
1st, improve and developed existing model, when the model after improvement has relatively low storage demand and less calculating
Between;
2nd, truncated system is introduced, gives the optimization method for solving constrained least-squares problem, it is as a result more stable;
3rd, give large-scale equation group coefficient matrix specific partitioned mode, it is ensured that the Line independent between matrix rows
Property, it is to avoid information redundancy, so as to give the accelerating algorithm Ji Kuaihang projection iterative method of row projection algorithm, improves method
Convergence rate;
4th, the method after improving can solve extensive problem, and the calculating time is linear with calculating grid number, required to deposit
Storage space is far smaller than nonzero element number in HASM equation group coefficient matrixes;In the case where precision is ensured, HASM is solved
Defect in extensive problem is solved.
On the basis of above-mentioned technical proposal, the present invention can also do following improvement.
Further, the partial differential equations of the curved surface are:
Wherein, E=1+fx 2, F=fx·fy,
X for spatial discretization mesh point abscissa, y for spatial discretization mesh point vertical coordinate, fxFor function f
First-order partial derivative to x, fxxFor second-order partial differential coefficients of the function f to x, fyFor first-order partial derivatives of the function f to y, fyyFor function f pair
The second-order partial differential coefficient E of yx、Fx、GxThe respectively first-order partial derivative of E, F, G to x, Ey、Fy、GyRespectively E, F, G is inclined to the single order of y
Derivative, For Equations of The Second Kind Cristoffel symbols.
It is using the beneficial effect of above-mentioned further scheme so that HASM is set up in complete differential geometry theoretical basiss
On, it is ensured that the stability of HASM, improve the simulation precision of HASM.
Further, the step 3 is specifically included:
Step 3.1:Calculated according to the finite difference approximation of first kind fundamental quantity E, F, G and Equations of The Second Kind fundamental quantity L, M, N and treated
Survey the first kind fundamental quantity of each mesh point of region and the value of Equations of The Second Kind fundamental quantity;
Step 3.2:Finite difference approximation, the finite difference approximation of Equations of The Second Kind fundamental quantity with reference to first kind fundamental quantity and
The finite difference of two class Cristoffel symbols obtains discrete equation group;
Step 3.3:The discrete equation group is converted into into the algebra system of matrix form;
Step 3.4:The algebra system is combined into into equality constraint least square problem with sampling equation.
It is that HASM is finally translated into an equation by ground sampling constraints using the beneficial effect of above-mentioned further scheme
Constrained least-squares problem, in order under conditions of ensureing that the sample point analogue value is equal to sampled value, keep non-detachable mold
Intend error minimum.Sample information is made full use of, is also to ensure that iteration levels off to the effective means of best simulation effect.
Further, it is by the concrete grammar that the coefficient matrix in HASM equation group enters every trade piecemeal in the step 7:If being
Each sub-block A of matrix number AiBe up to u rows, and Ai∈Ru×n, it is independent that u < < n are full rank, the i.e. row per block, it is assumed that
Generating sub-block Ai, the sub-block is comprising the j rows (j < u) in matrix A, and known Ai TQR be decomposed into Ai T=QjRj,
Block Ai TRow dependency estimationWhereinrhhIt is positioned at Rj(h,
H) element of position, a1For a line in matrix A, orderAccording to Ai TQR decompose, using QR decompose update method
To obtainQR decompose, then calculateRow correlation estimation, if the estimation is still less than κ, a1Add block Ai, its
In, κ is a positive number set in advance.
Further, the QR decomposes using Francis QR decomposition strategies.
It is, for the QR being related to decomposes, to be decomposed using Francis QR using the beneficial effect of above-mentioned further scheme
Strategy, can be calculated cost by O (u3) it is reduced to O (u2), u < < n, so as to improve computational efficiency.The partitioning of matrix can be accelerated
The convergence of row projection iterative method, reduces HASM solving equations and calculates the time.
Further, the mode for being stored to the block matrix after coefficient matrix decomposition in the step 7 is row compression storage
Mode CSR.
It is that CSR forms are most common and flexible compressed format using the beneficial effect of above-mentioned further scheme, it is by square
The nonzero element of battle array carries out being stored by row compression, and the original position of nonzero element is recorded with special array, and compression efficiency is high,
Compression process readily appreciates, thereby dramatically reduces memory requirements.
Further, the step 8 and step 9 are specifically included:Assume that current iteration point is to judge xkWhether restrain, if not
Convergence, then find out from xkOrthogonal chooses x apart from farthest blockkProjection on described piece is used as next iteration point.
It is to accelerate convergence rate using the beneficial effect of above-mentioned further scheme.
Description of the drawings
Fig. 1 is a kind of High Accuracy Surface Modeling method and step flow chart based on big data provided in an embodiment of the present invention;
Fig. 2 is standard mathematical curved surface and sampling point distributions figure;
Fig. 3 is the Error Graph that HASM, FRK, IDW and FRS simulate curved surface and true curved surface.
Specific embodiment
The principle and feature of the present invention are described below in conjunction with accompanying drawing, example is served only for explaining the present invention, and
It is non-for limiting the scope of the present invention.
As shown in figure 1, a kind of High Accuracy Surface Modeling method based on big data provided in an embodiment of the present invention, including with
Lower step:
Step 1:The geographic coordinate information and variable sampled value to be measured of each sampled point are created, is wrapped in the geographic coordinate information
Include the longitude information of sampled point and the latitude information of sampled point;
Step 2:Mesh point form is turned to by regional space to be measured is discrete, mesh point centrifugal pump is obtained, according to geographical coordinate
Information and variable sampled value to be measured set up sampling equation, and the sampling equation is used to whether judge sampled point in mesh point, its
In, if sampled point is on the mesh point, the value of the mesh point is variable sampled value to be measured;If sampled point is in grid
Approximation sample value that is interior, then will being obtained using Taylor expansion on the nearest mesh point of the sampled point on the mesh point;
Step 3:First kind fundamental quantity E, F, G and second of each mesh point of region to be measured is calculated according to mesh point centrifugal pump
Class fundamental quantity L, M, N, wherein first fundamental quantity be used for represent simulation Curves on surfaces length, simulation curved surface area and
The curvature of simulation Curves on surfaces, the second fundamental quantity is used to represent the local buckling intensity of variation of simulation curved surface, will be with the
It is discrete that the partial differential equations of the curved surface that one fundamental quantity and second fundamental quantity are represented carry out higher difference, obtains discrete equation group pair
The algebra system answered, equality constraint least square problem is combined into by the algebra system with the sampling equation;
The step 3 is specifically included:
Step 3.1:Calculated according to the finite difference approximation of first kind fundamental quantity E, F, G and Equations of The Second Kind fundamental quantity L, M, N and treated
Survey the first kind fundamental quantity of each mesh point of region and the value of Equations of The Second Kind fundamental quantity;
Step 3.2:Finite difference approximation, the finite difference approximation of Equations of The Second Kind fundamental quantity with reference to first kind fundamental quantity and
The finite difference of two class Cristoffel symbols obtains discrete equation group;
Step 3.3:The discrete equation group is converted into into the algebra system of matrix form;
Step 3.4:The algebra system is combined into into equality constraint least square problem with sampling equation.
Specifically, according to surface theory fundamental theorem:If the first kind of curved surface and Equations of The Second Kind fundamental quantity E, F, G, L, M and N are full
Sufficient symmetry, E, F, G positive definite, E, F, G, L, M and N meet the partial differential equations of curved surface, i.e. Gauss equation group, then total differential
Equation group is in f (x, y)=f (x0,y0) (x=x0, y=y0) under initial condition, there is unique solution z=f (x, y).
The expression formula of Gauss equation group is,
X for spatial discretization mesh point abscissa, y for spatial discretization mesh point vertical coordinate, fxFor function f
First-order partial derivative to x, fxxFor second-order partial differential coefficients of the function f to x, fyFor first-order partial derivatives of the function f to y, fyyFor function f pair
The second-order partial differential coefficient E of yx、Fx、GxThe respectively first-order partial derivative of E, F, G to x, Ey、Fy、GyRespectively E, F, G is inclined to the single order of y
Derivative, For Equations of The Second Kind Cristoffel symbols.
If { (xi,yj) be the orthogonal subdivision of computational fields Ω, [0, Lx] × [0, Ly] be dimensionless standardization computational fields, max
Numerical value is rounded after { Lx, Ly }=1, the normalization that Lx is survey region horizontal length.Ly is survey region vertical-direction length
Normalization after round numerical value.For material calculation, { (xi,yj) | 0≤i≤I+1,0≤j≤J+1 } it is mark
The grid of standardization computational fields, then the finite difference approximation of first kind fundamental quantity is,
Wherein, Ei,j, Fi,j, Gi,j, be respectively the value of E, F, G on mesh point (i, j), fi,jTo simulate curved surface in mesh point
Value on (i, j);
The finite difference approximation of Equations of The Second Kind fundamental quantity is,
Wherein, Li,j, Mi,j, Ni,jThe respectively value of L, M, N on mesh point (i, j);
The finite difference of Equations of The Second Kind Cristoffel symbols is expressed as,
Wherein,For Equations of The Second Kind Christoffer
Value of that symbol on mesh point (i, j);
The finite difference form of Gauss equation group is,
(1.1.2) matrix form can be written as:
Wherein,
Wherein,
For value of above-mentioned (1.1.2) the formula right-hand vector using finite difference scheme after discrete.
Control with reference to the operative constraint of sample information, above-mentioned constrained least-squares problem (1.1.3) can be expressed as HASM institutes
The least square problem of the equality constraint of solution,
Sx=k is the sampling equation that sampled point meets, and wherein S and k is respectively sampling matrix and vector of samples;If
It is z=f (x, y) in pth sampled point (xi,yj) value, then sp,(i-1)×J+j=1,
HASM is finally translated into an equality constraint least square problem (Equality by ground sampling constraints
constraint least squares problem:LSE)
Step 4:Equality constraint least square is converted into into solution for topic and blocks object function minimum problem;
Specifically, by studying discovery, a parameter lambda is introduced, LSE problems can first pass through Lagrange multiplier methods by its turn
To turn to ask as follows and block object function minimum problem:
Wherein
Step 5:Object function minimum problem is blocked in solution and is converted into the symmetrical Indeterminate Equation Group of solution, it is described it is symmetrical not
Equation group is determined for High Accuracy Surface Modeling HASM equation group;
Specifically, it is rightDerivation, another its derivative is 0, can be obtainedWith reference toAnd Sx=k can obtain symmetrical indefinite system as follows
System:
Wherein, I is all 1 for diagonal entry, and other elements are 0 unit matrix.For matrixTransposed matrix.ST
For the transposed matrix of S.λ is the weight matrix that sampled point weight is constituted, and value is between 1~2 in HASM.
Step 6:Randomly select the iterative initial value of HASM equation group;
Step 7:Coefficient matrix in HASM equation group is entered into every trade piecemeal, and the block matrix after decomposing to coefficient matrix enters
Row storage;
Specifically, for the partitioned mode of coefficient matrix, this research gives a block algorithm of A, using the algorithm per block
Be up to u rows, and every piece of Ai∈Ru×n, it is independent that u < < n are full rank, the i.e. row per block.Hypothesis is generating a block
Ai, the block is comprising the j rows (j < u) in matrix A, and known Ai TQR be decomposed into Ai T=QjRj, make rhhIt is positioned at Rj(h,
H) element of position.Block Ai TRow dependency estimationWherein
For a line a in matrix A1Whether block A is addediCriterion be a1It is not allocated to any other piece, and a1After addition
AiRow correlation estimation βiLess than κ, κ is a positive number set in advance.In order to determine a new row a1Whether block is added
Ai, orderAnd according to existing Ai TQR decompose obtainingQR decompose, to this using QR decompose renewal side
Method is realizing.Then calculateRow correlation estimation, if the estimation is still less than κ, a1Add block Ai。
The block decomposition algorithm is described as follows, and the algorithm is realized based on C++.
Γ=1,2 are made ..., m, Γs={ l:A in A1Row have distributed to certain block }
Initialization:Make i=1, Γs=φ,
whileΓs≠Γ,do
Make Γc=Γ Γs, j=1, Γi=φ
Choose l ∈ Γc, make Ai=[a1],R1=[| | a1||2,0]T,
CalculateQ1=In-2vvT
Make dmax=| | a1||2, dmin=| | a1||2
Γc←Γc{ l }, Γs←Γs∪ { l }, Γi←Γi∪{l}
While (j < u and Γc≠φ)do
Choose l ∈ Γc
OrderV=[| | a | |2,0]T∈Rn-j
Calculate
tmax←max{dmax,||a||2},tmin←min{dmin,||a||2},
if tmin≠ 0, andThen
Update Ai←[Ai,a1]
Γc←Γc{ l }, Γs←Γs∪ { l }, Γi←Γi∪{l}
J=j+1
dmax←tmax,dmin←tmin
else
Γc←Γc\{l}
end
end
i←i+1
end
In order to improve computational efficiency, for the QR being related to decomposes, we employ Francis QR decomposition strategies, and will
It calculates and spends by O (u3) it is reduced to O (u2), u < < n.
In above-mentioned algorithm, it is related to sparse matrix block AiBetween multiplication and sparse matrix and the computing taken advantage of of vector, in vector
Product and vector addition computing.Sparse matrix is typically stored as compressed format.With application scenarios and the difference of calculating platform, matrix
Generally it is compressed to different storage formats.The selection of compressed format will consider the sparse feature and calculating platform of matrix.
To matrix storage using row compression storage mode (CSR), CSR forms are most common and flexible compressed format for this research, and it will
Nonzeros carries out being stored by row compression, and the original position of nonzero element, compression efficiency are recorded with special array
Height, compression process is readily appreciated.CSR forms and in being transplanted in different platform.Many new compressed formats are also all based on CSR
Form modifying.During this method storage n rank matrix As, it is assumed that l nonzero element is had in A, then need with a l tie up to
Amount x is deposited successively the nonzero element in A by the order of Row Column, with a l dimensional vector xJA is deposited successively by same order
In these nonzero element row numbers, while also need to introduce n+1 tieing up integer vector x(R),Indicate i-th in A
First nonzero element is stored in the position in x in row,The coefficient matrix of Indeterminate Equation Group (4) in this research
For symmetrical matrix, therefore triangular portions nonzero element need to be only stored in practice.It is corresponding to employ block row pressure for Huge types
Contracting storage mode.
The matrix realized based on above-mentioned form can be written as with vector multiplication y=Av:
y(x(R)(i))=x (i) × v (xJ(i))
end
Storage mode is compressed based on CSR rows, can analyze the calculating of above-mentioned algorithm spends and is O (n) to the maximum, wherein n is meter
Calculate grid number.
Step 8:Kuai Hang projection iterative methods are adopted to iterative initial value, HASM equation group is solved, and whether judges solving result
Convergence;
Step 9:When solving result is not restrained, Kuai Hang projection iterative methods are adopted again to solving result, solve HASM side
Journey group, and judge whether solving result restrains, if convergence, execution step 10 otherwise, re-executes step 9;
Specifically, for the method for solving of above-mentioned symmetrical uncertain system is generally direct method and iterative method.Direct method is related to
Decomposition to matrix etc. is not appropriate for extensive problem.Conventional iterative method is Krylov subspace iterative method, is located more in advance
Reason conjugate gradient method PCG, the QR decomposition method LSQR based on least square, and minimum residual error method GMRES of broad sense etc..Due to
Such iterative method needs that equation group coefficient matrix is all disposably input into internal memory, with the increase of calculation scale, such method
Do not use.Row projection iterative method can avoid problems, row projection iterative method from being widely used, and algorithm is simple, classical row
Projection iterative method such as Cimmio algorithms, Kaczmar algorithms etc..
Define HiFor set:RnThe space that real number vector is constituted, i=1 ..., p are tieed up for n.
Therefore it is anyThat is x*For p sub-spaces HiCommon factor, be linear system ATThe solution of x=b.If required (1.1.5)
In symmetrical uncertain system be Ax=b, is deducted marks according to the grid of zoning and matrix A is decomposed into block row form:
And define Pk(AiT) it is AiTProjection operator in codomain.General thought is first by xkProject to
P hyperplane
Algorithm:Block Cimmino row sciagraphies:
Choose x(0), k=0 is made,
Steps be repeated alternatively until convergence,
begin
Do in parallel i=1 ... p
δi(k)=Ai+bi-PA(AiT)x(k)=Ai+(bi-Aix(k))
end parallel
Set k=k+1
end
The method can be avoided without fully entering matrix element every time, and one piece of row of input matrix is only needed every time, protected
The solution probability of extensive problem is demonstrate,proved.But have the disadvantage that convergence rate is slow, therefore less application in practice.
Kaczmar algorithms are based on for this this research, a new block-iterative algorithm with row projection is given.By choose from work as
Front iteration point carries out orthogonal projection apart from farthest block, and will project as next iteration point, so as to accelerate convergence speed
Degree.Assume that current iteration point is xk, x is calculated firstkIn all HiOn orthogonal projection Pi(xk), for i=1 ..., then p compares
It is more all of | | Pi(xk)-xk||2And obtain wherein the maximum, that is, find out from xkOrthogonal is apart from farthest block Hi, it is assumed that | | Pj
(xk)-xk||2Maximum, i.e.,Choose xkIn HjOn projection Pj(xk) as next
Individual iteration point, i.e. xk+1=Pj(xk), the process for continuing the above obtains a sequence { xk, continuous iteration is until convergence.The algorithm is retouched
State as follows:
Initialization:Piecemeal is carried out to matrix A, initial point x is given0∈Rn, 0≤ε < 1 make k=0
Step 10:When HASM solution of equations is restrained, determine whether whether HASM solution of equations meets Gauss section
Up to neat equation group, if being unsatisfactory for, execution step 6;If meeting, exported with regard to variable to be measured according to HASM solution of equations
High-precision analog surface model..
The checking of the embodiment of the present invention is described below,
1st, numerical experimentation
First by taking standard mathematical curved surface as an example, the effectiveness of algorithm is studied.Compare the HASM methods after improving and be suitable for
The Kriging methods (FRK) of extensive Solve problems, the Spline methods (FRS) for being suitable for extensive Solve problems and it is anti-away from
From the simulated performance difference of method of weighting IDW.
Domain of definition is [0,1] × [0,1].
As shown in figure 1, randomly selecting 1/100 sampled point on standard mathematical curved surface, all experiments are transported on 64 machines
OK, it is Gauss-Codazii equation group that criterion is shut down in HASM.Zoning is deducted marks as 1000 × 1000.u=100, κ=
5. the measurement of pair calculation error, using mean absolute error RMSE, its computing formula is as follows:
Wherein fi,For the i-th th actual value and the analogue value, N is sampled point number, is counted
Calculate result as shown in table 1:
The distinct methods computational efficiency com-parison and analysis of table 1
Method | HASM | G-IDW | FRK | FRS |
RMSE | 1.3076×10-4 | 1.66×10-2 | 2.20×10-3 | 5.78×10-4 |
Calculating time (s) | 54.06s | 20.11s | 40.00s | 24.79s |
As a result show, HASM computational accuracy highests, next to that FRS methods.HASM computational accuracies are respectively IDW, FRK and
127 times of FRS, 17 times and 4 times.But the calculating speed of HASM is less than additive method.This is because needing in HASM calculating process
It is discrete to partial differential equations finite difference, need group of equations right-hand vector, and solving equation group etc., calculating process is more multiple
It is miscellaneous.
(a) HASM according to Fig. 2, (b) FRK, (c) G-IDW, and (d) FRS simulate the Error Graph of curved surface and true curved surface,
Therein, it can be seen that IDW simulation errors are maximum, maximum error is at border and peak value.Maximum deviation is 0.2139.FRK
Also larger error is generated, maximum error occurs in boundary for -0.0123. errors most for the maximum deviation of 0.02737.FRS
Little is HASM methods, it can be seen that error distribution is relatively uniform.
Although the calculating time of HASM is more than additive method, it is linearly proportional with calculating grid that it calculates the time.
Table 2 gives the calculating time of HASM under different calculation scales.The calculating time can be expressed as with the relational expression for calculating grid:
T=1.1099 × 10-5n+26.7447,R2=0.91
The calculating time of HASM under the different calculation scales of table 2.
Calculate grid number | 1million | 4million | 9million | 16million | 25million |
Calculating time (s) | 54.06 | 88.21 | 107.54 | 155.19 | 339.15 |
2nd, real case
With China to study area, the distribution of many mean annual precipitations of past 50 years 1961-2010 is calculated using said method,
Spatial resolution is 1km, and it is 19,606,916 that correspondence calculates grid number.
All sides are can be seen that from many mean annual precipitation distribution results of Chinese scope of HASM, FRK, IDW and FRS simulation
Method can preferably reflect the distribution trend of precipitation.The curved surface of HASM and FRK methods simulation is with respect to additive method more more
It is smooth.IDW and FRS methods occur in that many buphthalmos phenomenons, and FRS methods generate vibration by a relatively large margin in boundary.
Random selection 15% as check post verify distinct methods.This process is repeated 10 times, and calculates this 10 times
Average RMSE.As a result it is as shown in table 3.It can be seen that HASM computational accuracies are highests, its simulation precision distinguishes my FRK, IDW and
1.4,1.5 and 1.6 times of FRS.The simulation error of FRS is maximum.IDW calculates the time at least, next to that HASM.
The comparison of distinct methods in the real case of table 3.
Method | HASM | FRK | IDW | FRS |
RMSE(mm) | 90.87 | 123.51 | 133.44 | 147.10 |
Calculating time (s) | 166 | 237 | 63 | 172 |
Numerical experimentation and real case, show the HASM methods after improving while precision is ensured so that during its calculating
Between with calculate grid number it is linear, in storage, due to solve constrained least-squares problem when, employ block row projection
Algorithm, only needs one piece of row of storage matrix, and it is stored using row compression storage mode, it is ensured that the rule of Solve problems
Mould.
The foregoing is only presently preferred embodiments of the present invention, not to limit the present invention, all spirit in the present invention and
Within principle, any modification, equivalent substitution and improvements made etc. should be included within the scope of the present invention.
Claims (7)
1. a kind of High Accuracy Surface Modeling method based on big data, comprises the following steps:
Step 1:The geographic coordinate information and variable sampled value to be measured of each sampled point are created, the geographic coordinate information includes adopting
The longitude information of sampling point and the latitude information of sampled point;
Step 2:Mesh point form is turned to by regional space to be measured is discrete, mesh point centrifugal pump is obtained, according to geographic coordinate information
Sampling equation is set up with variable sampled value to be measured, the sampling equation is used to whether judge sampled point in mesh point, wherein, such as
On the mesh point, then the value of the mesh point is variable sampled value to be measured to fruit sampled point;If sampled point is in grid,
The approximation sample value that will be obtained using Taylor expansion on the nearest mesh point of the sampled point on the mesh point;
Step 3:First kind fundamental quantity E, F, G and Equations of The Second Kind base of each mesh point of region to be measured are calculated according to mesh point centrifugal pump
This amount L, M, N, wherein first fundamental quantity is used to represent the length of simulation Curves on surfaces, the area of simulation curved surface and simulation
The curvature of Curves on surfaces, the second fundamental quantity is used for the local buckling intensity of variation of expression simulation curved surface, will use the first base
It is discrete that the partial differential equations of the curved surface that this amount and second fundamental quantity are represented carry out higher difference, obtains discrete equation group corresponding
Algebra system, equality constraint least square problem is combined into by the algebra system with the sampling equation;
Step 4:Equality constraint least square is converted into into solution for topic and blocks object function minimum problem;
Step 5:Object function minimum problem is blocked in solution and is converted into the symmetrical Indeterminate Equation Group of solution, the symmetrical indefinite side
Journey group is High Accuracy Surface Modeling HASM equation group;
Step 6:Randomly select the iterative initial value of HASM equation group;
Step 7:Coefficient matrix in HASM equation group is entered into every trade piecemeal, and the block matrix after decomposing to coefficient matrix is deposited
Storage;
Step 8:Kuai Hang projection iterative methods are adopted to iterative initial value, HASM equation group is solved, and judges whether solving result restrains;
Step 9:When solving result is not restrained, Kuai Hang projection iterative methods are adopted again to solving result, solve HASM equation group,
And judge whether solving result restrains, if convergence, execution step 10 otherwise, re-executes step 9;
Step 10:When HASM solution of equations is restrained, determine whether whether HASM solution of equations meets Gauss Kodak neat
Equation group, if being unsatisfactory for, execution step 6;If meeting, exported with regard to the high-precision of variable to be measured according to HASM solution of equations
Degree simulation surface model.
2. method according to claim 1, it is characterised in that the partial differential equations of the curved surface are:
Wherein,F=fx·fy,
X for spatial discretization mesh point abscissa, y for spatial discretization mesh point vertical coordinate, fxIt is function f to x's
First-order partial derivative, fxxFor second-order partial differential coefficients of the function f to x, fyFor first-order partial derivatives of the function f to y, fyyBe function f to y two
Rank partial derivative Ex、Fx、GxThe respectively first-order partial derivative of E, F, G to x, Ey、Fy、GyThe respectively first-order partial derivative of E, F, G to y, For Equations of The Second Kind Cristoffel symbols.
3. method according to claim 2, it is characterised in that the step 3 is specifically included:
Step 3.1:Area to be measured is calculated according to the finite difference approximation of first kind fundamental quantity E, F, G and Equations of The Second Kind fundamental quantity L, M, N
The first kind fundamental quantity of each mesh point of domain and the value of Equations of The Second Kind fundamental quantity;
Step 3.2:Finite difference approximation, the finite difference approximation of Equations of The Second Kind fundamental quantity and Equations of The Second Kind with reference to first kind fundamental quantity
The finite difference of Cristoffel symbols obtains discrete equation group;
Step 3.3:The discrete equation group is converted into into the algebra system of matrix form;
Step 3.4:The algebra system is combined into into equality constraint least square problem with sampling equation.
4. method according to claim 3, it is characterised in that by the coefficient matrix in HASM equation group in the step 7
The concrete grammar for entering every trade piecemeal is:If each sub-block A of coefficient matrices AiBe up to u rows, and Ai∈Ru×n, u < < n are
Full rank, the i.e. row per block are independent, it is assumed that generating sub-block Ai, the sub-block is comprising j rows (the j < in matrix A
And known A u),i TQR be decomposed into Ai T=QjRj, block Ai TRow dependency estimationWherein rhhIt is positioned at Rj(h, h) position element, a1For a line in matrix A, orderAccording to Ai TQR decompose, update method is decomposed obtaining using QRQR decompose, then calculateRow
Correlation estimation, if the estimation is still less than κ, a1Add block Ai, wherein, κ is a positive number set in advance.
5. method according to claim 4, it is characterised in that the QR decomposes and adopts FrancisQR decomposition strategies.
6. the method according to claim 4 or 5, it is characterised in that to the block square after coefficient matrix decomposition in the step 7
The mode that battle array is stored is row compression storage mode CSR.
7. method according to claim 6, it is characterised in that the step 8 and step 9 are specifically included:Assume current changing
Generation point is to judge xkWhether restrain, if not restraining, find out from xkOrthogonal chooses x apart from farthest blockkThrowing on described piece
Shadow is used as next iteration point.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710013712.0A CN106683185B (en) | 2017-01-09 | 2017-01-09 | High-precision curved surface modeling method based on big data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201710013712.0A CN106683185B (en) | 2017-01-09 | 2017-01-09 | High-precision curved surface modeling method based on big data |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106683185A true CN106683185A (en) | 2017-05-17 |
CN106683185B CN106683185B (en) | 2020-04-03 |
Family
ID=58849422
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201710013712.0A Expired - Fee Related CN106683185B (en) | 2017-01-09 | 2017-01-09 | High-precision curved surface modeling method based on big data |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106683185B (en) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110555189A (en) * | 2019-08-26 | 2019-12-10 | 滁州学院 | Spatial interpolation method based on reverse computing thinking |
CN111475475A (en) * | 2020-04-01 | 2020-07-31 | 中国人民解放军火箭军工程大学 | Differentiated compression storage model of data matrix |
CN115374682A (en) * | 2022-10-25 | 2022-11-22 | 中国科学院地理科学与资源研究所 | Space-time collaborative high-precision curved surface modeling method and system |
CN116090315A (en) * | 2023-04-07 | 2023-05-09 | 中国科学院地理科学与资源研究所 | Precipitation space distribution simulation method considering space heterogeneity and data real-time update |
CN116108761A (en) * | 2023-04-12 | 2023-05-12 | 中国科学院地理科学与资源研究所 | Regional climate simulation method and system for coupling deep learning and HASM |
CN112541158B (en) * | 2020-12-17 | 2023-10-03 | 中国科学院数学与系统科学研究院 | Method for space curved surface intersection executed by electronic equipment and electronic equipment |
CN117875091A (en) * | 2024-03-12 | 2024-04-12 | 中国科学院地理科学与资源研究所 | Optimization method and device of high-precision curved surface modeling method based on adaptive algorithm |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101271596A (en) * | 2007-03-21 | 2008-09-24 | 中国科学院地理科学与资源研究所 | Method for establishing digital model of landform curved surface based on basic law of theory of surfaces |
CN103077274A (en) * | 2013-01-05 | 2013-05-01 | 中国科学院地理科学与资源研究所 | High-precision curve modeling intelligent method and device |
CN103235974A (en) * | 2013-04-25 | 2013-08-07 | 中国科学院地理科学与资源研究所 | Method for improving processing efficiency of massive spatial data |
-
2017
- 2017-01-09 CN CN201710013712.0A patent/CN106683185B/en not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101271596A (en) * | 2007-03-21 | 2008-09-24 | 中国科学院地理科学与资源研究所 | Method for establishing digital model of landform curved surface based on basic law of theory of surfaces |
CN103077274A (en) * | 2013-01-05 | 2013-05-01 | 中国科学院地理科学与资源研究所 | High-precision curve modeling intelligent method and device |
CN103235974A (en) * | 2013-04-25 | 2013-08-07 | 中国科学院地理科学与资源研究所 | Method for improving processing efficiency of massive spatial data |
Non-Patent Citations (4)
Title |
---|
M.BELLALIJ等: "Some properties of range restricted GMRES methods", 《JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS》 * |
王世海等: "逐次最小二乘在高精度曲面建模方法(HASM)中的应用", 《武汉大学学报信息科学版》 * |
赵娜等: "高精度曲面建模的一种快速算法", 《地球信息科学学报》 * |
赵明伟等: "高精度曲面建模优化方案", 《中国图象图形学报》 * |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110555189A (en) * | 2019-08-26 | 2019-12-10 | 滁州学院 | Spatial interpolation method based on reverse computing thinking |
CN110555189B (en) * | 2019-08-26 | 2022-09-09 | 滁州学院 | Spatial interpolation method based on reverse computing thinking |
CN111475475A (en) * | 2020-04-01 | 2020-07-31 | 中国人民解放军火箭军工程大学 | Differentiated compression storage model of data matrix |
CN112541158B (en) * | 2020-12-17 | 2023-10-03 | 中国科学院数学与系统科学研究院 | Method for space curved surface intersection executed by electronic equipment and electronic equipment |
CN115374682A (en) * | 2022-10-25 | 2022-11-22 | 中国科学院地理科学与资源研究所 | Space-time collaborative high-precision curved surface modeling method and system |
CN116090315A (en) * | 2023-04-07 | 2023-05-09 | 中国科学院地理科学与资源研究所 | Precipitation space distribution simulation method considering space heterogeneity and data real-time update |
CN116108761A (en) * | 2023-04-12 | 2023-05-12 | 中国科学院地理科学与资源研究所 | Regional climate simulation method and system for coupling deep learning and HASM |
CN117875091A (en) * | 2024-03-12 | 2024-04-12 | 中国科学院地理科学与资源研究所 | Optimization method and device of high-precision curved surface modeling method based on adaptive algorithm |
CN117875091B (en) * | 2024-03-12 | 2024-05-10 | 中国科学院地理科学与资源研究所 | Optimization method and device of high-precision curved surface modeling method based on adaptive algorithm |
Also Published As
Publication number | Publication date |
---|---|
CN106683185B (en) | 2020-04-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106683185A (en) | High accuracy surface modeling method based on big data | |
US10439594B2 (en) | Actually-measured marine environment data assimilation method based on sequence recursive filtering three-dimensional variation | |
Braaten et al. | A study of recirculating flow computation using body-fitted coordinates: consistency aspects and mesh skewness | |
CN103106301B (en) | A kind of method of the calculating radiation shield be coupled with characteristic line method based on Monte Carlo method | |
CN104007479B (en) | A kind of Ionospheric Tomography based on multiple dimensioned subdivision and Ionospheric delay correcting method | |
Yue et al. | A multi‐grid method of high accuracy surface modeling and its validation | |
Chen et al. | Global shallow water models based on multi-moment constrained finite volume method and three quasi-uniform spherical grids | |
CN115374682A (en) | Space-time collaborative high-precision curved surface modeling method and system | |
CN105046046A (en) | Ensemble Kalman filter localization method | |
Cai et al. | Efficient mass-and energy-preserving schemes for the coupled nonlinear Schrödinger–Boussinesq system | |
Crockatt et al. | Improvements to a class of hybrid methods for radiation transport: Nyström reconstruction and defect correction methods | |
CN103077274B (en) | High Accuracy Surface Modeling Intelligentized method and device | |
Zheng et al. | Towards a new multiscale air quality transport model using the fully unstructured anisotropic adaptive mesh technology of fluidity (version 4.1. 9) | |
CN111339688A (en) | Method for solving rocket simulation model time domain equation based on big data parallel algorithm | |
Shaw et al. | Multidimensional method-of-lines transport for atmospheric flows over steep terrain using arbitrary meshes | |
CN103971411A (en) | Space curved surface modeling method by utilizing space curved surface sampling points of three-dimensional objects | |
Roberts | Advanced response matrix methods for full core analysis | |
CN105760572A (en) | Finite element grid encoding and indexing method for three-dimensional surface grid model | |
Sørensen et al. | A mass-conserving and multi-tracer efficient transport scheme in the online integrated Enviro-HIRLAM model | |
CN109960776B (en) | Improved method for hydraulic travel time and hydraulic signal attenuation inversion calculation | |
CN103678788A (en) | Spatial data interpolation and curved surface fitting method based on curved surface theory | |
Sofiev et al. | Construction of an Eulerian atmospheric dispersion model based on the advection algorithm of M. Galperin: dynamic cores v. 4 and 5 of SILAM v. 5.5. | |
Kumar et al. | L2 estimates for weak Galerkin finite element methods for second-order wave equations with polygonal meshes | |
CN111222250B (en) | Method for improving parameter solving efficiency of geospatial coordinate transformation model | |
CN117828916A (en) | Advanced geological forecasting method and system adapting to complex terrain by induced polarization method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CF01 | Termination of patent right due to non-payment of annual fee | ||
CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200403 Termination date: 20220109 |