CN106683185A - High accuracy surface modeling method based on big data - Google Patents

High accuracy surface modeling method based on big data Download PDF

Info

Publication number
CN106683185A
CN106683185A CN201710013712.0A CN201710013712A CN106683185A CN 106683185 A CN106683185 A CN 106683185A CN 201710013712 A CN201710013712 A CN 201710013712A CN 106683185 A CN106683185 A CN 106683185A
Authority
CN
China
Prior art keywords
hasm
equations
equation group
point
equation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710013712.0A
Other languages
Chinese (zh)
Other versions
CN106683185B (en
Inventor
赵娜
岳天祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Geographic Sciences and Natural Resources of CAS
Original Assignee
Institute of Geographic Sciences and Natural Resources of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Geographic Sciences and Natural Resources of CAS filed Critical Institute of Geographic Sciences and Natural Resources of CAS
Priority to CN201710013712.0A priority Critical patent/CN106683185B/en
Publication of CN106683185A publication Critical patent/CN106683185A/en
Application granted granted Critical
Publication of CN106683185B publication Critical patent/CN106683185B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/20Finite element generation, e.g. wire-frame surface description, tesselation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/05Geographic models
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • G06T17/30Polynomial surface description

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Geometry (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Mathematical Analysis (AREA)
  • Pure & Applied Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Mathematical Optimization (AREA)
  • Algebra (AREA)
  • Remote Sensing (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Complex Calculations (AREA)

Abstract

The invention relates to a high accuracy surface modeling method based on big data. The method comprises the following steps: creating geographic coordinate information and to-be-tested variable sampling values of all sampling points; turning a to-be-tested regional space into a grid point form through discretization, and establishing a sampling equation; conducting high order difference discretization on a partial differential equation set of a surface, obtaining a corresponding algebraic system, combining the algebraic system and the sampling equation to form an equality constrain least squares problem, converting the problem into a solve cross cutting object function minimum value problem, and then converting the minimum value problem into a solve symmetry indeterminate equation set; randomly selecting iteration initial values; blocking a coefficient matrix, and storing the block matrixes after decomposition; solving an HASM equation set through a block line projection iterative method, and determining whether a solving result is convergent; determining whether a solution meets demands of a Gauss and C.odazzi equation set; and outputting a high accuracy simulation surface model. Large-scale problems can be solved, the needed storage space is small, and defects of HASM for solving large-scale problems are prevented.

Description

A kind of High Accuracy Surface Modeling method based on big data
Technical field
The present invention relates to be related to a kind of method that space curved surface for extensive problem is modeled, can be used for big data background The fields such as generation, meteorology, Biomass, the spatial distribution simulation of soil of lower digital elevation model, it is also possible to be considered as curved surface grid A kind of method approached, can be used for the surface modeling of the aspects such as large-scale physics, chemistry, medical science.
Background technology
In order to perplex the error problem and Issues On Multi-scales of curved surface modeling since solving half a century, we are several with differential What principle and optimal control opinion are theoretical basiss, establish one with approximate data of overall importance (including remotely-sensed data and global mould Type coarse resolution analog data) be for driving field, with local high accuracy data (including monitoring network data and investigation sampled data) High Accuracy Surface Modeling (High Accuracy Surface Modelling, the be abbreviated as HASM) method of optimal control condition, And widely applied in more than 20 years on Research foundation, refinement defines epigeosphere modeling philosophy.
HASM can finally be converted into an equality constraint least square problem (Equality by ground sampling constraints constraint least squares problem:LSE), in order to sample ensureing that the sample point analogue value is equal to Under conditions of value, keep overall simulation error minimum.Make full use of sample information, be also ensure iteration level off to best simulation effect The effective means of fruit.Although HASM methods have very big improvement than traditional interpolation method on simulation precision, table is studied Bright, current HASM can only process small-scale problem, and above-mentioned solution procedure is that LSE problems are converted into into normal equation system to solve.One Aspect, the equation group condition number of coefficient matrix after conversion is very big, causes the sensitivity and pathosis of problem, and this causes to solve The alternative manner convergence rate of equation group is very slow, or does not restrain, and thereby results in and can cannot get the approximate of former Solve problems Solution;On the other hand, currently employed preconditioning conjugate gradient solves HASM equation group to be needed equation group coefficient matrix whole Disposable input internal memory, with the increase of Solve problems scale, its memory space can rise appreciably, for extensive problem work as Front solution strategies are not used.Current HASM often processes plan for the simulation of national 1km resolution datas using burst Slightly, the error at partition boundaries is which increased, so as to reduce the overall precision of analog result.
The content of the invention
Defect of the present invention for existing HASM models in extensive problem is solved, there is provided a kind of improved HASM, required memory space is little, can solve extensive problem in the case where precision is ensured.
The technical scheme that the present invention solves above-mentioned technical problem is as follows:A kind of High Accuracy Surface Modeling side based on big data Method, comprises the following steps:
Step 1:The geographic coordinate information and variable sampled value to be measured of each sampled point are created, is wrapped in the geographic coordinate information Include the longitude information of sampled point and the latitude information of sampled point;
Step 2:Mesh point form is turned to by regional space to be measured is discrete, mesh point centrifugal pump is obtained, according to geographical coordinate Information and variable sampled value to be measured set up sampling equation, and the sampling equation is used to whether judge sampled point in mesh point, its In, if sampled point is on the mesh point, the value of the mesh point is variable sampled value to be measured;If sampled point is in grid Approximation sample value that is interior, then will being obtained using Taylor expansion on the nearest mesh point of the sampled point on the mesh point;
Step 3:First kind fundamental quantity E, F, G and second of each mesh point of region to be measured is calculated according to mesh point centrifugal pump Class fundamental quantity L, M, N, wherein first fundamental quantity be used for represent simulation Curves on surfaces length, simulation curved surface area and The curvature of simulation Curves on surfaces, the second fundamental quantity is used to represent the local buckling intensity of variation of simulation curved surface, will be with the It is discrete that the partial differential equations of the curved surface that one fundamental quantity and second fundamental quantity are represented carry out higher difference, obtains discrete equation group pair The algebra system answered, equality constraint least square problem is combined into by the algebra system with the sampling equation;
Step 4:Equality constraint least square is converted into into solution for topic and blocks object function minimum problem;
Step 5:Object function minimum problem is blocked in solution and is converted into the symmetrical Indeterminate Equation Group of solution, it is described it is symmetrical not Equation group is determined for High Accuracy Surface Modeling HASM equation group;
Specifically,
Step 6:Randomly select the iterative initial value of HASM equation group;
Step 7:Coefficient matrix in HASM equation group is entered into every trade piecemeal, and the block matrix after decomposing to coefficient matrix enters Row storage;
Step 8:Kuai Hang projection iterative methods are adopted to iterative initial value, HASM equation group is solved, and whether judges solving result Convergence;
Step 9:When solving result is not restrained, Kuai Hang projection iterative methods are adopted again to solving result, solve HASM side Journey group, and judge whether solving result restrains, if convergence, execution step 10 otherwise, re-executes step 9;
Step 10:When HASM solution of equations is restrained, determine whether whether HASM solution of equations meets Gauss section Up to neat equation group, if being unsatisfactory for, execution step 6;If meeting, exported with regard to variable to be measured according to HASM solution of equations High-precision analog surface model.
Present invention seek to address that the big data problem in space curved surface modeling field, has the advantage that:
1st, improve and developed existing model, when the model after improvement has relatively low storage demand and less calculating Between;
2nd, truncated system is introduced, gives the optimization method for solving constrained least-squares problem, it is as a result more stable;
3rd, give large-scale equation group coefficient matrix specific partitioned mode, it is ensured that the Line independent between matrix rows Property, it is to avoid information redundancy, so as to give the accelerating algorithm Ji Kuaihang projection iterative method of row projection algorithm, improves method Convergence rate;
4th, the method after improving can solve extensive problem, and the calculating time is linear with calculating grid number, required to deposit Storage space is far smaller than nonzero element number in HASM equation group coefficient matrixes;In the case where precision is ensured, HASM is solved Defect in extensive problem is solved.
On the basis of above-mentioned technical proposal, the present invention can also do following improvement.
Further, the partial differential equations of the curved surface are:
Wherein, E=1+fx 2, F=fx·fy,
X for spatial discretization mesh point abscissa, y for spatial discretization mesh point vertical coordinate, fxFor function f First-order partial derivative to x, fxxFor second-order partial differential coefficients of the function f to x, fyFor first-order partial derivatives of the function f to y, fyyFor function f pair The second-order partial differential coefficient E of yx、Fx、GxThe respectively first-order partial derivative of E, F, G to x, Ey、Fy、GyRespectively E, F, G is inclined to the single order of y Derivative, For Equations of The Second Kind Cristoffel symbols.
It is using the beneficial effect of above-mentioned further scheme so that HASM is set up in complete differential geometry theoretical basiss On, it is ensured that the stability of HASM, improve the simulation precision of HASM.
Further, the step 3 is specifically included:
Step 3.1:Calculated according to the finite difference approximation of first kind fundamental quantity E, F, G and Equations of The Second Kind fundamental quantity L, M, N and treated Survey the first kind fundamental quantity of each mesh point of region and the value of Equations of The Second Kind fundamental quantity;
Step 3.2:Finite difference approximation, the finite difference approximation of Equations of The Second Kind fundamental quantity with reference to first kind fundamental quantity and The finite difference of two class Cristoffel symbols obtains discrete equation group;
Step 3.3:The discrete equation group is converted into into the algebra system of matrix form;
Step 3.4:The algebra system is combined into into equality constraint least square problem with sampling equation.
It is that HASM is finally translated into an equation by ground sampling constraints using the beneficial effect of above-mentioned further scheme Constrained least-squares problem, in order under conditions of ensureing that the sample point analogue value is equal to sampled value, keep non-detachable mold Intend error minimum.Sample information is made full use of, is also to ensure that iteration levels off to the effective means of best simulation effect.
Further, it is by the concrete grammar that the coefficient matrix in HASM equation group enters every trade piecemeal in the step 7:If being Each sub-block A of matrix number AiBe up to u rows, and Ai∈Ru×n, it is independent that u < < n are full rank, the i.e. row per block, it is assumed that Generating sub-block Ai, the sub-block is comprising the j rows (j < u) in matrix A, and known Ai TQR be decomposed into Ai T=QjRj, Block Ai TRow dependency estimationWhereinrhhIt is positioned at Rj(h, H) element of position, a1For a line in matrix A, orderAccording to Ai TQR decompose, using QR decompose update method To obtainQR decompose, then calculateRow correlation estimation, if the estimation is still less than κ, a1Add block Ai, its In, κ is a positive number set in advance.
Further, the QR decomposes using Francis QR decomposition strategies.
It is, for the QR being related to decomposes, to be decomposed using Francis QR using the beneficial effect of above-mentioned further scheme Strategy, can be calculated cost by O (u3) it is reduced to O (u2), u < < n, so as to improve computational efficiency.The partitioning of matrix can be accelerated The convergence of row projection iterative method, reduces HASM solving equations and calculates the time.
Further, the mode for being stored to the block matrix after coefficient matrix decomposition in the step 7 is row compression storage Mode CSR.
It is that CSR forms are most common and flexible compressed format using the beneficial effect of above-mentioned further scheme, it is by square The nonzero element of battle array carries out being stored by row compression, and the original position of nonzero element is recorded with special array, and compression efficiency is high, Compression process readily appreciates, thereby dramatically reduces memory requirements.
Further, the step 8 and step 9 are specifically included:Assume that current iteration point is to judge xkWhether restrain, if not Convergence, then find out from xkOrthogonal chooses x apart from farthest blockkProjection on described piece is used as next iteration point.
It is to accelerate convergence rate using the beneficial effect of above-mentioned further scheme.
Description of the drawings
Fig. 1 is a kind of High Accuracy Surface Modeling method and step flow chart based on big data provided in an embodiment of the present invention;
Fig. 2 is standard mathematical curved surface and sampling point distributions figure;
Fig. 3 is the Error Graph that HASM, FRK, IDW and FRS simulate curved surface and true curved surface.
Specific embodiment
The principle and feature of the present invention are described below in conjunction with accompanying drawing, example is served only for explaining the present invention, and It is non-for limiting the scope of the present invention.
As shown in figure 1, a kind of High Accuracy Surface Modeling method based on big data provided in an embodiment of the present invention, including with Lower step:
Step 1:The geographic coordinate information and variable sampled value to be measured of each sampled point are created, is wrapped in the geographic coordinate information Include the longitude information of sampled point and the latitude information of sampled point;
Step 2:Mesh point form is turned to by regional space to be measured is discrete, mesh point centrifugal pump is obtained, according to geographical coordinate Information and variable sampled value to be measured set up sampling equation, and the sampling equation is used to whether judge sampled point in mesh point, its In, if sampled point is on the mesh point, the value of the mesh point is variable sampled value to be measured;If sampled point is in grid Approximation sample value that is interior, then will being obtained using Taylor expansion on the nearest mesh point of the sampled point on the mesh point;
Step 3:First kind fundamental quantity E, F, G and second of each mesh point of region to be measured is calculated according to mesh point centrifugal pump Class fundamental quantity L, M, N, wherein first fundamental quantity be used for represent simulation Curves on surfaces length, simulation curved surface area and The curvature of simulation Curves on surfaces, the second fundamental quantity is used to represent the local buckling intensity of variation of simulation curved surface, will be with the It is discrete that the partial differential equations of the curved surface that one fundamental quantity and second fundamental quantity are represented carry out higher difference, obtains discrete equation group pair The algebra system answered, equality constraint least square problem is combined into by the algebra system with the sampling equation;
The step 3 is specifically included:
Step 3.1:Calculated according to the finite difference approximation of first kind fundamental quantity E, F, G and Equations of The Second Kind fundamental quantity L, M, N and treated Survey the first kind fundamental quantity of each mesh point of region and the value of Equations of The Second Kind fundamental quantity;
Step 3.2:Finite difference approximation, the finite difference approximation of Equations of The Second Kind fundamental quantity with reference to first kind fundamental quantity and The finite difference of two class Cristoffel symbols obtains discrete equation group;
Step 3.3:The discrete equation group is converted into into the algebra system of matrix form;
Step 3.4:The algebra system is combined into into equality constraint least square problem with sampling equation.
Specifically, according to surface theory fundamental theorem:If the first kind of curved surface and Equations of The Second Kind fundamental quantity E, F, G, L, M and N are full Sufficient symmetry, E, F, G positive definite, E, F, G, L, M and N meet the partial differential equations of curved surface, i.e. Gauss equation group, then total differential Equation group is in f (x, y)=f (x0,y0) (x=x0, y=y0) under initial condition, there is unique solution z=f (x, y).
The expression formula of Gauss equation group is,
X for spatial discretization mesh point abscissa, y for spatial discretization mesh point vertical coordinate, fxFor function f First-order partial derivative to x, fxxFor second-order partial differential coefficients of the function f to x, fyFor first-order partial derivatives of the function f to y, fyyFor function f pair The second-order partial differential coefficient E of yx、Fx、GxThe respectively first-order partial derivative of E, F, G to x, Ey、Fy、GyRespectively E, F, G is inclined to the single order of y Derivative, For Equations of The Second Kind Cristoffel symbols.
If { (xi,yj) be the orthogonal subdivision of computational fields Ω, [0, Lx] × [0, Ly] be dimensionless standardization computational fields, max Numerical value is rounded after { Lx, Ly }=1, the normalization that Lx is survey region horizontal length.Ly is survey region vertical-direction length Normalization after round numerical value.For material calculation, { (xi,yj) | 0≤i≤I+1,0≤j≤J+1 } it is mark The grid of standardization computational fields, then the finite difference approximation of first kind fundamental quantity is,
Wherein, Ei,j, Fi,j, Gi,j, be respectively the value of E, F, G on mesh point (i, j), fi,jTo simulate curved surface in mesh point Value on (i, j);
The finite difference approximation of Equations of The Second Kind fundamental quantity is,
Wherein, Li,j, Mi,j, Ni,jThe respectively value of L, M, N on mesh point (i, j);
The finite difference of Equations of The Second Kind Cristoffel symbols is expressed as,
Wherein,For Equations of The Second Kind Christoffer Value of that symbol on mesh point (i, j);
The finite difference form of Gauss equation group is,
(1.1.2) matrix form can be written as:
Wherein,
Wherein,
For value of above-mentioned (1.1.2) the formula right-hand vector using finite difference scheme after discrete.
Control with reference to the operative constraint of sample information, above-mentioned constrained least-squares problem (1.1.3) can be expressed as HASM institutes The least square problem of the equality constraint of solution,
Sx=k is the sampling equation that sampled point meets, and wherein S and k is respectively sampling matrix and vector of samples;If It is z=f (x, y) in pth sampled point (xi,yj) value, then sp,(i-1)×J+j=1,
HASM is finally translated into an equality constraint least square problem (Equality by ground sampling constraints constraint least squares problem:LSE)
Step 4:Equality constraint least square is converted into into solution for topic and blocks object function minimum problem;
Specifically, by studying discovery, a parameter lambda is introduced, LSE problems can first pass through Lagrange multiplier methods by its turn To turn to ask as follows and block object function minimum problem:
Wherein
Step 5:Object function minimum problem is blocked in solution and is converted into the symmetrical Indeterminate Equation Group of solution, it is described it is symmetrical not Equation group is determined for High Accuracy Surface Modeling HASM equation group;
Specifically, it is rightDerivation, another its derivative is 0, can be obtainedWith reference toAnd Sx=k can obtain symmetrical indefinite system as follows System:
Wherein, I is all 1 for diagonal entry, and other elements are 0 unit matrix.For matrixTransposed matrix.ST For the transposed matrix of S.λ is the weight matrix that sampled point weight is constituted, and value is between 1~2 in HASM.
Step 6:Randomly select the iterative initial value of HASM equation group;
Step 7:Coefficient matrix in HASM equation group is entered into every trade piecemeal, and the block matrix after decomposing to coefficient matrix enters Row storage;
Specifically, for the partitioned mode of coefficient matrix, this research gives a block algorithm of A, using the algorithm per block Be up to u rows, and every piece of Ai∈Ru×n, it is independent that u < < n are full rank, the i.e. row per block.Hypothesis is generating a block Ai, the block is comprising the j rows (j < u) in matrix A, and known Ai TQR be decomposed into Ai T=QjRj, make rhhIt is positioned at Rj(h, H) element of position.Block Ai TRow dependency estimationWherein For a line a in matrix A1Whether block A is addediCriterion be a1It is not allocated to any other piece, and a1After addition AiRow correlation estimation βiLess than κ, κ is a positive number set in advance.In order to determine a new row a1Whether block is added Ai, orderAnd according to existing Ai TQR decompose obtainingQR decompose, to this using QR decompose renewal side Method is realizing.Then calculateRow correlation estimation, if the estimation is still less than κ, a1Add block Ai
The block decomposition algorithm is described as follows, and the algorithm is realized based on C++.
Γ=1,2 are made ..., m, Γs={ l:A in A1Row have distributed to certain block }
Initialization:Make i=1, Γs=φ,
whileΓs≠Γ,do
Make Γc=Γ Γs, j=1, Γi
Choose l ∈ Γc, make Ai=[a1],R1=[| | a1||2,0]T,
CalculateQ1=In-2vvT
Make dmax=| | a1||2, dmin=| | a1||2
Γc←Γc{ l }, Γs←Γs∪ { l }, Γi←Γi∪{l}
While (j < u and Γc≠φ)do
Choose l ∈ Γc
OrderV=[| | a | |2,0]T∈Rn-j
Calculate
tmax←max{dmax,||a||2},tmin←min{dmin,||a||2},
if tmin≠ 0, andThen
Update Ai←[Ai,a1]
Γc←Γc{ l }, Γs←Γs∪ { l }, Γi←Γi∪{l}
J=j+1
dmax←tmax,dmin←tmin
else
Γc←Γc\{l}
end
end
i←i+1
end
In order to improve computational efficiency, for the QR being related to decomposes, we employ Francis QR decomposition strategies, and will It calculates and spends by O (u3) it is reduced to O (u2), u < < n.
In above-mentioned algorithm, it is related to sparse matrix block AiBetween multiplication and sparse matrix and the computing taken advantage of of vector, in vector Product and vector addition computing.Sparse matrix is typically stored as compressed format.With application scenarios and the difference of calculating platform, matrix Generally it is compressed to different storage formats.The selection of compressed format will consider the sparse feature and calculating platform of matrix. To matrix storage using row compression storage mode (CSR), CSR forms are most common and flexible compressed format for this research, and it will Nonzeros carries out being stored by row compression, and the original position of nonzero element, compression efficiency are recorded with special array Height, compression process is readily appreciated.CSR forms and in being transplanted in different platform.Many new compressed formats are also all based on CSR Form modifying.During this method storage n rank matrix As, it is assumed that l nonzero element is had in A, then need with a l tie up to Amount x is deposited successively the nonzero element in A by the order of Row Column, with a l dimensional vector xJA is deposited successively by same order In these nonzero element row numbers, while also need to introduce n+1 tieing up integer vector x(R),Indicate i-th in A First nonzero element is stored in the position in x in row,The coefficient matrix of Indeterminate Equation Group (4) in this research For symmetrical matrix, therefore triangular portions nonzero element need to be only stored in practice.It is corresponding to employ block row pressure for Huge types Contracting storage mode.
The matrix realized based on above-mentioned form can be written as with vector multiplication y=Av:
y(x(R)(i))=x (i) × v (xJ(i))
end
Storage mode is compressed based on CSR rows, can analyze the calculating of above-mentioned algorithm spends and is O (n) to the maximum, wherein n is meter Calculate grid number.
Step 8:Kuai Hang projection iterative methods are adopted to iterative initial value, HASM equation group is solved, and whether judges solving result Convergence;
Step 9:When solving result is not restrained, Kuai Hang projection iterative methods are adopted again to solving result, solve HASM side Journey group, and judge whether solving result restrains, if convergence, execution step 10 otherwise, re-executes step 9;
Specifically, for the method for solving of above-mentioned symmetrical uncertain system is generally direct method and iterative method.Direct method is related to Decomposition to matrix etc. is not appropriate for extensive problem.Conventional iterative method is Krylov subspace iterative method, is located more in advance Reason conjugate gradient method PCG, the QR decomposition method LSQR based on least square, and minimum residual error method GMRES of broad sense etc..Due to Such iterative method needs that equation group coefficient matrix is all disposably input into internal memory, with the increase of calculation scale, such method Do not use.Row projection iterative method can avoid problems, row projection iterative method from being widely used, and algorithm is simple, classical row Projection iterative method such as Cimmio algorithms, Kaczmar algorithms etc..
Define HiFor set:RnThe space that real number vector is constituted, i=1 ..., p are tieed up for n. Therefore it is anyThat is x*For p sub-spaces HiCommon factor, be linear system ATThe solution of x=b.If required (1.1.5) In symmetrical uncertain system be Ax=b, is deducted marks according to the grid of zoning and matrix A is decomposed into block row form:
And define Pk(AiT) it is AiTProjection operator in codomain.General thought is first by xkProject to P hyperplane
Algorithm:Block Cimmino row sciagraphies:
Choose x(0), k=0 is made,
Steps be repeated alternatively until convergence,
begin
Do in parallel i=1 ... p
δi(k)=Ai+bi-PA(AiT)x(k)=Ai+(bi-Aix(k))
end parallel
Set k=k+1
end
The method can be avoided without fully entering matrix element every time, and one piece of row of input matrix is only needed every time, protected The solution probability of extensive problem is demonstrate,proved.But have the disadvantage that convergence rate is slow, therefore less application in practice.
Kaczmar algorithms are based on for this this research, a new block-iterative algorithm with row projection is given.By choose from work as Front iteration point carries out orthogonal projection apart from farthest block, and will project as next iteration point, so as to accelerate convergence speed Degree.Assume that current iteration point is xk, x is calculated firstkIn all HiOn orthogonal projection Pi(xk), for i=1 ..., then p compares It is more all of | | Pi(xk)-xk||2And obtain wherein the maximum, that is, find out from xkOrthogonal is apart from farthest block Hi, it is assumed that | | Pj (xk)-xk||2Maximum, i.e.,Choose xkIn HjOn projection Pj(xk) as next Individual iteration point, i.e. xk+1=Pj(xk), the process for continuing the above obtains a sequence { xk, continuous iteration is until convergence.The algorithm is retouched State as follows:
Initialization:Piecemeal is carried out to matrix A, initial point x is given0∈Rn, 0≤ε < 1 make k=0
Step 10:When HASM solution of equations is restrained, determine whether whether HASM solution of equations meets Gauss section Up to neat equation group, if being unsatisfactory for, execution step 6;If meeting, exported with regard to variable to be measured according to HASM solution of equations High-precision analog surface model..
The checking of the embodiment of the present invention is described below,
1st, numerical experimentation
First by taking standard mathematical curved surface as an example, the effectiveness of algorithm is studied.Compare the HASM methods after improving and be suitable for The Kriging methods (FRK) of extensive Solve problems, the Spline methods (FRS) for being suitable for extensive Solve problems and it is anti-away from From the simulated performance difference of method of weighting IDW.
Domain of definition is [0,1] × [0,1].
As shown in figure 1, randomly selecting 1/100 sampled point on standard mathematical curved surface, all experiments are transported on 64 machines OK, it is Gauss-Codazii equation group that criterion is shut down in HASM.Zoning is deducted marks as 1000 × 1000.u=100, κ= 5. the measurement of pair calculation error, using mean absolute error RMSE, its computing formula is as follows:
Wherein fi,For the i-th th actual value and the analogue value, N is sampled point number, is counted Calculate result as shown in table 1:
The distinct methods computational efficiency com-parison and analysis of table 1
Method HASM G-IDW FRK FRS
RMSE 1.3076×10-4 1.66×10-2 2.20×10-3 5.78×10-4
Calculating time (s) 54.06s 20.11s 40.00s 24.79s
As a result show, HASM computational accuracy highests, next to that FRS methods.HASM computational accuracies are respectively IDW, FRK and 127 times of FRS, 17 times and 4 times.But the calculating speed of HASM is less than additive method.This is because needing in HASM calculating process It is discrete to partial differential equations finite difference, need group of equations right-hand vector, and solving equation group etc., calculating process is more multiple It is miscellaneous.
(a) HASM according to Fig. 2, (b) FRK, (c) G-IDW, and (d) FRS simulate the Error Graph of curved surface and true curved surface, Therein, it can be seen that IDW simulation errors are maximum, maximum error is at border and peak value.Maximum deviation is 0.2139.FRK Also larger error is generated, maximum error occurs in boundary for -0.0123. errors most for the maximum deviation of 0.02737.FRS Little is HASM methods, it can be seen that error distribution is relatively uniform.
Although the calculating time of HASM is more than additive method, it is linearly proportional with calculating grid that it calculates the time. Table 2 gives the calculating time of HASM under different calculation scales.The calculating time can be expressed as with the relational expression for calculating grid:
T=1.1099 × 10-5n+26.7447,R2=0.91
The calculating time of HASM under the different calculation scales of table 2.
Calculate grid number 1million 4million 9million 16million 25million
Calculating time (s) 54.06 88.21 107.54 155.19 339.15
2nd, real case
With China to study area, the distribution of many mean annual precipitations of past 50 years 1961-2010 is calculated using said method, Spatial resolution is 1km, and it is 19,606,916 that correspondence calculates grid number.
All sides are can be seen that from many mean annual precipitation distribution results of Chinese scope of HASM, FRK, IDW and FRS simulation Method can preferably reflect the distribution trend of precipitation.The curved surface of HASM and FRK methods simulation is with respect to additive method more more It is smooth.IDW and FRS methods occur in that many buphthalmos phenomenons, and FRS methods generate vibration by a relatively large margin in boundary.
Random selection 15% as check post verify distinct methods.This process is repeated 10 times, and calculates this 10 times Average RMSE.As a result it is as shown in table 3.It can be seen that HASM computational accuracies are highests, its simulation precision distinguishes my FRK, IDW and 1.4,1.5 and 1.6 times of FRS.The simulation error of FRS is maximum.IDW calculates the time at least, next to that HASM.
The comparison of distinct methods in the real case of table 3.
Method HASM FRK IDW FRS
RMSE(mm) 90.87 123.51 133.44 147.10
Calculating time (s) 166 237 63 172
Numerical experimentation and real case, show the HASM methods after improving while precision is ensured so that during its calculating Between with calculate grid number it is linear, in storage, due to solve constrained least-squares problem when, employ block row projection Algorithm, only needs one piece of row of storage matrix, and it is stored using row compression storage mode, it is ensured that the rule of Solve problems Mould.
The foregoing is only presently preferred embodiments of the present invention, not to limit the present invention, all spirit in the present invention and Within principle, any modification, equivalent substitution and improvements made etc. should be included within the scope of the present invention.

Claims (7)

1. a kind of High Accuracy Surface Modeling method based on big data, comprises the following steps:
Step 1:The geographic coordinate information and variable sampled value to be measured of each sampled point are created, the geographic coordinate information includes adopting The longitude information of sampling point and the latitude information of sampled point;
Step 2:Mesh point form is turned to by regional space to be measured is discrete, mesh point centrifugal pump is obtained, according to geographic coordinate information Sampling equation is set up with variable sampled value to be measured, the sampling equation is used to whether judge sampled point in mesh point, wherein, such as On the mesh point, then the value of the mesh point is variable sampled value to be measured to fruit sampled point;If sampled point is in grid, The approximation sample value that will be obtained using Taylor expansion on the nearest mesh point of the sampled point on the mesh point;
Step 3:First kind fundamental quantity E, F, G and Equations of The Second Kind base of each mesh point of region to be measured are calculated according to mesh point centrifugal pump This amount L, M, N, wherein first fundamental quantity is used to represent the length of simulation Curves on surfaces, the area of simulation curved surface and simulation The curvature of Curves on surfaces, the second fundamental quantity is used for the local buckling intensity of variation of expression simulation curved surface, will use the first base It is discrete that the partial differential equations of the curved surface that this amount and second fundamental quantity are represented carry out higher difference, obtains discrete equation group corresponding Algebra system, equality constraint least square problem is combined into by the algebra system with the sampling equation;
Step 4:Equality constraint least square is converted into into solution for topic and blocks object function minimum problem;
Step 5:Object function minimum problem is blocked in solution and is converted into the symmetrical Indeterminate Equation Group of solution, the symmetrical indefinite side Journey group is High Accuracy Surface Modeling HASM equation group;
Step 6:Randomly select the iterative initial value of HASM equation group;
Step 7:Coefficient matrix in HASM equation group is entered into every trade piecemeal, and the block matrix after decomposing to coefficient matrix is deposited Storage;
Step 8:Kuai Hang projection iterative methods are adopted to iterative initial value, HASM equation group is solved, and judges whether solving result restrains;
Step 9:When solving result is not restrained, Kuai Hang projection iterative methods are adopted again to solving result, solve HASM equation group, And judge whether solving result restrains, if convergence, execution step 10 otherwise, re-executes step 9;
Step 10:When HASM solution of equations is restrained, determine whether whether HASM solution of equations meets Gauss Kodak neat Equation group, if being unsatisfactory for, execution step 6;If meeting, exported with regard to the high-precision of variable to be measured according to HASM solution of equations Degree simulation surface model.
2. method according to claim 1, it is characterised in that the partial differential equations of the curved surface are:
f x x = Γ 11 1 f x + Γ 11 2 f y + L E + G - 1 f y y = T 22 1 f x + Γ 22 2 f y + N E + G - 1 f x y = Γ 12 1 f x + Γ 12 2 f y + M E + G - 1
Wherein,F=fx·fy,
L = f x x 1 + f x 2 + f y 2 , M = f x y 1 + f x 2 + f y 2 , N = f y y 1 + f x 2 + f y 2 ,
Γ 11 1 = 1 2 ( GE x - 2 FF x + FE y ) ( E G - F 2 ) - 1 , Γ 11 2 = 1 2 ( 2 EF x - EE y - FE x ) ( E G - F 2 ) - 1 ,
Γ 22 1 = 1 2 ( 2 GF y - GG x - FG y ) ( E G - F 2 ) - 1 , Γ 22 2 = 1 2 ( EG y - 2 FF y + FG x ) ( E G - F 2 ) - 1 ,
Γ 12 1 = 1 2 ( GE y - FG x ) ( E G - F 2 ) - 1 , Γ 12 2 = 1 2 ( EG x - FE y ) ( E G - F 2 ) - 1 ,
X for spatial discretization mesh point abscissa, y for spatial discretization mesh point vertical coordinate, fxIt is function f to x's First-order partial derivative, fxxFor second-order partial differential coefficients of the function f to x, fyFor first-order partial derivatives of the function f to y, fyyBe function f to y two Rank partial derivative Ex、Fx、GxThe respectively first-order partial derivative of E, F, G to x, Ey、Fy、GyThe respectively first-order partial derivative of E, F, G to y, For Equations of The Second Kind Cristoffel symbols.
3. method according to claim 2, it is characterised in that the step 3 is specifically included:
Step 3.1:Area to be measured is calculated according to the finite difference approximation of first kind fundamental quantity E, F, G and Equations of The Second Kind fundamental quantity L, M, N The first kind fundamental quantity of each mesh point of domain and the value of Equations of The Second Kind fundamental quantity;
Step 3.2:Finite difference approximation, the finite difference approximation of Equations of The Second Kind fundamental quantity and Equations of The Second Kind with reference to first kind fundamental quantity The finite difference of Cristoffel symbols obtains discrete equation group;
Step 3.3:The discrete equation group is converted into into the algebra system of matrix form;
Step 3.4:The algebra system is combined into into equality constraint least square problem with sampling equation.
4. method according to claim 3, it is characterised in that by the coefficient matrix in HASM equation group in the step 7 The concrete grammar for entering every trade piecemeal is:If each sub-block A of coefficient matrices AiBe up to u rows, and Ai∈Ru×n, u < < n are Full rank, the i.e. row per block are independent, it is assumed that generating sub-block Ai, the sub-block is comprising j rows (the j < in matrix A And known A u),i TQR be decomposed into Ai T=QjRj, block Ai TRow dependency estimationWherein rhhIt is positioned at Rj(h, h) position element, a1For a line in matrix A, orderAccording to Ai TQR decompose, update method is decomposed obtaining using QRQR decompose, then calculateRow Correlation estimation, if the estimation is still less than κ, a1Add block Ai, wherein, κ is a positive number set in advance.
5. method according to claim 4, it is characterised in that the QR decomposes and adopts FrancisQR decomposition strategies.
6. the method according to claim 4 or 5, it is characterised in that to the block square after coefficient matrix decomposition in the step 7 The mode that battle array is stored is row compression storage mode CSR.
7. method according to claim 6, it is characterised in that the step 8 and step 9 are specifically included:Assume current changing Generation point is to judge xkWhether restrain, if not restraining, find out from xkOrthogonal chooses x apart from farthest blockkThrowing on described piece Shadow is used as next iteration point.
CN201710013712.0A 2017-01-09 2017-01-09 High-precision curved surface modeling method based on big data Expired - Fee Related CN106683185B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710013712.0A CN106683185B (en) 2017-01-09 2017-01-09 High-precision curved surface modeling method based on big data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710013712.0A CN106683185B (en) 2017-01-09 2017-01-09 High-precision curved surface modeling method based on big data

Publications (2)

Publication Number Publication Date
CN106683185A true CN106683185A (en) 2017-05-17
CN106683185B CN106683185B (en) 2020-04-03

Family

ID=58849422

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710013712.0A Expired - Fee Related CN106683185B (en) 2017-01-09 2017-01-09 High-precision curved surface modeling method based on big data

Country Status (1)

Country Link
CN (1) CN106683185B (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110555189A (en) * 2019-08-26 2019-12-10 滁州学院 Spatial interpolation method based on reverse computing thinking
CN111475475A (en) * 2020-04-01 2020-07-31 中国人民解放军火箭军工程大学 Differentiated compression storage model of data matrix
CN115374682A (en) * 2022-10-25 2022-11-22 中国科学院地理科学与资源研究所 Space-time collaborative high-precision curved surface modeling method and system
CN116090315A (en) * 2023-04-07 2023-05-09 中国科学院地理科学与资源研究所 Precipitation space distribution simulation method considering space heterogeneity and data real-time update
CN116108761A (en) * 2023-04-12 2023-05-12 中国科学院地理科学与资源研究所 Regional climate simulation method and system for coupling deep learning and HASM
CN112541158B (en) * 2020-12-17 2023-10-03 中国科学院数学与系统科学研究院 Method for space curved surface intersection executed by electronic equipment and electronic equipment
CN117875091A (en) * 2024-03-12 2024-04-12 中国科学院地理科学与资源研究所 Optimization method and device of high-precision curved surface modeling method based on adaptive algorithm

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101271596A (en) * 2007-03-21 2008-09-24 中国科学院地理科学与资源研究所 Method for establishing digital model of landform curved surface based on basic law of theory of surfaces
CN103077274A (en) * 2013-01-05 2013-05-01 中国科学院地理科学与资源研究所 High-precision curve modeling intelligent method and device
CN103235974A (en) * 2013-04-25 2013-08-07 中国科学院地理科学与资源研究所 Method for improving processing efficiency of massive spatial data

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101271596A (en) * 2007-03-21 2008-09-24 中国科学院地理科学与资源研究所 Method for establishing digital model of landform curved surface based on basic law of theory of surfaces
CN103077274A (en) * 2013-01-05 2013-05-01 中国科学院地理科学与资源研究所 High-precision curve modeling intelligent method and device
CN103235974A (en) * 2013-04-25 2013-08-07 中国科学院地理科学与资源研究所 Method for improving processing efficiency of massive spatial data

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
M.BELLALIJ等: "Some properties of range restricted GMRES methods", 《JOURNAL OF COMPUTATIONAL AND APPLIED MATHEMATICS》 *
王世海等: "逐次最小二乘在高精度曲面建模方法(HASM)中的应用", 《武汉大学学报信息科学版》 *
赵娜等: "高精度曲面建模的一种快速算法", 《地球信息科学学报》 *
赵明伟等: "高精度曲面建模优化方案", 《中国图象图形学报》 *

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110555189A (en) * 2019-08-26 2019-12-10 滁州学院 Spatial interpolation method based on reverse computing thinking
CN110555189B (en) * 2019-08-26 2022-09-09 滁州学院 Spatial interpolation method based on reverse computing thinking
CN111475475A (en) * 2020-04-01 2020-07-31 中国人民解放军火箭军工程大学 Differentiated compression storage model of data matrix
CN112541158B (en) * 2020-12-17 2023-10-03 中国科学院数学与系统科学研究院 Method for space curved surface intersection executed by electronic equipment and electronic equipment
CN115374682A (en) * 2022-10-25 2022-11-22 中国科学院地理科学与资源研究所 Space-time collaborative high-precision curved surface modeling method and system
CN116090315A (en) * 2023-04-07 2023-05-09 中国科学院地理科学与资源研究所 Precipitation space distribution simulation method considering space heterogeneity and data real-time update
CN116108761A (en) * 2023-04-12 2023-05-12 中国科学院地理科学与资源研究所 Regional climate simulation method and system for coupling deep learning and HASM
CN117875091A (en) * 2024-03-12 2024-04-12 中国科学院地理科学与资源研究所 Optimization method and device of high-precision curved surface modeling method based on adaptive algorithm
CN117875091B (en) * 2024-03-12 2024-05-10 中国科学院地理科学与资源研究所 Optimization method and device of high-precision curved surface modeling method based on adaptive algorithm

Also Published As

Publication number Publication date
CN106683185B (en) 2020-04-03

Similar Documents

Publication Publication Date Title
CN106683185A (en) High accuracy surface modeling method based on big data
US10439594B2 (en) Actually-measured marine environment data assimilation method based on sequence recursive filtering three-dimensional variation
Braaten et al. A study of recirculating flow computation using body-fitted coordinates: consistency aspects and mesh skewness
CN103106301B (en) A kind of method of the calculating radiation shield be coupled with characteristic line method based on Monte Carlo method
CN104007479B (en) A kind of Ionospheric Tomography based on multiple dimensioned subdivision and Ionospheric delay correcting method
Yue et al. A multi‐grid method of high accuracy surface modeling and its validation
Chen et al. Global shallow water models based on multi-moment constrained finite volume method and three quasi-uniform spherical grids
CN115374682A (en) Space-time collaborative high-precision curved surface modeling method and system
CN105046046A (en) Ensemble Kalman filter localization method
Cai et al. Efficient mass-and energy-preserving schemes for the coupled nonlinear Schrödinger–Boussinesq system
Crockatt et al. Improvements to a class of hybrid methods for radiation transport: Nyström reconstruction and defect correction methods
CN103077274B (en) High Accuracy Surface Modeling Intelligentized method and device
Zheng et al. Towards a new multiscale air quality transport model using the fully unstructured anisotropic adaptive mesh technology of fluidity (version 4.1. 9)
CN111339688A (en) Method for solving rocket simulation model time domain equation based on big data parallel algorithm
Shaw et al. Multidimensional method-of-lines transport for atmospheric flows over steep terrain using arbitrary meshes
CN103971411A (en) Space curved surface modeling method by utilizing space curved surface sampling points of three-dimensional objects
Roberts Advanced response matrix methods for full core analysis
CN105760572A (en) Finite element grid encoding and indexing method for three-dimensional surface grid model
Sørensen et al. A mass-conserving and multi-tracer efficient transport scheme in the online integrated Enviro-HIRLAM model
CN109960776B (en) Improved method for hydraulic travel time and hydraulic signal attenuation inversion calculation
CN103678788A (en) Spatial data interpolation and curved surface fitting method based on curved surface theory
Sofiev et al. Construction of an Eulerian atmospheric dispersion model based on the advection algorithm of M. Galperin: dynamic cores v. 4 and 5 of SILAM v. 5.5.
Kumar et al. L2 estimates for weak Galerkin finite element methods for second-order wave equations with polygonal meshes
CN111222250B (en) Method for improving parameter solving efficiency of geospatial coordinate transformation model
CN117828916A (en) Advanced geological forecasting method and system adapting to complex terrain by induced polarization method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200403

Termination date: 20220109