CN101021868A - Terrain data storing method based on object storage - Google Patents
Terrain data storing method based on object storage Download PDFInfo
- Publication number
- CN101021868A CN101021868A CN 200710051621 CN200710051621A CN101021868A CN 101021868 A CN101021868 A CN 101021868A CN 200710051621 CN200710051621 CN 200710051621 CN 200710051621 A CN200710051621 A CN 200710051621A CN 101021868 A CN101021868 A CN 101021868A
- Authority
- CN
- China
- Prior art keywords
- storage
- landform
- terrain data
- data
- vector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
This invention relates to a landform data storage method based on object storage characterizing that landform data and its attribute data form storage objects stored in a storage system based on objects, in which, the storage objects of adjacent or near landform data tiles are distributed in different storage devices in the storage system based on the objects, and this invented data storage organization mode and its distribution strategy based on objects realizes integrated storage of landform data and its attribute data to guarantee constant of response time to increase the operation efficiency of the landform data applied system.
Description
Technical field
The invention belongs to mass spatial information storage administration field, particularly relate to a kind of terrain data storage means based on object storage.
Background technology
Fast development along with the space exploration technology, the quantity that terrain data (DEM and data texturing) obtains is just with unprecedented speed increment, the application of extensive even ultra-large dimensional topography real time roaming system more and more widely, as the digital earth, extensive Military Simulation etc., this type systematic is except there being very harsh requirement on the efficient to terrain rendering, efficiently outside terrain rendering algorithm and the data dispatch strategy, simultaneously it belongs to data-intensive application, to storage system in memory capacity, I/O performance (bandwidth, throughput, response time) higher requirement is also arranged.Chinese scholars is at the real-time rendering of landform, carried out number of research projects, and obtained breakthrough progress, as technology such as relevant self-adaptation level details technology (LOD) of viewpoint and observability rejectings, effectively improve the efficient of terrain rendering, but the storage of massive terrains data and managerial research work are also fewer, according to " wooden barrel principle ", the raising of the direct system for restricting overall performance of storage bottleneck of system, and then influence the effect that landform is roamed.
The present invention can enumerate the great difficulty that concrete data illustrate that the terrain data memory technology faces: the storage space that large-scale landform real time roaming system needs is huge, with mesh spacing be 3 seconds be example, the dem data in the whole world is stored with short (double byte), so Quan Qiu data volume just reaches the scale of 432000*216000*2 byte, the data that are roughly equal to 173G, 1 meter resolution covers the DOM data of China up to 53TB, the data in the whole world will be up to the PB level, one-of-a-kind system can't satisfy the demand of memory capacity, simultaneously according to two index parameters that satisfy the human vision effect in the virtual reality technology, frame per second reaches more than 10 frames, response time should be less than 0.1 second, at most should be above 1/4 second, the landform roaming system requires throughput to reach more than the 300M-400Mb/s to storage system, and supports more concurrent family access number as far as possible.
Face landform real time roaming system to memory capacity and the ever-increasing demand of performance, large-scale landform roaming system needs a kind of high performance storage mode.
Summary of the invention
The object of the invention is to solve the prior art deficiency, and a kind of terrain data storage means that can improve extensive real time roaming running efficiency of system is provided.
For achieving the above object, object-based terrain data storage means provided by the invention is terrain data and attribute data thereof to be organized into the landform storage object be stored in based in the object storage system, and the landform storage object of adjacent or close terrain data tile is distributed in based on the difference in the object storage system based on object storage equipment.
And the landform storage object is made up of terrain data piece and topographical object attribute, and the topographical object attribute comprises object storage attribute and landform memory attribute.
And, adopt vector base that storage policy is realized landform storage object distributed store, implementation procedure is as follows,
A) terrain data is divided into N by level and vertical gridlines
1* N
2Individual tile is formed the landform storage object with the terrain data of tile and attribute data thereof, tile be designated as (tx, ty), 0≤tx≤N wherein
1-1,0≤ty≤N
2-1, N
1And N
2Be integer;
B) given is K based on the object storage number of devices, the generation algorithm is produced the vector u and the v of a pair of linear independence according to vector base;
C) by u, the linear space that v opens is designated as: and S (u, v)=w|w=mu+nv, m, n ∈ Z}, wherein, w is the vector in S space;
D) in the S space between non-zero vector the shortest distance be designated as L (r)=min{r|r=|w
2-w
1|, w
2, w
1∈ S}, wherein r is the distance between non-zero vector in the S space;
E) two tile (tx
1, ty
1) and (tx
2, ty
2) be designated as vector T respectively
1And T
2If, T
2=T
1+ w, then T
2And T
1Be distributed in same based on the object storage equipment.
And described vector base may further comprise the steps producing algorithm,
(1) initialization integer a, b, c, d, i,
K＝bc，c＞b＞0，d＝0，
i＝2；
(2) determine that initial vector is to w
1And w
2,
w
1＝(c，d)，w
2＝(a，b)；
(3) seek the integer j that satisfies condition, j selects the most approaching
Integer, and calculate w
I+1=w
I-1+ jw
i
(4) according to condition j=0? value is judged, if j=0, then u=w
I-1, v=w
i, finish to calculate, otherwise carry out next step calculating;
(5) according to condition | w
I+1| 〉=| w
i|? judge, if | w
I+1| 〉=| w
i|, u=w then
I+1, v=w
i, finish to calculate, otherwise, upgrade a, b, c, d, (c, d)=w
I-1, (a, b)=w
i, i=i+1 returns step 3 and continues to calculate.
The present invention adopts and stores terrain data based on the object storage mode, eliminated storage I/0 bottleneck, and having designed the landform storage object structure of suitable storage terrain data information, the landform memory attribute can be used for the landform storage object is carried out retrieval and inquisition, has improved recall precision.The present invention has also adopted the distributed store management, the landform storage object that is adjacent to the graphic data tile is distributed in based on the difference in the object storage system based on object storage equipment, guarantee that query window is under the condition that meets certain requirements, response time constant can make the real time roaming running effect more stable.Terrain data storage means provided by the invention can comprehensively improve the operational efficiency of terrain data application system, is particularly suitable for extensive even ultra-large dimensional topography real time roaming system.
Description of drawings
Fig. 1 is the storage organization of landform storage object of the present invention;
Fig. 2 is that embodiment of the invention vector base is to producing algorithm flow chart;
Fig. 3 is an embodiment of the invention terrain data tile pyramid model;
Fig. 4 is the quaternary tree model.
Embodiment
Terrain data storage means based on object storage provided by the invention is terrain data and attribute data thereof to be organized into the landform storage object be stored in based in the object storage system, and the landform storage object of adjacent or close terrain data tile is distributed in based on the difference in the object storage system based on object storage equipment.
During concrete enforcement, because data volume is huge, terrain data adopts the layering storage usually, to satisfy different images sharpness application demand.And according to the characteristics of terrain data, it is that the unit is so that stores processor that every layer data all is divided into the tile.Referring to Fig. 3, the terrain data in the embodiment of the invention adopts the tile pyramid model to carry out the layering storage.In the landform roaming system, terrain data tissue based on pyramid model is the model of using always, can stipulate when the present invention specifically implements that terrain data presses following tile pyramid model and coded system tissue: (1) adopts the multiplying power method to make up the multiresolution pyramid model; (2) every layer of terrain data data block of dividing uniformly-spaced, etc. size, these data blocks are base units of the data transmitted in the system; (3) data block adopts " nLayer_nBlkNoX_nBlkNoY " rule encoding, the corresponding gold tower number of plies of nLayer record, and nBlkNoX and nBlkNoY write down row number and row number respectively; The landform roaming client is in the terrain visualization process, by sending the data block coding, to the corresponding terrain data of data set provider request.Terrain data tile pyramid model among Fig. 3 is based on the quaternary tree model construction, certain tile in the Level=0 layer is corresponding to 4 adjacent tiles in the Level=1 layer, again corresponding to 4 adjacent tiles in the Level=2 layer, arrow is represented correspondence to certain tile in the Level=1 layer again.The quaternary tree model that Fig. 4 provides the foundation is so that understand this relation.Each layer data can be identical in the processing in when storage, thus the present invention when the description technique scheme if do not specify, all be meant same layer data.
Based on object storage system is follow-on Network storage technology, has high-performance, enhanced scalability, intellectuality and cross-platform safety and characteristics such as shares.It is hidden in the object layer separating in device-dependent characteristic (distributing as piece) slave unit one deck, realizes cross-platform sharing, effectively solves the isomerous environment problem that SAN faces; Host computer system can directly be visited based on object storage equipment and be carried out exchanges data, does not need the forwarding of server, has eliminated the server bottleneck of NAS.Therefore adopt and to satisfy of the requirement of large-scale terrain roaming system network store system based on object storage system.
The present invention innovates and has proposed to adopt the technical scheme of carrying out the terrain data storage based on object storage technology, and terrain data adopts the storage organization of landform storage object, and each tile and set of properties thereof are made into the form of landform storage object and store.The landform storage object is made up of terrain data piece and topographical object attribute, and the topographical object attribute comprises object storage attribute and landform memory attribute.Referring to Fig. 1, mainly to form based on the object in the object storage by object data piece and object properties, object properties mainly comprise object ID, block pointer, logic length and quota size etc.Expansion is based on the attribute of the object in the object storage, and the mode that terrain data and attribute data is organized into the landform storage object is stored, and the attribute data of terrain data is as the expansion of the attribute of object.The landform storage object comprises topographical object attribute and terrain data piece, and what the terrain data piece was stored is exactly terrain data, corresponding to the object data piece in the object.The topographical object attribute comprises object storage attribute and landform memory attribute, and the object storage attribute is corresponding to the object properties of object, and the landform memory attribute is the expansion of object properties, mainly comprises level number, resolution, coordinate range and version number etc.Like this, the landform storage object can be realized the integrated storage of terrain data and attribute data, and the landform memory attribute can provide the query and search function of terrain data.
In conjunction with based on object storage, terrain data and attribute data thereof the mode with the landform storage object is stored in based in the object storage system, and adopts certain storage Distribution Strategy, can make the real time roaming running effect more stable.Based on object storage system is a kind of distributed network storage system, comprise a plurality of based on object storage equipment, the mode storage object of common employing order burst mapping or Hash, but the landform roaming system need extract the data of several adjacent in query window tiles usually, if the landform storage object of tile in the query window all can be distributed in different based on the object storage equipment, when response was inquired about so, the data of each tile can be taken by parallel, can improve the response time.Ideally, each tile of every tomographic image data can both be stored in different from the object storage equipment, query window size so no matter, it is different from the object storage equipment to guarantee that adjacent tiles is stored in, but be limited based on the object storage number of devices when specifically implementing, the size of query window also gets final product to satisfy to use, need not excessive, therefore under situation about determining, can guarantee in suitable query window radius size that the landform storage object of adjacent or close terrain data tile is distributed in different from object storage equipment based on the object storage number of devices.The present invention has designed that adjacent one another are or close tile is distributed to as much as possible is different from the Distribution Strategy on the object storage equipment: adopt vector base that storage policy is realized landform storage object distributed store, implementation procedure is as follows,
A) terrain data is divided into N by level and vertical gridlines
1* N
2Individual tile is formed the landform storage object with the terrain data of tile and attribute data thereof, tile be designated as (tx, ty), 0≤tx≤N wherein
1-1,0≤ty≤N
2-1, N
1And N
2Be integer;
B) given is K (obviously K is an integer, and K＞0) based on the object storage number of devices, the generation algorithm is produced the vector u and the v of a pair of linear independence according to vector base;
C) by u, the linear space that v opens is designated as: and S (u, v)=w|w=mu+nv, m, n ∈ Z}, wherein, w is the vector in S space;
D) in the S space between non-zero vector the shortest distance be designated as L (r)=min{r|r=|w
2-w
1|, w
2, w
1∈ S}, wherein r is the distance between non-zero vector in the S space;
E) two tile (tx
1, ty
1) and (tx
2, ty
2) be designated as vector T respectively
1And T
2If, T
2=T
1+ w, then T
2And T
1Be distributed in same based on the object storage equipment.
This Distribution Strategy can guarantee the query window radius less than L (r)/2 o'clock, and each at most only can be once accessed based on object storage equipment.And can make query window under situation about meeting the demands, response time constant makes running effect stable.During concrete enforcement, at first different from the landform storage object of respectively storing a tile on the object storage equipment, with the landform storage object of other tiles of layer by above-mentioned steps e) judge getting final product that the back decision stores based on object storage equipment.
Right in order to obtain suitable vector base fast, the embodiment of the invention provides a kind of and has produced the right algorithm of vector base so that implement, and described vector base may further comprise the steps producing algorithm,
(1) initialization integer a, b, c, d, i,
K＝bc，c＞b＞0，d＝0，
i＝2；
(2) determine that initial vector is to w
1And w
2,
w
1＝(c，d)，w
2＝(a，b)；
(3) seek the integer j that satisfies condition, j selects the most approaching
Integer, and calculate w
I+1=w
I-1+ jw
i
J selects the most approaching
Integer be a kind of optimized choice, otherwise be prone to redundancy in calculating.
(4) according to condition j=0? value is judged, if j=0, then u=w
I-1, v=w
i, finish to calculate, otherwise carry out next step calculating;
(5) according to condition | w
I+1| 〉=| w
i|? judge, if | w
I+1| 〉=| w
i|, u=w then
I+1, v=w
i, finish to calculate, otherwise, upgrade a, b, c, d, (c, d)=w
I-1, (a, b)=w
i, i=i+1 returns step 3 and continues to calculate.
This algorithm can program form be carried out by computing machine automatically, the algorithm flow that provides referring to Fig. 2.
Claims (4)
1. terrain data storage means based on object storage, it is characterized in that: terrain data and attribute data thereof are organized into the landform storage object and are stored in based in the object storage system, and the landform storage object of adjacent or close terrain data tile is distributed in based on the difference in the object storage system based on object storage equipment.
2. terrain data storage means as claimed in claim 1 is characterized in that: the landform storage object is made up of terrain data piece and topographical object attribute, and the topographical object attribute comprises object storage attribute and landform memory attribute.
3. terrain data storage means as claimed in claim 1 or 2 is characterized in that: adopt vector base that storage policy is realized landform storage object distributed store, implementation procedure is as follows,
A) terrain data is divided into N by level and vertical gridlines
1* N
2Individual tile is formed the landform storage object with the terrain data of tile and attribute data thereof, tile be designated as (tx, ty), 0≤tx≤N wherein
1-1,0≤ty≤N
2-1, N
1And N
2Be integer;
B) given is K based on the object storage number of devices, the generation algorithm is produced the vector u and the v of a pair of linear independence according to vector base;
C) by u, the linear space that v opens is designated as: and S (u, v)=w|w=mu+nv, m, n ∈ Z}, wherein, w is the vector in S space;
D) in the S space between non-zero vector the shortest distance be designated as L (r)=min{r|r=|w
2-w
1|, w
2, w
1∈ S}, wherein r is the distance between non-zero vector in the S space;
E) two tile (tx
1, ty
1) and (tx
2, ty
2) be designated as vector T respectively
1And T
2If, T
2=T
1+ w, then T
2And T
1Be distributed in same based on the object storage equipment.
4. terrain data storage means as claimed in claim 3 is characterized in that: described vector base may further comprise the steps producing algorithm,
(1) initialization integer a, b, c, d, i,
K＝bc，c＞b＞0，d＝0，
i＝2；
(2) determine that initial vector is to w
1And w
2,
w
1＝(c，d)，w
2＝(a，b)；
(3) seek the integer j that satisfies condition, j selects the most approaching
Integer, and
Calculate w
I+1=w
I-1+ jw
i
(4) according to condition j=0? value is judged, if j=0, then u=w
I-1, v=w
i, finish to calculate, otherwise carry out next step calculating;
(5) according to condition | w
I+1| 〉=| w
i|? judge, if | w
I+1| 〉=| w
i|, u=w then
I+1, v=w
i, finish to calculate, otherwise, upgrade a, b, c, d, (c, d)=w
I-1, (a, b)=w
i, i=i+1 returns step 3 and continues to calculate.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007100516212A CN100481085C (en) | 2007-03-06 | 2007-03-06 | Terrain data storing method based on object storage |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2007100516212A CN100481085C (en) | 2007-03-06 | 2007-03-06 | Terrain data storing method based on object storage |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101021868A true CN101021868A (en) | 2007-08-22 |
| CN100481085C CN100481085C (en) | 2009-04-22 |
Family
ID=38709631
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2007100516212A Expired - Fee Related CN100481085C (en) | 2007-03-06 | 2007-03-06 | Terrain data storing method based on object storage |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100481085C (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101887595A (en) * | 2009-05-14 | 2010-11-17 | 武汉如临其境科技创意有限公司 | Three-dimensional digital earth-space data organizing and rendering method based on quad-tree index |
| CN101963996A (en) * | 2010-10-29 | 2011-02-02 | 中国科学院地理科学与资源研究所 | Global raster data storing method |
| CN102821138A (en) * | 2012-07-09 | 2012-12-12 | 广州鼎鼎信息科技有限公司 | Metadata distributed storage method applicable to cloud storage system |
| CN104009864A (en) * | 2014-04-11 | 2014-08-27 | 重庆纳跃信息科技有限公司 | Clouded management platform |
| CN104516912A (en) * | 2013-09-29 | 2015-04-15 | 中国移动通信集团黑龙江有限公司 | Dynamic data storage method and device |
| CN104821007A (en) * | 2015-04-15 | 2015-08-05 | 中国资源卫星应用中心 | System for directly performing quick-look display on three-dimensional earth |
-
2007
- 2007-03-06 CN CNB2007100516212A patent/CN100481085C/en not_active Expired - Fee Related
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101887595A (en) * | 2009-05-14 | 2010-11-17 | 武汉如临其境科技创意有限公司 | Three-dimensional digital earth-space data organizing and rendering method based on quad-tree index |
| CN101887595B (en) * | 2009-05-14 | 2014-05-28 | 武汉如临其境科技创意有限公司 | Three-dimensional digital earth-space data organizing and rendering method based on quad-tree index |
| CN101963996A (en) * | 2010-10-29 | 2011-02-02 | 中国科学院地理科学与资源研究所 | Global raster data storing method |
| CN101963996B (en) * | 2010-10-29 | 2013-02-13 | 中国科学院地理科学与资源研究所 | Global raster data storing method |
| CN102821138A (en) * | 2012-07-09 | 2012-12-12 | 广州鼎鼎信息科技有限公司 | Metadata distributed storage method applicable to cloud storage system |
| CN102821138B (en) * | 2012-07-09 | 2015-06-24 | 广州鼎鼎信息科技有限公司 | Metadata distributed storage method applicable to cloud storage system |
| CN104516912A (en) * | 2013-09-29 | 2015-04-15 | 中国移动通信集团黑龙江有限公司 | Dynamic data storage method and device |
| CN104516912B (en) * | 2013-09-29 | 2018-06-26 | 中国移动通信集团黑龙江有限公司 | A kind of dynamic date storage method and device |
| CN104009864A (en) * | 2014-04-11 | 2014-08-27 | 重庆纳跃信息科技有限公司 | Clouded management platform |
| CN104009864B (en) * | 2014-04-11 | 2018-02-16 | 重庆纳跃信息科技有限公司 | A kind of cloud management platform |
| CN104821007A (en) * | 2015-04-15 | 2015-08-05 | 中国资源卫星应用中心 | System for directly performing quick-look display on three-dimensional earth |
| CN104821007B (en) * | 2015-04-15 | 2018-08-10 | 中国资源卫星应用中心 | A kind of system for carrying out regarding display soon directly on the three-dimensional earth |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100481085C (en) | 2009-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Cignoni et al. | BDAM—Batched Dynamic Adaptive Meshes for high performance terrain visualization | |
| Silva et al. | Out-of-core algorithms for scientific visualization and computer graphics | |
| CN100481085C (en) | Terrain data storing method based on object storage | |
| Lindstrom et al. | Terrain simplification simplified: A general framework for view-dependent out-of-core visualization | |
| Samanta et al. | Parallel rendering with k-way replication | |
| CN101963996B (en) | Global raster data storing method | |
| CN101246597A (en) | Method for commercial scale vector map data gradual transmission and dynamic reconstruction | |
| CN102255962A (en) | Distributive storage method, device and system | |
| CN104657436A (en) | Static tile pyramid parallel building method based on MapReduce | |
| CN101370025A (en) | Storing method, scheduling method and management system for geographic information data | |
| CN101364310A (en) | Three-dimensional model image generating method and apparatus | |
| CN103077549A (en) | Real-time large-scale terrain visualization implementation method based on kd tree | |
| CN101976468A (en) | Method and system for visualizing multiresolution dynamic landform | |
| Gobbetti et al. | Technical strategies for massive model visualization | |
| US20240212863A1 (en) | Unified anisotropic volume and surface mesh storage | |
| CN115272637B (en) | Large-area-oriented three-dimensional virtual ecological environment visual integration and optimization system | |
| WO2024108975A1 (en) | Slicing method for spatial model data | |
| DE102012213846A1 (en) | Real-time Euler water simulation using a limited large-cell grid | |
| Zhang et al. | Transmission and visualization of large geographical maps | |
| CN101436204A (en) | City evolvement simulation implementing method based on paralleling elementary cell automatic machine | |
| Zhang et al. | Visualization of large spatial data in networking environments | |
| Qiao et al. | A rapid visualization method of vector data over 3D terrain | |
| Kaehler | Massively parallel computation of accurate densities for N-body dark matter simulations using the phase-space-element method | |
| CN116883575B (en) | Building group rendering method, device, computer equipment and storage medium | |
| Weiss et al. | Supercubes: A high-level primitive for diamond hierarchies |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090422 Termination date: 20100306 |