CN101370025A - Storing method, scheduling method and management system for geographic information data - Google Patents
Storing method, scheduling method and management system for geographic information data Download PDFInfo
- Publication number
- CN101370025A CN101370025A CNA2007101204491A CN200710120449A CN101370025A CN 101370025 A CN101370025 A CN 101370025A CN A2007101204491 A CNA2007101204491 A CN A2007101204491A CN 200710120449 A CN200710120449 A CN 200710120449A CN 101370025 A CN101370025 A CN 101370025A
- Authority
- CN
- China
- Prior art keywords
- information data
- geographic information
- data block
- store path
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a geological information data storage method comprising: acquiring space position information of pre-divided geological information data block, hashing the corresponding geological information data block according to space position information, acquiring memory path of the geological information data block, storing the geological information data block under the memory path in file style. In the invention every geological information data block corresponds to a geological information data block file capable of directing requesting for downloading, thereby reducing data creation and inquiry time of system, promoting GIS service efficiency; memory path of the corresponding data block file can be directly computed out by space position information of geological information data block user needs, thereby effectively promoting reaction speed of system.
Description
Technical field
The present invention relates to the GIS data process field, particularly the storage device of a kind of storage means of geographic information data, a kind of geographic information data, a kind of geographic information data management system, a kind of dispatching method of geographic information data and a kind of dispatching device of geographic information data.
Background technology
GIS-Geographic Information System (Geographic Information System, GIS) be the computer system that is used to gather, store, manage, handle, retrieve, analyze and express geographical geographic information data, be the current techique of analyzing and handle the magnanimity geodata, handle the system of geography information.Geography information is meant the directly or indirectly information relevant with tellurian locus, is called spatial information again.Along with the development of GIS, the related scope of geography information is also enlarging gradually.
Along with spatial data amount ground constantly increases, more and more enterprises and public users are also more and more higher to the requirement of GIS service.Increasingly mature along with network technology, more GIS function need provide to enterprise and public users by network.In this case, network GIS (WebGIS) service, the main flow and the developing direction of especially three-dimensional WebGIS service having become GIS exploitation.
WebGIS in brief, utilizes the Web technology to expand and improve the technology of GIS exactly.Because http protocol adopts the request/acknowledgement mechanism based on the client/server node, has stronger user interactions ability, can transmit and on browser, show multi-medium data, if and the information spinner among the GIS need be with the spatial data of figure, image mode performance, the user is by interactive operation, promptly can carry out query analysis, and carry out corresponding operating spatial data.In the prior art, the function of WebGIS depends on the spatial data of magnanimity and relevant attribute data is realized, that is to say, the service that WebGIS provides not only relates to vast geographic range, such as, a city, the physical geography information data in a province or an area, also deeply relate to butcher,baker,and the candlestick maker's literary composition geographic information data, such as urbanization, the industrial and agricultural production development and change, with development and change of land, sea and air traffic etc., its data type that comprises comprises landform, image, vector, model, attribute, texture, sound, literal and multimedia etc., data volume are very huge.In this case, the magnanimity geographic information data to WebGIS carries out the difficult problem that effective organization and management becomes provides WebGIS to serve.
To this, a solution of prior art is, all geographic information data unifications are left in the data file of employing Hash table management, when the geographic information data service is provided, server node is according to the zone and the levels characteristic of institute's request msg, from this Hash table, find corresponding data, and extract and return to the client.The defective of this processing mode is: operating system is big or small restricted to the data file, in case the size of data file surpasses this restriction, then can't handle these mass datas; Server node needs the detailed data of pre-loaded full wafer zone or all geography information, thereby take too much resource, and when extracting the required data of user according to required parameter, need just may obtain corresponding results through complicated calculations, thereby had a strong impact on the treatment effeciency of server node, ask to cause systemic breakdown when many user especially.
So those skilled in the art press for develops a kind of efficiently method of organization and management geographic information data.
Summary of the invention
Technical problem to be solved by this invention provides a kind of storage means and dispatching method of geographic information data, has in order to solve in the prior art management to the GIS mass data that file size is limited, system load is big, resource occupation is too much and the problem of calculation of complex;
The present invention also provides a kind of storage device and dispatching device of geographic information data, in order to guarantee said method realization and application in practice;
The present invention also provides a kind of geographic information data management system, in order to solve in the prior art server load overweight, reacted slow problem.
For solving the problems of the technologies described above, the embodiment of the invention discloses a kind of storage means of geographic information data, comprising:
Obtain spatial positional information through the geographic information data piece of pre-cutting;
According to described spatial positional information the corresponding geographical information data block is carried out hash, obtain the store path of described geographic information data piece;
Described geographic information data piece is stored under the described store path with document form.
Preferably, described Hash step comprises:
Extract a plurality of characteristic parameters in the described spatial positional information;
Generate multistage store path according to described a plurality of characteristic parameters.
The embodiment of the invention also discloses a kind of storage device of geographic information data, comprising:
Acquisition module is used to obtain the spatial positional information through the geographic information data piece of pre-cutting;
The hash processing module is used for according to described spatial positional information the corresponding geographical information data block being carried out hash, obtains the store path of described geographic information data piece;
The stores processor module is used for described geographic information data piece is stored under the described store path with document form.
Preferably, described hash processing module further comprises:
Extraction unit is used for extracting a plurality of characteristic parameters of described spatial positional information;
The path generation unit is used for generating multistage store path according to described a plurality of characteristic parameters.
The embodiment of the invention also discloses a kind of geographic information data management system, described system connects a plurality of server nodes, comprising:
Storage device comprises acquisition module, hash processing module and stores processor module, and described acquisition module is used to obtain the spatial positional information through the geographic information data piece of pre-cutting; Described hash processing module is used for according to described spatial positional information the corresponding geographical information data block being carried out hash, obtains the store path of described geographic information data piece; Described stores processor module is used for described geographic information data piece is stored under the described store path with document form;
Distribution apparatus is used for described geographic information data block file is divided according to presetting rule, and is stored to respectively in each server node.
Preferably, described geographic information data management system also comprises:
Tape deck is used to write down the frequency of calling of each geographical information data block file;
Buffer storage is used for the described satisfactory geographic information data file of frequency that calls is added in the buffer memory of its existing server node.
Preferably, described distribution apparatus comprises:
Relating module is used to set up the property index table of the geographic information data block file of described server node address and its storage.
The embodiment of the invention also discloses a kind of dispatching method of geographic information data, comprising:
Receive the dispatch request that the user sends, generate required parameter, the described request parameter comprises the spatial positional information of the geographic information data piece that the user asks;
Calculate the store path of described geographic information data piece according to described spatial positional information;
Extract described geographic information data block file down from described store path.
Preferably, described store path comprises the server node address, and described dispatching method also comprises:
Obtain described geographic information data piece corresponding server node address.
Preferably, described dispatching method also comprises:
Judge in the buffer memory of described server node whether have described geographic information data block file, if then from buffer memory, directly extract described geographic information data block file; If not, then extract described geographic information data block file down from described store path.
The embodiment of the invention also discloses a kind of dispatching device of geographic information data, comprising:
The required parameter generation module is used to receive the dispatch request that the user sends, and generates required parameter, and the described request parameter comprises the spatial positional information of the geographic information data piece that the user asks;
Path calculation module is used for calculating according to described spatial positional information the store path of described geographic information data piece;
Extraction module is used for extracting described geographic information data block file down from described store path.
Preferably, described store path comprises the server node address, and described dispatching device also comprises:
Acquisition module is used to obtain described geographic information data piece corresponding server node address.
Preferably, described dispatching device also comprises:
Judge module is used for judging whether the buffer memory of described server node exists described geographic information data block file, if then trigger the buffer memory read module; If not, then trigger extraction module;
The buffer memory read module is used for directly extracting described geographic information data block file from buffer memory.
Compared with prior art, the embodiment of the invention has the following advantages:
At first, the present invention is by carrying out hash to the geographic information data piece through pre-cutting, obtain the store path of described geographic information data piece, make all corresponding one of each geographic information data piece can directly ask the geographic information data block file downloaded, the data that reduced system generate and inquiry
+Time, improved the GIS efficiency of service; In this case, can directly calculate the store path of corresponding data block file, effectively improve the reaction speed of system by the spatial positional information of the required geographic information data piece of user.
Moreover, the present invention is by further organizing the data block file after the hash, according to certain division foundation, hash data is divided into many parts, and layout by this distributed management, has been carried out equilibrium treatment to the load of server to a plurality of server nodes respectively, improve the operating efficiency of system, improved the upper limit of concurrent service.
In addition, the present invention puts into buffer memory by setting up the buffer memory of service node with calling the higher geographic information data piece of frequency, when user's request, can at first read in buffer memory, thereby further improve the reaction speed of system, user's experience is better.
At last, the present invention is for the service provider, and technology realizes simple, and no technology barrier does not have special secret algorithm, and cost and risk is lower.
Description of drawings
Fig. 1 is the flow chart of the storage means embodiment of a kind of geographic information data of the present invention;
Fig. 2 is the structural representation of the store path that obtains of a certain geographic information data piece hash;
Fig. 3 is the blocking organization structural representation of a kind of model inside;
Fig. 4 is the structural representation of the store path that obtains of a certain model data hash;
Fig. 5 is the structured flowchart of a kind of geographic information data storage device embodiment of the present invention;
Fig. 6 uses the flow chart that device embodiment shown in Figure 5 carries out the geographic information data storage;
Fig. 7 is the structured flowchart of a kind of geographic information data management system embodiment of the present invention;
Fig. 8 uses the schematic diagram that the preferred embodiment of the present invention is provided with a kind of geographic information data institutional framework;
Fig. 9 is the flow chart of the dispatching method embodiment of a kind of geographic information data of the present invention;
Figure 10 is the structured flowchart of the dispatching device embodiment of a kind of geographic information data of the present invention.
Embodiment
For above-mentioned purpose of the present invention, feature and advantage can be become apparent more, the present invention is further detailed explanation below in conjunction with the drawings and specific embodiments.
One of core idea of the embodiment of the invention is, in GIS, by the geographic information data piece through pre-cutting is carried out hash, obtain the store path of corresponding geographical information data block, make all corresponding geographic information data block file of spatial positional information of each geographic information data piece.
With reference to Fig. 1, show the flow chart of the storage means embodiment of a kind of geographic information data of the present invention, specifically may further comprise the steps:
In practice, the user is required often only be certain more among a small circle in, the geographic information data under a certain display level, thereby present embodiment need be realized based on the geographic information data piece through pre-cutting.In the present embodiment, should adopt different method of partitions to handle to dissimilar geographic information datas, for example, for having the map datum (comprising terrain data, image data etc.) that shows level, then can adopt the method for hierarchical block to handle.Wherein, described level is corresponding to the level of detail and the displaying ratio chi of displaying contents, derive from the source data of the different proportion chi of same area, perhaps, from same source data, generate, promptly according to showing needed engineer's scale difference according to different vacuate ranks, according to certain vacuate criterion, can also carry out vacuate and simplification to source data according to the needed data volume of each level, finally generate a plurality of demonstration levels.After such layering processing, can form a similar pyramidal map datum sequence, each level in the sequence has all comprised the map datum in whole geographic ranges, but on data volume, these map datums successively decrease step by step.Then, map datum after these process layerings processing is carried out piecemeal processing further, and described piecemeal can be foundation with the geographic range, for example, according to the regular grid that equates display size (as, square) other map datum of each display level is carried out cutting.The size of described regular grid can be decided according to data volume and file size that diagram data block file is individually comprised, the geographical span of described regular grid also should its corresponding demonstration rank be correlated with, be the different corresponding different spans of demonstration rank, by above-mentioned cutting method.Can obtain the block map data that a plurality of sizes are consistent and adjoin each other.In addition, for three-dimensional modeling data, then can directly carry out piecemeal etc. according to the method for above-mentioned regular grid cutting.Certain above-mentioned cutting method only is used for for example, and it all is feasible that those skilled in the art adopt any cutting method, and the present invention is not limited this.
Geographic information data piece behind the described piecemeal all has corresponding spatial positional information, and, described spatial positional information is made up of a plurality of characteristic parameters usually, for example, the longitude of certain characteristic point and latitude value in the geographic information data piece, the demonstration level of geographic information data piece etc., in this case, described Hash step 102 can further include following substep:
A plurality of characteristic parameters in substep S1, the described spatial positional information of extraction;
Substep S2, generate multistage store path according to described a plurality of characteristic parameters.
For example, when the spatial positional information of certain geographic information data piece comprises longitude, latitude value and demonstration hierarchical information, then can be according to the demonstration level information setting higher level store path of described geographic information data piece; Longitude or latitude value according to certain characteristic point in the described geographic information data piece are provided with subordinate's store path.
More specifically, described subordinate store path can also comprise one-level store path and secondary storage path, and in this case, described subordinate store path can be provided with by following steps:
Steps A 1, the one-level store path is set according to the represented longitude scope of longitude of certain characteristic point in the described geographic information data piece;
Steps A 2, the secondary storage path is set according to the represented latitude scope of latitude value of certain characteristic point in the described geographic information data piece.
In this example, described storing step 103 is, all geographic information data pieces in described longitude scope and the latitude scope are stored under the described store path with document form, and generate the unique characteristic of correspondence sign of each geographic information data piece respectively, so that the user directly asks to download.
The situation that below will use example in practice further specifies:
Certain landform and the image data piece of supposing geographic information data have by spatial positional information (x, y, level), x, y, level three characteristic parameters of representation space positional information respectively forms, wherein, x is characteristic point (central point or the further feature point of this data block, the present invention does not limit the setting of this point) longitude, y is the latitude value of this characteristic point, level represents the demonstration hierarchical information of this data block, according to these characteristic parameters this data block is carried out hash, obtain the store path of this data block.Particularly, the method for described hash can adopt any ashing technique, for example, based on above-mentioned characteristic parameter, defines its hash function and is:
f(BlockID)＝root_path\level\[x]\[y]\BlockID；
Be understandable that, by calculating this hash function, can obtain the store path of this data block after the hash: root_path level [x] [y] BlockID.Wherein, root_path represents the root path of this data block store, level represents higher level's store path of this data block, x represents the one-level store path of this data block, and y represents the secondary storage path of this data block, in practice, described x and y can be the concrete longitude and the latitude value of this data block, in this case, under the described secondary storage path, only can store a unique data block file.Yet, when dispatching store path is searched the time for reducing, the operating efficiency of further raising system, a kind of advantageous applications mode of present embodiment is to adopt the characteristic value of the certain span of representation feature parameter that corresponding path is set, such as, above-mentioned [x] is the value after described longitude is rounded, [y] is the value after described latitude value is rounded, in this case, the next a plurality of data block files that can store in its represented scope in described secondary storage path, and generation can unique signature identification BlockID that determines this geographic information data piece.For example, be the geographic information data piece of (1035600,247800,2) for spatial positional information, its corresponding store path schematic diagram is as shown in Figure 2.Need to prove the associated description of the aforementioned part of the corresponding specification in described higher level's store path, one-level store path and secondary storage path.
In this example, the method of described hash can also be provided with according to the difference of spatial positional information characteristic parameter, for example, when the spatial positional information of certain geographic information data piece only comprises longitude and latitude value, then can higher level's store path be set according to the longitude of certain characteristic point in the described geographic information data piece; Latitude value according to certain characteristic point in the described geographic information data piece is provided with subordinate's store path.
The situation that below will use example in practice further specifies:
If three-dimensional modeling data has been carried out following pre-cutting to be handled: the model of global range is divided in m * n the cell block (regular grid), described cell block is by the latitude and longitude value (x of its characteristic point, y) carry out index, each model has the ModelBlockID of a unique correspondence, and model inside has blocking organization mode as shown in Figure 3.In this case, the cell block of supposing certain model place for (x, y), wherein x is the longitude of characteristic point in this cell block (central point or further feature point), y is the latitude value of this characteristic point, defines corresponding hash function to be:
f(ModelBlockID)＝root_path\x\y\ModelBlockID\...；
Be understandable that, by calculating this hash function, can obtain the store path of this data block after the hash: root_path x y ModelBlockID ....For example, the locus of model data is (103,24), and ModelBlockID is ModelBlockID3, adopts above-mentioned hash function to carry out store path that hash calculates as shown in Figure 4.
In the present embodiment, by the geographic information data piece through pre-cutting is carried out hash, obtain the store path of described geographic information data piece, make all corresponding one of each geographic information data piece can directly ask the geographic information data block file downloaded, the data that reduced system generate and query time, have improved the GIS efficiency of service; In this case, can directly calculate the store path of corresponding data block file, avoid the use of complicated index file and strategy, effectively improve the reaction speed of system by the spatial positional information of the required geographic information data piece of user.
For present embodiment, for simple description, so it all is expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not subjected to the restriction of described sequence of movement, because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in the specification all belongs to preferred embodiment, and related action and module might not be that the present invention is necessary.
With reference to figure 5, show the structured flowchart of a kind of geographic information data storage device embodiment of the present invention, specifically comprise with lower module:
Preferably, described hash processing module 502 may further include with lower unit:
Extraction unit is used for extracting a plurality of characteristic parameters of described spatial positional information;
The path generation unit is used for generating multistage store path according to described a plurality of characteristic parameters.
With reference to figure 6, show and use the flow chart that device embodiment shown in Figure 5 carries out the geographic information data storage, specifically may further comprise the steps:
Preferably, described hash processing module 502 is carried out hash by following substep:
Substep B1, extraction unit extract a plurality of characteristic parameters in the described spatial positional information;
Substep B2, path generation unit generate multistage store path according to described a plurality of characteristic parameters.
For not detailed part in the description of above-mentioned Fig. 5 and Fig. 6, can be referring to the aforementioned relevant portion of this specification.
Be well known that WebGIS mainly has following characteristic: (1) WebGIS is based on the client/server system of network, rather than one-of-a-kind system independently; (2) WebGIS utilizes the internet to carry out information exchange between the client and server, and the transmission of its information is global; (3) WebGIS is a distributed system, and user and server can be distributed on different location and the different computer platform.Above-mentioned characteristic based on WebGIS, one of another core idea of the present invention is, data block file after the hash is further organized, division foundation according to certain is divided into many parts with hash data, and the difference layout is to a plurality of server nodes, by this distributed management, equilibrium treatment is carried out in load to server, thereby effectively alleviates load of server, improves the operating efficiency of system.
With reference to figure 7, show the structured flowchart of a kind of geographic information data management system embodiment of the present invention, described system connects a plurality of server nodes, comprises with lower device:
In the present embodiment,, the geographic information data block file after the hash is further organized by distribution apparatus, as required or experience any presetting rule is set, the geographic information data block file is divided into many parts, and is arranged into respectively on a plurality of server nodes.Described presetting rule can be divided for the represented geographic range of foundation geographic information data block file, also can divide for the frequency of calling according to each geographical information data block, can also be for dividing according to the data type of geographic information data block file etc., it can also be the combination of above-mentioned rule, those skilled in the art can not be excessive according to the load of individual server node, the principle of the load balancing of each server node, it all is feasible that any presetting rule is set, and the present invention does not need this to limit.
When carrying out distributed treatment,, can set up a concordance list, in table, set up the corresponding relation of the geographic information data block file attribute of the address of service node and its storage for dispatching conveniently.Thereby preferably, described distribution apparatus can also comprise relating module: the property index table that is used to set up the geographic information data block file of described server node address and its storage.
For example, suppose that geographical information data block file divides and be stored to respectively each server node according to data type, then can generate concordance list as follows:
| The server node address | Data type |
| http://192.168.0.1/ | terrain |
| http://192.168.0.2/ | image |
| http://192.168.0.3/ | model |
Certainly, above-mentioned all only is for present embodiment is described for explaining of concordance list and presetting rule, and those skilled in the art can set up corresponding concordance list and presetting rule on their own fully as required, and the present invention does not limit this.For improving the reaction speed of server node, reduce data in server scheduling load, in the present embodiment, the service node buffer memory can also be set, particularly, promptly can be by on each service node, setting up the metadata cache of service node, with access frequency higher data (for example, area-of-interest etc.), use high speed storing equipment (as internal memory) buffer memory to get up, disk access time during with the minimizing request of data, the efficiency of service of raising service node.Thereby preferably, present embodiment can also comprise with lower device:
Tape deck is used to write down the frequency of calling of each geographical information data block file;
Buffer storage is used for the described satisfactory geographic information data file of frequency that calls is added in the buffer memory of its existing server node.
In practice, the data in the buffer memory dynamically update, and in this case, by writing down the frequency of calling of each geographical information data block file, ordering is then got and called several higher geographic information data block files of frequency and put into buffer memory.Preferably, the described record that calls frequency can be finished by counter, and described number can be according to the hardware case of service node and some other factor, and for example importance degree etc. is set.
Below realize in practice that with a kind of the method for buffer memory is that example describes, carry out following operation at each server node:
(a) set up access counter at each geographic information data block file, initial value is 0;
(b), the counting of this data block file is added 1 according to the call request of sending at certain geographical information data block file;
(c) add up the counting of all geographic information data block files, and sort from high to low;
(d) preceding 5000 geographic information data block files are added into buffer memory.
When initial buffer memory, may there be data in the buffer memory, along with the increase of server number of run, the geographic information data block file in the buffer memory will constantly add, upgrade.Certainly, the method that those skilled in the art adopt any record to call frequency and buffer memory all is feasible, and the present invention does not need this to limit.
Use a kind of geographic information data institutional framework schematic diagram that the preferred embodiment of system of the present invention is provided with as shown in Figure 8, need to prove, in practice, described scheduling engine can be provided with also and can not be provided with, when dispatch service is finished by server, according to the dispatch request that the user sends, Web server 801 can obtain the store path of corresponding geographical information data block file by scheduling engine 802; And when dispatch service is finished by the client (not shown), then can directly calculate the store path of corresponding geographical information data block file by client, and do not need to be provided with scheduling engine 802.
Because the storage device in the present embodiment is identical with aforementioned storage device, so description is fairly simple, relevant part gets final product referring to the part explanation of preceding method and device embodiment.
Present embodiment has carried out equilibrium treatment by distributed management to the load of server, has made full use of multiserver node distribution formula advantage, has improved the operating efficiency of system, has improved the upper limit of concurrent service greatly.In addition, also adopt caching mechanism, effectively improved the reaction speed of system.
Based on above-mentioned hash storage mode and multiserver node Distribution Strategy, can set corresponding scheduling strategy, calculate corresponding service node and store path, with response user's dispatch request.With reference to figure 9, show the flow chart of the dispatching method embodiment of a kind of geographic information data of the present invention, specifically may further comprise the steps:
The dispatch request that step 901, reception user send generates required parameter, and the described request parameter comprises the spatial positional information of the geographic information data piece that the user asks;
If described store path comprises the server node address, then present embodiment can also may further comprise the steps:
Obtain described geographic information data piece corresponding server node address.
If set up metadata cache on the described server node, then present embodiment may further include following steps:
Judge in the buffer memory of described server node whether have described geographic information data block file, if then from buffer memory, directly extract described geographic information data block file; If not, then extract described geographic information data block file down from the respective stored path of described server node address.
For making those skilled in the art understand correlation technique of the present invention better, below by way of example dispatching method of the present invention is described:
(1) supposes according to the user at terrain data (1035600,247800,2), image data (1035600,247800,2), model data (103,24), ModelBlockID3 sends dispatch request, and generate required parameter and comprise: the spatial positional information of landform and spatial data is (1035600,247800), BlockID is (1035600,247800,2); The spatial positional information of model data is (103,24), and ModelBlockID is ModelBlockID3;
(2) select hash function according to data type, calculate the relative path of above-mentioned terrain data, image data and model data store according to the hash function of selecting:
For terrain data, use hash function f (BlockID)=root_path level x y the BlockID relative path that calculates its storage be terrain_data/2/103/24/ (1035600,247800,2);
For image data, use hash function f (BlockID)=root_path level x y the BlockID relative path that calculates its storage be image_data/2/103/24/ (1035600,247800,2);
For model data, use hash function f (ModelBlockID)=root_path x y Model-BlockID ... the relative path that calculates its storage is model_data/103/24/ModelBlockID3/...;
(3) according to concordance list, obtain the server node path at corresponding data place, obtain the absolute path of storage:
Terrain data is http: // 192.168.0.1/terrain_data/2/103/24/ (1035600,247800,2);
Image data is http: // 192.168.0.2/image_data/2/103/24/ (1035600,247800,2);
Model data is: http: // 192.168.0.3/model_data/103/24/ModelBlockID3/...;
(4) search corresponding data block in the corresponding server node and whether be present in the buffer memory of this server node,, then directly from buffer memory, return the corresponding data block file if exist; If there is no, then read and return corresponding data block file from server node.
In practice, described scheduling process can be finished by the scheduling engine of server end, in this case, by server corresponding geographical information data block file is returned to the user; In addition, described scheduling process also can be finished by client, and in this case, then corresponding to the geographic information data block file by client downloads, the present invention does not limit this.
For present embodiment, for simple description, so it all is expressed as a series of combination of actions, but those skilled in the art should know, the present invention is not subjected to the restriction of described sequence of movement, because according to the present invention, some step can adopt other orders or carry out simultaneously.Secondly, those skilled in the art also should know, the embodiment described in the specification all belongs to preferred embodiment, and related action and module might not be that the present invention is necessary.
With reference to Figure 10, show the structured flowchart of the dispatching device embodiment of a kind of geographic information data of the present invention, specifically comprise with lower module:
Required parameter generation module 1001 is used to receive the dispatch request that the user sends, and generates required parameter, and the described request parameter comprises the spatial positional information of the geographic information data piece that the user asks;
If described store path comprises the server node address, then present embodiment can also comprise acquisition module, is used to obtain described geographic information data piece corresponding server node address.
If set up metadata cache on the described server node, present embodiment can further include with lower module:
Judge module is used for judging whether the buffer memory of described server node exists described geographic information data block file, if then trigger the buffer memory read module; If not, then trigger extraction module;
The buffer memory read module is used for directly extracting described geographic information data block file from buffer memory.
For described device embodiment, because it is substantially corresponding to method embodiment, so description is fairly simple, relevant part gets final product referring to the part explanation of method embodiment.Identical similar part is mutually referring to getting final product between each embodiment in this specification, and each embodiment stresses all is difference with other embodiment.
Be understandable that the present invention can be used in numerous general or special purpose computingasystem environment or the configuration.For example: personal computer, server computer, handheld device or portable set, plate equipment, multicomputer system, the system based on microprocessor, set top box, programmable consumer-elcetronics devices, network PC, minicom, mainframe computer, comprise distributed computing environment (DCE) of above any system or equipment or the like.
In addition, the present invention can describe in the general context of the computer executable instructions of being carried out by computer, for example program module.Usually, program module comprises the routine carrying out particular task or realize particular abstract, program, object, module, data structure or the like.Also can in distributed computing environment (DCE), put into practice the present invention, in these distributed computing environment (DCE), by by communication network connected teleprocessing equipment execute the task.In distributed computing environment (DCE), program module can be arranged in the local and remote computer-readable storage medium that comprises memory device.
In the present invention, " module ", " device ", " system " or the like refer to be applied to the related entities of computer, as combination, software or the executory software etc. of hardware, hardware and software.In detail, for example, module can but to be not limited to be process, processor, object, executable module, execution thread, program and/or the computer that runs on processor.Also have, run on application program on the server or shell script, server can be a module.One or more modules can be in process of carrying out and/or thread, and module can and/or be distributed between two or many computers in localization on the computer, and can be by various computer-readable mediums operations.Module can also be according to the signal with one or more packets, for example, from one with local system, distributed system in another module mutual, and/or communicate by this locality and/or remote process at the network of internet signal by the data of signal and other system interaction.
More than the storage device of the storage means of a kind of geographic information data provided by the present invention, a kind of geographic information data, a kind of geographic information data management system, a kind of dispatching method of geographic information data and a kind of dispatching device of geographic information data are described in detail, used specific case herein principle of the present invention and execution mode are set forth, the explanation of above embodiment just is used for helping to understand method of the present invention and core concept thereof; Simultaneously, for one of ordinary skill in the art, according to thought of the present invention, the part that all can change in specific embodiments and applications, in sum, this description should not be construed as limitation of the present invention.
Claims (13)
1. the storage means of a geographic information data is characterized in that, comprising:
Obtain spatial positional information through the geographic information data piece of pre-cutting;
According to described spatial positional information the corresponding geographical information data block is carried out hash, obtain the store path of described geographic information data piece;
Described geographic information data piece is stored under the described store path with document form.
2. the method for claim 1 is characterized in that, described Hash step comprises:
Extract a plurality of characteristic parameters in the described spatial positional information;
Generate multistage store path according to described a plurality of characteristic parameters.
3. the storage device of a geographic information data is characterized in that, comprising:
Acquisition module is used to obtain the spatial positional information through the geographic information data piece of pre-cutting;
The hash processing module is used for according to described spatial positional information the corresponding geographical information data block being carried out hash, obtains the store path of described geographic information data piece;
The stores processor module is used for described geographic information data piece is stored under the described store path with document form.
4. storage device as claimed in claim 3 is characterized in that, described hash processing module further comprises:
Extraction unit is used for extracting a plurality of characteristic parameters of described spatial positional information;
The path generation unit is used for generating multistage store path according to described a plurality of characteristic parameters.
5. a geographic information data management system is characterized in that, described system connects a plurality of server nodes, comprising:
Storage device comprises acquisition module, hash processing module and stores processor module, and described acquisition module is used to obtain the spatial positional information through the geographic information data piece of pre-cutting; Described hash processing module is used for according to described spatial positional information the corresponding geographical information data block being carried out hash, obtains the store path of described geographic information data piece; Described stores processor module is used for described geographic information data piece is stored under the described store path with document form;
Distribution apparatus is used for described geographic information data block file is divided according to presetting rule, and is stored to respectively in each server node.
6. geographic information data management system as claimed in claim 5 is characterized in that, also comprises:
Tape deck is used to write down the frequency of calling of each geographical information data block file;
Buffer storage is used for the described satisfactory geographic information data file of frequency that calls is added in the buffer memory of its existing server node.
7. as claim 5 or 6 described geographic information data management systems, it is characterized in that described distribution apparatus comprises:
Relating module is used to set up the property index table of the geographic information data block file of described server node address and its storage.
8. the dispatching method of a geographic information data is characterized in that, comprising:
Receive the dispatch request that the user sends, generate required parameter, the described request parameter comprises the spatial positional information of the geographic information data piece that the user asks;
Calculate the store path of described geographic information data piece according to described spatial positional information;
Extract described geographic information data block file down from described store path.
9. dispatching method as claimed in claim 8 is characterized in that described store path comprises the server node address, and described dispatching method also comprises:
Obtain described geographic information data piece corresponding server node address.
10. dispatching method as claimed in claim 9 is characterized in that, also comprises:
Judge in the buffer memory of described server node whether have described geographic information data block file, if then from buffer memory, directly extract described geographic information data block file; If not, then extract described geographic information data block file down from described store path.
11. the dispatching device of a geographic information data is characterized in that, comprising:
The required parameter generation module is used to receive the dispatch request that the user sends, and generates required parameter, and the described request parameter comprises the spatial positional information of the geographic information data piece that the user asks;
Path calculation module is used for calculating according to described spatial positional information the store path of described geographic information data piece;
Extraction module is used for extracting described geographic information data block file down from described store path.
12. dispatching device as claimed in claim 11 is characterized in that, described store path comprises the server node address, and described dispatching device also comprises:
Acquisition module is used to obtain described geographic information data piece corresponding server node address.
13. dispatching device as claimed in claim 12 is characterized in that, also comprises:
Judge module is used for judging whether the buffer memory of described server node exists described geographic information data block file, if then trigger the buffer memory read module; If not, then trigger extraction module;
The buffer memory read module is used for directly extracting described geographic information data block file from buffer memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101204491A CN101370025A (en) | 2007-08-17 | 2007-08-17 | Storing method, scheduling method and management system for geographic information data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNA2007101204491A CN101370025A (en) | 2007-08-17 | 2007-08-17 | Storing method, scheduling method and management system for geographic information data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101370025A true CN101370025A (en) | 2009-02-18 |
Family
ID=40413640
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNA2007101204491A Pending CN101370025A (en) | 2007-08-17 | 2007-08-17 | Storing method, scheduling method and management system for geographic information data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101370025A (en) |
Cited By (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101887398A (en) * | 2010-06-25 | 2010-11-17 | 浪潮(北京)电子信息产业有限公司 | Method and system for dynamically enhancing input/output (I/O) throughput of server |
| CN102169494A (en) * | 2011-04-06 | 2011-08-31 | 北京师范大学 | Distributed remotely-sensed data managing system and method |
| CN102495848A (en) * | 2011-11-17 | 2012-06-13 | 深圳市赛格导航科技股份有限公司 | Method for processing massive GPS (global positioning system) data and system |
| CN102541418A (en) * | 2010-12-30 | 2012-07-04 | 上海博泰悦臻电子设备制造有限公司 | Processing method and device for realizing map display |
| CN103137009A (en) * | 2011-11-30 | 2013-06-05 | 上海博泰悦臻电子设备制造有限公司 | Display method and device for map and vehicle-mounted system |
| CN103345507A (en) * | 2013-07-04 | 2013-10-09 | 江西交通咨询公司 | Three-dimensional map dynamic loading method based on collision box principle |
| CN103957504A (en) * | 2014-04-21 | 2014-07-30 | 百度在线网络技术（北京）有限公司 | Positioning service assessment method, device and system |
| CN104156475A (en) * | 2014-08-25 | 2014-11-19 | 中国联合网络通信集团有限公司 | Geographic information reading method and device |
| CN105354091A (en) * | 2015-10-19 | 2016-02-24 | 北京天耀宏图科技有限公司 | Spatial position based elastic load balance method and system |
| CN106095331A (en) * | 2016-05-31 | 2016-11-09 | 浙江科澜信息技术有限公司 | A kind of control method fixing big file internal resource |
| CN106257450A (en) * | 2015-06-19 | 2016-12-28 | 杭州海康威视数字技术股份有限公司 | The document alignment of group system, storage method and apparatus |
| CN103677930B (en) * | 2013-12-19 | 2017-01-04 | 广东威创视讯科技股份有限公司 | Based on GIS data loading method and the device of spelling wall system |
| CN106528793A (en) * | 2016-12-14 | 2017-03-22 | 国家测绘地理信息局卫星测绘应用中心 | Spatial-temporal fragment storage method for distributed spatial database |
| CN106599040A (en) * | 2016-11-07 | 2017-04-26 | 中国科学院软件研究所 | Layered indexing method and search method for cloud storage |
| CN103678578B (en) * | 2013-12-10 | 2017-07-18 | 广东威创视讯科技股份有限公司 | A kind of data visualization processing method, server and data visualization processing system |
| CN107111460A (en) * | 2015-03-30 | 2017-08-29 | 西部数据技术公司 | Use the data de-duplication of block file |
| CN108875087A (en) * | 2016-10-24 | 2018-11-23 | 北京亚控科技发展有限公司 | A method of description things space attribute is simultaneously searched based on the description |
| CN109657481A (en) * | 2017-10-12 | 2019-04-19 | 北京京东尚科信息技术有限公司 | Data managing method and device |
| CN112307025A (en) * | 2020-10-29 | 2021-02-02 | 杭州海康威视数字技术股份有限公司 | Method and device for constructing distributed index |
| GB2619229A (en) * | 2021-02-28 | 2023-11-29 | Ibm | Recording a separated sound from a sound stream mixture on a personal device |
-
2007
- 2007-08-17 CN CNA2007101204491A patent/CN101370025A/en active Pending
Cited By (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101887398B (en) * | 2010-06-25 | 2012-08-29 | 浪潮(北京)电子信息产业有限公司 | Method and system for dynamically enhancing input/output (I/O) throughput of server |
| CN101887398A (en) * | 2010-06-25 | 2010-11-17 | 浪潮(北京)电子信息产业有限公司 | Method and system for dynamically enhancing input/output (I/O) throughput of server |
| CN102541418A (en) * | 2010-12-30 | 2012-07-04 | 上海博泰悦臻电子设备制造有限公司 | Processing method and device for realizing map display |
| CN102169494A (en) * | 2011-04-06 | 2011-08-31 | 北京师范大学 | Distributed remotely-sensed data managing system and method |
| CN102495848A (en) * | 2011-11-17 | 2012-06-13 | 深圳市赛格导航科技股份有限公司 | Method for processing massive GPS (global positioning system) data and system |
| CN102495848B (en) * | 2011-11-17 | 2013-06-19 | 深圳市赛格导航科技股份有限公司 | Method for processing massive GPS (global positioning system) data and system |
| CN103137009A (en) * | 2011-11-30 | 2013-06-05 | 上海博泰悦臻电子设备制造有限公司 | Display method and device for map and vehicle-mounted system |
| CN103137009B (en) * | 2011-11-30 | 2017-05-24 | 上海博泰悦臻电子设备制造有限公司 | Display method and device for map and vehicle-mounted system |
| CN103345507B (en) * | 2013-07-04 | 2016-10-12 | 江西交通咨询公司 | A kind of method based on collision box principle dynamic load three-dimensional map |
| CN103345507A (en) * | 2013-07-04 | 2013-10-09 | 江西交通咨询公司 | Three-dimensional map dynamic loading method based on collision box principle |
| CN103678578B (en) * | 2013-12-10 | 2017-07-18 | 广东威创视讯科技股份有限公司 | A kind of data visualization processing method, server and data visualization processing system |
| CN103677930B (en) * | 2013-12-19 | 2017-01-04 | 广东威创视讯科技股份有限公司 | Based on GIS data loading method and the device of spelling wall system |
| CN103957504A (en) * | 2014-04-21 | 2014-07-30 | 百度在线网络技术（北京）有限公司 | Positioning service assessment method, device and system |
| CN103957504B (en) * | 2014-04-21 | 2018-05-04 | 百度在线网络技术（北京）有限公司 | Positioning service appraisal procedure, apparatus and system |
| CN104156475B (en) * | 2014-08-25 | 2018-06-01 | 中国联合网络通信集团有限公司 | Geography information read method and device |
| CN104156475A (en) * | 2014-08-25 | 2014-11-19 | 中国联合网络通信集团有限公司 | Geographic information reading method and device |
| CN107111460B (en) * | 2015-03-30 | 2020-04-14 | 西部数据技术公司 | Deduplication using chunk files |
| CN107111460A (en) * | 2015-03-30 | 2017-08-29 | 西部数据技术公司 | Use the data de-duplication of block file |
| CN106257450B (en) * | 2015-06-19 | 2019-09-17 | 杭州海康威视数字技术股份有限公司 | Document alignment, storage method and the device of group system |
| CN106257450A (en) * | 2015-06-19 | 2016-12-28 | 杭州海康威视数字技术股份有限公司 | The document alignment of group system, storage method and apparatus |
| CN105354091A (en) * | 2015-10-19 | 2016-02-24 | 北京天耀宏图科技有限公司 | Spatial position based elastic load balance method and system |
| CN106095331A (en) * | 2016-05-31 | 2016-11-09 | 浙江科澜信息技术有限公司 | A kind of control method fixing big file internal resource |
| CN108875087A (en) * | 2016-10-24 | 2018-11-23 | 北京亚控科技发展有限公司 | A method of description things space attribute is simultaneously searched based on the description |
| CN108875087B (en) * | 2016-10-24 | 2021-09-21 | 北京亚控科技发展有限公司 | Method for describing object space attribute and searching based on description |
| CN106599040A (en) * | 2016-11-07 | 2017-04-26 | 中国科学院软件研究所 | Layered indexing method and search method for cloud storage |
| CN106528793A (en) * | 2016-12-14 | 2017-03-22 | 国家测绘地理信息局卫星测绘应用中心 | Spatial-temporal fragment storage method for distributed spatial database |
| CN106528793B (en) * | 2016-12-14 | 2019-12-24 | 自然资源部国土卫星遥感应用中心 | Space-time fragment storage method of distributed spatial database |
| CN109657481A (en) * | 2017-10-12 | 2019-04-19 | 北京京东尚科信息技术有限公司 | Data managing method and device |
| CN109657481B (en) * | 2017-10-12 | 2020-12-22 | 北京京东尚科信息技术有限公司 | Data management method and device |
| CN112307025A (en) * | 2020-10-29 | 2021-02-02 | 杭州海康威视数字技术股份有限公司 | Method and device for constructing distributed index |
| GB2619229A (en) * | 2021-02-28 | 2023-11-29 | Ibm | Recording a separated sound from a sound stream mixture on a personal device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101370025A (en) | Storing method, scheduling method and management system for geographic information data | |
| CN101346000B (en) | System for providing local mobile geographic information service based on GPS and mobile terminal | |
| JP6998964B2 (en) | Methods and equipment for determining the geofence index grid | |
| Wang et al. | Research and implementation on spatial data storage and operation based on Hadoop platform | |
| CN103927933B (en) | A kind of magnanimity moves method and the device that target renders | |
| CN101963996B (en) | Global raster data storing method | |
| CN103455531B (en) | A kind of parallel index method supporting high dimensional data to have inquiry partially in real time | |
| Hongchao et al. | Distributed data organization and parallel data retrieval methods for huge laser scanner point clouds | |
| CN103488760A (en) | Provision method of geographic information tile services and device for implementing provision method | |
| CN105183921A (en) | Shop addressing system based on bi-chromatic reverse nearest neighbor inquiry under mobile cloud computing environment | |
| CN109871418A (en) | A kind of space index method and system of space-time data | |
| CN104281701A (en) | Method and system for querying distributed multi-scale spatial data | |
| CN101719148B (en) | Three-dimensional spatial information saving method, device, system and query system | |
| CN106156138A (en) | The foundation of the spatial index of point of interest, Perimeter method and apparatus | |
| CN103064670A (en) | Method and system for innovation platform data management based on place net | |
| CN109359237A (en) | It is a kind of for search for boarding program method and apparatus | |
| CN106471501A (en) | The method of data query, the storage method data system of data object | |
| US20150293971A1 (en) | Distributed queries over geometric objects | |
| Uznir et al. | Improving 3D spatial queries search: Newfangled technique of space filling curves in 3D city modeling | |
| CN111859187B (en) | POI query method, device, equipment and medium based on distributed graph database | |
| CN103167032B (en) | The indoor positioning background service system of map auxiliary | |
| CN101436204A (en) | City evolvement simulation implementing method based on paralleling elementary cell automatic machine | |
| CN115756870A (en) | Organization model construction method and space-time data storage method based on GeoSOT grid computing power | |
| US20220303720A1 (en) | System and Method of Forecasting Based on Periodical Sketching of Big Data of Observations | |
| CN103685380A (en) | Geographic information data distribution service method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20090218 |