CN101014044A - Network GIS system and data transmitting method thereof - Google Patents
Network GIS system and data transmitting method thereof Download PDFInfo
- Publication number
- CN101014044A CN101014044A CN 200710051430 CN200710051430A CN101014044A CN 101014044 A CN101014044 A CN 101014044A CN 200710051430 CN200710051430 CN 200710051430 CN 200710051430 A CN200710051430 A CN 200710051430A CN 101014044 A CN101014044 A CN 101014044A
- Authority
- CN
- China
- Prior art keywords
- gis
- server
- data
- object storage
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides one network GIS system and its data transmission method, wherein, the system comprises the following parts: GIS customer end to provide GIS service require operation and to get service result; application servo group to respond GIS service require and services; subject based memory group to store subject space data and to provide common pool to application servo. The transmission method comprises the following steps: space data stores space memory subject based on group and the application servo group and the memory group are combined.
Description
Technical field
The invention belongs to the geographical information technology field, particularly a kind of network GIS system and data transmission method thereof.
Background technology
Network provides an information superhighway for information exchange between the user and information inquiry all over the world, GIS-Geographic Information System (Geographic Information System, be called for short GIS) have abundant space querying, spatial analysis and attribute management function, becoming the main contents of Internet or Intranet.Along with the continuous development of Internet technology and people demand to generalized information system, generalized information system is merged mutually with network technology, the function of utilizing Internet to browse, inquire about and analyze for the user provides spatial data, form the geographical space integrated platform of a networking, become the inexorable trend of generalized information system development.Along with the enlarging day by day of network GIS application, spatial data resolution improve constantly and one dimension is handled the transformation of handling to multidimensional, the spatial data amount of catenet GIS management sharply increases, to the TB level, even PB level is being the data-centered transformation of middle mind-set with system from the GB level.
At present, network GIS comprises client computer, application server, database server in the typical three-decker of being applied as of Internet, and all spatial datas and application services all are placed on server end, greatly reduce the workload of FTP client FTP.But along with the increase of spatial data amount, there are two transfer of data bottlenecks in this structure: server provides the network service bandwidth bottleneck of service and the storage I/O bandwidth bottleneck of spatial data storage system.Specifically, increase when the GIS number of users, the GIS application server of Single-Server structure is subjected to the restriction of the network bandwidth, be difficult to satisfy the requirement of multi-user concurrent visit, the visit capacity of this service number system also sharply increases, and this spatial data transmission pressure has caused the storage I/O bottleneck of spatial data storage system.Because network GIS is used with the regular transaction processing a great difference is arranged, outstanding behaviours is in processing mode, the spatial distributions of googol according to amount, complexity, therefore the technological means of these two kinds of bottlenecks does not appear solving in existing network GIS technical field as yet, and the network GIS application and development is restricted.
Summary of the invention
The object of the invention is to solve the prior art deficiency, provides the network GIS technical scheme to overcome network service bandwidth bottleneck and storage I/O bandwidth bottleneck.
For achieving the above object, network GIS system of the present invention comprises following part, and the GIS client is used for the GIS service request operation being provided and obtaining service result to the client; Application server cluster is used to respond the GIS service request of GIS client and GIS is provided service; Based on the object storage cluster, be used for mode memory space data, and provide the storage shared pool to application server cluster with the space storage object.
And application server cluster is made up of load dispatch device and GIS server pools, and above-mentioned part is connected by the switching network based on TCP/IP.
And, load dispatch device copy is set.
And the GIS server pools adopts the LVS server to form.
And, form by meta data server with based on object storage equipment based on the object storage cluster.
And, GIS server, meta data server and based on object storage equipment by switching network interconnection based on TCP/IP.
The present invention also provides the data transmission method of above-mentioned network GIS system, spatial data is stored in based in the object storage cluster in the mode of space storage object, application server cluster and combine based on the object storage cluster, provide the storage shared pool based on the object storage cluster to application server cluster, the GIS client visits based on the space storage object in the object storage cluster by application server cluster.
And control path, data path separate with the management path, and the GIS server sends data access request by the control path to meta data server; Meta data server is managed based on object storage equipment by the management path; The GIS server is directly visited based on object storage equipment by data path.
And the GIS client is from based on the data transmission procedure that obtains spatial data the object storage equipment being:
(a) the GIS client is sent the GIS service request to the load dispatch device;
(b) the load dispatch device is selected a GIS server and to this GIS server forwards GIS service request from the GIS server pools;
(c) the GIS server sends data service request to meta data server;
(d) meta data server authenticates the GIS server, returns effective credential;
(e) GIS server by utilizing credential is to based on object storage equipment sending data access request;
(f) verify the legitimacy of GIS server data request based on object storage equipment by credential, set up transfer of data and connect;
(g) the GIS server will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to the GIS client.
And in the term of validity of credential, the GIS client continues to need not repeating step (d)～(f) from when obtaining spatial data the object storage equipment, directly carries out exchanges data at the GIS server between based on object storage equipment.
The present invention creatively is provided with dual cluster and realizes network GIS system, come service in the supervising the network generalized information system by application server cluster, has solved the network service bandwidth bottleneck that the GIS server provides service; By application server cluster with based on the combination of object storage cluster, make up new spatial data transmission path, solved storage I/O bandwidth bottleneck.By two kinds of transfer of data bottlenecks of comprehensive solution, the present invention has significantly improved the message transmission rate of network GIS.The present invention also uses for network GIS the data transmission method of new network GIS system is provided, and has set up safe data transmission mechanism; Employing solves the isomerous environment problem of memory device based on the object storage mode.Enforcement of the present invention will be established solid network foundation for the popularization and application of global geographical information, for human lives's application of aspects geography information is brought huge convenience.
Description of drawings
Fig. 1 is a network GIS system composition frame chart of the present invention;
Fig. 2 is an application server cluster schematic diagram of the present invention;
Fig. 3 is of the present invention based on object storage cluster schematic diagram;
Fig. 4 is the transfer of data workflow diagram of the embodiment of the invention.
Embodiment
Referring to accompanying drawing 1, network GIS system provided by the invention comprises following part,
(1) the GIS client 1, and being used for provides GIS service request operation to the client;
The GIS client part mainly is that the client computer that the GIS client software is housed is formed; The GIS client links to each other with application server cluster by network (adopting Internet usually).It is partly existing that the GIS client part belongs to prior art.In a network GIS system, the quantity of GIS client usually is huge and uncertain, and the user only needs the GIS client software is installed on personal computer, means that promptly producing one can supply the client of access.Unless the therefore high GIS-Geographic Information System (for example military use) of safety requirements, GIS client 1 partly adopts internal lan to be connected with other, and employing Internet connection is the most practical way of most convenient under other situations.
(2) application server cluster 2, be used to respond the GIS service request of GIS client and GIS is provided service;
Application server in function that application server cluster is partly realized and the prior art three-decker is similar, is used to respond the GIS client-requested and service is provided.Application server cluster of the present invention partly is made up of load dispatch device 211, GIS server pools, can adopt the 100M/1000M high speed switching network of use based on TCP/IP when specifically implementing.
Cluster is the set or the group of a plurality of systems, and they work as individual server together.Therefore consider the service role that network GIS is huge day by day, adopting Clustering that the GIS service is provided is the best thinking that solves network service bandwidth bottleneck.The GIS server pools comprises a plurality of GIS servers that same services is provided, and each GIS server plays a role as a node of cluster.Cluster server technology based on the Linux core is the most ripe at present, and application server cluster 2 can make up by LVS server cluster standard when specifically implementing, and the GIS server can adopt the LVS server.For Resources allocation, also load dispatch device 211 need be set, when GIS client 1 sends the GIS service request, load dispatch device 211 will be transmitted to a certain GIS server in the GIS server pools with user's request according to built-in dispatching algorithm.Load dispatch device 211 is load balancing cores of whole application server cluster, and all operations are all finished in the (SuSE) Linux OS core space when specifically implementing, and expense is very little, has very high throughput.The GIS service need be called spatial data, and the present invention is by providing shared memory space based on the object storage cluster, with calling of all GIS servers in the support GIS server pools.
Referring to Fig. 2, the embodiment of the invention also is provided with load dispatch device copy 212 standby as load dispatch device 211, is unique part in the face of GIS client 1 in the whole application server cluster 2; The GIS server pools is formed (only enumerate two GIS servers in the accompanying drawing, in fact can expand more) by GIS server 221 and GIS server 222 etc., constitutes the real supplier of GIS service.When the load of receiving when whole system surpasses the disposal ability of all nodes at present, can in the GIS server pools, increase the GIS server and satisfy ever-increasing request load.The component part that GIS application server, data server, WMS server (WMS is a warehouse management system) or the like various GIS servers can be the GIS server pools.For good retractility and availability is provided, the present invention has adopted based on object storage technology, and the object-based storage cluster file system of GIS server access is just as the visit local file system.For the ease of the principle of reactive applications server cluster 2, the embodiment of the invention will be called the storage shared pool of application server cluster based on the shared memory space that object storage cluster 3 is realized, adopt the X mark.
(3), be used for mode memory space data, and provide storage shared pool X to application server cluster with the space storage object based on object storage cluster 3.
The data capacity of single database server can't satisfy network GIS to be used, and the present invention adopts the cluster memory technology to replace the effect of database server in the prior art.The mass data storage technology has experienced the three phases to SAN (storage area network) by DAS (direct-connected mode is stored), NAS (network is directly stored): wherein the DAS mode is that memory device is passed through cable directly to server, be piling up of hardware, do not have the improvement of file system, use limited in default of centralized management solution; The NAS mode can be considered piece level Clustering, is the All Files under the different system platform is deposited in the memory device, therefore has the I/O bottleneck equally, also can't solve the bottleneck problem that network GIS faces; The SAN mode realizes the file-level cluster by a software virtual layer, and only needing by a SAN file system is the addressable file that is stored on a plurality of equipment, and therefore a plurality of equipment constitute cluster can provide more space for the storage data.But present this mode still is difficult to satisfy the requirement of network GIS, because typical SAN mode need be provided with the center of meta data server as the large-scale cluster storage, obtain the storage data and need pass through visit, control, the management of meta data server, so meta data server constitutes the I/O bottleneck easily.And the SAN mode can only be managed the file of homogeneous environment concentratedly, is difficult to be applied to network GIS complicated spatial data source.
The present invention proposes the storage cluster scheme that is suitable for network GIS, by application server cluster 2 with based on the combination of object storage cluster 3, make up new spatial data transmission path, GIS client 1 visits based on the space storage object in the object storage cluster 3 by application server cluster 2, and the direct transmission by GIS server and memory device has solved storage I/O bandwidth bottleneck.
The present invention adopts based on object storage equipment 32, based on the abstract design of object storage by object hierarchy, functions such as the visit of storage, control, management are repartitioned, the logical construction of file system and the mapping relations of physical store are hidden into object one deck, and the accessing operation of data is realized by the interface of object.Can be hidden in the object layer separating in device-dependent characteristic (distributing) slave unit one deck based on object storage, realize cross-platform sharing, effectively solve the isomerous environment problem that SAN faces as piece.During concrete enforcement, massive spatial data is decomposed into a series of spaces storage object according to own characteristic, application and storage demand and carries out object-based spatial data storage and management.The space storage object can be defined as one group and be distributed in one or more based on the object of being made up of spatial data, memory attribute and operation on the object storage equipment.Memory attribute is used for defining the storage characteristics of different spaces data, as data layout, security information and behaviour in service statistical information etc., thereby can indicate operational processes to spatial data according to memory attribute.Based on object storage spatial data and attribute data are stored with the space storage object, managing for the centralized stores of implementation space data provides a kind of new solution.Therefore, it should be noted that of the present inventionly to mean a plurality of hardware of memory device in the specific implementation, and these hardware can be variety classes based on object storage equipment 32.These hardware are interconnected by switching network during concrete enforcement, constitute the basis of storage cluster.Connect the GIS server of application server cluster 2, meta data server 31 and get final product by switching network interconnection based on TCP/IP based on object storage equipment 32 from particular hardware.
The present invention also sums up the data transmission method that this network GIS system based on dual cluster is provided: adopt spatial data to be stored in based in the object storage cluster 3 in the mode of space storage object, application server cluster 2 and combine based on object storage cluster 3, storage shared pool X is provided for application server cluster 2 based on object storage cluster 3, GIS client 1 visits based on the space storage object in the object storage cluster 3 by application server cluster 2.The present invention has also improved spatial data storage I/O mode: when carrying out transfer of data, meta data server 31 is independent from application server, control path, data path are separated with the management path: specific embodiment is referring to Fig. 3, and a certain GIS server 221 sends data access request by the control path to meta data server 31; Meta data server 31 is managed based on object storage equipment 32 by the management path; GIS server 221 is directly visited based on object storage equipment 32 by data path.This structure has shortened the I/O path greatly, and 90% metadata management is moved down into based in the object storage equipment 32, thereby has solved the meta data server bottleneck problem in the legacy network cluster memory technology.
Referring to Fig. 4, GIS client 1 is carried out from being divided into following steps based on the data transmission procedure that obtains spatial data the object storage equipment 32:
(a) GIS client 1 is sent the GIS service request to load dispatch device 211;
(b) load dispatch device 211 is selected a GIS server 221 and is transmitted the GIS service request to this GIS server 221 from the GIS server pools;
(c) GIS server 221 sends data service request to meta data server 31;
(d) 31 pairs of GIS servers 221 of meta data server authenticate, and return effective credential;
(e) GIS server 221 utilizes credential to sending data access request based on object storage equipment 32;
(f) verify the legitimacy of GIS server 221 request of data based on object storage equipment 32 by credential, set up transfer of data and connect;
(g) GIS server 221 will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to GIS client 1.
In the term of validity of credential, GIS client 1 continues to need not repeating step (d)～(f) from when obtaining spatial data the object storage equipment 32, directly carries out exchanges data at GIS server 221 between based on object storage equipment 32.
Claims (10)
1. network GIS system is characterized in that: comprise following part, the GIS client is used for the GIS service request operation being provided and obtaining service result to the client; Application server cluster is used to respond the GIS service request of GIS client and GIS is provided service; Based on the object storage cluster, be used for mode memory space data, and provide the storage shared pool to application server cluster with the space storage object.
2. network GIS system as claimed in claim 1 is characterized in that: application server cluster is made up of load dispatch device and GIS server pools, and above-mentioned part is connected by the switching network based on TCP/IP.
3. network GIS system as claimed in claim 2 is characterized in that: load dispatch device copy is set.
4. as claim 2 or 3 described network GIS systems, it is characterized in that: the GIS server pools adopts the LVS server to form.
5. as claim 1 or 2 or 3 described network GIS systems, it is characterized in that: form by meta data server with based on object storage equipment based on the object storage cluster.
6. network GIS system as claimed in claim 5 is characterized in that: GIS server, meta data server and based on object storage equipment by switching network interconnection based on TCP/IP.
7. data transmission method as claim 1 or 2 or 3 or 6 described network GIS systems, it is characterized in that: spatial data is stored in based in the object storage cluster in the mode of space storage object, application server cluster and combine based on the object storage cluster, provide the storage shared pool based on the object storage cluster to application server cluster, the GIS client visits based on the space storage object in the object storage cluster by application server cluster.
8. the data transmission method of a network GIS system as claimed in claim 7 is characterized in that: control path, data path separate with the management path, and the GIS server sends data access request by controlling the path to meta data server; Meta data server is managed based on object storage equipment by the management path; The GIS server is directly visited based on object storage equipment by data path.
9. the data transmission method of a network GIS system as claimed in claim 8, it is characterized in that: the GIS client is from based on the data transmission procedure that obtains spatial data the object storage equipment being:
(a) the GIS client is sent the GIS service request to the load dispatch device;
(b) the load dispatch device is selected a GIS server and to this GIS server forwards GIS service request from the GIS server pools;
(c) the GIS server sends data service request to meta data server;
(d) meta data server authenticates the GIS server, returns effective credential;
(e) GIS server by utilizing credential is to based on object storage equipment sending data access request;
(f) verify the legitimacy of GIS server data request based on object storage equipment by credential, set up transfer of data and connect;
(g) the GIS server will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to the GIS client.
10. the data transmission method of a network GIS system as claimed in claim 9, it is characterized in that: in the term of validity of credential, the GIS client continues from when obtaining spatial data the object storage equipment, need not repeating step (d)～(f), directly between based on object storage equipment, carry out exchanges data at the GIS server.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710051430 CN101014044A (en) | 2007-01-30 | 2007-01-30 | Network GIS system and data transmitting method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN 200710051430 CN101014044A (en) | 2007-01-30 | 2007-01-30 | Network GIS system and data transmitting method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101014044A true CN101014044A (en) | 2007-08-08 |
Family
ID=38701325
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200710051430 Pending CN101014044A (en) | 2007-01-30 | 2007-01-30 | Network GIS system and data transmitting method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101014044A (en) |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102148870A (en) * | 2011-03-07 | 2011-08-10 | 浪潮(北京)电子信息产业有限公司 | Cloud storage system and implementation method thereof |
| CN103986605A (en) * | 2014-05-23 | 2014-08-13 | 杭州华三通信技术有限公司 | Network management server, processing server, network management system and corresponding method |
| CN106664314A (en) * | 2014-07-25 | 2017-05-10 | 华为技术有限公司 | Method, computing device and system for invoking software application methods of remote Java objects |
| CN106802948A (en) * | 2017-01-13 | 2017-06-06 | 郑州云海信息技术有限公司 | A kind of grid GIS data-storage system |
| CN109447536A (en) * | 2018-08-28 | 2019-03-08 | 浙江工业大学 | A kind of warehouse Real-time Monitor Management method based on GIS |
| CN110602163A (en) * | 2019-08-07 | 2019-12-20 | 阿里巴巴集团控股有限公司 | File uploading method and device |
| CN115907697A (en) * | 2023-01-10 | 2023-04-04 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | House building online investigation method and equipment |
-
2007
- 2007-01-30 CN CN 200710051430 patent/CN101014044A/en active Pending
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102148870A (en) * | 2011-03-07 | 2011-08-10 | 浪潮(北京)电子信息产业有限公司 | Cloud storage system and implementation method thereof |
| CN102148870B (en) * | 2011-03-07 | 2013-07-10 | 浪潮(北京)电子信息产业有限公司 | Cloud storage system and implementation method thereof |
| CN103986605A (en) * | 2014-05-23 | 2014-08-13 | 杭州华三通信技术有限公司 | Network management server, processing server, network management system and corresponding method |
| CN103986605B (en) * | 2014-05-23 | 2017-11-14 | 新华三技术有限公司 | NM server, processing server, network management system and corresponding method |
| CN106664314A (en) * | 2014-07-25 | 2017-05-10 | 华为技术有限公司 | Method, computing device and system for invoking software application methods of remote Java objects |
| US10341234B2 (en) | 2014-07-25 | 2019-07-02 | Huawei Technologies Co., Ltd. | Method, computing device and system for invoking software application methods of remote JAVA objects |
| CN106664314B (en) * | 2014-07-25 | 2020-03-31 | 华为技术有限公司 | Method, computing device and system for calling software application method of remote Java object |
| CN106802948A (en) * | 2017-01-13 | 2017-06-06 | 郑州云海信息技术有限公司 | A kind of grid GIS data-storage system |
| CN109447536A (en) * | 2018-08-28 | 2019-03-08 | 浙江工业大学 | A kind of warehouse Real-time Monitor Management method based on GIS |
| CN110602163A (en) * | 2019-08-07 | 2019-12-20 | 阿里巴巴集团控股有限公司 | File uploading method and device |
| CN110602163B (en) * | 2019-08-07 | 2022-02-01 | 创新先进技术有限公司 | File uploading method and device |
| CN115907697A (en) * | 2023-01-10 | 2023-04-04 | 住房和城乡建设部信息中心(住房和城乡建设部住房信息管理中心) | House building online investigation method and equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104395898B (en) | Virtual memory facilities gateway | |
| CN108121705B (en) | Open multi-source two-dimensional and three-dimensional geographic information data aggregation and release system | |
| CN104917843B (en) | Cloud storage and medical image seamless interfacing system | |
| US7647335B1 (en) | Computing system and methods for distributed generation and storage of complex relational data | |
| CN101014044A (en) | Network GIS system and data transmitting method thereof | |
| Chervenak et al. | High-performance remote access to climate simulation data: a challenge problem for data grid technologies | |
| Alam et al. | Cloud database management system architecture | |
| CN104680462A (en) | Case information optimization and acquisition method for medical system based on cloud platform | |
| CN103533023B (en) | Cloud service application cluster based on cloud service feature synchronizes system and synchronous method | |
| CN101741614B (en) | Equivalent type node manager and equivalent type node management method | |
| CN102917025A (en) | Method for business migration based on cloud computing platform | |
| CN106293490A (en) | Data storage, the method read, Apparatus and system | |
| CN106453618A (en) | Remote sensing image processing service cloud platform system based on G-Cloud cloud computing | |
| CN105339899A (en) | Method and controller for clustering applications in a software-defined network | |
| CN103595799A (en) | Method for achieving distributed shared data bank | |
| CN109299056A (en) | A kind of method of data synchronization and device based on distributed file system | |
| CN108268614A (en) | A kind of distribution management method of forest reserves spatial data | |
| CN109684412A (en) | A kind of distributed data base system | |
| EP3057007A1 (en) | Cloud-based hardware architecture | |
| CN102137161A (en) | File-level data sharing and storing system based on fiber channel | |
| CN110765192A (en) | GIS data management and processing method based on cloud platform | |
| CN110009295A (en) | A kind of enterprise management informatization system construction method based on private clound | |
| Xie et al. | Data center based on cloud computing technology | |
| CN104166581A (en) | Virtualization method for increment manufacturing device | |
| CN111212138B (en) | Cross-site storage system and data information access method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20070808 |