CN101014044A - Network GIS system and data transmitting method thereof - Google Patents

Network GIS system and data transmitting method thereof Download PDF

Info

Publication number
CN101014044A
CN101014044A CN 200710051430 CN200710051430A CN101014044A CN 101014044 A CN101014044 A CN 101014044A CN 200710051430 CN200710051430 CN 200710051430 CN 200710051430 A CN200710051430 A CN 200710051430A CN 101014044 A CN101014044 A CN 101014044A
Authority
CN
China
Prior art keywords
gis
server
data
storage
cluster
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 200710051430
Other languages
Chinese (zh)
Inventor
喻占武
李忠民
郑胜
李锐
潘少明
胡滨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhan University WHU
Original Assignee
Wuhan University WHU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Wuhan University WHU filed Critical Wuhan University WHU
Priority to CN 200710051430 priority Critical patent/CN101014044A/en
Publication of CN101014044A publication Critical patent/CN101014044A/en
Pending legal-status Critical Current

Links

Abstract

The invention provides one network GIS system and its data transmission method, wherein, the system comprises the following parts: GIS customer end to provide GIS service require operation and to get service result; application servo group to respond GIS service require and services; subject based memory group to store subject space data and to provide common pool to application servo. The transmission method comprises the following steps: space data stores space memory subject based on group and the application servo group and the memory group are combined.

Description

A kind of network GIS system and data transmission method thereof
Technical field
The invention belongs to the geographical information technology field, particularly a kind of network GIS system and data transmission method thereof.
Background technology
Network provides an information superhighway for information exchange between the user and information inquiry all over the world, GIS-Geographic Information System (Geographic Information System, be called for short GIS) have abundant space querying, spatial analysis and attribute management function, becoming the main contents of Internet or Intranet.Along with the continuous development of Internet technology and people demand to generalized information system, generalized information system is merged mutually with network technology, the function of utilizing Internet to browse, inquire about and analyze for the user provides spatial data, form the geographical space integrated platform of a networking, become the inexorable trend of generalized information system development.Along with the enlarging day by day of network GIS application, spatial data resolution improve constantly and one dimension is handled the transformation of handling to multidimensional, the spatial data amount of catenet GIS management sharply increases, to the TB level, even PB level is being the data-centered transformation of middle mind-set with system from the GB level.
At present, network GIS comprises client computer, application server, database server in the typical three-decker of being applied as of Internet, and all spatial datas and application services all are placed on server end, greatly reduce the workload of FTP client FTP.But along with the increase of spatial data amount, there are two transfer of data bottlenecks in this structure: server provides the network service bandwidth bottleneck of service and the storage I/O bandwidth bottleneck of spatial data storage system.Specifically, increase when the GIS number of users, the GIS application server of Single-Server structure is subjected to the restriction of the network bandwidth, be difficult to satisfy the requirement of multi-user concurrent visit, the visit capacity of this service number system also sharply increases, and this spatial data transmission pressure has caused the storage I/O bottleneck of spatial data storage system.Because network GIS is used with the regular transaction processing a great difference is arranged, outstanding behaviours is in processing mode, the spatial distributions of googol according to amount, complexity, therefore the technological means of these two kinds of bottlenecks does not appear solving in existing network GIS technical field as yet, and the network GIS application and development is restricted.
Summary of the invention
The object of the invention is to solve the prior art deficiency, provides the network GIS technical scheme to overcome network service bandwidth bottleneck and storage I/O bandwidth bottleneck.
For achieving the above object, network GIS system of the present invention comprises following part, and the GIS client is used for the GIS service request operation being provided and obtaining service result to the client; Application server cluster is used to respond the GIS service request of GIS client and GIS is provided service; Based on the object storage cluster, be used for mode memory space data, and provide the storage shared pool to application server cluster with the space storage object.
And application server cluster is made up of load dispatch device and GIS server pools, and above-mentioned part is connected by the switching network based on TCP/IP.
And, load dispatch device copy is set.
And the GIS server pools adopts the LVS server to form.
And, form by meta data server with based on object storage equipment based on the object storage cluster.
And, GIS server, meta data server and based on object storage equipment by switching network interconnection based on TCP/IP.
The present invention also provides the data transmission method of above-mentioned network GIS system, spatial data is stored in based in the object storage cluster in the mode of space storage object, application server cluster and combine based on the object storage cluster, provide the storage shared pool based on the object storage cluster to application server cluster, the GIS client visits based on the space storage object in the object storage cluster by application server cluster.
And control path, data path separate with the management path, and the GIS server sends data access request by the control path to meta data server; Meta data server is managed based on object storage equipment by the management path; The GIS server is directly visited based on object storage equipment by data path.
And the GIS client is from based on the data transmission procedure that obtains spatial data the object storage equipment being:
(a) the GIS client is sent the GIS service request to the load dispatch device;
(b) the load dispatch device is selected a GIS server and to this GIS server forwards GIS service request from the GIS server pools;
(c) the GIS server sends data service request to meta data server;
(d) meta data server authenticates the GIS server, returns effective credential;
(e) GIS server by utilizing credential is to based on object storage equipment sending data access request;
(f) verify the legitimacy of GIS server data request based on object storage equipment by credential, set up transfer of data and connect;
(g) the GIS server will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to the GIS client.
And in the term of validity of credential, the GIS client continues to need not repeating step (d)~(f) from when obtaining spatial data the object storage equipment, directly carries out exchanges data at the GIS server between based on object storage equipment.
The present invention creatively is provided with dual cluster and realizes network GIS system, come service in the supervising the network generalized information system by application server cluster, has solved the network service bandwidth bottleneck that the GIS server provides service; By application server cluster with based on the combination of object storage cluster, make up new spatial data transmission path, solved storage I/O bandwidth bottleneck.By two kinds of transfer of data bottlenecks of comprehensive solution, the present invention has significantly improved the message transmission rate of network GIS.The present invention also uses for network GIS the data transmission method of new network GIS system is provided, and has set up safe data transmission mechanism; Employing solves the isomerous environment problem of memory device based on the object storage mode.Enforcement of the present invention will be established solid network foundation for the popularization and application of global geographical information, for human lives's application of aspects geography information is brought huge convenience.
Description of drawings
Fig. 1 is a network GIS system composition frame chart of the present invention;
Fig. 2 is an application server cluster schematic diagram of the present invention;
Fig. 3 is of the present invention based on object storage cluster schematic diagram;
Fig. 4 is the transfer of data workflow diagram of the embodiment of the invention.
Embodiment
Referring to accompanying drawing 1, network GIS system provided by the invention comprises following part,
(1) the GIS client 1, and being used for provides GIS service request operation to the client;
The GIS client part mainly is that the client computer that the GIS client software is housed is formed; The GIS client links to each other with application server cluster by network (adopting Internet usually).It is partly existing that the GIS client part belongs to prior art.In a network GIS system, the quantity of GIS client usually is huge and uncertain, and the user only needs the GIS client software is installed on personal computer, means that promptly producing one can supply the client of access.Unless the therefore high GIS-Geographic Information System (for example military use) of safety requirements, GIS client 1 partly adopts internal lan to be connected with other, and employing Internet connection is the most practical way of most convenient under other situations.
(2) application server cluster 2, be used to respond the GIS service request of GIS client and GIS is provided service;
Application server in function that application server cluster is partly realized and the prior art three-decker is similar, is used to respond the GIS client-requested and service is provided.Application server cluster of the present invention partly is made up of load dispatch device 211, GIS server pools, can adopt the 100M/1000M high speed switching network of use based on TCP/IP when specifically implementing.
Cluster is the set or the group of a plurality of systems, and they work as individual server together.Therefore consider the service role that network GIS is huge day by day, adopting Clustering that the GIS service is provided is the best thinking that solves network service bandwidth bottleneck.The GIS server pools comprises a plurality of GIS servers that same services is provided, and each GIS server plays a role as a node of cluster.Cluster server technology based on the Linux core is the most ripe at present, and application server cluster 2 can make up by LVS server cluster standard when specifically implementing, and the GIS server can adopt the LVS server.For Resources allocation, also load dispatch device 211 need be set, when GIS client 1 sends the GIS service request, load dispatch device 211 will be transmitted to a certain GIS server in the GIS server pools with user's request according to built-in dispatching algorithm.Load dispatch device 211 is load balancing cores of whole application server cluster, and all operations are all finished in the (SuSE) Linux OS core space when specifically implementing, and expense is very little, has very high throughput.The GIS service need be called spatial data, and the present invention is by providing shared memory space based on the object storage cluster, with calling of all GIS servers in the support GIS server pools.
Referring to Fig. 2, the embodiment of the invention also is provided with load dispatch device copy 212 standby as load dispatch device 211, is unique part in the face of GIS client 1 in the whole application server cluster 2; The GIS server pools is formed (only enumerate two GIS servers in the accompanying drawing, in fact can expand more) by GIS server 221 and GIS server 222 etc., constitutes the real supplier of GIS service.When the load of receiving when whole system surpasses the disposal ability of all nodes at present, can in the GIS server pools, increase the GIS server and satisfy ever-increasing request load.The component part that GIS application server, data server, WMS server (WMS is a warehouse management system) or the like various GIS servers can be the GIS server pools.For good retractility and availability is provided, the present invention has adopted based on object storage technology, and the object-based storage cluster file system of GIS server access is just as the visit local file system.For the ease of the principle of reactive applications server cluster 2, the embodiment of the invention will be called the storage shared pool of application server cluster based on the shared memory space that object storage cluster 3 is realized, adopt the X mark.
(3), be used for mode memory space data, and provide storage shared pool X to application server cluster with the space storage object based on object storage cluster 3.
The data capacity of single database server can't satisfy network GIS to be used, and the present invention adopts the cluster memory technology to replace the effect of database server in the prior art.The mass data storage technology has experienced the three phases to SAN (storage area network) by DAS (direct-connected mode is stored), NAS (network is directly stored): wherein the DAS mode is that memory device is passed through cable directly to server, be piling up of hardware, do not have the improvement of file system, use limited in default of centralized management solution; The NAS mode can be considered piece level Clustering, is the All Files under the different system platform is deposited in the memory device, therefore has the I/O bottleneck equally, also can't solve the bottleneck problem that network GIS faces; The SAN mode realizes the file-level cluster by a software virtual layer, and only needing by a SAN file system is the addressable file that is stored on a plurality of equipment, and therefore a plurality of equipment constitute cluster can provide more space for the storage data.But present this mode still is difficult to satisfy the requirement of network GIS, because typical SAN mode need be provided with the center of meta data server as the large-scale cluster storage, obtain the storage data and need pass through visit, control, the management of meta data server, so meta data server constitutes the I/O bottleneck easily.And the SAN mode can only be managed the file of homogeneous environment concentratedly, is difficult to be applied to network GIS complicated spatial data source.
The present invention proposes the storage cluster scheme that is suitable for network GIS, by application server cluster 2 with based on the combination of object storage cluster 3, make up new spatial data transmission path, GIS client 1 visits based on the space storage object in the object storage cluster 3 by application server cluster 2, and the direct transmission by GIS server and memory device has solved storage I/O bandwidth bottleneck.
The present invention adopts based on object storage equipment 32, based on the abstract design of object storage by object hierarchy, functions such as the visit of storage, control, management are repartitioned, the logical construction of file system and the mapping relations of physical store are hidden into object one deck, and the accessing operation of data is realized by the interface of object.Can be hidden in the object layer separating in device-dependent characteristic (distributing) slave unit one deck based on object storage, realize cross-platform sharing, effectively solve the isomerous environment problem that SAN faces as piece.During concrete enforcement, massive spatial data is decomposed into a series of spaces storage object according to own characteristic, application and storage demand and carries out object-based spatial data storage and management.The space storage object can be defined as one group and be distributed in one or more based on the object of being made up of spatial data, memory attribute and operation on the object storage equipment.Memory attribute is used for defining the storage characteristics of different spaces data, as data layout, security information and behaviour in service statistical information etc., thereby can indicate operational processes to spatial data according to memory attribute.Based on object storage spatial data and attribute data are stored with the space storage object, managing for the centralized stores of implementation space data provides a kind of new solution.Therefore, it should be noted that of the present inventionly to mean a plurality of hardware of memory device in the specific implementation, and these hardware can be variety classes based on object storage equipment 32.These hardware are interconnected by switching network during concrete enforcement, constitute the basis of storage cluster.Connect the GIS server of application server cluster 2, meta data server 31 and get final product by switching network interconnection based on TCP/IP based on object storage equipment 32 from particular hardware.
The present invention also sums up the data transmission method that this network GIS system based on dual cluster is provided: adopt spatial data to be stored in based in the object storage cluster 3 in the mode of space storage object, application server cluster 2 and combine based on object storage cluster 3, storage shared pool X is provided for application server cluster 2 based on object storage cluster 3, GIS client 1 visits based on the space storage object in the object storage cluster 3 by application server cluster 2.The present invention has also improved spatial data storage I/O mode: when carrying out transfer of data, meta data server 31 is independent from application server, control path, data path are separated with the management path: specific embodiment is referring to Fig. 3, and a certain GIS server 221 sends data access request by the control path to meta data server 31; Meta data server 31 is managed based on object storage equipment 32 by the management path; GIS server 221 is directly visited based on object storage equipment 32 by data path.This structure has shortened the I/O path greatly, and 90% metadata management is moved down into based in the object storage equipment 32, thereby has solved the meta data server bottleneck problem in the legacy network cluster memory technology.
Referring to Fig. 4, GIS client 1 is carried out from being divided into following steps based on the data transmission procedure that obtains spatial data the object storage equipment 32:
(a) GIS client 1 is sent the GIS service request to load dispatch device 211;
(b) load dispatch device 211 is selected a GIS server 221 and is transmitted the GIS service request to this GIS server 221 from the GIS server pools;
(c) GIS server 221 sends data service request to meta data server 31;
(d) 31 pairs of GIS servers 221 of meta data server authenticate, and return effective credential;
(e) GIS server 221 utilizes credential to sending data access request based on object storage equipment 32;
(f) verify the legitimacy of GIS server 221 request of data based on object storage equipment 32 by credential, set up transfer of data and connect;
(g) GIS server 221 will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to GIS client 1.
In the term of validity of credential, GIS client 1 continues to need not repeating step (d)~(f) from when obtaining spatial data the object storage equipment 32, directly carries out exchanges data at GIS server 221 between based on object storage equipment 32.

Claims (10)

1. network GIS system is characterized in that: comprise following part, the GIS client is used for the GIS service request operation being provided and obtaining service result to the client; Application server cluster is used to respond the GIS service request of GIS client and GIS is provided service; Based on the object storage cluster, be used for mode memory space data, and provide the storage shared pool to application server cluster with the space storage object.
2. network GIS system as claimed in claim 1 is characterized in that: application server cluster is made up of load dispatch device and GIS server pools, and above-mentioned part is connected by the switching network based on TCP/IP.
3. network GIS system as claimed in claim 2 is characterized in that: load dispatch device copy is set.
4. as claim 2 or 3 described network GIS systems, it is characterized in that: the GIS server pools adopts the LVS server to form.
5. as claim 1 or 2 or 3 described network GIS systems, it is characterized in that: form by meta data server with based on object storage equipment based on the object storage cluster.
6. network GIS system as claimed in claim 5 is characterized in that: GIS server, meta data server and based on object storage equipment by switching network interconnection based on TCP/IP.
7. data transmission method as claim 1 or 2 or 3 or 6 described network GIS systems, it is characterized in that: spatial data is stored in based in the object storage cluster in the mode of space storage object, application server cluster and combine based on the object storage cluster, provide the storage shared pool based on the object storage cluster to application server cluster, the GIS client visits based on the space storage object in the object storage cluster by application server cluster.
8. the data transmission method of a network GIS system as claimed in claim 7 is characterized in that: control path, data path separate with the management path, and the GIS server sends data access request by controlling the path to meta data server; Meta data server is managed based on object storage equipment by the management path; The GIS server is directly visited based on object storage equipment by data path.
9. the data transmission method of a network GIS system as claimed in claim 8, it is characterized in that: the GIS client is from based on the data transmission procedure that obtains spatial data the object storage equipment being:
(a) the GIS client is sent the GIS service request to the load dispatch device;
(b) the load dispatch device is selected a GIS server and to this GIS server forwards GIS service request from the GIS server pools;
(c) the GIS server sends data service request to meta data server;
(d) meta data server authenticates the GIS server, returns effective credential;
(e) GIS server by utilizing credential is to based on object storage equipment sending data access request;
(f) verify the legitimacy of GIS server data request based on object storage equipment by credential, set up transfer of data and connect;
(g) the GIS server will be handled the back according to the GIS service request from the spatial data that obtains based on object storage equipment provides to the GIS client.
10. the data transmission method of a network GIS system as claimed in claim 9, it is characterized in that: in the term of validity of credential, the GIS client continues from when obtaining spatial data the object storage equipment, need not repeating step (d)~(f), directly between based on object storage equipment, carry out exchanges data at the GIS server.
CN 200710051430 2007-01-30 2007-01-30 Network GIS system and data transmitting method thereof Pending CN101014044A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200710051430 CN101014044A (en) 2007-01-30 2007-01-30 Network GIS system and data transmitting method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200710051430 CN101014044A (en) 2007-01-30 2007-01-30 Network GIS system and data transmitting method thereof

Publications (1)

Publication Number Publication Date
CN101014044A true CN101014044A (en) 2007-08-08

Family

ID=38701325

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200710051430 Pending CN101014044A (en) 2007-01-30 2007-01-30 Network GIS system and data transmitting method thereof

Country Status (1)

Country Link
CN (1) CN101014044A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102148870A (en) * 2011-03-07 2011-08-10 浪潮(北京)电子信息产业有限公司 Cloud storage system and implementation method thereof
CN103986605A (en) * 2014-05-23 2014-08-13 杭州华三通信技术有限公司 Network management server, processing server, network management system and corresponding method
CN106664314A (en) * 2014-07-25 2017-05-10 华为技术有限公司 Method, computing device and system for invoking software application methods of remote Java objects
CN106802948A (en) * 2017-01-13 2017-06-06 郑州云海信息技术有限公司 A kind of grid GIS data-storage system
CN109447536A (en) * 2018-08-28 2019-03-08 浙江工业大学 A kind of warehouse Real-time Monitor Management method based on GIS
CN110602163A (en) * 2019-08-07 2019-12-20 阿里巴巴集团控股有限公司 File uploading method and device

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102148870A (en) * 2011-03-07 2011-08-10 浪潮(北京)电子信息产业有限公司 Cloud storage system and implementation method thereof
CN102148870B (en) * 2011-03-07 2013-07-10 浪潮(北京)电子信息产业有限公司 Cloud storage system and implementation method thereof
CN103986605A (en) * 2014-05-23 2014-08-13 杭州华三通信技术有限公司 Network management server, processing server, network management system and corresponding method
CN103986605B (en) * 2014-05-23 2017-11-14 新华三技术有限公司 NM server, processing server, network management system and corresponding method
CN106664314A (en) * 2014-07-25 2017-05-10 华为技术有限公司 Method, computing device and system for invoking software application methods of remote Java objects
US10341234B2 (en) 2014-07-25 2019-07-02 Huawei Technologies Co., Ltd. Method, computing device and system for invoking software application methods of remote JAVA objects
CN106664314B (en) * 2014-07-25 2020-03-31 华为技术有限公司 Method, computing device and system for calling software application method of remote Java object
CN106802948A (en) * 2017-01-13 2017-06-06 郑州云海信息技术有限公司 A kind of grid GIS data-storage system
CN109447536A (en) * 2018-08-28 2019-03-08 浙江工业大学 A kind of warehouse Real-time Monitor Management method based on GIS
CN110602163A (en) * 2019-08-07 2019-12-20 阿里巴巴集团控股有限公司 File uploading method and device

Similar Documents

Publication Publication Date Title
CN105408882A (en) Automated desktop placement
Chervenak et al. High-performance remote access to climate simulation data: a challenge problem for data grid technologies
CN105393219A (en) Application marketplace for virtual desktops
Alam et al. Cloud database management system architecture
CN101014044A (en) Network GIS system and data transmitting method thereof
CN102917025A (en) Method for business migration based on cloud computing platform
US7647335B1 (en) Computing system and methods for distributed generation and storage of complex relational data
CN101741614B (en) Equivalent type node manager and equivalent type node management method
CN103533023B (en) Cloud service application cluster based on cloud service feature synchronizes system and synchronous method
CN102137161B (en) File-level data sharing and storing system based on fiber channel
CN105339899A (en) Method and controller for clustering applications in a software-defined network
CN103595799A (en) Method for achieving distributed shared data bank
EP3057007B1 (en) Cloud-based hardware architecture
CN109684412A (en) A kind of distributed data base system
CN106453618A (en) Remote sensing image processing service cloud platform system based on G-Cloud cloud computing
CN108121705B (en) Open multi-source two-dimensional and three-dimensional geographic information data aggregation and release system
CN106293490A (en) Data storage, the method read, Apparatus and system
CN108268614A (en) A kind of distribution management method of forest reserves spatial data
CN102193958A (en) Method for implementing spatial decision support system based on Internet
CN104166581A (en) Virtualization method for increment manufacturing device
CN201532634U (en) Cloud computing infrastructure system based on unbelievable server nodes
Guo et al. Better Realization of Mobile Cloud Computing Using Mobile Network Computers
Zhou et al. Gis application model based on cloud computing
Pan et al. An open sharing pattern design of massive power big data
CN109299056B (en) A kind of method of data synchronization and device based on distributed file system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Open date: 20070808