CN104239509A - Multi-version GIS slicing service system - Google Patents
Multi-version GIS slicing service system Download PDFInfo
- Publication number
- CN104239509A CN104239509A CN201410466803.6A CN201410466803A CN104239509A CN 104239509 A CN104239509 A CN 104239509A CN 201410466803 A CN201410466803 A CN 201410466803A CN 104239509 A CN104239509 A CN 104239509A
- Authority
- CN
- China
- Prior art keywords
- section
- slice
- data
- server
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/22—Indexing; Data structures therefor; Storage structures
- G06F16/2228—Indexing structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/56—Provisioning of proxy services
- H04L67/568—Storing data temporarily at an intermediate stage, e.g. caching
Abstract
The invention relates to a multi-version GIS slicing service system which comprises a file storage server, an application cache server, a slicing server and a client, wherein the file storage server is used for storing slicing associated files in layers according to types and versions, wherein the slicing associated files include a slicing data file, a slicing resource description file and a slicing index file, the slicing data file is used for storing slicing data information, the slicing resource description file is used for describing the type, grade, coordinate and version information of the slicing data, and the slicing index file is used for describing the index information of the slicing data; the application cache server is used for loading the slicing index information into the application cache server; the slicing server is provided with an access interface capable of receiving a slicing request and is used for receiving a slicing request of the client, acquiring the corresponding slicing index information and slicing data and returning the corresponding slicing index information and slicing data to the client; the client is used for sending the slicing request and receiving the returned slicing data. The system is capable of providing access and management for multiple versions of GIS slicing, and is simple in system structure and good in use effect.
Description
Technical field
The present invention relates to GIS technology field, particularly a kind of multi version GIS section service system.
Background technology
GIS section is served as GIS client provides the service of the static slicing such as image, vector.Slice information changes with municipal administration transformation.But because urban development speed is different, the renewal speed of different cities slice information also has different demands, short then 3-4 month, long then 1-2.Traditional GIS section only can provide the slice information of a version, and cannot provide the slice information of different times different editions.This just causes generalized information system cannot carry out " rollback " history slice information, thus effectively cannot analyze the change that slice information occurs, and also cannot carry out preview to the new tile service not yet issued.And, high and give, reach 10-20K owing to often opening slice size, even larger, will there is network bottleneck, limit tile performance.
Summary of the invention
The object of the present invention is to provide a kind of multi version GIS to cut into slices service system, this system can provide the GIS of multiple different editions cut into slices access, management, and system architecture is simply, and result of use is good.
The object of the invention is to adopt following technical scheme to realize: a kind of multi version GIS section service system, comprising:
Document storage server, for storing section associated documents, different section associated documents in document storage server by type, grade and version Bedding storage successively, described section associated documents comprise slice of data file and the section Resource Description File corresponding to slice of data file and index file of cutting into slices, described slice of data file is for storing slice of data information, section Resource Description File is for describing the type of slice of data, grade, coordinate and version information, and section index file is for describing the index information of slice of data;
Application cache server, is connected with document storage server, resolves for the section index file that stores in scanning document storage server, be loaded in application cache server by the section index information parsed to it;
Section server, be connected with document storage server with application cache server respectively, and be provided with the access interface of the section request that can receive the type, grade, coordinate and the version information that comprise section, for receiving the section request of client, then according to the type of section, grade, coordinate and the version information of specifying in section request, corresponding section index information is obtained from application cache server, from document storage server, obtain corresponding slice of data according to described section index information again, and the slice of data of acquisition is returned to client;
Client, sends the section request of the type, grade, coordinate and the version information that comprise section for tangential section server, and the slice of data that reception section server returns.
Further, the index information of described slice of data comprises the memory location of slice of data place slice of data file, the size of slice of data, and the deviation post of slice of data in slice of data file.
Further, if the section request that receives of section server does not comprise the version information of section, then give tacit consent to the index information that the most highest version that to obtain section from application cache server is corresponding.
Further, this system also comprises the WEB be connected with section server and client side respectively and accelerates caching server, described WEB accelerates caching server and is used for the slice of data that buffer memory section server sends to client, and return to client, the section request of section server is also sent to for receiving client; When described WEB acceleration caching server receives the section request of client transmission, search WEB and accelerate the caching server whether buffer memory slice of data of section request, that the direct slice of data by buffer memory returns to client, otherwise described section request forward is given section server, the slice of data of request is provided by section server.
Further, described client-cache WEB accelerates the slice of data that caching server returns, and regularly accelerate caching server transmission section update request to WEB, whether WEB accelerates caching server and judges to ask the slice of data upgraded to upgrade, return the slice of data of renewal, the slice of data of client buffer update, otherwise return a state value, confirm that client-cache is effective.
The invention has the beneficial effects as follows and provide a kind of multi version GIS section service system, achieve and the multi version of GIS slice information is accessed, managed, not only can realize slice information " rollback " to any historical juncture, the section effect that also can realize not yet issuing carries out preview, convenient amendment adjustment slice information being carried out to necessity before section is issued, improve the success ratio that section is issued, reduce the cost issued.In addition, native system architecturally face adopts multi-level buffer to support high concurrent and extensibility, solves the network bandwidth bottleneck problem of section service facing.
Accompanying drawing explanation
Fig. 1 is the system architecture schematic diagram of the embodiment of the present invention.
Fig. 2 is that associated documents of cutting into slices in the embodiment of the present invention deposit configuration diagram in document storage server.
Embodiment
Below in conjunction with drawings and the specific embodiments, the present invention is described in further detail.
Multi version GIS section service system of the present invention, as shown in Figure 1, comprises document storage server, application cache server, section server and client side.
Described document storage server is dissimilar for storing, the section associated documents of version, different section associated documents in document storage server by type, grade and version Bedding storage successively, described section associated documents comprise slice of data file and the section Resource Description File corresponding to slice of data file and index file of cutting into slices, described slice of data file is for storing slice of data information, section Resource Description File is for describing the type of the slice of data stored in corresponding slice of data file, grade, coordinate and version information, section index file is for describing the index information of the slice of data stored in corresponding slice of data file, namely to cut into slices index information.The index information of described slice of data comprises the memory location of slice of data place slice of data file, the size of slice of data, and the deviation post of slice of data in slice of data file.
Described application cache server is connected with document storage server, resolves for the section index file that stores in scanning document storage server, be loaded in application cache server by the section index information parsed it.
Described section server is connected with document storage server with application cache server respectively, and is provided with the access interface of the section request that can receive the type, grade, coordinate and the version information that comprise section; Described section server is for receiving the section request of client, then according to the type of section, grade, coordinate and the version information of specifying in section request, corresponding section index information is obtained from application cache server, from document storage server, obtain corresponding slice of data according to described section index information again, and the slice of data of acquisition is returned to client.If the section request that receives of section server does not comprise the version information of section, then give tacit consent to the index information that the most highest version that to obtain section from application cache server is corresponding.
Described client is used for the section request that tangential section server sends type, grade, coordinate and the version information comprising section, and the slice of data that reception section server returns.
Native system provides REST style interface service, and client visits section by the section request comprising slice type, grade, coordinate and version information.The access interface design of access section is as follows:
http://maps.epgis.com.cn/tileService/
verctor/
16/
532,204/
1
Root directory type classification coordinate version
Client can visit specific slice information by specifying the version number of section.Client can not also specify the version number of section, and the data of the up-to-date issue of the section of searching corresponding to specified type, grade, coordinate return by section service.The Interface design that acquiescence returns section is as follows:
http://maps.epgis.com.cn/tileService/
verctor/
16/
532,204
Root directory type classification coordinate
When creating section associated documents, 3 files can be produced, being section Resource Description File, section index file and slice of data file respectively, these files being stored with slice type and version number's layering, as shown in Figure 2.When startup section service, section index information is loaded in application cache server, when receiving section request, according to the type of section of specifying in request, grade, coordinate and version number, find the storage index of corresponding section in the buffer, if non-indicated release number, so just return the section index of announced maximum version number, then according to this index, from persistence medium, namely slice of data is read in document storage server.
When the service of section starts, system is by the index file of scan slice and resolve file, is pre-stored within buffer memory by section index information, the access speed of raising slice of data.When carrying out section and upgrading, upgrade the index information in buffer memory according to the section index file uploaded.
In the present embodiment, native system also comprises WEB and accelerates caching server, described WEB accelerates caching server and is connected with section server and client side respectively, described WEB accelerates caching server and is used for the slice of data that buffer memory section server sends to client, and return to client, the section request of section server is also sent to for receiving client; When described WEB acceleration caching server receives the section request of client transmission, search WEB and accelerate the caching server whether buffer memory slice of data of section request, that the direct slice of data by buffer memory returns to client, otherwise described section request forward is given section server, the slice of data of request is provided by section server.
Described client-cache WEB accelerates the slice of data that caching server returns, and regularly accelerate caching server transmission section update request to WEB, whether WEB accelerates caching server and judges to ask the slice of data upgraded to upgrade, that the slice of data returning renewal responds section update request, the slice of data of client buffer update, otherwise return a state value, confirm that client-cache is effective.
Namely in the present embodiment, native system have employed multi-level buffer, comprises client-cache, WEB accelerates buffer memory and application cache.
1) client-cache
Because section renewal frequency is lower, frequency several months to the several years not etc., and there is locality to browsing of map in user, therefore greatly can improve GIS in client-cache section and to publish picture efficiency, alleviate the pressure of tile service device.
2) WEB accelerator buffer memory
When client sends section request, first WEB accelerator searches the whether buffer memory section of request, if the buffer memory section of this request of WEB accelerator, so just directly section is returned client; Otherwise just by request forward to tile service device, from storage system, read corresponding section, be then cached in WEB accelerator, and return client.
Because client can to slice information buffer memory, when client section is expired, client can send the request of a SNNP to WEB caching server.First whether WEB accelerator change according to the slice of data of condition judgment request, if the slice of data of buffer memory upgrades, so WEB buffer memory accelerator just uses new slice of data to respond request, the slice of data that client-cache is new; If the slice of data of buffer memory does not upgrade, so WEB accelerator does not retransmit tile data, and just returning a state value, to represent client-cache effective.Because the state value returned is more much smaller than returning a tile data, therefore alleviating the pressure of the network bandwidth, also shortening the response time of tile request simultaneously.
3) application cache
The index information of application cache server buffer section, when the request of cutting into slices is not hit in WEB accelerator time, application server can the storage information of read requests section from application cache, then from storage system, reads section.
In the present embodiment, native system also adopts multistage load-balancing technique to support high concurrent and extensibility, solves due to network bandwidth bottleneck problem.
The multistage load balancing of native system comprises four-layer load-equalizing, seven layers of load balancing.
1) four-layer load-equalizing
It is the IP address of multiple internal server that four-layer load-equalizing refers to an outside IP address maps, dynamically uses a home address, reach the effect of load balancing to each TCP connection request.Four-layer load-equalizing has multiple common dispatching method, comprises the dispatching algorithm based on poll, based on the dispatching algorithm of Smallest connection, based on locally scheduling.
2) seven layers of load balancing
Seven layers of load balancing refer to contents distribution, mainly through the content (as judged different application according to URL) of significant application layer real in message, add that the server selection mode of load balancing (comprises poll, IP Hash, weight etc.), determine the final internal server selected.In section service, according to the slice type comprised in section request, section X, Y-coordinate, and the version number of section is as the condition of seven layers of load balancing.
Be more than preferred embodiment of the present invention, all changes done according to technical solution of the present invention, when the function produced does not exceed the scope of technical solution of the present invention, all belong to protection scope of the present invention.
Claims (5)
1. a multi version GIS section service system, is characterized in that, comprising:
Document storage server, for storing section associated documents, different section associated documents in document storage server by type, grade and version Bedding storage successively, described section associated documents comprise slice of data file and the section Resource Description File corresponding to slice of data file and index file of cutting into slices, described slice of data file is for storing slice of data information, section Resource Description File is for describing the type of slice of data, grade, coordinate and version information, and section index file is for describing the index information of slice of data;
Application cache server, is connected with document storage server, resolves for the section index file that stores in scanning document storage server, be loaded in application cache server by the section index information parsed to it;
Section server, be connected with document storage server with application cache server respectively, and be provided with the access interface of the section request that can receive the type, grade, coordinate and the version information that comprise section, for receiving the section request of client, then according to the type of section, grade, coordinate and the version information of specifying in section request, corresponding section index information is obtained from application cache server, from document storage server, obtain corresponding slice of data according to described section index information again, and the slice of data of acquisition is returned to client;
Client, sends the section request of the type, grade, coordinate and the version information that comprise section for tangential section server, and the slice of data that reception section server returns.
2. multi version GIS section service system according to claim 1, it is characterized in that, the index information of described slice of data comprises the memory location of slice of data place slice of data file, the size of slice of data, and the deviation post of slice of data in slice of data file.
3. multi version GIS section service system according to claim 1, it is characterized in that, if the section request that receives of section server does not comprise the version information of section, then give tacit consent to the index information that the most highest version that to obtain section from application cache server is corresponding.
4. multi version GIS section service system according to claim 1, it is characterized in that, also comprise the WEB be connected with section server and client side respectively and accelerate caching server, described WEB accelerates caching server and is used for the slice of data that buffer memory section server sends to client, and return to client, the section request of section server is also sent to for receiving client; When described WEB acceleration caching server receives the section request of client transmission, search WEB and accelerate the caching server whether buffer memory slice of data of section request, that the direct slice of data by buffer memory returns to client, otherwise described section request forward is given section server, the slice of data of request is provided by section server.
5. multi version GIS section service system according to claim 4, it is characterized in that, described client-cache WEB accelerates the slice of data that caching server returns, and regularly accelerate caching server transmission section update request to WEB, whether WEB accelerates caching server and judges to ask the slice of data upgraded to upgrade, and is return the slice of data of renewal, the slice of data of client buffer update, otherwise return a state value, confirm that client-cache is effective.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410466803.6A CN104239509B (en) | 2014-09-15 | 2014-09-15 | Multi version GIS section service systems |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410466803.6A CN104239509B (en) | 2014-09-15 | 2014-09-15 | Multi version GIS section service systems |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104239509A true CN104239509A (en) | 2014-12-24 |
| CN104239509B CN104239509B (en) | 2018-04-13 |
Family
ID=52227568
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410466803.6A Active CN104239509B (en) | 2014-09-15 | 2014-09-15 | Multi version GIS section service systems |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104239509B (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107734021A (en) * | 2017-09-30 | 2018-02-23 | 上海壹账通金融科技有限公司 | block chain data uploading method, system, computer system and storage medium |
| CN108121705A (en) * | 2016-11-28 | 2018-06-05 | 星际空间（天津）科技发展有限公司 | Multi-source two, three-dimensional geographic information data aggregate and the delivery system of a kind of opening |
| CN108427703A (en) * | 2017-02-15 | 2018-08-21 | 谷歌有限责任公司 | The system and method accessed the data file for being stored in data-storage system are provided |
| CN109189796A (en) * | 2018-08-20 | 2019-01-11 | 武汉中海庭数据技术有限公司 | Accurately diagram data management method and device |
| CN111209022A (en) * | 2020-01-03 | 2020-05-29 | 支付宝(杭州)信息技术有限公司 | Resource publishing and acquiring method, device and equipment |
| CN111291035A (en) * | 2020-03-23 | 2020-06-16 | 东软睿驰汽车技术（沈阳）有限公司 | Method and device for slicing data and related product |
| CN113038170A (en) * | 2021-03-01 | 2021-06-25 | 北京四达时代软件技术股份有限公司 | Live broadcast HLS data generation method and device, processing method and device and control system |
| CN113505254A (en) * | 2021-07-08 | 2021-10-15 | 山东志盈医学科技有限公司 | Method and device for efficiently storing digital slices by server |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130067379A1 (en) * | 2011-09-13 | 2013-03-14 | General Electric Company | Graphical comparison of geographic information system data |
| CN103744855A (en) * | 2013-11-29 | 2014-04-23 | 航天恒星科技有限公司 | Tile map storage method based on aggregation files |
-
2014
- 2014-09-15 CN CN201410466803.6A patent/CN104239509B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130067379A1 (en) * | 2011-09-13 | 2013-03-14 | General Electric Company | Graphical comparison of geographic information system data |
| CN103744855A (en) * | 2013-11-29 | 2014-04-23 | 航天恒星科技有限公司 | Tile map storage method based on aggregation files |
Non-Patent Citations (2)
| Title |
|---|
| 任洒苗: "基于云计算的WebGIS关键技术研究", 《中国优秀硕士学位论文全文数据库 基础科学辑》 * |
| 杨建思，朱仁惠，刘华: "一种大文件多版本遥感影像数据组织管理方法", 《地理信息世界》 * |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108121705B (en) * | 2016-11-28 | 2021-10-08 | 星际空间（天津）科技发展有限公司 | Open multi-source two-dimensional and three-dimensional geographic information data aggregation and release system |
| CN108121705A (en) * | 2016-11-28 | 2018-06-05 | 星际空间（天津）科技发展有限公司 | Multi-source two, three-dimensional geographic information data aggregate and the delivery system of a kind of opening |
| CN108427703A (en) * | 2017-02-15 | 2018-08-21 | 谷歌有限责任公司 | The system and method accessed the data file for being stored in data-storage system are provided |
| WO2018151771A1 (en) * | 2017-02-15 | 2018-08-23 | Google Llc | Systems and methods for providing access to a data file stored at a data storage system |
| US10387383B2 (en) | 2017-02-15 | 2019-08-20 | Google Llc | Systems and methods for providing access to a data file stored at a data storage system |
| US11232080B2 (en) | 2017-02-15 | 2022-01-25 | Google Llc | Systems and methods for providing access to a data file stored at a data storage system |
| CN107734021A (en) * | 2017-09-30 | 2018-02-23 | 上海壹账通金融科技有限公司 | block chain data uploading method, system, computer system and storage medium |
| CN107734021B (en) * | 2017-09-30 | 2020-04-07 | 深圳壹账通智能科技有限公司 | Block chain data uploading method and system, computer system and storage medium |
| US11146384B2 (en) | 2017-09-30 | 2021-10-12 | One Connect Smart Technology Co., Ltd. (Shenzhen) | Method, system, computer system and storage medium of uploading blockchain data |
| CN109189796A (en) * | 2018-08-20 | 2019-01-11 | 武汉中海庭数据技术有限公司 | Accurately diagram data management method and device |
| CN109189796B (en) * | 2018-08-20 | 2020-10-13 | 武汉中海庭数据技术有限公司 | High-precision map data management method and device |
| CN111209022A (en) * | 2020-01-03 | 2020-05-29 | 支付宝(杭州)信息技术有限公司 | Resource publishing and acquiring method, device and equipment |
| CN111291035A (en) * | 2020-03-23 | 2020-06-16 | 东软睿驰汽车技术（沈阳）有限公司 | Method and device for slicing data and related product |
| CN111291035B (en) * | 2020-03-23 | 2023-05-16 | 东软睿驰汽车技术（沈阳）有限公司 | Method and device for slicing data and related products |
| CN113038170A (en) * | 2021-03-01 | 2021-06-25 | 北京四达时代软件技术股份有限公司 | Live broadcast HLS data generation method and device, processing method and device and control system |
| CN113038170B (en) * | 2021-03-01 | 2022-05-13 | 北京四达时代软件技术股份有限公司 | Live broadcast HLS data generation method and device, processing method and device and control system |
| CN113505254A (en) * | 2021-07-08 | 2021-10-15 | 山东志盈医学科技有限公司 | Method and device for efficiently storing digital slices by server |
| CN113505254B (en) * | 2021-07-08 | 2024-01-23 | 山东志盈医学科技有限公司 | Method and device for efficiently storing digital slices by server |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104239509B (en) | 2018-04-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104239509A (en) | Multi-version GIS slicing service system | |
| US11349940B2 (en) | Server side data cache system | |
| EP2266043B1 (en) | Cache optimzation | |
| US7979509B1 (en) | Clustered network acceleration devices having shared cache | |
| US7171469B2 (en) | Apparatus and method for storing data in a proxy cache in a network | |
| US8078574B1 (en) | Network acceleration device cache supporting multiple historical versions of content | |
| CN102480397A (en) | Method and equipment for accessing internet pages | |
| CN102523256A (en) | Content management method, device and system | |
| CN103631820B (en) | The metadata management method and equipment of distributed file system | |
| JP2005539314A (en) | Apparatus and method for processing data in a network | |
| CN102591970A (en) | Distributed key-value query method and query engine system | |
| CN102694860A (en) | Method, equipment and system for data processing of cloud storage | |
| CN103237046A (en) | Distributed file system supporting mixed cloud storage application and realization method thereof | |
| CN106294870B (en) | Object-based distribution cloud storage method | |
| CN104714965A (en) | Static resource weight removing method, and static resource management method and device | |
| JP6506374B2 (en) | Cache management | |
| US10579597B1 (en) | Data-tiering service with multiple cold tier quality of service levels | |
| CN103067461A (en) | Metadata management system of document and metadata management method thereof | |
| CN103227826A (en) | Method and device for transferring file | |
| CN102546674A (en) | Directory tree caching system and method based on network storage device | |
| US10635715B2 (en) | Remote virtualized asset delivery and local provisioning | |
| CN103179148A (en) | Processing method and system for sharing enclosures in internet | |
| CN104537013A (en) | Data processing method and device | |
| CN103036948B (en) | Namely network file processing method, XM, software serve SaaS platform | |
| CN111190547A (en) | Distributed container mirror image storage and distribution system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |