CN110147408A - For the big data integrated system of multi-source heterogeneous spatial data - Google Patents
For the big data integrated system of multi-source heterogeneous spatial data Download PDFInfo
- Publication number
- CN110147408A CN110147408A CN201711240856.6A CN201711240856A CN110147408A CN 110147408 A CN110147408 A CN 110147408A CN 201711240856 A CN201711240856 A CN 201711240856A CN 110147408 A CN110147408 A CN 110147408A
- Authority
- CN
- China
- Prior art keywords
- data
- spatial data
- source heterogeneous
- spatial
- gml
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Remote Sensing (AREA)
- Computing Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The invention discloses a kind of big data integrated system for multi-source heterogeneous spatial data, which includes: data end module, Service Process Server module and client modules；Wherein, the data end module includes multi-source heterogeneous spatial data and relational data；The effect of the Service Process Server module is to form a connecting link, and is the connection bridge between the data end module and the client modules；The client modules support SVG, have the ability for carrying out display to spatial data and directly inquiring.The present invention program maintenance data interoperability scheme, use WebService technology, the space data integration based on GML and the spatial database control based on SVG are realized on Microsoft.NET platform, and solution is provided to the integrated of multi-source heterogeneous spatial data.
Description
Technical field
The invention belongs to multi-source heterogeneous spatial data integrated technology field, it is related to a kind of for multi-source heterogeneous spatial data
Big data integrated system.
Background technique
With the rapid development of computer technology, network technology, people are not obtained with the ability of processing space data not
Disconnected to improve, the spatial information amount possessed accounts for the 80% of informational capacity.Meanwhile different GIS softwares uses different data lattice
Formula encodes geography information, causes the isomerism of GIS data；Different regions use different generalized information systems, cause
The polyphyly of GIS data.
Multi-source heterogeneous spatial data is utilized to aggregation of data and data sharing is made troubles, and becomes spatial information sharing
Bottleneck.With the rapid development and sharply expansion in the world of network technology, how to realize in a network environment point
The multi-source heterogeneous spatial data of cloth integrates, and becomes a hot and difficult issue problem of current GIS development.
Currently, both at home and abroad for the integrated main using 3 kinds of schemes of spatial data:
(1) Data Format Transform: spatial data copies to current after special data converter formats
In database or file in system.
(2) the direct access to other software data formats, access Direct data access: are realized in spatial information software
A variety of data formats.
(3) data interoperation: data interoperation mode is the specification that OGC (openGISconsor-tium) is formulated.Data
Interoperability refers in the case where heterogeneous database and distributed computing, on the basis of mutual understanding, can pellucidly obtain institute
The information needed.
Wherein, Data Format Transform major defect be the loss of spatial data is caused due to the difference of data model, and
It is difficult in data set caused by space data quantity is huge；Direct data access major defect is that spatial information software is difficult to every kind
The spatial data of format is understood.
There is limitation in above two scheme, cannot achieve and integrate to multi-source heterogeneous spatial data.
Summary of the invention
It is different for multi-source it is an object of that present invention to provide a kind of big data integrated system for multi-source heterogeneous spatial data
The integration problem of conformational space data, maintenance data interoperate scheme, using GML and WebService technology,
Operation is built on Microsoft.NET platform, is efficiently solved the integration problem of multi-source heterogeneous spatial data, is realized and be based on
The space data integration of GML and spatial database control based on SVG.
In order to solve the above technical problems, the present invention adopts the following technical scheme that: one kind being directed to multi-source heterogeneous spatial data
Big data integrated system, which includes: data end module, Service Process Server module and client modules；Wherein,
The data end module includes multi-source heterogeneous spatial data and relational data；The effect of the Service Process Server module is
It forms a connecting link, is the connection bridge between the data end module and the client modules；The client modules are supported
SVG has the ability for carrying out display to spatial data and directly inquiring.
Further, the data end module includes the multi-source heterogeneous spatial data and database clothes for being distributed in heterogeneous networks
The relational data stored in business device；Wherein, the heterogeneous spatial data for being distributed in heterogeneous networks is transformed into system by GML wrapper
In one GML, to realize the shared of spatial data, the isomerism of data is eliminated.
Further, the Service Process Server module is to realize non-space on M i scrosoft.NET platform
The query service of data and spatial data.
Further, the client modules support SVG, have the energy for carrying out display to spatial data and directly inquiring
Power, user access its spatial data by browser.
The present invention have compared with prior art it is below the utility model has the advantages that
The present invention program provides a kind of big data integrated system for multi-source heterogeneous spatial data, for multi-source heterogeneous sky
Between data integration problem, maintenance data interoperate scheme, using GML and WebServ ice technology, in Mi crosoft.NET
Operation is built on platform, realizes the space data integration based on GML and the spatial database control based on SVG.
Detailed description of the invention
Fig. 1 is to be directed to the large data sets of multi-source heterogeneous spatial data into the general frame figure of system model.
Fig. 2 is the ESRI wrapper structure chart for the big data integrated system of multi-source heterogeneous spatial data.
Fig. 3 is to be directed to the big data integrated system realization GML document of multi-source heterogeneous spatial data to the mutual behaviour of SQL database
Make procedure chart.
Fig. 4 is the flow chart that SVG is converted into for the big data integrated system realization GML of multi-source heterogeneous spatial data.
Specific embodiment
With reference to the accompanying drawing and specific embodiment to the present invention carry out in further detail with complete explanation.It is understood that
It is that described herein the specific embodiments are only for explaining the present invention, rather than limitation of the invention.
Referring to Fig.1, a kind of big data integrated system for multi-source heterogeneous spatial data of the invention, the system include:
Data end module, Service Process Server module and client modules；Wherein, the data end module includes multi-source heterogeneous sky
Between data and relational data；The effect of the Service Process Server module is to form a connecting link, be the data end module with
Connection bridge between the client modules；The client modules support SVG, have and carry out display and straight to spatial data
Connect the ability of Spatial data query.
In the multi-source heterogeneous spatial data integrated system of design, the Driven Heterogeneous Geographic Data Set of multi-data source is collected
At needing that specific spatial data is described with GML, obtain unified data descriptor format.The present invention is in designing system
By the application of layering thought when framework, according to the function of system module, whole system is divided into following three modules:
It is data end module first, data end module includes the multi-source heterogeneous spatial data and data for being distributed in heterogeneous networks
The relational data stored in the server of library.In order to realize the shared of spatial data, it is necessary to the space of heterogeneous networks will be distributed in
Data are transformed into unified GML in data terminal.
The function of GML wrapper is exactly to parse various isomeric datas, passes through pattern extraction, data pick-up and data conversion handle
M IS is to unified GML document, to eliminate Heterogeneous data.
Followed by Service Process Server module, by the GML data of WebService technology access data terminal, and to returning
The data set returned is handled by GML data repository interoperation service, GML data is mapped in database server, then
Data in database are analyzed and inquired etc. with operation, operating result is supplied to client.Client modules are at business
It manages server module and issues request, Service Process Server module is counted to required for data query Analysis Service program inquiring
According to if it is Non-spatial Data, direct request spatial database is inquired the result needed；If it is spatial data,
SVG format transition service and GML data repository interoperation service routine are then requested, XSLT (extensible is used
Stylesheet language transforma-tions) dynamic generation SVG document, then on a web browser by SVG3.0
Inquiry operation is carried out to SVG document.
Service Process Server module carries out realizing Non-spatial Data and spatial data on Miscrosoft.NET platform
Query service.Miscrosoft.NET is WebService development technique the most popular, is to integrate and apply to provide weight
The solution wanted.
It is finally client modules, user passes through browser addressing space data.Firstly, user positions number by metadata
According to collection；Then it is further retrieved: the attribute query and basic space number of specified figure layer display control, pictorial element
According to analysis.
Client modules support SVG, have the ability for carrying out display to spatial data and directly inquiring.Work as client modules
After proposing inquiry request, if the content of inquiry is included in pervious query result, and client modules are had been downloaded into, just
It directly can complete to inquire in client modules, inquiry request is otherwise submitted to Service Process Server end module and is executed.Most
Afterwards, client modules are graphical by the result of return and are presented to the user.
1, conversion of the multi-source heterogeneous spatial data to GML document
Multi-source heterogeneous spatial data is various heterogeneous data sources.In order to which data are carried out with unified storage and pipe
Reason, and data sharing is realized between different GIS manufacturers and organization, it is necessary to eliminate isomerism.For this purpose, the present invention designs
GML wrapper has been used, M IS to unified GML document, to eliminate Heterogeneous data, has realized and is based on GML
Conversion of Spatial Data.
GML wrapper is made of several wrappers independent of each other, and each wrapper corresponds to a kind of data source.Therefore this hair
The bright data source category for support has good scalability.The data source new for every kind, that the present invention needs to do
It is the corresponding wrapper of building.It is with ESRI (environmental systems research institute) wrapper
Example, is made of, as shown in Figure 2 two parts.
(1) it document analysis component: explains SHAPE file, extracts and organize geometric data；Explain DBF file, extraction and group
Knit attribute data；Construct document object tree DOM Tree；
(2) GML transition components: the document object tree constructed according to SHAPE document analysis component and DBF document analysis component
Generate GML document.
The realization of ESRI wrapper is divided into two steps: when 1. establishing DOM Tree, generating the node of each geographic object, but node
Specifying information is not saved, and only retains pointer of its corresponding information in SHAPE DBF file；2. generating GML from DOM Tree
When, geometry, attribute data are read into corresponding file further according to pointer, to generate GML document, complete multi-source heterogeneous sky
Between conversion of the data to GML document.
2, the interoperability of GML and spatial database server
The interoperability of GML and spatial database server includes two aspects: 1. realizing GML number by Web Service
After access, transmission and reception, needs for GML data to be mapped in spatial database server, GML data is stored,
So that data are carried out with the operation such as inquire；2. the relation data being stored in spatial database server is mapped to GML document,
GML to be further converted on .NET platform the document of SVG format, client modules realize spatial data can
Depending on changing.The present invention, as spatial database, realizes GML document to SQL Server database using SQL Server database
Interoperability, as shown in Figure 3.
Following example illustrates GML documents and SQL Server Interoperability Mechanism:
The table of Database are as follows:
FeatureMember: the title and serial number of record GML difference figure layer；
BounderBy: writing edge dividing value；
Linestring: the coordinate value of record straight line, rectangle and polygon；
Arc/ellipse: record arc, elliptical information.
The attribute of corresponding main database table is as shown in table 1 to table 5.
1 Feature Collection of table
| Feature Collection_Id | type Name |
| 7 | Residential quarters |
2 bounded By of table
| bounded By_Id | Feature Collection_Id |
| 7 | 7 |
3 BOX of table
4 Feature of table
| Feature Member_Id | type Name | Feature Collection_Id |
| 57 | 0 | 7 |
| 60 | 330 | 7 |
5 FeatureMembet of table
| Feature td | type Name | identifier | Feature Collection td |
| 57 | LineString | Line String00 1 | 57 |
| 60 | LineString | Line String00 4 | 60 |
3, the visualization of spatial data
1) SVG and its method for transformation
GML document is substantially the XML document for including geography information, and GML document itself is cannot be directly with the shape of map
What formula was shown, it can be converted VML (vector markup language), X3D, SVG isovector format.
SVG is the scalable vector graphics language description specification based on XML.The grammer and structure of SVG be based on XML,
The conversion essence of GML document to SVG are the XML documents that a kind of XML document of format is converted into another format.For GML
Obtained SVG document after conversion directly opens SVG with browser after being mounted with the plug-in unit for supporting SVG to show for browser
Document, browser directly explain SVG execution, to generate corresponding map.On .NET platform, GML to SVG's is transformed
Journey, as shown in Figure 4.
XSLT can extensible stylesheet list language conversion, be a kind of language for transform XML documents structure, it can be by one
A XML document is converted into another XML document.XSLT depends on XML syntax analyzer, and XML document is converted into a tree by it
Shape structure.This tree represenation structure for the exactly document that XSLT is manipulated, rather than document itself.XSLT language is illustrative
, it only describes required conversion, and is not to provide the Process Character instruction sequence for realizing this conversion.Really conversion is real
Now then depend on xslt processor..NET platform, which provides to aim at, executes XSLT conversion and that develops several is built in
The class that System.Xml encapsulation is concentrated, including XslTransform and Xpath-Document class.By using these classes and its
Its class, so that it may the function of XSLT language is given full play in ASP.NET application program.
2) client modules of spatial data are realized
The present invention has in the major function that client modules are realized: the display control of figure layer, the mark of figure layer, map reference
Display, pictorial element highlight display, the attribute query of pictorial element, setting of legend etc..
The inquiry of attribute information is carried out under Web environment, usually reading attributes information returns to from the database on backstage
Client modules are shown.Two kinds of situations can be divided into for the attribute information inquiry of SVG image: when attribute data volume is little
When, attribute data can be deposited in a script file with image file and download to client modules, in this way for
The inquiry of attribute information is completed in client modules, does not need to come into contacts with the database on backstage, to improve the response time.
When attribute data volume is larger, then can be looked by the ASP.NET program with server end to access database come return attribute
Ask result.The present invention has used both methods according to attribute data amount respectively.
The attribute query code (by taking rectangle as an example, length limitation only provides partial code) of pictorial element:
The above description is only a preferred embodiment of the present invention, is not intended to restrict the invention, for those skilled in the art
For, the invention can have various changes and changes.All any modifications made within the spirit and principles of the present invention are equal
Replacement, improvement etc., should all be included in the protection scope of the present invention.
Claims (4)
1. being directed to the big data integrated system of multi-source heterogeneous spatial data, which is characterized in that the system comprises: data terminal mould
Block, Service Process Server module and client modules；Wherein, the data end module include multi-source heterogeneous spatial data and
Relational data；The effect of the Service Process Server module is to form a connecting link, and is the data end module and the client
Connection bridge between end module；The client modules support SVG, have and to spatial data carry out display and directly inquire
Ability.
2. the big data integrated system according to claim 1 for multi-source heterogeneous spatial data, which is characterized in that described
Data end module includes the relationship type number stored in the multi-source heterogeneous spatial data and database server for be distributed in heterogeneous networks
According to；Wherein, the heterogeneous spatial data for being distributed in heterogeneous networks is transformed into unified GML by GML wrapper, to realize sky
Between data it is shared, eliminate the isomerism of data.
3. the big data integrated system according to claim 1 for multi-source heterogeneous spatial data, which is characterized in that described
Service Process Server module realizes the query service of Non-spatial Data and spatial data on Miscrosoft.NET platform.
4. the big data integrated system according to claim 1 for multi-source heterogeneous spatial data, which is characterized in that described
Client modules support SVG, have the ability for carrying out display to spatial data and directly inquiring, and user accesses it by browser
Spatial data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711240856.6A CN110147408A (en) | 2017-12-01 | 2017-12-01 | For the big data integrated system of multi-source heterogeneous spatial data |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711240856.6A CN110147408A (en) | 2017-12-01 | 2017-12-01 | For the big data integrated system of multi-source heterogeneous spatial data |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110147408A true CN110147408A (en) | 2019-08-20 |
Family
ID=67588026
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711240856.6A Pending CN110147408A (en) | 2017-12-01 | 2017-12-01 | For the big data integrated system of multi-source heterogeneous spatial data |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110147408A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111125233A (en) * | 2020-01-02 | 2020-05-08 | 中航(广州)信息科技有限公司 | International reimbursement heterogeneous data acquisition technology |
-
2017
- 2017-12-01 CN CN201711240856.6A patent/CN110147408A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111125233A (en) * | 2020-01-02 | 2020-05-08 | 中航(广州)信息科技有限公司 | International reimbursement heterogeneous data acquisition technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100588166C (en) | Distributed GIS space information integration apparatus based on mobile agent and GML | |
| US20090125488A1 (en) | Geographic XML database management system | |
| CN101625694A (en) | Method and system for storing various standard geological metadata | |
| CN104636265B (en) | A kind of access method of efficient memory model tissue of CIMXML document | |
| CN101216835A (en) | Data file conversion method and apparatus | |
| CN101625690A (en) | Method and device for sharing access of distributed and heterogeneous earth science data resource | |
| CN110147408A (en) | For the big data integrated system of multi-source heterogeneous spatial data | |
| Zhu et al. | A multi-source heterogeneous vector space data integration scheme based on geojson | |
| Tong et al. | SQL-middleware: enabling the blockchain with SQL | |
| CN101840426B (en) | GML document storage and enquiry method based on coordinate separation | |
| CN111930870A (en) | Power distribution network design platform based on 3DGIS | |
| CN104572991A (en) | Heterogeneous facet conversion-based component retrieval method in network forming software component library | |
| Wang et al. | Spatial data sharing and interoperability based on web spatial data service and GML | |
| Tong et al. | Modeling cadastral spatial features based on geography markup language in GIS: A case study in Shanghai | |
| Song et al. | The Storage Optimization of Test Cases and Test Results in Spacecraft Automatic Test Based on JSON | |
| Braun | Microservice-based Reference Architecture for Semantics-aware Measurement Systems | |
| Li et al. | Visualization Method of Trajectory Data Based on GML, KML | |
| Kleiner et al. | Web-Enabling Geographic Data with Object-Relational Databases | |
| CN105718537A (en) | Agricultural product supply chain whole-course data conversion method using logistics data as core | |
| Chunithipaisan et al. | The development of web processing service using the power of spatial database | |
| Ma et al. | Design of meteorological information display system based on data warehouse | |
| Chawanji | Vector tile cache connecting effective spatial communication and geospatial AI | |
| Wang et al. | Managing multi-scale spatial data for mobile application | |
| Wu et al. | Web GIS-based information management system of Dashanbao black-necked crane national natural reserve in Zhaotong, Yunnan | |
| Wang | Web Database Access Technology Based on ASP. NET |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190820 |
|
| WD01 | Invention patent application deemed withdrawn after publication |