CN105447132A - Four-layer geographic data storage system oriented to Internet of Things application - Google Patents
Four-layer geographic data storage system oriented to Internet of Things application Download PDFInfo
- Publication number
- CN105447132A CN105447132A CN201510801491.4A CN201510801491A CN105447132A CN 105447132 A CN105447132 A CN 105447132A CN 201510801491 A CN201510801491 A CN 201510801491A CN 105447132 A CN105447132 A CN 105447132A
- Authority
- CN
- China
- Prior art keywords
- node
- application
- data
- geographic
- logic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9537—Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a four-layer geographic data storage system oriented to Internet of Things application. The system comprises a four-layer architecture composed of a geographic node, a logical node, an application node and a storage node, wherein the geographic node is used for accurately describing geometrical shape of a site in the application; the application node is used for describing objects containing geographic position information in the Internet of Things application; the logical node is a core structure of an organization space in the four-layer geographic data storage system oriented to Internet of Things application, and is used for organizing geographically significant points in a layered-structure, and respectively associating the geographic node, the application node and the storage node. A flexible and high-efficiency method is provided for query and processing operations of data; the storage node is used for efficiently processing different types of data, and needs to use SQL, NoSQL and a distributed file system in mixed form. After using the module provided in the invention, geographic data storage oriented to Internet of Things application can be organized effectively in decoupled form, and high-efficiency query and storage can be carried out.
Description
Technical field
What the present invention relates to is a kind of technology of Internet of Things field, four layers of geodata storage system of specifically a kind of internet of things oriented application.
Background technology
In Internet of Things application, produce and a large amount of both comprised geographical location information, comprise again the data of text message or other information, need to consider this concentrated message providing service simultaneously, for user provides location-based accurate service, so these data of Storage and Processing are most important in Internet of Things application.
Through finding the retrieval of prior art, DongxiangZhang, Kian-LeeTan, AnthonyK.H.Tung shows " Scalabletop-kspatialkeywordsearch; " Proceedingsofthe16thInternationalConferenceonExtendingDa tabaseTechnology, the extendible I that ACM, 2013, pp.359-370. propose
3propose to adopt the space-division method of quadtree, spatial data and text data organized at same storage space, and propose one efficiently inquiry pruning method obtain better efficiency.I
3spatial organization's method divides in strict accordance with four points of trees, and dirigibility is poor in actual applications for this, limits to some extent.
Chinese patent literature CN104008212A, open (bulletin) day 2014.08.27, discloses the Internet of Things time series data access method that a kind of geographical location information is associated, belongs to the large field of data storage of computing machine.The method comprises: 1) by a up-to-date data information memory to latest data cache table; 2) the basic point time is determined, and rise time concordance list major key; 3) in the row race that corresponding data is capable, Delta Time, geohash coding and real data is preserved to time index table; 4) major key of the temporal index table that basic point space and basic point ageing are formed is generated according to geohash coding; 5) in the row race that corresponding data is capable, Delta Time, increment space, device id and real data is preserved to temporal index table; 6) data query information.But this technology 1) be confined to preliminary extraction and the inquiry of internet of things equipment data, can not complicated applications be supported; 2) description for geographical location information is fairly simple; 3) for the deficiency that complex data structures is supported.
Summary of the invention
The present invention is directed to prior art above shortcomings, four layers of geodata storage system of a kind of internet of things oriented application are proposed, according to the characteristic of Internet of Things application spatial data, four layer architectures of geographic node, logic node, actual node, memory node are comprised by one, organization space information neatly, be entrance with logic node, associate positional information and abundant content information accurately.And consider the heterogeneity of data in Internet of Things, bottom storage scheme such as mixing SQL, NoSQL and distributed document storage etc., there is provided one can support to become granularity data tissue and inquiry, be applicable to the flexible expansion framework of distributed environment, meet the spatial data sweetly disposition in Internet of Things application and the demand of storage scheme, for the application data inquiry of labyrinth provides support.
The present invention is achieved by the following technical solutions:
The present invention includes: application layer, technical support layer and accumulation layer, wherein: application layer is connected with technical support layer and transmits the geographic position data and application content data applying and produce, technical support layer is treated and after inquiring about, the Query Result obtained is returned application layer, and accumulation layer is connected from technical support layer and the data corresponding according to different data structure storage.
Technique effect
Compared with prior art, current method great majority focus on the some problems solving Spatial data query, take keyword as representative, but in the application of reality, data often comprise abundanter semanteme and more complicated structure, and the solution only comprising keyword query may be met difficulty in actual applications.The structure that the present invention proposes is more suitable for the structure flexibly of practical application, comprise space expression method, uncoupled spatial object, positional information, and storage mode, there is provided a partial data tissue, storage, inquiry, enclosed structure, clearly complicated in tissue substance working application spatial data.
Accompanying drawing explanation
Fig. 1 is structural representation of the present invention;
Fig. 2 is logic node schematic diagram in technical support layer;
Fig. 3 describes a schematic diagram with the place of shape and area with geographic node;
Fig. 4 is technical support layer four layer architecture schematic diagram;
Fig. 5 is querying method schematic diagram.
Embodiment
The present embodiment is used and is verified in city intelligent charging pile system.The subject matter solved is needed to be manage all charging pile application datas in city in this system, comprising the master data of the attribute of charging pile own, the event data that charging electric vehicle behavior produces, and some promote the other types data such as picture, video required for information, the design in corresponding framework of the present invention in actual node.And user oriented function, the present invention needs to be user's recommendation charging pile met the demands nearby rapidly.What meet requires to include, the charging pile type of coupling and electric automobile type, upstate, idle condition etc., and the idle charging pile quantity in same place etc., consider that these require with charging pile distance as user recommends most suitable charging pile simultaneously.
As shown in Figure 1, the present embodiment comprises: application layer, technical support layer, accumulation layer, wherein:
Described application layer adopts Android front end, realizes Core Feature: optimal charge stake is recommended.
As shown in Figure 4, described technical support layer associated application layer and accumulation layer and be four-layer structure, comprise: for the geographic node of geometric configuration in place, the application node of the description of the object containing geographical location information and the logic node be attached thereto respectively and memory node thereof in accurate description application, wherein: geographic node is used for the position describing application node exactly; Application node is used for setting up application node type, comprises the attribute information of application node, status information, also supports the data of the labyrinth such as picture, video; As shown in Figure 2, described logic node: according to proposing space-division method and K value in framework, the present invention establishes the logic node of electric stake system, use Shanghai City is complete or collected works C.Partition function adopts administrative division; Memory node: select the one deck in logic node, for this layer region distributes a memory node, in each memory node, application node basicInfo leaves MySQL database in, and EventInfo leaves MongoDB in, and OtherInfo leaves in HDFS.
Described geographic node adopts and is proposed and the geographical markup language GML safeguarded by Open Geographic Information System association (OCG), it provide a widely used geographic information data standard, there is high scalability, plain text, the advantage of high efficient coding mode.Fig. 3 is and describes an example with the place of shape and area with geographic node.
Described application node comprises: the data content of fixed attribute information, thing connection status information and labyrinth.Consider at the same time in the inquiry of the position degree of correlation and the content degree of correlation, draw the content degree of correlation by application node.
From the angle of inquiry, application node comprises further:
1) parameter K:K represents the quantity of application node in certain area coverage.
2) Boolean type condition { b1, b2, b3 ... }: the conditional attribute of demand fulfillment in inquiry.
3) quantify content: content score is the numerical expression of the content degree of correlation, is calculated by the content that can quantize in application node and produces.
4) other guide: the relevant information that have recorded this objects all in application node, can comprise picture, video etc.
And from stored angles, the information in application node can be divided into again three parts, facilitate the process of memory node.
1) BasicInfo, namely the essential information of actual node, comprises the information such as ID, Type
2) EventInfo, namely comprises the semi-structured dynamic data that sensor produces, and comprises the timestamp that event occurs, event attribute, and state change
3) OtherInfo, i.e. the unstructured data of the amendment of the lower frequency such as picture, video and reading
Geographically significant point gets up with the structure organization of layering by described logic node, associates geographic node, application node and memory node respectively.For the inquiry of data and process operation provide flexible and efficient method.
Described logic node is with the pyramidal hierarchical organization arrangement shown in Fig. 4, and every one deck comprises the logic node of varying number, and father's logic node on upper strata comprises all regions of lower straton logic node, successively segments.Leaf node one_to_one corresponding application node.
This hierarchy controls the quantity of application node in every one deck logic node according to fixing K value, by the index structure providing areas combine algorithm and region partitioning algorithm to set up a balance, improves search efficiency.
Described memory node is according to the spatial dimension of logically node division, for several logic nodes distribute a memory node, namely according to the storage capacity of data volume and server, select the one deck in pyramid, each logic node for this one deck distributes a memory node; For each memory node, all adopt the storage means that SQL+NoSQL+ distributed file system mixes, process three kinds of data in actual node respectively.When inquiring about, for these three kinds of data distribute independent bandwidth, inquiring about simultaneously, raising the efficiency.
As shown in Figure 5, described inquiry refers to: a given inquiry request (query), comprises the place of inquiry generation, the Boolean condition (conditions) that need meet and query contents.Cx，。The present invention detects the child node of Cx successively, wipe out ineligible region, by calculating final mark to position mark (LocationScore) and query contents mark (ContentScore), get the net result of application node as inquiry of best result.
The technical indicator of above-mentioned work compares in table 1 with the technical parameter of similar products at home and abroad.
Table 1 technical characteristic contrasts
The geodata storage that the invention enables internet of things oriented to apply obtains effectively, the tissue of decoupling zero, and inquires about efficiently and store, and this is also greatest feature of the present invention.
Above-mentioned concrete enforcement can carry out local directed complete set to it by those skilled in the art in a different manner under the prerequisite not deviating from the principle of the invention and aim; protection scope of the present invention is as the criterion with claims and can't help above-mentioned concrete enforcement and limit, and each implementation within the scope of it is all by the constraint of the present invention.
Claims (7)
1. four layers of geodata storage system of an internet of things oriented application, it is characterized in that, comprise: application layer is connected with technical support layer and transmits the geographic position data and application content data applying and produce, technical support layer is treated and after inquiring about, the Query Result obtained is returned application layer, and accumulation layer is connected from technical support layer and the data corresponding according to different data structure storage;
Described technical support layer comprises: for the geographic node of geometric configuration in place, the application node of the description of the object containing geographical location information and the logic node be attached thereto respectively and memory node totally four layer architectures thereof in accurate description application, wherein: geographic node, application node, memory node are connected centered by logic node; Geographic node provides position and the shape information of specified place to logic node, and application node provides a certain place about the data of application content to logic node, i.e. the carrier of match query, and memory node provides the information of concrete data storage location to logic node.
2. four layers of geodata storage system according to claim 1, is characterized in that, described geographic node adopts and proposed and the geographical markup language GML safeguarded by Open Geographic Information System association.
3. four layers of geodata storage system according to claim 1, it is characterized in that, described application node comprises: the data content of fixed attribute information, thing connection status information and labyrinth; Consider at the same time in the inquiry of the position degree of correlation and the content degree of correlation, draw the content degree of correlation by application node.
4. four layers of geodata storage system according to claim 1, is characterized in that, geographically significant point gets up with the structure organization of layering by described logic node, associates geographic node, application node and memory node respectively.
5. four layers of geodata storage system according to claim 1, it is characterized in that, described logic node arranges with pyramidal hierarchical organization, every one deck comprises the logic node of varying number, father's logic node on upper strata comprises all regions of lower straton logic node and successively segments, described leaf node one_to_one corresponding application node;
Described hierarchy controls the quantity of application node in every one deck logic node according to fixing K value, by the index structure providing areas combine algorithm and region partitioning algorithm to set up a balance.
6. four layers of geodata storage system according to claim 1, it is characterized in that, described memory node is according to the spatial dimension of logically node division, for several logic nodes distribute a memory node, namely according to the storage capacity of data volume and server, select the one deck in pyramid, each logic node for this one deck distributes a memory node; For each memory node, all adopt the storage means that SQL+NoSQL+ distributed file system mixes, process three kinds of data in actual node respectively; When inquiring about, distributing independent bandwidth for these three kinds of data and inquiring about simultaneously.
7. four layers of geodata storage system according to claim 1 or 3 or 6, it is characterized in that, described inquiry refers to: a given inquiry request, comprise the place of inquiry generation, the Boolean condition that need meet and query contents, by detecting the child node of query contents successively, wiping out ineligible region, by calculating final mark to position mark and query contents mark, getting the net result of application node as inquiry of best result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510801491.4A CN105447132A (en) | 2015-11-19 | 2015-11-19 | Four-layer geographic data storage system oriented to Internet of Things application |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510801491.4A CN105447132A (en) | 2015-11-19 | 2015-11-19 | Four-layer geographic data storage system oriented to Internet of Things application |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105447132A true CN105447132A (en) | 2016-03-30 |
Family
ID=55557309
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510801491.4A Pending CN105447132A (en) | 2015-11-19 | 2015-11-19 | Four-layer geographic data storage system oriented to Internet of Things application |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105447132A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106126532A (en) * | 2016-06-13 | 2016-11-16 | 浪潮(北京)电子信息产业有限公司 | A kind of data management system, method and the asset management system |
| CN109783538A (en) * | 2018-12-28 | 2019-05-21 | 陆明 | Data processing system |
| CN114116774A (en) * | 2022-01-28 | 2022-03-01 | 北京安帝科技有限公司 | Log data query method and device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103176990A (en) * | 2011-12-21 | 2013-06-26 | 方正国际软件(北京)有限公司 | Spatial data storage and spatial data storage reading method and spatial data storage reading system |
| CN104281701A (en) * | 2014-10-20 | 2015-01-14 | 北京农业信息技术研究中心 | Method and system for querying distributed multi-scale spatial data |
-
2015
- 2015-11-19 CN CN201510801491.4A patent/CN105447132A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103176990A (en) * | 2011-12-21 | 2013-06-26 | 方正国际软件(北京)有限公司 | Spatial data storage and spatial data storage reading method and spatial data storage reading system |
| CN104281701A (en) * | 2014-10-20 | 2015-01-14 | 北京农业信息技术研究中心 | Method and system for querying distributed multi-scale spatial data |
Non-Patent Citations (1)
| Title |
|---|
| SHUAI LUAN等: "A Four-Layer Flexible Spatial Data Framework towards IoTApplication", 《2015 IEEE 12TH INTERNATIONAL CONFERENCE ON E-BUSINESS ENGINEERING》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106126532A (en) * | 2016-06-13 | 2016-11-16 | 浪潮(北京)电子信息产业有限公司 | A kind of data management system, method and the asset management system |
| CN109783538A (en) * | 2018-12-28 | 2019-05-21 | 陆明 | Data processing system |
| CN114116774A (en) * | 2022-01-28 | 2022-03-01 | 北京安帝科技有限公司 | Log data query method and device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106372114B (en) | A kind of on-line analysing processing system and method based on big data | |
| CN102831307B (en) | Three-dimensional GIS (Geographic Information System) technology based power grid visualization system and method | |
| CN104252489A (en) | Method for fast obtaining position character description information according to latitude and longitude data | |
| CN103530354B (en) | geographic information data fusion system | |
| CN105808672A (en) | Browser based mass three-dimensional point cloud data release method | |
| CN109408548A (en) | A kind of urban electric power big data application system and method | |
| CN101963996B (en) | Global raster data storing method | |
| CN103049554B (en) | A kind of vector QR tree parallel index method | |
| CN103106284B (en) | Subdivision middleware for three-dimensional data global information correlation and information correlation method | |
| CN103412897A (en) | Parallel data processing method based on distributed structure | |
| CN108959352A (en) | Time-space data analysis platform and processing method based on time and Spatial Data Model | |
| CN106933833A (en) | A kind of positional information method for quickly querying based on Spatial Data Index Technology | |
| CN110147377A (en) | General polling algorithm based on secondary index under extensive spatial data environment | |
| CN105447132A (en) | Four-layer geographic data storage system oriented to Internet of Things application | |
| CN110175175A (en) | Secondary index and range query algorithm between a kind of distributed space based on SPARK | |
| Li et al. | A cloud-based trajectory data management system | |
| CN115129795A (en) | Data space-time storage method based on geospatial grid | |
| CN112085826A (en) | Efficient three-dimensional space grid rendering method and device | |
| US20190197029A1 (en) | Methods, systems and apparatus to improve spatial-temporal data management | |
| Wang et al. | Integration of 3DGIS and BIM and its application in visual detection of concealed facilities | |
| CN103106254B (en) | The parallel joining method of polygon vector data file | |
| CN115408382B (en) | Vector space information gridding storage management method for large-scale satellite data | |
| Huang et al. | A grid based trajectory indexing method for moving objects on fixed network | |
| CN116108120A (en) | Grid indexing method for track data, track data searching method and track data searching device | |
| CN110019466A (en) | Big data integrated system based on metadata |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20160330 |