CN114238531A - Method and device for drawing mechanism resources - Google Patents
Method and device for drawing mechanism resources Download PDFInfo
- Publication number
- CN114238531A CN114238531A CN202111466497.2A CN202111466497A CN114238531A CN 114238531 A CN114238531 A CN 114238531A CN 202111466497 A CN202111466497 A CN 202111466497A CN 114238531 A CN114238531 A CN 114238531A
- Authority
- CN
- China
- Prior art keywords
- data
- resource
- geomesa
- map
- spatial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000007246 mechanism Effects 0.000 title claims abstract description 41
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000006243 chemical reaction Methods 0.000 claims abstract description 20
- 238000004140 cleaning Methods 0.000 claims abstract description 18
- 238000013507 mapping Methods 0.000 claims abstract description 15
- 238000012545 processing Methods 0.000 claims abstract description 13
- 238000013075 data extraction Methods 0.000 claims abstract description 11
- 238000007726 management method Methods 0.000 claims description 22
- 238000013500 data storage Methods 0.000 claims description 14
- 238000000605 extraction Methods 0.000 claims description 14
- 230000000007 visual effect Effects 0.000 claims description 14
- 238000009877 rendering Methods 0.000 claims description 8
- 239000000284 extract Substances 0.000 claims description 7
- 238000001914 filtration Methods 0.000 claims description 7
- 238000007781 pre-processing Methods 0.000 claims description 7
- 239000004744 fabric Substances 0.000 claims 4
- 239000000463 material Substances 0.000 abstract description 3
- 230000008520 organization Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 3
- 238000007405 data analysis Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000035515 penetration Effects 0.000 description 2
- 230000002265 prevention Effects 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 210000001520 comb Anatomy 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 230000007123 defense Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000012634 fragment Substances 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000007670 refining Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2457—Query processing with adaptation to user needs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/28—Databases characterised by their database models, e.g. relational or object models
- G06F16/284—Relational databases
- G06F16/285—Clustering or classification
Abstract
The invention provides a method and a device for mapping mechanism resources, wherein the method comprises the following steps: arranging and classifying the data of the mechanism according to a set rule; performing data extraction, data cleaning, data conversion and data loading on the classified data; sending the processed data to GeoMesa for processing to obtain spatial data; stratifying the spatial data to obtain layer data; the map data is mapped, all resource data related to the mechanism can be visually displayed through one map, the accuracy of the acquired data is improved, and resources such as manpower, material resources, time and the like are saved.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a method and a device for drawing on mechanism resources.
Background
Along with the continuous deepening of command city construction, an organization needs to rely on various industrial data, data management, analysis and research and judgment are carried out more efficiently by utilizing the technical advantages of 'big data', and personnel are deployed reasonably by releasing data values, guiding services by information and greatly improving the fighting capacity of the personnel. In the existing technical scheme, an organization network manager mainly searches related data information through a system platform by means of data provided by a big data platform, and then completes tasks such as striking, prevention, management, control, service and the like by means of communication equipment, field investigation, personnel resources and the like.
In the prior art, although the mechanism depends on a large data platform, many data need to be completed by other means, for example, when important prevention and control is performed, the surrounding environment needs to be studied and known in the field; when the cooperative defense is caught, the positions of the personnel need to be confirmed through communication equipment; when the monitoring is called, system platforms and the like need to be switched, which can increase redundant workload, consume a large amount of resources such as manpower, material resources and time, and have low accuracy.
Disclosure of Invention
The technical problem to be solved by the present invention is to provide a method and a device for mapping a mechanism resource, which can visually display all resource data related to the mechanism through one map, improve the accuracy of the acquired data, and save resources such as manpower, material resources, time, and the like.
In a first aspect, the present invention provides a method for mapping mechanism resources, including:
step 1, arranging and classifying the data of the mechanism according to a set rule;
step 2, performing data extraction, data cleaning, data conversion and data loading on the classified data;
step 3, sending the processed data to GeoMesa for processing to obtain spatial data;
step 4, stratifying the spatial data to obtain layer data;
and 5, carrying out the upper graph on the graph layer data.
Further, the step 2 is further specifically:
data extraction: finding the data source of each system platform according to the sorted classification, selecting the data source by adopting an ETL tool, setting a data field, defining a data interface, and formulating an extraction cycle to finish the extraction work of the data;
data cleaning: setting a filtering condition of the data through an ETL tool according to a business rule, and cleaning the data;
data conversion: setting data splitting, data merging and data association through an ETL tool, generating corresponding data formats according to a set data table structure, simultaneously generating respective resource data main keys, and binding the association relation of the resource data according to the main key relation;
loading data: and (4) sorting various resource data, and storing the data into an HBase database according to a data table structure.
Further, the step 3 is further specifically:
the processed data are sent to GeoMesa, the GeoMesa carries out preprocessing on the transmitted data, an index mechanism in the GeoMesa extracts geographic information and time information of the GeoMesa according to Feature data, after the integrity of the data is determined, parameters of longitude and latitude and time are subjected to data conversion to establish a spatial index, and then a normaize method is called to format the time and spatial data and integrate the time and spatial data into sequence data; the GeoMesa utilizes a Kryo serialization mechanism to serialize sequence data and convert the sequence data into a binary format suitable for Hbase storage;
connecting an HBase database by using Java codes, and connecting a GeoMesa cluster by using a GeoMesa interface to create a DataStore object, wherein the DataStore object provides an interface for GeoMesa specified directory operation; defining various resource table structures by using a SimpleFeatureType object, and creating the resource table structures into Schema in the DataStore; reading the data of each data resource, converting the data into SimpleFeture spatial data of various resources, and storing the spatial data into an HBase database by calling a GeoMesa interface.
Further, the step 4 is further specifically:
creating a data source: using a visual page of the GeoServer, entering a working area management page, inputting a working area name and a name space URI (Uniform resource identifier) to create a working area, newly creating HBase data storage in the data storage management page of the working area, selecting the HBase as a data source, filling a data source name and database connection configuration, and storing and generating resource data;
and (4) releasing the layer: layer management is carried out on a visual page of the GeoServer, layers are added to select HBase data sources, and different layers select different data tables according to different types of resource data; and entering a layer release page, configuring a coordinate reference system and the setting of a map frame, and modifying the map style to generate a tile layer of the resource data.
Further, the step 5 is further specifically:
and configuring WMS service parameter information to complete the creation of the layer by adopting an OpenLayers front-end map framework, generating a map through an OpenLayers API, and rendering at the front end to complete the resource map application.
In a second aspect, the present invention provides an apparatus for mapping on a mechanism resource, including:
the data classification module is used for sorting and classifying the data of the mechanism according to a set rule;
the data processing module is used for performing data extraction, data cleaning, data conversion and data loading on the classified data;
the spatial data module is used for sending the processed data to the GeoMesa for processing to obtain spatial data;
the layer data module is used for layering the spatial data to obtain layer data;
and the drawing module is used for drawing the drawing data.
Further, the data processing module is further specifically:
data extraction: finding the data source of each system platform according to the sorted classification, selecting the data source by adopting an ETL tool, setting a data field, defining a data interface, and formulating an extraction cycle to finish the extraction work of the data;
data cleaning: setting a filtering condition of the data through an ETL tool according to a business rule, and cleaning the data;
data conversion: setting data splitting, data merging and data association through an ETL tool, generating corresponding data formats according to a set data table structure, simultaneously generating respective resource data main keys, and binding the association relation of the resource data according to the main key relation;
loading data: and (4) sorting various resource data, and storing the data into an HBase database according to a data table structure.
Further, the spatial data module is further specifically:
the processed data are sent to GeoMesa, the GeoMesa carries out preprocessing on the transmitted data, an index mechanism in the GeoMesa extracts geographic information and time information of the GeoMesa according to Feature data, after the integrity of the data is determined, parameters of longitude and latitude and time are subjected to data conversion to establish a spatial index, and then a normaize method is called to format the time and spatial data and integrate the time and spatial data into sequence data; the GeoMesa utilizes a Kryo serialization mechanism to serialize sequence data and convert the sequence data into a binary format suitable for Hbase storage;
connecting an HBase database by using Java codes, and connecting a GeoMesa cluster by using a GeoMesa interface to create a DataStore object, wherein the DataStore object provides an interface for GeoMesa specified directory operation; defining various resource table structures by using a SimpleFeatureType object, and creating the resource table structures into Schema in the DataStore; reading the data of each data resource, converting the data into SimpleFeture spatial data of various resources, and storing the spatial data into an HBase database by calling a GeoMesa interface.
Further, the layer data module further specifically includes:
creating a data source: using a visual page of the GeoServer, entering a working area management page, inputting a working area name and a name space URI (Uniform resource identifier) to create a working area, newly creating HBase data storage in the data storage management page of the working area, selecting the HBase as a data source, filling a data source name and database connection configuration, and storing and generating resource data;
and (4) releasing the layer: layer management is carried out on a visual page of the GeoServer, layers are added to select HBase data sources, and different layers select different data tables according to different types of resource data; and entering a layer release page, configuring a coordinate reference system and the setting of a map frame, and modifying the map style to generate a tile layer of the resource data.
Further, the map loading module is further specifically:
and configuring WMS service parameter information to complete the creation of the layer by adopting an OpenLayers front-end map framework, generating a map through an OpenLayers API, and rendering at the front end to complete the resource map application.
One or more technical solutions provided in the embodiments of the present invention have at least the following technical effects or advantages:
according to the method and the device for mapping the mechanism resources, provided by the embodiment of the application, by combining a GIS map information system, GeoServer space service and big data analysis technology, the map is displayed through the map to display the resource data such as people, vehicles and cases required by the mechanism and complete mapping of the resources, and the functions of coordinate position of map viewing data, real-time track analysis, video playing and recording, periphery analysis and the like are realized; the loading and the quick positioning of the related cases can be realized, and the corresponding contents are marked; meanwhile, surrounding monitoring videos and personnel resources can be checked, thereby facilitating the judgment and analysis of occurrence positions and surrounding conditions by commanders, and carrying out early processing and distribution on related events.
The foregoing description is only an overview of the technical solutions of the present invention, and the embodiments of the present invention are described below in order to make the technical means of the present invention more clearly understood and to make the above and other objects, features, and advantages of the present invention more clearly understandable.
Drawings
The invention will be further described with reference to the following examples with reference to the accompanying drawings.
FIG. 1 is a flow chart of a method according to one embodiment of the present invention;
fig. 2 is a schematic structural diagram of a device according to a second embodiment of the present invention.
Detailed Description
The technical scheme in the embodiment of the application has the following general idea:
the proposal provides a method for mapping mechanism resources, which is characterized in that the core of the method is that the corresponding acquired resources are marked in a map after being processed according to the prior map function, and the specific processing method is as follows:
1. and (6) acquiring data.
The business system used by the research organization learns the data information in each system platform, classifies and combs all data by combining the business requirements of the organization, and simultaneously customizes a data table structure (table name, field type, field length and the like). The data comprises five resource types of a theme, a business, a case, equipment and key personnel;
2. and (6) data arrangement.
Data extraction: and finding data sources of each system platform according to the sorted five resource types, wherein the data sources may comprise a relational data source, a Kafka data source, a text data source and the like, selecting the data sources by using an ETL tool, setting data fields, defining a data interface, and formulating an extraction period to finish the extraction work of the data.
Data cleaning: the extracted data has more or less problems, such as missing information of the address field of the building, wrong identity card number of the data format and repeated user entry problems. According to the business rules, the filtering conditions of the data are set through an ETL tool, incomplete data, error data and repeated data are mainly processed (missing data can be supplemented, and data which cannot be supplemented can be deleted), and therefore the accuracy of the data is guaranteed.
Data conversion: after obtaining the correct data, it needs to be converted into service data. And setting data splitting, data merging and data association through an ETL tool, generating a corresponding data format according to a formulated data table structure, and simultaneously generating respective resource data primary keys. And binding the incidence relation of the resource data according to the main foreign key relation to realize data communication.
(example of data conversion-data generation: building data does not have address coding, and then needs to be associated with standard address to obtain, and the building information and the address coding information can be derived through the association of two tables, and the data is generated according to the structure of the data table.)
(example of data transformation-association relationship: because a cell and a building are in a one-to-many relationship, when data is generated, cell data has a cell main key, and building data has a building main key and a cell foreign key, the cell and the building can be bound through the main foreign key relationship, and all building information of the cell can be found.)
Loading data: and (4) sorting various resource data, and storing the data into an HBase database according to a data table structure.
3. And (4) spatializing data.
Data transmission to GeoMesa: the data of each system platform is cleaned through ETL, and the result data is stored in an HBase database. The SimpleFeatureType object is used to define various resource table structures, and this is created in DataStore as Schema. Reading the data of each data resource, converting the data into SimpleFeture space data of various resources, and storing the space data by calling a GeoMesa interface.
GeoMesa internal data processing: the GeoMesa carries out preprocessing on the transmitted data, and mainly comprises the operations of primary key processing, data format conversion, data fragment storage and the like of the Feature object. The indexing mechanism in GeoMesa extracts geographic information and time information of Feature data according to the Feature data, after the integrity of the data is determined, the parameters of longitude, latitude and time are subjected to data conversion to establish spatial index, and then a normaize method is called to format the time and spatial data and integrate the time and spatial data into a sequence. Geomesas will use the Kryo serialization mechanism to serialize and convert sequence data into a binary format suitable for Hbase storage. And finally calling an HBase API (application program interface), and writing the processed data into an HBase database.
4. And layering the data map.
Creating a data source: and (3) entering a working area management page by using a visual page of the GeoServer, and inputting a working area name and a name space URI (Uniform resource identifier) to create a working area. And establishing HBase data storage on a data storage management page of the working area, selecting HBase as a data source, filling a data source name and database connection configuration, and storing and generating resource data.
And (4) releasing the layer: and entering layer management on a visual page of the GeoServer, adding layers, selecting HBase data sources, and selecting different data tables for different layers according to different types of resource data. Entering a layer publishing page, configuring a coordinate reference system and setting a map frame, modifying a map style to generate a tile layer of the resource data, and clicking a publishing button to complete the publishing of the WMS service.
5. And (5) drawing the data.
And acquiring data of each resource data layer through WMS service issued by GeoServer. And configuring WMS service parameter information to complete the creation of the layer by adopting an OpenLayers front-end map framework, generating a map through an OpenLayers API, and rendering at the front end to complete the function of drawing on the resource. Through the control of the resource layer, the resource layer can be selectively displayed and hidden, and the resource data can be filtered by circle selection, frame selection and polygon selection, and peripheral resources, resource outlines, legend names and resource information can be displayed.
And (6) data retrieval.
And (3) synchronizing the HBase database data to an ElasticSearch database by adopting Java codes, and realizing the functions of searching, highlighting and counting various resource data through the ElasticSearch database. The front-end map queries an ElasticSearch database by calling a service API interface, retrieves various resource data by using a comprehensive query function, and knows the detailed information and the coordinate position of the resource. And by combining a map control tool, the functions of resource outline drawing, video playing and recording, vehicle track tracking, community personnel statistics and the like are realized, and the map data retrieval function is enriched.
And data penetration.
When the data is stored in the HBase database, the association relations of all resource data are bound, and an association hierarchy is formed (for example, the relation between a community and a cell is one-to-many, the relation between the community and a building is one-to-many, and the community can find the community from the community and the building from the community. The HBase database is accessed through Java codes, a query interface of a data association level is realized according to the association relation of each resource data, a front-end page queries data through calling a service API (application program interface), and the data penetration effect is realized from communities, buildings, houses, people and vehicles to regions and cases according to the data association level. For example, the community information display can be used for viewing the number of communities, the statistics of personnel and vehicles and the incidence rate of cases, displaying the overall overview of the community at a macroscopic viewing angle, and refining the specific information of each person and each vehicle by using a microscopic viewing angle.
And (6) analyzing the data.
And accessing an HBase database through Java codes, returning the GeoJson data of provinces, city and counties to a front-end page through a service API, generating polygonal graphs from the data of each region through an OpenLayers API, and rendering on a map to finish region outline drawing.
The ElasticSearch database stores the statistical data of each region, accesses the ElasticSearch database through Java codes, returns the data to a front-end page through a service API, and displays the statistical data and statistical reports of personnel, houses, units, cases and key personnel in each region by clicking the name of the region.
Example one
As shown in fig. 1, the present embodiment provides a method for mechanism resource mapping, including:
step 1, arranging and classifying the data of the mechanism according to a set rule;
step 2, data extraction: finding the data source of each system platform according to the sorted classification, selecting the data source by adopting an ETL tool, setting a data field, defining a data interface, and formulating an extraction cycle to finish the extraction work of the data;
data cleaning: setting a filtering condition of the data through an ETL tool according to a business rule, and cleaning the data;
data conversion: setting data splitting, data merging and data association through an ETL tool, generating corresponding data formats according to a set data table structure, simultaneously generating respective resource data main keys, and binding the association relation of the resource data according to the main key relation;
loading data: sorting various resource data, and storing the data into an HBase database according to a data table structure;
step 3, the processed data are sent to GeoMesa, the GeoMesa carries out preprocessing on the transmitted data, an index mechanism in the GeoMesa extracts geographic information and time information of the GeoMesa according to Feature data, after the integrity of the data is determined, parameters of longitude and latitude and time are subjected to data conversion to establish spatial index, then a normalize method is called to format the time and spatial data, and the time and spatial data are integrated into sequence data; the GeoMesa utilizes a Kryo serialization mechanism to serialize sequence data and convert the sequence data into a binary format suitable for Hbase storage;
connecting an HBase database by using Java codes, and connecting a GeoMesa cluster by using a GeoMesa interface to create a DataStore object, wherein the DataStore object provides an interface for GeoMesa specified directory operation; defining various resource table structures by using a SimpleFeatureType object, and creating the resource table structures into Schema in the DataStore; reading data of each data resource, converting the data into SimpleFeture spatial data of various resources, and storing the spatial data into an HBase database by calling a GeoMesa interface;
step 4, creating a data source: using a visual page of the GeoServer, entering a working area management page, inputting a working area name and a name space URI (Uniform resource identifier) to create a working area, newly creating HBase data storage in the data storage management page of the working area, selecting the HBase as a data source, filling a data source name and database connection configuration, and storing and generating resource data;
and (4) releasing the layer: layer management is carried out on a visual page of the GeoServer, layers are added to select HBase data sources, and different layers select different data tables according to different types of resource data; entering a layer release page, configuring a coordinate reference system and setting of a map frame, and modifying a map style to generate a tile layer of the resource data;
and 5, configuring WMS service parameter information to complete layer creation by adopting an OpenLayers front-end map framework, generating a map through an OpenLayers API, and rendering at the front end to complete resource map creation.
Based on the same inventive concept, the application also provides a device corresponding to the method in the first embodiment, which is detailed in the second embodiment.
Example two
As shown in fig. 2, in this embodiment, an apparatus for mechanism resource mapping is provided, including:
the data classification module is used for sorting and classifying the data of the mechanism according to a set rule;
the data processing module is used for extracting data: finding the data source of each system platform according to the sorted classification, selecting the data source by adopting an ETL tool, setting a data field, defining a data interface, and formulating an extraction cycle to finish the extraction work of the data;
data cleaning: setting a filtering condition of the data through an ETL tool according to a business rule, and cleaning the data;
data conversion: setting data splitting, data merging and data association through an ETL tool, generating corresponding data formats according to a set data table structure, simultaneously generating respective resource data main keys, and binding the association relation of the resource data according to the main key relation;
loading data: sorting various resource data, and storing the data into an HBase database according to a data table structure;
the space data module is used for sending processed data to GeoMesa, the GeoMesa carries out preprocessing on the sent data, an index mechanism in the GeoMesa extracts geographic information and time information of the GeoMesa according to Feature data, after the integrity of the data is determined, parameters of longitude and latitude and time are subjected to data conversion to establish space index, and then a normalize method is called to format the time and space data and integrate the time and space data into sequence data; the GeoMesa utilizes a Kryo serialization mechanism to serialize sequence data and convert the sequence data into a binary format suitable for Hbase storage;
connecting an HBase database by using Java codes, and connecting a GeoMesa cluster by using a GeoMesa interface to create a DataStore object, wherein the DataStore object provides an interface for GeoMesa specified directory operation; defining various resource table structures by using a SimpleFeatureType object, and creating the resource table structures into Schema in the DataStore; reading data of each data resource, converting the data into SimpleFeture spatial data of various resources, and storing the spatial data into an HBase database by calling a GeoMesa interface;
the layer data module is used for creating a data source: using a visual page of the GeoServer, entering a working area management page, inputting a working area name and a name space URI (Uniform resource identifier) to create a working area, newly creating HBase data storage in the data storage management page of the working area, selecting the HBase as a data source, filling a data source name and database connection configuration, and storing and generating resource data;
and (4) releasing the layer: layer management is carried out on a visual page of the GeoServer, layers are added to select HBase data sources, and different layers select different data tables according to different types of resource data; entering a layer release page, configuring a coordinate reference system and setting of a map frame, and modifying a map style to generate a tile layer of the resource data;
and the map loading module is used for configuring WMS service parameter information to complete the creation of the map layer by adopting an OpenLayers front-end map framework, generating a map through an OpenLayers API and rendering the map at the front end to complete the resource map loading.
Since the apparatus described in the second embodiment of the present invention is an apparatus used for implementing the method of the first embodiment of the present invention, based on the method described in the first embodiment of the present invention, a person skilled in the art can understand the specific structure and the deformation of the apparatus, and thus the details are not described herein. All the devices adopted in the method of the first embodiment of the present invention belong to the protection scope of the present invention.
Although specific embodiments of the invention have been described above, it will be understood by those skilled in the art that the specific embodiments described are illustrative only and are not limiting upon the scope of the invention, and that equivalent modifications and variations can be made by those skilled in the art without departing from the spirit of the invention, which is to be limited only by the appended claims.
Claims (10)
1. A method for mapping a mechanism resource, comprising: the method comprises the following steps:
step 1, arranging and classifying the data of the mechanism according to a set rule;
step 2, performing data extraction, data cleaning, data conversion and data loading on the classified data;
step 3, sending the processed data to GeoMesa for processing to obtain spatial data;
step 4, stratifying the spatial data to obtain layer data;
and 5, carrying out the upper graph on the graph layer data.
2. A method for mapping on a fabric resource according to claim 1, wherein: the step 2 is further specifically as follows:
data extraction: finding the data source of each system platform according to the sorted classification, selecting the data source by adopting an ETL tool, setting a data field, defining a data interface, and formulating an extraction cycle to finish the extraction work of the data;
data cleaning: setting a filtering condition of the data through an ETL tool according to a business rule, and cleaning the data;
data conversion: setting data splitting, data merging and data association through an ETL tool, generating corresponding data formats according to a set data table structure, simultaneously generating respective resource data main keys, and binding the association relation of the resource data according to the main key relation;
loading data: and (4) sorting various resource data, and storing the data into an HBase database according to a data table structure.
3. A method for mapping on a fabric resource according to claim 1, wherein: the step 3 is further specifically as follows:
the processed data are sent to GeoMesa, the GeoMesa carries out preprocessing on the transmitted data, an index mechanism in the GeoMesa extracts geographic information and time information of the GeoMesa according to Feature data, after the integrity of the data is determined, parameters of longitude and latitude and time are subjected to data conversion to establish a spatial index, and then a normaize method is called to format the time and spatial data and integrate the time and spatial data into sequence data; the GeoMesa utilizes a Kryo serialization mechanism to serialize sequence data and convert the sequence data into a binary format suitable for Hbase storage;
connecting an HBase database by using Java codes, and connecting a GeoMesa cluster by using a GeoMesa interface to create a DataStore object, wherein the DataStore object provides an interface for GeoMesa specified directory operation; defining various resource table structures by using a SimpleFeatureType object, and creating the resource table structures into Schema in the DataStore; reading the data of each data resource, converting the data into SimpleFeture spatial data of various resources, and storing the spatial data into an HBase database by calling a GeoMesa interface.
4. A method for mapping on a fabric resource according to claim 1, wherein: the step 4 is further specifically as follows:
creating a data source: using a visual page of the GeoServer, entering a working area management page, inputting a working area name and a name space URI (Uniform resource identifier) to create a working area, newly creating HBase data storage in the data storage management page of the working area, selecting the HBase as a data source, filling a data source name and database connection configuration, and storing and generating resource data;
and (4) releasing the layer: layer management is carried out on a visual page of the GeoServer, layers are added to select HBase data sources, and different layers select different data tables according to different types of resource data; and entering a layer release page, configuring a coordinate reference system and the setting of a map frame, and modifying the map style to generate a tile layer of the resource data.
5. A method for mapping on a fabric resource according to claim 1, wherein: the step 5 is further specifically as follows:
and configuring WMS service parameter information to complete the creation of the layer by adopting an OpenLayers front-end map framework, generating a map through an OpenLayers API, and rendering at the front end to complete the resource map application.
6. An apparatus for mapping on a facility resource, comprising: the method comprises the following steps:
the data classification module is used for sorting and classifying the data of the mechanism according to a set rule;
the data processing module is used for performing data extraction, data cleaning, data conversion and data loading on the classified data;
the spatial data module is used for sending the processed data to the GeoMesa for processing to obtain spatial data;
the layer data module is used for layering the spatial data to obtain layer data;
and the drawing module is used for drawing the drawing data.
7. The apparatus of a mechanism resource map-on-board of claim 6, wherein: the data processing module is further specifically:
data extraction: finding the data source of each system platform according to the sorted classification, selecting the data source by adopting an ETL tool, setting a data field, defining a data interface, and formulating an extraction cycle to finish the extraction work of the data;
data cleaning: setting a filtering condition of the data through an ETL tool according to a business rule, and cleaning the data;
data conversion: setting data splitting, data merging and data association through an ETL tool, generating corresponding data formats according to a set data table structure, simultaneously generating respective resource data main keys, and binding the association relation of the resource data according to the main key relation;
loading data: and (4) sorting various resource data, and storing the data into an HBase database according to a data table structure.
8. The apparatus of a mechanism resource map-on-board of claim 6, wherein: the spatial data module is further specifically:
the processed data are sent to GeoMesa, the GeoMesa carries out preprocessing on the transmitted data, an index mechanism in the GeoMesa extracts geographic information and time information of the GeoMesa according to Feature data, after the integrity of the data is determined, parameters of longitude and latitude and time are subjected to data conversion to establish a spatial index, and then a normaize method is called to format the time and spatial data and integrate the time and spatial data into sequence data; the GeoMesa utilizes a Kryo serialization mechanism to serialize sequence data and convert the sequence data into a binary format suitable for Hbase storage;
connecting an HBase database by using Java codes, and connecting a GeoMesa cluster by using a GeoMesa interface to create a DataStore object, wherein the DataStore object provides an interface for GeoMesa specified directory operation; defining various resource table structures by using a SimpleFeatureType object, and creating the resource table structures into Schema in the DataStore; reading the data of each data resource, converting the data into SimpleFeture spatial data of various resources, and storing the spatial data into an HBase database by calling a GeoMesa interface.
9. The apparatus of a mechanism resource map-on-board of claim 6, wherein: the layer data module further specifically comprises:
creating a data source: using a visual page of the GeoServer, entering a working area management page, inputting a working area name and a name space URI (Uniform resource identifier) to create a working area, newly creating HBase data storage in the data storage management page of the working area, selecting the HBase as a data source, filling a data source name and database connection configuration, and storing and generating resource data;
and (4) releasing the layer: layer management is carried out on a visual page of the GeoServer, layers are added to select HBase data sources, and different layers select different data tables according to different types of resource data; and entering a layer release page, configuring a coordinate reference system and the setting of a map frame, and modifying the map style to generate a tile layer of the resource data.
10. The apparatus of a mechanism resource map-on-board of claim 6, wherein: the drawing module further comprises:
and configuring WMS service parameter information to complete the creation of the layer by adopting an OpenLayers front-end map framework, generating a map through an OpenLayers API, and rendering at the front end to complete the resource map application.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111466497.2A CN114238531A (en) | 2021-12-03 | 2021-12-03 | Method and device for drawing mechanism resources |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111466497.2A CN114238531A (en) | 2021-12-03 | 2021-12-03 | Method and device for drawing mechanism resources |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114238531A true CN114238531A (en) | 2022-03-25 |
Family
ID=80752880
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111466497.2A Pending CN114238531A (en) | 2021-12-03 | 2021-12-03 | Method and device for drawing mechanism resources |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114238531A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115249409A (en) * | 2022-09-20 | 2022-10-28 | 深圳市城市交通规划设计研究中心股份有限公司 | System, method and equipment for monitoring key vehicle driving into forbidden area and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106611046A (en) * | 2016-12-16 | 2017-05-03 | 武汉中地数码科技有限公司 | Big data technology-based space data storage processing middleware framework |
| CN109829022A (en) * | 2019-01-08 | 2019-05-31 | 桂林电子科技大学 | A kind of the Internet map service system and construction method of fusion monitoring video information |
-
2021
- 2021-12-03 CN CN202111466497.2A patent/CN114238531A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106611046A (en) * | 2016-12-16 | 2017-05-03 | 武汉中地数码科技有限公司 | Big data technology-based space data storage processing middleware framework |
| CN109829022A (en) * | 2019-01-08 | 2019-05-31 | 桂林电子科技大学 | A kind of the Internet map service system and construction method of fusion monitoring video information |
Non-Patent Citations (1)
| Title |
|---|
| 邱程: "基于分布式存储的地理时空大数据管理系统研究", 《中国优秀硕士学位论文全文数据库》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115249409A (en) * | 2022-09-20 | 2022-10-28 | 深圳市城市交通规划设计研究中心股份有限公司 | System, method and equipment for monitoring key vehicle driving into forbidden area and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112115198B (en) | Urban remote sensing intelligent service platform | |
| Abel et al. | Spatial join strategies in distributed spatial DBMS | |
| CN105162627B (en) | It was found that the method and system with presentation network application access information | |
| CN110807015A (en) | Big data asset value delivery management method and system | |
| CN104216895A (en) | Method and device for generating POI data | |
| CN109254901B (en) | A kind of Monitoring Indexes method and system | |
| US20200334314A1 (en) | Emergency disposal support system | |
| CN111309741A (en) | Handheld natural resource management system and method based on GIS | |
| CN114417802B (en) | Intelligent report generation system | |
| CN111563200A (en) | Information display method, device, equipment and medium | |
| CN112148708A (en) | Power grid planning-oriented visual application system | |
| CN108268445A (en) | A kind of method and device for handling address information | |
| CN111125284A (en) | Integrated space-time big data and geographic information public service cloud platform | |
| CN116842255A (en) | Accident data management method, visualization system and display method based on metallurgical industry | |
| CN114238531A (en) | Method and device for drawing mechanism resources | |
| Nurnawati et al. | Design of integrated database on mobile information system: a study of Yogyakarta smart city app | |
| CN117455379A (en) | Basic intelligent management system and method | |
| CN111382165A (en) | Mobile homeland management system | |
| CN116028467A (en) | Intelligent service big data modeling method, system, storage medium and computer equipment | |
| CN110019237A (en) | A kind of system and method based on cartographic analysis criminal's whereabouts | |
| CN115098610A (en) | Block data management system | |
| CN110795449A (en) | BS architecture-based environment-friendly public opinion system | |
| CN111414492A (en) | Knowledge network construction method and system | |
| CN115269500B (en) | Ecological environment data storage method, ecological environment data retrieval method and electronic equipment | |
| Hansen et al. | A GIS-based methodology for exporting the Hazards US (HAZUS) earthquake model for global applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220808 Address after: 100084 No. 1 Tsinghua Yuan, Beijing, Haidian District Applicant after: TSINGHUA University Applicant after: LINEWELL SOFTWARE Co.,Ltd. Address before: 362000 16 / F, building 2, Nanwei building, Fenghai Road, Fengze District, Quanzhou City, Fujian Province Applicant before: LINEWELL SOFTWARE Co.,Ltd. |
|
| TA01 | Transfer of patent application right | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20220325 |
|
| WD01 | Invention patent application deemed withdrawn after publication |