CN108628895B - Map data processing method and device - Google Patents
Map data processing method and device Download PDFInfo
- Publication number
- CN108628895B CN108628895B CN201710170673.5A CN201710170673A CN108628895B CN 108628895 B CN108628895 B CN 108628895B CN 201710170673 A CN201710170673 A CN 201710170673A CN 108628895 B CN108628895 B CN 108628895B
- Authority
- CN
- China
- Prior art keywords
- data
- plug
- information point
- information
- processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a method and a device for processing map data, wherein the method comprises the following steps: when information point original data about a map are received, calling each plugin in a preset target plugin set to process the information point original data respectively, wherein the target plugin set comprises at least two plugins which are configured based on processing requirements and used for processing the information point original data; combining and processing each data processed by each plug-in unit on the original data of the information points to obtain updated data of the information points; and updating the associated data of the map according to the information point updating data. By adopting the method and the device, the original data of the information points can be processed as required, so that the updating processing of data such as a navigation map and the like can be completed more efficiently.
Description
Technical Field
The invention relates to the technical field of computer application, in particular to a method and a device for processing map data.
Background
POI (Point of Information) data may be understood as Information Point data, each POI data may contain a plurality of elements, which may for example include elements of name, category, latitude and longitude, nearby hotel, restaurant, shop, etc. The POI data may be considered as basic data of the entire navigation map.
POI data may be obtained from 30 or more data sources. There may be situations where POI data received from other sources is unavailable or less useful information due to inconsistent data quality and attributes of each source, adversely affecting the updating of the map.
Disclosure of Invention
The embodiment of the invention provides a method and a device for processing map data, which can process POI (point of interest) original data through a plug-in to obtain updated data meeting the map updating requirement.
In order to solve the foregoing technical problem, an embodiment of the present invention provides a method for processing map data, including:
when information point original data about a map are received, calling each plugin in a preset target plugin set to process the information point original data respectively, wherein the target plugin set comprises at least two plugins used for processing the information point original data;
combining and processing each data processed by each plug-in unit on the original data of the information points to obtain updated data of the information points;
and updating the associated data of the map according to the information point updating data.
Optionally, the method further includes: configuring a plurality of plug-ins; the configured plug-in includes: the system comprises a standard plug-in used for carrying out information standard processing on the original data of the information point, a filtering plug-in used for carrying out filtering processing on the original data of the information point and/or a completion plug-in used for performing completion processing on the original data of the information point.
Optionally, the invoking each plugin in a preset target plugin set to process the information point original data respectively includes:
calling a standard plug-in a preset target plug-in set to carry out standard processing on the original data of the information point;
wherein the specification processing includes: and modifying and updating the original classification information in the original data of the information points into standard classification information set for the original classification information in the mapping rules according to the mapping rules configured by the standard plug-in.
Optionally, the invoking each plugin in a preset target plugin set to process the information point original data respectively includes:
calling a completion plug-in a preset target plug-in set to perform completion processing on the original data of the information point;
wherein the completion processing comprises: analyzing elements recorded in the original data of the information points, determining target elements according to preset element requirements, and complementing content data corresponding to the target elements, wherein the target elements refer to necessary elements recorded in the element requirements, and the content data of the elements does not exist in the original data of the information points.
Optionally, the complemented content data includes any one or more of the following data:
completing address data of the address elements based on address segmentation service; completing the location description data of the location description element based on the location description service; complementing the name data of the name elements based on the role marking service; and completing result data of whether the chain store element is the chain store or not based on the chain store service.
Optionally, the invoking each plugin in a preset target plugin set to process the information point original data respectively includes:
calling a filter plug-in a preset target plug-in set to filter the original data of the information point;
wherein the filtering process comprises: and judging the original data of the information points according to the filtering rules configured in the filtering plug-in, and filtering and deleting the original data of the information points which do not accord with the regulation of the filtering rules.
Optionally, the method further includes:
outputting a configuration interface based on the plug-in, and receiving configuration information input on the configuration interface;
and updating the configuration file for the corresponding plug-in according to the configuration information, and loading the updated configuration file for the corresponding plug-in.
Correspondingly, an embodiment of the present invention further provides a processing apparatus for map data, including:
the system comprises a calling module, a processing module and a processing module, wherein the calling module is used for calling each plugin in a preset target plugin set to process original data of an information point when the original data of the information point about a map is received, and the target plugin set comprises at least two plugins for processing the original data of the information point;
the processing module is used for combining and processing each data processed by each plug-in to the original data of the information point to obtain updated data of the information point;
and the updating module is used for updating the associated data of the map according to the information point updating data.
Optionally, the apparatus further comprises: a configuration module for configuring a plurality of plug-ins; the configured plug-in includes: the system comprises a specification plug-in used for carrying out information specification processing on the original data of the information point, a filtering plug-in used for carrying out filtering processing on the original data, and/or a completion plug-in used for completing the original data of the information point.
Optionally, the calling module is specifically configured to call a canonical plug-in a preset target plug-in set to perform canonical processing on the information point original data; wherein the specification processing includes: and modifying and updating the original classification information in the original data of the information points into standard classification information set for the original classification information in the mapping rules according to the mapping rules configured by the standard plug-in.
Optionally, the calling module is specifically configured to call a completion plug-in a preset target plug-in set to perform completion processing on the information point original data; wherein the completion processing comprises: analyzing elements recorded in the original data of the information points, determining target elements according to preset element requirements, and complementing content data corresponding to the target elements, wherein the target elements refer to necessary elements recorded in the element requirements, and the content data of the elements does not exist in the original data of the information points.
Optionally, the complemented content data includes any one or more of the following data:
completing address data of the address elements based on address segmentation service; completing the location description data of the location description element based on the location description service; complementing the name data of the name elements based on the role marking service; and (4) result data of whether the chain store element is a chain store is supplemented based on the chain store service.
Optionally, the calling module is specifically configured to call a filter plug-in a preset target plug-in set to filter the information point original data; wherein the filtering process comprises: and judging the original data of the information points according to the filtering rules configured in the filtering plug-in, and filtering and deleting the original data of the information points which do not accord with the rules of the filtering.
Optionally, the configuration module is further configured to output a configuration interface based on the plug-in, and receive configuration information entered on the configuration interface; and updating the configuration file for the corresponding plug-in according to the configuration information, and loading the updated configuration file for the corresponding plug-in.
According to the embodiment of the invention, for the input information point data of various sources, two or more plug-ins preset according to requirements can be called to preprocess the information point data to obtain the desired information point updating data, so that the map updating requirement is met, useless information point data is reduced well, and the map updating efficiency is improved.
Drawings
FIG. 1 is a schematic diagram of a system for processing map data according to an embodiment of the present invention;
FIG. 2 is a flow chart illustrating a method for processing map data according to an embodiment of the present invention;
FIG. 3 is a flow chart illustrating another method for processing map data according to an embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a processing apparatus for map data according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a server according to an embodiment of the present invention.
Detailed Description
According to the embodiment of the invention, a large number of various types of plug-ins can be configured, each piece of POI data is processed through the various types of plug-ins aiming at a large number of POI original data from different sources, and classification specification processing, filtering processing, information completion processing and the like can be executed respectively. And based on the property of the plug-ins, a user interface related to the plug-ins can be provided for a user, so that the user can configure the user interface, update the configuration files of the plug-ins based on the configuration and load the corresponding configuration files for the plug-ins. Due to the fact that coordination processing can be conducted through a large number of plug-ins, processing efficiency of POI original data of different sources can be improved, and due to the fact that a configuration interface is provided for a user to configure the plug-ins, efficiency of updating requirements is further improved.
In one embodiment, the classification specification process may specify various information point raw data classified based on different classification rules to obtain a certain classification category desired by a user. The desired classification category may be determined by a user by configuring the classification rules of the classification specification plug-in, i.e., mapping a plurality of different classification categories to a standard classification category. This mapping may be a many-to-one process, for example, the classification of hotel guesthouses and hotel guests in the raw data needs to be mapped to hotel guesthouses: other hotels; the categories of the raw data, such as the zhejiang vegetables, hang bang/jiangzhe vegetables, jiang zhe vegetables, jing/jiangzhe vegetables and ningbo jiangzhe vegetables, are mapped as foods: a Chinese restaurant; mapping the classified home building materials and furniture in the original data into shopping: furniture and household building materials.
In one embodiment, the filtering process may perform filtering process on the information point raw data, where the information point raw data includes a plurality of elements, and generally includes at least: address elements, name elements, longitude and latitude elements, category elements, and the like. When the filtering plug-in filters the information point original data based on the filtering rule, the information point original data without the elements such as name, address, longitude and latitude and the like can be directly filtered out, so that the information point original data with complete information can be processed by other subsequent plug-ins. In one embodiment, the information point update data that is finally merged after being processed by other plug-ins may also be filtered. The complementing plugins for information complementing are stored in the embodiment of the invention, the names, the addresses and the like can be complemented for some original data of information points for information complementing, and if the elements such as the names, the addresses and the like cannot be obtained through the processing of the complementing plugins, the data can be filtered out through the filtering plugins.
In one embodiment, the completion processing is mainly based on the recording requirement, the original data of the information points missing the necessary elements in the recording requirement is supplemented, corresponding data is obtained through calculation based on address segmentation service, position description service, role marking service, chain store service and the like, and the content data of the necessary elements is supplemented in the original data of the information points. For example, analyzing original data of an information point, determining that the information point lacks a necessary element address required by a recording requirement, calculating data such as a name or longitude and latitude coordinates corresponding to the original data of the information point based on an address splitting service to search address information of a position corresponding to the original data of the information point, wherein the address information mainly refers to information such as XX streets.
Specifically, as shown in fig. 1, the system is a schematic structural diagram of a system for processing map data according to an embodiment of the present invention, in which a data classification module receives, through a real-time service interface, raw POI data from different sources, where the raw POI data may originate from servers of different map data providers or from some government agency servers for providing map services. The data grading module sends the received POI data to plug-ins in the distributed system respectively, and in the embodiment of the invention, the plug-ins comprise an address segmentation plug-in, a position description plug-in, a role marking plug-in, a classification mapping plug-in and a chain store plug-in. After receiving the POI original data, the plug-ins respectively carry out corresponding classification mapping standard processing, address completion processing, position description completion processing, role name completion processing, chain store completion processing and the like, respectively process the POI preliminary update data and send the POI preliminary update data to the data grading processing module. For some cases where the plug-in processing is unsuccessful, such as where the address splitting plug-in does not find the corresponding address and does not complete completion processing of the address, then no data may be returned or the raw data of the POI may be returned to the data rating module as the initial update data of the POI.
And after receiving the POI preliminary update data, the data grading module performs combined processing on the POI preliminary update data. In one embodiment, the data ranking module may combine the plug-ins returning the preliminary POI update data in a targeted manner, for example, if the preliminary POI update data is returned by the address splitting plug-in, only data content corresponding to elements related to the address in the preliminary POI update data is extracted, if the preliminary POI update data is returned by the location description plug-in, content data corresponding to location description elements in the preliminary POI update data is extracted, and so on, to obtain content data corresponding to each element, and then generate POI update data in a preset format based on each content data.
After the POI update data are obtained, the data grading module stores the obtained POI update data in the corresponding storage area.
After the POI update data is obtained and stored, when the map needs to be updated, the corresponding point can be updated and displayed at the corresponding longitude and latitude position based on each element in the POI update data, the corresponding name and information such as whether the chain store exists can be displayed at the point on the map, and the user can be responded to the retrieval of the map based on the stored information point update data, for example, when the user is in a restaurant during the retrieval, the corresponding POI update data can be found and displayed to the user at the corresponding longitude and latitude position.
Specifically, please refer to fig. 2, which is a flowchart illustrating a method for processing map data according to an embodiment of the present invention, where the method according to the embodiment of the present invention may be applied to a distributed cluster service system, for example, a hadoop distributed cluster service system, and the method may specifically include the following steps.
S201: when information point original data about a map are received, calling each plugin in a preset target plugin set to process the information point original data respectively, wherein the target plugin set comprises at least two plugins configured based on processing requirements and used for processing the information point original data. The processing requirement may be a requirement of the user, such as the corresponding filtering requirement, completion requirement, specification requirement, etc. mentioned above.
The target plug-in set may be a set of all plug-ins set in the system, or may be a set composed of a part of plug-ins selected in the system. At least two plug-ins in the target plug-in set respectively execute different processing. For example, any two or more of a specification plug-in for performing information specification processing on the information point original data, a filtering plug-in for performing filtering processing on the original data, and a completion plug-in for performing completion processing on the information point original data are included.
In one embodiment, the specification plug-in refers to a class plug-in, and the specification plug-in may specifically be a plug-in for classification specification processing, which may map various different classification categories into a classification category; the specification plug-in may also be a plug-in for address specification processing, unifying various address categories into one standard address category, for example, adjusting some addresses accurate to the street number to record only to the street.
In one embodiment, the completion plug-in refers to a type of plug-in, and the completion plug-in may specifically be a plug-in for completing an address, a plug-in for completing a name, a plug-in for completing a location description, a plug-in for completing whether a chain store is present, or not, and the like. The plugin of the supplement address is mainly an address of latitude and longitude coordinates corresponding to the original data of the supplement information point, and the plugin of the supplement location description mainly refers to possible description of the location, for example, the location description information is description about the location beside a city government building.
In other embodiments, before the S201, the following steps may be performed: sending POI original data to a filtering plug-in, and calling a filtering plug-in a preset target plug-in set to filter the information point original data; wherein the filtering process comprises: and judging the original data of the information points according to the filtering rules configured in the filtering plug-in, filtering and deleting the original data of the information points which do not accord with the rules of the filtering, and continuously processing the new original data of the POI. If the POI raw data is not filtered, the filtering plug-in returns the POI raw data, and then the S201 is executed. In one embodiment, the filtering plug-in may also return the POI data with element filtering on the original data of the POI to obtain the POI data with some unnecessary elements deleted. For example, if the POI raw data input by the user without the location description element includes the location description element, the filtering module may delete the content data of the location description element and return the POI data not including the data description element, so as to perform the S201 more quickly.
S202: and combining and processing each data processed by each plug-in unit on the original data of the information points to obtain updated data of the information points. Corresponding content data can be extracted based on the category of the plug-in returning corresponding data, a piece of POI updating data is formed based on each extracted content data, for example, if the POI updating data is the POI initial updating data returned by the address segmentation plug-in, only the data content corresponding to the element related to the address in the POI updating data is extracted, if the POI updating data is the POI initial updating data returned by the position description plug-in, the content data corresponding to the position description element in the POI updating data is extracted, and so on, the content data corresponding to each element is obtained, and then the POI updating data in the preset format is generated based on each content data.
In other embodiments, after S202, the obtained information point update data may be further transmitted to a filtering plug-in, and the filtering plug-in performs filtering processing on the information point original data; wherein the filtering process comprises: and judging the information point updating data according to the filtering rules configured in the filtering plug-in, and filtering and deleting the information point updating data which does not accord with the rules of the filtering.
S203: and updating the associated data of the map according to the information point updating data. S203 is specifically to update data in a memory for storing data of a corresponding map, for example, the above-mentioned memories such as base, hive, and Dcache.
According to the embodiment of the invention, for the input information point data of various sources, two or more plug-ins preset according to requirements can be called to preprocess the information point data to obtain the required information point updating data, so that the map updating requirement is met, useless information point data is reduced better, and the map updating efficiency is improved.
Referring to fig. 3 again, the method is a schematic flow chart of another map data processing method according to an embodiment of the present invention, and the method according to the embodiment of the present invention may be applied to a distributed cluster service system, for example, a hadoop distributed cluster service system, and the method may specifically include the following steps.
S301: configuring a plurality of plug-ins; the configured plug-in includes: the system comprises a specification plug-in used for carrying out information specification processing on the original data of the information point, a filtering plug-in used for carrying out filtering processing on the original data, and/or a completion plug-in used for carrying out completion processing on the original data of the information point. The process of configuring a plurality of plug-ins may include the generation and subsequent updating of the plug-ins.
In one embodiment, a subsequent update process of the plug-in may include: outputting a configuration interface based on the plug-in, and receiving configuration information input on the configuration interface; and updating the configuration file for the corresponding plug-in according to the configuration information, and loading the updated configuration file for the corresponding plug-in. The user can enter corresponding information on the configuration interface to obtain an updated configuration file, for example, enter a standard classification category and the like, so as to configure the canonical plug-in, and map the classification category in the POI original data to the standard classification category by the canonical plug-in based on a new mapping relationship.
S302: receiving information point raw data about a map;
s303: calling a standard plug-in a preset target plug-in set to carry out standard processing on the original data of the information point; wherein the specification processing includes: and modifying and updating the original classification information in the original data of the information points into standard classification information set for the original classification information in the mapping rules according to the mapping rules configured by the standard plug-in.
S304: and calling a completion plug-in a preset target plug-in set to perform completion processing on the original data of the information point. The completion process of S304 may be implemented in various ways. In an embodiment, the information point original data may be directly sent to all completion plug-ins, and the completion plug-ins analyze the POI original data, determine whether the corresponding element has specific content data, if so, directly return the POI original data, if not, perform corresponding calculation to obtain corresponding content data, for example, if an address element in the POI original data does not have corresponding content data, the address segmentation plug-in may search for and determine an address based on the content data of the longitude and latitude element in the POI original data, and supplement the address element in the POI original data.
In another embodiment, the completion process includes: analyzing elements recorded in the original data of the information points, determining target elements according to preset element requirements, and completing the content data corresponding to the target elements, wherein the target elements refer to necessary elements recorded in the element requirements, and the elements of the content data of the elements do not exist in the original data of the information points. The complemented content data comprises any one or more of the following: completing address data of the address elements based on an address splitting service; completing the position description data of the position description element based on the position description service; complementing the name data of the name elements based on the role marking service; and (4) result data of whether the chain store element is a chain store is supplemented based on the chain store service. That is, a completion plug-in that first parses the POI original data, determines specific content data of each element, determines an element that is a necessary element but does not have specific content data as a target element, and supplements the target element with corresponding content data may perform completion processing such as address, name, location description, and the like.
S305: combining and processing each data processed by the information point original data by each plug-in to obtain information point update data;
s306: and updating the associated data of the map according to the information point updating data.
According to the embodiment of the invention, for the input information point data of various sources, two or more plug-ins preset according to requirements can be called to preprocess the information point data to obtain the desired information point updating data, so that the map updating requirement is met, useless information point data is reduced well, and the map updating efficiency is improved.
The following describes in detail a processing apparatus and a server for map data according to an embodiment of the present invention.
Referring to fig. 4, a schematic structural diagram of a processing apparatus for map data according to an embodiment of the present invention is shown, where the apparatus according to the embodiment of the present invention may be disposed in a server, and specifically, the apparatus includes the following modules.
The system comprises a calling module 401, a processing module and a processing module, wherein the calling module 401 is used for calling each plug-in a preset target plug-in set to process the information point original data when the information point original data about the map is received, and the target plug-in set comprises at least two plug-ins for processing the information point original data; a processing module 402, configured to combine the data obtained by processing the information point original data by each plug-in to obtain information point update data; an updating module 403, configured to update the associated data of the map according to the information point update data.
In one embodiment, the apparatus may further include: a configuration module 404 for configuring a plurality of plug-ins; the configured plug-in includes: the system comprises a specification plug-in used for carrying out information specification processing on the original data of the information point, a filtering plug-in used for carrying out filtering processing on the original data, and/or a completion plug-in used for carrying out completion processing on the original data of the information point.
In an embodiment, the invoking module 401 is specifically configured to invoke a canonical plug-in a preset target plug-in set to perform canonical processing on the information point original data; wherein the specification processing includes: and according to a mapping rule configured in a specification plug-in, modifying and updating original classification information in the information point original data into standard classification information set for the original classification information in the mapping rule.
In an embodiment, the invoking module 401 is specifically configured to invoke a completion plug-in a preset target plug-in set to perform completion processing on the information point original data; wherein the completion processing comprises: analyzing elements recorded in the original data of the information points, determining target elements according to preset element requirements, and completing the content data corresponding to the target elements, wherein the target elements refer to necessary elements recorded in the element requirements, and the elements of the content data of the elements do not exist in the original data of the information points.
In one embodiment, the complemented content data comprises any one or more of the following:
completing address data of the address elements based on address segmentation service; completing the location description data of the location description element based on the location description service; complementing the name data of the name elements based on the role marking service; and (4) result data of whether the chain store element is a chain store is supplemented based on the chain store service.
In an embodiment, the invoking module 401 is specifically configured to invoke a filter plug-in a preset target plug-in set to perform filtering processing on the original data of the information point; wherein the filtering process comprises: and judging the original data of the information points according to the filtering rules configured in the filtering plug-in, and filtering and deleting the original data of the information points which do not accord with the rules of the filtering.
In one embodiment, the configuration module 404 is further configured to output a configuration interface based on the plug-in, and receive configuration information entered on the configuration interface; and updating the configuration file for the corresponding plug-in according to the configuration information, and loading the updated configuration file for the corresponding plug-in.
For specific implementation of each module of the apparatus according to the embodiment of the present invention, reference may be made to the description of related content or steps in each embodiment, which is not described herein again.
According to the embodiment of the invention, for the input information point data of various sources, two or more plug-ins preset according to requirements can be called to preprocess the information point data to obtain the desired information point updating data, so that the map updating requirement is met, useless information point data is reduced well, and the map updating efficiency is improved.
Referring to fig. 5, it is a schematic structural diagram of a server according to an embodiment of the present invention, where the server according to the embodiment of the present invention may include structures such as a power supply module, a heat dissipation module, and a rack as needed, and the embodiment of the present invention further includes a communication interface 501, a processor 502, and a memory 503. The communication interface 501, the processor 502 and the memory 503 are connected to each other, for example, through a bus.
The communication interface 501 is mainly used for data communication with the outside, and in the embodiment of the present invention, POI data transmitted by an external data source may be received.
The memory 503 may include a volatile memory (volatile memory), such as a random-access memory (RAM); the memory 503 may also include a non-volatile memory (non-volatile memory), such as a flash memory (flash memory), a Hard Disk Drive (HDD) or a solid-state drive (SSD); the memory 503 may also comprise a combination of the above kinds of memories.
The processor 502 may be a Central Processing Unit (CPU). The processor 502 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a Programmable Logic Device (PLD), or a combination thereof. The PLD may be a Complex Programmable Logic Device (CPLD), a field-programmable gate array (FPGA), a General Array Logic (GAL), or any combination thereof.
Optionally, the memory 503 stores an operating system and is also used to store program instructions. The processor 502 may invoke the program instructions to implement the map data processing method as shown in the embodiments of fig. 2 and 3 of the present application.
Specifically, the processor 502 calls a program instruction stored in the memory 503, and is configured to call, when receiving information point original data about a map, each plugin in a preset target plugin set to process the information point original data, where the target plugin set includes at least two plugins configured based on processing requirements and used for processing the information point original data; combining and processing each data processed by the information point original data by each plug-in to obtain information point update data; and updating the associated data of the map according to the information point updating data.
In one embodiment, the processor 502 is further configured to configure a plurality of plug-ins; the configured plug-in includes: the system comprises a specification plug-in used for carrying out information specification processing on the original data of the information point, a filtering plug-in used for carrying out filtering processing on the original data, and/or a completion plug-in used for carrying out completion processing on the original data of the information point.
In an embodiment, the processor 502 is specifically configured to invoke a canonical plug-in a preset target plug-in set to perform canonical processing on the information point original data; wherein the specification processing includes: and modifying and updating the original classification information in the original data of the information points into standard classification information set for the original classification information in the mapping rules according to the mapping rules configured by the standard plug-in.
In an embodiment, the processor 502 is specifically configured to call a completion plug-in a preset target plug-in set to perform completion processing on the information point original data; wherein the completion processing comprises: analyzing elements recorded in the original data of the information points, determining target elements according to preset element requirements, and completing the content data corresponding to the target elements, wherein the target elements refer to necessary elements recorded in the element requirements, and the elements of the content data of the elements do not exist in the original data of the information points.
In one embodiment, the complemented content data comprises any one or more of the following:
completing address data of the address elements based on address segmentation service; completing the location description data of the location description element based on the location description service; complementing the name data of the name elements based on the role marking service; and (4) result data of whether the chain store element is a chain store is supplemented based on the chain store service.
In an embodiment, the processor 502 is specifically configured to invoke a filter plug-in a preset target plug-in set to perform filtering processing on the information point original data;
wherein the filtering process comprises: and judging the original data of the information points according to the filtering rules configured in the filtering plug-in, and filtering and deleting the original data of the information points which do not accord with the rules of the filtering.
In one embodiment, the processor 502 is further configured to output a configuration interface based on the plug-in, and receive configuration information entered on the configuration interface; and updating the configuration file for the corresponding plug-in according to the configuration information, and loading the updated configuration file for the corresponding plug-in.
According to the embodiment of the invention, for the input information point data of various sources, two or more plug-ins preset according to requirements can be called to preprocess the information point data to obtain the desired information point updating data, so that the map updating requirement is met, useless information point data is reduced well, and the map updating efficiency is improved.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above may be implemented by a computer program, which may be stored in a computer readable storage medium and executed by a computer to implement the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), or the like.
Claims (13)
1. A method for processing map data, comprising:
when receiving information point original data about a map, sending the POI original data to a filtering plug-in, and performing element filtering processing on the information point original data through the filtering plug-in to obtain information point original data after the element filtering processing; the element filtering process includes an element deletion process;
calling each plugin in a preset target plugin set to respectively process the information point original data after the element filtering processing, wherein the target plugin set comprises at least two plugins which are configured based on processing requirements and used for processing the information point original data; the configuration file of each plug-in is updated according to configuration information input on a configuration interface output based on each plug-in, and each plug-in is allowed to load the updated configuration file to process the original data of the information point;
receiving information point initial updating data returned after the information point original data after the element filtering processing is processed by the plug-in the target plug-in set;
the returned information point preliminary updating data are combined to obtain information point updating data, wherein the combination processing comprises the steps of extracting content data of the returned information point preliminary updating data based on the type of a plug-in corresponding to the returned information point preliminary updating data, and forming an information point updating data based on the extracted content data;
updating the associated data of the map according to the information point updating data;
the method for combining the returned preliminary update data of the information points to obtain the update data of the information points comprises any one or two of the following steps:
if the data is the preliminary update data of the information point returned by the address segmentation plug-in the target plug-in set, extracting the data content corresponding to the elements of the address from the preliminary update data of the information point returned by the address segmentation plug-in so as to combine the data content corresponding to the extracted elements of the address;
and if the data is the information point preliminary update data returned by the position description plug-in the target plug-in set, extracting the content data corresponding to the position description elements from the information point preliminary update data returned by the position description plug-in so as to combine the data content corresponding to the extracted position description elements.
2. The method of claim 1, further comprising:
configuring a plurality of plug-ins; the configured plug-in includes: the system comprises a specification plug-in used for carrying out information specification processing on the original data of the information points, a filtering plug-in used for carrying out filtering processing on the original data of the information points and/or a completion plug-in used for carrying out completion processing on the original data of the information points.
3. The method of claim 2, wherein the calling each plugin in the preset target plugin set to process the information point raw data respectively comprises:
calling a standard plug-in a preset target plug-in set to carry out standard processing on the original data of the information point;
wherein the specification processing includes: and according to a mapping rule configured in a specification plug-in, modifying and updating original classification information in the information point original data into standard classification information set for the original classification information in the mapping rule.
4. The method of claim 2, wherein the calling each plugin in the preset target plugin set to process the information point raw data respectively comprises:
calling a completion plug-in a preset target plug-in set to perform completion processing on the original data of the information point;
wherein the completion processing comprises: analyzing elements recorded in the original data of the information points, determining target elements according to preset element requirements, and complementing content data corresponding to the target elements, wherein the target elements refer to necessary elements recorded in the element requirements, and the content data of the elements does not exist in the original data of the information points.
5. The method of claim 4, wherein the complemented content data comprises any one or more of:
completing address data of the address elements based on an address splitting service; completing the location description data of the location description element based on the location description service; complementing the name data of the name elements based on the role marking service; and completing result data of whether the chain store element is the chain store or not based on the chain store service.
6. The method of claim 2, wherein the calling each plugin in the preset target plugin set to process the information point raw data respectively comprises:
calling a filtering plug-in a preset target plug-in set to filter the original data of the information point;
wherein the filtering process comprises: and judging the original data of the information points according to the filtering rules configured in the filtering plug-in, and filtering and deleting the original data of the information points which do not accord with the regulation of the filtering rules.
7. A map data processing apparatus, comprising:
the system comprises a calling module, a filtering plug-in and a processing module, wherein the calling module is used for sending POI (point of interest) original data to the filtering plug-in when receiving the information point original data about a map, and performing element filtering processing on the information point original data through the filtering plug-in to obtain the information point original data after the element filtering processing; the element filtering process includes an element deleting process; calling each plugin in a preset target plugin set to process the information point original data after the element filtering processing, wherein the target plugin set comprises at least two plugins used for processing the information point original data, the configuration file of each plugin is updated according to the configuration information input on a configuration interface output based on each plugin, and each plugin is allowed to load the updated configuration file to process the information point original data;
the processing module is used for receiving information point preliminary updating data returned after the information point original data after the element filtering processing is processed by the plug-in the target plug-in set; combining the returned information point preliminary updating data to obtain information point updating data, wherein the combining comprises extracting content data of each returned information point preliminary updating data based on the type of the plug-in corresponding to the returned information point preliminary updating data, and forming an information point updating data based on each extracted content data;
the updating module is used for updating the associated data of the map according to the information point updating data;
the processing module is specifically configured to, if the data is the preliminary update data of the information point returned by the address splitting plugin in the target plugin set, extract the data content corresponding to the element related to the address from the preliminary update data of the information point returned by the address splitting plugin, so as to combine the data content corresponding to the extracted element related to the address; and/or
And if the data is the information point preliminary updating data returned by the position description plug-in the target plug-in set, extracting the content data corresponding to the position description elements from the information point preliminary updating data returned by the position description plug-in so as to combine the data content corresponding to the extracted position description elements.
8. The apparatus of claim 7, further comprising:
a configuration module for configuring a plurality of plug-ins; the configured plug-in includes: the system comprises a specification plug-in used for carrying out information specification processing on the original data of the information point, a filtering plug-in used for carrying out filtering processing on the original data, and/or a completion plug-in used for carrying out completion processing on the original data of the information point.
9. The apparatus of claim 8,
the calling module is specifically used for calling a standard plug-in a preset target plug-in set to perform standard processing on the original data of the information point; wherein the specification processing includes: and modifying and updating the original classification information in the original data of the information points into standard classification information set for the original classification information in the mapping rules according to the mapping rules configured by the standard plug-in.
10. The apparatus of claim 8,
the calling module is specifically used for calling a completion plug-in a preset target plug-in set to perform completion processing on the original data of the information point; wherein the completion processing comprises: analyzing elements recorded in the original data of the information points, determining target elements according to preset element requirements, and complementing content data corresponding to the target elements, wherein the target elements refer to necessary elements recorded in the element requirements, and the content data of the elements does not exist in the original data of the information points.
11. The apparatus of claim 10, wherein the complemented content data comprises any one or more of:
completing address data of the address elements based on an address splitting service; completing the position description data of the position description element based on the position description service; complementing the name data of the name elements based on the role marking service; and completing result data of whether the chain store element is the chain store or not based on the chain store service.
12. The apparatus of claim 8,
the calling module is specifically used for calling a filtering plug-in a preset target plug-in set to filter the original data of the information point; wherein the filtering process comprises: and judging the original data of the information points according to the filtering rules configured in the filtering plug-in, and filtering and deleting the original data of the information points which do not accord with the rules of the filtering.
13. A computer storage medium, in which a computer program is stored which, when executed by a processor, causes the method of any one of claims 1-6 to be carried out.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710170673.5A CN108628895B (en) | 2017-03-21 | 2017-03-21 | Map data processing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710170673.5A CN108628895B (en) | 2017-03-21 | 2017-03-21 | Map data processing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108628895A CN108628895A (en) | 2018-10-09 |
| CN108628895B true CN108628895B (en) | 2022-11-25 |
Family
ID=63687288
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710170673.5A Active CN108628895B (en) | 2017-03-21 | 2017-03-21 | Map data processing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108628895B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109492066B (en) * | 2018-10-30 | 2021-03-02 | 百度在线网络技术（北京）有限公司 | Method, device, equipment and storage medium for determining branch names of points of interest |
| CN116993857B (en) * | 2023-08-11 | 2024-04-02 | 中国科学院西北生态环境资源研究院 | Thematic map preparation method and device, storage medium and electronic equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101074991A (en) * | 2007-06-29 | 2007-11-21 | 中国网络通信集团公司 | Method and system for processing geographic position information and middleware in geographic information system |
| CN103514199A (en) * | 2012-06-25 | 2014-01-15 | 高德软件有限公司 | Method and device for POI data processing and method and device for POI searching |
| CN104216895A (en) * | 2013-05-31 | 2014-12-17 | 高德软件有限公司 | Method and device for generating POI data |
| CN106096032A (en) * | 2016-06-28 | 2016-11-09 | 天津海量信息技术股份有限公司 | A kind of data digging system |
| CN106156165A (en) * | 2015-04-16 | 2016-11-23 | 阿里巴巴集团控股有限公司 | Method of data synchronization between heterogeneous data source and device |
| CN106294409A (en) * | 2015-05-22 | 2017-01-04 | 阿里巴巴集团控股有限公司 | Data processing method and device |
-
2017
- 2017-03-21 CN CN201710170673.5A patent/CN108628895B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101074991A (en) * | 2007-06-29 | 2007-11-21 | 中国网络通信集团公司 | Method and system for processing geographic position information and middleware in geographic information system |
| CN103514199A (en) * | 2012-06-25 | 2014-01-15 | 高德软件有限公司 | Method and device for POI data processing and method and device for POI searching |
| CN104216895A (en) * | 2013-05-31 | 2014-12-17 | 高德软件有限公司 | Method and device for generating POI data |
| CN106156165A (en) * | 2015-04-16 | 2016-11-23 | 阿里巴巴集团控股有限公司 | Method of data synchronization between heterogeneous data source and device |
| CN106294409A (en) * | 2015-05-22 | 2017-01-04 | 阿里巴巴集团控股有限公司 | Data processing method and device |
| CN106096032A (en) * | 2016-06-28 | 2016-11-09 | 天津海量信息技术股份有限公司 | A kind of data digging system |
Non-Patent Citations (4)
| Title |
|---|
| 地名地址数据库多源集成方法研究;郭丰堂等;《测绘与空间地理信息》;20170225(第02期);全文 * |
| 基于Spark的交互式数据预处理系统;张磊;《计算机系统应用》;20161130;第25卷(第11期);第2-4页 * |
| 知识发现中异构信息标准化处理研究――以资源环境领域文献为例;曲建升等;《图书情报工作》;20160320(第06期);全文 * |
| 顾及位置关系的网络POI地址信息标准化处理方法;王勇等;《测绘学报》;20160515(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108628895A (en) | 2018-10-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210211471A1 (en) | Highly scalable four-dimensional web-rendering geospatial data system for simulated worlds | |
| JP5658823B2 (en) | Metadata integration for duplicate images | |
| WO2015085948A1 (en) | Method, device, and server for friend recommendation | |
| US20150199433A1 (en) | Method and system for search engine indexing and searching using the index | |
| US10216848B2 (en) | Method and system for recommending cloud websites based on terminal access statistics | |
| Alarabi et al. | TAREEG: a MapReduce-based web service for extracting spatial data from OpenStreetMap | |
| CN110888837B (en) | Object storage small file merging method and device | |
| KR102361112B1 (en) | Extracting similar group elements | |
| US20170154073A1 (en) | System and method for retrieving data | |
| CN109241003B (en) | File management method and device | |
| CN105229639A (en) | Short word hash | |
| CN108628895B (en) | Map data processing method and device | |
| US20160154781A1 (en) | Semantic Modeling of Geographic Information in Business Intelligence | |
| US11514062B2 (en) | Feature value generation device, feature value generation method, and feature value generation program | |
| CN112559913B (en) | Data processing method, device, computing equipment and readable storage medium | |
| US9529855B2 (en) | Systems and methods for point of interest data ingestion | |
| GB2539384A (en) | Data search method and device | |
| US20170180511A1 (en) | Method, system and apparatus for dynamic detection and propagation of data clusters | |
| US11816085B2 (en) | Programmatic determinations using decision trees generated from relational database entries | |
| CN113706222A (en) | Method and device for site selection of store | |
| US20170336954A1 (en) | Interactive analysis of data based on progressive visualizations | |
| KR101862178B1 (en) | Method for customized posting and server implementing the same | |
| US20240064179A1 (en) | Highly scalable four-dimensional geospatial data system for simulated worlds | |
| CN116563674B (en) | Sample image enhancement method, system, electronic device and readable storage medium | |
| CN112714033B (en) | Method and device for determining characteristic information of video set |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |