WO2016155386A1

WO2016155386A1 - Method and device for determining whether webpage comprises point of interest (poi) data

Info

Publication number: WO2016155386A1
Application number: PCT/CN2015/099580
Authority: WO
Inventors: 王智广; 魏少俊
Original assignee: 北京奇虎科技有限公司; 奇智软件（北京）有限公司
Priority date: 2015-03-31
Filing date: 2015-12-29
Publication date: 2016-10-06
Also published as: CN104699835B; CN104699835A

Abstract

A method and device for determining whether a webpage comprises point of interest (POI) data. The method comprises: acquiring multiple pieces of POI data from the Internet (S101); crawling multiple webpages comprising address information (S102); separately normalizing address information in the multiple pieces of POI data and the address information comprised in the multiple webpages to be longitude and latitude information (S103); matching longitude and latitude information of the multiple pieces of POI data with that of the multiple webpages (S104); for the POI data and the webpages having same longitude and latitude information, searching in the webpages according to POI names corresponding to the POI data, so as to determine whether the webpages comprise the POI names of the POI data (S105); and when the webpages comprise the POI names of the POI data, determining that the webpages comprise the point of interest (POI) data (S106). The method and the device help to subsequently determine the accuracy of collected POI data according to the accuracy of content recorded by the webpages, thereby subsequently providing a reliable guarantee for collecting accurate POI data in the Internet in a large scale.

Description

Method and apparatus for determining POI data including point of interest in a web page

Technical field

The present invention relates to the field of computer technology, and in particular, to a method and apparatus for determining POI data including points of interest in a web page.

Background technique

In a geographic information system, a POI (Point Of Interest) can be a house, a shop, a mail box, a bus stop, and the like. The POI data includes address information and a POI name.

The traditional POI data acquisition method requires the technician to use a precise surveying and mapping instrument to obtain the latitude and longitude information of each POI, and then mark it down. This method is time-consuming and laborious, resulting in a small amount of POI data obtained through the acquisition, geographic information. It is difficult for the system to provide a high level of service based on a small amount of POI data.

There is a large amount of POI data on the Internet. If the webpage containing POI data can be collected from the Internet, and the POI data is extracted from the collected webpage for use by the geographic information system, labor and time are greatly saved. However, the Internet is full of fake POI data. For example, the content of the blog page contains “original address: http://xxx.xxx.xxx/xxx”. Although it contains the word “address”, the address is a network address or The URL (Uniform Resoure Locator) is not the geographical address information in the POI data; thus, the proportion of the fake POI data in the collected POI data is high.

Summary of the invention

The present invention is directed to the disadvantages of the prior art, and provides a method and apparatus for determining POI data including POIs in a web page to solve the problem of collecting more false POI data in the prior art.

According to an aspect, the present invention provides a method for determining a POI data including a POI in a webpage page, including:

Obtain multiple POI data from the Internet;

Crawling multiple web pages including address information;

Normalizing the address information in the plurality of POI data and the address information included in the plurality of web page pages into latitude and longitude information;

And matching the latitude and longitude information of the plurality of POI data with the latitude and longitude information of the plurality of webpage pages based on the same latitude and longitude information;

For the POI data and the webpage page having the same latitude and longitude information, the POI name corresponding to the POI data is searched in the webpage page to determine whether the POI name of the POI data is included in the webpage page;

When the POI name of the POI data is included in the web page, it is determined that the web page includes the POI data of the POI.

According to another aspect, the present invention further provides an apparatus for determining a POI data including a POI in a webpage page, including:

a POI data acquisition module, configured to acquire multiple POI data from the Internet;

a webpage crawling module for crawling a plurality of webpage pages including address information;

a latitude and longitude information normalization module, configured to normalize address information in the plurality of POI data and address information included in the plurality of webpage pages into latitude and longitude information;

The latitude and longitude information matching module is configured to perform matching on the latitude and longitude information of the plurality of POI data and the latitude and longitude information in the plurality of webpage pages based on the same latitude and longitude information;

The webpage includes a POI name determining module, configured to search for the POI data and the webpage page having the same latitude and longitude information, and search for the POI of the POI data in the webpage page according to the POI name corresponding to the POI data. name;

The webpage includes a POI data determining module, configured to determine, when the webpage includes the POI name of the POI data, the webpage page includes the POI data of the POI.

According to still another aspect of the present invention, a computer program is provided, comprising computer readable code that, when executed on a computing device, causes the computing device to perform the method for determining a web page as described above The method of including POI data of interest points is included in the page.

According to still another aspect of the present invention, a computer readable medium is proposed, wherein the computer program described above is stored.

In the technical solution of the present invention, the address information is normalized into latitude and longitude information, and the geographical address information can be filtered out. Due to the uniqueness of the latitude and longitude, the accuracy of the matching result based on the latitude and longitude information is much higher than the existing text-based information. The accuracy of the matching results, which facilitates subsequent collection avoidance POI data to the fake address information; based on the latitude and longitude information of the POI data and the latitude and longitude information in the webpage page, further determining whether the POI name of the POI data is included in the webpage page to accurately determine whether the POI data is included in the same The webpage page facilitates the subsequent determination of the accuracy of the collected POI data according to the authority and accuracy of the content recorded on the webpage, thereby providing a reliable guarantee for collecting large quantities of highly accurate POI data in the Internet. .

The additional aspects and advantages of the invention will be set forth in part in the description which follows.

DRAWINGS

The above and/or additional aspects and advantages of the present invention will become apparent and readily understood from

1a is a schematic flowchart of a method for determining POI data including a POI in a webpage page according to an embodiment of the present invention;

FIG. 1b is a schematic diagram of a webpage including multiple POI data according to an embodiment of the present invention; FIG.

2 is a schematic diagram of a framework for determining an internal structure of an apparatus for including POI data of a point of interest in a webpage page according to an embodiment of the present invention;

3 is a schematic diagram of a framework of an internal structure of a POI data acquiring module according to an embodiment of the present invention;

Figure 4 shows schematically a block diagram of a computing device for performing the method according to the invention;

Fig. 5 schematically shows a storage unit for holding or carrying program code implementing the method according to the invention.

Specific embodiment

The embodiments of the present invention are described in detail below, and the examples of the embodiments are illustrated in the drawings, wherein the same or similar reference numerals are used to refer to the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the drawings are intended to be illustrative of the invention and are not to be construed as limiting.

The singular forms "a", "an", "the" It should be further understood that the phrase "comprising", used in the context of the present invention, refers to the presence of the features, integers, and steps. The operation, elements, and/or components of the present invention are not intended to be exhaustive or to be added to one or more other features, integers, steps, operations, components, components and/or combinations thereof. It will be understood that when an element is referred to as being "connected" or "coupled" to another element, it can be directly connected or coupled to the other element. Further, "connected" or "coupled" as used herein may include either a wireless connection or a wireless coupling. The phrase "and/or" used herein includes all or any one and all combinations of one or more of the associated listed.

Those skilled in the art will appreciate that all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention belongs, unless otherwise defined. It should also be understood that terms such as those defined in a general dictionary should be understood to have meaning consistent with the meaning in the context of the prior art, and will not be idealized or excessive unless specifically defined as here. The formal meaning is explained.

FIG. 1a is a schematic flowchart diagram of a method for determining POI data including POI in a web page according to the present invention.

S101: Acquire multiple POI data from the Internet; S102: Crawl a plurality of webpage pages including address information; S103: normalize address information in the plurality of POI data and address information included in the plurality of webpage pages into latitude and longitude respectively Information; S104: matching latitude and longitude information of the plurality of POI data with latitude and longitude information of the plurality of webpage pages based on the same latitude and longitude information; S105: for the POI data and the webpage page having the same latitude and longitude information, according to the POI corresponding to the POI data The name is searched in the webpage page to determine whether the POI name of the POI data is included in the webpage page. S106: When the webpage page includes the POI name of the POI data, it is determined that the webpage page includes the POI data of the POI.

The method for determining the POI data of the interest point in the webpage of the present invention normalizes the address information into the latitude and longitude information, and can filter the address information of the geographical location, and the matching result based on the latitude and longitude information is due to the uniqueness of the latitude and longitude. The accuracy is much higher than the accuracy of the existing text-based matching result, thereby facilitating the subsequent avoidance of collecting the data of the fake address information; on the basis of matching the latitude and longitude information of the POI data with the latitude and longitude information in the webpage page, Further determining whether the POI name of the POI data is included in the webpage page to accurately determine whether the POI data is included in the same webpage page, thereby facilitating subsequent determination of the collected POI data according to the authority and accuracy of the content recorded on the webpage page. The accuracy, in turn, provides a reliable guarantee for collecting high-accuracy POI data in the Internet in large quantities.

The following is a detailed description of the process schematic diagram shown in FIG. 1a for determining a POI data including a POI in a webpage page, including the following steps:

S101: Acquire multiple POI data from the Internet.

Specifically, a plurality of web pages including POI data are crawled from the Internet using a program of a web crawler; and then a plurality of POI data are extracted from a plurality of web pages including POI data. The POI data includes address information and a POI name; preferably, the POI data may also include a contact, a zip code, a network label, and the like.

The inventors of the present invention have found that there are such web pages in the Internet, in which the content of each web page contains one or more POI data, and the address information in the POI data includes address keywords such as "address"; and these The page structure feature URL format of the web page, and the location and format of the POI data in the web page are regular. In other words, POI data can be quickly extracted from these web pages in a unified way.

Preferably, a plurality of URLs (Uniform Resole Locators) corresponding to a plurality of web pages including address keywords such as “address” can be crawled from the Internet; and pattern aggregation is performed on the plurality of URLs obtained by the crawling A class that clusters URLs with the same structural characteristics into the same pattern set.

More preferably, for a plurality of web pages including address keywords, a web page including only one POI data is obtained, and URLs of all web pages including only one POI data are obtained; pattern clustering is performed on all obtained URLs, and the same structural features are used. URL clustering is the same pattern set.

For example, in many web pages including address keywords, the URL http://www.aibang.com/detail/1537772035-1606201508 includes only the POI data of "Epson (China) Co., Ltd." and the URL is http: The page of //www.aibang.com/detail/152928073-419169481 only includes the POI data of “Beijing Wangfu Chinese Medicine and Western Medicine Hospital”. These two URLs have the same structural characteristics www.aibang.com/detail/*, Where * is a wildcard for any character; therefore, the two URLs can be clustered into the same pattern set; that is, all URLs in the pattern set have the same structural feature www.aibang.com/detail/*.

Preferably, for a plurality of webpages including address keywords, a webpage including a plurality of POI data, obtaining URLs of all webpages including multiple POI data; pattern clustering all acquired URLs, having the same structural features The URLs are clustered into the same pattern collection.

For example, the webpage with the URL www.dianping.com/topic/s_c_2_120_r14_x540/p7, as shown in FIG. 1b, includes the POI titles "boy london", "COACH" and "Milan shop". Multiple POI data such as Sanlitun); the webpage with the URL www.dianping.com/topic/s_c_2_120_r14_x540/p6 also includes multiple POI data; obtain all URLs whose structural features conform to www.dianping.com/topic/* Where * is a wildcard for any character; pattern clustering is performed for all URLs obtained, and the URLs in the same pattern set obtained by clustering have the structural characteristics www.dianping.com/topic/*.

A pattern set including a plurality of web pages including POI data is filtered from a plurality of pattern sets, and a plurality of web pages including POI data are extracted from the pattern set.

Preferably, extracting the plurality of POI data from the plurality of web pages including the POI data may include:

A POI data extraction template corresponding to the pattern set is generated based on page structure features of a plurality of URLs belonging to the same pattern set corresponding to a plurality of web pages including POI data. Specifically, for each URL belonging to the same pattern set, a POI data extraction template corresponding to the pattern set is generated according to the format and location of the POI data in each webpage corresponding to the URL.

Based on the POI data extraction template, a plurality of POI data are extracted from a plurality of web pages including POI data. Specifically, for each webpage in the same pattern set, for the webpage corresponding to the URL, the format of the POI data in the template and the location of the plurality of POI data in the webpage are extracted according to the generated POI data, and more information is extracted from the webpage. POI data.

S102: Crawling a plurality of webpage pages including address information.

Specifically, a web crawler-like program is used to crawl a plurality of webpage pages including address keywords from the Internet.

Extracting a plurality of text information associated with the address keyword among the plurality of web page pages.

Specifically, for a webpage page, the text content of the webpage page is extracted, and an address keyword that may include address information, such as “address”, “located” or “located in”, is searched for in the text content; and text near the address keyword is extracted. Fragment; segment the text segment according to the set separator and the length of the segment, such as the text length of the text segment from the address keyword is greater than the set threshold, and/or the separator of the text segment (such as a space, a comma, The period, etc., divides the text segment; in the segmentation result, the text segment between the segmentation (for example, the separator) and the address keyword is used as the text information associated with the address keyword in the web page.

Extract the address information of the corresponding web page from a plurality of text information.

Specifically, for each text information extracted from the web page, the address information is extracted from the text information as the address information of the web page.

S103: Normalize the address information in the plurality of POI data and the address information included in the plurality of webpage pages into the latitude and longitude information.

A geographic information base including address information, latitude and longitude information, and correspondence between address information and latitude and longitude information including provinces, cities, counties (districts), towns, and roads in the country is obtained in advance. The address information in the geographic information base may include address information indicating multiple expression forms of the same geographical address; for example, "6 Jiuxianqiao Road, Chaoyang District", "Beijing Chaoyang Jiuxianqiao No. 6" and "Chaoyang District" Multiple address information such as "Jiuxianqiao No. 6" means the same geographical address.

Specifically, the address information in the plurality of POI data is respectively normalized into latitude and longitude information of the plurality of POI data. For example, for the address information in each POI data, the latitude and longitude information corresponding to the address information is searched from the pre-acquired geographic information database, and the found latitude and longitude information is determined as the latitude and longitude information of the POI data.

S104: Matching the latitude and longitude information of the plurality of POI data with the latitude and longitude information of the plurality of webpage pages based on the same latitude and longitude information.

Specifically, for each POI data, determining whether there is a webpage page whose latitude and longitude information is consistent with the latitude and longitude information of the POI data in each webpage page, and if yes, determining that the POI data matches the webpage page, that is, determining The POI data has the same latitude and longitude information as the web page page, otherwise the POI data is ignored.

Due to the uniqueness of latitude and longitude, the accuracy of the matching result based on the latitude and longitude information is much higher than the accuracy of the existing text-based matching result, so that more accurate POI data can be collected according to the more accurate matching result. Moreover, the matching based on the latitude and longitude information is equivalent to matching the plurality of geographic information corresponding to the latitude and longitude information, thereby expanding the matching range, and facilitating subsequent collection of more POI data.

S105: Search for the POI data and the webpage page having the same latitude and longitude information according to the POI name corresponding to the POI data, and determine whether the POI name of the POI data is included in the webpage page.

Specifically, for the POI data and the webpage page having the same latitude and longitude information, all the name information is found from the webpage page; for each name information found, the name information is judged. Whether to match the POI name in the POI data: if so, the POI name including the POI data in the web page page is determined; otherwise, the POI data is ignored.

Preferably, for the POI data and the webpage page having the same latitude and longitude information, if the name information in the webpage page and the POI name in the POI data are not completely consistent in the text expression, substantially indicating the same POI, It is confirmed that the POI name in the POI data matches the name information in the webpage page, thereby determining the POI name including the POI data in the webpage page.

For example, for POI data and webpage pages having the same latitude and longitude information, the POI name in the POI data is “Qihu 360”, and the name information in the webpage page is “Beijing Qihoo Technology Co., Ltd.”, which can be confirmed as The POI name of the POI data is included in the web page.

Preferably, for the POI data and the webpage page having the same latitude and longitude information, when it is determined that the plurality of name information is included in the webpage page, the text distance between the plurality of name information and the address information of the webpage page is separately calculated. The name information corresponding to the minimum text distance is determined as the name information corresponding to the address information in the web page. The text distance may be the number of characters between the name information and the address information.

For the POI data and the webpage page having the same latitude and longitude information, the POI name corresponding to the POI data is compared with the name information corresponding to the address information in the webpage page. When the comparison is consistent, it is determined that the POI name of the POI data is included in the webpage page.

Specifically, for the POI data and the webpage page having the same latitude and longitude information, determining whether the POI name corresponding to the POI data and the name information corresponding to the address information in the webpage page are consistent: if yes, determining that the webpage includes the POI The POI name of the data; otherwise, the POI name of the POI data is not included in the web page page.

S106: For the POI data and the webpage page having the same latitude and longitude information, when the webpage page includes the POI name of the POI data, it is determined that the webpage page includes the POI data of the POI.

Specifically, for the POI data and the webpage page having the same latitude and longitude information, when it is determined in the foregoing step S105 that the POI name of the POI data is included in the webpage page, it is determined in the step that the webpage page includes the POI data of the POI. Specifically, the webpage page is determined to include the POI name and address information of the POI.

Based on the above method for determining POI data including POI in a web page, the present invention provides As shown in FIG. 2, a schematic diagram of a framework for determining a POI data of a point of interest in a webpage page includes: a POI data acquisition module 201, a webpage crawling module 202, and a latitude and longitude information normalization module. 203. The latitude and longitude information matching module 204, the webpage page includes a POI name determining module 205, and the webpage page includes a POI data determining module 206.

The POI data obtaining module 201 is configured to acquire a plurality of POI data from the Internet.

The webpage crawling module 202 is configured to crawl a plurality of webpage pages including address information.

Specifically, the webpage crawling module 202 crawls a plurality of webpage pages including address keywords from the Internet; extracts a plurality of text information associated with the address keywords in the plurality of webpage pages; and extracts corresponding information from the plurality of textual information The address information of the web page.

The latitude and longitude information normalization module 203 is configured to normalize the address information in the plurality of POI data and the address information included in the plurality of web page pages into the latitude and longitude information.

Specifically, the latitude and longitude information normalization module 203 normalizes the address information in the plurality of POI data into the latitude and longitude information of the plurality of POI data. Preferably, for the address information in each POI data, the latitude and longitude information corresponding to the address information is searched from the pre-acquired geographic information database, and the found latitude and longitude information is determined as the latitude and longitude information of the POI data. The pre-acquired geographic information database includes address information, latitude and longitude information, and correspondence between the address information and the latitude and longitude information of provinces, cities, counties (districts), towns, and roads in the country.

And, the latitude and longitude information normalization module 203 normalizes the address information included in the plurality of webpage pages into the latitude and longitude information of the plurality of webpage pages. Preferably, for the address information included in each webpage page, the latitude and longitude information corresponding to the address information is searched from the pre-acquired geographic information database, and the found latitude and longitude information is determined as the latitude and longitude information of the webpage page.

The latitude and longitude information matching module 204 is configured to match the latitude and longitude information of the plurality of POI data with the latitude and longitude information of the plurality of webpage pages based on the same latitude and longitude information. Specifically, the latitude and longitude information matching module 204 determines, for each POI data, whether there is a webpage page whose latitude and longitude information is consistent with the latitude and longitude information of the POI data in each webpage page, and if yes, determines that the POI data is related to the webpage page. Matching, that is, determining that the POI data has the same latitude and longitude information as the web page page, otherwise, the POI data is ignored.

The webpage includes a POI name determining module 205, configured to search for the POI data and the webpage page having the same latitude and longitude information, and search for the POI of the POI data in the webpage page according to the POI name corresponding to the POI data. name. Specifically, the web page The facet determining module 205 includes, for the POI data and the webpage page having the same latitude and longitude information, all the name information is found from the webpage page; and for each name information found, it is determined whether the name information is related to the POI data. The POI name matches: if so, the POI name of the POI data is determined in the web page; otherwise, the POI data is ignored.

The web page includes a POI data determining module 206 for determining that the web page includes the POI data of the POI when the POI name of the POI data is included in the web page.

Preferably, the schematic diagram of the internal structure of the POI data acquisition module 201 is as shown in FIG. 3, and includes a webpage crawling unit 301 and a POI data extracting unit 302.

The webpage crawling unit 301 is configured to crawl a plurality of webpages including POI data from the Internet.

Specifically, the webpage crawling unit 301 crawls a plurality of URLs corresponding to the plurality of webpages including the address keyword from the Internet; performs pattern clustering on the plurality of URLs, and clusters the URLs having the same structural feature into the same pattern set; A pattern set including a plurality of web pages including POI data is filtered from a plurality of pattern sets, and a plurality of web pages including POI data are extracted from the pattern set.

The POI data extracting unit 302 is configured to extract a plurality of POI data from a plurality of web pages including POI data.

Specifically, the POI data extracting unit 302 is specifically configured to generate a POI data extraction template corresponding to the pattern set based on page structure features of the plurality of URLs corresponding to the plurality of URLs in the same pattern set, and extract the template based on the POI data. Extracting a plurality of POI data from a plurality of web pages including POI data.

Preferably, as shown in FIG. 2, the apparatus for determining the POI data included in the webpage page of the present invention further includes: a webpage page name information determining module 207.

The name information determining module 207 in the webpage is configured to separately calculate a text distance between the plurality of name information and the address information of the webpage page when the webpage page includes the plurality of name information; and the minimum text distance corresponds to The name information is determined to be name information corresponding to the address information in the web page.

At this time, the webpage including the POI name determining module 205 is further configured to compare the POI name corresponding to the POI data with the name information corresponding to the address information in the webpage page; when the comparison is consistent, determining that the webpage page includes the The POI name of the POI data.

In the technical solution of the embodiment of the present invention, the address information is normalized into latitude and longitude information, which can be filtered. Unless the geographic address information is used, it is advantageous to avoid the subsequent collection of the fake POI data of the address information; and further, the POI name including the POI data in the webpage page is further determined on the basis that the latitude and longitude information of the POI data matches the latitude and longitude information in the webpage page, It is beneficial to avoid collecting some POI data whose latitude and longitude information or POI name cannot be matched, and the POI data which cannot be matched is often less accurate, so that it can be conveniently collected according to the POI data of the POI included in the determined webpage. More accurate POI data.

Those skilled in the art will appreciate that the present invention includes apparatus related to performing one or more of the operations described herein. These devices may be specially designed and manufactured for the required purposes, or may also include known devices in a general purpose computer. These devices have computer programs stored therein that are selectively activated or reconfigured. Such computer programs may be stored in a device (eg, computer) readable medium or in any type of medium suitable for storing electronic instructions and coupled to a bus, respectively, including but not limited to any Types of disks (including floppy disks, hard disks, optical disks, CD-ROMs, and magneto-optical disks), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (Erasable Programmable Read-Only Memory) , EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or light card. That is, a readable medium includes any medium that is stored or transmitted by a device (eg, a computer) in a readable form.

Those skilled in the art will appreciate that each block of the block diagrams and/or block diagrams and/or flow diagrams and combinations of blocks in the block diagrams and/or block diagrams and/or flow diagrams can be implemented by computer program instructions. . Those skilled in the art will appreciate that these computer program instructions can be implemented by a general purpose computer, a professional computer, or a processor of other programmable data processing methods, such that the processor is executed by a computer or other programmable data processing method. The blocks of the disclosed structure and/or block diagrams and/or flow diagrams or blocks specified in the various blocks.

Those skilled in the art can understand that the steps, measures, and solutions in the various operations, methods, and processes that have been discussed in the present invention may be alternated, changed, combined, or deleted. Further, other steps, measures, and schemes of the various operations, methods, and processes that have been discussed in the present invention may be alternated, modified, rearranged, decomposed, combined, or deleted. Further, the steps, measures, and solutions in the prior art having various operations, methods, and processes disclosed in the present invention may also be alternated, changed, rearranged, decomposed, combined, or deleted.

The above is only a part of the embodiments of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It should be considered as the scope of protection of the present invention.

The various component embodiments of the present invention may be implemented in hardware, or in a software module running on one or more processors, or in a combination thereof. Those skilled in the art will appreciate that a microprocessor or digital signal processor (DSP) may be used in practice to implement some or all of the means for determining POI data in a web page including point of interest POI data in accordance with an embodiment of the present invention. Some or all of the features of the part. The invention can also be implemented as a device or device program (e.g., a computer program and a computer program product) for performing some or all of the methods described herein. Such a program implementing the invention may be stored on a computer readable medium or may be in the form of one or more signals. Such signals may be downloaded from an Internet website, provided on a carrier signal, or provided in any other form.

For example, Figure 4 schematically illustrates a block diagram of a computing device for performing the method in accordance with the present invention. The computing device conventionally includes a processor 410 and a computer program product or computer readable medium in the form of a memory 420. The memory 420 may be an electronic memory such as a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), an EPROM, a hard disk, or a ROM. Memory 420 has a memory space 430 for program code 431 for performing any of the method steps described above. For example, storage space 430 for program code may include various program code 431 for implementing various steps in the above methods, respectively. The program code can be read from or written to one or more computer program products. These computer program products include program code carriers such as hard disks, compact disks (CDs), memory cards or floppy disks. Such computer program products are typically portable or fixed storage units as described with reference to FIG. The storage unit may have storage segments, storage spaces, and the like that are similarly arranged to memory 420 in the computing device of FIG. The program code can be compressed, for example, in an appropriate form. Typically, the storage unit comprises computer readable code 431' for performing the steps of the method according to the invention, ie code that can be read by a processor, such as 410, which, when executed by the computing device, causes the calculation The device performs the various steps in the methods described above.

It should be noted that the above embodiments illustrate the invention rather than the invention. Limitations, and alternative embodiments may be devised by those skilled in the art without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as a limitation. The word 'comprising' does not exclude the presence of the elements or steps that are not recited in the claims. The word "a" or "an" The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitably programmed computer. In the unit claims enumerating several means, several of these means can be embodied by the same hardware item. The use of the words first, second, and third does not indicate any order. These words can be interpreted as names.

In addition, it should be noted that the language used in the specification has been selected for the purpose of readability and teaching, and is not intended to be construed or limited. Therefore, many modifications and changes will be apparent to those skilled in the art without departing from the scope of the invention. The disclosure of the present invention is intended to be illustrative, and not restrictive, and the scope of the invention is defined by the appended claims.

The present invention is applicable to computer systems/servers that can operate with numerous other general purpose or special purpose computing system environments or configurations. Examples of well-known computing systems, environments, and/or configurations suitable for use with computer systems/servers include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, based on Microprocessor systems, set-top boxes, programmable consumer electronics, networked personal computers, small computer systems, mainframe computer systems, and distributed cloud computing technology environments including any of the above, and the like.

The computer system/server can be described in the general context of computer system executable instructions (such as program modules) being executed by a computer system. Generally, program modules may include routines, programs, target programs, components, logic, data structures, and the like that perform particular tasks or implement particular abstract data types. The computer system/server can be implemented in a distributed cloud computing environment where tasks are performed by remote processing devices that are linked through a communication network. In a distributed cloud computing environment, program modules may be located on a local or remote computing system storage medium including storage devices.

"One embodiment", "embodiment" or "one or more" as referred to herein The embodiment means that the specific features, structures or characteristics described in connection with the embodiments are included in at least one embodiment of the invention. In addition, it is noted that the examples of the words "in one embodiment" are not necessarily all referring to the same Example.

Claims

A method for determining a POI data including a POI in a webpage page, comprising:

Obtain multiple POI data from the Internet;

Crawling multiple web pages including address information;

Normalizing the address information in the plurality of POI data and the address information included in the plurality of web page pages into latitude and longitude information;

And matching the latitude and longitude information of the plurality of POI data with the latitude and longitude information of the plurality of webpage pages based on the same latitude and longitude information;

For the POI data and the webpage page having the same latitude and longitude information, the POI name corresponding to the POI data is searched in the webpage page to determine whether the POI name of the POI data is included in the webpage page;

When the POI name of the POI data is included in the web page, it is determined that the web page includes the POI data of the POI.
The method according to claim 1, wherein the step of acquiring a plurality of POI data from the Internet further comprises:

Crawling multiple web pages including POI data from the Internet;

Extracting a plurality of POI data from the plurality of web pages including POI data.
The method according to any one of claims 1-2, wherein the step of crawling a plurality of web pages including POI data from the Internet further comprises:

Crawling multiple URLs corresponding to multiple web pages including address keywords from the Internet;

Performing pattern clustering on the plurality of URLs, and clustering URLs having the same structural feature into the same pattern set;

A pattern set including a plurality of web pages including POI data is filtered from a plurality of pattern sets, and a plurality of web pages including POI data are extracted from the pattern set.
The method according to any one of claims 1 to 3, wherein the step of extracting a plurality of POI data from the plurality of web pages including POI data further comprises:

Generating a POI data extraction template corresponding to the pattern set based on page structure features of the plurality of URLs belonging to the same pattern corresponding to the plurality of web pages including the POI data;

Extracting a plurality of POI data from the plurality of web pages including POI data based on the POI data extraction template.
The method according to any one of claims 1 to 4, wherein the step of crawling a plurality of webpage pages including address information further comprises:

Crawling multiple web pages including address keywords from the Internet;

Extracting a plurality of text information associated with the address keyword among the plurality of webpage pages;

Extracting address information of the corresponding webpage page from the plurality of text information.
The method according to any one of claims 1 to 5, further comprising:

When it is determined that the plurality of name information is included in the webpage page, calculating a text distance between the plurality of name information and the address information of the webpage page respectively;

Determining the name information corresponding to the minimum text distance as the name information corresponding to the address information in the webpage page;

The step of determining, according to the POI name corresponding to the POI data, the POI name of the POI data in the webpage page, further includes:

Comparing the POI name corresponding to the POI data with the name information corresponding to the address information in the webpage page;

When the comparison is consistent, it is determined that the POI name of the POI data is included in the webpage page.
An apparatus for determining a POI data including a POI in a webpage page, comprising:

a POI data acquisition module, configured to acquire multiple POI data from the Internet;

a webpage crawling module for crawling a plurality of webpage pages including address information;

a latitude and longitude information normalization module, configured to normalize address information in the plurality of POI data and address information included in the plurality of webpage pages into latitude and longitude information;

The latitude and longitude information matching module is configured to perform matching on the latitude and longitude information of the plurality of POI data and the latitude and longitude information in the plurality of webpage pages based on the same latitude and longitude information;

The webpage includes a POI name determining module, configured to search for the POI data and the webpage page having the same latitude and longitude information, and search for the POI of the POI data in the webpage page according to the POI name corresponding to the POI data. name;

The webpage includes a POI data determining module, configured to determine, when the webpage includes the POI name of the POI data, the webpage page includes the POI data of the POI.
The apparatus according to claim 7, wherein the POI data acquisition module specifically comprises:

a webpage crawling unit, configured to crawl a plurality of webpages including POI data from the Internet;

a POI data extracting unit, configured to extract a plurality of POI data from the plurality of web pages including POI data.
Device according to any of claims 7-8, characterized in that

The webpage crawling unit is specifically configured to: crawl a plurality of URLs corresponding to the plurality of webpages including the address keyword from the Internet; perform pattern clustering on the plurality of URLs, and cluster the URLs having the same structural feature into the same a pattern set; filtering a pattern set including a plurality of web pages including POI data from a plurality of pattern sets, and extracting a plurality of web pages including POI data from the pattern set.
A device according to any one of claims 7-9, wherein

The POI data extraction unit is specifically configured to generate a POI data extraction template corresponding to the pattern set based on a page structure feature of a plurality of URLs corresponding to the plurality of URLs in the same pattern set, and extract the template based on the POI data. Extracting a plurality of POI data from the plurality of web pages including POI data.
A device according to any one of claims 7-10, wherein

The web page crawling module is specifically configured to: crawl a plurality of webpage pages including an address keyword from the Internet; and extract a plurality of text information associated with the address keyword in the plurality of webpage pages; The address information of the corresponding webpage page is extracted from the plurality of text information.
The device according to any one of claims 7 to 10, further comprising: a name information determining module in the webpage;

The name information determining module in the webpage is configured to calculate a text distance between the plurality of name information and address information of the webpage page when determining that the webpage includes a plurality of name information; and the minimum text distance The corresponding name information is determined as the name information corresponding to the address information in the webpage page;

The webpage including the POI name determining module is further configured to compare the POI name corresponding to the POI data with the name information corresponding to the address information in the webpage page; when the comparison is consistent, determining that the webpage page includes the POI data The POI name.
A computer program comprising computer readable code, when the computer readable code is run on a computing device, causing the computing device to perform the determining a web page according to any one of claims 1-6 A method of including POI data of points of interest.
A computer readable medium storing the computer program of claim 13.