KR101138751B1 - Apparatus and method for processing web information by using extracting local information - Google Patents

Abstract

The present invention relates to an apparatus and method for processing web information using local information extraction, and to break away from the subject-based grouping method according to the prior art in the web information service, by integrating various pieces of information covering the same area around the local information. Because it can be managed, it is possible to analyze the web content, extract the main information, grasp the location information related to the web content content, and integrate and manage various web information around the relevant local information.

Location information extraction, area information extraction, area based information service, information integration

Description

APAPATUS AND METHOD FOR PROCESSING WEB INFORMATION BY USING EXTRACTING LOCAL INFORMATION}

The present invention relates to an apparatus and method for processing web information using local information extraction, and more particularly, to grasp location information related to web content contents, and then process by consolidating various web information based on relevant local information. The present invention relates to a web information processing apparatus and method using local information extraction for providing document data.

The present invention is derived from a study conducted as part of the IT growth engine technology development project of the Ministry of Knowledge Economy [Task management number: 2008-S-020-01, Task name: Web QA technology development].

The search service, which is one of various services provided using the Internet, refers to a service that provides a user with a search result corresponding to the search query after searching for a predetermined search query input by the user.

In order to provide such a search service, a search service provider constructs a database by collecting information about websites and indexes and stores them in advance, and searches the website information stored in the database when a search is requested from a user. To the user.

In the search service for providing web information according to the prior art, it is used in a subject-oriented grouping method.

The subject-based grouping method is to provide web information grouped by subjects such as economy, society, travel, education, and the like.

On the other hand, in recent years, the use of web search service has diversified, and according to this trend, the search service provider receives a request for registration of key information including local information of a specific point of interest directly from the user and registers it in the local information database. It is to provide a local information search service using this local information database.

Recently, a local information search service has been provided as a kind of web search service. When searching for web information for such a local information search service, if the subject-based grouping method according to the prior art is used, the search results are extracted by subject. Therefore, there was a problem that the local information retrieval service was not suitable for the local information retrieval service.

The present invention has been proposed to solve the problems of the prior art as described above, local information extraction to provide document data processed by integrating a variety of web information centered on the relevant local information after grasping the location information related to the content of the web content Provides a web information processing apparatus and method utilizing the.

According to an embodiment of the present invention, a web information processing apparatus using local information extraction may include a document analysis unit that performs language analysis on document data extracted from web content, and the document data based on a result of the language analysis. A subject classification section for selecting a subject of the subject, a main information extracting section for extracting main information including regional information from the document data according to the selected subject and the result of the language analysis, and within a setting range based on the regional information And a related information mapping unit for grouping and mapping the document data covering an area, and an information integrating unit for comparing the mapped document data and integrating and processing the document data.

The web information processing apparatus may further include a location information grasping unit for converting the extracted area information into actual geographic location information, and the related information mapping unit converts the document data based on the area information and the location information. Can be grouped and mapped.

The location information grasping unit may convert the area information into the location information by using the point of interest information.

The document analysis unit may perform the linguistic analysis including morphological analysis and entity name recognition using a linguistic analysis resource.

The subject classifying unit determines a template in which the type of information to be extracted from the document data is expressed according to the selected subject, and the main information extracting unit selects the main information from the document data based on the template. Can be extracted.

The related information mapping unit may limit an area within the set range to the same area.

The information integrating unit may modify the main information if the main information does not match according to the comparison result.

According to another embodiment of the present invention, a web information providing method using local information extraction is a method in which a web information processing apparatus processes web information using local information extraction, and performs language analysis on document data extracted from web content. Selecting a subject of the document data based on a result of the language analysis; extracting main information including local information from the document data according to the selected subject and the result of the language analysis; And grouping and mapping the document data covering an area within a setting range based on the region information, and comparing the mapped document data and integrating the document data according to the comparison result.

The web information processing method may further include converting the extracted area information into actual geographical location information, and the mapping may include mapping and mapping the document data based on the area information and the location information. Can be.

In the converting, the area information may be converted into the location information by using the point of interest information.

The performing may include performing a linguistic analysis including morphological analysis and entity name recognition using a linguistic analysis resource.

The selecting may include determining a template in which the type of information to be extracted from the document data is expressed according to the selected subject. The extracting may include extracting the main information from the document data based on the template. Can be.

In the mapping, the region within the set range may be limited to the same region.

The integrated processing may be modified to coincide with each other if the main information is inconsistent according to the comparison result.

According to the present invention, since it is possible to integrate and manage a variety of information covering the same area with the focus on the local information, apart from the subject-oriented grouping method according to the prior art in the web information service, the main information is extracted by analyzing the web content. By identifying location information related to content contents, various web information can be integrated and managed based on relevant local information.

Therefore, the information scattered on the web is integrated and presented based on local information through document analysis including high-dimensional language analysis, document subject classification, key information extraction, relevant location information extraction, local information-based information mapping and information integration process. It can be used to service.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various different forms, and only the embodiments make the disclosure of the present invention complete, and the general knowledge in the art to which the present invention belongs. It is provided to fully inform the person having the scope of the invention, which is defined only by the scope of the claims. Like numbers refer to like elements throughout.

In describing the embodiments of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the gist of the present invention, the detailed description thereof will be omitted. In addition, terms to be described below are terms defined in consideration of functions in the embodiments of the present invention, which may vary according to intentions or customs of users and operators. Therefore, the definition should be based on the contents throughout this specification.

Combinations of each block of the accompanying block diagram and each step of the flowchart may be performed by computer program instructions. These computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment such that instructions executed through the processor of the computer or other programmable data processing equipment may not be included in each block or flowchart of the block diagram. It will create means for performing the functions described in each step. These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement functionality in a particular manner, and thus the computer usable or computer readable memory. It is also possible for the instructions stored in to produce an article of manufacture containing instruction means for performing the functions described in each block or flowchart of each step of the block diagram. Computer program instructions may also be mounted on a computer or other programmable data processing equipment, such that a series of operating steps may be performed on the computer or other programmable data processing equipment to create a computer-implemented process to create a computer or other programmable data. Instructions that perform processing equipment may also provide steps for performing the functions described in each block of the block diagram and in each step of the flowchart.

In addition, each block or step may represent a portion of a module, segment or code that includes one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative embodiments, the functions noted in the blocks or steps may occur out of order. For example, the two blocks or steps shown in succession may in fact be executed substantially concurrently or the blocks or steps may sometimes be performed in the reverse order, depending on the functionality involved.

1 is a block diagram of a web information processing apparatus using local information extraction according to an embodiment of the present invention.

As shown therein, the web information processing apparatus of the present invention includes a document collecting unit 110, a document database 120, a document analyzing unit 130, a language analysis resource storing unit 131, a subject classifying unit 140, and a main unit. The information extracting unit 150, the location information identifying unit 160, the point of interest information storage unit 161, the related information mapping unit 170, the information integrating unit 180, and the like are configured.

The document collecting unit 110 stores the extracted document data in the document database 120 by extracting a body from web content such as the web document 1.

The document analyzer 130 performs language analysis on the document data stored in the document database 120 using the language analysis resource storage unit 131. In this case, the document analysis unit 110 performs a language analysis including morphological analysis and entity name recognition by using the language analysis resource stored in the language analysis resource storage unit 131. The linguistic analysis resource may include various digital dictionaries, linguistic analysis rules, learning corpus, and the like.

The subject classifying unit 140 selects a subject of document data stored in the document database 120 based on the result of the language analysis by the document analyzing unit 130, and selects information to be extracted from the document data according to the selected subject. Determine the template in which the type is expressed.

The main information extracting unit 150 is based on a topic selected by the subject classifying unit 140, that is, a template determined by the subject classifying unit 140, and a region of the document data based on the results of language analysis by the document analyzing unit 130. Extract key information, including information.

The location information identifying unit 160 converts the location information extracted by the main information extracting unit 150 into actual geographical location information by using the point of interest information storage unit 161. For example, the actual geographical position information may be obtained through the point of interest analysis using the point of interest digital dictionary stored in the point of interest information storage unit 161.

The related information mapping unit 170 may store document data stored in the document database 120 based on local information extracted by the main information extractor 150 or based on location information converted by the corresponding local information and location information identifying unit 160. Group and map document data covering the area within the setting range. At this time, the region within the setting range may be limited to the same region.

The information integrating unit 180 compares the document data mapped by the related information mapping unit 170, and if the main information is inconsistent according to the comparison result, the information integrating unit 180 is modified to match and then integrated and processed into a single updated document data. The processed document data is stored in the document database 120.

The web information processing process by the web information processing apparatus using the local information extraction according to the embodiment of the present invention configured as described above will be described in more detail with reference to the flowchart of FIG. 2 and the exemplary view of FIG. 3.

First, the document collecting unit 110 extracts the text from the web content such as the web document 1 (S201) and stores the extracted document data in the document database 120 (S203).

Then, the document analyzer 130 performs language analysis on the document data stored in the document database 120 using the language analysis resource storage unit 131 (S205). In this case, the document analysis unit 110 performs a language analysis including morphological analysis and entity name recognition using the language analysis resource storage unit 131. For example, assuming that the document belonging to the "delicious" field is analyzed, a language analysis such as an entity name, a menu name, a restaurant name, and the like registered in the language analysis digital dictionary mounted in the language analysis resource storage unit 131 may be performed. .

Next, the subject classifying unit 140 selects a subject of the document data stored in the document database 120 based on the result of the language analysis by the document analyzing unit 130 (S207), and the corresponding document data according to the selected subject. The template in which the type of information to be extracted is determined is determined (S209). For example, the template may include a restaurant name, a phone number, an address, a menu name, and the like.

Subsequently, the main information extracting unit 150 based on the subject selected by the subject classifying unit 140, that is, the template data determined by the subject classifying unit 140 and the result of language analysis by the document analyzing unit 130, corresponding document data. Extract main information including local information from (S211). For example, an address may be extracted as local information.

Meanwhile, the location information determiner 160 may convert the location information extracted by the main information extractor 150 into actual geographical location information by using the point of interest information storage unit 161. For example, the actual geographical position information may be obtained through the point of interest analysis using the point of interest digital dictionary stored in the point of interest information storage unit 161.

Then, the related information mapping unit 170 is stored in the document database 120 based on the local information extracted from the main information extraction unit 150 or based on the location information converted by the corresponding local information and location information identifying unit 160. The document data covering the area within the setting range among the document data is grouped and mapped (S213). At this time, the region within the setting range may be limited to the same region. For example, document data having the same address is grouped into one group and mapped.

Finally, the information integrating unit 180 compares the document data mapped by the related information mapping unit 170 (S215), and if the main information is inconsistent according to the comparison result (S217) after correcting to match (S219) Integrated processing into a single updated document data, and stores the integrated processed document data in the document database 120 (S221). Here, the modification of the main information to coincide means that the information content of the remaining document data is corrected based on any one document data when the information types are the same but the contents are inconsistent. In this case, the document data with the highest reliability value evaluated by referring to the web address of the web content from which the document data is extracted may be used as a reference. For example, the reliability value of the document data extracted from the portal site is higher than the document data extracted from the blog, and the document data extracted from the portal site may be used as a reference for correcting the information content. The integrated processing means that the updated document data includes all kinds of information even if the plurality of document data includes different kinds of information.

3 illustrates an embodiment of integrating local information of a blog document and a web portal site in a web information processing apparatus using local information extraction according to an embodiment of the present invention. In FIG. 3, both the web document 1a and the web document 1b are documents dealing with a restaurant called “makchang yaki-gu,” located in a specific area.

Reference numeral 3 of FIG. 3 is extracted as a result of performing the document analyzing unit 130, the subject classifying unit 140, the main information extracting unit 150, the location information identifying unit 160, and the like for the web document 1a. Information. The subject classifying unit 140 classifies the document data corresponding to the web document 1a as a "delicious" subject, and the main information extracting unit 150 uses the "position / menu / price" information in the document data based on the template. Is extracted.

On the other hand, there are a lot of contents dealing with a restaurant called "makgugji" on the web. For example, the web document 1b of FIG. 3 is content presented as local information of a web portal site. In this case, information about a corresponding restaurant may be extracted in the form of reference numeral 5. That is, the subject classifying unit 140 classifies the document data corresponding to the web document 1b as a "delicious" subject, and the main information extracting unit 150 determines the "phone number / location / business type" in the document data based on the template. / Menu "information is extracted.

The related information mapping unit 170 performs grouping by searching for information that deals with similar local information among the document data. In FIG. 3, document data corresponding to the web document 1a and document data corresponding to the web document 1b are mapped. The result is illustrated. In addition, multimedia contents including image information such as maps and photos may be grouped through metadata mapping.

In the example of FIG. 3, the location information is expressed as "Sinchon-dong, Seodaemun-gu, Seoul" while the reference information 5, more accurate and detailed address information, that is, "62-24, Changjeon-dong, Seodaemun-gu, Seoul" was extracted. In addition, while the price information of the menu is not represented at 5, the price information of the menu is included at 3.

The information integrating unit 180 modifies the location information of the document data extracted from the web document 1a based on the location information of the document data extracted from the web document 1b, and the type of information included in the web document 1b. And merged the document data to include all kinds of information included in the web document 1b to generate updated document data indicated by 7 and store the generated document data in the document database 120.

As such, the information integrated by the information integrating unit 180 is provided to a user who requests a web search service, and the user receives a web search result centering on local information.

1 is a block diagram of a web information processing apparatus utilizing local information extraction according to an embodiment of the present invention;

2 is a flowchart illustrating a web information processing method using local information extraction according to an embodiment of the present invention;

3 is a view showing an embodiment of integrating local information of a blog document and a web portal site in a web information processing apparatus using local information extraction according to an embodiment of the present invention.

<Explanation of symbols for the main parts of the drawings>

110: document collection unit 120: document database

130: document analysis unit 140: subject classification unit

150: main information extraction unit 160: location information grasping unit

170: related information mapping unit 180: information integration unit

Claims (14)

A document analysis unit which performs language analysis on the document data extracted from the web content, including morphological analysis using the linguistic analysis resources and object name recognition; A subject classifier configured to select a subject of the document data based on a result of the language analysis, and determine a template in which the type of information to be extracted from the document data is expressed according to the selected subject; A main information extraction unit for extracting main information including local information from the document data based on the template according to the selected topic and the result of the language analysis; A related information mapping unit for grouping and mapping the document data covering an area within a setting range based on the local information; An information integration unit for comparing the mapped document data and integrating the document data according to the comparison result Web information processing device utilizing local information extraction, including. The method of claim 1, The web information processing device, Location information grasp unit for converting the extracted area information into actual geographical location information More, The related information mapping unit maps the document data by grouping the document data based on the area information and the location information. Web information processing device using local information extraction. The method of claim 2, The location information identifying unit converts the area information into the location information by using the point of interest information. Web information processing device using local information extraction. delete delete The method of claim 1, The related information mapping unit may limit an area within the setting range to the same area. Web information processing device using local information extraction. The method of claim 1, The information integrating unit, if the main information is inconsistent according to the comparison result, to correct to match Web information processing device utilizing local information extraction, including. As a web information processing device processes web information by using local information extraction, Performing a linguistic analysis on the document data extracted from the web content, including morphological analysis using a linguistic analysis resource and object name recognition; Selecting a subject of the document data based on a result of the language analysis, and determining a template in which the type of information to be extracted from the document data is expressed according to the selected subject; Extracting main information including local information from the document data based on the template according to the selected topic and the result of the language analysis; Grouping and mapping the document data covering an area within a setting range based on the area information; Comparing the mapped document data and integrated processing according to the comparison result Web information processing method using local information extraction, including. The method of claim 8, The web information processing method may include converting the extracted area information into actual geographical location information. More, The mapping may include grouping and mapping the document data based on the region information and the location information. Web information processing method using local information extraction. The method of claim 9, The converting may include converting the area information into the location information by using the point of interest information. Web information processing method using local information extraction. delete delete The method of claim 8, The mapping may include defining an area within the set range to the same area. Web information processing method using local information extraction. The method of claim 8, In the integrated processing, if the main information is inconsistent according to the comparison result, to correct to match Web information processing method using local information extraction, including.

Images