KR20000038979A - System supporting mobile computation for collecting news information and method for the same - Google Patents

Abstract

PURPOSE: A system supporting a mobile computation for collecting news information and a method for the same are provided to gather sections of an online newspaper and magazine on web sites of the internet, and extract desired news records from the gathered sections in real time, by allowing a developer to indicate a target of the extracted news records easily and simply in response to variance of the web sites. CONSTITUTION: A hypertext transfer protocol(HTTP) communication part(10) collects each section supported with a hypertext markup language(HTML) document from the online newspaper and magazine web sites on the internet. A noise removing part(20) removes a noise in the document collected by the HTTP communication part(10). A pattern input part(40) provides a regular pattern requested by a developer or user. A pattern matching part(30) converts the web document without the noise to a regular string, and matches the converted regular string with the inputted regular pattern and thereby extracts the newspaper records. A personal digital assistance(PDA) installing part(50) supplies the extracted newspaper records to a user and automatically installs the records selected by the user in a PDA(60).

Description

News information collection system and collection method supporting mobile computing

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a news information collection system and collection method that supports mobile computing, and more particularly, to collect sections of online magazines and newspapers supported in the form of Hypertext Markup Language (HTML) documents on the web of the Internet. In addition, the present invention relates to a news information collection system and a collection method that can provide a user with a newspaper article record through a predetermined process.

In recent years, with the advent of the information society, the World Wide Web has become commonplace, and the advancement of the Internet of the media and broadcasting media sites such as newspapers, TVs, and magazines has become prominent. These sites change their content at regular intervals, and continue to increase their impact on the web based on their reputation in other media.

Conventional techniques for collecting and processing information in HTML format and providing it to a user in an online web site related to the present invention can be broadly classified into two types.

First, it is a push solution that sends newspaper article information to the user based on the newspaper classification preferred by the existing user. Such push solutions, particularly press and broadcast media, allow users to view newspaper articles as if they were watching TV channels without having to search for them directly using a web browser. According to this push solution, the user first selects the user's preference among the internal classifications of "politics", "economy", "society", and the like, and the time when the user's computer terminal is idle for the article information about the preferences. On the server sends it extracted from the newspaper site. A good example is when the user's computer terminal is idle. Thus, there are many push solutions in the form of a user's screensaver application. This was the form of an early push solution, which was later used for a variety of applications in addition to personalized newspapers.

Secondly, there is a shopping agent having a product information retrieval technology, and the technology related to this shopping agent is disclosed in the following literature.

Kim Hyun-don et al., "Development of a Shopping Agent with a Comparison Purchasing Function," Proceedings of the Korean Information Science Society, 24 (2), 289-292, 1997. In addition, the present invention discloses a method of enabling a comparative purchase on the web by adding a function of comparing and analyzing search results.

RB Doorenbos et al, "A Scalable Comparison-Shopping Agent for the World-Wide Web", Proceedings of the 1 ^st International Conference on Autonomous Agents, 1 (1), 39-48, 1997, A shopping agent that consists of a learner that automatically generates data for a universal interface module for querying indexes and interpreting results, and a shopping agent that parses user queries and sends queries against the searchable indexes of online stores based on it. Is described.

However, the above-mentioned push solutions have to be supplied with article information using a predetermined protocol by a contract with a news or magazine site, or the article information can be retrieved from a newspaper site by using a code that is imperatively implemented by human hands. Extract. Therefore, in the push solution method, the method of extracting newspaper articles by the code implemented by the temporal adaptation method has a decisive disadvantage that the already written code becomes useless when the newspaper site is changed.

In addition, in the case of a shopping agent for product information retrieval, the online store is trained to generate a regular expression pattern representing the desired product information. Since the regular expression pattern is obtained as is from a web document without noise removal, The problem was that if you change, you have to learn again.

As a result, the object of the present invention is to be in real-time by pointing out a target to extract article information in a simple and easy way, while being more resistant to changes in the web site than the conventional method from such a periodically changing newspaper or magazine site. The present invention provides a news information collection system and a collection method for extracting article information.

1 is a block diagram of a system for collecting news information supporting mobile computing according to the present invention;

2 is an overall flowchart of a news information collection process supporting mobile computing according to the present invention;

3 is a detailed flowchart illustrating a noise removing process in the news information collecting process shown in FIG. 2;

FIG. 4 is a detailed flowchart illustrating a pattern matching process among news information collecting processes illustrated in FIG. 2.

Explanation of symbols on the main parts of the drawings

10: HTTP communication unit 20: noise removing unit

30: pattern matching section 40: pattern input section

50: PDA installation unit

In order to achieve the above object, a news information collection system according to an aspect of the present invention,

An HTTP communication unit that collects, by HTTP (Hypertext Transfer Protocol) communication, each side of a newspaper supported in the form of an HTML document from an online newspaper or magazine site on the web of the Internet;

A noise removing unit for removing noise present in the newspaper article document collected by the HTTP communication unit;

A pattern input unit for inputting a regular expression pattern required by a developer or a user,

The pattern matching unit converts the web document from which the noise is removed by the noise removing unit into a regular expression string, extracts a newspaper article record by matching the converted regular expression string with a regular expression pattern input by a developer or a user through the pattern input unit. Characterized in that provided.

In addition, the news information collection system according to another aspect of the present invention, characterized in that it further comprises a PDA installation unit for presenting the extracted newspaper articles to the user and automatically installs the article selected by the user to a PDA (Personal Digital Assistant) do.

At this time, the noise canceling unit, each of the records constituting the list of newspaper article documents collected by the HTTP communication unit anchor tag conversion module for converting the surrounding anchor tag into a form that the pattern matching unit is easy to process; It is preferable to include a tag removal module for deleting unnecessary tags in the newspaper article document converted the anchor tag.

The pattern matching unit may include a regular expression string generator for converting a web document from which noise is removed by the noise removing unit into a regular expression string, and a developer or user through the regular expression string converted by the regular expression string generator and the pattern input unit. It is preferable to have a regular expression string matcher that matches the regular expression pattern inputted by s, and extracts, as a record of the article list, the portion of the web document corresponding to the substring that has been successfully matched.

In addition, the news information collection method according to an aspect of the present invention,

Collecting, by HTTP communication, each side of a newspaper supported in the form of an HTML document from an online newspaper or magazine site on the web of the Internet;

Removing noise present in the collected newspaper article;

Entering the regular expression pattern required by the developer or user;

And converting the noise-free web document into a regular expression string, extracting a newspaper article record by matching the converted regular expression string and the input regular expression pattern.

In addition, the news information collection method according to another aspect of the present invention, characterized in that it further comprises the step of presenting the extracted newspaper article to the user and automatically install the article selected by the user on the PDA.

The inventors note that each side of the online magazines and newspapers supported in the form of HTML documents on the web of the Internet serves as a list of articles, and thus, the characteristics of the small changes in the parts irrelevant to the actual information of the target site are solid. It is possible to provide a news information collection system and a collection method that can extract the desired article information by using the noise reduction technology that allows to have it, and the pattern matching technology that can extract the desired information with the simple instruction of the developer. As a result of discovering and intensive research, the present invention has been completed.

Hereinafter, a preferred embodiment of a news information collection system and a collection method according to the present invention supporting mobile computing will be described in more detail with reference to the accompanying drawings.

1 is a block diagram of a news information collection system supporting mobile computing according to the present invention. As shown in FIG. 1, a news information collection system according to a preferred embodiment of the present invention is located on the web of the Internet. An HTTP communication unit 10 which collects each side of a newspaper supported in the form of an HTML document from an online newspaper or magazine site by HTTP communication, and removes noise present in the newspaper article document collected by the HTTP communication unit 10. Converting the noise canceling unit 20, a pattern input unit 40 for inputting a regular expression pattern required by a developer or a user, and the web document from which noise is removed by the noise removing unit 20 to a regular expression string, And a pattern matching unit 30 which matches the regular expression string converted by the developer or user through the pattern input unit 40 and extracts a newspaper article record. Presenting to the user and exported newspaper article further includes a PDA installation section 50 to automatically install the article selected by the user on the PDA (60).

The noise removing unit 20 converts each of the records constituting the list of newspaper article documents collected by the HTTP communication unit 10 into a form that the pattern matching unit 30 can easily process. An anchor tag conversion module 21 and a tag removal module 22 for deleting unnecessary tags from the newspaper article document in which the anchor tags are converted are provided.

In addition, the pattern matching unit 30 includes a regular expression string generator 31 for converting a web document from which noise is removed by the noise removing unit 20 to a regular expression string, and the regular expression string generator 31 for conversion. A regular expression string matcher that matches the regular expression string inputted by a developer or a user through the pattern input unit 40, and extracts a web document part corresponding to a successful substring as a record of an article list ( 32).

FIG. 2 is a flowchart illustrating a process of collecting news information supporting mobile computing according to the present invention. In the news information collecting method according to the present invention, first, in the form of an HTML document from an online newspaper or magazine site on the web of the Internet, FIG. Each side (political, economic, etc.) of the supported newspapers is collected by HTTP communication to obtain a newspaper article document M1 (S10). Next, the noise existing in the collected newspaper article document M1 is removed to obtain a web document M2 from which the noise is removed (S20). Thereafter, the noise-free web document M2 is converted into a regular expression string, and the converted regular expression string is matched with the regular expression pattern M3 inputted by the developer or the user (S40) (S30), and then matched by the pattern. By extracting the newspaper article record M4, news information is collected. Thereafter, the newspaper articles M4 extracted through the above process are presented to the user, and the article selected by the user is automatically installed in the PDA 60 (S50).

3 is a detailed flowchart illustrating a noise removing process in the news information collecting process illustrated in FIG. 2, and the noise removing process will be described in detail with reference to FIG. 3. The newspaper article M1 obtained above is like a list document of articles, and each record constituting the list is surrounded by an anchor tag. Therefore, the most important tag in the newspaper article corresponds to the anchor tag. Such an anchor tag is converted into a form that is easy to process in a pattern matching process to be described later, thereby obtaining a newspaper article document M5 obtained by converting the anchor tag (S21). Thereafter, unnecessary tags are deleted from the newspaper article document M5 with the anchor tag converted to obtain a web document M2 from which the noise is removed (S22).

FIG. 4 is a detailed flowchart illustrating a pattern matching process in the news information collecting process shown in FIG. 2. As shown in FIG. 4, the web document M2 from which noise is removed through the noise removing process is converted into a regular expression string. (S31). Thereafter, the converted regular expression string is matched with the regular expression pattern M3 indicated by the developer or the user (S32). In this case, when there is a successful substring, the portion of the noise-deleted web document M2 corresponding to the string corresponds to the title of the article as a record of the article list.

According to the present invention, by collecting each side of the online magazines and newspapers supported in the form of HTML documents on the web of the Internet in real time, and through the noise reduction process and pattern matching process, it is more resistant to changes in the website than the conventional method At the same time, the developer can extract the desired article information in real time by pointing out a target to extract the article information in a simple and easy way. In addition, by allowing the user to automatically select articles extracted from the newspaper articles thus extracted on a multimedia mobile terminal such as a PDA, for example, a user automatically receives newspaper information on a web site in the morning and transmits it to the PDA. After storage, newspaper information can be easily obtained on the go without accessing the web.

Moreover, the present invention provides various functions such as comparing different viewpoints of newspaper articles provided by online newspapers and magazines, scraping related articles, enabling automatic retrieval on the client side of a specific article, and the like. do.

Therefore, the news information collection system and collection method according to the present invention can be effectively used in push solutions, personalized news servers, information search agents and the like.

Claims (6)

An HTTP communication unit that collects, by HTTP communication, each side of a newspaper supported in the form of an HTML document from an online newspaper or magazine site on the web of the Internet, A noise removing unit for removing noise present in the newspaper article document collected by the HTTP communication unit; A pattern input unit for inputting a regular expression pattern required by a developer or a user, The pattern matching unit converts the web document from which the noise is removed by the noise removing unit into a regular expression string, extracts a newspaper article record by matching the converted regular expression string with a regular expression pattern input by a developer or a user through the pattern input unit. News information collection system, characterized in that provided. The method of claim 1, And a PDA installation unit for presenting the extracted newspaper articles to a user and automatically installing articles selected by the user on a PDA. The method of claim 1, The noise canceling unit, Each record constituting the list of newspaper article documents collected by the HTTP communication unit is an anchor tag conversion module for converting the surrounding anchor tag into a form that the pattern matching unit is easy to process; News information collection system characterized in that it comprises a tag removal module for deleting unnecessary tags in the newspaper article converted the anchor tag. The method of claim 1, The pattern matching unit, A regular expression string generator for converting a web document from which noise is removed by the noise removing unit into a regular expression string; A regular expression that matches a regular expression string converted by the regular expression string generator with a regular expression pattern input by a developer or a user through the pattern input unit, and extracts a web document part corresponding to a successful division string as a record of an article list. News information collection system comprising a string matching device. Collecting, by HTTP communication, each side of a newspaper supported in the form of an HTML document from an online newspaper or magazine site on the web of the Internet; Removing noise present in the collected newspaper article; Entering the regular expression pattern required by the developer or user; And converting the noise-free web document into a regular expression string, extracting a newspaper article record by matching the converted regular expression string and the input regular expression pattern. The method of claim 5, And presenting the extracted newspaper articles to a user and automatically installing articles selected by the user on a PDA.