KR20020061443A - Method and system for data gathering, processing and presentation using computer network - Google Patents

Abstract

PURPOSE: A method and a system for collecting, processing, and displaying information are provided to search information desired by a user from web documents via the Internet, and display the searched information as a desired form. CONSTITUTION: A system(100) for collecting, analyzing and processing information is connected to various Internet sites(150) and a user web browser(180) via the Internet(170). The system(100) receives a search word of information from the user via the user web browser(180). The system(100) collects information from the Internet sites(150), and analyzes and processes collected data before providing it to the user. The system(100) is connected to an external database(160) directly or via the Internet(170), so that the system(100) collects information from the external database(160). The system(100) includes an intelligent-type agent(110), a data process part(120) and a presentation process part(130). The system(100) further includes a database(140) for storing collected, processed information.

Description

Method and system for data gathering, processing and presentation using computer network

The present invention relates to a method and system for collecting, analyzing and processing information using a computer communication network. Specifically, when a user inputs a search word for necessary information, various related information on a web document of the Internet using a search engine The present invention relates to a method and system for collecting and extracting only necessary data from collected documents, reprocessing the database, and providing the same to a user.

Just as the Internet is called the sea of information, a lot of information that exists around the world can be obtained through the Internet. However, since the amount of information is excessively large and the display format of the information is not organized, it is impossible for the user to search all the information and find the desired information. In view of this, many methods are used to help the user find the information he / she wants.

Typical examples include search engines such as Yahoo or Empas. When a user enters a search term for the information they want to find, they search the web documents on the Internet to find related web documents or sites, It provides a link to the site and provides a preview function.

In addition, personalized browsing services are provided that combine specific areas from multiple sites that contain the desired information and simultaneously view them through the user's browser.

However, all of these methods only display the search target information or provide a link to the search target information, so that the user must check all the searched information one by one. Furthermore, in order to reuse the searched information, the collected information is collected by the user. To re-enter the database, create a report, and so on.

Meanwhile, an intelligent agent such as a price comparison engine is used as a method for solving such a problem. Such an intelligent agent may present desired information according to learned rules and present comparison information with respect to the collected specific information. However, the information collection and comparison method by the intelligent agent is also limited to the specific information (for example, the selling price), and simply lists the comparison information for the limited information, and simply displays the comparison information. It does not provide the user with a form that can be reprocessed.

Therefore, not only displaying the desired information, but also finding, analyzing and processing the desired information and presenting it in a visual form to the user or making the database in a form that can be easily reprocessed can greatly reduce the time and cost of information retrieval. It can also be used as a foundation solution for personalized information services.

SUMMARY OF THE INVENTION The present invention has been made in view of this point, and an object thereof is to provide a method and system for collecting, processing, and displaying information that can find desired information from a web document or the like and display the desired information in a desired form through the Internet. .

Another object of the present invention is to provide a method and system for collecting, processing, and displaying information that can be provided to a user in a form capable of reprocessing and extracting desired information from documents collected by searching on the Internet.

Figure 1 is a schematic diagram showing the configuration of the entire system for implementing the information collection, analysis and processing method using a computer communication network of the present invention.

2 is a flowchart illustrating a method for collecting, analyzing and processing information using a computer communication network of the present invention.

FIG. 3 is a diagram visually displaying a process of extracting information from a web document by searching for a web document including desired information in a method for collecting, analyzing, and processing information using a computer communication network of the present invention.

4 is a diagram illustrating a process of formalizing information collected by a method for collecting, analyzing, and processing information using a computer communication network of the present invention.

5 is a diagram illustrating an example of a database including existing information for merging with information collected by the method of collecting, analyzing, and processing information using a computer communication network of the present invention.

FIG. 6 is a diagram illustrating a process of displaying information collected in a method of collecting, analyzing, and processing information using a computer communication network in the form of a table and a graph.

FIG. 7 is a diagram illustrating a process of generating a strategic report using information collected in a method for collecting, analyzing, and processing information using a computer communication network of the present invention.

8 is a diagram illustrating a process of posting information collected in a method for collecting, analyzing, and processing information using a computer communication network as a reprocessable spreadsheet file.

In order to achieve the above object, in the present invention, when a user inputs a search word for finding desired information and specifies a search target, the web document including the desired information is analyzed by using a data collection engine after analyzing the input search word. Search the database and collect data containing the information you want. After extracting the desired information from the collected data using a natural language processing engine or HTML / XML parser, the extracted information is standardized / formalized and stored in a database form. If necessary, the data included in the pre-created and stored database are merged and displayed to the user in a visual form along with the retrieved data, or the data is processed and provided to the user in a reprocessable form such as a spreadsheet file. The display form may be determined according to a user's request, and may be in the form of a web document or a report including a graph or a table, or may be stored in the report by generating the stored data in a sentence.

That is, the method for collecting, processing, and displaying information using a computer communication network according to the present invention includes receiving a search word from a user through a computer communication network, and using the search word, a web document or a database including information indicated by the search word. Searching for; extracting information indicated by the search word from a searched web document or database; standardizing / formalizing the extracted information and storing the information in the form of a database; and displaying the information stored in the form of a database. Receiving an input from the user through, and providing the information stored in the form of a database to the user through a computer communication network according to the display form input from the user.

Herein, in the step of receiving a form for displaying the information from the user, at least one of a table including the information, a graph representing the information, a sentence including the information, and a reprocessable spreadsheet file including the information The user may directly design the display form to include one, or provide a template having various display forms including the information to the user through a computer communication network, and allow the user to select one of the templates.

On the other hand, the information collection, processing and display system using a computer communication network according to the present invention, an input unit for receiving a search word input from a user through a computer communication network, a web document that receives the search word from the input unit and includes the information indicated by the search word Or a data collection engine for searching a database, an information extraction unit for extracting information indicated by the search word from a web document or a database retrieved from the data collection engine, a data processing unit for standardizing / standardizing and storing the information extracted from the information extraction unit, and standardization A database for storing standardized information, and a display unit for providing the user with information stored in the database through a computer communication network.

Here, the information extracting unit removes the HTML / XML tag from the searched web document and extracts the information indicated by the search word from a sentence included in the searched web document and an HTML / XML parser capable of extracting only a portion including the information. It is preferable to include a natural language processing unit capable of doing so.

Preferred embodiments of the present invention will now be described in detail with reference to the drawings.

Figure 1 is a schematic diagram showing the configuration of the entire system for implementing the information collection, analysis and processing method using a computer communication network of the present invention.

Information collection, analysis and processing system 100 of the present invention can be connected to various Internet sites 150 and the user's web browser 180 through the Internet 170, the user through the user's web browser 180 Receives a search word for the information to be collected from, collects information from the Internet site 150, analyzes and processes the data and provides it to the user. In addition, the system 100 of the present invention may be directly connected to external databases 160 that are built in advance or through the Internet, and may collect data from such external databases 160. Information collected from information sources such as Internet site 150 or external database 160 is integrated in the system 100 of the present invention.

The system 100 of the present invention is largely composed of an intelligent agent 110, a data processor 120, and a presentation processor 130, and has a database 140 for storing collected and processed information.

Intelligent agent 110 is involved in data collection and analysis. The intelligent agent 110 is again a data collection engine 111 for retrieving and collecting the desired data through Internet sites, natural language processing engine 112 for processing data consisting of sentences, HTML (HyperText Markup Language) documents or XML (Extensible Markup Language) It is composed of an HTML / XML parser 113 for extracting the desired data from the document data, the data collected and processed by the intelligent agent 110 is transmitted to the data processing unit 120.

The data processing unit 120 includes a data standard / formulation unit 121 for standardizing / standardizing data received from the intelligent agent 110 in a predetermined form, and a database generation unit 122 for generating a database using the same. It consists of a database control unit 123 and the like for controlling. The database 140 generated by the database generator 122 may be called out and used at any time according to a user's needs.

The presentation processing unit 130 processes the data standardized / formulated by the data processing unit 120 and stored in the database 140 in the form required by the user. The presentation processing unit 130 is composed of a presentation component 131, html, XML, XSL generation unit 132, sentence generation unit 133, etc., to generate a presentation of the desired form according to the user's request Provide it back to the user.

Now, the information collection, analysis and processing method using the computer communication network of the present invention implemented using such a system will be described.

2 is a flowchart illustrating a method for collecting, analyzing and processing information using a computer communication network of the present invention.

First, a user inputs a search word to find desired information and selects a search target (S210). Search terms can be entered as words or sentences, and the search target can specify a plurality of web documents, existing knowledge management systems (KMS) or other databases. For web documents, you can also search by specifying a specific site. If you do not specify a search target, you can predefine a search target by default. For example, a user may enter a question such as "what is the size of the Internet advertising market in China?" As a search term.

When a user inputs a search word and a search target, the user searches for a web document, a content database, an existing database, etc., designated as a search target, and collects necessary information (S220). This information collection process is performed through the data collection engine 111 in the intelligent agent 110, which is performed by the operator repeatedly searching the web document to define rules and learn them. This approach has already been implemented in conventional search engines (robots) and the like, and this known method can be used to collect data. For example, in a price comparison site, a surfer tracks links with price information for a specific shopping mall and learns this rule from the search agent, so that the search agent tracks the link according to the rule to get price information. In the data collection step of the present invention can also collect data in this manner.

The next step is to analyze and extract the desired information from the various types of information retrieved (S230). In this step, the natural language processing engine 112, the HTML / XML parser 113, or the like is used. In other words, if necessary, HTML / XML parsing technology is applied to a web document to extract only the necessary data except HTML / XML tags, and within the text, documents, files, and databases that contain the same or similar search terms. The semantic algorithm is applied to the structure of the sentence in the data to analyze its meaning.

3 shows a process of collecting and extracting information through the second and third steps of the present invention. As shown in FIG. 3, the information collection, analysis, and processing system of the present invention searches for web documents, finds documents corresponding to a search word entered by a user (“what is the scale of the Internet advertising market in China?”), And then searches for the corresponding documents. Extract necessary data from That is, in the example shown in FIG. 3, three web documents containing information on the size of the Internet advertising market in China were searched. In the first document, a table representing the size of the Internet advertising market in China was extracted, and the second and third documents were searched. Extracts the part of the article that represents that number.

The extracted data is transferred to the data processor and standardized / formulated and stored in the database (S240). The standardization / formalization of data, for example, unites numeric data units that are organized differently depending on the source of the retrieved data (for example, in units of renminbi (rmb), the Chinese currency, in units of dollars). , Etc.), converting data represented by characters into numbers (eg, modifying data displayed as "two thousand dollars" to "2,000 $", etc.). In addition, by separating the letters, numbers, and the like of the extracted data to create a database according to the structure to store the data in a formal form. An example of this process is shown in FIG. 4. As shown in Figure 4, the information on the size of the Internet advertising market in China, which is shown in the form of tables and articles, respectively, is standardized and standardized in the form of a database representing the market size by year and stored in the database.

Meanwhile, the information requested by the user may exist in a database that is already stored. In this case, this information can be retrieved and added to the extracted information. Figure 5 shows the overseas online advertising market scale data previously stored in the existing database.

Next, the user selects a display form of the information he wants to search (S250). That is, although the data for each media / year as shown in FIG. 4 may be displayed as a table as it is, according to a user's request, the horizontal and vertical axes may be displayed as a table for each year / media or the market size searched for each media. It can be displayed by adding or adding the average value of. In addition, if necessary, data may be selected from a database, and then processed according to a desired representation (for example, mathematical calculation (for example, the amount displayed in units of months) may be modified. In addition, by using the existing database as shown in FIG. 5, the information obtained through the search and the existing information may be integrated and displayed.

In addition, when generating a web screen or a report with the retrieved information, the user may select how to decorate the web screen or the report. This process may provide a variety of templates to the user and allow the user to choose among them, or allow the user to design combinations and layouts of tables, graphs, spreadsheets, and the like.

Now, finally, information is displayed according to the form requested by the user (S260).

The form displayed to the user may be various forms such as a web screen, a result report, a spreadsheet file, and the like, as selected by the user in step S250. When using ActiveX components, various display forms such as grids, graphs, reports, and spreadsheets such as MS-Excel can be implemented.

6 to 8 are diagrams showing the information collected in the last step of the present invention to the user in various forms. In FIG. 6, the information collection result is displayed on a web screen including a table and a graph. FIG. 7 shows a strategy report automatically generated using the collected information. FIG. 8 shows a spreadsheet capable of reprocessing the collected information. This shows posting to a file (eg MS Excel).

When generating the report, in the reverse order of extracting the desired information from the sentence, it is also possible to generate the necessary sentence based on the information extracted and stored in the database to be included in the report.

As described above, unlike the case of a search engine that provides only index / link information, the present invention presents the compared / analyzed / processed knowledge information to the user, and creates strategic knowledge information by interworking with an existing system such as MIS or EIS. do.

Although the present invention has been described in detail with reference to preferred embodiments, this embodiment has been presented for the purpose of understanding the present invention, and the scope of the present invention is not limited to this embodiment. It will be understood by those skilled in the art that various modifications can be made without departing from the scope of the technical idea of the present invention, and the scope of the present invention should be interpreted by the appended claims.

As described above, according to the present invention, time and effort required for information retrieval can be drastically reduced, and the quality of the search results can be improved, and in the case of existing content service companies or portal sites, content by separate manual work is required. It can reduce the collection processing work and save the service operation cost.

In addition, since the processed data is automatically shown in a visual form, intuitive decision making is possible, and a report form display method can be used to reduce an additional report writing task.

Claims (7)

Receiving a search word from a user through a computer communication network, Searching a web document or a database including information indicated by the search word using the search word, Extracting information indicated by the search word from the searched web document or database; Standardizing / standardizing the extracted information and storing the extracted information in the form of a database; Receiving an input from a user through a computer communication network to display the information stored in the form of a database; And providing the information stored in the form of a database to a user through a computer communication network in accordance with a display form input from the user. The method of claim 1, In the step of receiving a form to display the information from the user, A computer communication network in which a user can directly design a display form to include at least one of a table including the information, a graph representing the information, a sentence containing the information, and a file for a reprocessable spreadsheet containing the information. Information collection, processing and display methods used. The method of claim 1, In the step of receiving a form to display the information from the user, A method for collecting, processing, and displaying information using a computer communication network that provides a user with a template having various display forms including the information to a user through a computer communication network, and selects a desired one among the templates. An input unit for receiving a search word input from a user through a computer communication network, A data collection engine receiving the search word from the input unit and searching a web document or a database including information indicated by the search word, An information extraction unit for extracting information indicated by the search word from the web document or database retrieved from the data collection engine; A data processor for standardizing / standardizing and storing information extracted from the information extracting unit; A database for storing the standardized / formalized information, Information collection, processing and display system using a computer communication network comprising a display unit for providing a user with information stored in the database through a computer communication network. The method of claim 4, wherein The display unit displays and provides the information in a form including at least one of a table including the information, a graph representing the information, and a sentence including the information so that a user visually recognizes the information. Information collection, processing and display system using computer network. The method of claim 4, wherein The display unit, information collection, processing and display system using a computer communication network that provides the user with a spreadsheet file that can be processed again. The method of claim 4, wherein The information extracting unit may extract information indicated by the search word from an HTML / XML parser capable of removing an HTML / XML tag from the searched web document and extracting only a part including information and a sentence included in the searched web document. Information collection, processing and display system using a computer communication network including a natural language processing unit.