KR100645742B1 - Method and apparatus for collecting search data by getting various data including web document creation - Google Patents

Abstract

A method and a device for collecting search data by obtaining diverse information including web document generation are provided to collect the new search data in real-time by checking whether a webpage is generated or updated by inserting a specific image into the webpage when the webpage is generated and checking a request for loading the image in real-time when the webpage is displayed. An image storing part(302) receives a transfer request for the specific image and transmits the image to a web browser(330) as a homepage referring to the image is read/displayed by the web browser. A URL(Uniform Resource Locator) information storing part(308) stores homepage search history information. A determiner(304) determines whether the homepage is appeared in the Internet first or not by referring to URL information of the homepage referring to the image and the URL search history information stored in the URL information storing part. A data collector(306) collects search-related information by connecting to the homepage in case of the first appeared homepage and increases a visit counter of the homepage in other cases.

Description

Method and apparatus for collecting search data by acquiring various information including web document creation {Method and apparatus for collecting search data by getting various data including web document creation}

1 is a reference diagram for explaining the exchange of information about a web page between a web server and a search data collection server by inserting an image file into a web document;

2 is a diagram illustrating an example of a web page including an image for confirmation;

3 is a block diagram of an apparatus for collecting search data according to an embodiment of the present invention;

4 is a flowchart of a search data collection method according to an embodiment of the present invention;

5 is a diagram illustrating an example of a web page source file with a comment field inserted.

The present invention relates to information retrieval, and more particularly, to a method and apparatus for collecting new retrieval data by acquiring various information including web document generation using a specific image included in a web page.

In recent years, countless web pages have been created and disappeared on the Internet. Therefore, for information retrieval, the information collection server must visit a web page on the Internet and collect data, and it is very difficult to search and collect data of web pages generated and lost so many times in real time.

That is, conventionally, the information collection server has a limited depth of search in collecting data by visiting web pages on the Internet, and thus it is difficult to search all the information, and it is difficult to collect frequently updated information in real time because the search period is long. . As a method for solving such a problem, there is a method of reporting a visited URL by installing a specific program in a user terminal, but there is a problem such as a risk or security of personal information leakage.

Accordingly, the technical problem to be achieved by the present invention is to find out whether a web page is newly created or updated by inserting a specific image when the web page is produced and checking the loading request of the image in real time as the web page is displayed. It is to provide a method and apparatus for collecting search data that makes it possible to collect my new search data in real time.

Another technical problem to be achieved by the present invention is to add a comment field such as title, author, and creation date to the source file of the web page, and to provide a search data collection method and apparatus for more accurately knowing the overview information of the web page. To provide.

According to the present invention, according to the present invention, as a home page referring to a specific image is read and displayed by a user browser, the request for transmission of the specific image and location information of the home page referring to the image are received and the image is recalled. Sending to a browser; Determining whether the home page is a home page that first appears on the Internet by referring to the location information; And if the home page is the first home page, accessing the home page to collect search related information, and otherwise increasing the visit counter of the corresponding home page. do.

Preferably, the location information is a URL (Uniform Resource Locator) of the home page, and the location information is received through a referrer of a web server managing the home page.

In addition, when collecting search-related information by accessing the home page, it is preferable to extract information including the title, author, and creation date of the home page document by analyzing comment information included in a source file of the home page. .

On the other hand, according to another aspect of the present invention, the technical problem is an image storage unit for receiving a request to transmit the specific image and transmits to the browser, as the home page that is referenced to the specific image is read and displayed by the user browser; A URL information storage unit which stores at least one home page search history information; A determination unit determining whether the home page is a home page that first appears on the Internet by referring to location information of a home page referring to the image and a URL search history stored in the URL information storage unit; And a data collection unit for accessing the home page to collect search-related information when the home page is the first home page as a result of the determination, and increasing the visit counter of the corresponding home page. It is also achieved by the device.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a reference diagram for explaining the exchange of information on a web page between a web server and a search data collection server by inserting an image file into a web document.

Web servers # 1 to # 3 (110a to 110c) manage and manage web pages. As an example, if there is a web document written in the html source file 150 in the web server # 1 110a, the document is displayed as shown in the web page 160 shown. The html source file 150 includes location information of a specific image. For example, an image tag including a Uniform Resource Locator (URL) 152 is inserted. Referring to FIG. 1, for example, a tag such as <img src = "http://lastsnow.1noon.net/lastsnow.gif"> may be inserted. That is, a file called lastsnow.gif is stored in a server having the domain name lastsnow.1noon.net, and it can be seen that the web page 160 is read by reading this file.

When the user's web browser 105 connects to web server # 1 110a to read a web page with the html source file 150, the user's web browser 105 interprets the html source file 150 and finally Meet <img src = "http://lastsnow.1noon.net/ lastsnow.gif"> Accordingly, the server is connected to the server having the domain name lastsnow.1noon.net, and the "lastsnow.gif" file is loaded and transmitted to the user's web browser 105. In addition, the web browser 105 transmits the URL, which is the location information of the web document including the image “lastsnow.gif”, to the search data collection server 100 through the referrer. Then, the search data collection server 100 checks the search database which it owns and collects the data by accessing the URL if the URL is the first URL. If this is not the first URL that appears, increment the visitor counter for that URL by one. Therefore, when a web page is created and loaded into the user's web browser 105 for the first time, the web page can be checked in real time to add search information of the web page to the search server and easily count the number of visitors of the web page. .

2 is a diagram illustrating an example of a web page including an image for confirmation.

Referring to FIG. 2, it can be seen that the confirmation image 210 is included in the last portion of the home page 200. The confirmation image 210 may be a visible image or may be invisible.

3 is a block diagram of a search data collection apparatus according to an embodiment of the present invention.

The search data collection device 300 includes an image storage unit 302, a determination unit 304, a data collection unit 306, and a URL information storage unit 308. When a web page referring to a specific image stored in the search data collection device 300 is read by the user's web browser 330, the user accesses the search data collection device 300 that stores the image to display the image. The image is received from the image storage unit 302. As described above with reference to FIG. 1, the determination unit 304 receives the URL of the web server 310 through the referrer and determines whether the corresponding URL is the first URL. The URL information storage unit 308 stores URL information collected by the search data collecting device 300 and a counter of visitors who visit the URL. That is, the search data collecting device 300 stores a history of URLs for collecting data.

The determination unit 304 accesses the data collection unit 306 to read the search data when the received URL is the first URL. When the data collection unit 306 transmits the collected search data to the search server 320, a user who accesses the search server 320 receives a search word and receives a result. On the other hand, if the received URL is a URL that has already been collected, the visit counter of the corresponding URL is increased by one and stored in the URL information storage unit 308.

4 is a flowchart of a search data collection method according to an embodiment of the present invention.

When the search data collection apparatus 300 receives the request message of the specific image stored in the search data and the URL information requesting the image through the referrer (S410), the corresponding image is first transmitted (S420). Then, it is determined whether the URL is the first URL (S430). If the URL is the first URL, the access data is collected by accessing the URL (S440) and the visit counter of the URL is increased by one (S450). If this URL is not the first URL to appear, it is a URL that has already collected data, and since there is no need to collect data again, only one visit counter is increased (S450).

5 is a diagram illustrating an example of a web page source file with a comment field inserted.

The html source file 500 includes several tags. For example, you can use the title tag as <title> first sight </ title> to represent the title of a web page. However, when creating a web page, the contents of these tags are often not properly inserted, which makes it difficult to use this information.

Thus, referring to FIG. 5, information such as title 510, author 520, or creation date 530 can be inserted into a web page source file of the present invention using a comment tag, and the information collection server analyzes these comments. By doing so, attribute information of the web document can be extracted. For example, the title inserts a tag like <!-/ Title: First Snow Co ./-->, the author inserts a tag like <!-/ By: administrator /->, and the creation date is < Insert a tag such as!-/ Created: 20050719 /->.

On the other hand, the above-described search data collection method can be created by a computer program. Codes and code segments constituting the program can be easily inferred by a computer programmer in the art. In addition, the program is stored in a computer readable media, which is read and executed by a computer to implement a search data collection method. The information storage medium includes a magnetic recording medium, an optical recording medium, and a carrier wave medium.

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

As described above, according to the present invention, it is possible to find a new web page in real time and collect search data or to report the number of visits of the web page in real time so that the search data can be updated in real time and the management of the web page can be efficiently performed. You can do That is, whenever a web page containing a specific image is read using a referrer, the URL that requests the loading of the image is automatically reported, so that the number of readings of the document can be known. Therefore, the reliability of the web page, the degree of issue, etc. Not only can it be used as a measure, it can also collect and update information in real time regardless of the complexity of the URL path of the web page.

In addition, by adding a comment field to a web page, related information such as title, author, creation date, etc. of the web page can be easily identified.

Claims (10)

As the home page referring to a specific image is read and displayed by a user browser, receiving a request for transmission of the specific image and location information of the home page referring to the image and transmitting the image to the browser; Determining whether the home page is a home page that first appears on the Internet by referring to the location information; And And if the home page is the first home page, accessing the home page to collect search related information, and otherwise increasing the visit counter of the home page. The method of claim 1, And the location information is a URL (Uniform Resource Locator) of the home page. The method of claim 1, And the location information is received through a referrer of a web server managing the home page. The method of claim 1, When accessing the home page and collecting search related information, the search information is analyzed by extracting information including the title, author, and creation date of the home page document by analyzing comment information included in the source file of the home page. How data is collected. The method of claim 4, wherein And the comment is inserted into the home page source file according to a tag format such as <!-/ Comment /->. An image storage unit which receives a request for transmission of the specific image and transmits it to the browser as a home page referring to the specific image is read and displayed by a user browser; A URL information storage unit which stores at least one home page search history information; A determination unit determining whether the home page is a home page that first appears on the Internet by referring to location information of a home page referring to the image and a URL search history stored in the URL information storage unit; And And a data collector configured to access the home page to collect search-related information when the home page is the first home page as a result of the determination, and to increase the visit counter of the corresponding home page. . The method of claim 6, wherein the determination unit And receiving location information of the home page through a referrer of the web server managing the home page. The method of claim 6, wherein the data collection unit When accessing the home page and collecting search related information, the search information is analyzed by extracting information including the title, author, and creation date of the home page document by analyzing comment information included in the source file of the home page. Data collection device. The method of claim 8, And the comment is inserted into the home page source file according to a tag format such as <!-/ Comment /->. A computer-readable recording medium having recorded thereon a program for executing the method of any one of claims 1 to 5 on a computer.

Images