JP5002631B2 - Word information collection device, word information collection method, and word information collection program - Google Patents

Description

  The present invention relates to a word information collection device, a word information collection method, and a word information collection program that collect information about words included in a web page.

  Conventionally, various information is displayed on a search result page by a search engine on a network in addition to a list of search results corresponding to a specified search word. For example, there are advertisement information related to the search term and specific service information such as shopping related to the search term. Thus, since not only a list of search results but also various information can be displayed, useful information can be provided to the user. Therefore, further enhancement of contents on the search result page is required.

  Here, the search engine stores the word and information related to the web page including the word in association with each other. Based on the information, the search engine performs indexing based on the appearance frequency and importance of the word on the web page. An index for searching is created. At the time of search, since this search index is referred to, information with high indexing (high weight) is displayed at the top of the search result page, and more useful and meaningful information is provided to the user.

  In addition, the search engine circulates through the network, acquires information about the web page, and stores it in the database. Since the web page is updated every day, it is convenient for the user to provide the user with more useful information to quickly notify the update information. As a method for providing such information, for example, a technique is known in which a homepage is circulated regularly and regularly, and a difference on the homepage is detected and analyzed each time (see, for example, Patent Document 1).

JP 2002-73649 A

By the way, various search terms can be input. For example, rare words such as buzzwords may be designated. A buzzword is highly likely to have spread from the web page where it first appeared, and some users want to obtain information on the web page that started the buzz.
However, with the method described in Patent Document 1, the latest information of each web page can be obtained, but information when a specific word first appears on the web page cannot be obtained.

  An object of the present invention is to easily collect information on a web page in which an arbitrary word first appears, and to use the collected information to enhance the content of the web page and to collect word information To provide a method and a word information collection program.

  A word information collection device according to the present invention collects information about words included in a web page on a network, and uses the collected words to generate a search index for performing an index search for a search key A page information acquisition unit that is an information collection device and acquires the update date and time of the web page together with information related to the web page by visiting the network, and a page analysis unit that analyzes the acquired web page and extracts word candidates And registration status determination means for comparing the extracted word candidates with a search index generated in advance from the acquired word candidates and determining whether or not the word candidates are stored in the search index And if it is determined as a result of the determination that it is not stored in the search index, the word candidate Characterized in that and a first-appearing word registration means for storing the first occurrence word storage means in association with the update date and time and information relating to the web page as a Created date.

  The word information collection device of the present invention is a device that collects words contained in a web page on a network and generates a search index for executing an index search for a search key using the collected words. . For this purpose, the page information acquisition means circulates the network and acquires information on the web page (this process is referred to as a crawl process). Here, the information about the web page includes URL (Uniform Resource Locator) information of the web page, text data displayed on the web page, image data, and the like. At this time, the page information acquisition unit also acquires the update date and time of the web page. The page analysis means analyzes the sentence of the acquired web page and extracts word candidates.

  The registration status determination means determines whether or not the extracted word candidate has been registered in the search index. Each time the crawl process is performed, the search index is created for the entire word candidates acquired so far. The first appearing word registering means stores the word candidate judged as unregistered by the registration status judging means in the first appearing word storage means. At this time, the word candidate is associated with the update date and time of the web page acquired by the page information acquisition unit as the first appearance date and time, and the URL information of the web page, text data and image data displayed on the web page, and the like Information relating to the web page is stored in association with each other.

  In the present invention, while performing a normal process of creating a search index for the words collected through the network, on the other hand, first appearance information about the extracted word candidates is collected. The first appearance information is the date and time when an arbitrary word first appears on the web page and information related to the web page. That is, using the crawl processing and index creation processing normally performed by the word information collection device, the registration status determination means and the first appearance word registration means simultaneously collect the first appearance information.

In this way, it is possible to collect first appearance information while creating an index by crawl processing, so it is not necessary to perform processing only for obtaining first appearance information, and it is possible to collect first appearance information of words easily and efficiently. it can.
The first appearance information collected in this way can be displayed on a web page and provided to the user. For example, the content of the search result page can be enhanced by displaying the first appearance information together with the search result list corresponding to the search term designated by the user.

  In the word information collection device of the present invention, when the registration status determination unit determines that the word candidate is stored in the search index, the first appearance word registration unit stores the word candidate in association with the word candidate. It is preferable that the first appearance date and time and the acquired update date and time are compared, and if it is determined that the update date and time is older than the first appearance date and time, the initial appearance date and time of the word candidate is updated with the update date and time.

  In the present invention, the first appearance word registration means performs an update process of the word data stored in the first appearance word storage means. The update process is performed when it is determined that the word candidate extracted by the registration status determination unit has been registered in the search index. That is, since the search index is created for all the word candidates acquired up to the previous time by the previous crawl process, all the words stored in the first appearing word registration means are included in the search index. Therefore, by determining whether or not the word candidate is registered in the search index, it is possible to determine whether or not the word candidate is registered in the first appearance word storage unit.

Each time the update process acquires information on a web page containing an arbitrary word by crawling, the first appearance date and time of the word stored in the first appearance word storage means and the web page acquired simultaneously with the acquisition of the web page information If the update date is older than the first appearance date, the first appearance date associated with the word stored in the first word storage means is updated with the update date, and is associated with the word. Update the information of the current web page with the newly acquired information of the web page. That is, the older the update date and time of a newly acquired web page, the more it is stored in the first word storage means. By repeating such processing, it is possible to collect information about an old web page in which the word appears on the web as a result.
According to the present invention, each time the crawl process is performed, the word data stored in the first appearance word storage means is updated to the information of the web page with the oldest update date and time. Information about the page can be easily collected. Therefore, word first appearance information can be efficiently collected using a normal crawl process.

  In the word information collection device of the present invention, a search word acquisition unit that requests input of a search word to a terminal device connected via the network and acquires the input search word, and the acquired search word The search keyword is searched from the search index, the data search means for acquiring information about the web page associated with the corresponding keyword, and the word that matches the acquired search word is searched from the initial word storage means. And information on the web page associated with the corresponding word and the first appearance date search means, information on the web page acquired by the data search means, and information on the web page acquired by the first word search means And a search result page that creates and distributes a web page that displays the date and time of first appearance. It is preferable to further comprise a providing means.

  In the present invention, the first appearance information collected in the first appearance word storage means is displayed together with a list of search results for the search term designated by the user. That is, in the same way as a search engine that is normally used, the designated search term is acquired, the data of the search term is acquired from the search index, and displayed on the search result page as a list. However, the data of the search term (first appearance date and time, information on the web page) is acquired from the first appearance word storage means, and the data is displayed on the search result page by the search result page providing means and transmitted to the terminal device.

  According to this invention, the user can obtain information different from the search result for the designated search word, that is, first appearance information of the search word. In particular, when post-trend is designated as a search word, the first appearance information for this buzzword can obtain information related to the beginning of the trend, which is useful for the user. In this way, the content of the search result page can be enhanced.

  In the word information collection device of the present invention, the word information collection device further comprises first word registration determining means for determining whether or not a word that matches the extracted word candidate is stored in the first word information storage means. Is determined that the word candidate is not stored in the search index by the registration status determination means, and the word candidate is not stored in the first appearance word information storage means by the first appearance word registration determination means. When it is determined, it is preferable to associate the update date and time with the word candidate and the information about the web page as the first appearance date and store them in the first appearance word storage means.

  The word information collection device of the present invention further comprises first word registration determining means for determining whether or not a word that matches the extracted word candidate is stored in the first word information storage means. The registration means determines that the word candidate is not stored in the search index by the registration status determination means, and the word candidate is stored in the first word information storage means by the first word registration determination means. If it is determined that the word candidate and the information related to the web page are associated with the update date and time as the first appearance date and stored in the first appearance word storage means, the first word registration judgment means determines that the word candidate is the first appearance word. If it is determined that the information is stored in the information storage means, the initial value stored in association with the word candidate is stored. Comparing the update date date and said acquired, if the update time is determined to older than the first appearance time, it is preferable to update the first-appearing time of said word candidates in said update time.

In this invention, before performing the registration process or the update process by the first appearance word registration means, the first appearance word registration determination means determines whether or not the corresponding word candidate is registered in the first appearance word storage means. If the corresponding word has already been registered in the first appearance word storage means, update processing is performed, and if not registered, registration processing is performed.
According to this, even if the word stored in the first word storage means and the word stored in the search index do not match, the registration process or the update process can be surely performed.

  The word information collection method of the present invention collects information about words included in a web page on a network, and uses the collected words to generate a search index for performing an index search on a search key. A method for collecting information, which includes a page information acquisition step for acquiring the update date and time of the web page together with information related to the web page by visiting the network, and a page analysis step for analyzing the acquired web page and extracting word candidates And a registration status determination step of determining whether or not the word candidate is stored in the search index by comparing the extracted word candidate with a search index generated in advance from the acquired word candidate And, as a result of the determination, when it is determined that it is not stored in the search index, A first appearance word registration step of storing the update time to the information about the serial word candidate and the web page first appears word storage means in association with the first appearance time, characterized in that it comprises a.

  According to the present invention, information relating to a web page is obtained by visiting a network, word candidates are extracted by analyzing the web page, and a search index is created for the words extracted so far. On the other hand, the first appearance information about the extracted word candidate is collected. In the present invention, the first appearance information is collected by the registration status determination step and the first appearance word registration step using a normal process of generating a search index by a crawl process.

  Specifically, it is determined whether or not the extracted word candidate is already registered in the search index, and when it is determined that the word candidate is not registered in the search index, the word candidate is registered in the first word storage means. . At the time of registration, the word candidate is associated with the update date and time acquired in the page information acquisition step as the first appearance date and information related to the web page including the word candidate and stored. The search index is created for the entire word candidates acquired so far each time the crawl process is performed.

In this way, it is possible to collect the first appearance information while creating an index by a normal crawl process, so it is not necessary to perform a process only for obtaining the first appearance information, and the first appearance information of the word is collected easily and efficiently. be able to.
Moreover, the first appearance information collected in this way can be displayed on the web page, thereby enhancing the content of the web page.

  In the word information collection method of the present invention, the first appearance word registration step is stored in association with the word candidate when the registration status determination step determines that the word candidate is stored in the search index. It is preferable that the first appearance date and time and the acquired update date and time are compared, and if it is determined that the update date and time is older than the first appearance date and time, the initial appearance date and time of the word candidate is updated with the update date and time.

  In the present invention, when it is determined that the word candidate extracted in the registration status determination step is already registered in the search index, the corresponding word data stored in the first appearance word storage unit is updated. The update process is performed every time the web page information including an arbitrary word is acquired by the crawl process, and the first appearance date and time of the corresponding word stored in the first appearance word storage means and the web page acquired at the same time as the acquisition of the web page information. If the update date is older than the first appearance date, the first appearance date associated with the word stored in the first word storage means is updated with the update date, and is associated with the word. Update the information of the current web page with the newly acquired information of the web page. That is, the older the update date and time of a newly acquired web page, the more it is stored in the first word storage means. By repeating such a process, it is possible to collect information on the web page where the word appears to appear for the first time.

  According to the present invention, each time the crawl process is performed, the word data stored in the first appearance word storage means is updated to the information of the web page with the oldest update date and time. Information about the page can be easily collected. Therefore, word first appearance information can be efficiently collected using a normal crawl process.

The word information collection program of the present invention causes a computer to execute the above-described word information collection method.
According to this invention, since the above-described word information collecting method is executed by the computer, the same operation and effect as described above can be obtained with a simple configuration simply by installing this word information collecting program, and the utility is high. .

1 is a block diagram showing a schematic configuration of a word information collection system according to an embodiment of the present invention. The flowchart which shows operation | movement of the word information collection apparatus in the said embodiment. The schematic diagram of the screen which displayed the search result page which the word information collection apparatus in the said embodiment provides on the terminal device.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the present embodiment, a word information collection system having a search engine function will be described as an example.
[1. Configuration of word information collection system]
As shown in FIG. 1, the word information collection system 1 includes a word information collection device 100 and a terminal device 200 connected to the word information collection device 100 via the Internet 20.

  The Internet 20 is the Internet based on a general-purpose protocol such as TCP / IP, but is not limited to this. For example, an intranet such as a LAN (Local Area Network), a network such as a communication line network or a broadcasting network in which a plurality of base stations capable of transmitting and receiving information via a wireless medium constitute a network, and a medium for directly receiving data Any configuration that transmits and receives data, such as the wireless medium itself, can be used.

The word information collection device 100 has a search engine function and collects initial word information. Here, the first appearance information is information when an arbitrary word first appears on the web page, the date and time (first appearance date) at that time, the URL information of the web page, and the text displayed on the web page Includes information such as data and image data.
As the word information collecting apparatus 100, a commonly used personal computer (PC) is used, and a storage means for storing various information, a control means such as a CPU for performing various calculations, a keyboard, a mouse, and the like. Input means, display means for outputting a web page as a screen display, and the like are provided.

  As shown in FIG. 1, the word information collection device 100 includes an index database 101 as a search index and a first word database 102 as first word information storage as storage means. Although not shown, the word information collection device 100 includes a database that stores various forms for creating a search result page.

  For example, as shown in Table 1 below, the index database 101 has a table structure in which URL (Uniform Resource Locator) information and rank of a web page including the word are associated with each word and stored as one record. It has become. Note that the items are not limited to those listed here, and information that can be displayed as search results, for example, image data related to words, may be added as appropriate.

Ranking is to calculate the degree of association between a word and a web page with respect to a plurality of web pages including an arbitrary word by using various algorithms, and assign it to the web page. As a ranking method, for example, in a web page including the word, the higher the frequency that the word occupies the content of the web page, the higher the degree of importance, or the web page title includes the keyword. If so, it will be ranked with high importance. There is also a method of ranking according to how many links are made to the web page containing the keyword.
In this ranking, each time a crawl process is performed, a search index including newly collected words is created and re-registered in the index database 101.

  For example, as shown in Table 2 below, the first appearance word database 102 stores the first appearance date and time, which is the date and time when the word first appeared on the web page for each word, URL information and cache of the web page including the word. The table structure is associated and stored as one record. The cache stores the contents of the web page. Even when the web page has been updated, the web page before the update can be viewed by displaying the cache. Note that the items are not limited to those listed here, and information that can be displayed as search results, for example, image data related to words, may be added as appropriate.

  The word information collection device 100 includes, as calculation processing means, a word information collection means 110 that collects word information from a web page on a network, a web search means 120 that provides a search result corresponding to a designated search word, However, a transmission / reception means for transmitting / receiving data to / from the terminal device 200 via the network is provided.

The word information collection unit 110 collects word information from the network, and includes page information acquisition unit 111, page analysis unit 112, registration status determination unit 113, first appearance word registration unit 114, and search index generation unit. 115 and first appearance word registration determination means 116.
The page information acquisition unit 111 circulates in the network and acquires information (information on the web page) such as URL information, text data, and image data of the web page published in the network. This process is generally called a crawl process, and each web page is circulated based on the previously created search index, that is, the URL information of the web page stored in the index database 101. In addition, the frequency of the crawl process can be adjusted as necessary.

  The page analysis unit 112 extracts a sentence (text) included in the web page acquired by the page information acquisition unit 111 and performs morphological analysis on the sentence. Morphological analysis is a process of dividing a sentence into meaningful words and determining the part of speech of each word. The page analysis unit 112 acquires words that can be nouns from among a plurality of words obtained by morphological analysis as word candidates.

  The registration status determination unit 113 determines whether the word candidate obtained by the page analysis unit 112 has been registered in the index database 101. The index database 101 stores indexes created for word candidates acquired up to the previous crawl process. Word candidates already registered in the index database 101 are to be updated to the first appearing word database 102, and unregistered word candidates are to be registered.

  The first appearance word registration unit 114 registers or updates the acquired word candidate in the first appearance word database 102. As the registration process, the URL information of the web page in which the word candidate is included in the registered word candidate and the update date and time of the web page are associated with each other and stored in the first word database 102. In addition, as the update process, the word data in the first word database 102 to be updated is compared with the stored first date and time and the obtained update date and time. When the update date and time is older than the first date and time, The first appearance date is updated with the update date.

The search index generation means 115 creates a search index for newly collected word candidates and word information stored in the index database 101, and updates the index database 101 with the created search index.
The first appearance word registration determination means 116 determines whether or not the target word candidate has been registered in the first appearance word database 102 before the registration or update processing of the first appearance word registration means 114. When it is determined that the word candidate has already been registered in the first appearance word database 102, the word candidate is subjected to update processing. On the other hand, if it is determined that the word is not registered, the word candidate is subjected to registration processing.

The web search means 120 provides a search result page corresponding to the search term specified by the terminal device 200, and includes a search word acquisition means 121, an index search means 122, a first word search means 123, and a search result. Page providing means 124.
The search word acquisition unit 121 transmits a search page to the terminal device 200 in response to a request from the terminal device 200. By causing the terminal device 200 to display a search page on which a column for inputting a search term is displayed, the user is allowed to input the search term. The input search term is transmitted from the terminal device 200 to the word information collection device 100 in response to a user request, and the search term acquisition unit 121 acquires the received search term.

The index search means 122 searches the acquired search term from the index database 101, and acquires URL information associated with a keyword corresponding to the search term.
The first appearance word search means 123 searches the acquired first search word from the first appearance word database 102, and acquires the first appearance word corresponding to the search word, the first appearance date and time associated with the first appearance word, URL information, cache, and the like.

  The search result page providing unit 124 creates a search result page and transmits it to the terminal device 200. In the search result page displayed by the display means of the terminal device 200, the first appearance information of the search word is displayed in addition to the list of search results. As the first appearance information, the title of the web page where the search term appears for the first time is displayed, and a link to the web page is put on this title. The web page can be browsed simply by clicking on the title. In addition, the first appearance date and cache are also displayed. Since the contents when the information about the web page is acquired are stored in the cache, even if the web page does not exist, the web page at the time of the first appearance can be browsed.

  Although not shown, the terminal device 200 requests a search service from the word information collection device 100 as an arithmetic processing unit, and receives and outputs a web page of the requested search service, and outputs the web page as a screen display. Output means for input and input means such as a mouse and a keyboard capable of inputting characters. On the other hand, the storage means includes a database for storing form data related to various forms. Although it does not specifically limit as the terminal device 200, For example, a mobile telephone, a notebook personal computer, etc. are mentioned.

[2. Operation of word information collection device 100]
Next, the operation of the word information collection device 100 will be described. In the word information collection device 100, the processing by the word information collection unit 110 and the processing by the web search unit 120 operate separately.

First, the operation of the word information collecting unit 110 will be described with reference to FIG.
In step S <b> 1, the page information acquisition unit 111 circulates a web page that is open to the network, and acquires information about the web page and the update date and time of the web page. Here, the information on the web page is URL information of the web page, text data and image data displayed on the web page, and the update date / time is the date / time normally given when the web page is updated. That is.
Next, in step S2, the page analysis unit 112 extracts the text data of the web page acquired by the page information acquisition unit 111, and performs morphological analysis on the text data. Among a plurality of words obtained by morphological analysis, a word that can be a noun is acquired as a word candidate.

In this way, the following processing is performed for each word candidate obtained from the web page.
In step S3, the registration status determination unit 113 refers to the index database 101 and determines whether the word candidate obtained by the page analysis unit 112 is stored. When the word candidate is stored in the index database 101 (S3: Yes), the process proceeds to step S6. On the other hand, when the word candidate is not stored in the index database 101 (S3: No), the process proceeds to step S4.

  In step S4, the first appearance word registration determination unit 116 refers to the first appearance word database 102 and determines whether the word candidate obtained by the page analysis unit 112 is stored. If the word candidate is stored in the first appearance word database 102 (S4: Yes), the process proceeds to step S6. On the other hand, when the word candidate is not stored in the first appearance word database 102 (S4: No), the process proceeds to step S5.

In step S5, the first appearance word registering means 114 associates the word candidate obtained by the page analysis means 112 with the update date and time of the web page containing the word candidate and the URL information, and stores them in the first appearance word database 102. Proceed to step S8.
In step S6, the first appearance word registering unit 114 searches the first appearance word database 102 for a word that matches the word candidate obtained by the page analysis unit 112, the first appearance date and time associated with the word, and the word candidate. The update date / time of the included web page is compared, and it is determined whether the update date / time is older than the first appearance date / time. If the update date is older than the first appearance date (S6: Yes), the process proceeds to step S7. On the other hand, if the update date is the same as or newer than the first appearance date (S6: No), the process proceeds to step S8.

In step S7, the first appearance word registration unit 114 searches the first appearance word database 102 for a word that matches the word candidate obtained by the page analysis unit 112, and the first appearance date and time associated with the word is determined as the update date and time of the web page. The URL information and cache of the web page associated with the relevant word are updated with the URL information and cache of the web page, and the process proceeds to step S8.
In addition, the process from step S3 to S7 is implemented several times according to the number of word candidates.

  In step S8, the search index generation means 115 generates a search index for the newly collected word candidates and the word information stored in the index database 101, and the index database is generated using the newly generated search index. After updating 101, the process ends.

Next, the operation of the web search means 120 will be described.
First, in order to access the search page provided by the word information collection device 100, for example, the user activates a web browser, inputs an address, and requests the search page. .
When the word information collection device 100 receives a search page request from the terminal device 200 by a transmission / reception means (not shown), the search word acquisition means 121 reads a search page form from a storage means (not shown), and based on the information. To create a search page and send it to the terminal device.

In the terminal device 200, the information on the search page is received by the terminal transmission / reception means and is displayed on the screen by a display means (display or the like) (not shown).
In accordance with the screen display, the user inputs a word (search word) to be searched using the input means and transmits it to the word information collecting apparatus 100.
The word information collection device 100 receives the search word by the transmission / reception means, and the search word acquisition means 121 acquires the search word.

Next, the index search means 122 searches the index database 101 for a word corresponding to the acquired search word, and extracts the corresponding word data.
The first word search means 123 searches the first word database 102 for a word that matches the acquired search word, and extracts the corresponding word data.
Next, the search result page providing unit 124 creates a search result page as shown in FIG. 3 and transmits it to the terminal device 200.

In FIG. 3, the search result page 5 has a search word input area 51, a first appearance information display area 52, and a search result list display area 53.
The search word input area 51 has a search word input field 511 and a search button 512 that can be input by the user. A search term input by the user is displayed in the search term input field 511, and a search button 512 is a button for transmitting a request for re-search to the word information collecting apparatus 100.

  The first appearance information display area 52 includes a title field 521 indicating first appearance information, a URL information field 522 in which the title of the web page is displayed in text, a first appearance date and time field 523 in which the first appearance date and time are displayed, and the web page And a cache column 524 with a link to the cache. In the title column 521, a title for allowing the user to understand that the web page information when the designated search word first appears is displayed. For example, when “Nekonabe” is designated as a search term, the title “Nekobebe first appeared!” Can be displayed. The text displayed in the URL information column 522 has a link to the URL of the web page. Just clicking the URL information column 522 moves to the URL of the web page where the specified search term first appears. The contents can be browsed. In addition, when the cache column 524 is clicked, the contents of the web page when saved in the first appearance word database 102 (first appearance) can be browsed.

  The search result list display area 53 is an area in which data extracted from the index database 101 is displayed as a list. The title of the web page is displayed as text, and the text is linked to the URL of the web page.

  The user can not only browse a list of web pages related to the designated search word by using the search result page displayed on the display unit of the terminal device 200, but also the web page on which the designated search word first appears. Information about can also be obtained.

[3. Effects of this embodiment]
In embodiment mentioned above, there can exist the effect shown below.
In the word information collection unit 110, the page information acquisition unit 111 circulates the network to acquire information about the web page, the page analysis unit 112 acquires the word information from the acquired web page, and the search index generation unit 115 searches. In addition to normal processing in a so-called search engine for creating an index for use, first appearance information related to word information acquired by the registration status determination means and first appearance word registration means 114 is collected. The page information acquisition unit 111 acquires the update date and time of the web page together with information on the web page. Since the first appearing date and time is associated with the word stored in the first appearing word database 102, the first appearing date and time are compared with the acquired update date and time, and the older date and time is re-registered as the first appearing date and time. That is, since the update date and time of the web page to be acquired is updated to an old date and time as needed, the information on the oldest web page can be efficiently collected as a result.
As described above, the first appearance information can be collected easily and efficiently while performing the processing normally performed in the search engine.

Further, the web search means 120 displays the collected first appearance information on the search result page together with the search result list of the search terms designated by the user. As a search term designated by the user, there is a word like a buzzword in addition to a general word. A buzzword is often displayed as a buzzword when it is displayed on a certain web page, and the buzzword often spreads, and there are many users who want to obtain information on a web page that has started a buzzword. In the above embodiment, the web search unit 120 displays, for example, the title of the web page in which the detected word first appears and the date and time of first appearance, for the first appearance information collected by the word information collection unit 110 described above. The search result page is displayed with a link to the URL of the page.
Therefore, the user can obtain the first appearance information of the designated search term and can browse the first appeared web page. Thus, useful information that the user wants to know can be provided together with the search result of the search term, and the content of the search result page can be enhanced.

  Further, in the above embodiment, a cache is displayed as part of the first appearance information on the search result page. Since the web page linked as the first appearance information is old and is often updated thereafter, there is a high possibility that the web page at the first appearance cannot be browsed. However, since the contents of the first appearance web page are stored as a cache in the first appearance word database 102 and displayed as a cache on the search result page, even if the first appearance web page does not exist, the first appearance web page is browsed. be able to. Therefore, information useful for the user can be provided.

[4. Modified example]
In addition, this invention is not limited to embodiment mentioned above, In the range which can achieve the objective of this invention, the deformation | transformation shown below is also included.
For example, in the above embodiment, in the operation of the word information collection unit 110, the first appearance word registration determination unit 116 performs the process of determining whether or not the search word has been registered in the first appearance word database 102 (S4). This process may be omitted. This is because the registration status determination means 113 determines the registration status in the index database 101 in step S3, so that the presence or absence of registration in the first appearance word database 102 can be determined based on this determination result. is there. According to this, the processing speed can be increased.

  Moreover, in the said embodiment, although the page analysis means 112 decomposed | disassembled the sentence into the word candidate by morphological analysis, the method of extracting a word candidate is not restricted to this. You may analyze using the language processing technique generally used, for example, N-gram.

  Further, in the above embodiment, image data may be added as an item of the first appearance word database 102. Image data related to the word is acquired from a web page including an arbitrary word, and the image data is associated with the word and stored in the first appearance word database 102. Therefore, when the first appearance information is displayed on the search result page by the web search means 120, the image data can be displayed as a part of the first appearance information. Since the image data is visual, it is easy for the user to recognize. That is, it is possible to provide information that is easy to understand for the user.

  The present invention can be used for a search engine or the like as a word information collection device that collects word information included in a web page on a network.

DESCRIPTION OF SYMBOLS 100 ... Word information collection apparatus 101 ... Index database 102 ... First appearance word database 110 ... Word information collection means 111 ... Page information acquisition means 112 ... Page analysis means 113 ... Registration status determination means 114 ... First appearance word registration means 115 ... Index generation for search Means 116 ... First appearance word registration determination means 120 ... Web search means 121 ... Search word acquisition means 122 ... Index search means 123 ... First appearance word search means 124 ... Search result page provision means 200 ... Terminal device

Claims (8)

A word information collection device that collects information about words included in a web page on a network and generates a search index for performing an index search on a search key using the collected words.
A page information acquisition unit that circulates the network and acquires the update date and time of the web page together with information about the web page;
Page analysis means for analyzing the acquired web page and extracting word candidates;
A registration status determination unit that compares the extracted word candidates with a search index generated in advance from the acquired word candidates, and determines whether the word candidates are stored in the search index;
As a result of the determination, when it is determined that the word is not stored in the search index, first word registration that associates the update date with the word candidate and information about the web page as the first time and stores it in the first word storage means Means for collecting word information. In the word information collection device according to claim 1,
The first appearance word registration means is:
If the registration status determination means determines that the word candidate is stored in the search index, the first appearance date and time stored in association with the word candidate is compared with the acquired update date and time, and the update date and time is compared. When it is determined that is older than the first appearance date and time, the first appearance date and time of the word candidate is updated with the update date and time. In the word information collection device according to claim 1 or 2,
Search term acquisition means for requesting input of a search term to a terminal device connected via the network and acquiring the input search term;
Data search means for searching for a keyword that matches the acquired search term from the search index, and acquiring information relating to a web page associated with the corresponding keyword;
Searching for a word that matches the acquired search word from the first word storage means, and obtaining information on a web page associated with the corresponding word and a first appearance date and time;
Search result page providing means for creating and distributing a web page displaying information on the web page acquired by the data search means, information on the web page acquired by the first appearance word search means, and the date and time of first appearance, and further provided A word information collection device characterized by that. In the word information collection device according to claim 1,
A first word registration determination unit that determines whether or not a word that matches the extracted word candidate is stored in the first word information storage unit;
The initial word registration means determines that the word candidate is not stored in the search index by the registration status determination means, and the word candidate is stored in the initial word information storage means by the initial word registration determination means. When it is determined that the word candidate is not stored, the word candidate and the information related to the web page are associated with the update date and time as the first appearance date and stored in the first appearance word storage unit. The word information collection device according to claim 2,
A first word registration determination unit that determines whether or not a word that matches the extracted word candidate is stored in the first word information storage unit;
The first appearance word registration means is:
The registration status determining means determines that the word candidate is not stored in the search index, and the initial word registration determining means determines that the word candidate is not stored in the initial word information storage means. If the word candidate and the information related to the web page, the update date and time is associated as the first appearance date and stored in the first appearance word storage means,
If it is determined by the first word registration determination means that the word candidate is stored in the first word information storage means, the first appearance date and time stored in association with the word candidate is compared with the acquired update date and time. If the update date / time is determined to be older than the first appearance date / time, the word information collection device updates the first appearance date / time of the word candidate with the update date / time. A method of collecting word information for collecting information about words contained in a web page on a network and generating a search index for performing an index search on a search key using the collected words,
A page information acquisition step of acquiring the update date and time of the web page together with the information about the web page by visiting the network;
A page analysis step of analyzing the acquired web page and extracting word candidates;
A registration status determination step of comparing the extracted word candidates with a search index generated in advance from the acquired word candidates and determining whether the word candidates are stored in the search index;
As a result of the determination, when it is determined that the word is not stored in the search index, first word registration that associates the update date with the word candidate and information about the web page as the first time and stores it in the first word storage means A word information collecting method comprising: a step. In the word information collection method according to claim 6,
The first appearance word registration step includes:
If it is determined in the registration status determination step that the word candidate is stored in the search index, the first appearance date and time stored in association with the word candidate is compared with the acquired update date and time, and the update date and time is compared. If it is determined that is older than the first appearance date and time, the first appearance date and time of the word candidate is updated with the update date and time.   A word information collecting program for causing a computer to execute the word information collecting method according to claim 6.

Images