JP2008269392A - Device, method, and program for processing web page information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device, a method, and a program for avoiding, as much as possible, a situation in which a user cannot acquire desired information to be shown across a plurality of Web pages. <P>SOLUTION: A device for processing Web page (2) includes a Web page acquisition means acquiring a Web page including characteristic expression data expressing that content is shown across the plurality of Web pages; an aggregate data generation means generating aggregate data configured to enable aggregating web pages of which the content items are related to one another out of Web pages acquired by the acquisition means; and a result data generation means generating result data configured to be displayed on a user terminal (81) in an aspect in which Web pages that can be aggregated are aggregated with the aggregate data. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a web page information processing apparatus, a web page information processing method, and a web page information processing program.

  In recent years, it has become possible for anyone to publish their diaries, opinions, etc. on a web page by using a user terminal that can communicate via the Internet, and there are many web pages represented by blogs (abbreviations of Weblog). Existing.

  So, if you want to view other users' experiences about what you are interested in, such as travel reports, new product reports, newly opened store reports, movie reports, etc., use a search engine. And narrow down the web pages related to the things you want to browse. At this time, the narrowed-down web pages include web pages that are highly related to matters to be browsed and web pages that are less relevant.

Recently, a technique that can automatically extract only a necessary portion from a web page to be browsed has been proposed (for example, Patent Document 1). According to this technology, for example, even when information different from information desired by a user is included in one web page, a necessary portion including desired information is automatically acquired. Therefore, it is possible to reduce the burden on the user when obtaining desired information from one web page.
JP 2006-277090 A

  However, according to the above technique, when the desired information is shown across a plurality of web pages, a part of the desired information shown on one web page can be efficiently acquired, but the remaining desired information Since it is difficult to specify the web page on which the information is shown, there is a possibility that the desired information cannot be acquired as a result. Conventionally, web page information is generally searched by inputting a keyword representing desired information to a search engine, but search results are ranked and displayed for each page. For this reason, even if a page having a topic of desired information is found, if the topic spans a plurality of pages, it is necessary to follow the link further from the page and search for the previous and subsequent pages.

  Therefore, an object of the present invention is to provide an apparatus, a method, and a program capable of avoiding as much as possible a situation in which a user cannot acquire desired information shown across a plurality of web pages.

  In order to solve the problems as described above, in the web page information processing apparatus, the web page information processing method, and the web page information processing program, the present invention aggregates web pages that can be aggregated by aggregated data related to keywords. According to another aspect of the present invention, it is configured to generate result data configured to be displayed by a user terminal and configured to be displayed by a user terminal on a web page that can be aggregated by aggregated data related to a keyword.

  More specifically, the following is provided.

(1) Result configured to be communicable with a user terminal via a network and configured to display a web page searched based on a keyword designated by the user using the user terminal. A web page information processing apparatus for transmitting data to the user terminal,
Web page acquisition means for acquiring a web page including feature expression data representing content being shown across a plurality of web pages from a number of web pages managed by the user using the user terminal;
Aggregated data generating means for generating aggregated data configured to be capable of aggregating web pages related to the content among the web pages acquired by the web page acquiring means;
A web page that can be aggregated by aggregated data related to the keyword is configured to be displayed by the user terminal in an aggregated manner, and a web page that can be aggregated by the aggregated data related to the keyword is displayed by the user terminal. Result data generating means for generating result data configured to be displayed;
Search result transmitting means for transmitting result data generated by the result data generating means to the user terminal;
A web page information processing apparatus comprising:

  According to the structure of (1), it is comprised so that the web page which can be aggregated by the aggregated data relevant to a keyword by the search result transmission means will be displayed by the user terminal in an aggregated manner, and the aggregate related to the keyword. Result data configured such that a web page that can be aggregated by data is displayed by the user terminal is transmitted to the user terminal.

  Therefore, even when the desired information is shown across multiple web pages, the web page that can be aggregated by aggregated data related to the keyword related to the information desired by the user is displayed on the user terminal. Therefore, it becomes possible to easily specify the web page on which the desired information is shown.

  Therefore, according to the said structure, the situation where a user cannot acquire the desired information shown ranging over a some web page can be avoided as much as possible.

(2) The web page information processing apparatus according to (1),
The web page acquisition means includes the feature expression data, start data indicating that a series of stories starts, continuation data indicating that a sequence of stories continues, and end data indicating that a series of stories is over A web page information processing apparatus that acquires a web page including at least one.

  According to the configuration of (2), when the user wants to browse a web page indicating that a series of stories starts, it is possible to save the user from searching for this web page as much as possible.

(3) The web page information processing apparatus according to (2),
Based on the date and time information indicating the date and time included in the web page acquired by the web page acquisition means and the period information indicating the period, the web page indicating that the series of stories continues and the series of stories are ended. Web page discrimination means for discriminating web pages is provided,
The aggregate data generation means generates aggregate data including the discrimination information determined by the web page determination means,
The result data generation unit generates result data configured to be displayed by the user terminal in a manner in which a web page determined based on determination information included in aggregated data related to the keyword is identified. A web page information processing apparatus.

  According to the configuration of (3), even if it is a web page related to a keyword, it is displayed by the user terminal in a manner in which web pages that are not related to a series of stories are excluded from the aggregated web pages. It is possible to reduce the burden on the user when continuously browsing a series of stories shown across a plurality of web pages.

(4) The web page information processing apparatus according to any one of (1) to (3),
The aggregated data generation unit is a web page information processing apparatus that generates aggregated data including information on the URL of the web page acquired by the web page acquisition unit.

  According to the configuration of (4), since the aggregated data is generated including the information on the URL of the web page acquired by the web page acquisition unit, the web page associated with the URL information is displayed on the user terminal. Result data configured to be generated can be generated.

(5) The web page information processing apparatus according to any one of (1) to (4),
The aggregated data generation unit generates aggregated data configured to be capable of aggregating web pages having relatively high web page similarity among the web pages acquired by the web page acquiring unit. Page information processing device.

  According to the configuration of (5), even if it is a web page related to a keyword, it is displayed by the user terminal in a manner in which web pages with low similarity are excluded from the aggregated web pages. It is possible to reduce the burden on the user when browsing a series of stories shown across pages.

(6) A web page information processing apparatus configured to be communicable with a user terminal via a network displays a web page searched based on a keyword designated by the user using the user terminal. A web page information processing method for transmitting result data configured to be transmitted to the user terminal,
A web page acquisition step of acquiring a web page including feature expression data representing content being shown across a plurality of web pages from a large number of web pages managed by the user using the user terminal;
An aggregated data generating step for generating aggregated data configured to be able to aggregate the webpages whose contents are related among the webpages acquired by the webpage acquiring step;
A web page that can be aggregated by aggregated data related to the keyword is configured to be displayed by the user terminal in an aggregated manner, and a web page that can be aggregated by the aggregated data related to the keyword is displayed by the user terminal. A result data generation step for generating result data configured to be displayed;
A search result transmission step of transmitting the result data generated by the result data generation step to the user terminal;
A web page information processing method characterized by comprising:

  According to the configuration of (6), even if the desired information is shown across a plurality of web pages, the web pages that can be aggregated by the aggregated data related to the keywords related to the information desired by the user are aggregated. Since it is displayed by the user terminal in such a manner, it becomes possible to easily specify the web page on which the desired information is shown. According to this configuration, it is possible to avoid as much as possible the situation in which the user cannot obtain desired information shown across a plurality of web pages.

(7) A web page information processing apparatus configured to be communicable with a user terminal via a network displays a web page searched based on a keyword designated by the user using the user terminal. A web page information processing program for transmitting result data configured to the user terminal,
A web page acquisition step of acquiring a web page including feature expression data representing content being shown across a plurality of web pages from a large number of web pages managed by the user using the user terminal;
An aggregated data generating step for generating aggregated data configured to be able to aggregate the webpages whose contents are related among the webpages acquired by the webpage acquiring step;
A web page that can be aggregated by aggregated data related to the keyword is configured to be displayed by the user terminal in an aggregated manner, and a web page that can be aggregated by the aggregated data related to the keyword is displayed by the user terminal. A result data generation step for generating result data configured to be displayed;
A search result transmission step of transmitting the result data generated by the result data generation step to the user terminal;
Web page information processing program characterized by causing a computer to execute.

  According to the configuration of (7), even if the desired information is shown across a plurality of web pages, web pages that can be aggregated by aggregated data related to keywords related to the information desired by the user are aggregated. Since it is displayed by the user terminal in such a manner, it becomes possible to easily specify the web page on which the desired information is shown. According to this configuration, it is possible to avoid as much as possible the situation in which the user cannot obtain desired information shown across a plurality of web pages.

  ADVANTAGE OF THE INVENTION According to this invention, the situation where a user cannot acquire the desired information shown ranging over a some web page can be avoided as much as possible.

  Hereinafter, an embodiment of the present invention will be described with reference to FIGS.

[Configuration of Web Page Information Processing System 1]
The configuration of the web page information processing system 1 will be described with reference to FIG.

  As shown in FIG. 1, the web page information processing system 1 includes a web page information processing apparatus 2, a user terminal 81, a network 82, and a public database server 90. In the web page information processing system 1, the web page information processing apparatus 2, the user terminal 81, and the public database server 90 are configured to be able to communicate with each other via a network 82.

  The user terminal 81 is configured so that the user can search and browse web pages for displaying content such as documents and images published on the Internet. The public database server 90 includes a database (for example, a blog DB 91 described later). The public database server 90 operates the database in response to a request from the outside (for example, the user terminal 81) (for example, obtains data according to the request from the data stored in the database), and requests the request source. Send data according to. The configuration of the web page information processing apparatus 2 will be described later.

[Configuration of Web Page Information Processing Apparatus 2]
The web page information processing apparatus 2 includes a blog analysis server 10, a search server 20, and a database server 30.

  The blog analysis server 10 includes an article acquisition unit 11, a feature expression extraction unit 12, a start / end article determination unit 13, a continuous article determination unit 14, a story aggregation unit 15, and an index generation unit 16.

  The article acquisition unit 11 is posted on a so-called blog, which is published on a web page managed and managed by an individual or a group of several people, from the blog DB 91 included in the public database server 90 that can communicate via the network 82. Articles that have been posted (hereinafter referred to as "articles") are acquired. More specifically, the article acquisition unit 11 acquires articles from a plurality of blog DBs 91 included in a plurality of public database servers 90 capable of communication.

  The feature expression extraction unit 12 includes feature expression data indicating that contents are shown across a plurality of articles from the sentence example DB 31 of the database server 30 (more specifically, start data indicating that a series of stories starts, a series of Continuation data indicating that the story of (1) continues, and end data indicating that the series of stories ends). Details of the feature expression data will be described later. Then, the feature expression extraction unit 12 extracts an article including feature expression data from the article acquired by the article acquisition unit 11.

  Here, the sentence example DB 31 is provided in the database server 30, but is not limited thereto. For example, it may be provided in the blog analysis server 10 or may be provided in a predetermined database server outside the web page information processing apparatus 2. The same applies to the index DB 32. On the other hand, the blog DB 91 is provided in the public database server 90 outside the web page information processing apparatus 2, but is not limited thereto. For example, the blog DB 91 may be provided inside the web page information processing apparatus 2. That is, the web page information processing apparatus 2 may include the blog DB 91.

  Based on this, the web page information processing apparatus 2 manages a web page including feature expression data indicating that contents are shown across a plurality of web pages by the user using the user terminal 81. It can be said that a web page obtaining means for obtaining from a large number of web pages is provided.

  The start / end article discriminating unit 13 includes an article indicating that a series of stories starts (hereinafter referred to as “starting article”) and an article indicating that the series of stories ends (hereinafter referred to as “starting articles”) from the articles extracted by the feature expression extracting unit 12. "End article"). More specifically, the start / end article determination unit 13 determines an article including start data as a start article, and determines an article including end data as an end article.

  The continuation article determination unit 14 determines an article (hereinafter referred to as “continuation article”) indicating that a series of stories continues from the article extracted by the feature expression extraction unit 12. More specifically, the continuation article determination unit 14 determines an article including continuation data as a continuation article.

  The story aggregating unit 15 aggregates articles related to the contents of articles (articles related to a series of stories) from the articles extracted by the feature expression extracting unit 12. More specifically, the story aggregating unit 15 associates one article with another article based on date information indicating date and time and period information indicating a period included in at least one of the one article and another article. If one is determined to be related, one article and another article are aggregated. For example, when the date and time information “Departure on December 10” and the period information “I will go on a trip for 3 days and 4 nights” are included in one article, the story aggregation unit 15 includes the date and time information “ If "December 12 morning" is included, it is determined that these articles are related.

  In addition to or instead of this, the story aggregating unit 15 aggregates articles related to a series of stories based on the similarity of the articles. That is, the story aggregating unit 15 aggregates articles having a relatively high degree of similarity among articles extracted by the feature expression extracting unit 12. For example, weights are added to words or phrases included in the title of the start article to obtain a similarity to the start article. At this time, it is preferable that the story aggregation unit 15 determines that there is a relationship when the similarity is greater than a specific value. The method for obtaining the similarity is a known technique.

  The index generation unit 16 generates an index including aggregated data indicating the results aggregated by the story aggregating unit 15. Here, the aggregated data is configured to be able to aggregate articles related to the contents among the articles extracted by the feature expression extraction unit 12. The generated index is stored in the index DB 32. Details of the index will be described later.

  Therefore, the web page information processing apparatus 2 includes aggregated data generation means for generating aggregated data configured to be able to aggregate the web pages related to the contents among the web pages acquired by the web page acquisition means. I can say that.

  The search server 20 includes an index acquisition unit 21, a search result generation unit 22, and a search result transmission unit 23.

  The index acquisition unit 21 acquires an index related to the keyword specified by the user using the user terminal 81 from the index DB 32. More specifically, the index acquisition unit 21 acquires an index including a keyword or a part of the keyword, and an index including aggregated data that matches the aggregated data included in the index.

  Based on the index acquired by the index acquisition unit 21, the search result generation unit 22 generates result data configured to display an article related to the keyword on the user terminal 81. For example, the result data includes URL information used when the user displays a link for browsing an article. Further, the search result generation unit 22 generates result data configured to be displayed by the user terminal 81 in a manner in which articles that can be aggregated by aggregated data related to keywords are aggregated. Note that details of the manner in which articles are aggregated will be described later.

  For this reason, the web page information processing apparatus 2 is configured to be displayed by the user terminal 81 in a manner in which web pages that can be aggregated by aggregated data related to keywords are aggregated, and are associated with the keywords. It can be said that the apparatus includes result data generating means for generating result data configured such that web pages that can be aggregated by the aggregated data are displayed by the user terminal 81.

  The search result transmission unit 23 transmits the result data generated by the search result generation unit 22 to the user terminal 81. More specifically, the result data generated by the search result generation unit 22 is transmitted to the user terminal 81 that requested the article search.

  Therefore, it can be said that the web page information processing apparatus 2 includes a search result transmission unit that transmits the result data generated by the result data generation unit to the user terminal 81.

  The database server 30 includes a sentence example DB 31 and an index DB 32. The database server 30 responds to requests from the blog analysis server 10 (more strictly speaking, the article acquisition unit 11 and the index generation unit 16) and the search server 20 (more strictly speaking, the index acquisition unit 21). The index DB 32 is operated to transmit data corresponding to the request to the request source.

  As described above, the web page information processing apparatus 2 includes the web page acquisition unit, the aggregated data generation unit, the result data generation unit, and the search result transmission unit.

  According to this configuration, even in a case where desired information is shown across a plurality of web pages, web pages that can be aggregated by aggregated data related to keywords related to information desired by the user are aggregated. Since it is displayed by the user terminal, it becomes possible to easily specify the web page on which the desired information is shown. Therefore, according to the web page information processing apparatus 2, it is possible to avoid as much as possible the situation in which the user cannot acquire desired information shown across a plurality of web pages.

[Main processing in the web page information processing system 1]
With reference to FIG. 2, main processing in the web page information processing system 1 will be described. In the web page information processing system 1, basically, a series of processes starts when the user terminal 81 detects a search request described later.

(Search request)
The user terminal 81 detects an operation (hereinafter referred to as “search request”) in which a user makes a search request based on a keyword. When detecting the search request, the user terminal 81 transmits search request data for acquiring an article related to the keyword to the search server 20 (search request transmission). The search request data includes information on keywords. On the other hand, when receiving the search request data, the search server 20 transmits the received search request data to the database server 30 (search request transmission).

(Search execution)
Upon receiving the search request data, the database server 30 indexes the index related to the keyword based on the keyword information contained in the search request data (in other words, the keyword specified by the user using the user terminal 81). Obtain from DB32. When the database server 30 acquires the index related to the keyword, the database server 30 transmits index reply data including the index information to the search server 20 (result reply).

(Result data generation)
Upon receiving the index reply data, the search server 20 generates result data based on the index information included in the index reply data. When the search server 20 generates the result data, the search server 20 transmits the result data to the user terminal 81 (result reply).

(Result display)
When the user terminal 81 receives the result data, the user terminal 81 displays a screen corresponding to the result data. More specifically, the user terminal 81 displays the articles related to the keyword in an aggregated manner and displays the articles related to the keyword in a manner that can be browsed (for example, an article in which the user is related to the keyword). Link to view.) An example of the screen will be described later.

(Article request)
The user terminal 81 detects an operation (hereinafter referred to as “article request”) in which a user requests an article based on a screen corresponding to the result data. When the user terminal 81 detects an article request, the user terminal 81 transmits browsing request data for acquiring an article specified by the user to the public database server 90 (article browsing request transmission).

(Get articles)
When the public database server 90 receives the browsing request data, the public database server 90 acquires an article corresponding to the browsing request data from a database (for example, the blog DB 91). When the public database server 90 acquires an article corresponding to the browsing request data, the public database server 90 transmits article data configured to be displayed on the user terminal 81 to the user terminal 81 (result reply).

(Result display)
When receiving the article data, the user terminal 81 displays an article corresponding to the article data. As described above, the web page information processing system 1 performs a series of processes.

[Example of screen displayed by user terminal 81]
An example of a screen displayed by the user terminal 81 will be described with reference to FIG. FIG. 3 shows a result display screen 40 which is an example of a screen corresponding to the result data. The result display screen 40 mainly includes a text box 41, a search button 42, a search mode switching link 43, a title 44, a start link 45, a continuation link 46, an end link 47, and a page switching link 48.

  The text box 41 is an input unit provided for inputting a keyword related to an article desired by the user. The search button 42 is an operation unit provided for the user to perform an operation for requesting a search. The search mode switching link 43 is a search mode switching unit provided for switching between a normal search that is a conventional search and a story search that searches for articles related to a series of stories. The title 44 is a title of a series of stories shown in an article searched based on a keyword. The start link 45 is a reference section for a start article. For example, when the user presses the start link 45 using an input unit described later, a start article is displayed on the user terminal 81. The continuation link 46 is an inquiry section for continuation articles. The end link 47 is an end article reference section. The page switching link 48 is a page switching unit provided to refer to articles that are not displayed on the screen among the collected articles.

  Here, an example of a screen displayed by the user terminal 81 when the user inputs “first overseas trip” as a keyword into the text box 41 using the input means described later and presses the search button 42. The characteristics of a certain result display screen 40 will be described. Although the story search is designated as the search mode, the time when this is designated may be before the search button 42 is pressed or after the search button 42 is pressed.

  The result display screen 40 shows an aspect in which articles related to keywords are aggregated. The aggregated mode is, for example, the mode of the start link 45, the continuation link 46, and the end link 47. These are aligned so that the user can easily recognize them. Furthermore, these are identified so that the user can easily recognize them.

  More specifically, the start link 45, the continuation link 46, and the end link 47 are numbered and arranged according to the order in which a series of experiences about overseas travel is developed. The start link 45 is identified by, for example, “beginning” as a word (or phrase) indicating that a series of experiences about overseas travel starts, and the start article is identified. On the other hand, for example, “end” is added to the end link 47 as a word (or phrase) indicating that a series of experiences relating to overseas travel ends, and the end article is identified.

  Based on these, even if a series of experiences is shown across multiple articles, these articles are aggregated, aligned, and displayed in an identified manner, so This makes it possible to save the user from having to read through a series of experiences that he wants to browse from a database of articles.

[Example of feature expression data]
An example of feature expression data will be described with reference to FIGS. 4 and 5. 4 and 5 show the ID, the attribute, and the content of the feature expression data (feature expression).

  The ID is information for uniquely identifying a certain record (in other words, feature expression data) from the sentence example DB 31. The attribute indicates a portion (for example, a title, a text, etc.) that has a relatively high possibility of including feature expression data among the portions constituting the article. And the attribute is matched with the feature expression data. In general, feature expression data associated with the attribute “A” is often included in the title, and feature expression data associated with “B” is often included in the text.

  Here, with respect to the feature expression data, “Example #NUM” corresponding to ID “1”, “Part 2” corresponding to ID “40”, and “End” corresponding to ID “193” are taken as examples. explain. “#NUM” is basically an arbitrary natural number. Therefore, “No. #NUM episode” indicates “No. 1 episode”, “No. 2 episode”, “No. 3 episode”, and the like.

  For example, when the feature expression is “first episode”, it means that the feature expression data related to this feature expression is start data. When the feature expression is “second edition”, it means that the feature expression data related to this feature expression is continuous data. When the feature expression is “end”, it means that the feature expression data related to this feature expression is end data. As described above, the feature expression data is data that represents that a series of contents are shown across a plurality of articles and can identify a start article, a continuation article, and an end article. In addition, when the feature expression is “second episode”, it means that the feature expression data related to this feature expression is continuation data or end data. It is determined based on date information, period information, and the like.

  The addition, change, and deletion of feature expression data may be performed manually or may be performed by applying a machine learning technique. For machine learning, there are known methods such as support vector machine and naive bayes, and the weights described later are determined by using them, and feature expressions (for example, characteristic words) are acquired based on the determined weights. can do.

  That is, the blog analysis server 10 may include a weight determination unit that determines weights by machine learning, and a feature expression acquisition unit that acquires feature expressions based on the weights. At this time, the blog analysis server 10 determines whether or not the predetermined article is a single article (hereinafter referred to as “single article”), in other words, the predetermined article is a continuous article (hereinafter referred to as “continuous article”). It is preferable to provide a single / continuous article discriminating unit that discriminates whether or not there is based on the weight of words (for example, nouns, verbs) included in a predetermined article.

  An example in which the blog analysis server 10 determines a single article and a continuous article will be described with reference to FIG. First, an example in which the blog analysis server 10 performs the following steps 1 to 3 and determines the weight will be described.

(Step 1)
Articles necessary for learning are given to the blog analysis server 10. For example, four articles shown in the learning case table are given to the blog analysis server 10. In the attributes shown in FIG. 6, continuous articles are represented as “I” and single articles as “B”.

(Step 2)
The blog analysis server 10 takes out words included in the article and counts the number of times these words appear (so-called number of appearances). The result is, for example, a table of the number of appearances. The number next to the word indicates the number of appearances.

(Step 3)
The blog analysis server 10 weights each by machine learning and creates a list (so-called weight list). The result is, for example, a weight list table. In the embodiment, for example, article NO. When the blog analysis server 10 determines that 1 is a single article, and the weight of “night play” is “0”, the weight is set to “1” (= “0 + 1”). The same applies to “yesterday”, “first time”, “night”, “banff”, “town”, and “going out”. On the other hand, article NO. When the blog analysis server 10 determines that 4 is a continuous article and the weight of “good morning” is “0”, the weight is “−1” (= “0 + (− 1)”). And The same applies to “morning”, “wrinkle”, “foot”, “show”, and “rude”.

  That is, the blog analysis server 10 changes the weight by the number of appearances for each word in the article when the single article and the continuous article are erroneously determined. Then, the blog analysis server 10 determines the final weight by repeating the determination many times (for example, 10 times, ideally, until all cases are correctly answered). As a result, a word having a large weight becomes a feature expression. Note that a feature expression created manually may be added to the weight list (for example, with a large weight).

  Then, the blog analysis server 10 determines that an article including many words having a large weight is a continuous article. As an example of this determination, an example is given when the blog analysis server 10 is given an article that says, “I went to a souvenir shop yesterday. explain.

  First, the blog analysis server 10 uses words and the number of occurrences of words from the above article (in this example, “Yesterday: 1, souvenir: 2, go: 1, buy: 1, baggage: 1, send: 1, consultation: 1)). Subsequently, the blog analysis server 10 calculates a score based on the number of appearances of the word and the weight of the weight list. More specifically, the blog analysis server 10 calculates a score by multiplying the number of appearances of a word by a weight value corresponding to the word. Subsequently, the blog analysis server 10 calculates the sum of the scores obtained from each word included in this article. In this example, the sum is 28 × 1 + 11 × 2 + 7 × 1 = 57. Finally, the blog analysis server 10 determines that this article is a continuous article because the sum is equal to or greater than a certain threshold (for example, 0 or more). The blog analysis server 10 determines that this article is a single article if the sum is less than the threshold.

[Example of index]
An example of an index will be described with reference to FIG. FIG. 7 shows an ID, a category, a state identifier, a URL, a title, and a text (excerpt). In addition, description of an example is abbreviate | omitted in "..." shown in FIG.

  The ID is information for uniquely identifying a certain record (in other words, an index) from the index DB 32. The classification is information for identifying the aggregated data. The status identifier is information for identifying each of the start article, the continuation article, and the end article. The URL indicates the location of the article. The title indicates the title of the article. The text (excerpt) indicates a part of the text of the article. More specifically, the text (excerpt) is an excerpt of a predetermined number of characters from the text that is highly related to the title. Note that the entire text may be used instead of the text excerpt.

  The index is composed of an ID, a category, a status identifier, a URL, a title, and a text (extract), but is not limited thereto. For example, the index may be configured to include the date and time when the article was created in addition to these. Further, for example, the index may be configured by a section, a state identifier, and a URL. In this case, the search server 20 acquires the URL of the article related to the keyword from the public database server 90 instead of transmitting the search request. The search server 20 refers to the index DB 32 and searches for the index based on the acquired URL.

[Operation of Blog Analysis Server 10]
With reference to FIG. 8, the main processing executed in the blog analysis server 10 will be described.

  First, the blog analysis server 10 refers to the blog DB 91 and acquires an article (S1). At this time, it is preferable that the blog analysis server 10 obtains an article from one blog DB 91 and obtains an article from another blog DB 91 after the processing of S2 to S9 is performed. That is, it is good also as a structure by which the process of S1-S9 is performed for every blog DB91.

  Subsequently, the blog analysis server 10 refers to the sentence example DB 31 and acquires feature expression data (S2). In addition, although it is the structure by which the process of S2 is performed after the process of S1 is performed, it is not restricted to this. A configuration in which the processing in S1 is performed after the processing in S2 may be performed, or the processing in S1 and the processing in S2 may be performed in parallel.

  Subsequently, the blog analysis server 10 extracts an article whose feature expression is included in the title of the article (S3). More specifically, the blog analysis server 10 extracts an article in which feature expression data having an attribute “A” is included in the title of the article.

  Subsequently, the blog analysis server 10 extracts articles whose feature expressions are included in the body of the article (S4). More specifically, the blog analysis server 10 extracts an article in which feature expression data having an attribute “B” is included in the body of the article. At this time, it is preferable to extract articles from the articles excluding the articles extracted in S3. Note that the blog analysis server 10 employs a configuration in which an article including feature expression data having an attribute “B” is included in the body of the article, but is not limited thereto. For example, the blog analysis server 10 may be configured to extract an article in which feature expression data having an attribute “A” or “B” is included in the body of the article.

  Subsequently, the blog analysis server 10 determines a start article and an end article from the extracted articles (S5). More specifically, the blog analysis server 10 determines whether start data is included in the extracted article. At this time, when the blog analysis server 10 determines that the start data is included, the blog analysis server 10 generates determination data in which the state identifier indicates “S”. Furthermore, the blog analysis server 10 determines whether or not end data is included in the extracted article. At this time, when the blog analysis server 10 determines that the end data is included, the blog analysis server 10 generates determination data in which the state identifier indicates “E”.

  Subsequently, the blog analysis server 10 determines a continuation article from the extracted articles (S6). More specifically, the blog analysis server 10 determines whether continuation data is included in the extracted article. At this time, when the blog analysis server 10 determines that the continuation data is included, the blog analysis server 10 generates determination data in which the state identifier indicates “C”.

  Subsequently, the blog analysis server 10 collects articles related to the content (S7). More specifically, the blog analysis server 10 determines whether one article and another article are related based on date information and period information. At this time, if the blog analysis server 10 determines that there is a relationship, the blog analysis server 10 generates aggregated data configured to aggregate one article and another article. The generated aggregated data includes classification information, URL information, discrimination data, and the like.

  On the other hand, the blog analysis server 10 determines a continuation article and an end article from the aggregated articles based on date information and period information. For example, when the blog analysis server 10 includes date and time information “Departure on December 10” and period information “I will go on a trip for 3 days and 4 nights” in one article, the date and time information “ If “December 12 morning” is included, it is determined that the other article is a continuation article, and the date and time information “December 13 morning” indicating the final date of the period information is included in the other article. If so, it is basically determined that the other article is the end article. However, there is an article with relatively high similarity in which the date and time information (for example, “December 18 morning”) later than the date and time information indicated in other articles is included in the aggregated articles. Then, even if the date and time information indicating the last date (or the last time) of the period information is included in another article, the article may be determined to be a continuing article.

  Based on this, the web page information processing apparatus 2 continues a series of stories based on the date information indicating the date and time included in the web page acquired by the web page acquisition means and the period information indicating the period. It can be said that there is provided a web page discrimination means for discriminating a web page indicating that a web page is indicating to be performed and a web page indicating that a series of stories are to be ended.

  Here, the above-mentioned content is demonstrated with reference to FIG. When the blog analysis server 10 determines the continuation article based on the date information and the period information, for example, the continuation article corresponding to the ID “2”, the continuation article corresponding to the ID “3”, and the ID “4” are supported. When it is determined that the story progresses according to the continuing article, the identifiers “1”, “2”, and “3” are attached to the state identifiers corresponding thereto. Therefore, the status identifier is information for identifying each of the start article, the continuation article, and the end article, and for identifying the order in which a series of stories progresses. That is, it can be said that the blog analysis server 10 includes story combination means for combining these articles so that the aggregated articles become a series of stories.

  Subsequently, the blog analysis server 10 generates an index based on the determined result and the aggregated result (S8). More specifically, the blog analysis server 10 generates an index including aggregated data.

  Subsequently, the blog analysis server 10 transmits registration request data for registering the generated index to the database server 30 (S9). When the database server 30 receives the registration request data, the database server 30 stores an index corresponding to the registration request data in the index DB 32.

  Although illustration is omitted, these processes basically start automatically at a predetermined cycle (preferably once a day) (so-called batch processing). However, it may be configured to start when the search button 42 is pressed (so-called real-time processing). If real-time processing is adopted, it is preferable to acquire an article related to the keyword in S1. Then, after or instead of S9, the blog analysis server 10 transmits the generated index (that is, index data including index information) to the search server 20. And the search server 20 will generate result data based on this index data, if index data is received.

[Operation of Search Server 20]
With reference to FIG. 9, main processing executed by the search server 20 will be described.

  First, the search server 20 generates result data with reference to the index DB 32 (S11). For example, when the keyword is “first overseas trip”, the search server 20 includes the keyword or a part of the keyword (which may be a character related to the keyword) in the title and the text (excerpt). Search the index. At this time, if an index having an ID of “1” is searched, all indexes having a classification of “1” are acquired. Specifically, the search server 20 is configured so that each article aggregated based on the URL included in the acquired index is displayed by the user terminal 81, and based on the category “1” included in the acquired index. State identifiers “S” and “C” that are configured to be displayed by the user terminal 81 in a manner in which articles corresponding to IDs “1” to “5” that can be aggregated are aggregated. And the result data configured to be displayed by the user terminal 81 in a manner in which the start article, the continuation article, and the end article are identified based on “E”. If a plurality of result data can be generated, each result data may be generated so that the above-mentioned contents are displayed by the user terminal 81 in descending order of the date and time when the start article was created. Each result data may be generated so that the content is displayed by the user terminal 81 in descending order. Furthermore, a configuration in which the user can specify these is preferable.

  Subsequently, the search server 20 transmits the result data to the user terminal 81 (S12).

[Server hardware configuration]
FIG. 10 is a diagram illustrating a hardware configuration of the blog analysis server 10, the search server 20, the database server 30, and the public database server 90 (hereinafter referred to as “server”). CPU 110 constituting a control unit (a plurality of CPUs such as CPU 120 may be added in a multiprocessor configuration), bus line 105, communication I / F 140, main memory 150, BIOS 160, USB port 190, I / O controller 170, and Input means such as a keyboard and mouse 180 and a display device 122 are provided.

  Storage means such as a tape drive 172, a hard disk 174, an optical disk drive 176, and a semiconductor memory 178 can be connected to the I / O controller 170.

  The BIOS 160 stores a boot program executed by the CPU 110 when the server is started, a program depending on the server hardware, and the like.

  The hard disk 174 stores various programs for functioning as a server and programs for executing the functions of the present embodiment, and various databases can be configured as necessary.

  As the optical disk drive 176, for example, a DVD-ROM drive, a CD-ROM drive, a DVD-RAM drive, or a CD-RAM drive can be used. In this case, the optical disk 177 corresponding to each drive is used. A program or data may be read from the optical disk 177 by the optical disk drive 176 and provided to the main memory 150 or the hard disk 174 via the I / O controller 170. Similarly, the tape medium 171 corresponding to the tape drive 172 can be used mainly for backup.

  The program provided to the server is provided by being stored in a recording medium such as the hard disk 174, the optical disk 177, or a memory card. This program may be installed in the server and executed by being read from the recording medium via the I / O controller 170 or downloaded via the communication I / F 140.

  The above program may be stored in an internal or external storage medium. Here, in addition to the hard disk 174, the optical disk 177, or the memory card, a magneto-optical recording medium such as an MD, or a tape medium 171 can be used as the storage medium. Further, a storage device such as a hard disk 174 or an optical disk library provided in a server system connected to a dedicated communication line or a communication line such as the Internet may be used as a recording medium, and the program may be provided to the server via the Internet.

  Here, the display device 122 displays various screens and displays a calculation result screen by the server, and includes a display device such as a cathode ray tube display device (CRT) or a liquid crystal display device (LCD). .

  The communication I / F 140 is a network adapter that enables the server to be connected to the user terminal 81 via a network 82 (for example, a dedicated network, a public network, etc.). The communication I / F 140 may include a modem, a cable modem, and an Ethernet (registered trademark) adapter.

  In the above example, the server has been mainly described. However, the functions described above can be realized by installing a program in a computer and operating the computer as a server. Therefore, the functions realized by the server described as the present embodiment can be realized by executing the above-described method by the computer, or by introducing the above-described program into the computer and executing it.

  Although the embodiment has been described above, the present invention is not limited to the above-described embodiment. Moreover, the effect by this invention is not limited to what was described in embodiment.

The figure which shows the structure of a web page information processing system. The figure which shows the main processes in a web page information processing system. The figure which shows the example of the screen displayed by a user terminal. The figure which shows the example of feature expression data. The figure which shows the example of feature expression data. The figure which shows the example in which a blog analysis server discriminate | determines a single article and a continuous article. The figure which shows the example of an index. The flowchart which shows the main processes performed with a blog analysis server. The flowchart which shows the main processes performed with a search server. The figure which shows the structure of the hardware of a server.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Web page information processing system 2 Web page information processing apparatus 10 Blog analysis server 11 Article acquisition part 12 Feature expression extraction part 13 Start / end article discrimination | determination part 14 Continuation article discrimination | determination part 15 Story aggregation part 16 Index generation part 20 Search server 21 Index Acquisition unit 22 Search result generation unit 23 Search result transmission unit 30 Database server 31 Example DB
32 Index DB

Claims (7)

Result data configured to be communicable with a user terminal via a network and configured to display a web page searched based on a keyword specified by a user using the user terminal is displayed by the user terminal. A web page information processing apparatus for transmitting to a user terminal,
Web page acquisition means for acquiring a web page including feature expression data representing content being shown across a plurality of web pages from a number of web pages managed by the user using the user terminal;
Aggregated data generating means for generating aggregated data configured to be capable of aggregating web pages related to the content among the web pages acquired by the web page acquiring means;
A web page that can be aggregated by aggregated data related to the keyword is configured to be displayed by the user terminal in an aggregated manner, and a web page that can be aggregated by the aggregated data related to the keyword is displayed by the user terminal. Result data generating means for generating result data configured to be displayed;
Search result transmitting means for transmitting result data generated by the result data generating means to the user terminal;
A web page information processing apparatus comprising: The web page information processing apparatus according to claim 1,
The web page acquisition means includes the feature expression data, start data indicating that a series of stories starts, continuation data indicating that a sequence of stories continues, and end data indicating that a series of stories is over A web page information processing apparatus that acquires a web page including at least one. The web page information processing apparatus according to claim 2,
Based on the date and time information indicating the date and time included in the web page acquired by the web page acquisition means and the period information indicating the period, the web page indicating that the series of stories continues and the series of stories are ended. Web page discrimination means for discriminating web pages is provided,
The aggregate data generation means generates aggregate data including the discrimination information determined by the web page determination means,
The result data generation unit generates result data configured to be displayed by the user terminal in a manner in which a web page determined based on determination information included in aggregated data related to the keyword is identified. A web page information processing apparatus. The web page information processing apparatus according to any one of claims 1 to 3,
The aggregated data generation unit is a web page information processing apparatus that generates aggregated data including information on the URL of the web page acquired by the web page acquisition unit. The web page information processing apparatus according to claim 1,
The aggregated data generation unit generates aggregated data configured to be capable of aggregating web pages having relatively high web page similarity among the web pages acquired by the web page acquiring unit. Page information processing device. A web page information processing apparatus configured to be communicable with a user terminal via a network so that a web page searched based on a keyword specified by a user using the user terminal is displayed by the user terminal. A web page information processing method for transmitting result data configured to the user terminal,
A web page acquisition step of acquiring a web page including feature expression data representing content being shown across a plurality of web pages from a large number of web pages managed by the user using the user terminal;
An aggregated data generating step for generating aggregated data configured to be able to aggregate the webpages whose contents are related among the webpages acquired by the webpage acquiring step;
A web page that can be aggregated by aggregated data related to the keyword is configured to be displayed by the user terminal in an aggregated manner, and a web page that can be aggregated by the aggregated data related to the keyword is displayed by the user terminal. A result data generation step for generating result data configured to be displayed;
A search result transmission step of transmitting the result data generated by the result data generation step to the user terminal;
A web page information processing method characterized by comprising: A web page information processing apparatus configured to be communicable with a user terminal via a network so that a web page searched based on a keyword specified by a user using the user terminal is displayed by the user terminal. A web page information processing program for transmitting the configured result data to the user terminal,
A web page acquisition step of acquiring a web page including feature expression data representing content being shown across a plurality of web pages from a large number of web pages managed by the user using the user terminal;
An aggregated data generating step for generating aggregated data configured to be able to aggregate the webpages whose contents are related among the webpages acquired by the webpage acquiring step;
A web page that can be aggregated by aggregated data related to the keyword is configured to be displayed by the user terminal in an aggregated manner, and a web page that can be aggregated by the aggregated data related to the keyword is displayed by the user terminal. A result data generation step for generating result data configured to be displayed;
A search result transmission step of transmitting the result data generated by the result data generation step to the user terminal;
A web page information processing program comprising:

Images