JP5225369B2 - Web page evaluation apparatus and Web page evaluation method - Google Patents

Description

  The present invention relates to a web page evaluation apparatus and a web page evaluation method.

  Conventionally, in a search service on the Web, a Web page including a keyword input by a user is searched. Then, URLs of Web pages extracted as a result of the search are displayed as a list. At this time, the Web page evaluation apparatus calculates an evaluation index based on predetermined evaluation items such as the attention level and search frequency of the Web page in order to guide the user to a desired Web page more efficiently. In the search service, the URLs of Web pages with high evaluation indices are displayed in order.

As such a Web page evaluation device, a usage history server device including an evaluation score calculation unit that calculates an evaluation value for a service based on a usage history for a service by a user has been proposed (Patent Document 1).
According to this usage history server device, an evaluation value is calculated based on a user's usage history, so a higher evaluation value can be calculated for a Web page that meets the user's request.

JP 2005-174094 A

  By the way, in recent Web pages, there are many Web pages created by copying contents of other Web pages. Such a Web page created by copying the content of another Web page does not provide new information like a Web page that provides the original content of the copy source. However, since the usage history server device described in Patent Document 1 cannot accurately reflect such a relationship, a web page created by copying another web page is unreasonably appreciated, and the search service In some cases, it was also ranked higher.

  The present invention accurately creates a copy relationship by deducting the evaluation index of a web page created by copying another web page, and as a result is created by copying the other web page in a search service. It is an object of the present invention to provide a web page evaluation apparatus that can prevent a web page from being ranked higher than a copy-source web page.

(1) A web page evaluation apparatus for calculating an evaluation index of a web page,
Read the evaluation target Web page from which the evaluation index is calculated from the Web page storage unit that stores the Web page, and compare the evaluation target Web page with another Web page stored in the Web page storage unit Similarity that identifies at least a part of the evaluation target Web page and at least a part of the comparison target Web page having a similarity equal to or higher than a predetermined threshold by comparing the target Web page Relationship identification means;
An editing date and time estimating means for estimating the date and time when the part of the evaluation target Web page was edited and the date and time when the part of the comparison target Web page was edited, which was specified by the similarity relation specifying means;
If the date and time when the part of the comparison target web page was edited is older than the date and time when the part of the evaluation target web page was edited, which was estimated by the editing date and time estimation means, Copy relation determination means for determining that the part is created by copying the part of the comparison Web page;
Repetitive means for performing processing of the similarity relation specifying means, the editing date and time estimation means, and the copy relation determination means for all the web pages stored in the web page storage means;
The ratio of the part determined to be copied and created by the copy relation determination means in the evaluation target Web page is calculated, and the evaluation index of the evaluation target Web page is deducted according to the ratio. A web page evaluation device comprising evaluation index deduction means.

  According to the invention described in (1), the similarity relation specifying unit reads out the evaluation target Web page from which the evaluation index is calculated from the Web page storage unit that stores the Web page, and the evaluation target Web page; By comparing the comparison target Web page, which is another Web page stored in the Web page storage unit, with at least a part of the evaluation target Web page and a comparison having a similarity equal to or higher than a predetermined threshold with the part. Identify at least a part of the target Web page. The editing date / time estimating means estimates the date / time when a part of the evaluation target Web page specified by the similarity relation specifying means and the date / time when a part of the comparison target Web page was edited. The copy relation determination unit is configured to determine whether the evaluation target web page is older than the date when the part of the evaluation target web page is edited, which is estimated by the editing date estimation unit. It is determined that a part has been created by copying a part of the comparison target Web page. The repetition unit performs the processes of the similarity relationship specifying unit, the editing date estimation unit, and the copy relationship determination unit for all the Web pages stored in the Web page storage unit. The evaluation index deduction means calculates a ratio of a part of the evaluation target web page that is determined to be copied and created by the copy relation determination means, and deducts the evaluation index of the evaluation target web page according to the ratio. To do.

Thereby, when the date and time when a part of the similar part of the comparison target Web page is edited is older than the date and time when the part of the evaluation target Web page is edited, a part of the evaluation target Web page is a part of the comparison target Web page. The evaluation index of the evaluation target Web page can be deducted in accordance with the ratio of the part determined to have been created by copying the copy.
Therefore, by subtracting the evaluation index of the web page created by copying another web page, the copy relationship is accurately expressed, and as a result, the web created by copying the other web page in the search service It is possible to provide a web page evaluation apparatus that can prevent a page from being ranked higher than a web page that is a copy source.

  (2) Evaluation in which the copy relation determination unit adds the evaluation index of the comparison target Web page determined that the part of the evaluation target Web page is created by copying the part of the comparison target Web page The Web page evaluation device according to (1), further comprising index adding means.

  According to the invention described in (2), the proportion of the part determined to be copied and created from the evaluation index of the evaluation target Web page determined to be created by copying a part of the comparison target Web page The evaluation index can be deducted according to the evaluation index, and can be added to the evaluation index of the comparison target Web page determined to have been partially copied.

  Therefore, by subtracting the evaluation index of the Web page created by copying another Web page, and adding the evaluation index of the copy-source Web page copied from the other Web page, the copy relationship is accurately expressed. As a result, there is provided a web page evaluation device that can prevent a web page created by copying another web page in the search service from being ranked higher than the web page of the copy source. Can be provided.

  (3) In the evaluation target Web page, the evaluation index adding means includes a portion between the comparison target Web pages that the copy relation determination unit determines to have been created by copying the part of the comparison target Web page. The web page evaluation apparatus according to (2), in which when there is an overlap, the score of the evaluation index of the comparison target Web page is reduced as the degree of the overlap is larger.

  According to the invention described in (3), in the evaluation target web page, when a portion determined to be created by copying a part of the comparison target web page is duplicated between the comparison target web pages, the duplication is performed. The greater the degree of, the more the points added to the evaluation index of the comparison target Web page can be reduced.

  Therefore, the evaluation index of a Web page created by copying another Web page is deducted, and even if there are a plurality of copy-source Web pages, the evaluation index of the copy-source Web page is reduced. In addition, the copy relationship is accurately expressed, and as a result, the Web page created by copying the other Web page in the search service is prevented from being ranked higher than the copy-source Web page. Thus, it is possible to provide a web page evaluation apparatus that can optimize the ranking between copy source web pages.

  (4) In the evaluation target Web page, the evaluation index adding means includes a portion between the comparison target Web pages that the copy relation determination unit determines to have been created by copying the part of the comparison target Web page. (2) or (3), when there is an overlap, an evaluation index is added only to the comparison target Web page having the oldest date and time when the part of the overlapping comparison target Web page was edited Web page evaluation device.

  According to the invention described in (4), in the evaluation target Web page, when a portion determined to be created by copying a part of the comparison target Web page is duplicated between the comparison target Web pages, the overlap is performed. The evaluation index can be added only to the comparison target Web page with the oldest date and time when a part of the comparison target Web page is edited. Here, “the date and time of editing is the oldest” means that when two Web pages overlap in the same range, the date and time edited in the Web page related to the overlap is the oldest. This means a Web page. When three or more Web pages overlap in the same range, it means the Web page with the oldest date and time edited among the Web pages related to the overlap.

  Therefore, the evaluation index of a web page created by copying another web page is deducted, and even when there are a plurality of copy source web pages, only the copy source web page with the oldest edited date is used. By adding points, the copy relationship is accurately expressed, and as a result, the Web page created by copying the other Web page in the search service is ranked relatively higher than the copy source Web page. It is possible to provide a Web page evaluation apparatus that can suppress the above and optimize the ranking between copy-source Web pages.

(5) A web page evaluation method executed by a computer that calculates a web page evaluation index,
Read the evaluation target Web page from which the evaluation index is calculated from the Web page storage unit that stores the Web page, and compare the evaluation target Web page with another Web page stored in the Web page storage unit Similarity that identifies at least a part of the evaluation target Web page and at least a part of the comparison target Web page having a similarity equal to or higher than a predetermined threshold by comparing the target Web page A relationship identification step;
An editing date and time estimation step for estimating the date and time when the part of the evaluation target Web page was edited and the date and time when the part of the comparison target Web page was edited, which was specified in the similarity relationship specifying step;
If the date and time when the part of the comparison target web page was edited is older than the date and time when the part of the evaluation target web page was edited, which was estimated in the editing date and time estimation step, A copy relationship determination step for determining that the part is created by copying the part of the comparison target Web page;
A repetition step of performing the similarity relationship specifying step, the editing date / time estimation step, and the copy relationship determination step for all the web pages stored in the web page storage means;
The ratio of the part determined to be copied and created in the copy relation determination step in the evaluation target Web page is calculated, and the evaluation index of the evaluation target Web page is deducted according to the ratio. A web page evaluation method comprising: an evaluation index deduction step.

  According to the invention described in (5), it is possible to provide a page ranking method that exhibits the same operational effects as in (1).

  According to the present invention, by subtracting the evaluation index of a web page created by copying another web page, the copy relationship is accurately expressed, and as a result, the other web page is copied in the search service. It is possible to provide a web page evaluation apparatus that can prevent the created web page from being ranked higher relative to the copy source web page.

It is a figure which shows the function structure of the web page evaluation apparatus which concerns on embodiment of this invention. It is a figure explaining the web page produced by copying the other web page which concerns on the said embodiment. It is a figure explaining the copy information table of the Web page of FIG. 2 which concerns on the said embodiment. It is a flowchart of the process which matches and memorize | stores the relationship between the evaluation object web page and comparison object web page of the web page evaluation apparatus which concerns on the said embodiment in a copy information table. It is a flowchart of the point reduction process of the evaluation index of the evaluation target Web page of the Web page evaluation apparatus according to the embodiment and the point addition process of the evaluation index of the comparison target Web page. It is a flowchart of the process which deducts the evaluation index of the evaluation object Web page by the evaluation index deduction means which concerns on the said embodiment. It is a flowchart of the process which adds the evaluation index of the comparison target Web page by the evaluation index adding means according to the embodiment.

  Embodiments of the present invention will be described below in detail with reference to the drawings. In the following description of the embodiments, the same constituent elements are denoted by the same reference numerals, and the description thereof is omitted or simplified.

[Functional configuration of Web page evaluation apparatus 1]
FIG. 1 is a diagram showing a functional configuration of a Web page evaluation apparatus 1 according to an embodiment of the present invention.
The web page evaluation device 1 includes an evaluation target web page reading unit 10, a repetition unit 20, an evaluation index calculation unit 30, and a copy relationship storage unit 25. Also, the Web page evaluation apparatus 1 is connected via a network to a content DB 100 in which Web page addresses and contents are stored in association with each other and an index DB 200 in which Web page addresses and evaluation indexes are stored in association with each other. Has been. The web page evaluation device 1 calculates an evaluation index of a web page stored in the content DB 100 and stores it in the index DB 200. In this embodiment, the evaluation index is a score calculated based on predetermined evaluation items such as the attention level and search frequency of a Web page, and a search server (not shown) including the Web page evaluation device 1 In the search service, the URLs of Web pages with high evaluation indices are displayed in order on the user terminal (not shown).

  The evaluation target web page reading unit 10 reads an evaluation target web page that is a target for calculating an evaluation index from the content DB 100 serving as a web page storage unit that stores the web page.

The repeating unit 20 includes a similarity relationship specifying unit 21, an editing date / time estimating unit 22, and a copy relationship determining unit 23. The repetition unit 20 performs the processes of the similarity relationship specifying unit 21, the editing date and time estimation unit 22, and the copy relationship determination unit 23 for all Web pages stored in the content DB 100.
The similar relationship specifying unit 21 includes a comparison target web page reading unit 211 and a similar content specifying unit 212.

The comparison target web page reading unit 211 reads a comparison target web page that is a comparison target with the evaluation target web page and is another web page from the content DB 100.
Note that the comparison target web page reading unit 211, when the evaluation target web page includes a description (for example, URL) indicating the read comparison target web page, sets another web page as the comparison target web page. It can also be read. As a result, even if a Web page is created by copying another Web page, if the copy source is indicated, the evaluation index can not be deducted.

  The similar content specifying unit 212 compares the evaluation target Web page with the comparison target Web page, thereby at least a part of the evaluation target Web page, and the part and the predetermined threshold or more (for example, 80% or more). Are compared with at least a part of the comparison target Web pages having the similarities and stored together with these similarities. The similar content specifying unit 212 determines a unit of the comparison range (for example, the entire Web page, each paragraph, each category, etc.) according to the type of content.

  The editing date / time estimating means 22 estimates the reference date / time specified by the similarity relationship specifying means 21 when a part of the evaluation target Web page is edited and the reference date / time when a part of the comparison target Web page is edited. In the present embodiment, the reference date and time is the date and time when a part specified by the similar content specifying unit 212 of the similar relationship specifying unit 21 was posted on the Web page. In addition, the reference date and time may be the date and time when the content DB 100 is updated or the date and time that is published in a part of the content.

  The copy relation determination unit 23 evaluates when the reference date and time when a part of the comparison target Web page is edited is older than the reference date and time estimated by the editing date and time estimation unit 22 and when a part of the evaluation target Web page is edited. It is determined that a part of the target Web page is created by copying a part of the comparison target Web page. Then, the copy relation determining unit 23 sets a part of the evaluation target web page determined to be created by copying a part of the comparison target web page as a copy range, and includes the comparison target web page in the evaluation target web page. The copy information table of the copy relation storage unit 25 (see FIG. 3) is created by associating the start position of the copy range and the end position of the copy range in the evaluation target web page with the similarity between the evaluation target web page and the comparison target web page. ).

  The repetition unit 20 performs the processes of the similarity relationship specifying unit 21, the editing date and time estimation unit 22, and the copy relationship determination unit 23 for all Web pages stored in the content DB 100.

The copy relation storage unit 25 stores a copy information table.
The copy information table will be described with reference to FIGS.
FIG. 2 is a diagram for explaining a Web page created by copying another Web page.
FIG. 3 is a diagram for explaining the copy information table of the Web page of FIG.

  As shown in FIG. 2, the web page (aaa.htm) shown at the center in FIG. html article A and top right ppp. html article B, and ddd. htm and lower right ccc. It is created by copying the article C of html.

  In FIG. 3, this Web page (aaa.htm) is read as an evaluation target Web page by the comparison target Web page reading unit 211 (see FIG. 1), and the comparison target Web page (bbb.htm) is read by the copy relationship determination unit 23. , Ppp.htm, ddd.htm, and ccc.htm).

As shown in FIG. 3, in the copy information table, the evaluation target Web page is associated with the evaluation target reference date, the comparison target Web page, the comparison target reference date, the copy range start position, the copy range end position, and the similarity. Yes.
The evaluation target web page is the URL of the evaluation target web page that the evaluation target web page reading means 10 (see FIG. 1) calls as a target for calculating an evaluation index from the content DB 100 (see FIG. 1).
The evaluation target reference date and time is a reference date and time when a part of the evaluation target Web page estimated by the editing date and time estimation means 22 (see FIG. 1) is edited.
The comparison target Web page is the URL of the comparison target Web page that is determined to have been copied to the evaluation target Web page by the copy relationship determination unit 23 (see FIG. 1).
The comparison target reference date and time is a reference date and time when a part of the comparison target Web page estimated by the editing date and time estimation unit 22 (see FIG. 1) is edited.
The copy range start position is a part of the start position set as the copy range by the copy relationship determination unit 23 in the comparison range unit in the comparison target Web page determined by the similar content specifying unit 212 (see FIG. 1).
The copy range end position is a part of the end position set as the copy range by the copy relation determining unit 23 in the comparison range unit in the comparison target Web page determined by the similar content specifying unit 212.
The similarity is a similarity between a part (copy range) of the evaluation target Web page specified by the similar content specifying unit 212 and a part of the comparison target Web page.

Returning to FIG. 1, the evaluation index calculating unit 30 includes an evaluation index deducting unit 32 and an evaluation index adding unit 33.
The evaluation index deduction unit 32 includes a ratio calculation unit 321 and a deduction unit 322.
The ratio calculation means 321 refers to the copy information table (see FIG. 3) stored in the copy relation storage means 25 and copies that have been determined to be copied and created by the copy relation determination means 23 in the evaluation target Web page. The ratio of the range in the unit of the comparison range determined by the similar content specifying unit 212 is calculated.

The deduction means 322 deducts the evaluation index of the evaluation target Web page calculated based on a predetermined evaluation item such as the degree of attention and the search frequency according to the ratio calculated by the ratio calculation means 321, and calculates by deducting this score. The evaluation index and the URL of the evaluation target web page are stored in the index DB 200 in association with each other. For example, if the score to be deducted is 100 when all the units in the comparison range have been copied and the percentage of the units in the comparison range is 80%, the deduction means 322 sets the deduction to 80. .
Further, the point deduction means 322 can further deduct points in consideration of a weighting value corresponding to the degree of similarity. For example, if the deduction means 322 has a deduction according to the ratio calculated by the ratio calculation means 321 of 80 and the similarity is 85%, the deduction 80 is multiplied by the similarity 85% and the deduction is 68. You can also.

The evaluation index adding means 33 adds the evaluation index of the comparison target Web page that the copy relation determination means 23 determines that a part of the evaluation target Web page is created by copying a part of the comparison target Web page. The evaluation index calculated in this way and the URL of the comparison target Web page are stored in the index DB 200 in association with each other.
The evaluation index adding unit 33 includes an overlap degree calculating unit 331, a point target Web page specifying unit 332, and a adding unit 333.

  The duplication degree calculation unit 331 refers to the copy information table (see FIG. 3) stored in the copy relationship storage unit 25, and in the evaluation target Web page, the copy relationship determination unit 23 copies a part of the comparison target Web page. When the portion (copy range) determined to have been created is duplicated among a plurality of comparison target Web pages, the degree of duplication is calculated.

A specific description will be given with reference to FIG.
The case where it overlaps between several comparison object web pages is the following cases, for example.
Evaluation target Web page aaa. In htm, the range from the copy range start position 911 to the copy range end position 1792 (articles A and B in FIG. 2) is bbb. html and ppp. The range from the copy range start position 3385 to the copy range end position 4428 (article C in FIG. 2) is ccc. htm and ddd. It overlaps with htm.

  In such a case, the duplication degree calculation means 331 determines that the duplicate copy ranges (articles A and B in FIG. 2) are based on the copy range start position and the copy range end position that are associated with the respective comparison target Web pages. The degree of duplication is calculated by dividing by the specified full copy range. For example, bbb. html ppp. The degree of duplication calculated in relation to htm is the duplication of the copy range 881 (the copy range end position 1792 of bbb.htm—the copy range start position 911 = 881 of ppp. Copy range end position 1792-bbb.htm copy range start position 482 = 1310) (total of article A and articles A and B in FIG. 2), which is approximately 67%. In addition, ppp. htm bbb. The duplication degree calculated in relation to htm is the duplication of the copy range 881 (the copy range end position 1792 of bbb.htm—the copy range start position 911 = 881 of ppp. The copy range end position 2614-ppp.htm of the copy range start position 911 = 1703) (article B in FIG. 2) is calculated to be about 52%. When calculated in the same manner, ccc. htm and ddd. The degree of overlap with htm is 100% of each other.

  Returning to FIG. 1, the point addition Web page specifying unit 332 refers to the copy information table (see FIG. 3) stored in the copy relationship storage unit 25, and the copy relationship determination unit 23 compares the evaluation target Web page. When the part judged to have been created by copying a part of the target Web page is duplicated between the comparison target Web pages, the comparison with the oldest date and time when the part of the duplicated comparison target Web page was edited The target web page is specified.

A specific description will be given with reference to FIG.
The case where it overlaps between several comparison object web pages is the following cases, for example.
Ppp. Shown in the copy information table. From the copy range start position 911 of htm to bbb. The range of the htm copy range end position 1792 is bbb. html and ppp. html and ccc. htm and ddd. From the copy range start position 3385 of htm, ccc. htm and ddd. The range of the copy range end position 4428 of htm is ccc. htm and ddd. It overlaps with htm. Here, in this embodiment, an example in which two comparison target Web pages overlap is described. However, the present invention is not limited to this, and the same can be applied to the case where three or more comparison target Web pages overlap. Based on the range end position, the Web page related to the overlap can be specified.

  In such a case, the point addition Web page specifying unit 332 uses the bbb. html and ppp. The comparison target standard date and time (edited date and time) with html are compared, and the comparison target standard date and time is the oldest pp. Specify htm. In addition, the point addition Web page specifying unit 332 includes ccc. htm and ddd. The comparison target standard date and time (edited date) with htm is compared, and the comparison target standard date and time is the oldest ddd. Specify htm. Here, the “comparison standard date and time” is the oldest web page. When two web pages overlap in the same copy range, the comparison target standard date and time (in the web page related to the duplication) (Edited date and time) means the older Web page, and when three or more Web pages overlap in the same copy range, the comparison reference date and time (edit) in the Web pages related to the overlap Date and time) means the oldest Web page.

  Returning to FIG. 1, the scoring unit 333 refers to the copy information table (see FIG. 3) stored in the copy relation storage unit 25, and the degree of duplication calculated by the duplication degree calculation unit 331 and the point-to-be-added Web page specification. Based on the specification of the means 332, the evaluation index of the comparison target Web page is added, and the evaluation index calculated by adding the score and the URL of the comparison target Web page are stored in the index DB 200 in association with each other.

A specific description will be given with reference to FIG.
The point adding means 333 includes bbb. For example, when all the points are set to 100, pp. The degree of duplication calculated in relation to htm is about 67%, and the reference date and time for comparison of this overlapping part is ppp. Since htm is older, a point corresponding to the overlapping portion is subtracted and 33 (100−67 = 33) is added.
In addition, the point adding means 333 is configured to use ppp. For example, when all points are added to 100, the degree of overlap is about 67% as described above, but the reference date and time for comparison of the overlapped part is ppp. Since htm is older, 100 is added to all points.
Further, the point adding means 333 includes ccc. For example, when all the points are set to 100, the degree of duplication is 100% as described above, and the comparison target reference date and time of the overlapping portion is ddd. Since htm is older, the added point becomes 0 (100-100 = 0) and is not added.
Further, the point adding means 333 is provided with ddd. For example, when all the points are added to 100, the degree of overlap is 100% as described above, but the reference date and time for comparison of the overlapping portion is ddd. Since htm is older, 100 is added to all points. As described above, when two or more comparison target Web pages overlap as in the case where two comparison target Web pages overlap, the added point of the overlapping part is the oldest comparison target reference date and time of the overlapping part. This is performed only for the comparison target Web page.

  In addition, in the case where there is no overlap between the plurality of comparison target web pages, the point addition means 333 adds all the points to the evaluation index of one comparison target web page and corresponds to the URL of the comparison target web page. In addition, it is stored in the index DB 200.

[Hardware Configuration of Web Page Evaluation Apparatus 1]
The web page evaluation device 1 according to the present embodiment is applied to a computer and its peripheral devices. Each unit in the Web page evaluation apparatus 1 is configured by hardware included in a computer and its peripheral devices, and software that controls the hardware.

  The hardware includes an evaluation target Web page reading unit 10, a repeating unit 20, a CPU (Central Processing Unit) as the evaluation index calculation unit 30, a storage unit as the copy relation storage unit 25, a communication device, and an input device. included. Examples of the storage unit include a memory (RAM: Random Access Memory, ROM: Read Only Memory, etc.), a hard disk drive (HDD: Hard Disk Drive), and an optical disk (CD: Compact Disc, DVD: Digital Versatile Drive, etc.). Can be mentioned. Examples of the communication device include various wired and wireless interface devices. Examples of the display device include various displays such as a liquid crystal display and a plasma display. Examples of the input device include an input key, a touch panel, a keyboard, and a pointing device (mouse, tracking ball, etc.).

  The software includes a computer program and data for controlling the hardware. The computer program and data are stored in the storage unit, and are appropriately executed and referenced by each control unit. The computer program and data can be distributed via a communication line, or can be recorded on a computer-readable medium such as a CD-ROM and distributed.

[Control Flow of Web Page Evaluation Apparatus 1]
Next, the control flow of the web page evaluation apparatus 1 will be described.
FIG. 4 is a flowchart of processing for storing the relationship between the evaluation target Web page and the comparison target Web page in the copy information table in the Web page evaluation apparatus 1 according to the present embodiment in association with each other.

  In step S11, an evaluation target Web page reading process is performed. In this process, the evaluation target web page reading means 10 (see FIG. 1) reads out the evaluation target web page from which the evaluation index is calculated from the content DB 100 (see FIG. 1).

  In step S12, a comparison target web page reading process is performed. In this process, the comparison target web page reading unit 211 (see FIG. 1) reads out the comparison target web page to be compared with the evaluation target web page from the content DB 100 (see FIG. 1).

  In step S13, a similar content specifying process is performed. In this process, the similar content specifying unit 212 (see FIG. 1) compares at least a part of the evaluation target Web page with the predetermined Web page by comparing the evaluation target Web page with the comparison target Web page. At least a part of the comparison target web page having a similarity degree equal to or higher than a threshold is specified and stored together with these similarity degrees.

  In step S14, an edit date estimation process is performed. In this processing, the editing date / time estimating means 22 (see FIG. 1) is compared with the reference date / time specified by the similar content specifying means 212 (see FIG. 1) in step S13, which is a part of the evaluation target web page edited, and the comparison target. A reference date and time when a part of the Web page is edited is estimated.

  In step S15, a copy relation determination process is performed. In this process, the copy relation determining means 23 (see FIG. 1) is compared with the reference date and time estimated by the editing date and time estimating means 22 (see FIG. 1) in step S14 and a part of the evaluation target web page is edited. When the reference date and time when a part of the Web page is edited is old, it is determined that a part of the evaluation target Web page is created by copying a part of the comparison target Web page. Further, in this process, the copy relation determining unit 23 sets a part of the evaluation target Web page determined to have been created by copying a part of the comparison target Web page as a copy range, and includes the comparison target Web page on the comparison target Web page. The copy relationship storage unit 25 (see FIG. 1) associates the Web page, the start position of the copy range and the end position of the copy range in the evaluation target Web page, and the similarity between the evaluation target Web page and the comparison Web page. ) In the copy information table (see FIG. 3).

  In step S16, it is determined whether or not the copy relation determination for all Web pages has been completed. In this process, the repetition unit 20 (see FIG. 1) is configured to execute the processing of steps S12 to S15 by the similarity relationship specifying unit 21, the editing date and time estimation unit 22, and the copy relationship determination unit 23, which is stored in the content DB 100. It is determined whether or not all the web pages except the page have been visited. The repeating unit 20 returns the processing to step S12 when not performing all the web pages, and ends this routine when performing all the web pages.

FIG. 5 is a flowchart of the evaluation index deduction of the evaluation target Web page and the evaluation index addition process of the comparison target Web page of the Web page evaluation apparatus 1 according to the present embodiment.
In step S20, evaluation target Web page evaluation index deduction processing is performed. In this process, the evaluation index deduction means 32 (see FIG. 1) deducts the evaluation index of the evaluation target Web page. The evaluation target Web page evaluation index deduction process will be described in detail with reference to FIG.
FIG. 6 is a flowchart of a process for deducting the evaluation index of the evaluation target Web page by the evaluation index deduction means 32.

  In step S21, a ratio calculation process is performed. In this processing, the ratio calculation means 321 (see FIG. 1) refers to the copy information table (see FIG. 3) stored in the copy relation storage means 25 (see FIG. 1) by the copy relation determination means 23 (see FIG. 1). Thus, the ratio of the copy range determined to be copied and created in the evaluation target Web page in the unit of the comparison range is calculated.

  In step S22, a deduction process is performed. In this process, the deduction means 322 (see FIG. 1) calculates the evaluation index of the evaluation target Web page calculated based on predetermined evaluation items such as the degree of attention and the search frequency in step S21 by the ratio calculation means 321. Points are deducted according to the ratio, and the evaluation index calculated by deducting the points and the URL of the evaluation target Web page are associated with each other and stored in the index DB 200 (see FIG. 1).

Returning to FIG. 5, in step S <b> 30, comparison target Web page evaluation index addition processing is performed. In this process, the evaluation index adding means 33 (see FIG. 1) adds the evaluation index of the comparison target web page. The comparison target Web page evaluation index adding process will be described in detail with reference to FIG.
FIG. 7 is a flowchart of a process for adding the evaluation index of the comparison target Web page by the evaluation index adding means 33.

  In step S31, it is determined whether or not comparison target Web pages overlap. In this process, the duplication degree calculation means 331 (see FIG. 1) refers to the copy information table (see FIG. 3) stored in the copy relation storage means 25 (see FIG. 1), and copies it on the evaluation target Web page. It is determined whether or not the part (copy range) determined by the relationship determining unit 23 (see FIG. 1) to have been created by copying a part of the comparison target Web page is duplicated among the plurality of comparison target Web pages. The overlapping degree calculation unit 331 moves the process to step S32 when it is determined that they are overlapping, and moves the process to step S34 when it is determined that they are not overlapping.

  In step S32, an overlap degree calculation process is performed. In this process, the duplication degree calculation unit 331 (see FIG. 1) calculates the duplication degree with reference to the copy information table (see FIG. 3) stored in the copy relation storage unit 25 (see FIG. 1).

  In step S33, a point addition Web page specifying process is performed. In this process, the point addition Web page specifying unit 332 (see FIG. 1) refers to the copy information table (see FIG. 3) stored in the copy relation storage unit 25 (see FIG. 1), and the comparison is repeated. The comparison target Web page with the oldest date and time when a part of the target Web page is edited is specified.

  In step S34, a point addition process is performed. In this process, the scoring means 333 (see FIG. 1) compares based on the degree of duplication calculated by the duplication degree calculation means 331 (see FIG. 1) in step S32 and the identification of the scoring target Web page specifying means 332 in step S33. The evaluation index of the target web page is added, and the evaluation index calculated by adding the score and the URL of the comparison target web page are stored in the index DB 200 in association with each other. Further, if the point adding means 333 determines that there is no overlap between the comparison target web pages in step S31, the point addition means 333 adds all the points to the evaluation index of one comparison target web page, and the comparison target web page. The URL is stored in the index DB 200 in association with the URL.

According to the Web page evaluation apparatus 1 according to the present embodiment, the following operational effects are obtained.
The similarity relation specifying unit 21 reads the evaluation target web page from which the evaluation index is calculated from the content DB 100 storing the web page, and the evaluation target web page and other web pages stored in the content DB 100. By comparing the comparison target Web page, at least a part of the evaluation target Web page and at least a part of the comparison target Web page having a degree of similarity equal to or higher than a predetermined threshold are specified.
The editing date / time estimating means 22 estimates the date / time when a part of the evaluation target Web page specified by the similarity relation specifying means 21 was edited and the date / time when a part of the comparison target Web page was edited.
The copy relation determination unit 23 determines the evaluation target Web when the date when the part of the comparison target Web page is edited is older than the date when the part of the evaluation target Web page is edited, which is estimated by the editing date estimation unit 22. It is determined that a part of the page is created by copying a part of the comparison target Web page.
The repetition unit 20 performs the processes of the similarity relationship specifying unit 21, the editing date and time estimation unit 22, and the copy relationship determination unit 23 for all Web pages stored in the content DB 100.
The evaluation index deduction unit 32 calculates a ratio of a part of the evaluation target Web page that is determined to be copied and created by the copy relation determination unit 23, and the evaluation index of the evaluation target Web page according to the ratio. Is deducted.

Thereby, when the date and time when a part of the similar part of the comparison target Web page is edited is older than the date and time when the part of the evaluation target Web page is edited, a part of the evaluation target Web page is a part of the comparison target Web page. The evaluation index of the evaluation target Web page can be deducted in accordance with the ratio of the part determined to have been created by copying the copy.
Therefore, by subtracting the evaluation index of the web page created by copying another web page, the copy relationship is accurately expressed, and as a result, the web created by copying the other web page in the search service It is possible to provide a web page evaluation apparatus that can prevent a page from being ranked higher than a web page that is a copy source.

Further, the evaluation index adding means 33 adds an evaluation index of the comparison target Web page that the copy relation determination means 23 determines that a part of the evaluation target Web page is created by copying a part of the comparison target Web page.
As a result, the evaluation index can be deducted according to the proportion of the part determined to be copied and created from the evaluation index of the evaluation target Web page determined to be created by copying a part of the comparison target Web page. In addition, points can be added to the evaluation index of the comparison target Web page that is determined to have been partially copied.

  Therefore, by subtracting the evaluation index of the Web page created by copying another Web page, and adding the evaluation index of the copy-source Web page copied from the other Web page, the copy relationship is accurately expressed. As a result, there is provided a web page evaluation device that can prevent a web page created by copying another web page in the search service from being ranked higher than the web page of the copy source. Can be provided.

In addition, the evaluation index adding means 33 is a case where the portions of the evaluation target Web page that the copy relation determination means 23 determines to be created by copying a part of the comparison target Web page overlap between the comparison target Web pages. In addition, as the degree of overlap is larger, the score of the evaluation index of the comparison target Web page is reduced.
As a result, in the evaluation target web page, when a portion determined to be created by copying a part of the comparison target web page is duplicated between the comparison target web pages, the comparison target web is increased as the degree of duplication increases. You can reduce the score of the page evaluation index.

  Therefore, the evaluation index of a Web page created by copying another Web page is deducted, and even if there are a plurality of copy-source Web pages, the evaluation index of the copy-source Web page is reduced. In addition, the copy relationship is accurately expressed, and as a result, the Web page created by copying the other Web page in the search service is prevented from being ranked higher than the copy-source Web page. Thus, it is possible to provide a web page evaluation apparatus that can optimize the ranking between copy source web pages.

In addition, the evaluation index adding means 33 is a case where the portions of the evaluation target Web page that the copy relation determination means 23 determines to be created by copying a part of the comparison target Web page overlap between the comparison target Web pages. In addition, an evaluation index is added only to the comparison target Web page having the oldest date and time when a part of the overlapping comparison target Web page is edited.
As a result, in the evaluation target web page, when a portion determined to be created by copying a part of the comparison target web page is duplicated between the comparison target web pages, one of the duplicate comparison target web pages is displayed. The evaluation index can be added only to the comparison target Web page with the oldest date and time when the part was edited.

  Therefore, the evaluation index of a web page created by copying another web page is deducted, and even when there are a plurality of copy source web pages, only the copy source web page with the oldest edited date is used. By adding points, the copy relationship is accurately expressed, and as a result, the Web page created by copying the other Web page in the search service is ranked relatively higher than the copy source Web page. It is possible to provide a Web page evaluation apparatus that can suppress the above and optimize the ranking between copy-source Web pages.

  As mentioned above, although embodiment of this invention was described, this invention is not restricted to embodiment mentioned above. The effects described in the embodiments of the present invention are only the most preferable effects resulting from the present invention, and the effects of the present invention are limited to those described in the embodiments of the present invention. is not.

DESCRIPTION OF SYMBOLS 1 Web page evaluation apparatus 20 Repetition means 21 Similarity relationship specification means 22 Editing date estimation means 23 Copy relation judgment means 32 Evaluation index deduction means 100 Content DB

Claims (5)

A web page evaluation apparatus for calculating an evaluation index of a web page,
Read the evaluation target Web page from which the evaluation index is calculated from the Web page storage unit that stores the Web page, and compare the evaluation target Web page with another Web page stored in the Web page storage unit Similarity that identifies at least a part of the evaluation target Web page and at least a part of the comparison target Web page having a similarity equal to or higher than a predetermined threshold by comparing the target Web page Relationship identification means;
An editing date and time estimating means for estimating the date and time when the part of the evaluation target Web page was edited and the date and time when the part of the comparison target Web page was edited, which was specified by the similarity relation specifying means;
If the date and time when the part of the comparison target web page was edited is older than the date and time when the part of the evaluation target web page was edited, which was estimated by the editing date and time estimation means, Copy relation determination means for determining that the part is created by copying the part of the comparison Web page;
Repetitive means for performing processing of the similarity relation specifying means, the editing date and time estimation means, and the copy relation determination means for all the web pages stored in the web page storage means;
The ratio of the part determined to be copied and created by the copy relation determination means in the evaluation target Web page is calculated, and the evaluation index of the evaluation target Web page is deducted according to the ratio. A web page evaluation device comprising evaluation index deduction means.   Evaluation index adding means for adding the evaluation index of the comparison target web page that the copy relation determination means determines that the part of the evaluation target Web page is created by copying the part of the comparison target web page The web page evaluation apparatus according to claim 1, further comprising:   The evaluation index adding means includes a portion of the evaluation target Web page that the copy relationship determination means determines to have been created by copying the part of the comparison target Web page. 3. The Web page evaluation apparatus according to claim 2, wherein, when the degree of overlap is larger, the score of the evaluation index of the comparison target Web page is reduced.   The evaluation index adding means includes a portion of the evaluation target Web page that the copy relationship determination means determines to have been created by copying the part of the comparison target Web page. 4. The Web page evaluation apparatus according to claim 2, wherein an evaluation index is added only to the comparison target Web page having the oldest date and time when the part of the duplicate comparison target Web page is edited. . A web page evaluation method executed by a computer that calculates a web page evaluation index,
Read the evaluation target Web page from which the evaluation index is calculated from the Web page storage unit that stores the Web page, and compare the evaluation target Web page with another Web page stored in the Web page storage unit Similarity that identifies at least a part of the evaluation target Web page and at least a part of the comparison target Web page having a similarity equal to or higher than a predetermined threshold by comparing the target Web page A relationship identification step;
An editing date and time estimation step for estimating the date and time when the part of the evaluation target Web page was edited and the date and time when the part of the comparison target Web page was edited, which was specified in the similarity relationship specifying step;
If the date and time when the part of the comparison target web page was edited is older than the date and time when the part of the evaluation target web page was edited, which was estimated in the editing date and time estimation step, A copy relationship determination step for determining that the part is created by copying the part of the comparison target Web page;
A repetition step of performing the similarity relationship specifying step, the editing date / time estimation step, and the copy relationship determination step for all the web pages stored in the web page storage means;
The ratio of the part determined to be copied and created in the copy relation determination step in the evaluation target Web page is calculated, and the evaluation index of the evaluation target Web page is deducted according to the ratio. A web page evaluation method comprising: an evaluation index deduction step.

Images