JP6354497B2 - Display area specifying device, display area specifying method, and program - Google Patents

Description

  The present invention relates to a display area specifying device, a display area specifying method, and a program.

  With the spread of the Internet, the types of Web browsers that display HTML documents obtained via the Internet are increasing. In addition to the types of Web browsers, there are many combinations in consideration of differences in Web browser versions and operating OSs.

  However, the web browsers have different drawing characteristics from each other or have their own extended functions. Further, there is a definition regarding HTML that is interpreted differently for each Web browser. As a result, the display result of the HTML document may be different for each Web browser.

  Accordingly, by specifying the display area of each HTML element in the display result of the HTML document by each Web browser and comparing the display areas specified for each Web browser, there is a difference in the display result of the HTML document by each Web browser. Has been studied (see, for example, Patent Document 1).

  In Patent Document 1, the display area of each HTML document in the display result by the Web browser is specified by the following method.

  First, one HTML element in the HTML document is selected, and the HTML document is modified so that the HTML element is displayed in black and the other HTML elements are displayed in white. Subsequently, the modified HTML document is displayed by each Web browser, and in the display result by each Web browser, the black area is specified as the display area of the selected HTML element.

JP 2010-39815 A

  However, according to the method described in Patent Document 1, with respect to each HTML element in the HTML document, (1) modification of the HTML document, (2) activation of each Web browser, and display of the HTML document by each Web browser, (3) It is necessary to repeatedly specify the display area of the HTML element. For example, if there are 100 HTML elements in the HTML document, (1) to (3) need to be repeated 100 times, which is inefficient.

  In view of this, an object of one aspect is to make it possible to efficiently specify the display area of each display element in the display data.

  In one proposal, the display area specifying device assigns a different color to each display element included in the display data, and assigns each display element or the background of each display element to the display element by the assignment unit. A change unit that changes the definition content of the display data so that the display data is displayed, a display unit that displays display data after the change by the change unit in a browser, and a display result of the display data by the browser For each color assigned to the display element, a specifying unit that specifies an area specified based on a pixel of the color as a display area of the display element to which the color is assigned. .

  According to one aspect, it is possible to efficiently specify the display area of each display element in the display data.

It is a figure which shows the hardware structural example of the comparison apparatus in 1st embodiment. It is a figure which shows the function structural example of the comparison apparatus in 1st embodiment. It is a flowchart for demonstrating an example of the process sequence which the comparison apparatus of 1st embodiment performs. It is a figure which shows an example of the HTML document of evaluation object. It is a figure which shows an example of the HTML document by which the modification for coloring was performed about one HTML element. It is a figure which shows an example of the HTML document by which the modification for coloring was performed about all the HTML elements of coloring object. It is a figure which shows an example of the value memorize | stored in the allocation color memory | storage part in 1st embodiment. It is a figure which shows the structural example of a display area memory | storage part. It is a flowchart for demonstrating an example of the specific process of the circumscribed rectangle of the pixel of a certain color in 1st embodiment. It is a figure which shows an example of the pixel extracted from a capture image and a capture image. It is a figure which shows the example of designation | designated of the background color with respect to a div element. It is a figure which shows an example of the circumscribed rectangle specified about the block level element containing another block level element. It is a flowchart for demonstrating the 1st modification of the detection process of the difference of the display result for every Web browser. It is a figure which shows an example of the positional relationship determined not to correspond. It is a figure which shows an example of the positional relationship determined to correspond. It is a figure which shows an example of the relative positional relationship of two HTML elements. It is a flowchart for demonstrating the 2nd modification of the detection process of the difference of the display result for every Web browser. It is a figure for demonstrating the parallel relationship in this Embodiment. It is a flowchart for demonstrating an example of the process sequence of the determination process of the allocation color in 2nd embodiment. It is a figure which shows an example of the value memorize | stored in the allocation color memory | storage part in 2nd embodiment. It is a flowchart for demonstrating an example of the specific process of the circumscribed rectangle of the pixel of a certain color in 2nd embodiment. It is a flowchart for demonstrating an example of the specific process of the circumscribed rectangle of the pixel of a certain color in 3rd embodiment. It is an example of the image for demonstrating the specification process of the circumscribed rectangle of the pixel of a certain color in 3rd embodiment. It is a figure for demonstrating adjacent 8 vicinity.

  The first embodiment will be described below with reference to the drawings. FIG. 1 is a diagram illustrating a hardware configuration example of the comparison device according to the first embodiment. 1 includes a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, an interface device 105, a display device 106, an input device 107, and the like that are mutually connected by a bus B.

  A program that realizes processing in the comparison apparatus 10 is provided by the recording medium 101. When the recording medium 101 on which the program is recorded is set in the drive device 100, the program is installed from the recording medium 101 to the auxiliary storage device 102 via the drive device 100. However, the program need not be installed from the recording medium 101 and may be downloaded from another computer via a network. The auxiliary storage device 102 stores the installed program and also stores necessary files and data.

  The memory device 103 reads the program from the auxiliary storage device 102 and stores it when there is an instruction to start the program. The CPU 104 realizes functions related to the comparison device 10 in accordance with a program stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network. The display device 106 displays a GUI (Graphical User Interface) or the like by a program. The input device 107 is a keyboard, a mouse, or the like, and is used for inputting various operation instructions.

  An example of the recording medium 101 is a portable recording medium such as a CD-ROM, a DVD disk, or a USB memory. An example of the auxiliary storage device 102 is an HDD (Hard Disk Drive) or a flash memory. Both the recording medium 101 and the auxiliary storage device 102 correspond to computer-readable recording media.

  FIG. 2 is a diagram illustrating a functional configuration example of the comparison device according to the first embodiment. 2, the comparison apparatus 10 includes a plurality of Web browsers 11, an assigned color determination unit 12, an HTML document modification unit 13, a browser display unit 14, a screen capture unit 15, a display area specifying unit 16, a comparison unit 17, and an output unit. 18 etc. Each of these units is realized by processing that one or more programs installed in the comparison apparatus 10 cause the CPU 104 to execute. The comparison apparatus 10 also uses an HTML document storage unit 121, an assigned color storage unit 122, a modified document storage unit 123, a display area storage unit 124, and the like. Each of these storage units can be realized by using a storage device connected to the auxiliary storage device 102 or the memory device 103 or the comparison device 10 via a network.

  The web browser 11 controls the display of the HTML document. Each Web browser 11 is, for example, a different type of Web browser. The HTML document storage unit 121 stores an HTML document that is an evaluation target for the display result of each Web browser 11. The assigned color determination unit 12 assigns a different color to each HTML element included in the HTML document. The assigned color storage unit 122 stores information indicating the color assigned by the assigned color determination unit 12 for each HTML element. The HTML document modification unit 13 modifies (rewrites) the definition content of the HTML document so that each HTML element is displayed with the color allocated by the allocation color determination unit 12. The modified HTML document is stored in the modified document storage unit 123.

  The browser display unit 14 displays the HTML document after modification on each Web browser 11. The screen capture unit 15 acquires an image indicating a rendering result by each Web browser 11 for the HTML document after modification. For example, when the drawing result by the Web browser 11 is displayed on a liquid crystal display or the like, the screen capture unit 15 performs screen capture for the liquid crystal display. When the drawing simulator of the web browser 11 is used, the screen capture unit 15 acquires an image output from the drawing simulator.

  The display area specifying unit 16 specifies the display area of each display element in the display result by each Web browser 11 based on the color assigned to each display element. The display area specified for each Web browser 11 and for each HTML element is stored in the display area storage unit 124.

  The comparison unit 17 compares the display areas of the HTML elements for each Web browser 11 and detects a difference between the Web browsers 11 regarding the display result of the HTML document. The output unit 18 outputs information indicating the difference detected by the comparison unit 17.

  Hereinafter, a processing procedure executed by the comparison apparatus 10 will be described. FIG. 3 is a flowchart for explaining an example of a processing procedure executed by the comparison device of the first embodiment.

  In step S <b> 101, the assigned color determination unit 12 reads an HTML document to be evaluated from the HTML document storage unit 121.

  FIG. 4 is a diagram illustrating an example of an HTML document to be evaluated. The HTML document d1 shown in FIG. 4 includes an HTML element te1 that displays “character string 1”, an HTML element te2 that displays “character string 2”, an HTML element te3 that displays “character string 3”, and the like.

  Subsequently, the assigned color determination unit 12 selects one HTML element to be colored from the HTML elements included in the HTML document d1 (S102). The selected HTML element is hereinafter referred to as “target element”.

  Subsequently, the assigned color determination unit 12 assigns a color that does not overlap with a color already assigned to another HTML element to the target element (S103). In the first embodiment, the colors assigned to the HTML elements are expressed in RGB format, and the values of R / G / B are 0x00 to 0xFF. For example, if the variable for managing the color assigned to the HTML element is C, the 0th to 7th bits of the variable C indicate the B value, the 8th to 15th bits indicate the G value, and the 16th to 23rd bits. Indicates an R value.

  In step S102, C in the calculation result “C ← C + α” may be a color assigned to the target element. The initial value of C is, for example, 0x000000. α is a constant such as 1, for example. Hereinafter, the color assigned to the target element is referred to as “assigned color”.

  Subsequently, the HTML document modification unit 13 modifies the definition content of the HTML document d1 so that the target element is displayed in the assigned color (S104).

  FIG. 5 is a diagram illustrating an example of an HTML document in which one HTML element is modified for coloring. In FIG. 5, the HTML element te1 is surrounded by <font> tags. Also, “# 0000FF” is set as the value of the color attribute of the <font> tag. As a result, “character string 1” is displayed in blue. Such modification is performed in step S104. It should be noted that other methods may be used as a method for modifying an HTML document for displaying HTML elements in a desired color. For example, a <font> tag including a style attribute such as <font style = “background-color: # 00F”> may be added to the HTML element, so that the background of the HTML element may be colored.

  Subsequently, the HTML document modifying unit 13 associates the target element with the allocated color and stores them in the allocated color storage unit 122 (S105). Steps S102 to S105 are executed for all HTML elements to be colored (S106). The HTML element to be colored is an HTML element whose display position and display area are to be known in the display result by the Web browser 11. For example, when it is desired to compare the display results of characters between the Web browsers 11, the text element is included in the coloring target. Further, when it is desired to compare the arrangement relationship of the div blocks, the div element is included in the coloring target. When it is desired to compare display areas of all HTML elements, all block elements and inline elements in the HTML document are included in the coloring target.

  When all the coloring objects are modified (Yes in S106), the HTML document d1 is in a state as shown in FIG.

  FIG. 6 is a diagram showing an example of an HTML document in which all the HTML elements to be colored have been modified for coloring. In the HTML document d1 shown in FIG. 6, the HTML element te2 and e3 are also modified similarly to the HTML element te1. The modified HTML document d1 is stored in the modified document storage unit 123.

  Further, when all the coloring objects are modified (Yes in S106), the assigned color storage unit 122 stores information as shown in FIG.

  FIG. 7 is a diagram illustrating an example of values stored in the assigned color storage unit in the first embodiment. As shown in FIG. 7, the assigned color storage unit 122 stores the XPath and the RGB value of the assigned color for each HTML element to be colored. XPath is an example of identification information of an HTML element. The number of lines and the number of digits in the HTML document d1 may be used instead of XPath. Further, id attributes having different values may be added to each HTML element, and the value of the id attribute may be used instead of XPath.

  Subsequently, the browser display unit 14 selects one Web browser 11 from the group of Web browsers 11 to be compared with respect to the display result of the HTML document d1 (S107), and is stored in the modified document storage unit 123. The HTML document d1 is displayed on the Web browser 11 (hereinafter referred to as “target browser”) (S108). That is, the modified HTML document d1 (FIG. 6) is displayed. Accordingly, at this time, each HTML element to be colored is displayed by an assigned color for the HTML element.

  Subsequently, the screen capture unit 15 performs screen capture on the drawing area (area where the HTML document is displayed) of the Web browser 11 (S109). As a result, image data indicating the display result of the HTML document d1 (hereinafter referred to as “capture image”) is acquired. In the screen capture, for example, an API (Application Programming Interface) of an OS (Operating System) on which the Web browser 11 is operating may be used, and an image showing a drawing area may be acquired as a bitmap image. Alternatively, the video signal flowing through the display terminal may be converted into image data.

  Subsequently, the display area specifying unit 16 selects one of the records stored in the assigned color storage unit 122 (FIG. 7) as a processing target (S110). That is, one set of an HTML element (XPath) and an assigned color is selected. The HTML element of the selected record is hereinafter referred to as “selected element”, and the assigned color of the record is hereinafter referred to as “selected color”.

  Subsequently, the display area specifying unit 16 specifies the display area of the selected element based on the captured image (S111). For example, the display area specifying unit 16 extracts all pixels whose RGB values match the selected color, and specifies a circumscribed rectangle (for example, a minimum circumscribed rectangle) including all the extracted pixels.

  Subsequently, the display area specifying unit 16 associates a coordinate value (hereinafter referred to as “display coordinates”) that can specify the circumscribed rectangular area (that is, the display area of the selected element) with the selected element. It memorize | stores in the memory | storage part 124 (S112). That is, the circumscribed rectangular area is specified as the display area of the selected element in the display result of the HTML document d1 by the target browser.

  FIG. 8 is a diagram illustrating a configuration example of the display area storage unit. In FIG. 8, the display area storage unit 124 stores the XPath, the assigned color, and the display coordinates for each coloring target HTML element. The display coordinates are the coordinate values of the upper left vertex and the lower right vertex of the circumscribed rectangle specified for the HTML element related to the XPath.

  Steps S110 to S112 are executed for all records stored in the assigned color storage unit 122 (S113). Steps S107 to S113 are executed for all Web browsers 11 to be compared. Therefore, display coordinates are stored in the display area storage unit 124 for each Web browser 11 for each HTML element.

  When steps S107 to S113 are executed for all the Web browsers 11 to be compared (Yes in S114), the comparison unit 17 is based on the information stored in the display area storage unit 124 for each Web browser 11 to be compared. Then, a difference in the display result of the HTML document d1 by each Web browser 11 is detected (S115).

  For example, the display coordinates for each Web browser 11 may be simply compared for each HTML element (for each XPath), and an HTML element that does not match the compared display coordinates may be detected as a difference.

  Alternatively, when the display coordinates are not required to be completely coincident, the difference may be detected by another method. An example (variation) of another method will be described later.

  Subsequently, the output unit 18 outputs information on the HTML element detected as the difference (S116). For example, information regarding the HTML element is displayed on the display device 106. At this time, the output unit 18 may specify a definition part related to the HTML element in the HTML document d1 and display the HTML document (HTML source code) so that the definition part is highlighted.

  Next, details of step S111 will be described. FIG. 9 is a flowchart for explaining an example of a circumscribed rectangle specifying process for a pixel of a certain color in the first embodiment.

  In step S <b> 201, the display area specifying unit 16 substitutes the selected color (indicating RGB value) for the variable D. In the variable D, as in the variable C, the 0th to 7th bits indicate the B value, the 8th to 15th bits indicate the G value, and the 16th to 23rd bits indicate the R value.

  Subsequently, the display area specifying unit 16 extracts only pixels having RGB values that match the value of D from the captured image (S202).

  FIG. 10 is a diagram illustrating an example of a captured image and pixels extracted from the captured image. In FIG. 10, it is assumed that (1) is a captured image. Of the character string shown in (1), it is assumed that only the RGB values of the pixels constituting the character string “electronic device / semiconductor” match the value of D. In this case, in step S202, the pixel shown in (2) is extracted.

  Subsequently, the display area specifying unit 16 specifies the circumscribed rectangle (minimum circumscribed rectangle) of the extracted pixel, and acquires the coordinate values of the upper left vertex and the lower right vertex of the circumscribed rectangle (S203). The acquired coordinate values are stored in the display area storage unit 124 (FIG. 8) in association with the XPath of the selected element.

  Although FIG. 10 shows an example in which the character string itself is colored, the background of the character string may be colored instead of the character string itself. Even in this case, the same processing procedure as in FIG. 9 may be executed. However, when the background is colored, there is a possibility that the line spacing of characters is different for each Web browser 11, and the detection accuracy of the display area of the character string may be deteriorated. Therefore, regarding the text element, as described above, it is desirable that the character string itself is a coloring target.

  Moreover, although the example in which only the text element is included is shown in the HTML document d1, the style attribute is added to the tag related to the HTML element other than the text element so that the background of the HTML element is colored. By modifying the HTML document, it is possible to specify a display area for HTML elements other than text elements.

  For example, the background color may be specified using the background-color keyword in the style attribute of a block level element such as the div element.

  FIG. 11 is a diagram illustrating a designation example of the background color for the div element. The HTML document d2 shown in FIG. 11 includes three div elements, div elements de1, de2, and de3. The <div> tag of each div element has a style attribute of the form “style =“ background-color: #XXX ””. Here, the value of “#XXX” is different for each div element. As a result, each div element is displayed in a different color.

  Further, in FIG. 11, each div element is designated as padding, so that a blank space is provided between the div element and the HTML element in the div element. This is a contrivance for accurately specifying a circumscribed rectangle of a block level element including other HTML elements. For example, in FIG. 11, the div element de1 includes div elements de2 and de3. In such a case, by specifying padding for the div element de1, it is possible to reduce the possibility that the circumscribed rectangle of the div element de1 is erroneously specified.

  FIG. 12 is a diagram illustrating an example of a circumscribed rectangle specified for a block level element including another block level element. FIG. 12 shows areas of the div element de1, the div element de2, and the div element 3 shown in FIG.

  (1) is a display example when padding is not specified. In (1), since the left vertices of the div element de1 and the div element de2 match, the width of the circumscribed rectangle of the div element de1 is specified as being in the range indicated by w1.

  On the other hand, (2) is an example in which padding is specified for both the left and right sides of the div element de1. In this case, the range indicated by w2 is specified as the width of the div element de1 by the pixels of the margin part.

  Note that when an HTML document to be evaluated includes an img element, it is difficult to color an image embedded by the img element. If the img element is left as it is, the circumscribed rectangle of each HTML element is erroneously detected based on the pixel of the image embedded by the img element. Therefore, the HTML document modification unit 13 generates a transparent image having the same size as the image embedded by the img element, and replaces the value of the src attribute of the img element with the path name of the file in which the transparent image is stored. May be.

  Alternatively, “style =“ visibility: hidden; ”” may be added to the <img> tag. According to such a style attribute, the HTML element can be hidden while a display area of the HTML element in which the style attribute is specified is secured.

  Subsequently, a modified example of step S115 in FIG. 3 will be described. For example, whether the relative positional relationship of each HTML element in the display result by a certain Web browser 11 and the relative positional relationship of each HTML element in the display result by another Web browser 11 satisfies a predetermined condition. By determining whether or not, a difference may be detected.

  FIG. 13 is a flowchart for explaining a first modified example of the difference detection processing for display results for each Web browser. In the processing of FIG. 13, it is assumed that there are two types of Web browsers 11 to be compared for convenience. However, the processing of FIG. 13 may be executed for three or more types of Web browsers 11.

  In step S210, the comparison unit 17 processes one unprocessed combination among two combinations of HTML elements in the HTML element group (hereinafter referred to as “target element group”) that is a coloring target. Choose as. An unprocessed combination refers to a combination that is not set as a processing target for step S220 and subsequent steps.

  Subsequently, the comparison unit 17 obtains the relative positional relationship in the display results of the two types of Web browsers 11 for the two HTML elements included in the selected combination (S220).

  Usually, the default line spacing, character spacing, and the like differ depending on the Web browser 11. Therefore, when the positional relationship between the HTML elements in the two types of Web browsers 11 is compared by confirming whether the distance between the HTML elements is the same or not, the positional relationship is different even if it looks similar to the human eye. May be determined. That is, even if the positional relationship looks almost the same from the viewpoint of a person, it is determined that the position is different depending on the computer. As a result, the difference is excessively detected.

  Therefore, in the first modification, the comparison unit 17 determines that the relative relationship between the two HTML elements is the same if the alignment relations (shift directions) of the two HTML elements in the vertical and horizontal directions (horizontal and vertical directions) match. It is determined that the physical positional relationship matches. For example, the comparison unit 17 determines that the positional relationship shown in (A) of FIG. 14 is different from the positional relationship shown in (B) for two HTML elements. This is because the left end and right end of the two HTML elements are aligned in (A), whereas the left end and right end of the two HTML elements are not aligned in (B). That is, (A) and (B) differ in the direction of deviation in the left-right direction (horizontal direction). On the other hand, the comparison unit 17 determines that the positional relationship shown in FIG. 15A matches the positional relationship shown in FIG. This is because the vertical and horizontal shift directions of the other HTML element with respect to one HTML element match. For example, even if the interval between two HTML elements, that is, the amount of deviation differs between (A) and (B), the determination result is not affected.

  An example of a determination method by the comparison unit 17 for obtaining the above determination result will be described. Here, it is assumed that the relative positional relationship between the two HTML elements in the display result of at least one Web browser 11 is as shown in FIG.

  FIG. 16 is a diagram illustrating an example of the relative positional relationship between two HTML elements. In FIG. 16, the HTML element e1 is one of the two HTML elements selected in step S210, and the HTML element e2 is the other HTML element. The coordinate value of the upper left vertex of the HTML element e1 is represented as (left1, top1), and the coordinate value of the lower right vertex is represented as (right1, bottom1). The coordinate value of the upper left vertex of the HTML element e2 is expressed as (left2, top2), and the coordinate value of the lower right vertex is expressed as (right2, bottom2). The values of left 1, top 1, right 1, bottom 1, left 2, top 2, right 2, and bottom 2 can be specified based on the display coordinates stored in the display area storage unit 124.

  The comparison unit 17 applies the coordinate value to the following function f (x) to obtain values of f0 to f7.

f0 = f (left1-left2)
f1 = f (left1-right2)
f2 = f (right1-left2)
f3 = f (right1-right2)
f4 = f (top1-top2)
f5 = f (top1-bottom2)
f6 = f (bottom1-top2)
f7 = f (bottom1-bottom2)
Here, the value of f (x) is as follows.

If x> α, f (x) = 1
If -α <= x <= α, f (x) = 0
If x <−α, f (x) = − 1
The threshold value α is a constant equal to or greater than 0 that indicates a range in which it is determined that two values compared in the function f (x) are the same, and is determined in advance. That is, f0 to f7 obtained by the function f (x) indicate the direction of relative displacement in the vertical and horizontal directions with respect to the upper left vertex and the lower left vertex of the two HTML elements compared. In other words, f0 to f7 indicate the vertical and horizontal directions with respect to the vectors v1 to v4 shown in FIG.

  According to the example of FIG. 16, the values of f0 to f7 are as follows. In FIG. 16, it is assumed that the origin is the upper left. Here, for convenience, it is assumed that α = 0.

f0 = f (left1-left2) =-1
f1 = f (left1-right2) = − 1
f2 = f (right1-left2) = 1
f3 = f (right1-right2) = − 1
f4 = f (top1-top2) =-1
f5 = f (top1-bottom2) =-1
f6 = f (bottom1-top2) =-1
f7 = f (bottom1-bottom2) = − 1
In step S <b> 220, the comparison unit 17 obtains the values of f <b> 0 to f <b> 7 related to the two HTML elements selected in step S <b> 210 regarding the display results of the two types of Web browsers 11.

  Subsequently, the comparison unit 17 compares f0 to f7 obtained for the display results of the two types of Web browsers 11 (S230). Here, the same subscripts (0 to 7) for f are compared. When all the compared values match (Yes in S230), the comparison unit 17 determines whether or not the processing has been performed for all combinations of two HTML elements in the HTML elements included in the target element group ( S240). When an unprocessed combination remains (No in S240), the comparison unit 17 repeats Step S210 and subsequent steps regarding the unprocessed combination.

  When the values of f0 to f7 match for all combinations (Yes in S240), the comparison unit 17 determines that the relative positional relationship of the target element group matches between the two types of Web browsers 11 (S250). . On the other hand, when a combination in which any of the values of f0 to f7 does not match is detected (No in S230), the comparison unit 17 determines that the relative positional relationship of the target element group differs between the two types of Web browsers 11. Determination is made (S260).

  In step S240, if at least f0, f4, f5, f6, and f7 match, the comparison unit 17 may determine that the relative positional relationship of the target element group matches between the two types of browsers. Also good. For example, in the case of comparison between character strings, it may be determined that the relative positional relationship matches if only the beginning of the line is secured. Accordingly, such a determination criterion may be applied to a combination of character strings. By doing so, for example, it can be determined that the relative positional relationship between the character strings is the same even if the character spacing is different between the two types of browsers.

  As described above, in the first modified example, if the direction of displacement of each vertex of the circumscribed rectangle of each HTML element included in the HTML element group is the same for each Web browser 11, the display result of the HTML document by each Web browser 11. Are determined to match.

  In the above, an example in which α is a constant has been described. However, the value of α may be changed according to the types of two HTML elements whose relative positional relationship is required.

  Subsequently, a second modification will be described. In the second modification, each Web browser 11 uses a combination of HTML elements that are parallel in the horizontal direction in any Web browser 11 based on whether the other Web browsers 11 are also parallel in the horizontal direction. Differences in the display results are detected.

  FIG. 17 is a flowchart for explaining a second modification of the process for detecting a difference in display results for each Web browser.

  In step S <b> 301, the comparison unit 17 selects any two of the plurality of HTML elements that are to be colored as determination targets for the presence or absence of a parallel relationship (S <b> 301). Subsequently, the comparison unit 17 establishes a parallel relationship (or adjacency relationship) for each Web browser 11 based on the display coordinates stored in the display area storage unit 124 for each Web browser 11 for the two selected HTML elements. It is determined whether it has (S302).

  FIG. 18 is a diagram for explaining the parallel relationship in the present embodiment. In FIG. 18, (1) to (3) are examples in which it is determined that the HTML element e0 and the HTML element e1 have a parallel relationship.

  That is, in the present embodiment, two HTML elements do not have overlapping portions (or interference portions) in the horizontal range, and the vertical range of one HTML element is the vertical direction of the other HTML element. When included in the range, it is determined that the two HTML elements have a parallel relationship.

  The determination of the presence or absence of the parallel relationship may be performed as follows.

  The display coordinates (the coordinate value of the upper left vertex and the coordinate value of the lower right vertex) of one of the two HTML elements are (left0, top0) − (right0, bottom0), and the display of the other HTML element When the coordinates are (left1, top1) − (right1, bottom1), if both of the following condition 1 and condition 2 are satisfied, the two HTML elements are determined to have a parallel relationship. The coordinate system of the display coordinates of the HTML element is as shown in (1) of FIG.

Condition 1: (α1 ≦ left1−right0 ≦ α2) or (α1 ≦ left0−right1 ≦ α2)
Condition 2: (β ≦ top1−top0 and β ≦ bottom0−bottom1) or (β ≦ top0−top1 and β ≦ bottom1−bottom0)
In the above conditions 1 and 2, the left-right relationship between one HTML element and the other HTML element is not limited.

In the above conditions 1 and 2, the left-right relationship between one HTML element and the other HTML element is not limited.

Condition 1 is a condition indicating that the display area of one HTML element and the display area of the other HTML element do not have overlapping portions in the horizontal range. That is, the condition 1 is a condition indicating that the left end or right end of the display area of one HTML element is in contact with or separated from the right end or left end of the display area of the other HTML element.
Note that α1 and α2 in the condition 1 are constants for allowing an error in coordinates used for condition determination. Usually, α1 is a small negative number and α2 is a small positive number.

Condition 2 is a condition indicating that the vertical range of one HTML element is included in the vertical range of the other HTML element. Note that β in condition 2 is also a constant to allow an error in coordinates used for condition determination. Usually, β is a small negative number.

  Note that Condition 2 may be relaxed. For example, with respect to the HTML element e0 and the HTML element e1 shown in (4) of FIG. 18, the overlapping portion in the vertical range is at least a predetermined ratio with respect to the height of at least one of the HTML elements. Conditions may be used instead of condition 2. In condition 2, the predetermined ratio is 100%.

  In the display of the HTML document by the Web browser 11, if it is guaranteed that the HTML elements do not overlap each other, the condition 1 may be removed from the condition for satisfying the parallel relationship.

  Subsequently, the comparison unit 17 determines whether or not the determination result of the presence / absence of the parallel relationship between the two HTML elements is different for each Web browser 11 (S303). When the determination result for each Web browser 11 is different, that is, when it is determined that one Web browser 11 has a parallel relationship and the other Web browser 11 does not have a parallel relationship (Yes in S303). ), The comparison unit 17 determines whether or not the following condition 3 is satisfied for the display coordinates of each of the two HTML elements related to the display result of the Web browser 11 determined not to have a parallel relationship ( S304).

Condition 3: [gamma] <= top1-bottom0 or [gamma] <= top0-bottom1
That is, whether or not the difference between the minimum value of the Y coordinate of the display area of the lower HTML element and the maximum value of the Y coordinate of the upper side of the display area of the upper HTML element is equal to or higher than the height of the lower HTML element. Determined.

  Condition 3 can be said to be a condition indicating that the Y coordinate value of the upper side of one HTML element is equal to or less than the Y coordinate value of the bottom side of the other HTML element. Alternatively, Condition 3 can be said to be a condition indicating that the entire vertical range of one HTML element is lower than the vertical range of the other HTML element. That is, the condition 3 is a condition for determining whether one HTML element wraps around below the other HTML element. Note that γ in condition 3 is also a constant to allow an error in coordinates used for condition determination. Usually, γ is a small negative number.

  When the condition 3 is satisfied (Yes in S304), the comparison unit 17 detects two HTML elements to be determined as parallel relationships as differences in the display results of the Web browsers 11 (S305). That is, it is detected that there is an incompatibility between the two Web browsers 11 regarding the display of the two HTML elements.

  In addition, when the determination result of the parallel relationship for every Web browser 11 corresponds (No in S303), or the determination result of the parallel relationship for each Web browser 11 is different from each other, but the condition 3 is not satisfied (No in S304). Step S305 is not executed.

  Subsequently, the comparison unit 17 determines whether or not the determination of the presence or absence of the parallel relationship has been executed for all combinations of two HTML elements from the HTML element group from which the display coordinates have been acquired (S306). When there is an undetermined combination (No in S306), Step S301 and subsequent steps are repeated for the combination. If there is no undetermined combination (Yes in S306), the process in FIG. 17 ends.

  As described above, according to the first embodiment, each HTML element is colored with a different color, and an HTML document is displayed. Among the pixels constituting the image showing the display result of the HTML document, the display area of the HTML element is specified based on the pixel of the color assigned to the HTML element for each HTML element. Therefore, the display area of a plurality of HTML elements can be specified by one display for each Web browser 11. As a result, the display area of each HTML element in the HTML document can be efficiently specified.

  Next, a second embodiment will be described. In the second embodiment, differences from the first embodiment will be described. In the second embodiment, points not particularly mentioned may be the same as those in the first embodiment.

  In recent PCs (Personal Computers), anti-aliasing processing is performed so that smooth characters are displayed even at a low display resolution. The anti-aliasing process is a process in which a gradation is given to the edge of a character so that the character can be seen clearly from a distance.

  When anti-aliasing processing is performed, even if a tag such as <font color = # FF0000> is added to one text element and one color is assigned, there are many character strings related to the text element in actual display. Colors will be used. Therefore, even if a pixel having an RGB value indicating the assigned color of the text element is extracted from the captured image, it is difficult to accurately obtain a circumscribed rectangle of the text element based on the pixel. This is because the pixel may include a pixel constituting an HTML element other than the text element.

  Therefore, in the second embodiment, when a color is assigned to a text element, the hue is used as a reference, and colors having different hues are assigned to each text element. If the character background is an achromatic color, the hue of the pixels constituting the character is unchanged even in the anti-aliasing process, and even if the character background is a chromatic color, the hue of the pixels constituting the character is The property of not changing greatly is used.

  In the second embodiment, the variable H is used in place of the variable C as a variable for managing the color assigned to the HTML element in the processing of FIG. Note that the variable names are different only to avoid confusion with the first embodiment.

  The initial value of the variable H is 0, for example. Further, in step S103 of FIG. 3, for example, the processing shown in FIG. 19 is executed. FIG. 19 is a flowchart for explaining an example of a processing procedure of assigned color determination processing according to the second embodiment.

  In step S <b> 401, the assigned color determination unit 12 assigns the result of adding β to the variable H to the variable H. By doing so, a color different from the already assigned color is assigned. β is, for example, a constant such as 1. If a chromatic color is used for the background of the character, the value of β is preferably larger than 1. In the HTML document, the background color is specified by the bgcolor attribute in the <body> tag. Therefore, whether or not the background color is a chromatic color may be determined based on the value of bgcolor.

  Subsequently, the assigned color determination unit 12 converts the color specified by the hue H, the saturation 1 and the lightness 1 into an RGB value (S402). The assigned color determination unit 12 sets the conversion result as the assigned color of the target element. However, the saturation and lightness are not necessarily 1 as long as the values are other than 0. Further, the saturation and lightness do not have to be common values among the HTML elements.

  In step S <b> 105 of FIG. 3, the assigned color determination unit 12 stores the value of the variable H (that is, the hue value) in the assigned color storage unit 122 in association with the target element.

  FIG. 20 is a diagram illustrating an example of values stored in the allocated color storage unit in the second embodiment. As shown in FIG. 20, in the second embodiment, the assigned color storage unit 122 stores the hue value assigned to the HTML element for each HTML element (for each XPath).

  Therefore, in step S110, a combination of XPath and hue is selected. Hereinafter, the hue selected in step S110 is referred to as “selected hue”.

  Next, details of step S111 in FIG. 3 will be described. FIG. 21 is a flowchart for explaining an example of a process for specifying a circumscribed rectangle of a pixel of a certain color in the second embodiment.

  In step S501, the display area specifying unit 16 substitutes the value of the selected hue into the variable I. Subsequently, the display area specifying unit 16 converts the RGB value of each pixel of the captured image, which is a bitmap image expressed by RGB values, into HSV (hue, saturation, brightness) values (S502). The conversion may be performed by a known method.

Subsequently, the display area specifying unit 16 extracts all the pixels satisfying the following expression (1) from the pixels constituting the capture image (S503).
I−β / 2 ≦ Hue of pixel H <I + β / 2 (1)
In equation (1), it is considered that the hue slightly changes due to the effect of anti-aliasing, and an error in the range of ± β / 2 is allowed. That is, in step S503, a pixel having a color related to a hue within a predetermined range is extracted from the hue of the selected color.

  Subsequently, the display area specifying unit 16 specifies the circumscribed rectangle (minimum circumscribed rectangle) of the extracted pixel, and acquires the coordinate values of the upper left vertex and the lower right vertex of the circumscribed rectangle (S504). The acquired coordinate values are stored in the display area storage unit 124 (FIG. 8) in association with the XPath of the selected element.

  As described above, according to the second embodiment, the display area of each HTML element can be specified even when anti-aliasing processing is performed.

  Next, a third embodiment will be described. In the third embodiment, differences from the second embodiment will be described. In the third embodiment, points not particularly mentioned may be the same as those in the second embodiment.

  In the third embodiment, a case is considered in which processing with higher anti-aliasing is performed, such as ClearType (registered trademark) or CoolType (registered trademark), for displaying characters.

  For characters displayed with ClearType (registered trademark) or CoolType (registered trademark) applied, there are pixels that have a color that is significantly different from the color specified for the character in the pixels constituting the character To do. Therefore, for a text element displayed with ClearType (registered trademark) or CoolType (registered trademark) applied, the color specified for the text element as in the first embodiment or the second embodiment. Even if this pixel is simply extracted, the circumscribed rectangle of the extracted pixel may be significantly different from the display area of the text element. This is because the pixels of a text element are mixed with pixels of multiple colors, so there is a high possibility that pixels of the same color exist in other text elements, and the text elements are distinguished based on color information. This is because it becomes difficult.

  Therefore, in the third embodiment, the processing shown in FIG. 22 is executed with respect to step S111 in FIG. Note that the color (hue) assignment method for each HTML element may be the same as in the second embodiment.

  FIG. 22 is a flowchart for explaining an example of a process for specifying a circumscribed rectangle of a pixel of a certain color in the third embodiment.

  In step S601, the display area specifying unit 16 converts the RGB value of each pixel of the capture image, which is a bitmap image expressed by RGB values, into HSV (hue, saturation, brightness) values.

  FIG. 23 is an example of an image for explaining a circumscribed rectangle specifying process for a pixel of a certain color in the third embodiment. In FIG. 23, it is assumed that (1) is a captured image. The color difference in the captured image is expressed by shading in the drawing. This indicates that pixels of different colors are mixed as a result of applying ClearType (registered trademark) or CoolType (registered trademark) even though the same hue is assigned to the character string “Press”.

  Subsequently, the display area specifying unit 16 binarizes the captured image (S602). The binarization may be performed by a known method. For example, attention may be paid to the V value of each pixel in the captured image, and binarization may be performed on the V value using Otsu's binarization algorithm. Alternatively, binarization may be performed by other methods such as simply using an average value of V values as a threshold for binarization. Note that (2) in FIG. 23 shows an image generated by binarization. Hereinafter, an image generated by binarization is referred to as a “binary image”. In the following, when the captured image is referred to, the image is an original captured image that is not binarized (that is, the image of (1) in FIG. 23).

  Subsequently, the display area specifying unit 16 extracts connected elements by recursively connecting the black pixels adjacent to the adjacent 8 pixels in the binary image (S603).

  FIG. 24 is a diagram for explaining the vicinity of adjacent 8. In FIG. 24, when pixel (1) is the target pixel, pixel (2) whose side is in contact with pixel (1) and pixel (3) whose vertex is in contact with image (1) are adjacent to pixel (1). 8 neighboring pixels. A connected element connected in the vicinity of the adjacent 8 means an element formed by a set of black pixels in a relationship of adjacent 8 adjacent to each other.

  FIG. 23 (3) shows an example in which three connection elements of connection elements ce1, ce2, and ce3 are extracted. Each connected element is a set of pixels estimated to have the same color. For example, it is presumed that the pixel groups constituting the connection element ce1 have the same color. Further, the generation of the binary image in step S602 is executed to improve the extraction accuracy of the connected elements when the background color of the HTML document to be evaluated is unknown or not uniform. If the background color of the HTML document is known and the background color is uniform, connected elements may be extracted for images other than the background color in the captured image. In this case, a binary image may not be generated.

  Subsequently, the display area specifying unit 16 obtains a histogram (frequency distribution table) of hues of pixels corresponding to the connected elements on the captured image for each connected element (S604). That is, as shown in (4) of FIG. 23, for each of the connected elements ce1, ce2, and ce3, a histogram of the hue of the pixel corresponding to the connected element in the captured image is obtained. Note that the image shown in (4) of FIG. 23 is the same as the image of (1).

  Subsequently, for each connected element, the display area specifying unit 16 obtains the median value of the hue based on the histogram obtained for the connected element, and uses the median as the representative hue value of the connected element (S605). ). In addition to the median value, a representative value such as an average value or a mode value may be used as the representative hue value.

  Subsequently, the display area specifying unit 16 replaces the hue value of each pixel of the captured image with the representative hue value obtained for the connected element to which the pixel belongs (hereinafter referred to as “hue replacement image”). Is generated (S606). FIG. 23 (5) shows an example of a hue replacement image. In the hue replacement image, the hues of all the images constituting the character string “Press” have the same value (representative hue value).

  Subsequently, the display area specifying unit 16 performs the same process as steps S501, S503, and S504 in FIG. 21 for the hue replacement image.

  That is, the display area specifying unit 16 substitutes the value of the selected hue for the variable I (S607). Subsequently, the display area specifying unit 16 extracts all the pixels satisfying the above formula (1) among the pixels constituting the hue replacement image (S608). In the hue replacement image, the hue value of each pixel corresponding to the character string is replaced with a common representative hue value, but there is a possibility that the representative hue value includes an error, so that ± β / Two errors are taken into account.

  Subsequently, the display area specifying unit 16 specifies the circumscribed rectangle (minimum circumscribed rectangle) of the extracted pixel, and acquires the coordinate values of the upper left vertex and the lower right vertex of the circumscribed rectangle (S609). The acquired coordinate values are stored in the display area storage unit 124 (FIG. 8) in association with the XPath of the selected element.

  As described above, according to the third embodiment, even when processing that further enhances anti-aliasing, such as ClearType (registered trademark) or CoolType (registered trademark), is executed. The display area can be specified.

  In each of the above embodiments, the comparison device 10 is an example of a display area specifying device. The allocation color determination unit 12 is an example of an allocation unit. The HTML document modification unit 13 is an example of a change unit. The browser display unit 14 is an example of a display unit. The display area specifying unit 16 is an example of a specifying unit. The comparison unit 17 is an example of a detection unit. The HTML element is an example of a display element. In other words, the present embodiment may be applied to display data other than an HTML document and display data including a plurality of display elements. In this case, a browser suitable for the display data may be used instead of the Web browser 11. A capture image is an example of a display image.

  As mentioned above, although the Example of this invention was explained in full detail, this invention is not limited to such specific embodiment, In the range of the summary of this invention described in the claim, various deformation | transformation・ Change is possible.

Regarding the above description, the following items are further disclosed.
(Appendix 1)
An assigning unit that assigns a different color to each display element included in the display data;
A changing unit that changes the definition content of the display data so that each display element or a background of each display element is displayed in a color assigned to the display element by the assigning unit;
A display unit for displaying the display data after the change by the change unit in a browser;
In the display image showing the display result of the display data by the browser, for each color assigned to the display element, an area specified based on the pixel of the color is designated as a display area of the display element to which the color is assigned. A specific part to identify as,
A display area specifying device comprising:
(Appendix 2)
The display unit displays the display data after the change by the change unit in a plurality of browsers,
The specifying unit, for each browser, in a display image showing a display result of the display data by the browser, for each color assigned to the display element, an area specified based on a pixel of the color, Identify the display area of the display element assigned the color,
The display area specifying apparatus according to claim 1, further comprising a detection unit that detects a difference in display results of the plurality of browsers by comparing display areas of the display elements specified for the browsers.
(Appendix 3)
The changing unit assigns a different hue to each display element, and defines the display data so that each display element or the background of each display element is displayed in a color related to the hue assigned to the display element. Change the content,
In the display image, for each hue assigned to the display element, the specifying unit assigns the hue to an area specified based on a pixel of a color related to a hue within a predetermined range from the hue. Specify as the display area of the display element,
The display area specifying device according to appendix 1 or 2, characterized in that:
(Appendix 4)
The changing unit assigns a different hue to each display element, and defines the display data so that each display element or the background of each display element is displayed in a color related to the hue assigned to the display element. Change the content,
For each pixel of a color different from the background color of the display data, the specifying unit obtains a set of pixels adjacent to the pixel, and for each set, the hue of each pixel included in the set is An image replaced with a representative value related to the hue distribution of the image is generated, and in the image, each hue assigned to the display element is specified based on pixels of a color related to a hue within a predetermined range from the hue. The display area of the display element to which the hue is assigned,
The display area specifying device according to appendix 1 or 2, characterized in that:
(Appendix 5)
The changing unit assigns a different hue to each display element, and defines the display data so that each display element or the background of each display element is displayed in a color related to the hue assigned to the display element. Change the content,
The specifying unit generates a binary image in which the display image is binarized, obtains a set of black pixels adjacent to the black pixel for each black pixel in the binary image, and For each set, an image is generated in which the hues of the pixels corresponding to the black pixels included in the set are replaced by representative values related to the distribution of the respective hues, and the image is assigned to the display element in the image. For each hue, an area identified based on pixels of a color within a predetermined range from the hue is identified as a display area of a display element to which the hue is assigned.
The display area specifying device according to appendix 1 or 2, characterized in that:
(Appendix 6)
Computer
Assign different colors to each display element included in the display data,
Change the definition content of the display data so that each display element or the background of each display element is displayed in the color assigned to the display element by the assigning process,
Display the display data after the change by the processing to be changed in a browser;
In the display image showing the display result of the display data by the browser, for each color assigned to the display element, an area specified based on the pixel of the color is designated as a display area of the display element to which the color is assigned. As specified,
A display area specifying method characterized by executing processing.
(Appendix 7)
In the process of displaying, the display data after the change by the process of changing is displayed on a plurality of browsers,
In the display image showing the display result of the display data by the browser for each of the browsers, the specifying process specifies an area specified based on the pixel of the color for each color assigned to the display element. Specify the display area of the display element to which the color is assigned,
The display area according to claim 6, wherein the computer executes a process of comparing the display areas of the respective display elements specified for each of the browsers and detecting differences in display results of the plurality of browsers. Identification method.
(Appendix 8)
The process of changing assigns a different hue to each display element, and displays each display element or the background of each display element in a color related to the hue assigned to the display element. Change the definition,
In the display process, for each hue assigned to the display element in the display image, the hue is assigned to an area specified based on a pixel having a color within a predetermined range from the hue. Specified as the display area of the displayed element,
The display area specifying method according to appendix 6 or 7, characterized in that:
(Appendix 9)
The process of changing assigns a different hue to each display element, and displays each display element or the background of each display element in a color related to the hue assigned to the display element. Change the definition,
In the specifying process, for each pixel of a color different from the background color of the display data, a set of pixels adjacent to the pixel is obtained, and for each set, each hue of the pixels included in the set is Generate an image replaced with a representative value for each hue distribution, and specify for each hue assigned to the display element in the image based on pixels of a color related to a hue within a predetermined range from the hue Identify the area to be displayed as the display area of the display element to which the hue is assigned.
The display area specifying method according to appendix 6 or 7, characterized in that:
(Appendix 10)
The process of changing assigns a different hue to each display element, and displays each display element or the background of each display element in a color related to the hue assigned to the display element. Change the definition,
The specifying process generates a binary image in which the display image is binarized, obtains a set of black pixels adjacent to the black pixel for each black pixel in the binary image, and for the display image, For each set, an image is generated in which the hues of the pixels corresponding to the black pixels included in the set are replaced by representative values related to the distribution of the respective hues, and the image is assigned to the display element in the image. For each hue, an area specified based on pixels of a color within a predetermined range from the hue is specified as a display area of a display element to which the hue is assigned.
The display area specifying method according to appendix 6 or 7, characterized in that:
(Appendix 11)
On the computer,
Assign different colors to each display element included in the display data,
Change the definition content of the display data so that each display element or the background of each display element is displayed in the color assigned to the display element by the assigning process,
Display the display data after the change by the processing to be changed in a browser;
In the display image showing the display result of the display data by the browser, for each color assigned to the display element, an area specified based on the pixel of the color is designated as a display area of the display element to which the color is assigned. As specified,
A program that executes processing.
(Appendix 12)
In the process of displaying, the display data after the change by the process of changing is displayed on a plurality of browsers,
In the display image showing the display result of the display data by the browser for each of the browsers, the specifying process specifies an area specified based on the pixel of the color for each color assigned to the display element. Specify the display area of the display element to which the color is assigned,
The program according to appendix 11, wherein the computer executes a process of comparing the display areas of the display elements specified for each browser and detecting differences in the display results of the plurality of browsers.
(Appendix 13)
The process of changing assigns a different hue to each display element, and displays each display element or the background of each display element in a color related to the hue assigned to the display element. Change the definition,
In the display process, for each hue assigned to the display element in the display image, the hue is assigned to an area specified based on a pixel having a color within a predetermined range from the hue. Specified as the display area of the displayed element,
The program according to appendix 11 or 12, characterized by the above.
(Appendix 14)
The process of changing assigns a different hue to each display element, and displays each display element or the background of each display element in a color related to the hue assigned to the display element. Change the definition,
In the specifying process, for each pixel of a color different from the background color of the display data, a set of pixels adjacent to the pixel is obtained, and for each set, each hue of the pixels included in the set is Generate an image replaced with a representative value for each hue distribution, and specify for each hue assigned to the display element in the image based on pixels of a color related to a hue within a predetermined range from the hue Identify the area to be displayed as the display area of the display element to which the hue is assigned.
The program according to appendix 11 or 12, characterized by the above.
(Appendix 15)
The process of changing assigns a different hue to each display element, and displays each display element or the background of each display element in a color related to the hue assigned to the display element. Change the definition,
The specifying process generates a binary image in which the display image is binarized, obtains a set of black pixels adjacent to the black pixel for each black pixel in the binary image, and for the display image, For each set, an image is generated in which the hues of the pixels corresponding to the black pixels included in the set are replaced by representative values related to the distribution of the respective hues, and the image is assigned to the display element in the image. For each hue, an area specified based on pixels of a color within a predetermined range from the hue is specified as a display area of a display element to which the hue is assigned.
The program according to appendix 11 or 12, characterized by the above.

DESCRIPTION OF SYMBOLS 10 Comparison apparatus 11 Web browser 12 Allocation color determination part 13 HTML document modification part 14 Browser display part 15 Screen capture part 16 Display area specification part 17 Comparison part 18 Output part 100 Drive apparatus 101 Recording medium 102 Auxiliary storage apparatus 103 Memory apparatus 104 CPU
105 interface device 106 display device 107 input device 121 HTML document storage unit 122 assigned color storage unit 123 modified document storage unit 124 display area storage unit B bus

Claims (7)

An assigning unit that assigns a different color to each display element included in the display data;
A changing unit that changes the definition content of the display data so that each display element or a background of each display element is displayed in a color assigned to the display element by the assigning unit;
A display unit for displaying the display data after the change by the change unit in a browser;
In the display image showing the display result of the display data by the browser, for each color assigned to the display element, an area specified based on the pixel of the color is designated as a display area of the display element to which the color is assigned. A specific part to identify as,
A display area specifying device comprising: The display unit displays the display data after the change by the change unit in a plurality of browsers,
The specifying unit, for each browser, in a display image showing a display result of the display data by the browser, for each color assigned to the display element, an area specified based on a pixel of the color, Identify the display area of the display element assigned the color,
The display area specifying device according to claim 1, further comprising: a detection unit that detects a difference in display results of the plurality of browsers by comparing display areas of the display elements specified for the browsers. . The changing unit assigns a different hue to each display element, and defines the display data so that each display element or the background of each display element is displayed in a color related to the hue assigned to the display element. Change the content,
In the display image, for each hue assigned to the display element, the specifying unit assigns the hue to an area specified based on a pixel of a color related to a hue within a predetermined range from the hue. Specify as the display area of the display element,
The display area specifying device according to claim 1, wherein the display area specifying device is a display area specifying device. The changing unit assigns a different hue to each display element, and defines the display data so that each display element or the background of each display element is displayed in a color related to the hue assigned to the display element. Change the content,
For each pixel of a color different from the background color of the display data, the specifying unit obtains a set of pixels adjacent to the pixel, and for each set, the hue of each pixel included in the set is An image replaced with a representative value related to the hue distribution of the image is generated, and in the image, each hue assigned to the display element is specified based on pixels of a color related to a hue within a predetermined range from the hue. The display area of the display element to which the hue is assigned,
The display area specifying device according to claim 1, wherein the display area specifying device is a display area specifying device. The changing unit assigns a different hue to each display element, and defines the display data so that each display element or the background of each display element is displayed in a color related to the hue assigned to the display element. Change the content,
The specifying unit generates a binary image in which the display image is binarized, obtains a set of black pixels adjacent to the black pixel for each black pixel in the binary image, and For each set, an image is generated in which the hues of the pixels corresponding to the black pixels included in the set are replaced by representative values related to the distribution of the respective hues, and the image is assigned to the display element in the image. For each hue, an area identified based on pixels of a color within a predetermined range from the hue is identified as a display area of a display element to which the hue is assigned.
The display area specifying device according to claim 1, wherein the display area specifying device is a display area specifying device. Computer
Assign different colors to each display element included in the display data,
Change the definition content of the display data so that each display element or the background of each display element is displayed in the color assigned to the display element by the assigning process,
Display the display data after the change by the processing to be changed in a browser;
In the display image showing the display result of the display data by the browser, for each color assigned to the display element, an area specified based on the pixel of the color is designated as a display area of the display element to which the color is assigned. As specified,
A display area specifying method characterized by executing processing. On the computer,
Assign different colors to each display element included in the display data,
Change the definition content of the display data so that each display element or the background of each display element is displayed in the color assigned to the display element by the assigning process,
Display the display data after the change by the processing to be changed in a browser;
In the display image showing the display result of the display data by the browser, for each color assigned to the display element, an area specified based on the pixel of the color is designated as a display area of the display element to which the color is assigned. As specified,
A program that executes processing.