JP2005190443A - Web browser display screen verification method and apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method and a apparatus for verifying whether a display screen is displayed as intended by a web content provider or not when a web content is displayed on a web browser mounted on a built-in terminal such as a mobile phone terminal or a PDA. <P>SOLUTION: Content data like a HTML document or multimedia data distributed from a web server is acquired directly from the web server or through the built-in terminal, and display screen data is generated in accordance with the content data, and display screen data outputted from the web browser of the built-in terminal is acquired, and these two display screen data are compared in a pixel signal level to automatically and accurately verify whether or not the web browser generates a display screen as intended by the web content provider. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a method and apparatus for verifying a display screen of a Web browser mounted on an embedded terminal, and in particular, when browsing Web content using a mobile terminal such as a mobile phone terminal or a PDA, the display screen is Web The present invention relates to a method and a system for verifying whether or not a content provider is displaying as intended.

  In the present invention, “embedded terminal” refers to an electronic device other than a general-purpose computer in which a CPU operates in accordance with a program stored in a ROM and functions as a communication terminal.

  As an example of an embedded terminal equipped with a Web browser, a conventional technology will be described for a mobile phone terminal. FIG. 8 is a diagram schematically showing a system for acquiring Web content from a Web server on the Internet and displaying it on a mobile phone terminal. In FIG. 8, when the mobile phone terminal 50 accesses the Internet 20 through the base station 40 and requests the Web server 10 to acquire Web content, the Web server 10 transmits the requested Web content to the mobile phone terminal 50.

  The Web content transmitted by the Web server 10 is generally data described in a markup language such as HTML, which is subjected to a predetermined conversion process in the gateway 30 and then transmitted to the mobile phone terminal 50. . The gateway 30 converts the data transmitted from the Web server 10 into a format that can be displayed on the Web browser installed in the mobile phone terminal 50 based on the model information of the mobile phone terminal 50 and the like. For example, an HTML tag that is not supported by the Web browser of the mobile phone terminal 50 is removed or converted to another tag.

  By the way, the Web browser installed in the mobile phone terminal is made specifically for each model of the mobile phone terminal, although it follows a certain specification. For example, it has been developed in consideration of the display screen size and the number of colors of the mobile phone terminal. For this reason, even if the same Web content is received by Web browsers of different types of mobile phone terminals, it is not always displayed in the same manner on the Web browser.

  Further, as described above, the gateway that mediates between the web server and the mobile phone terminal converts the transmission data, so even if the same web content is received from the same web server, if the mediating gateway is different, the mobile phone The display on the web browser of the telephone terminal is not always the same. Furthermore, for text data, the language code may change due to processing at the gateway. Note that the above situation applies not only to mobile phone terminals but also to all built-in terminals equipped with a Web browser.

  Therefore, it becomes necessary to test whether the Web content distributed from the Web server is displayed as intended by the distributor on the Web browser of the embedded terminal. Conventionally, Web content is actually acquired and displayed on a Web browser of an embedded terminal, and the size, layout, and color of the displayed data are appropriate in consideration of the content of the Web content and the attributes of the Web browser. It was confirmed visually.

  However, a service that links a Web server with an application server or database, dynamically generates Web content in response to an input operation from the Web browser, and transmits it to the Web browser is generally performed. In this case, the display test in the Web browser needs to manually check the display results for all input patterns, which is a heavy burden on the test operator.

  In recent years, multimedia data such as moving images has been distributed to mobile phone terminals, etc., but whether or not the display of image data and moving image data on a Web browser is appropriate. It is considered very difficult for a test operator to confirm visually.

  Furthermore, if the layout of the display result intended by the distributor cannot be obtained, or if the display data generated by the Web application or the like cannot be predicted, it is accurately determined whether the content displayed on the Web browser is valid. There is no means to judge.

  In order to solve such a problem, a system that supports a Web system operation check test, a system that automatically performs a test, and the like have been proposed.

  The “test support program and test support method” disclosed in Patent Document 1 generates candidate data according to the attribute of the data input area included in the HTML data distributed from the Web server in the test support apparatus, and the HTML The candidate data is displayed together with the HTML data on the browser by being inserted into the data and transmitted to the client. Thereby, it is said that the trouble of the operation input in the operation check operation of the server application can be saved and a highly reliable test result can be obtained.

The "mobile phone test automation system" disclosed in Patent Document 2 automatically inputs a key from a test apparatus to a mobile phone according to a test scenario, and compares screen display contents with result data prepared in advance. It is. As a result, the enormous number of people and the number of days required for repeatedly confirming the operation of the mobile phone system can be reduced.
JP2003-44318A. JP 2002-335320 A.

  However, the technique described in Patent Document 1 focuses on the operation check test of the Web server and cannot be applied to the test of the Web browser itself. The technique described in Patent Document 2 is applied to a test of a Web system in which a test result needs to be prepared in advance and a test result cannot be obtained or a display content dynamically changes depending on a test situation. Can not.

  In any of the above documents, when the Web content distributed from the Web server is converted by the gateway and displayed on the Web browser of the embedded terminal with different implementation for each model, as the distributor intends. The point of testing whether the display is present is missing. In addition, no consideration is given to the point that it is necessary to verify the display screen of the Web content whose display content dynamically changes in accordance with the input from the Web browser.

  The present invention has been made in view of such circumstances, and when a Web content is displayed on a Web browser installed in an embedded terminal such as a mobile phone terminal or a PDA, the display screen is intended by the Web content provider. It is an object of the present invention to provide a method and an apparatus for verifying whether or not the display is performed as described above.

  As a result of diligent research in view of the above problems, the present inventor acquires content data such as an HTML document or multimedia data distributed from a Web server directly from the Web server or through an embedded terminal, and displays it according to the content data. The screen data is generated, the display screen data output from the Web browser of the embedded terminal is obtained, and the two display screen data are compared at the pixel signal level, so that the Web browser can perform as intended by the Web content provider. It was thought that it was possible to verify automatically and accurately whether or not a display screen was generated.

  That is, the present invention is a method for verifying a display screen of a Web browser, which acquires first display screen data output from a Web browser of an embedded terminal and performs second display from content data received from a Web server. The present invention provides a method for generating screen data and comparing the first and second display screen data to verify whether they are the same.

  The present invention is also a method for verifying a display screen of a Web browser, and acquires content data received by an embedded terminal and first display screen data output from the Web browser of the embedded terminal according to the content data Then, a third display screen data is generated from the acquired content data, and a method for comparing the first and third display screen data to verify whether or not they are the same is provided.

  The present invention is also a method for verifying a display screen of a Web browser, and acquires content data received by an embedded terminal and first display screen data output from the Web browser of the embedded terminal according to the content data Then, the third display screen data is generated from the acquired content data, the second display screen data is generated from the content data received from the Web server, and the first, second, and third display screen data The present invention provides a method for comparing two arbitrary display screen data and verifying whether they are the same.

  In the display screen verification method of the Web browser of the present invention, whether or not the display screen data obtained by performing a logical operation on the second and third display screen data and the first display screen data are the same It is characterized by verifying.

  For example, if logical product is taken, it is possible to generate display screen data reflecting only the part deleted from the content data in the gateway in the original content data, and if logical sum is taken, it is written from the content data in the gateway. Display screen data reflecting only the added portion in the original content data can be generated.

  In the display screen verification method of the Web browser of the present invention, the comparison result of the display screen data is displayed or output. For example, a monitor or a printer unit may be provided, or a signal may be output outside the apparatus.

  In the Web browser display screen verification method of the present invention, the content data acquired from the embedded terminal and the content data received from the Web server are compared to verify whether they are the same.

  As a result, it is possible to verify how the content data transmitted from the Web server to the mobile phone terminal has been changed in the gateway or the mobile phone terminal. This is particularly useful for verification of description language data and the like.

In the display screen verification method for a Web browser according to the present invention, a comparison result of content data is displayed or output.
The Web browser display screen verification method of the present invention is particularly suitable for application to a mobile phone terminal equipped with a Web browser.

  The present invention also includes means for acquiring first display screen data output from a Web browser of an embedded terminal, means for generating second display screen data from content data received from a Web server, and the first And a display screen verification device provided with means for comparing the second display screen data and verifying whether they are the same.

  The present invention also provides means for acquiring content data received at the embedded terminal, first display screen data output from the Web browser of the embedded terminal in accordance with the content data, and third content from the acquired content data. The present invention provides a display screen verification apparatus comprising means for generating display screen data and means for comparing the first and third display screen data to verify whether they are the same.

  The present invention also provides means for acquiring content data received at the embedded terminal, first display screen data output from the Web browser of the embedded terminal in accordance with the content data, and third content from the acquired content data. Means for generating display screen data, means for generating second display screen data from content data received from a web server, and any two display screens among the first, second and third display screen data There is provided a display screen verification device provided with means for comparing data and verifying whether they are identical.

  The display screen verification apparatus of the present invention compares the display screen data obtained by performing a logical operation on the second and third display screen data with the first display screen data, and verifies whether or not they are the same. The apparatus further comprises means.

  The display screen verification apparatus of the present invention further includes means for comparing the content data acquired from the embedded terminal and the content data received from the Web server to verify whether they are the same.

  The display screen verification apparatus according to the present invention further includes means for displaying or outputting the comparison result of the display screen data or the comparison result of the content data.

  As described above, according to the display screen verification system and verification device for the embedded-terminal-equipped Web browser of the present invention, whether the Web browser generates a display screen as intended by the Web content provider, It can be verified automatically and accurately. In addition, content data dynamically generated according to input from a Web browser can be verified without any problem. Since data used for verification is automatically acquired, there is an advantage that it is not necessary to acquire data for verification in advance.

  Further, if the display screen verification system of the present invention is applied to the mobile phone test automation system disclosed in Patent Document 2, the test of the Web browser can be completely automated, and the development efficiency of the Web browser is greatly increased. Will be improved.

  Hereinafter, with reference to the attached drawings, as a best mode for carrying out a display screen verification method and verification device for a built-in terminal-mounted Web browser according to the present invention, a display screen verification system for a Web browser-mounted mobile phone terminal is described in detail. Explained. 1 to 8 are diagrams illustrating embodiments of the present invention. In these drawings, the same reference numerals denote the same components, and the basic configuration and operation are the same. To do.

[First embodiment]
FIG. 1 is a schematic diagram showing the overall configuration of a system for verifying a display screen of a Web browser installed in a mobile phone terminal as a first embodiment of the present invention. In the figure, parts that are not particularly described are the same as those of the conventional system shown in FIG.

  1, the Web browser display screen verification system according to the present embodiment includes a Web server 10 that provides Web content for a mobile phone terminal through the Internet 20, a mobile phone terminal 50 that can access the Web content, and a mobile phone terminal. 50, a base station 40 serving as an access point, a gateway 30 that mediates data transmission between the Web server 10 and the mobile phone terminal 50, and a display screen verification device 70. The display screen verification device 70 is communicably connected to the Web server 10 via a communication line 80 such as a LAN or WAN, and is connected to the mobile phone terminal 50 via a connection cable 60 such as a serial cable.

  FIG. 2 is a functional block diagram schematically showing the internal configuration of the Web server 10 shown in FIG. The Web server 10 converts the Web content into content data in a format that can be displayed on the mobile phone terminal in the Web application 11. The content data includes text data described in a markup language such as HTML, multimedia data such as images and moving images, binary data such as programs, and the like. The Web server 10 generates HTTP protocol data including the content data in the intra-server HTTP interface 12, and uses the data as a data packet addressed to the mobile phone terminal in the intra-server communication interface 13 such as TCP / IP. Send to.

  The Web server 10 also transmits the content data generated in the Web application 11 to a predetermined terminal connected to the LAN 80, that is, the display screen verification device 70 in FIG.

  FIG. 3 is a functional block diagram schematically showing the internal configuration of the mobile phone terminal 50 shown in FIG. The mobile phone terminal 50 demodulates the received data from the signal received from the base station 40 in the wireless communication interface 51, takes out the content data included in the received data in the in-mobile phone terminal HTTP interface 52, and outputs it to the Web browser 53. The web browser 53 generates a display screen from the content data, and outputs the display screen data (pixel signal) to the LCD 54. In this way, Web content is displayed on the LCD 54 screen. The web browser 53 also outputs the same display screen data (pixel signal) that is output to the LCD 54 to the display screen verification device 70 through the external connection interface 55.

  FIG. 4 is a functional block diagram schematically showing the internal configuration of the display screen verification device 70 shown in FIG. The display screen verification device 70 can be composed of a general personal computer or the like, and includes a program for realizing the functions described below.

  The display screen verification device 70 acquires display screen data from an input signal from the mobile phone terminal 50 in the mobile phone interface 73 and causes the display screen data comparison unit 71 to output the display screen data. Further, the data packet from the web server 10 is received by the intra-client communication interface 74, the content data is acquired from the data packet by the intra-client HTTP interface 75, and is output to the display screen data generation unit 76. The display screen data generation unit 76 generates display screen data from the content data by applying parameters according to the model of the mobile phone terminal 50 and the type of Web browser. This parameter is set according to the display screen size and the number of colors that are different for each model of the mobile phone terminal or for each Web browser, and the display screen data intended by the Web content distributor is generated by applying the parameter. It has come to be. The display screen data (pixel signal) generated by the display screen data generation unit 76 is output to the display screen data comparison unit 71.

  The display screen data comparison unit 71 compares the display data input from the mobile phone interface 73 with the display data input from the display screen data generation unit 76. In this comparison, both data are compared for each pixel to determine whether or not they match. If they do not match, the display screen verification device 70 displays a predetermined warning to the user.

  According to the display screen verification system of the present embodiment described above, the display screen data actually output on the Web browser of the mobile phone terminal and the display screen data intended by the Web content distributor are pixelated. Since the comparison can be automatically performed at the signal level, the operation of the Web browser can be verified with high accuracy and efficiency.

[Second Embodiment]
A display screen verification system for a mobile phone terminal-mounted web browser according to a second embodiment of the present invention will be described with reference to FIGS. The overall system configuration of this embodiment is the same as that of the first embodiment shown in FIG. Also, in the figure, parts that are not particularly described are the same as those of the conventional system shown in FIG.

  FIG. 5 is a functional block diagram schematically showing the internal configuration of the mobile phone terminal 50 of the present embodiment. The mobile phone terminal 50 shown in the figure is composed of the same components as the mobile phone terminal 50 of the first embodiment, but the display screen data is output from the Web browser 53 to the external connection interface 55 and Content data is output from the in-phone terminal HTTP interface 52 to the external connection interface 55. Therefore, the mobile phone terminal 50 outputs the content data received from the Web server 10 and the display data (pixel signal) processed by the Web browser 53 to the display screen verification device 70.

  FIG. 6 is a functional block diagram schematically showing the internal configuration of the display screen verification device 70 of the present embodiment. The display screen verification device 70 shown in the figure has a configuration in which the intra-client communication interface 74 is omitted from the display screen verification device 70 of the first embodiment. Further, the display screen verification device 70 acquires the content data and the display screen data from the input signal from the mobile phone terminal 50 in the mobile phone interface 73, and displays the display screen data on the in-client HTTP interface 75. The screen data comparison unit 71 outputs the data.

  As a result, the display screen verification device 70 of the present embodiment actually displays the display screen data generated from the content data received at the mobile phone terminal 50 and the web browser of the mobile phone terminal 50 in the display screen data comparison unit 71. Can be automatically compared with the display screen data output at the pixel signal level. As a result, if the two data do not match, it is assumed that there is a software problem of the Web browser and a hardware problem of the LCD. Also, for example, if both data match but the screen actually displayed on the LCD 54 of the mobile phone terminal 50 is different from what the Web content distributor intends, data conversion in the gateway 30 is performed. It is estimated that

[Third embodiment]
With reference to FIG. 7, a display screen verification system for a mobile phone terminal-mounted web browser according to a third embodiment of the present invention will be described. The overall system configuration of this embodiment is the same as that of the first embodiment shown in FIG. Also, in the figure, parts that are not particularly described are the same as those of the conventional system shown in FIG.
The cellular phone terminal 50 of this embodiment is configured as shown in FIG.

  FIG. 7 is a functional block diagram schematically showing the internal configuration of the display screen verification device 70 of the present embodiment. The display screen verification device 70 shown in the figure has the same configuration as the display screen verification device 70 of the first embodiment, but the content data included in the input signal from the mobile phone terminal 50 in the mobile phone interface 73. Is output to the in-client HTTP interface 75, and the display screen data is output to the display screen data comparison unit 71.

  Therefore, in the display screen data generation unit 76, the content data received at the mobile phone terminal 50 and the content data directly received from the web server 10 are acquired. Data may be selectively used to generate display screen data.

  As a result, the display screen verification device 70 of the present embodiment uses the display screen data comparison unit 71 to display the display screen data generated from the content data received at the mobile phone terminal 50 and the Web content distribution directly acquired from the Web server 10. The display screen data intended by the user and the display screen data actually output on the web browser of the mobile phone terminal 50 can be automatically compared at the pixel signal level.

  Alternatively, the display screen data generation unit 76 may obtain new display screen data by performing a logical operation (AND, OR, XOR, etc.) on two display screen data generated from both data. For example, if logical product is taken, it is possible to generate display screen data in which only the part deleted from the content data in the gateway 30 is reflected in the original content data. Display screen data reflecting only the part added to the original content data can be generated.

  Further, in the display screen verification device 70 of the present embodiment, the content data comparison unit 79 that acquires and compares the above two content data from the in-client HTTP interface 75 is provided, and is transmitted from the Web server 10 to the mobile phone terminal 50. It is possible to verify what changes have been made in the gateway 30 or the mobile phone terminal 50.

  As mentioned above, although the verification method and verification apparatus of the display screen of the Web browser with an embedded terminal of the present invention have been described in detail by showing specific embodiments, the present invention is not limited to these. A person skilled in the art can make various changes and improvements to the configurations and functions of the invention according to the above-described embodiments or other embodiments without departing from the gist of the present invention.

  The method and apparatus for verifying the display screen of a Web browser with a built-in terminal according to the present invention can be any web browser embedded device that functions as a communication terminal, for example, a mobile phone terminal, a PDA, a car navigation system, a home appliance, or a digital television receiver. It is possible to apply to.

1 is a schematic diagram showing an overall configuration of a system for verifying a display screen of a Web browser mounted on a mobile phone terminal as a first embodiment of the present invention. FIG. 2 is a functional block diagram schematically showing an internal configuration of the Web server shown in FIG. 1. It is a functional block diagram which shows roughly the internal structure of the mobile telephone terminal shown in FIG. It is a functional block diagram which shows roughly the internal structure of the display screen verification apparatus shown in FIG. It is a functional block diagram which shows roughly the internal structure of the mobile telephone terminal in the system of 2nd Embodiment of this invention. It is a functional block diagram which shows roughly the internal structure of the display screen verification apparatus in the system of 2nd Embodiment of this invention. It is a functional block diagram which shows roughly the internal structure of the display screen verification apparatus in the system of 3rd Embodiment of this invention. 1 is a diagram schematically showing a system for acquiring Web content from a Web server on the Internet and displaying it on a mobile phone terminal.

Explanation of symbols

10 Web server 11 Web application 12 HTTP interface in server 13 Communication interface in server 20 Internet 30 Gateway 40 Base station 50 Mobile phone terminal 51 Wireless communication interface 52 HTP interface in mobile phone terminal 53 Web browser 54 LCD
55 External connection interface 60 Connection cable 70 Display screen verification device 71 Display screen data comparison unit 73 Mobile phone interface 74 In-client communication interface 75 In-client HTTP interface 76 Display screen data generation unit 79 Content data comparison unit 80 Communication line

Claims (14)

A method for verifying a display screen of a web browser,
Obtaining first display screen data output from the web browser of the embedded terminal;
Generating second display screen data from the content data received from the Web server;
A method of comparing the first and second display screen data to verify whether they are the same. A method for verifying a display screen of a web browser,
Acquiring content data received at the embedded terminal and first display screen data output from the web browser of the embedded terminal according to the content data;
Generating second display screen data from the acquired content data;
A method of comparing the first and second display screen data to verify whether they are the same. A method for verifying a display screen of a web browser,
Acquiring content data received at the embedded terminal and first display screen data output from the web browser of the embedded terminal according to the content data;
Generating second display screen data from the acquired content data;
Generating third display screen data from the content data received from the Web server;
A method of comparing two arbitrary display screen data among the first, second and third display screen data to verify whether they are the same. The method for verifying a display screen of a web browser according to claim 3,
A method comprising: comparing display screen data obtained by performing a logical operation on the second and third display screen data and the first display screen data to verify whether or not they are the same. In the method of verifying the display screen of the web browser according to any one of claims 1 to 4,
A method of displaying or outputting a comparison result of display screen data. In the method of verifying the display screen of the Web browser according to claim 3 or 4,
A method of comparing content data acquired from the embedded terminal with content data received from a Web server and verifying whether they are the same. The method for verifying a display screen of a web browser according to claim 6,
A method of displaying or outputting a comparison result of content data. A method for verifying a display screen of a web browser according to any one of claims 1 to 7,
A method of verifying a display screen of a Web browser of a mobile phone terminal. Means for obtaining first display screen data output from a web browser of an embedded terminal;
Means for generating second display screen data from content data received from a web server;
A web browser display screen verification device comprising: means for comparing the first and second display screen data to verify whether they are the same. Means for obtaining content data received at the embedded terminal, and first display screen data output from the web browser of the embedded terminal according to the content data;
Means for generating second display screen data from the acquired content data;
A web browser display screen verification device comprising: means for comparing the first and second display screen data to verify whether they are the same. Means for obtaining content data received at the embedded terminal, and first display screen data output from the web browser of the embedded terminal according to the content data;
Means for generating second display screen data from the acquired content data;
Means for generating third display screen data from content data received from a Web server;
A web browser display screen verification device comprising: means for comparing two arbitrary display screen data among the first, second and third display screen data to verify whether they are the same.   The display screen data obtained by performing a logical operation on the second and third display screen data and the first display screen data are further compared to verify whether they are the same. The Web browser display screen verification device according to claim 11.   The web browser according to claim 11 or 12, further comprising means for comparing the content data acquired from the embedded terminal with the content data received from the web server and verifying whether or not they are the same. Display screen verification device. 14. The Web browser display screen verification device according to claim 9, further comprising means for displaying or outputting a display screen data comparison result or content data comparison result.

Images