JP6833007B2 - Information processing device, control method of information processing device, and control program - Google Patents

Description

The present invention relates to an information processing device or the like for performing a screen display test.

Various devices have been developed for automatically inspecting whether or not the screen display of the device is normal. For example, in the technique described in Patent Document 1, test efficiency is achieved by automatically generating correct screen images and mask data, and learning the tendency of differences generated depending on the environment and timing of test execution and using them during the test. Attempts have been made to improve the accuracy and accuracy.

International Publication No. 2016/170618 Pamphlet

On the other hand, when trying to automatically determine the presence or absence of a defect in the screen display, there is a risk that a minute display deviation that should not be detected as a defect may be erroneously detected as a defect. For example, a deviation in the screen display that occurs in the device under test that cannot be seen by humans may be detected as a defect. In this case, the number of detected defects in the equipment has increased, and as a result, it may be necessary for a human to perform a visual retest.

One aspect of the present invention is to realize an information processing device or the like capable of reducing erroneous detection of defects in a screen display test.

The information processing device according to one aspect of the present invention includes a first data acquisition unit, a second data acquisition unit, a comparison unit, a search unit, and a display control unit. The first data acquisition unit acquires the first data. The first data is moving image data generated in the reference device based on the operation data including the information indicating the operation content and the operation timing of the user. The second data acquisition unit acquires the second data. The second data is moving image data generated in the target device based on the same operation data as the operation data. The comparison unit sequentially compares the first data and the second data in frame units. If there is a frame in which the first data and the second data do not match as a result of the comparison of the comparison unit, the search unit refers to either the frame image of the first data or the frame image of the second data in the frame. As an image, it is searched for whether or not a frame image matching the reference image exists in a predetermined number of frames before and after the other frame image. When the frame image that matches the reference image does not exist, the display control unit causes the output unit to output that the second data has a problem.

In the information processing apparatus according to one aspect of the present invention, the second data acquisition unit may sequentially acquire the second data generated by the target device in real time. Then, the comparison unit may sequentially compare the first data and the second data acquired by the second data acquisition unit.

In the information processing apparatus according to one aspect of the present invention, the operation data may include position information that is periodically updated and information indicating the acquisition timing of the position information. Then, the first data and the second data may include a map image of a predetermined area generated according to the position information.

In the information processing apparatus according to one aspect of the present invention, it is desirable that the predetermined number corresponds to a time shorter than 0.3 seconds when converted into the frame rates of the first data and the second data.

In the information processing apparatus according to one aspect of the present invention, the display control unit may output the number of frames of the reference image to the output unit when there is no frame image matching the reference image.

In the information processing apparatus according to one aspect of the present invention, the output unit may include at least one of a display unit and a communication unit. The display unit may display that a defect has occurred in the second data when there is no frame image that matches the reference image. Further, the communication unit may notify an external device that a problem has occurred in the second data when there is no frame image that matches the reference image.

The information processing device according to one aspect of the present invention may include a difference location identification unit. When there is a frame in which the first data and the second data do not match, the difference location specifying unit identifies the difference between the frame image of the first data and the frame image of the second data in the frame. Further, the search unit may determine a predetermined number according to the position of the difference on the frame image.

The control method of the information processing apparatus according to one aspect of the present invention includes a first data acquisition step, a second data acquisition step, a comparison step, a search step, and a display control step. In the first data acquisition step, the first data is acquired. The first data is moving image data generated in the reference device based on the operation data including the information indicating the operation content and the operation timing of the user. In the second data acquisition step, the second data is acquired. The second data is moving image data generated in the target device based on the same operation data as the operation data. In the comparison step, the first data and the second data are sequentially compared in frame units. In the search step, if there is a frame in which the first data and the second data do not match as a result of the comparison in the comparison step, either the frame image of the first data or the frame image of the second data in the frame is used as a reference. As an image, it is searched for whether or not a frame image matching the reference image exists in a predetermined number of frames before and after the other frame image. In the display control step, when the frame image matching the reference image does not exist, the output unit is made to output that the second data has a problem.

The control program according to one aspect of the present invention is a control program for operating a computer as an information processing device, and is a first data acquisition step, a second data acquisition step, a comparison step, a search step, and a display. Have the computer perform the control steps. In the first data acquisition step, the first data is acquired. The first data is moving image data generated in the reference device based on the operation data including the information indicating the operation content and the operation timing of the user. In the second data acquisition step, the second data is acquired. The second data is moving image data generated in the target device based on the same operation data as the operation data. In the comparison step, the first data and the second data are sequentially compared in frame units. In the search step, if there is a frame in which the first data and the second data do not match as a result of the comparison in the comparison step, either the frame image of the first data or the frame image of the second data in the frame is used as a reference. As an image, it is searched for whether or not a frame image matching the reference image exists in a predetermined number of frames before and after the other frame image. In the display control step, when the frame image matching the reference image does not exist, the output unit is made to output that the second data has a problem.

According to one aspect of the present invention, it is possible to reduce erroneous detection of defects in the screen display test.

It is a block diagram which shows the main part structure of the apparatus included in the test system which concerns on Embodiment 1. FIG. It is a figure which shows an example of the process flow in a test apparatus. It is a figure which shows an example of the flow of a test process. It is a figure which showed the comparison process schematically. An example of a display screen when the first data and the second data are simultaneously reproduced is shown. It is a figure which shows an example of the test result screen. It is a block diagram which shows the main part structure of the apparatus included in the test system which concerns on Embodiment 2. It is a figure which shows an example of the process flow in the test system which concerns on Embodiment 2. It is a block diagram which shows the main part structure of the apparatus included in the test system which concerns on Embodiment 3. It is a figure which shows an example of the process flow in a test apparatus. It is a block diagram which shows the main part structure of the apparatus included in the test system which concerns on Embodiment 4. It is a figure which shows an example of the process flow in a test apparatus. It is a block diagram which shows the main part structure of the apparatus included in the test system which concerns on Embodiment 5. It is a figure which shows an example of the result reproduction screen. It is a figure which shows an example of the operation data confirmation screen. It is a block diagram which shows the main part structure of the apparatus included in the modification 2 of the main part structure of the test system which concerns on Embodiment 1 and the modification 3 of the main part structure. It is a block diagram which shows the main part structure of the apparatus included in the modification 4 of the main part structure of the test system which concerns on Embodiment 1. FIG.

≪System overview≫
The test system according to each embodiment of the present invention is a system for executing a screen display test. The screen display test is a test for determining whether the screen display on the device under test is normal or abnormal.

Here, "the screen display is normal" means, for example, that the device to be tested displays the specified image on the display screen with the specified accuracy and timing. It should be noted that this image may also include a moving image. In the following description, the image means both a still image and a moving image. On the other hand, "abnormal screen display" means that the device under test does not display the specified image on the display screen with the specified accuracy and timing due to some problem.

The screen display test is performed, for example, on a pre-shipment device as part of a performance test. Further, for example, when a software program related to screen display is created or updated, the screen display test is executed as a part of the operation test of the program on the device in which the program is installed.

The image described above may include a GUI (Graphical User Interface). When the GUI is included in the image displayed on the device to be tested in the screen display test, it can be said that the screen display test also has an aspect of the GUI operation test. Hereinafter, specific examples of the test system according to the present invention will be described in detail in the first to sixth embodiments.

[Embodiment 1]
≪Main part composition≫
Hereinafter, the test system 600 according to the first embodiment will be described with reference to FIGS. 1 to 6. FIG. 1 is a block diagram showing a main configuration of an apparatus included in the test system 600. As shown in the figure, the test system 600 includes a reference device 1, a target device 2, a test device 3, and a storage device 4.

The test device 3 is a device that executes a screen display test. The storage device 4 is an external storage device of the test device 3. The target device 2 is a device to be tested in the screen display test. On the other hand, the reference device 1 is a reference device to be compared with the target device 2 in the screen display test executed by the test system 600.

The test device 3 is connected to one or more reference devices 1, one or more target devices 2, and one or more storage devices 4 by wire or wirelessly. In the present embodiment, unless otherwise specified, as shown in FIG. 1, the test device 3 is connected to one reference device 1, one target device 2, and one storage device 4. I will do it.

In the present embodiment, the reference machine is a device having standard performance. The image display accuracy and display timing of the reference device 1 serve as a reference for determining whether or not the image display accuracy and display timing of the target device 2, that is, the screen display of the target device 2 is normal.

The reference device 1 and the target device 2 may be of the same type or different types of devices. In the present embodiment, the reference device 1 and the target device 2 are of the same type. The reference device 1 and the target device 2 are realized, for example, by a display device of a terminal of a car navigation system mounted on a vehicle.

(Reference device 1)
The reference device 1 includes a first operation data acquisition unit 11, a first storage unit 12, a first control unit 13, and a first display unit 14.

The first operation data acquisition unit 11 acquires operation data from the test apparatus 3. The operation data is data including information indicating the operation content and operation timing of the user. The details of the operation data will be described later. The first operation data acquisition unit 11 stores the acquired operation data in the first storage unit 12.

The first storage unit 12 is a storage device that stores operation data. Further, the first storage unit 12 stores various programs executed by the first control unit 13. For example, the first storage unit 12 stores a program related to display control executed by the first control unit 13. Hereinafter, the program related to the display control is referred to as a display program.

The first control unit 13 comprehensively controls the reference device 1 by executing various programs stored in the first storage unit 12. For example, the first control unit 13 has a function of executing display control of the first display unit 14 and capture of the display screen of the first display unit 14. The first control unit 13 includes a first display control unit 131 and a first capture unit 132 in order to realize these functions.

The first display control unit 131 reads the display program and the operation data from the first storage unit 12, and controls the first display unit 14 as described in the display program and the operation data. As a result, the image as a result of executing the display program according to the content of the input operation described in the operation data is displayed on the first display unit 14.

The first capture unit 132 captures the display screen of the first display unit 14 as moving image data. As described above, the first display unit 14 displays an image according to the description of the operation data by the first display control unit 131. Therefore, it can be said that the moving image data captured by the first capture unit 132 is the moving image data generated in the reference device based on the operation data. The first capture unit 132 transmits the captured moving image data to the test device 3. Hereinafter, the moving image data captured by the first capture unit 132 will be referred to as "first data".

The first capture unit 132 may transmit the captured moving image data with the identifier of the reference device 1 to the test apparatus 3 as the first data. For example, when the test system 600 includes a plurality of reference devices 1, it is desirable that the test device 3 can determine which reference device 1 is the first data. Therefore, in this case, it is preferable that the first data is given the identifier of the reference device 1.

The first display unit 14 is a display device that displays an image under the control of the first control unit 13. The specific configuration of the first display unit 14 is not particularly limited.

(Target device 2)
The target device 2 includes a second operation data acquisition unit 21, a second storage unit 22, a second control unit 23, and a second display unit 24.

The second operation data acquisition unit 21 acquires operation data from the test apparatus 3. Here, the operation data acquired by the second operation data acquisition unit 21 is the same data as the operation data acquired by the first operation data acquisition unit 11 of the reference device 1. The second operation data acquisition unit 21 stores the acquired operation data in the second storage unit 22.

The second storage unit 22 is a storage device that stores operation data. Further, the second storage unit 22 stores various programs executed by the second control unit 23. For example, the second control unit 23 stores a display program executed by the second control unit 23.

The second control unit 23 comprehensively controls the target device 2 by executing various programs stored in the second storage unit 22. For example, the second control unit 23 has a function of executing display control of the second display unit 24 and capture of the display screen of the second display unit 24. The second control unit 23 includes a second display control unit 231 and a second capture unit 232 in order to realize these functions.

The second display control unit 231 reads the display program and the operation data from the second storage unit 22, and controls the second display unit 24 as described in the display program and the operation data. As a result, the image as a result of executing the display program according to the content of the input operation described in the operation data is displayed on the second display unit 24.

The second capture unit 232 captures the display screen of the second display unit 24 as moving image data. As described above, the second display unit 24 displays an image according to the description of the operation data by the second display control unit 231. Therefore, it can be said that the moving image data captured by the second capture unit 232 is the moving image data generated in the reference device based on the operation data. The second capture unit 232 transmits the captured moving image data to the test device 3. Hereinafter, the moving image data captured by the second capture unit 232 will be referred to as "second data".

The second capture unit 232 may transmit the captured moving image data with the identifier of the target device 2 to the test apparatus 3 as the second data. For example, when the test system 600 includes a plurality of target devices 2, it is desirable that the test device 3 can determine which target device 2 is the second data. Therefore, in this case, it is preferable that the second data is given the identifier of the target device 2.

The second display unit 24 is a display device that displays an image under the control of the second control unit 23. The specific configuration of the second display unit 24 is not particularly limited.

(Storage device 4)
The storage device 4 is a storage device that stores operation data and test results. The storage device 4 stores the operation data 41. Further, the storage device 4 may store the test result data 42.

The operation data 41 is data indicating the content of the input operation of the user and the timing of the input operation. For example, the operation data 41 may be log data of an input operation actually performed by the user in the reference device 1 or a device of the same type as the reference device 1. Further, for example, the operation data 41 may be data automatically generated by the test device 3 or another external device. Further, for example, the operation data 41 may be data that can be created and edited by the user by using a dedicated tool installed in the test device 3 or another external device.

The test result data 42 is data showing the result of the screen display test in the test apparatus 3. Hereinafter, the result of the screen display test is also simply referred to as a test result.

(Test device 3)
The test device 3 includes a data collection unit 31, a third storage unit 32, a third control unit 33, an input unit 34, an output unit 35, and an operation data output unit 36.

The data collection unit 31 receives the first data from the reference device 1. The data collecting unit 31 stores the received first data as the first data 321 in the third storage unit 32. In addition, the data collection unit 31 receives the second data from the target device 2. The data collecting unit 31 stores the collected second data as the second data 322 in the third storage unit 32.

In the test system 600, when the test device 3 can be connected to a plurality of reference devices 1, the data collection unit 31 may store the received first data in the third storage unit 32 for each reference device 1. desirable. Further, in the test system 600, when the test apparatus 3 can be connected to a plurality of target devices 2, the data collecting unit 31 may store the received second data in the third storage unit 32 for each target device 2. desirable.

The third storage unit 32 is a storage device that stores various data required by the test device 3. The third storage unit 32 stores the first data 321 and the second data 322. In the test system 600, when the test device 3 can be connected to a plurality of reference devices 1, the third storage unit 32 stores the first data 321 for each reference device 1. Further, in the test system 600, when the test device 3 can be connected to a plurality of target devices 2, the third storage unit 32 stores the second data 322 for each target device 2. Further, the third storage unit 32 stores various programs executed by the third control unit 33 of the test apparatus 3.

The operation data output unit 36 reads the operation data 41 from the storage device 4 and transmits it to the reference device 1 and the target device 2. The timing at which the operation data output unit 36 transmits the operation data 41 to the reference device 1 and the target device 2 is not particularly limited. For example, when the third control unit 33 specifies that the input unit 34 has received the input operation instructing the transmission of the operation data, the operation data output unit 36 sends the operation data 41 to the reference device 1 and the target device 2.

The input unit 34 is an input interface that accepts a user's input operation. The input unit 34 is realized by, for example, a physical button or a mouse in the test device 3. The input unit 34 transmits the content of the input operation to the third control unit 33.

The output unit 35 has at least one of a third display unit 351 and a communication unit 352. The third display unit 351 is a display device that displays an image under the control of the second control unit 23. The specific configuration of the second display unit 24 is not particularly limited. The communication unit 352 outputs an image to an external device under the control of the second control unit 23 by using wired communication such as Ethernet (registered trademark) or wireless communication such as WiFi (registered trademark) or Bluetooth (registered trademark).

(Third control unit 33)
The third control unit 33 is an information processing device that comprehensively controls the test device 3 by executing various programs stored in the third storage unit 32. The third control unit 33 specifies the instruction content for the input operation transmitted from the input unit 34, and controls each unit of the test apparatus 3 according to the instruction content.

Specifically, the third control unit 33 reads the operation data 41 of the storage device 4 and sends it to the operation data output unit 36. Further, the third control unit 33 acquires the first data 321 and the second data 322 and compares the respective moving images in frame units. Next, when the frame images do not match as a result of the comparison, the third control unit 33 searches for whether or not there is a frame image that matches a predetermined number of frames before and after, so that the second data 322 has a problem. Determine if it exists. Then, the third control unit 33 causes the third display unit 351 to display the determination result, that is, the result of the screen display test. In order to realize these functions, the third control unit 33 includes a first data acquisition unit 331, a second data acquisition unit 332, a comparison unit 333, a search unit 334, and a third display control unit 335. Including.

The first data acquisition unit 331 acquires the first data 321 from the third storage unit 32. The first data acquisition unit 331 sends the acquired first data 321 to the comparison unit 333. When the test device 3 receives the first data from the plurality of reference devices 1, the third storage unit 32 stores the first data 321 for each reference device 1. In such a case, the first data acquisition unit 331 may determine the first data 321 to be read according to the user's input operation to the input unit 34.

The second data acquisition unit 332 acquires the second data 322 from the third control unit 33. The second data acquisition unit 332 sends the acquired second data 322 to the comparison unit 333. When the test device 3 receives the second data from the plurality of target devices 2, the third storage unit 32 stores the second data 322 for each target device 2. In such a case, the second data acquisition unit 332 may determine the second data 322 to be read according to the user's input operation to the input unit 34.

The comparison unit 333 sequentially compares the first data 321 and the second data 322 in frame units. As described above, the first data 321 and the second data 322 are images generated by the reference device 1 and the target device 2, respectively, based on the same operation data. In the present embodiment, the first data 321 and the second data 322 will be described as being moving image data having the same number of frames.

The comparison unit 333 notifies the search unit 334 of the comparison result. That is, the comparison unit 333 determines whether or not the frame image of the first data 321 and the frame image of the second data 322 at a certain frame number match, and the search unit associates the frame number with the determination result. Notify 334. The frame number is a serial number attached to each frame image in the moving image data. Further, when the comparison of all frames of the first data 321 and the second data 322 is completed, the comparison unit 333 notifies the search unit 334 to that effect.

The comparison unit 333 may notify the search unit 334 of the frame number and the comparison result at each frame number for all the frames after the comparison of all the frames is completed. In this case, the comparison unit 333 does not have to notify the search unit 334 again that the comparison of all frames has been completed.

The search unit 334 executes the process described below according to the content of the notification from the comparison unit 333. First, when the comparison unit 333 notifies that the frame image of the first data 321 and the frame image of the second data 322 match as the determination result for a certain frame, the search unit 334 determines that the frame is the same. It is determined that the test result of the second data is normal.

On the other hand, when the comparison unit 333 notifies that the frame image of the first data 321 and the frame image of the second data 322 do not match as the determination result for a certain frame, the search unit 334 describes the mismatched frame as follows ( The processes 1) and (2) are executed. Hereinafter, a frame in which the frame image of the first data 321 and the frame image of the second data 322 do not match is referred to as a mismatched frame. Further, the following processes (1) and (2) are collectively referred to as a search process. A specific example of the search process will be described later.

(1) Either the frame image of the first data or the frame image of the second data in the mismatched frame is used as the reference image.

(2) For at least one of the frame images before and after the other frame image that is not the reference image, the search target image is searched for a frame image that matches the reference image among the frame images of a predetermined number of frames. Hereinafter, the other frame image that is not the reference image is also referred to as a search target image.

As will be described in detail later, the “predetermined number” in (2) indicates, in other words, the number of frames that can be tolerated as a deviation from the reference image. Hereinafter, this predetermined number is also referred to as "the number of grace frames".

If, as a result of the process of (2), there is a frame image that matches the search target image in the mismatched frame, the search unit 334 determines that the test result of the second data is normal for the mismatched frame. That is, the search unit 334 does not determine that the deviation of the screen display of the second data received from the target device 2 is a defect if the deviation of the image from the first data is within the range of the number of grace frames. It is desirable that the number of grace frames corresponds to a time shorter than 0.3 seconds when converted into the frame rates of the first data 321 and the second data 322. Generally, it is said that the deviation of the screen display that can be recognized by humans is about 0.3 seconds. Therefore, by setting the allowable range of the deviation of the number of frames to the extent equivalent to 0.3 seconds as described above, even if a problem occurs on the display screen, a minute deviation that cannot be recognized by the user is allowed. However, only when the deviation is larger than that can be detected as a defect.

On the other hand, as a result of the search in (2), if there is no frame image that matches the search target image in the mismatched frame, the search unit 334 determines that the test result of the second data is abnormal for the mismatched frame. .. That is, the search unit 334 determines that a defect has occurred in the second data in the mismatched frame.

The search unit 334 executes the above-mentioned processes (1) and (2) each time the comparison unit 333 notifies that the frame image of the first data 321 and the frame image of the second data 322 do not match. .. Then, when the comparison unit 333 notifies that the comparison of all the frames is completed, the search unit 334 notifies the third display control unit 335 of the test result for each frame. Alternatively, when the comparison unit 333 notifies the comparison results of all frames at once, the search unit 334 obtains the test results for each frame by making a determination for each frame in the above-mentioned cases. The test result is notified to the third display control unit 335.

As a test result, the search unit 334 may notify the third display control unit 335 of, for example, a frame number and information indicating whether the frame image of the second data at each frame number is normal or abnormal.

Further, the search unit 334 may notify the third display control unit 335 of the test result of the second data as a whole together with the test result for each frame instead of the test result for each frame. For example, when the following conditions (A) or (B) are met, the search unit 334 may notify the third display control unit 335 that the second data is normal as a test result.

(A) There was no mismatched frame.

(B) Although there were mismatched frames, it was determined that all the second data were normal for the mismatched frames.

On the other hand, in a case other than the above (A) or (B), that is, when it is determined that the second data is abnormal in any of the mismatched frames, the search unit 334 sends the second data to the third display control unit 335. May be notified that is abnormal.

The search unit 334 may store at least one of the test result for each frame and the test result for the entire second data in the storage device 4 as the test result data 42.

The third display control unit 335 creates an image showing the test result according to the test result notified from the search unit 334 and displays it on the third display unit 351. A specific example of the image created by the third display control unit 335 will be described in detail later.

(Modification example 1 of the main part configuration)
In the test system 600, the storage device 4 may be integrally configured with the third storage unit 32. For example, the third storage unit 32, which is an internal storage device of the test device 3, may store the first data 321 and the second data 322, the operation data 41, and the test result data 42. In this case, the storage device 4 is not essential in the test system 600. Further, for example, the storage device 4 which is an external storage device of the test device 3 may store the first data 321 and the second data 322, the operation data 41, and the test result data 42.

In either case, the data required for the operation of the third control unit 33, the first data acquisition unit 331, the second data acquisition unit 332, and each unit may be read from the third storage unit 32 or the storage device 4. Further, the search unit 334 may store the test result data 42 in either the third storage unit 32 or the storage device 4.

(Modification example 2 of the main part configuration)
The test system 600 according to the present embodiment may include a first camera 5 and a second camera 6. Hereinafter, the test system 1100 including the first camera 5 and the second camera 6 will be described with reference to FIG.

FIG. 16 is a block diagram showing a main part configuration of an apparatus included in the test system 1100, which is a modification 2 and a modification 3 of the main part configuration of the test system 600. The test system 1100 differs from the test system 600 in that it includes a first camera 5 and a second camera 6. In the test system 1100, the first capture unit 132 and the second capture unit 232 are not essential configurations.

The first camera 5 captures the display screen of the first display unit 14 as a moving image, thereby acquiring a moving image in which the images displayed by the first display unit 14 are sequentially projected, that is, the first data. By photographing the display screen of the second display unit 24, the second camera 6 acquires a moving image in which the images displayed by the second display unit 24 are sequentially projected, that is, the second data. The data collection unit 31 of the test system 1100 acquires the first data and the second data from the first camera 5 and the second camera 6, respectively. In this case, the first data acquisition unit 331 and the second data acquisition unit 332 adjust to the first data or the second data so that the size of the screen portion to be compared is unified and the color tone, saturation, etc. of the image are approximated. May be added. As a result, the comparison by the comparison unit 333 can be performed with high accuracy.

(Modification example 3 of the main part configuration)
As shown in FIG. 16, the test system 1100 according to the present embodiment may include a first test device 7 that transmits operation data to the reference device 1 and the target device 2. Further, the test system 1100 captures moving image data captured by the first capture unit 132 of the reference device 1 and the second capture unit 232 of the target device 2 from and from, or from the first camera 5 and the second camera 6. The configuration may include a second test apparatus 8 for acquisition and comparison.

The first test device 7 is the same as the operation data output unit 51 having the same function as the operation data output unit 36, the fourth control unit 52 that collectively controls the first test device 7, and the third display control unit. A fourth display control unit 521 having the same function as the above, a second input unit 53 having the same function as the input unit 34, a fourth display unit 54 having the same function as the third display unit 351 and a second communication control. A unit 55 and the like may be provided.

The second test apparatus 8 may include a first input unit 39 having the same function as the input unit 34. When at least a part of the first data acquired from the reference device 1 and the second data acquired from the target device 2 do not match, the second test device 8 sets the first test device 7 at the timing when a problem occurs. The first communication control unit 38 is provided, which transmits a request for acquiring the operation data 41 and receives the operation data 41 in response to the request for acquiring the operation data 41 transmitted from the first test apparatus 7. The first test apparatus 7 receives a request for acquiring the operation data 41 from the second test apparatus 8, and transmits the operation data 41 in response to the request for acquiring the operation data 41 received by the first test apparatus 7. A second communication control unit 55 may be provided.

(Modification example 4 of the main part configuration)
The test system 600 according to the present embodiment may transmit the operation data 41 to the plurality of reference devices 1 and the plurality of target devices 2. Hereinafter, a test system 1200 including a plurality of reference devices 1 and a plurality of target devices 2 will be described with reference to FIG.

FIG. 17 is a block diagram showing a main part configuration of the device included in the test system 1200, which is a modification 4 of the main part configuration of the test system 600. The reference device 1-1 and the reference device 1-2 each have the same configuration as the reference device 1. The target device 2-1 and the target device 2-2 each have the same configuration as the target device 2. The operation data output unit 36 transmits the operation data 41 to at least one of the reference device 1-1, the reference device 1-2, the target device 2-1 and the target device 2-2. Further, in the test system 1200, the data collection unit 31 collects the first data-1 from the reference device 1-1, collects the first data-2 from the reference device 1-2, and targets the second data-1. Collect from device 2-1 and collect second data-2 from target device 2-2. The first data-1 and the first data-2 are the first data in the reference device 1-1 and the reference device 1-2, respectively. The second data-1 and the second data-2 are the second data in the target device 2-1 and the target device 2-2, respectively. The test system 1200 has a first comparison unit 333-1 that compares the first data-1 and the second data-1 collected by the data collection unit 31, and a first data-2 collected by the data collection unit 31. And the second data-2, and has a second comparison unit 333-2 for comparison. Then, the test system 1200 includes a search unit 334 that acquires the results of comparisons made by each of the first comparison unit 333-1 and the second comparison unit 333-2, and searches for a defective portion using the results. I'm out. In the example of FIG. 17, a configuration for performing a screen display test of a system in which two reference devices and two target devices operate in cooperation with each other is described, but the reference devices and targets included in the target system for which the screen display test is performed. The number of devices is not limited to 2, and a screen display test of a system in which more than 2 reference devices or target devices are linked can also be performed.

≪Processing flow≫
FIG. 2 is a diagram showing an example of a processing flow in the third control unit 33 of the test apparatus 3. The third control unit 33 of the test device 3 acquires the operation data 41 from the storage device 4 at a predetermined timing (S100). For example, when the third control unit 33 identifies that the input operation received by the input unit 34 is an input operation instructing the transmission of the operation data 41, the third control unit 33 acquires the operation data 41 from the storage device 4. The third control unit 33 sends the acquired operation data 41 to the operation data output unit 36.

The operation data output unit 36 transmits the operation data 41 to the reference device 1 (S102). When the first operation data acquisition unit 11 of the reference device 1 receives the operation data 41, the first storage unit 12 stores the operation data 41. When the operation data 41 is already stored in the first storage unit 12, the first operation data acquisition unit 11 may update the operation data 41 of the first storage unit 12. When the operation data 41 is stored in the first storage unit 12 or the operation data 41 of the first storage unit 12 is updated, the first display control unit 131 of the first control unit 13 sets the operation data 41 and the display program. The image is displayed on the first display unit 14 based on the above. Then, the first capture unit 132 of the first control unit 13 creates the first data by sequentially capturing the images. The first control unit 13 transmits the first data created by the first capture unit 132 to the data collection unit 31 of the test apparatus 3.

The data collecting unit 31 receives the first data from the reference device 1 (S104). The data collecting unit 31 stores the received first data in the third storage unit 32 as the first data 321.

Further, the operation data output unit 36 transmits the operation data 41 to the target device 2 (S106). When the second operation data acquisition unit 21 of the target device 2 receives the operation data 41, the second storage unit 22 stores the operation data 41. When the operation data 41 is already stored in the second storage unit 22, the second operation data acquisition unit 21 may update the operation data 41 of the second storage unit 22. When the operation data 41 is stored in the second storage unit 22 or the operation data 41 of the second storage unit 22 is updated, the second display control unit 231 of the second control unit 23 sets the operation data 41 and the display program. The image is displayed on the second display unit 24 based on the above. Then, the second capture unit 232 of the second control unit 23 creates the second data by sequentially capturing the images. The second control unit 23 transmits the second data created by the second capture unit 232 to the data collection unit 31 of the test apparatus 3.

The data collection unit 31 receives the second data from the target device 2 (S108). The data collecting unit 31 stores the received second data in the third storage unit 32 as the second data 322.

The third control unit 33 executes the test process at a predetermined timing after the first data 321 and the second data 322 are stored in the third storage unit 32 (S110). The test process is a process related to the screen display test, and is a series of processes from the comparison of the frame image by the comparison unit 333 to the determination of the test result by the search unit 334. Details of the test process will be described later. The third control unit 33 executes the test process when, for example, the input operation received by the input unit 34 is specified to be an input operation instructing the start of the test.

When the test process is completed, the search unit 334 notifies the third display control unit 335 of the test result. The third display control unit 335 causes the third display unit 351 to display the test result (S112).

According to the process shown in FIG. 2, as a result of comparison between the first data 321 and the second data 322, if the images of the same frame do not match, it is searched for an image that matches a predetermined number of frames before and after. To do. Then, when there is no matching image in a predetermined number of frames before and after, the user is notified that the second data 322 is abnormal, that is, a problem has occurred in the screen display on the target device 2. As a result, it is possible to automatically check whether there is a problem in the screen display on the target device 2 while allowing a certain amount of deviation in the number of frames. Therefore, it is possible to reduce erroneous detection of defects in the screen display test.

(Modification example 1 of processing flow)
The processes S102 to S104 and the processes S106 to S108 may be executed in parallel, or may be executed in the reverse order. That is, the operation data output unit 36 may transmit the operation data 41 to both the reference device 1 and the target device 2 at any timing as long as the operation data 41 can be transmitted to both. Further, if the data collecting unit 31 can receive both the first data of the reference device 1 and the second data of the target device 2, whichever may be received first.

(Modification example 2 of processing flow)
The data acquisition timings of the first data acquisition unit 331 and the second data acquisition unit 332 may be different. For example, the first data acquisition unit 331 may acquire the first data 321 in advance and transmit it to the comparison unit 333. Then, the data collecting unit 31 may receive the second data from the target device 2 in real time.

In this case, the second data acquisition unit 332 may acquire the second data 322 once stored in the third storage unit 32, or may acquire the second data directly from the data collection unit 31. In either case, the second data acquisition unit 332 sequentially acquires the second data generated by the target device 2 in real time and transmits it to the comparison unit 333. Then, the comparison unit 333 sequentially compares the first data 321 with the second data received in real time.

As a result, it is possible to confirm the presence or absence of the defect in real time while operating the target device 2. Therefore, the screen display test can be executed more quickly.

≪Details of test process≫
FIG. 3 is a diagram showing an example of the flow of the test process. The example of FIG. 3 shows the flow of processing when the frame image of the first data is used as the reference image in the search processing. Further, the example of FIG. 3 shows the flow of processing when searching for a frame image that matches the reference image for the frame after the mismatched frame.

First, the first data acquisition unit 331 acquires the first data 321 from the third storage unit 32 (S500). The first data acquisition unit 331 sends the first data 321 to the comparison unit 333. The second data acquisition unit 332 acquires the second data 322 from the third storage unit 32 (S502). The second data acquisition unit 332 sends the second data 322 to the comparison unit 333. Note that S500 and S502 may be performed in no particular order.

The comparison unit 333 compares the received frame image of the first data 321 with the frame image of the second data 322 (S504), and determines whether or not these two frame images match (S506). ). The comparison unit 333 compares and determines the frame images having the same number of frames in order from the first frame of the first data 321 and the second data 322. For example, the comparison unit 333 compares the image of the first frame of the first data 321 with the image of the first frame of the second data 322, determines whether or not they match, and searches for the determination result. Notify department 334.

FIG. 4 is a diagram schematically showing the comparison process by the comparison unit 333. In the example of FIG. 4, the images PA1, PA2, and PA3 show the frame image of the first data 321 and the images PB1, PB2, and PB3 show the frame image of the second data 322. For example, the comparison unit 333 compares the illustrated frame t-1, frame t, and frame t + 1 in this order. At frame t-1, images PA1 and PB1 match. In this case, the comparison unit 333 notifies the search unit 334 that the first data 321 and the second data 322 match with respect to the frame t-1. On the other hand, in the frame t, the image PA2 and the image PB2 are different. In this case, the comparison unit 333 notifies the search unit 334 that the first data 321 and the second data 322 do not match with respect to the frame t. For the frame t + 1, the image PA3 and the image PB3 match. Therefore, the comparison unit 333 notifies the search unit 334 that the first data 321 and the second data 322 match with respect to the frame t + 1.

As a result of the comparison in S504, when the above-mentioned two frame images match (YES in S506), the search unit 334 determines that the frame image of the second data of the frame compared in S504 is normal (S508). ..

On the other hand, as a result of comparison in S504, when the above-mentioned two frame images do not match (NO in S506), the search unit 334 executes the above-mentioned processes (1) and (2). Specifically, the search unit 334 first initializes the frame count held by itself (S510). The initial value of the frame count is not particularly limited, but is assumed to be 0 here.

After initializing the frame count, the search unit 334 determines the reference image. For example, the search unit 334 determines the frame image of the first data as the reference image (S512). Hereinafter, the frame of the reference image is also referred to as a reference frame.

Next, the search unit 334 extracts the frame image one frame after the reference frame as a comparison image for comparison with the reference image for the second data (S514). When the comparative image is extracted, the search unit 334 increases the frame count by 1 (S516). The search unit 334 compares the reference image with the comparison image (S518) to determine whether or not the reference image and the comparison image match (S520). The comparison and determination in S518 to S520 may be the same as the comparison determination in the comparison unit 333. Further, the search unit 334 may cause the comparison unit 333 to execute the comparison determination instead, and may receive the result of the comparison determination from the comparison unit 333.

When the reference image and the comparison image match (YES in S520), the search unit 334 determines that the second data in the reference frame is normal (S508). That is, the search unit 334 does not determine the deviation of the second data received from the target device 2 as a defect if the image deviation from the first data is within the range of the specified value (described later) or less. .. On the other hand, when the reference image and the comparison image do not match (NO in S520), the search unit 334 determines whether the frame count is the same as the specified value or larger than the specified value (S522).

When the frame count is less than the specified value (NO in S522), the search unit 334 repeats the processing after S514. That is, the search unit 334 extracts a frame image one frame after the comparison image in S518 from the frame images of the second data 322 as the next comparison image (S514), and increases the frame count (S516). ), And the comparison determination (S518 to S520) between the reference image and the comparison image is executed.

On the other hand, when the frame count is the same as or larger than the specified value (YES in S522), the search unit 334 determines that the frame image of the second data in the reference frame is abnormal (S524). The specified value in S522 corresponds to the number of grace frames in (2) described above. It is desirable that the number of grace frames corresponds to a time shorter than 0.3 seconds when converted into the frame rates of the first data 321 and the second data 322.

The process shown in FIG. 3 is repeated for all frames of the first data 321 and the second data 322. That is, after the processing of S508 or S524, the search unit 334 determines whether or not the search processing is completed for all frames (S526).

When the search process is not completed for all frames (NO in S526), the third control unit 33 repeats the process from S504. That is, the comparison unit 333 compares the frame images of the next frame numbers of the first data 321 and the second data 322 (S504), determines whether or not the two frame images match (S506), and determines. The result is notified to the search unit 334. Subsequent processing is as described above.

On the other hand, when the search process for all frames is completed (YES in S526), the third control unit 33 ends the test process. The search unit 334 may store the test result in the storage device 4 as the test result data 42.

(Modification example 1 of test processing)
In the search process, a frame image that matches the reference image may be searched for the frame before the mismatched frame. In this case, in S514, the search unit 334 extracts a frame image one frame before the reference frame for the second data as a comparison image. Subsequent processing is as described above.

Desirably, the search unit 334 executes the search process for both the frame before the mismatched frame and the frame after the mismatched frame. Thereby, the accuracy of the test result can be improved.

(Modification example 2 of test processing)
Further, in the search process, the frame image of the second data may be determined as the reference image. In this case, in S514, the search unit 334 reads out the image one frame after the first data as a comparison image and executes the subsequent processing.

(Modified example 3 of test processing)
Further, the test apparatus 3 does not have to automatically perform the processing after S504. In this case, the first data acquisition unit 331 and the second data acquisition unit 332 send the acquired first data 321 and second data 322 to the third display control unit 335, respectively. Then, the third display control unit 335 simultaneously reproduces the first data 321 and the second data 322 in a display mode that can be compared by the user. As a result, the user can visually compare the first data 321 and the second data 322 while reproducing each of them. In this case, the test device 3 does not have to include the comparison unit 333 and the search unit 334. Further, the speed of simultaneous reproduction is not particularly limited, but it is desirable that the speed is easily visible to the user.

FIG. 5 shows an example of the display screen of the third display unit 351 when the first data 321 and the second data 322 are simultaneously reproduced. As shown in the figure, the moving image PA4 of the first data 321 and the moving image PB4 of the second data 322 are displayed on the third display unit 351.

Further, the third display unit 351 may display a column T1 for displaying information for identifying the reference device 1 which is the acquisition destination of the first data 321 being displayed. Further, the third display unit 351 may display a column T2 for displaying information for identifying the target device 2 which is the acquisition destination of the second data 322 being displayed. In the illustrated example, the names of the reference device 1 and the target device 2 are displayed in the columns T1 and T2, respectively.

Further, when the test apparatus 3 is configured to be connectable to a plurality of reference devices 1, the third display unit 351 may display a button B1 for changing the first data 321 to be displayed. When the input operation for selecting the button B1 is performed, the third control unit 33 of the test apparatus 3 causes the third display unit 351 to display a screen or the like for selecting the first data 321 to be displayed, and on the screen, The user may be allowed to select the first data 321 to be displayed. Then, the third display control unit 335 may start displaying the selected first data 321.

Similarly, when the test apparatus 3 is configured to be connectable to a plurality of target devices 2, the third display unit 351 may display a button B2 for changing the second data 322 to be displayed. When the input operation for selecting the button B2 is performed, the third control unit 33 of the test apparatus 3 causes the third display unit 351 to display a screen or the like for selecting the second data 322 to be displayed, and on the screen, The user may be allowed to select the second data 322 to be displayed. Then, the third display control unit 335 may start displaying the selected second data 322. Further, the third display unit 351 has a button B3 for instructing the start of reproduction of the first data 321 and the second data 322, a button B4 for instructing the pause of the video being played, and stopping the reproduction. Button B5 for doing so may be displayed.

The layout of the images and UIs such as icons, input fields, and buttons in FIG. 5 is merely an example, and the layout of each image and UI in the third display unit 351 is not limited to this.

As shown in FIG. 5, by simultaneously reproducing and displaying the first data 321 and the second data 322, the user can visually confirm the first data 321 and the second data 322. As a result, the user can be made to identify only the display deviation of a size that can be recognized by a human being as a defect among the cases where the display screen is displaced between the reference device 1 and the target device 2. Further, since the first data and the second data are simultaneously reproduced, it is possible to facilitate the visual confirmation of both data by the user.

(Modification example 4 of test processing)
As described above, the first data 321 and the second data 322 generated based on the same operation data are originally moving images having the same number of frames. However, in reality, even moving images generated based on the same operation data may be displaced by several frames.

For example, when the reference device 1 and the target device 2 are operated, a plurality of programs are operated in parallel in each device. At this time, the processing of the task of the display program may be slightly delayed due to the conflict of task processing between the programs. Due to such a delay, a difference in length of several frames may occur between the first data and the second data based on the same operation data.

Further, for example, in the case where the first capture unit 132 detects a display control instruction from the first display control unit 131 to the first display unit 14 and starts capturing, the start or end of the operation content included in the operation data. There is a risk that the image related to a part of the above cannot be captured. Similarly, for the second capture unit 232, for example, in the case of a configuration in which a display control instruction from the second display control unit 231 to the second display unit 24 is detected and capture is started, the beginning of the operation content included in the operation data or There is a risk that the image related to the end part cannot be captured.

This is because there may be a time lag between the time when the first capture unit 132 detects the screen display start instruction from the first display control unit 131 to the first display unit 14 and the time when the capture is actually started. Similarly, for the second capture unit 232, there may be a time lag between the detection of the screen display start instruction from the second display control unit 231 to the second display unit 24 and the actual start of capture. There is a risk of.

Further, even if the first display control unit 131 transmits a screen display end instruction to the first display unit 14, the screen display based on the operation data in the first display unit 14 does not necessarily end immediately. For example, when the last operation content included in the operation data is an operation of pressing a specific button, screen processing of animation accompanying the pressing of the button may occur.

In such a case, when the first capture unit 132 detects the instruction to end the screen display from the first display control unit 131 to the first display unit 14 and immediately ends the capture, in the captured moving image, the above-mentioned animation is displayed. There is a risk that the last part of the screen display based on the operation data, such as a part, will be missing. Similarly, for the second display control unit 231 and the second display unit 24, and the second capture unit 232, the last part of the screen display based on the operation data, such as a part of the animation described above, is missing in the captured moving image. There is a risk that it will end up.

The test system 600 according to the present embodiment may execute the following processing so as not to cause such a frame shift. The same applies to the test system according to the subsequent embodiments.

For example, the first display control unit 131 may cause the first display unit 14 to display a surplus image for several frames before the start of the screen display related to the operation data. The image is referred to as a "starting margin image" for convenience. In this case, the first capture unit 132 detects the start instruction of displaying the start residual frame image and starts the screen capture. Similar to the first display control unit 131, the second display control unit 231 may cause the second display unit 24 to display the start remaining frame image before the start of the screen display related to the operation data. In this case, the second capture unit 232 detects the start instruction of displaying the start residual frame image and starts the screen capture. As a result, the first capture unit 132 and the second capture unit 232 can reliably capture the image based on the operation data from the beginning.

Further, for example, the first display control unit 131 may cause the first display unit 14 to display a surplus image for several frames after the screen display related to the operation data is completed. The image is referred to as a "end remainder frame image" for convenience. In this case, the first capture unit 132 detects the end instruction of the display of the end residual frame image and ends the screen capture. Similar to the first display control unit 131, the second display control unit 231 may cause the second display unit 24 to display the end residual frame image after the screen display related to the operation data is completed. In this case, the second capture unit 232 detects the end instruction of displaying the end residual frame image and ends the screen capture. As a result, the first capture unit 132 and the second capture unit 232 can reliably capture the image based on the operation data until the end.

It is desirable that the start surplus frame image and the end surplus frame image are images that can be easily distinguished from the image based on the operation data in the first capture unit 132 and the second capture unit 232. For example, it is desirable that the start margin frame image and the end margin frame image are blank images such as one black color or one white color.

Further, the number of display frames of the start margin frame image and the end margin frame image is not particularly limited. For example, it is desirable that the start remaining frame image is displayed in a number of frames corresponding to a time equal to or longer than the time required for the first capture unit to start screen capture. Further, for example, it is desirable that the end residual frame image is displayed by the number of frames corresponding to several seconds after the output instruction of the image related to the last operation content of the operation data.

Further, when a moving image including a start remaining frame image is captured, the first capture unit 132 and the second capture unit 232 correspond to the starting extra frame image from the captured moving image at the time of generating the first data and the second data, respectively. It is desirable to delete the part to be used. As a result, the comparison process in the comparison unit 333 can be executed as usual. The first capture unit 132 and the second capture unit 232 may or may not delete the end residual frame image.

In this way, when the captured image, that is, the first data and the second data include the start residual frame image, the comparison unit 333 sets the start position in the first data 321 and the second data 322, that is, the operation data. After detecting the original image of the first frame and aligning the start positions, the comparison for each frame may be started.

As a result, when the first data 321 and the second data 322 include the start residual frame image, the comparison unit 333 displays the screen display related to the operation data in the reference device 1 and the screen display related to the operation data in the target device 2. Can be reliably compared from the beginning.

When the first data 321 and the second data 322 include the end residual frame image, the comparison unit 333 displays the screen display related to the operation data in the reference device 1 and the screen display related to the operation data in the target device 2. You can make a reliable comparison until the end. Therefore, the accuracy of the screen display test can be improved.

≪Application example of screen display test≫
The screen display test executed by the test system according to the present invention can be applied to a display terminal device that displays a map, a traveling route of a car, or the like in a car navigation system. Hereinafter, the display terminal device in the car navigation system will also be referred to as a car navigation terminal. For example, in the screen display test executed by the test system 600 according to the present embodiment, the test of the target device 2 which is a car navigation terminal can be executed by executing the process described below.

The car navigation terminal periodically acquires position information, updates its current position, and displays a map around the current position. Therefore, when the reference device 1 and the target device 2 are car navigation terminals, the operation data 41 of the storage device 4 includes the position information that is periodically updated and the information indicating the acquisition timing of the position information. As a result, in the reference device 1 and the target device 2, it is possible to capture an image when the same position information is acquired at the same timing and the same input operation is performed. The operation data output unit 36 of the test device 3 transmits the operation data 41 to the reference device 1 and the target device 2.

Upon receiving the operation data 41, the first display control unit 131 of the first control unit 13 and the second display control unit 231 of the second control unit 23 receive the position information included in the operation data 41 and the operation data 41. , An image corresponding to the display program is created and displayed on the first display unit 14 or the second display unit 24.

For example, the first display control unit 131 and the second display control unit 231 acquire the map data of the predetermined area around the current position indicated by the position information, and the map based on the map data is displayed in the first display unit 14 and the second display unit. Display on 24. Then, the first capture unit 132 and the second capture unit 232 transmit the image including the map image of the predetermined area generated according to the position information to the test apparatus 3 as the first data and the second data, respectively. ..

In this case, the first storage unit 12 and the second storage unit 22 may store map data. Alternatively, the first control unit 13 and the second control unit 23 may acquire map data by communicating with a server or the like (not shown) and display it on the first display unit 14 or the second display unit 24. Subsequent processing is as described above.

With the above configuration, it is possible to identify a defect in the screen display change according to the change in the position information, such as the delay in reflecting the position information on the map image displayed in the target device 2.

≪Display of test results≫
FIG. 6 is a diagram showing an example of a test result screen. The test result screen is a screen showing the result of the screen display test displayed on the third display unit 351 of the test apparatus 3. In the illustrated example, the test result screen is shown when the reference device 1 and the target device 2 are the car navigation terminals as described above.

The test result screen is displayed by the third display control unit 335 when an abnormality is detected in at least any frame of the second data 322. In other words, the test result screen is displayed when there is no frame image matching the reference image within the range of the number of grace frames before or after the reference frame for the search target image. The screen layout of the test result screen is not particularly limited as long as it can show the user that a defect has occurred in the second data.

In the case of the example of FIG. 6, on the test result screen, the frame number of the frame determined to be abnormal in the second data 322 is shown in the column T3. In other words, it can be said that the column T3 displays the number of frames of the reference image when the frame image matching the reference image does not exist within the range of the number of grace frames for the search target image. By displaying the frame number of the frame determined to be abnormal in this way, the user can easily identify the place where the problem has occurred.

Further, on the test result screen, the frame image PA5 of the first data 321 and the frame image PB5 of the second data 322 are displayed. In the columns T4 and T5, the frame numbers of the frames currently being displayed among the first data 321 and the second data 322 are displayed. The numbers in columns T4 and T5 can be changed by input operation, and images PA5 and PB5 with frame numbers corresponding to the numbers are displayed on the test result screen. As shown in the figure, numbers that can be input to the fields T4 and T5, that is, information indicating the total number of frames of the first data 321 and the second data 322 may be displayed together.

The first data 321 and the second data 322 may be reproduced frame by frame by matching the frame numbers on the test result screen. In this case, the button B7 for instructing the reproduction of these moving images is arranged on the test result screen. When the input operation of pressing the button B7 is executed, the third display control unit 335 simultaneously reproduces the first data 321 and the second data 322 and displays them on the third display unit 351. The playback speed is not particularly limited, but it is desirable that the speed is easily visible to the user.

In addition, buttons B6 and B8 for reproducing the first data 321 and the second data 322 frame by frame may be arranged on the test result screen. Button B6 is a button for instructing to play the frame immediately before the frame currently being played. Button B8 is a button for instructing to reproduce the frame immediately after the frame currently being reproduced.

The reproduction points of the first data 321 and the second data 322 may be specified by the time. For example, as shown in the column T7 of FIG. 6, by inputting the number of seconds, it is possible to go back or advance the frame by the amount corresponding to the number of seconds from the displayed frame and restart the playback. There may be.

Further, on the test result screen, the operation data 41 corresponding to the first data 321 and the second data 322 being reproduced may be displayed. For example, as shown in column T6 of FIG. 6, the operation contents at the timing of each frame may be displayed in a list format in accordance with the reproduction of the first data 321 and the second data 322.

The third display control unit 335 displays a test result screen indicating that there is no defect even when there is no abnormality in all frames of the second data 322, that is, when there is no defect in the second data 322. It may be displayed on 351. In this case, column T3 may be blank.

[Embodiment 2]
The test system according to the present invention may receive the first data and the operation data from the reference device 1 at the same timing. Hereinafter, Embodiment 2 of the present invention will be described. For convenience of explanation, the same reference numerals will be added to the members having the same functions as the members described in the above-described embodiment, and the description will not be repeated. This also applies to subsequent embodiments.

FIG. 7 is a block diagram showing a main configuration of an apparatus included in the test system 700 according to the present embodiment. In the test system 700, the reference device 1 does not include the first operation data acquisition unit 11 and the first storage unit 12, but includes the reference device input unit 15 and the reference device data creation unit 133. It is different from the test system 600 according to the above.

The reference device input unit 15 receives a user's input operation for the reference device 1. The reference device input unit 15 transmits the content of the input operation to the first control unit 13. The specific configuration of the reference device input unit 15 is not particularly limited. For example, the reference device input unit 15 may be a touch panel display integrally configured with the first display unit 14.

The first control unit 13 specifies the instruction content for the input operation transmitted from the reference device input unit 15, and controls each unit of the reference device 1 according to the instruction content. For example, the first display control unit 131 causes the first display unit 14 to display an image according to the instruction content.

The reference device data creation unit 133 of the first control unit 13 creates operation data from the input operation of the user received via the reference device input unit 15. The timing at which the reference device data creation unit 133 creates the operation data is not particularly limited. For example, in the reference device data creation unit 133, in parallel with the first display control unit 131 displaying the image on the first display unit 14, the user's instruction content related to the image display, that is, the content of the input operation and the operation The operation data including these may be created by specifying the timing of. The reference device data creation unit 133 transmits the created operation data to the test device 3. The operation data may be transmitted to the test apparatus 3 together with the first data, or may be transmitted separately.

≪Processing flow≫
FIG. 8 is a diagram showing an example of a processing flow in the test system 700. FIG. 8 is different from the processing flow shown in the first and second embodiments in that the processing of S200 and S202 is executed. Since the processing of S204 to S210 in FIG. 8 is the same as the processing of S106 to S112 in FIG. 2, the description is not repeated here.

First, the reference device 1 receives a series of input operations related to screen display by the user via the reference device input unit 15. The image displayed on the reference device 1 and the target device 2 in response to a series of input operations is an image to be tested in the screen display test.

The first control unit 13 specifies the instruction content of the input operation received by the reference device input unit 15. The first display control unit 131 causes the first display unit 14 to display an image according to the instruction content. On the other hand, the reference device data creation unit 133 creates operation data based on the input operation of the user (S200). For example, the reference device data creation unit 133 specifies the instruction content, that is, the operation content, and the timing of receiving the instruction, that is, the operation timing, and creates operation data including these.

The reference device data creation unit 133 transmits the created operation data to the test device 3. Further, as in the first embodiment, the first capture unit 132 creates the first data and transmits it to the test apparatus 3. The data collection unit 31 of the test apparatus 3 acquires the first data and the operation data from the reference device (S202). The data collection unit 31 sends the acquired first data and operation data to the third control unit 33.

The third control unit 33 stores the first data in the third storage unit 32 as the first data 321. Further, the third control unit 33 stores the operation data in the storage device 4 as the operation data 41. The subsequent processing flow is the same as that of the test system 600 according to the first embodiment.

According to the process shown in FIG. 8, both the first data and the operation data can be acquired from the reference device 1. The operation data acquired at this time is data indicating an input operation actually performed by the user in the reference device 1 in operation. Therefore, according to the process shown in FIG. 8, the screen display test can be executed using the operation data indicating the input operation in the actual device called the reference device 1. Therefore, the screen display test can be executed with appropriate operation data, which has the effect of improving the accuracy of the test.

If the reference device 1 is a device such as a car navigation terminal that displays an image including a map image of a predetermined area generated according to the position information that is updated regularly, the operation data is obtained by the following procedure. Is preferable. That is, it is desirable that the vehicle equipped with the reference device 1 actually travels a section corresponding to the map area to be used for the screen display test, and the user executes an input operation for the reference device 1 during the traveling. As a result, the position information that is periodically acquired by the GPS receiver (not shown) or the first control unit 13 that has a function as a GPS receiver while traveling, the acquisition timing of the position information, the content of the input operation, and the input. Operation data including operation timing can be created.

≪Application example of screen display test≫
Also in the test system 700 according to the present embodiment, the test of the target device 2 which is a car navigation terminal can be executed. In the present embodiment, when the test of the target device 2 which is a car navigation terminal is executed, the reference device 1 includes a GPS receiver. By receiving the signal from the GPS satellite, the GPS receiver periodically receives information indicating the current position of the reference device 1. The first control unit 13 periodically acquires information indicating the current position of its own device from the GPS receiver. As a result, the position information of the current position of the reference device 1 is periodically updated. The first control unit 13 may also have the function of a GPS receiver.

The reference device data creation unit 133 of the reference device 1 creates operation data based on the input operation of the user. At this time, the reference device data creation unit 133 creates operation data including the position information received from the GPS receiver and the information indicating the acquisition timing of the position information. The reference device data creation unit 133 transmits the created operation data to the test device 3. The test device 3 stores the received operation data 41 in the storage device 4. As a result, the storage device 4 stores the position information that is periodically updated and the operation data 41 that includes information indicating the acquisition timing of the position information. The subsequent processing is the same as the case of executing the test of the target device 2 which is the car navigation terminal in the test system 600 according to the first embodiment.

[Embodiment 3]
In the test system according to the present invention, it may be possible to create and edit operation data in the test apparatus 3. Hereinafter, Embodiment 3 of the present invention will be described. FIG. 9 is a block diagram showing a main configuration of an apparatus included in the test system 800 according to the present embodiment. The test system 800 differs from the test systems 600 and 700 in that it includes a test device data creation unit 336.

The test device data creation unit 336 creates operation data in response to at least one of the user's input operations on the second data 322 and the input unit 34. The test device data creation unit 336 stores the created operation data in the storage device 4 as the operation data 41.

≪Processing flow≫
FIG. 10 is a diagram showing an example of a processing flow in the test apparatus 3. FIG. 8 is different from the processing flow shown in the first and second embodiments in that the processing of S314 and S316 is executed. Since the processing of S300 to S312 in FIG. 10 is the same as the processing of S100 to S112 in FIG. 2, the description is not repeated here.

After the test process (S310) is completed, the test device data creation unit 336 creates operation data from the second data that is the target of the test process (S314). The processing of S314 to S316 and the processing of S312 are in no particular order. The test device data creation unit 336 stores the created operation data in the storage device 4 as the operation data 41.

Then, the third control unit 33 reads the operation data 41 at a predetermined timing and transmits it to the operation data output unit 36. The operation data output unit 36 transmits the operation data 41 to the reference device 1 (S302).

According to the process shown in FIG. 10, the operation data is recreated based on at least one of the first data and the user's input operation based on the result of the screen display test, and the screen is recreated using the recreated operation data. A display test can be performed. Therefore, since a more precise test can be performed, the accuracy of the test result can be improved.

In the test system 800 according to the present embodiment, the test of the target device 2 which is a car navigation terminal can also be executed. As a specific processing procedure, any of the methods described in the first and second embodiments may be adopted. Similarly, for the test system according to the subsequent embodiments, the test of the target device 2 which is a car navigation terminal can be executed by adopting any of the methods described in the first and second embodiments.

[Embodiment 4]
In the test system according to the present invention, the moving image data captured by the target device 2 before updating the display program may be used as the first data, and the moving image data captured by the target device 2 after updating the display program may be used as the second data. Good. Then, the test apparatus 3 may acquire these first data and the second data and execute the comparison and search processing. Hereinafter, the fourth embodiment of the present invention will be described.

FIG. 11 is a block diagram showing a main configuration of an apparatus included in the test system 900 according to the present embodiment. The test system 900 does not include the reference device 1, the target device 2 includes the program receiving unit 25, the test device 3 includes the program transmitting unit 37, and the storage device 4 includes the update program data 43. And different from the test systems 600, 700, and 800.

The update program data 43 of the storage device 4 is program data for updating the display program of the target device 2. The update program data 43 may be data indicating the entire display program of the target device 2, or may be data indicating only the update difference of the display program of the target device 2. Further, the update program data 43 may be created in an external device other than the test system 900 and stored in the storage device 4, or may be created by the third control unit 33 of the test device 3 and stored in the storage device 4. May be good.

The third control unit 33 of the test device 3 reads the update program data 43 at a predetermined timing and transmits it to the program transmission unit 37. The predetermined timing is not particularly limited, but for example, the third control unit 33 reads the update program data 43 when it is specified that the input unit 34 has received the input operation instructing the update of the display program of the target device 2. Is transmitted to the program transmission unit 37.

The program transmission unit 37 transmits the update program data 43 received from the third control unit 33 to the target device 2. The program receiving unit 25 of the target device 2 receives the update program data 43 and stores it in the second storage unit 22. As a result, the display program is updated in the second storage unit 22.

≪Processing flow≫
FIG. 12 is a diagram showing an example of a processing flow in the third control unit 33 of the test apparatus 3. FIG. 8 is different from the processing flow shown in the first and second embodiments in that the processing of S402 to S410 is executed. Since the processing of S400 and S408 to S414 in FIG. 12 is the same as the processing of S100 and S106 to S112 in FIG. 2, the description is not repeated here.

The third control unit 33 reads the operation data 41 from the storage device 4 at a predetermined timing and transmits it to the operation data output unit 36. The operation data output unit 36 transmits the operation data 41 to the target device 2 (S402).

When the second operation data acquisition unit 21 of the target device 2 receives the operation data 41, the operation data 41 is stored in the second storage unit 22. Then, the second display control unit 231 of the second control unit 23 causes the second display unit 24 to display an image based on the operation data 41 and the display program stored in the second storage unit 22. The second capture unit 232 captures the data output by the second display control unit 231 to the second display unit 24, and transmits this as the first data to the test apparatus 3.

The data collecting unit 31 receives the first data from the reference device 1 (S404). After that, the third control unit 33 updates the display program of the target device 2 at a predetermined timing. Specifically, the third control unit 33 reads the update program data 43 from the storage device 4 and transmits it to the program transmission unit 37. The program transmission unit 37 transmits the update program data 43 to the target device 2. The program receiving unit 25 of the target device 2 receives the update program data 43 and stores it in the second storage unit 22. That is, the display program of the target device 2 is updated (S406). Subsequent processing is the same as that of S106 and later of the first embodiment.

According to the process shown in FIG. 12, it is possible to inspect whether or not a problem has occurred in the screen display by updating the display program of the target device 2.

[Embodiment 5]
In the test apparatus of the test system according to the present invention, when there is a frame in which the first data 321 and the second data 322 do not match, the frame image of the first data 321 and the frame image of the second data 322 in that frame are used. It may be provided with the difference part identification part 337 which specifies the difference of. Then, the search unit 334 determines the number of frames that allow the deviation of the difference specified by the difference location identification unit 337 according to the position on the frame image, that is, the "specified value" in FIG. 2 of the first embodiment. You may decide. Hereinafter, Embodiment 5 of the present invention will be described.

FIG. 13 is a block diagram showing a main configuration of an apparatus included in the test system 1000 according to the present embodiment. The test system 1000 differs from the test systems 600, 700, 800, and 900 in that the test apparatus 3 includes a difference identification portion 337.

The difference location identification unit 337 specifies the difference between the frame image of the first data 321 and the frame image of the second data 322 in the frame determined to be a mismatched frame based on the comparison result of the comparison unit 333. The "difference" referred to here does not only indicate one point on the image, but may also indicate an area such as a display area of a specific UI object or an area of a specific place on a map.

The difference location identification unit 337 conveys the specified difference to the search unit 334. The search unit 334 changes the number of grace frames in (2) of the search process described in the first embodiment according to the differences. For example, if the difference is in the display area of a specific UI object, the number of grace frames may be smaller than in the other areas. For example, an image of a UI object that displays a specific text is always placed at a fixed position regardless of a user's input operation or fluctuation of various parameters. In this way, by reducing the number of grace frames for locations where display deviation is unlikely to occur under various conditions and increasing the number of grace frames for other locations, the display image of the target device 2 can be described. The test process can be performed in consideration of the load for displaying each part of the image. Therefore, the accuracy of the screen display test can be improved.

[Embodiment 6]
In the test system according to the present invention, the test result data 42 may include the first data 321 and the second data 322 corresponding to the test result. Then, the third display control unit 335 of the test apparatus 3 displays a screen including the information indicating the defective portion of the second data 322 and the moving images of the first data 321 and the second data 322 on the third display unit 351. You may let me. Hereinafter, this screen will be referred to as a result reproduction screen. Hereinafter, Embodiment 6 of the present invention will be described.

FIG. 14 is a diagram showing an example of a result reproduction screen. The third control unit 33 causes the third display unit 351 to display the result reproduction screen, for example, when a predetermined input operation is performed on the input unit 34.

On the result reproduction screen, at least, information indicating a defect portion of the second data 322 based on the test result data 42, and a moving image of the first data 321 and a moving image of the second data 322 included in the test result data 42 are displayed. Is displayed.

In the example of FIG. 14, the frame image PA6 of the first data 321, the frame image PB6 of the second data 322, and the list L1 of the defective parts of the second data 322 are displayed on the result reproduction screen. The first data 321 and the second data 322 are reproduced frame by frame by matching the frame numbers on the result reproduction screen. The playback speed and whether or not to perform automatic playback are not particularly limited, but it is desirable that the speed is easily visible to the user.

The list L1 is composed of, for example, a “No.” column and a “defect detection frame” column. In the "No." column, a serial number indicating the number of the defect frame identified by the information in the "Defect detection frame" column, counting from the first frame of the moving image, is displayed. In the "Defect detection frame" column, the frame number of the place where the defect is detected is displayed. Further, the list L1 may be automatically scrolled according to the number of playback frames of the moving images of the first data 321 and the second data 322. In this case, the display location of the list L1 may be scrolled by the buttons L11 to L13 on the right side of the list L1. Specifically, when the user executes an input operation of pressing the button L11, the third display control unit 335 of the third control unit 33 may scroll the list L1 onto a predetermined line. Further, when the user executes an input operation of pressing the button L12, the third display control unit 335 may stop scrolling of the list L1. Further, when the user executes an input operation of pressing the button L13, the third display control unit 335 may scroll the list L1 down a predetermined line. Further, when the user executes an input operation for selecting a specific row in the list L1, the third display control unit 335 is selected for the moving image PA6 of the first data 321 and the moving image PB6 of the second data 322. Video playback may be resumed from the frame number indicated by the line. Further, if there is no defect in the second data 322, the list L1 may be blank.

The test result reading icon button B9, which is a UI object for reading the test result data 42, may be displayed on the result reproduction screen. When the button B9 is pressed, the third display control unit 335 causes the third display unit 351 to display a sub screen for executing selection and reading of the test result data 42. When the user selects the test result data 42 on the sub screen, the third control unit 33 reads the selected test result data 42 from the storage device 4, and the third display control unit 335 reads the selected test result data 42 from the storage device 4, and the third display control unit 335 is the first data included in the test result data 42. The 321 and the second data 322 are simultaneously reproduced. Further, the third display control unit 335 displays in the list L1 information indicating a defective portion of the second data 322 based on the test result data 42.

Further, a UI object for designating the reproduction method of the first data 321 and the second data 322 may be arranged on the result reproduction screen. For example, in the example of FIG. 14, the list L2 is arranged. When the "all frames" column of the list L2 is selected, the third display control unit 335 causes the first data 321 and the second data 322 to be simultaneously reproduced from the first frame to the last frame. The third display control unit 335 may display the total number of frames together. In the illustrated example, the total number of frames is 1 to 10000. When the "designated frame" field of the list L2 is selected, the third display control unit 335 designates the first data 321 and the second data 322 as the end frame from the frame number designated as the start frame. Simultaneously play up to the frame number. In the illustrated example, the frame number designated as the start frame is 400, and the frame number designated as the end frame is 600. One column including the column of "frame being displayed" in the list L2 indicates the frame number of the currently displayed frame among the first data 321 and the second data 322.

In addition, UI objects for instructing reproduction, skipping, pausing, and stopping of the first data 321 and the second data 322 may be arranged on the result reproduction screen. In the example of FIG. 14, the button group B10 is arranged. The button B101 of the button group B10 is a button for instructing to jump to the frame of the defective portion immediately before the second data 322 and reproduce the frame when the frame currently being reproduced is the starting point. The button B107 is a button for instructing to jump to the frame of the defective portion immediately after the second data 322 and reproduce the frame when the frame currently being reproduced is the starting point. Button B102 is a button for instructing to jump to the frame immediately before the frame currently being played and play it. Button B106 is a button for instructing to jump to the frame one frame ahead of the frame currently being played and play it. Button B103 is a button for instructing playback stop. Button B104 is a button for instructing the pause of playback. Button B105 is a button for instructing playback. When the input operation of pressing the button B105 is executed, or if the reproduction has been paused before that, the third display control unit 335 reproduces the first data 321 and the second data 322 from the paused frame. resume. On the other hand, if the pause is not made, the third display control unit 335 starts the reproduction of the first data 321 and the second data 322 from the first frame of the reproduction start specified in the list L2.

Further, the result reproduction screen may be provided with a button B11 for instructing a screen transition to the operation data confirmation screen, which is a screen for confirming the contents of the operation data. When the input operation of pressing the button B11 is executed, the third display control unit 335 causes the third display unit 351 to display the operation data confirmation screen.

FIG. 15 is a diagram showing an example of an operation data confirmation screen. The third display control unit 335 reads the operation data 41 from the storage device 4 to obtain the information necessary for creating the operation data confirmation screen and creates the screen. The operation data confirmation screen includes at least the content of the operation indicated by the operation data and the information indicating the timing of the operation.

In the illustrated example, the operation data confirmation screen includes the list L3. In the "frame No." column of the list L3, the frame number in which the input operation is performed is displayed. In the "status" column of the list L3, it is displayed whether the second data 322 was normal or abnormal, that is, it did not match the first data 321 in the frame number indicated by the "frame No." column. In the "command type" column, the types of operation commands displayed in the "operation command" column described later are displayed. In the "Output specification" column, the setting of whether to output the operation command is displayed.

In the illustrated example, the operation command of the row in which this column is set to "output" is output as a user input operation in the reference device 1 and the target device 2. For example, for an operation command or the like corresponding to an input operation for selecting a specific object such as a button, this column is set to "output". On the other hand, the operation command of the line in which the information in this column is "non-output" is not output in the reference device 1 and the target device 2. For example, the operation data may include check data that is not related to the operation of the reference device 1 and the target device 2, but is necessary for performing analysis when a problem occurs. For such check data, this column is set to "non-output".

In the "Operation command" column, operation commands indicating the contents of the input operation of each line are displayed. In the same column, information indicating the values of the parameters set by the operation command may be stored together.

The list L3 may be automatically scrolled according to the number of playback frames of the moving images of the first data 321 and the second data 322. It may be possible to scroll the list L3 by the buttons L31 to L33 on the right side of the list L3. Specifically, when the user executes an input operation of pressing the button L31, the third display control unit 335 of the third control unit 33 may scroll the list L3 onto a predetermined line. Further, when the user executes an input operation of pressing the button L32, the third display control unit 335 may stop scrolling of the list L3. Further, when the user executes an input operation of pressing the button L33, the third display control unit 335 may scroll the list L1 down a predetermined line.

Further, when the operation data 41 can be edited in the test device 3 as in the test device 3 of the test system 800 shown in the third embodiment, the operation data 41 is added to the operation data confirmation screen, that is, the list L3. Button B12 for instructing the addition of a line, button B13 for instructing the change of the operation data 41, button B14 for instructing the deletion of a part or all of the operation data 41, and editing of the operation data 41. Is included, that is, a button B15 for instructing the destruction of the edited contents performed until the button B16 described later is pressed, and a button B16 for instructing the saving of the edited contents of the operation data 41 are included. It may be. In this way, the user can easily edit the operation data 41 by operating the buttons B12 to 16 while checking the operation data 41 in the list L3 to edit the operation data 41.

[Modification example]
The test system according to the present invention may acquire operation data indicating the operation content and operation timing of the input operation executed in the target device 2 from the target device 2. Hereinafter, the operation data acquired from the target device 2 will be referred to as the target device operation data for convenience.

In this case, the target device 2 includes a target device input unit and a target device data creation unit. The target device input unit receives a user's input operation for the target device 2. The target device input unit transmits the content of the input operation to the second control unit 23. The specific configuration of the target device input unit is not particularly limited. For example, the target device input unit may be a touch panel display integrally configured with the second display unit 24.

The target device data creation unit creates operation data from user input operations received via the target device input unit. The timing at which the target device input unit creates operation data is not particularly limited. For example, in the target device input unit, in parallel with the second display control unit 231 displaying the image on the second display unit 24, the user's instruction content related to the image display, that is, the input operation content and the operation timing And may be specified and the target device operation data including these may be created. The target device input unit transmits the created target device operation data to the test device 3. The target device operation data may be transmitted to the test device 3 together with the second data, or may be transmitted separately.

The data collection unit 31 of the test device 3 receives the target device operation data and stores it in the storage device 4 as the operation data 41. When the data collection unit 31 also receives the operation data from the reference device 1, the data collection unit 31 may store the operation data and the target device operation data separately in the storage device 4. Hereinafter, the test apparatus 3 may execute the processing described in each embodiment by using the target device operation data, that is, the operation data 41 derived from the target device 2.

For example, according to the above configuration, the target device operation data, that is, the operation history of the target device 2 is obtained from the target device 2 in which the problem has occurred, and the reference device 1 uses the data based on the target device operation data. One data can be obtained. That is, it is possible to obtain the first data when the reference device 1 is operated under the same operating conditions as the target device 2 in which the problem has occurred. Then, the first data and the second data can be compared to determine whether or not there is a defect in the second data. The cause of the malfunction of the target device 2 can be identified by the determination result and the setting of the device as the reference device 1.

For example, it is conceivable that a device that has the same display program as the target device 2 but executes a different version of the display program is set as the reference device 1, and a screen display test is performed using the target device operation data. This makes it possible to confirm whether or not the cause of the malfunction of the target device 2 occurs only in a specific version of the display program.

Further, when both the reference device 1 and the target device 2 are car navigation devices, the tester mounts these devices on the same vehicle and inputs to the reference device 1 and the target device 2 while actually driving the vehicle. May be done. It is desirable that this input operation be performed between the two devices at the same operation content and the same operation timing. The data collection unit 31 of the test device 3 receives the operation data and the first data from the reference device 1 and the target device operation data and the second data from the target device 2.

In this case, the target device 2 includes a GPS receiver. The function of the GPS receiver is the same as that of the reference device 1. In addition, the target device data creation unit creates target device operation data including the position information of the current position and the information indicating the acquisition timing of the position information.

The comparison unit 333 of the test apparatus 3 reads and compares the above-mentioned first data and the second data as the first data 321 and the second data 322. Further, the third control unit 33 may compare the operation data with the target device operation data. Then, the third display control unit 335 may display the result of the comparison on the third display unit 351.

Thereby, when the reference device 1 and the target device 2 are actually operated in the same manner under the same conditions, the result of the screen display test and the operation data and the target device operation data can be compared.

[Example of realization by software]
The control blocks (particularly each part of the third control unit 33) of various devices included in the test systems 600, 700, 800, 900, 1000, 1100, and 1200 are logic circuits (especially each part of the third control unit 33) formed in an integrated circuit (IC chip) or the like. It may be realized by hardware) or by software.

In the latter case, the various devices included in the test systems 600, 700, 800, 900, 1000, 1100 and 1200 include computers that execute program instructions that are software that implements each function. The computer includes, for example, one or more processors and a computer-readable recording medium that stores the program. Then, in the computer, the processor reads the program from the recording medium and executes it, thereby achieving the object of the present invention. As the processor, for example, a CPU (Central Processing Unit) can be used. As the recording medium, in addition to a "non-temporary tangible medium" such as a ROM (Read Only Memory), a tape, a disk, a card, a semiconductor memory, a programmable logic circuit, or the like can be used. Further, a RAM (Random Access Memory) for expanding the above program may be further provided. Further, the program may be supplied to the computer via an arbitrary transmission medium (communication network, broadcast wave, etc.) capable of transmitting the program. It should be noted that one aspect of the present invention can also be realized in the form of a data signal embedded in a carrier wave, in which the above program is embodied by electronic transmission.

The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the claims, and the embodiments obtained by appropriately combining the technical means disclosed in the different embodiments. Is also included in the technical scope of the present invention.

1 Reference device 2 Target device 3 Test device 4 Storage device 5 1st camera 6 2nd camera 7 1st test device 8 2nd test device 11 1st operation data acquisition unit 12 1st storage unit 13 1st control unit 14 1st Display unit 15 Reference device input unit 21 Second operation data acquisition unit 22 Second storage unit 23 Second control unit 24 Second display unit 25 Program reception unit 31 Data collection unit 32 Third storage unit 33 Third control unit (information processing) apparatus)
34 Input unit 35 Output unit 36 Operation data output unit 37 Program transmission unit 38 1st communication control unit 39 1st input unit 41 Operation data 42 Test result data 43 Update program data 51 Operation data output unit 52 4th control unit 53 2nd Input unit 54 4th display unit 55 2nd communication control unit 131 1st display control unit 132 1st capture unit 133 Reference device data creation unit 231 2nd display control unit 232 2nd capture unit 321 1st data 322 2nd data 331 1st data acquisition unit 332 2nd data acquisition unit 333 Comparison unit 334 Search unit 335 3rd display control unit 336 Test device data creation unit 337 Difference identification unit 351 3rd display unit 352 Communication unit 521 4th display control unit 600, 700, 800, 900, 1000, 1100, 1200 test system

Claims (9)

The first data acquisition unit that acquires the first data,
The second data acquisition unit that acquires the second data,
A comparison unit that sequentially compares the first data and the second data on a frame-by-frame basis,
As a result of the comparison of the comparison unit, when there is a frame in which the first data and the second data do not match, either the frame image of the first data or the frame image of the second data in the frame is displayed. As a reference image, a search unit for searching whether or not a frame image matching the reference image exists in a predetermined number of frames before and after the other frame image, and
When there is no frame image that matches the reference image, a display control unit that outputs to the output unit that a problem has occurred in the second data is provided.
The first data is moving image data generated in the reference device based on the operation data including the information indicating the operation content and the operation timing of the user.
The information processing device, characterized in that the second data is moving image data generated in the target device based on the same operation data as the operation data. The second data acquisition unit sequentially acquires the second data generated by the target device in real time, and the comparison unit acquires the first data and the second data acquired by the second data acquisition unit. The information processing apparatus according to claim 1, wherein the data processing apparatus is sequentially compared with each other. The operation data includes position information that is periodically updated and information indicating the acquisition timing of the position information.
The information processing apparatus according to claim 1 or 2, wherein the first data and the second data include a map image of a predetermined area generated according to the position information. The predetermined number corresponds to any one of claims 1 to 3, which corresponds to a time shorter than 0.3 seconds when converted into the frame rates of the first data and the second data. The information processing device described. The information processing device according to any one of claims 1 to 4, wherein the display control unit outputs the number of frames of the reference image to the output unit when a frame image matching the reference image does not exist. The output unit
When there is no frame image that matches the reference image, a display unit that displays that a defect has occurred in the second data and a display unit.
If there is no frame image that matches the reference image, among the communication units that notify the external device that a problem has occurred in the second data.
The information processing apparatus according to any one of claims 1 to 5, wherein the information processing apparatus includes at least one of them. When there is a frame in which the first data and the second data do not match, a difference location specifying portion for specifying the difference between the frame image of the first data and the frame image of the second data in the frame is used. Prepare,
The information processing device according to any one of claims 1 to 6, wherein the search unit determines the predetermined number according to the position of the difference on the frame image. The first data acquisition step to acquire the first data and
The second data acquisition step to acquire the second data and
A comparison step of sequentially comparing the first data and the second data on a frame-by-frame basis,
As a result of comparison in the comparison step, if there is a frame in which the first data and the second data do not match, either the frame image of the first data or the frame image of the second data in the frame is displayed. As a reference image, a search step of searching for whether or not a frame image matching the reference image exists in a predetermined number of frames before and after the other frame image, and
When there is no frame image that matches the reference image, a display control step of causing the output unit to output that a defect has occurred in the second data is included.
The first data is moving image data generated in the reference device based on the operation data including the information indicating the operation content and the operation timing of the user.
A control method for an information processing device, wherein the second data is moving image data generated in a target device based on the same operation data as the operation data. A control program for operating a computer as an information processing device.
The first data acquisition step to acquire the first data and
The second data acquisition step to acquire the second data and
A comparison step of sequentially comparing the first data and the second data on a frame-by-frame basis,
As a result of comparison in the comparison step, if there is a frame in which the first data and the second data do not match, either the frame image of the first data or the frame image of the second data in the frame is displayed. As a reference image, a search step of searching for whether or not a frame image matching the reference image exists in a predetermined number of frames before and after the other frame image, and
If there is no frame image that matches the reference image, the computer is made to execute a display control step of outputting to the output unit that a defect has occurred in the second data.
The first data is moving image data generated in the reference device based on the operation data including the information indicating the operation content and the operation timing of the user.
The second data is a control program characterized in that it is moving image data generated in the target device based on the same operation data as the operation data.

Images