JP2012043062A - Software automatic test system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a software automatic test system that can enhance the reliability to determine whether an image collation test is good or not even in the case of presence of an inspection exempt area and can reduce time and labor of an examiner.SOLUTION: A software automatic test system stores collation original image data 310 which are the collation source with the transparent background in advance, acquires collation target image data 300 from a test screen 200, generates synthetic image data 320 by synthesizing the collation original image data 310 on the collation target image data 300, and compares the synthetic image data 320 with the collation target image data 300.

Description

  The present invention relates to a software automatic test system that performs a program test for software that displays a screen.

  For example, a screen generation program is stored in a control device such as a programmable logic controller (PLC) that monitors and controls a control target device such as an FA device, and a screen that schematically illustrates the status of the control target device using the screen generation program. Is generated. The user can know the status of the control device by referring to this screen.

  Generally, in the development stage of this screen generation program, etc., to test this screen generation program, a test screen that laid out character data, figures, and images reflecting the simulated field conditions using the screen generation program Is displayed to determine whether the test screen is a valid display.

  Conventionally, the quality is judged by visual inspection of the test screen. However, since more data is mixedly displayed as the number of FA devices to be controlled increases, visual testing requires a great deal of time and effort.

  Therefore, a software automatic test system for automating tests has been proposed. For example, the software automatic test system of Patent Document 1 inserts a video RAM information fetching expansion board into the main body of a control target device, and the image data of the test screen generated by the control target device on this video RAM information fetching board. The stored image data is collated with the previously captured image data. That is, the entire test screen is set as one image data, and the image data of the entire test screen captured before is collated.

  This software automatic test system determines that the verification result of the entire test screen is inconsistent due to this partial image data when there is variable image data that is automatically changed according to the date and time in the image data. Will be. Therefore, after all, it is necessary to make a pass / fail judgment by visual inspection by the tester, and it is difficult to reduce time and labor and reduce human error.

  Therefore, in the software automatic test system of Patent Document 2, the entire test screen is similarly collated with previously captured image data as one image data, but includes means for deleting a variable area such as date and time in advance. Thus, a technique for collating image data after deleting a variable area has been proposed.

Japanese Patent Laid-Open No. 08-2335022 JP 2001-273168 A

  However, depending on the screen generated by the screen generation program, the image area that needs to be deleted may have a complicated shape, and it is difficult to deal with the deletion. Even if deletion is possible, there is a risk that the number of man-hours for preparatory work for testing may increase because it is necessary to prepare a mount image other than the image area to be deleted in advance as a template for outline cutting. There is a possibility that the deletion area remains, and the matching result becomes inconsistent.

  After all, even in the screen generation program test by image matching that performs the deletion process in advance, the time and labor are not sufficiently reduced, the reliability of the pass / fail judgment by the automatic test is lowered, and the time and effort of the tester is reduced. There was a problem that it was difficult to reduce the amount of stagnation.

  The present invention has been proposed in order to solve the above-described problems of the prior art, and relates to an automatic software test system that performs a program test for software that displays a screen. It is an object of the present invention to provide a software automatic test system that can improve the reliability of pass / fail judgment and reduce the time and labor of a tester even if there is an error.

  The present invention relates to a software automatic test system for determining whether or not a test screen generated by an inspection target device that stores a user interface program for generating a screen is based on image verification, and is a verification source image data that is a verification source with a transparent background Pre-stored image storage means, image acquisition means for acquiring target image data to be collated from the test screen, and composition for generating composite image data by synthesizing the collation source image data on the target image data Means, image comparison means for comparing the composite image data and the target image data, and notification means for notifying the comparison result.

  Further, the software automatic test system according to the present invention may be provided with image generation means for generating collation source image data instead of the image storage means.

  In the software automatic test system according to the present invention, the image acquisition unit stores in advance display position information indicating a correct display position and range of the target image data, and a part of the test screen based on the display position information. The target image data may be acquired by cutting out only the area.

  In the software automatic test system according to the present invention, the combining unit may perform the combining after changing the collation source image data to the size of the target image data.

  Further, in the software automatic test system according to the present invention, a plurality of objects are arranged on the test screen, the image storage unit stores in advance collation source image data for each object, and the image acquisition unit includes: A plurality of the target image data is acquired for each display position information corresponding to each object, and the synthesizing unit and the image comparing unit synthesize the target image data and the matching source image data having a corresponding relationship. The comparison means may notify the comparison result for each object.

  Further, in the software automatic test system according to the present invention, the image acquisition means includes an input means for inputting predetermined character data on the test screen, and the input from a predetermined specific data address of the inspection target device. Data acquisition means for acquiring the character data obtained, and display control means for generating the same screen as the test screen and displaying the character data acquired by the data acquisition means on the same screen. And target image data including the character data may be acquired from the same screen generated by the display control means.

  Further, in the software automatic test system according to the present invention, the inspection object device generates a test screen on which a write button is arranged, and the image acquisition means stores the inspection object in which result data of the write button is stored. A data acquisition unit that acquires the result data from a predetermined specific data address of the apparatus and a screen that is the same as the test screen are generated, and the result data acquired by the data acquisition unit is displayed on the same screen. Display control means for displaying, and target image data including the result data may be acquired from the same screen generated by the display control means.

  In the software automatic test system according to the present invention, an optical reading unit that optically reads characters from the target image data to acquire target character data, and a character storage unit that stores in advance collation source character data to be a collation source And character comparison means for comparing the original character data with the target character data.

  Further, in the software automatic test system according to the present invention, the software automatic test system further comprises color data acquisition means for scanning the target image data and acquiring the target color data of the character, wherein the character storage means is a verification source color that is a verification source Data may be further stored in advance, and the character comparison unit may further compare the target color data with the collation source color data.

  In the software automatic test system according to the present invention, a line color acquisition unit that acquires target color data of a line image included in the target image data, and a line color storage unit that stores in advance verification source color data to be a verification source And line color comparison means for comparing the target color data with the comparison source color data.

  In the software automatic test system according to the present invention, the line color acquisition unit acquires target color data of a pixel including the center of the line image and surrounding pixels, and the line color comparison unit includes the target color data. The color data and the collation source color data are respectively compared, and the notifying unit reports a comparison result indicating a match when any one of the target color data is the same as the collation source color data. Good.

  According to the present invention, collation source image data serving as a collation source with a transparent background is stored in advance, target image data to be collated is acquired from a test screen, and the collation source image data is stored on the target image data. Since the composite image data is generated by combining and the composite image data and the target image data are compared, it is not necessary to delete the non-matching target area that complicates the image processing. Even if there is a non-target region, it is possible to improve the reliability of the quality determination and reduce the time and labor of the tester.

It is a block diagram which shows the state which connected the software automatic test system which concerns on 1st Embodiment to the test object apparatus. It is a schematic diagram which shows an example of the test screen which the software automatic test system which concerns on 1st Embodiment produces | generates to a test object apparatus. It is a block diagram which shows the detailed structure of the software automatic test system which concerns on 1st Embodiment. It is a flowchart which shows the 1st operation | movement of the software automatic test system which concerns on 1st Embodiment. It is a flowchart which shows the 2nd operation | movement of the software automatic test system which concerns on 1st Embodiment. It is a schematic diagram which shows the 1st collation operation | movement of the software automatic test system which concerns on 1st Embodiment. It is a schematic diagram which shows the 2nd collation operation | movement of the software automatic test system which concerns on 1st Embodiment. It is a schematic diagram which shows the 3rd collation operation | movement of the software automatic test system which concerns on 1st Embodiment. It is a schematic diagram which shows the 4th collation operation | movement of the software automatic test system which concerns on 1st Embodiment. It is a schematic diagram which shows the test screen which concerns on 2nd Embodiment. It is a block diagram which shows the detailed structure of the software automatic test system which concerns on 2nd Embodiment. It is a flowchart which shows the operation | movement of the test data input process in the input test of the automatic software test system which concerns on 2nd Embodiment, and writing button press, and an image acquisition process. It is a block diagram which shows the detailed structure of the collation part of the software automatic test system which concerns on 3rd Embodiment. It is a flowchart which shows operation | movement of the collation part which concerns on 3rd Embodiment. It is a schematic diagram which shows the collation process of the software automatic test system which concerns on 3rd Embodiment. It is a block diagram which shows the detailed structure of the collation part 16 of the software automatic test system 1 which concerns on 4th Embodiment. It is a flowchart which shows operation | movement of the collation part which concerns on 4th Embodiment. It is a schematic diagram which shows the collation process of the software automatic test system which concerns on 4th Embodiment.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments of a software automatic test system according to the present invention will be described in detail with reference to the drawings.

(First embodiment)
FIG. 1 is a block diagram illustrating a state in which the software automatic test system 1 is connected to the inspection target device 100. The inspection target device 100 can transmit / receive data to / from the display device 110 via a signal cable or a network.

  The inspection target device 100 is a control device such as a PLC (programmable logic controller), for example. The inspection target device 100 is connected to a monitoring control target device (not shown) such as an FA device to be monitored or controlled, and collects on-site information data indicating the driving status from the monitoring control target device. The inspection target device 100 outputs signals for performing various controls on the monitoring control target device based on the field information data and the timing chart.

  The inspection target device 100 includes a processor such as a CPU and an MPU, and a memory such as a ROM and a hard disk. A control program is stored in the memory. The processor reads and processes the control program as appropriate, and outputs a signal corresponding to the processing result to the monitoring control target device.

  In addition, a screen generation program is stored in the memory of the inspection target device 100. The inspection target device 100 generates screen data that visually indicates the operation status of the FA device by appropriately processing the screen generation program, and outputs the screen data to the display device 110.

  The display device 110 includes a monitor including a liquid crystal display and a CRT display. Screen data input from the inspection target apparatus 100 is displayed. A user such as a site manager can monitor the operating state of the monitoring control target device on the display screen of the display device 110.

  The software automatic test system 1 causes the inspection target device 100 to generate a test screen 200 (see FIG. 2) and checks whether the test screen 200 is correctly displayed.

  The software automatic test system 1 includes an automatic test device 2 and a loader device 3. The automatic test apparatus 2 and the loader apparatus 3 are connected by a signal cable so that signals can be transmitted and received. The automatic test apparatus 2 and the loader apparatus 3 include, for example, a CPU, a RAM, a hard disk, and a man-machine interface such as a keyboard, a mouse, and a monitor, and operate when the CPU processes a program stored in the hard disk. .

  The automatic test apparatus 2 controls the generation of the test screen 200, checks the test screen 200, and outputs the results. The loader device 3 accesses the memory of the inspection target device 100 to read and write data.

  FIG. 2 is a schematic diagram illustrating an example of a test screen 200 that the software automatic test system 1 according to the first embodiment generates on the inspection target device 100. On the test screen 200, characters and image objects representing various types of information are displayed. The objects displayed on the test screen 200 are, for example, a fixed image 210, a variable image 220, and a display field 230.

  The fixed image 210 is not changed by a signal input from the monitoring control target device or the display device 110. For example, the fixed image 210 is a ruled line, a frame, a figure, and a background.

  The variable image 220 is an image that changes according to the field information data output from the monitoring control target device. The variable image 220 includes not only a raster image constituted by dots but also a vector image, ie, a figure constituted by lines and curves. This variable image 220 imitates FA equipment, such as a motor, a compressor, and a pump, a valve, a roller, a conducting tube, and a signal cable, for example. On the screen, the operating state can be recognized by the display color, shape, and size of the variable image 220. For example, the current path is represented by a line image, and the energized state is displayed in a display color such as a red display color when the power is on and a green display color when the power is stopped. Further, for example, the pump is represented by an image, and the operation state is displayed in a display color such as a red display color when the pump is in operation and a green display color when the pump is stopped.

  The display field 230 is an area where character data is displayed. The field information data output from the FA device is displayed. The character data includes roman characters, hiragana, katakana, kanji, and numerical values.

  The software automatic test system 1 generates test data indicating an object to be arranged on the test screen 200 in the inspection target device 100 and outputs the test data to the inspection target device 100. The test data includes the types of objects to be displayed on the test screen 200, display positions, and display contents. Test data is generated for each object to be displayed on the test screen 200.

  The software automatic test system 1 according to the first embodiment performs a display test of each object arranged on the test screen 200. The display position of each object arranged according to the test data and the quality of the display contents are individually checked.

  In the check, the software automatic test system 1 individually cuts out each screen area in which each object is displayed from the test screen 200 of the display device 110. Then, the software automatic test system 1 collates each target image data 300 to be collated obtained as a result of the cut-out with collation source image data 310 (for example, see FIG. 6) to be a collation source. The collation source image data 310 is image data obtained when the screen generation program correctly processes the test data. The collation source image data 310 is stored in advance in the software automatic test system 1.

  The detailed configuration of the software automatic test system 1 will be described in more detail with reference to FIG. FIG. 3 is a block diagram showing a detailed configuration of the software automatic test system 1. Each block shows each function realized by the software automatic test system 1 processing a program by hardware, but each of these functions may be realized by a circuit configuration.

  As shown in FIG. 3, the software automatic test system 1 includes a design condition input unit 11, a test data generation unit 12, a test data storage unit 13, a test data input unit 14, an image acquisition unit 15, a collation unit 16, and a notification unit. 17. The design condition input unit 11, the test data generation unit 12, the test data storage unit 13, the image acquisition unit 15, the collation unit 16, and the notification unit 17 are provided in the automatic test apparatus 2, and the test data input unit 14 This is realized by the cooperation of the device 2 and the loader device 3.

  The design condition input unit 11 includes a man-machine interface such as a keyboard, a mouse, and a monitor. The design condition input unit 11 generates design condition information in accordance with a user operation. The design condition information is data defining the configuration of the test screen 200 displayed on the display device 110, and is the basis of the test data. In the design condition information, an object type, a display position, and display contents are described.

  For example, the design condition input unit 11 generates and associates image identification information for identifying the variable image 220 to be displayed and variable image information in which the display position information of the variable image 220 is set. The display position information indicates the display position and range, and is described by a rectangular coordinate range, center coordinates, width, height, angle, and orientation. The image identification information is indicated by establishment condition information indicating a display color selection condition and image specifying information of image data displayed when the selection condition is satisfied. When the variable image 220 is a graphic such as a line or a circle, information for identifying the type of the graphic and display color information are described as the image specifying information.

  For the display field 230, display field information indicating designation of the type of character to be displayed, its display position, the number of display character digits, the type of font, the character color, size, and character decoration is generated in accordance with a user operation.

  The test data generation unit 12 searches for information on each object included in the design condition information, and generates test data with reference to the information. In the retrieval of object information, variable image information and display field information are retrieved from design condition information. If there are a plurality of variable image information and display field information, they are searched.

  The test data is data that reproduces a predetermined simulated on-site situation. For the display test of the variable image 220, the test data generation unit 12 generates test data in which variable image information and prestored pseudo field information data are set. For the inspection item in the display field 230, test data is generated in which display field information and character data stored in advance are set.

  The test data storage unit 13 stores the generated test data. The test data input unit 14 outputs the test data to the inspection target device 100 via the loader device 3.

  The image acquisition unit 15 acquires the target image data 300 by cutting out an image of each screen area where each object is displayed from the test screen 200 displayed on the display device 110. The screen area to be cut out refers to display position information included in the test data stored in the test data storage unit 13. In other words, the cutout is a hard copy of only a partial area on the test screen 200.

  When the test data is generated based on variable image information, the image acquisition unit 15 corresponds to display position information indicating the rectangular coordinate range, center coordinates, width, height, angle, and orientation of the variable image 220. The target image data 300 in the range to be acquired is acquired. When the test data is generated based on the display field information, the image acquisition unit 15 selects the range corresponding to the display position information indicating the display position and size, that is, the character portion displayed in the display field 230. The target image data 300 including is acquired.

  The matching unit 16 executes a display test for each object. The collation unit 16 includes a collation source storage unit 16a, a synthesis unit 16b, and an image comparison unit 16c.

  The verification source storage unit 16a stores verification source image data 310 in advance. The collation source image data 310 is image data that is reproduced when the object is correctly displayed. The collation source image data 310 has a transparent background. The verification source storage unit 16a stores verification source image data 310 for each test data pattern. That is, the collation source storage unit 16a stores various variable images 220 for each display color pattern. Also, a character image predetermined for a character display test in the display field 230 is stored for each display character digit number, font type, size, and character decoration designation. This character image is an image in which the same character as the character previously stored in the test data generation unit 12 is captured.

  The synthesizing unit 16b reads the collation source image data 310 and synthesizes the target image data 300 and the collation source image data 310. The collation source image data 310 is read with reference to the test data referred to when the target image data 300 is cut out. The composition unit 16c enlarges, reduces, rotates, and inverts the collation source image data 310 at the time of composition, and matches the size and orientation with the target image data 300. In the composition, the collation source image data 310 is overlaid as an upper layer.

  The image comparison unit 16c compares the synthesized image data 320 generated by the synthesis unit 16b with the target image data 300. That is, the image comparison unit 16c detects a coincidence portion and a disagreement portion of both image data.

  Here, since the target image data 300 is data obtained by cutting out one area of the test screen 200 displayed on the display device 110, for example, a non-matching area such as a background is mixed. However, this composition processing always matches the images in the non-verification region of the composite image data 320 and the target image data 300. Therefore, the comparison result between the two image data is substantially influenced only by the area of the variable image 220 or the area of the character image in the display field 230, and is not affected by the non-collation target area.

  The alerting | reporting part 17 displays a result on a monitor for every object which performed the display test.

  The operation of the software automatic test system 1 will be described with reference to FIGS. 4 and 5 are flowcharts showing the operation of the software automatic test system 1. FIG.

  First, when the user performs a generation operation of the test screen 200 using a keyboard or a mouse (S01), the design condition input unit 11 generates design condition information corresponding to the generation operation (S02).

  When the design condition information is generated, the test data generation unit 12 searches for information on each object from the design condition information (S03), and generates test data for a display test of each object (S04).

  When the test data is generated, the test data input unit 14 outputs the test data to the inspection target device 100 (S05).

  After the test data output process, the image acquisition unit 15 sets N = 1 (S06), and if the Nth test data is the variable image 220 or the display field 230 (S07, Yes), it is included in the Nth test data. A partial area corresponding to the displayed display position information is cut out from the test screen 200 to acquire the target image data 300 (S08). Then, the image acquisition unit 15 sets N = N + 1 (S09), and if N does not exceed the total number of test data (S10, No), repeats S07 to S09. If N exceeds the total number of test data (S10, Yes), the image acquisition process is terminated. The case where the Nth test data is not the variable image 220 or the display field 230 (S07, No) will be described in the second embodiment.

  When the image acquisition process ends, the collation unit 16 sets M = 1 (S11), reads the test data referred to when generating the M-th acquired target image data 300 (S12), and uses this test data as the test data. The collation source image data 310 corresponding to the included image specifying information is read (S13).

  The collation unit 16 changes the size of the collation source image data 310 according to the M-th acquired target image data 300 (S14), and synthesizes the collation source image data 310 and the target image data 300 after the change. (S15). When the composite image data 320 is generated, the collation unit 16 compares the composite image data 320 with the target image data 300 (S16).

  As a result of the comparison, if the number of mismatched portions is less than or equal to the predetermined number (S17, Yes), information indicating matching is output for the display test related to the Mth acquired target image data 300 (S18). If it exceeds the predetermined number (S17, No), information indicating inconsistency with respect to the display test is output (S19).

  Then, the collation unit 16 sets M = M + 1 (S20), and if M does not exceed the number of all target image data 300 (S21, No), repeats S12 to S20, and M is the number of all target image data 300. If it exceeds (S21, Yes), the collation process is terminated. And the alerting | reporting part 17 displays the screen which laid out the result on the monitor (S22).

  6 to 9 are schematic diagrams showing the collation operation of the software automatic test system 1. FIG. 6 shows a case where the size and display color of the variable image 220 of the motor are correctly displayed. When the matching source image data 310 is enlarged to match the size of the target image data 300 and then the matching source image data 310 is combined with a cut-out image as an upper layer, the variable image 220 in the target image data 300 and the matching source image data 310 are combined. Since the variable image 220 completely overlaps, the target image data 300 and the composite image data 320 match. Therefore, as a result of the comparison, this variable image 220 can be regarded as being correctly displayed.

  FIG. 7 shows a case where the variable image 220 of the motor is to be displayed in the display color indicating the operation state, but is displayed on the display device 110 in the display color indicating the stop state. In this case, since the display color of the variable image 220 of the verification source image data 310 is reflected in the composite image data 320, in the comparison between the composite image data 320 and the target image data 300, a background that is a non-verification region. Since the areas match, no unmatched places are detected in this area, but many unmatched places are detected in the variable image 220 area. Therefore, as a result of the comparison, the display test of the variable image 220 is rejected.

  FIG. 8 shows a case where the variable image 220 of the motor is to be displayed in the display color indicating the operation state, but the variable image 220 other than the motor is displayed in the display color indicating the stop state on the display device 110. . That is, the variable image 220 shown in the target image data 300 is different from the intended image, and the display color is different. In this case, since the composite image data 320 includes the data of the variable image 220 of the verification source image data 310 that is not included in the target image data 300, a large number of inconsistent portions are detected in this region. The display test fails.

  FIG. 9 shows a case where the variable image 220 of the motor is to be enlarged and displayed at a predetermined ratio, but the size is different. When the comparison source image data 310 is enlarged after being enlarged to the size of the control image data 300, the sizes of the variable images 220 appearing in both image data are different, and the number of inconsistent portions exceeds a predetermined number and is rejected.

  As described above, according to the software automatic test system 1 according to the first embodiment, the collation source image data 310 that is a collation source with a transparent background is stored in advance, and the target image data 300 to be collated is displayed from the test screen 200. The composite image data 320 is generated by acquiring and synthesizing the matching source image data 310 on the target image data 300, and the composite image data 320 and the target image data 300 are compared. This eliminates the need to delete areas that are not subject to verification, which complicates image processing, and improves the reliability of pass / fail judgments even if there are areas that are not subject to inspection in the image verification test. Can be reduced.

  In addition, since the display position information indicating the correct display position and range of the target image data 300 is stored in advance, and the target image data 300 is acquired by cutting out only a part of the test screen 200 based on the display position information. It is possible to eliminate the non-verification region as much as possible, and the test accuracy is further improved.

  Further, the collation source image data 310 is stored in advance for each object, a plurality of target image data 300 is obtained for each object, the corresponding target image data 300 and the collation source image data 310 are synthesized, Since the comparison is made, the result of image matching can be judged for each object, and the tester can immediately understand which object was good or not, thus reducing the time and labor of the tester. Can be further achieved.

  In the software automatic test system 1 of the present embodiment, the collation source image data 310 is stored in the collation source storage unit 16a for each test data pattern, in other words, for each object. However, if the collation source image data 310 of an image including characters is stored for each combination of font and character decoration, the number becomes enormous. Further, if the figure matching source image data 310 is stored for each combination of the intermediate coating color and the frame color, the number thereof becomes enormous. For this reason, the image data 310 including characters may be generated separately for the matching source image data 310. In this case, the synthesis includes a case where the collation source image data 310 is separately generated and superimposed on the reference image data 300, and a case where a figure or a character is directly drawn on the collation source image data 310 is included. In the latter case, the generation and synthesis of the collation source image data 310 are the same process.

  The collation unit 16 refers to the test data, and if the test data includes specific information indicating that it is a character image or graphic, the type, size, intermediate color, A graphic is generated based on the frame color information and used as collation source image data 310, and a character image is generated based on the character font and character decoration information and the specified character data included in the test data, and collation is performed. The original image data 310 is assumed. On the other hand, when the test data includes raster image specifying information, the verification source image data 310 stored in advance as described above may be acquired from the verification source storage unit 16a.

  In the software automatic test system 1 according to the present embodiment, the comparison between the comparison source image data 310 and the reference image data 300 has been described as an example in which a mismatch is determined if, for example, a predetermined number or more of image data remains by subtraction processing. In addition, in comparison processing, various methods such as comparison of feature points extracted by binarization and edge extraction, calculation of coincidence by statistical processing, comparison after two-dimensional Fourier transform, comparison by histogram, etc. That combination can be used.

(Second Embodiment)
The inspection target device 100 stores the character data transmitted from the display device 110 at a specific data address in a predetermined memory by appropriately processing the screen generation program. In addition, the inspection target device 100 stores predetermined character data in a specific data address on the memory using the writing instruction signal transmitted from the display device 110 as a trigger.

  In the software automatic system 1 according to the first embodiment, the mode in which the display test of the characters in the variable image 220 and the display field 230 is performed by image matching has been described. However, the input field 240 and the write button 250 are provided in the test screen 200. When arranged, it is possible to perform an input test and a write button press test of the screen generation program using the image collation of the software automatic system 1 according to the first embodiment.

  FIG. 10 is a schematic diagram illustrating a test screen 200 that is generated and controlled by the software automation system 1 according to the second embodiment. As shown in FIG. 10, in addition to the fixed image 210, the variable image 220, and the display field 230, the input field 240 and the write button 250 objects are arranged on the test screen 200.

  The input field 240 is also an area where character data is displayed. If the screen generation program is correctly described, the character data input by the keyboard of the display device 110 or the correct calculation result using this as a parameter is stored in a predetermined specific data address of the inspection target device 100.

  The write button 250 gives a trigger for a predetermined operation when pressed. The predetermined operation is, for example, calculation processing and calculation result output. If the screen generation program is correctly described, character data is output from the display device 110 to the inspection target device 100 when the write button 250 is pressed, and the calculation result of the inspection target device 100 using this character data as a parameter is determined in advance. Stored in the specified data address.

  FIG. 11 is a block diagram showing a detailed configuration of the software automatic test system 1 according to the second embodiment. The same components as those in the software automatic analysis system 1 according to the first embodiment are denoted by the same reference numerals, and detailed description thereof is omitted as appropriate.

  In the software automatic test system 1 according to the second embodiment, the design condition input unit 11 uses the variable image 220 and the display field 230 as well as the type, display position, and display content of the input field 240 and the write button 250 as the design condition. Describe information.

  In the input field 240, input field information indicating the display position, the number of display character digits, the font type, size, and character decoration is generated and associated in accordance with a user operation.

  In the write button 250, the specification of the image data indicating the button, the display position, the size, the characters in the button, and the write button information indicating the data content output to the inspection target device 100 when the write button 250 is pressed. Generate and associate according to user operation.

  In addition, when the design condition input unit 11 generates variable image information, display field information, input field information, and write button information indicating the definition of the screen configuration, the information and the data address of the inspection target device 100 are linked. Generate data link information.

  In addition to the display test, the test data generation unit 12 also retrieves input field information and write button information from design condition information for an input test and a write button press test. For the input test, test data including a set of input field information, prescribed character data, and data link information is generated. For the write button press test, test data including a set of write button information and data link information is generated. That is, from the test data, it is possible to estimate at which specific data address the result of pressing the input or write button is stored and at which position on the test screen 200 is displayed.

  In the case of an input test, the test data input unit 14 outputs specified character data to the display device 110 together with an input instruction to the input field 240. The test data input unit 14 outputs information instructing to press the write button 250 to the display device 110 when the write button 250 is pressed.

  The image acquisition unit 15 includes a data acquisition unit 15a and a display control unit 15b for an input test and a writing test. If the screen generation program is operating correctly, the character data is output from the display device 110 to the inspection target device 100 in accordance with the input instruction of the specified character data, and stored at the specified specific address. If the screen generation program is operating correctly, prescribed character data including a calculation result is stored at a specific address according to an instruction to press the write button 250.

  Therefore, the data acquisition unit 15 a includes the loader device 3 and acquires character data from a specified specific data address of the inspection target device 100. The display control unit 15b generates the test screen 200. Specifically, the automatic test apparatus 2 causes the loader apparatus 3 to generate a test screen 200. At this time, the display control unit 15 displays the character data acquired by the data acquisition unit 15a on the test screen 200 generated by itself. The display location is a screen area indicated by display position information included in the test data of the input test and the writing test.

  The image acquisition unit 15 cuts out a screen area including the character data on the test screen 200 of the loader device 3 with reference to the display position information of the test data, so that the target image data 300 for the input test and the write button press test is obtained. To get.

  The collation source storage unit 16a stores the collation source image data 310 for the input test and the write button press test in addition to the collation source image data 310 for the display test. The collation source image data 310 is a character image obtained if the display generation program is correctly described as a result of the acquisition of the target image data 300 by the image acquisition unit 15. The collation source image data 310 may be generated with reference to prescribed character data and test data.

  The collation unit 16 synthesizes the collation source image data 310 and the target image data 300 in the input test and the write button press test, and compares the obtained composite image data 320 with the target image data 300.

  Of the operations of the software automatic test system 1, the operations of test data input processing and image acquisition processing when the input test and write button are pressed will be described in detail with reference to FIG. Since the design condition generation process, the test data generation process, and the collation and the result display process are the same as those in the first embodiment, detailed description of the operation is omitted.

  First, when the test data corresponding to the input field information is included in the generated test data (S31, Yes), the test data input unit 14 outputs the prescribed character data and its input instruction to the display device 110. (S32). If the screen generation program is correct by this output, the character data is written to the specific data address of the inspection target device 100.

  Further, when the test data includes write button information in the test data (S33, Yes), the test data input unit 14 outputs an instruction to press the write button 250 to the display device 110 (S34). . With this output, if the screen generation program is correct, specified character data such as a correct calculation result is written to a specific address of the inspection target device 100.

  After the output processing of the test data, the image acquisition unit 15 acquires data of a specific data address corresponding to the data link information included in the Nth test data from the inspection target device 100 (S35), and includes the acquired character data. The test screen 200 is generated (S36). And the image acquisition part 15 cuts out the partial area | region where the character data was displayed, and acquires the target image data 300 (S37).

  As described above, in the software automatic test system 1 according to the second embodiment, the result data is acquired from the predetermined specific data address of the inspection target apparatus 100 in which the result data of the write button press is stored, and the acquired result data is stored. The target image data 300 including the result data displayed on the test screen 200 of the loader device 3 and the result data displayed on the test screen 200 of the loader device 3 is acquired, and image collation is performed.

  Further, in the software automatic test system 1 according to the second embodiment, in an input test in which predetermined character data is further input to the test screen 200, character data is obtained from a predetermined specific data address of the inspection target device 100. The acquired character data is displayed on the test screen 200 of the loader device 3, the target image data 300 including the character data displayed on the test screen 200 of the loader device 3 is acquired, and image collation is performed. I did it.

As a result, in addition to the display test, the input test and the write button press test can be performed by image collation similar to that of the first embodiment, and the number of test steps can be reduced.

(Third embodiment)
FIG. 13 is a block diagram illustrating a detailed configuration of the matching unit 16 of the software automatic test system 1 according to the third embodiment. The same components as those in the first and second embodiments are denoted by the same reference numerals, and detailed description thereof is omitted.

  In the software automatic test system 1 according to the third embodiment, when the target image data 300 is a character image, the target image data 300 is optically read and converted into character data. Compare with character data.

  The software automatic test system 1 further includes an optical reading unit 16d, a character color acquisition unit 16e, and a character comparison unit 16f in the collation unit 16. The optical reading unit 16d acquires target character data to be collated by optically reading characters in the target image data 300. The character color acquisition unit 16e acquires the character color (target character color) in the target image data 300. The character comparison unit 16f compares the target character data with the verification source character data stored in advance in the verification source storage unit 16a and serving as the verification source. In addition, the character comparison unit 16f compares the target character color with the collation source character color that is the collation source. The collation source character color is acquired from the character color designation information in the test data of the input field information and display field information.

  FIG. 14 is a flowchart showing the operation of the matching unit 16 according to the third embodiment. As illustrated in FIG. 14, the collation unit 16 refers to the test data corresponding to the M-th cut image and determines whether the test data refers to display field information, input field information, or write button information. Judgment is made (S41). As a result of the determination, if it corresponds to the variable image 220 (S41, No), the processing after S14 in the first embodiment is performed.

  On the other hand, as a result of the determination, if the test data refers to display field information, input field information, or write button information (S41, Yes), the optical reading unit 16d optically reads characters in the target image data 300. The target character data is obtained by converting it into the read character data (S42).

  Next, the character color obtaining unit 16e scans the target image data 300 in units of one pixel in the horizontal direction and obtains the first changed color data as the target character color (S43).

  Then, the character comparison unit 16f compares the target character data with the collation source character data, and the target character color with the collation source character color obtained by referring to the test data (S44). If either character data or character color is different as a result of the comparison (S45, Yes), the character comparison unit 16f outputs a mismatch (S46). On the other hand, if both match (S45, No), a match is output (S47).

  FIG. 15 is a schematic diagram illustrating the matching process of the matching unit 16. As shown in FIG. 15, it is assumed that a red character “123” appears in the acquired target image data 300 with a gray background. At this time, the optical reading unit 16d optically reads the character “123” to obtain target character data indicating “123”, and the character color obtaining unit 16e performs scanning in the horizontal direction. Since the pixel has changed from gray to red, the red target character color is acquired. If the collation source character data and the target character color are “123” and red, the comparison result of the character comparison unit 16f is coincident, and if either is different, the comparison result is disagreement.

  As described above, in the software automatic test system 1 according to the third embodiment, collation source character data is stored in advance, the character is optically read from the target image data 300, and the target character data is acquired. It is also possible to compare the data with the collation source character data. Further, collation source color data to be a collation source is further stored in advance, the target image data 300 is scanned to obtain target color data of characters, and the target color data and the collation source color data are further compared. You can also. As a result, even when a large amount of background noise components are present in the collation of the target image data 300 including characters because the characters and numerical values are line information, the collation accuracy can be improved.

(Fourth embodiment)
FIG. 16 is a block diagram illustrating a detailed configuration of the matching unit 16 of the software automatic test system 1 according to the fourth embodiment. The same components as those in the first to third embodiments are denoted by the same reference numerals, and detailed description thereof is omitted.

  In the software automatic test system 1 according to the fourth embodiment, in the case of a display test of the variable image 220 composed of lines, the color data on the line is acquired from the target image data 300, and this color data is stored in advance. Compare the correct color data.

  The software automatic test system 1 further includes a line color acquisition unit 16g and a line color comparison unit 16h in the collation unit 16. The line color acquisition unit 16g acquires color data (target line color data) for (2P + 1) ^ 2 pixels including one center point of the line and a predetermined range thereof (P is an integer of 0 or more). The line color comparison unit 16h compares the verification source line color data with the target line color data. The verification source line color data is display color information included in the test data of the variable image 220.

  FIG. 17 is a flowchart showing the operation of the matching unit 16 according to the fourth embodiment. As shown in FIG. 17, the collation unit 16 refers to the test data corresponding to the M-th cut image and determines whether or not the test data is variable image information indicating a graphic (S51). As a result of the determination, if it is not variable image information indicating a graphic (S51, No), the processing after S14 of the first embodiment is performed.

  On the other hand, if it is determined that the variable image information indicates a graphic (S51, Yes), the line color acquisition unit 16g calculates the sum of the pixels including the center coordinates of the line in the target image data 300 and the pixels in the vertical and horizontal directions. The target line color data of (2P + 1) ^ 2 minutes of pixels is acquired (S52).

  Then, the line color comparison unit 16h compares the target line color data of each pixel with the matching source line color data (S53). If any of the target line color data matches the verification source line color data (S54, Yes), the line color comparison unit 15f outputs a match (S55). On the other hand, if they are different (S54, No), a mismatch is output (S56).

  FIG. 18 is a schematic diagram showing the matching process of the matching unit 16. As shown in FIG. 17, in the acquired target image data 300, a red line appears on a diagonal line with a gray background. At this time, if P = 1, the line color acquisition unit 16g acquires the target line color data of a total of 9 pixels, which are pixels existing around one pixel around the pixel including the center coordinates. In this case, the breakdown of the color data is 6 color data representing the background gray and 3 color data representing the line color. If the matching source line color data is red, the obtained three target line color data matches the matching source line color data, and therefore the comparison result of the line color comparison unit 15f matches. On the other hand, for example, when all the target line color data of 9 pixels are gray or the like and are not red, the comparison results are inconsistent.

  As described above, in the software automatic test system 1 according to the fourth embodiment, the collation source color data to be the collation source is stored in advance, the target color data of the line image included in the target image data 300 is acquired, and the target color is acquired. It is also possible to compare the original color data with the data.

  In the software automatic test system 1 according to the fourth embodiment, the target color data of the pixel including the center of the line image and the surrounding pixels are respectively acquired, and each target color data is compared with the comparison source color data. It is also possible to report a comparison result indicating a match when any one of the target color data is the same as the collation source color data.

  According to this embodiment, since the variable image 220 included in the target image data 300 is line information, the collation accuracy can be improved even when a large amount of background noise components exist.

  In each of the above-described embodiments, the software automatic test system 1 has been described as a separate body of the automatic test apparatus 2 and the loader apparatus 3, but may be configured integrally with one computer, and the software is included in the display device 110. An automatic test system 1 may be provided.

  In the first and second embodiments, the example in which the target image data 300 and the verification source image data 310 are combined and verified is described. However, the variable image 220 is cut out from the target image data 300 according to the shape. It may be. In this case, the collation unit 16 further cuts out the variable image 220 from the target image data 300 by changing the size of the collation source image data 310 according to the target image data 300 and then superimposing them. Then, the further cut out image data and the comparison source image data 310 may be compared.

DESCRIPTION OF SYMBOLS 1 Software automatic test system 11 Setting condition input part 12 Test data generation part 13 Test data memory | storage part 14 Test data input part 15 Image acquisition part 15a Data acquisition part 15b Display control part 16 Collation part 16a Collation origin memory | storage part 16b Composition part 16c Image Comparison unit 16d Optical reading unit 16e Character color acquisition unit 16f Character data comparison unit 16g Line color acquisition unit 16h Line color comparison unit 17 Result display control unit 2 Automatic test device 3 Loader device 100 Inspection target device 110 Display device 200 Test screen 210 Fixed Image 220 Variable image 230 Display field 240 Input field 250 Write button 300 Target image data 310 Source image data 320 Composite image data

Claims (11)

A software automatic test system for determining whether or not a test screen generated by an inspection target device that stores a screen generation program is good or bad by image verification,
Image storage means for preliminarily storing collation source image data with a transparent background as a collation source of the image collation;
Image acquisition means for acquiring target image data to be subjected to image comparison from the test screen;
Combining means for generating combined image data by combining the collation source image data on the target image data;
Image comparison means for comparing the composite image data and the target image data;
An informing means for informing the comparison result;
Providing
Software automatic test system featuring. In place of the image storage means, comprising image generation means for generating the collation source image data,
The software automatic test system according to claim 1. The image acquisition means stores in advance display position information indicating the display position and range of the target image data, and acquires the target image data by cutting out only a partial area of the test screen based on the display position information. To do,
The software automatic test system according to claim 1 or 2. The synthesizing unit performs the synthesis after changing the comparison source image data to the size of the target image data;
The software automatic test system according to claim 3. A plurality of objects are arranged on the test screen,
The image storage means stores in advance pre-verification image data for each object,
The image acquisition means acquires the target image data for each object,
The synthesizing unit synthesizes the target image data and the collation source image data in a correspondence relationship,
The image comparison means compares each composite image data and each control image data,
The notifying means notifying a comparison result for each object;
The software automatic test system according to claim 3 or 4. The image acquisition means includes
Input means for inputting predetermined character data on the test screen;
Data acquisition means for acquiring the input character data from a predetermined specific data address of the inspection target device;
Display control means for generating the same screen as the test screen and displaying the character data acquired by the data acquisition means on the same screen;
Further comprising
Obtaining target image data including the character data from the same screen generated by the display control means;
The software automatic test system according to any one of claims 1 to 5. The inspection target device generates a test screen on which a write button is arranged,
The image acquisition means includes
Data acquisition means for acquiring the result data from a predetermined specific data address of the inspection target device in which the result data of the write button is stored;
Display control means for generating the same screen as the test screen and displaying the result data acquired by the data acquisition means on the same screen;
Further comprising
Obtaining target image data including the result data from the same screen generated by the display control means;
The software automatic test system according to any one of claims 1 to 5. Optical reading means for optically reading characters from the target image data to obtain target character data;
Character storage means for storing collation source character data as a collation source in advance;
A character comparison means for comparing the original character data with the target character data;
Further comprising,
The software automatic test system according to any one of claims 1 to 7. A color data acquisition unit that scans the target image data and acquires target color data of the character;
The character storage means further stores in advance collation source color data to be a collation source,
The character comparison means further compares the target color data with the collation source color data;
The software automatic test system according to claim 8. Line color acquisition means for acquiring target color data of a line image included in the target image data;
Line color storage means for preliminarily storing collation source color data to be a collation source;
A line color comparing means for comparing the target color data and the matching source color data;
Further comprising,
The software automatic test system according to any one of claims 1 to 7. The line color acquisition unit acquires target color data of a pixel including the center of the line image and surrounding pixels,
The line color comparison unit compares the target color data with the comparison source color data,
The notifying means notifying a comparison result indicating a match when any one of the target color data is the same as the collation source color data;
The software automatic test system according to claim 10.

Images