KR101999321B1 - Program test system and test method using the same - Google Patents

Abstract

The present invention enables automatic verification without creating a complicated program for automatically performing verification, and the once-built automated processor can minimize the effort and cost of maintenance due to the change of the program And more particularly, to a program verification apparatus and a verification method.
A program verification method according to the present invention comprises: selecting and preparing a target program for verification; A step of providing a script for advancing a plurality of steps for verification of the target program; The verification apparatus proceeds through a plurality of the steps by the script to obtain a result image for each step; And an analysis step of comparing the resultant image with an original image provided for each of the plurality of steps to determine whether an error has occurred.

Description

[0001] PROGRAM TEST SYSTEM AND TEST METHOD USING THE SAME [0002]

The present invention enables automatic verification without creating a complicated program for automatically performing verification, and the once-built automated processor can minimize the effort and cost of maintenance due to the change of the program And more particularly, to a program verification apparatus and a verification method.

Recently developed software and application programs are being developed to operate in various devices, various operating systems, and the like.

In order for the program to be executed smoothly in various environments, it is necessary to perform a test process to confirm whether the program is normally executed in the development stage, in particular, whether the function is stably executed in various environments. Particularly, even if part of the function or part of the interface changes, the progress and verification of such a test is necessary.

Such a test is preferably performed through the same procedure as the case where the program is used by the user, and is repeatedly performed to detect the verification and error of the program. These tests are performed mainly by developers such as developers because of the nature of the program. For some interface tests, verification is performed through an automated program.

In the case of an existing automation verification program, a method of programming a test procedure through program coding and performing verification through this is mainly used. However, in the case of such an automation verification program, it takes more manpower and effort to program the verification procedure. In the case of such an automation verification program, if a change is made to a verification target or a small part of the procedure, there is inconvenience that a verification procedure of the verification program must be newly coded.

Therefore, the performance of the test is mainly performed manually by the same manpower as the developer, the automation is not carried out, and a large amount of manpower is input, which causes a great cost and effort.

Korean Patent Laid-Open No. 10-2010-0108000 (Published Oct. 10, 2010) "Mobile Software Test Apparatus and Method"

Therefore, it is an object of the present invention to enable automatic verification without creating a complicated program for automatically performing a verification, and an automated processor once constructed can save time and effort for maintenance according to a change of the program And to provide a program verification device and a verification method that can minimize the number of program verification devices.

Another object of the present invention is to provide a program verification apparatus and a verification method that can easily and precisely identify information when a problem occurs in a verification program by providing a user with a verification result in a location and a scope of a problem easily to recognize .

A program verification method according to the present invention comprises: selecting and preparing a target program for verification; A step of providing a script for advancing a plurality of steps for verification of the target program; The verification apparatus proceeds through a plurality of the steps by the script to obtain a result image for each step; And an analysis step of comparing the resultant image with an original image provided for each of the plurality of steps to determine whether an error has occurred.

And the original image is an image which is determined to have not generated an error among the result images obtained at the initial step of the result image acquiring step.

And the original image is updated by a result image selected by the user among the result images obtained in the verification process.

In the analyzing step, the verification device compares all of the one original image and one of the result images corresponding thereto and analyzes whether they are the same or not, and determines that the same is normal.

In the analyzing step, the verifying apparatus divides one original image into a plurality of divided regions, divides one corresponding result image into the same number of divided regions, and analyzes whether the divided regions correspond to each other .

Wherein the verification device applies a display effect that distinguishes a divided region, which is not the same as the divided region of the original image, from the same divided region when the analysis result is generated.

And the verification device records an image of the divided region that is not the same as the divided region of the original image and an image of the divided region of the original image in correspondence with each other when the analysis result is created.

The program verifying apparatus and the verification method according to the present invention can perform automatic verification without generating a complicated program for automatically performing verification, and the once-constructed automated processor can perform the verification for the maintenance according to the change of the program Thereby making it possible to minimize effort and cost.

In addition, the program verifying apparatus and the verification method according to the present invention can provide a verification result that allows the user to easily recognize the location and extent of a problem, thereby enabling the verification program to more easily and accurately grasp the information in the event of an issue .

BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a schematic diagram showing a configuration of a program verifying apparatus according to the present invention; Fig.
2 is an exemplary diagram for explaining a simplified configuration of an automation verification apparatus according to the present invention;
Figs. 3 to 5 are illustrations for explaining a script and a verification process. Fig.
FIG. 6 is an exemplary diagram for explaining an analysis process based on a comparison of whole images. FIG.
FIG. 7 is an exemplary diagram for explaining an analysis process by a divided image comparison; FIG.

Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. It should be noted that the drawings denoted by the same reference numerals in the drawings denote the same reference numerals whenever possible, in other drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. And certain features shown in the drawings are to be enlarged or reduced or simplified for ease of explanation, and the drawings and their components are not necessarily drawn to scale. However, those skilled in the art will readily understand these details.

1 is a schematic diagram showing a configuration of a program verifying apparatus according to the present invention.

Referring to FIG. 1, a program verification method according to the present invention includes a target selection step S10, a script creation step S20, an original image acquisition step S30, a test progress step S40, an image analysis step S50, And a result deriving step (S60).

The object selecting step S10 is a step of selecting a program that needs verification. An object to be selected at this time, that is, a program, means any program that provides a predetermined execution result in response to a command input by the user through the input device. Particularly, the verification apparatus and method of the present invention can be used conveniently with respect to a process and an output of a program output through a screen, but it is possible to obtain a processing result according to the progress of a program, , The processing procedure and the result of the program do not necessarily have to be outputted through the display screen, and the present invention is not limited thereto. The program selected in the target selection step S10 may include a program such as a plug-in installed and executed in a specific execution program in addition to a text editor, an Internet Explorer, and various execution programs.

 The script creation step S20 is a step of defining a procedure and an operation for a series of processes for performing verification in the selected object. The script creation step S20 is a step for the user to specify and determine the verification process. For example, when verifying the import function of the text editor, the user writes the script so that the verification apparatus can perform the process of calling the import menu with the document editor being executed. The script created in the script creation step (S20) can be used by directly describing the command input by the input device used by the user. Or moving a point device such as a mouse and selecting it may be directly reflected in the script. In addition, a program type verification procedure may be input using a program language, and the present invention is not limited thereto.

Specifically, a process of directly inputting a command among the methods of generating a script can allow a user to configure a script for a verification process by sequentially writing commands for menu calls at each step in a verification apparatus. For example, a menu may be called up, and a command corresponding to an item of a called menu may be written so that a script is configured. A script for loading can be configured using a shortcut key for the menu. When a device such as a mouse is used, a process of moving a mouse point to a menu item of a document creator, a process of selecting a menu, and a process of selecting a command corresponding to a menu call are input to a verification device, can do.

The original image acquiring step S30 is a step of acquiring an original image so that the user can identify an error according to a process of a function to be verified. The original image obtained in the original image acquiring step (S30) is used as an image for comparison with the image obtained in the verification process. In the original image acquiring step (S30), the image of each step according to the execution of the function to be verified is captured and stored in the order of steps by the method such as image storage to acquire the original image. A plurality of original images may be provided to verify one function, and different original images may be obtained depending on the types of scripts. For example, in the case of verifying the loading process, a screen in which a command for calling a menu group including an import command is input, a screen in which a menu group is called by a command, and an import command in a menu group are selected The image for each step is saved as the original image such as the screen, the screen where the loading window is activated by the execution, and the window where the file selection by the loading is performed. In particular, the instruction image can be stored differently depending on the type of script, that is, the execution method of the instruction. For example, even if the verification of the same import command is performed, the original image can be prepared according to the process of executing the command through the keyboard and the process of executing the command through the mouse.

On the other hand, the original image acquiring step S30 can be executed by the following test proceeding step S50, which will be described in more detail below.

In the test progress step S40, when the script is prepared, the automated verification apparatus performs a series of processes according to the script, and acquires an image of a designated step in each process. That is, a command for inputting a command for calling a menu group including an import command for verification of a command for loading a script, a menu group call by an input command, a command of a menu group, a file selection by an import A script may have been written for. In the test progressing step S40, a screen for inputting a command for calling a menu group including each step corresponding to the script progress, that is, a command for inputting a menu group, a menu for calling a menu group, A screen in which an importing instruction is selected, a screen in which an importing window is activated by execution, and a screen in which a file is selected by importing are captured. The captured image is then stored as the resulting image. At this time, for convenience of comparison, the verification apparatus may assign a filename for comparison with the original image to each captured image, but the present invention is not limited thereto.

On the other hand, as described above, the original image can be acquired and stored in the test progress step S40. For example, when a test is performed by writing only a script in the state that the original image is not prepared, all of the comparative analysis based on the result image acquired at this time is processed as a failure, so that confirmation of the user is requested, . At this time, if the user confirms the image provided by the failure process and it is confirmed that the image is a normal process result, it is possible to store the normal image as the original image, and in the subsequent test, the user can compare and analyze the image using the stored image.

In the image analysis step S50, the original image and the resultant image are compared with each other, and a process of determining failure and success of the execution process is performed in each test step. In the image analysis step S50, the automation verification apparatus compares the images obtained in the test step using the script with the pre-stored original images, respectively. Using the result information, the automated verification apparatus performs a test Results are derived. In this image analysis step S50, there may be a method of comparing the entire image area and a method of comparing the image part area, which will be described in more detail below.

The result derivation step S60 is a step in which the automated verification apparatus analyzes the result of each step by using the result transmitted in the image analysis step S50 and arranges the error occurrence part or step and provides the test result to the user. In this derivation step (S60), the user confirms the error or the test result by recognizing the error or the part or the part reported in the error as the normal operation.

2 is an exemplary diagram for explaining a simplified configuration of an automation verification apparatus according to the present invention.

2, the automated verification apparatus according to the present invention includes an input unit 10, an output unit 20, a storage unit 30, and a processing unit 40. The processing unit 40 includes a test execution unit 41 An image obtaining unit 43, and an analyzing unit 45. [0034] FIG.

A script is input from the user to the input unit 10, and a command for specifying the original image can be input. The input unit 10 may include various input devices such as a keyboard and a mouse, and a script by each of the input devices may be input. In addition, various commands for selecting, executing, and verifying the verification target can be input through the input unit 10.

The output unit 20 outputs and provides a step and a result according to the execution of the verification target. The output unit 20 may be a video output device such as a monitor or a screen for displaying an image, but it is possible to use various types of output devices capable of expressing the steps and results of the execution.

The storage unit 30 stores a script input from a user, an original image, and a result image, and is provided or stored at the request of the processing unit 40. The storage unit 30 may be a storage device such as a memory or a disk, but the present invention is not limited thereto.

The processing unit 40 receives the script through the input unit 10, executes the verification target, applies the script to the verification target, performs the test, and outputs the process and the result through the output unit 20 In addition, the test analysis is performed by selecting and storing the original image for the test progress, acquiring the result image according to the test progress, and comparing the resultant image with the original image. For this, the processing unit 40 may include a test progress unit 41, an image obtaining unit 43, and an analyzing unit 45.

The test progress section 41 plays a role of executing a function to be verified by a script input through the input section 10. [ To this end, the test progress unit 41 receives a script for an item for verification.

The image obtaining unit 43 obtains the original image and the resultant image for verification of the verification target. The image acquiring unit 43 acquires an original image by allowing the user to select the image through the input unit 10 or a result image selected through the input unit 10 out of the result image obtained by the initial test or the test result And stores it in the storage unit 30. When the test progress unit 41 performs a test, a result image of each step or result of the verification process is acquired at a predetermined time or step and stored in the storage unit 30.

The analysis unit 45 compares the original image stored in the storage unit 30 with the resultant image to determine whether the original image is changed or not, and analyzes whether an error has occurred according to the determination result. The analysis unit 45 may compare the original image prepared for each step with the corresponding result image, or may perform a comparison on each divided area by dividing the original image into a predetermined form. This will be described in more detail below. Thereafter, the analyzer 45 generates a report in which items such as the inspection step, the item, and the image are recorded in the form of a table that is easy for the user to confirm the analysis result, (20) to the user.

FIGS. 3 to 5 are illustrations for explaining a script and a verification process.

3 to 5, the verification apparatus executes a specific function of a verification target through a script input through the input unit 10, and performs an execution process and verification of the result. Particularly, in the present invention, when a normal operation is performed for the verification process, an image of an output process or result is compared with a result image obtained for each process or result during a test to determine whether the function is normally executed or not, To the user.

More specifically, verification of the verification target can be performed for a specific command. For example, if the verification is performed on the "import" command, a script such as that shown in FIG. 3 to FIG. 5 may be prepared, and the verification device performs the verification according to the script.

First, when the document editor 100a to be verified is prepared as shown in FIG. 3, a menu 110a is provided in one area of the document editor 100a.

At this time, the verification apparatus selects the 'file' of the menu 110a by the first script among the previously input scripts, and the menu may be expanded 111 by the drop-down as 'file' is selected. At this time, the verification apparatus acquires the image of the document editor 100b of FIG. 4 as a result image of the progressing step.

5, the 'import' command is input to the text editor 110b by the verification device and the 'import' window 112 is activated as shown in FIG. 5, (100c). At this time as well, the verification apparatus acquires the image of the document editor 100c of FIG. 5 as a result image of the progress step.

Through this, the verification device performs a test on the functions and operations to be verified by the user, and obtains the resultant images according to the tests. As described above, when the original image is not stored separately, the user can use the image as the original image as a result of confirming that the user is the normal operation out of the initially obtained result images.

Meanwhile, if the original image and the resultant image are acquired by the above-described method, the verification device analyzes whether the normal operation is performed or the malfunction is performed through the analysis process.

6 and 7 are diagrams for explaining an analysis process, FIG. 6 is an exemplary diagram for explaining an analysis process by comparing all images, FIG. 7 is an exemplary diagram for explaining an analysis process by a divided image comparison to be.

Referring to FIG. 6, a verification apparatus compares a resultant image obtained in a test process with a prepared original image, and performs verification of each step or a final result. At this time, as shown in FIG. 6, the original image and the resultant image can be recognized as one image and the 1: 1 comparison can be performed. That is, if the whole of the original image 120 is compared with the entire one of the result images 121 and the resultant image 121 is any part of the original image 120, if an error occurs or a malfunction occurs .

In such a case, it is necessary to compare the entire area when it is necessary to compare it, that is, in the process in which partial change should not occur, or in the comparison of the results, and if there is a minor difference, it is recognized as an error, .

In contrast, analysis may be necessary to find out when there are local differences, such as the color of the icon and some form changes. In this case, as shown in FIG. 7, a plurality of regions may be divided into one original image, and the resultant image may be divided correspondingly to be compared with each region.

For example, when a source image 130 and a result image 131 are prepared for a certain process and the comparison is performed by dividing the image into a size of 3 × 3, the original image 130 and the result image 131 are divided into 16 segments Images 1, 1 to 4, and 4, respectively. In the case where the original image 130 and the resultant image 131 are divided, it is possible to distinguish and analyze the same area and the changed area by comparing the divided images 1,1 to 4,4 at the same position . That is, it is possible to accurately inform the user of a situation in which a minute change such as a menu icon can be recognized as an error. In particular, by increasing or decreasing the number of divided images, it is possible to improve and analyze the user's desired characteristics of accuracy or processing speed.

Also, based on the result of (3, 3) of the division image of the original image 130 and the result image 131, the data of the exact position of the error and the difference of the original is subtracted and the data is visualized By providing the summary results to the user, it is possible to quickly identify which part of the user has occurred and to replace them.

In particular, when providing such a divided image, it is possible to allow the user to recognize the error part more quickly by providing the corresponding divided image of the original image in correspondence with information about the result image of the stage.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, And the like. Accordingly, such modifications are deemed to be within the scope of the present invention, and the scope of the present invention should be determined by the following claims.

10: Input unit 20: Output unit
30: storage unit 40:
41: test progress section 43: image obtaining section
45: Analysis Unit 100: Document Editor
110: Menu 120: Original image
121: Result image

Claims (7)

Selecting and preparing a target program for verification;
A step of providing a script for advancing a plurality of steps for verification of the target program;
The verification apparatus proceeds through a plurality of the steps by the script to obtain a result image for each step;
And an analysis step of comparing the resultant image with an original image prepared for each of the plurality of steps to determine whether an error has occurred,
Wherein the analyzing step comprises:
Wherein the verification apparatus divides one original image into a plurality of divided regions and divides one of the resultant images corresponding thereto into the same number of divided regions to analyze whether the divided regions correspond to each other . The method according to claim 1,
Wherein the original image is an image judged to have no error among the result images obtained at the initial step of the result image acquiring step. 3. The method of claim 2,
Wherein the original image is updated by a result image selected by the user among the result images obtained in the verification process. delete delete The method according to claim 1,
Wherein the verifying device applies a display effect to the divided regions of the original image, which are not the same as the divided regions of the original image, from the same divided region when the analysis result is generated. The method according to claim 6,
Wherein the verification device records an image of the divided region that is not the same as the divided region of the original image and an image of the divided region of the original image in association with each other when the analysis result is created.

Images