KR20150030297A - Verification apparatus, terminal device, system, method and computer-readable medium for verifying application - Google Patents

Abstract

The purpose of the present invention is to designate terminal devices and scripts which must be executed in work units, allocate each work to the terminal devices, and collect work results therefrom. The present invention relates to a verification apparatus, a terminal device, a system, a method and a computer-readable recording medium for automatically verifying an application and, more specifically, to an apparatus, a system, a method, and a computer-readable recording medium storing the method in the form of a program. The apparatus includes: a database configured to store information on at least one among a work group, a terminal group, and a script group; an integrated manager configured to register group generation information for at least one of the work group, the terminal group, and the script group in the database, to set terminal groups and script groups to each work group, and to distribute scripts included in a relevant script group to terminal devices included in a terminal group set to each work group; and an analysis manager configured to receive state information according to script reproduction from a terminal device, and to analyze the received state information to determine whether a relevant work is normally performed.

Description

Technical Field [0001] The present invention relates to a verification apparatus, a terminal apparatus, a system, a method, and a computer-readable recording medium for automatically verifying an application,

The present invention relates to a verification apparatus, a terminal apparatus, a system, a method, and a computer-readable recording medium for automatically verifying an application. More specifically, the present invention relates to a verification apparatus, An apparatus, a system, a method, and a computer-readable recording medium for collecting and analyzing status information from a terminal apparatus, and assigning each task to an actual terminal apparatus.

Application testing is the process of running and evaluating all or part of an application system to verify that an application meets specified requirements and to identify differences between expected and actual results. For example, in the process of developing a wireless communication terminal such as a mobile phone, a smart phone, a PDA, etc., developers should test whether an application installed in the terminal developed by the developer works in real operation with the communication system. If an error is found during such a test, it will be found by finding the error, analyzing the cause, and finding and correcting the solution.

Conventional application test methods test an application using only a prepared test case. Since these test cases contain test scripts and test data, the script and test data for the test are all fixed before the application test is finally performed.

According to the conventional application test method, since the test data is fixed, if the test is insufficient or incomplete part is found after the test is performed, it can not be compensated. After the test is finished, new test data There is a problem in that it is costly and time consuming.

In the case of the existing automatic test, the system notifies the administrator immediately when an error occurs, compares the correct answer with the test object, and logs the verification history according to each turn, which can not reflect and merge the result of the verification There is an inconvenience in management.

Prior Art 1: Korean Patent Laid-Open No. 10-2012-0081873 (2012.07.20. Disclosed)

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned conventional problems, and it is an object of the present invention to designate a terminal device and a script to be executed in units of a task, allocate each task to an actual terminal device, and collect the result.

The present invention aims at dividing the produced automatic verification script by task and terminal device.

An object of the present invention is to increase the verification efficiency by allowing a group of tests under the same conditions to proceed without individual setting.

A verification apparatus for solving the above-mentioned problems registers group creation information for at least one of a database, a work group, a terminal group, and a script group in which information about at least one of a work group, a terminal group, and a script group is stored in the database , An integration manager for setting up a terminal group and a script group in each work group, distributing a script included in the script group to the terminals in the terminal group set in each work group, and status information on the script reproduction from the terminal And an analysis manager for analyzing the received status information and determining whether the work is normally operated.

The integration manager of the present invention can set reference terminal information including a reference terminal device and reference data among the terminal devices in the terminal group.

The analysis manager of the present invention compares the screen information of the status information with the previously stored view tree information, and if it does not coincide with the predetermined ratio or more, the analysis manager determines that an error has occurred.

On the other hand, the terminal apparatus of the present invention collects state information that changes in real time while executing a script file stored in the storage unit, a communication unit that receives a script file from the verification apparatus, a storage unit that stores the script file received through the communication unit, And a terminal control unit for transmitting the collected status information to a verification apparatus. Here, the status information may include at least one of terminal information, system resource information, and screen information.

According to another aspect of the present invention, there is provided a system for automatically verifying an application, the system comprising: an administrator terminal device that requests registration of group creation information for at least one of a work group, a terminal group, and a script group; Information is registered in the database, a terminal group and a script group are set in each work group, a script included in the script group is distributed to terminals in the terminal group set in each work group, A verification device for analyzing the received status information to determine whether the work is normally operated or not; a processor for collecting status information that changes in real time while executing a script file transmitted from the verification device, And transmitting the status information to the verification apparatus . ≪ / RTI >

The administrator terminal device may receive work assignment information including at least one of a terminal group and a script group to be assigned to each work group, work information of the work group, and reference terminal information, and may transmit the work assignment information to the verification device.

Further, the verification apparatus of the present invention may include a step of registering group creation information for at least one of a work group, a terminal group, and a script group, setting a terminal group and a script group in each work group Distributing a script included in the script group to the terminal devices in the terminal group set in each work group; analyzing the received status information when receiving status information on the script reproduction from the terminal device, And judging whether or not the vehicle is normally driven.

A method for automatic application verification described in various embodiments in the present invention can be embodied in a computer-readable recording medium having embodied therein a program for executing the method.

According to another aspect of the present invention, there is provided a method for automatically verifying an application, the method comprising: requesting registration of group creation information for at least one of a work group, a terminal group, and a script group; And registering the group creation information in a database. The administrator terminal device inputs work allocation information including at least one of a terminal group and a script group to be assigned to each work group, work information of the work group, and reference terminal information And transmitting the verification information to the verification apparatus, wherein the verification apparatus sets a terminal group and a script group in each work group according to the work assignment information, and stores work information or reference terminal information of the work group, The terminal groups in the terminal group set in each work group are assigned to the corresponding script group The terminal device receiving the script from the verification device collects status information that changes in real time while executing the script and transmits the collected status information to the verification device; The verification apparatus may include a step of analyzing status information received from the terminal and determining whether the work is normally operated.

According to the present invention, a terminal apparatus and a script to be executed in a unit of a task are specified, each task is assigned to an actual terminal apparatus, and the result is collected, so that a test under the same condition can be grouped without individual setting, The verification efficiency can be increased.

In addition, by dividing the generated automatic verification script by task and terminal device, it is possible to reuse the existing task group and test case without any setting even if the test version is changed.

In addition, since the reference terminal device to be compared can be easily changed, and the application verification result of the terminal device can be reflected and merged by the manual verification person in charge, the application verification result can be easily managed.

The effects of the present invention are not limited to the above-mentioned effects, and various effects can be included within the range that is obvious to a person skilled in the art from the following description.

1 is a diagram illustrating an embodiment of a system for automatic application verification of the present invention
2 is a block diagram showing an embodiment of the verification apparatus 20 of the present invention.
3 is a block diagram showing an embodiment of a terminal device of the present invention.
4 is a diagram illustrating a method for automatic application verification of the present invention.

The foregoing and other objects, features, and advantages of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which: FIG.

1 is a diagram illustrating an embodiment of a system for automatic application verification of the present invention.

A system for automatic application verification of the present invention includes an administrator terminal apparatus 100, a verification apparatus 200, and at least one terminal apparatus 300.

The administrator terminal apparatus 100 accesses the verification apparatus 200 via a communication network and registers group creation information for at least one of a work group, a terminal group, and a script group in the verification apparatus 200.

The manager terminal 100 receives work assignment information including at least one of a terminal group and a script group to be assigned to each work group, work information of the work group, and reference terminal information, and transmits the work assignment information to the verification apparatus 200. Here, the work information may include a detail or value for the job, and the reference terminal information may include a reference terminal device and reference data among the terminal devices of the terminal group. The reference data may include screen information, various execution information, and the like.

 As described above, the administrator terminal device 100 designates a terminal device and a script to be executed in units of a task.

The verification apparatus 200 registers the group creation information in the database in response to the group creation information registration request transmitted from the administrator terminal device 100. [

The verification apparatus 200 sets a terminal group and a script group in each work group according to the work assignment information transmitted from the administrator terminal device 100 and stores work information or reference terminal information of the work group.

The verification apparatus 200 distributes the script included in the script group to the terminal devices in the terminal group set in each work group. When the status information on the script reproduction is received from the terminal device 300, And judges whether the work is normally operated or not. At this time, the verification apparatus 200 compares the state information transmitted from the terminal device 300 with the pre-stored view tree information, and stores the result of performing the automatic verification according to the comparison result. That is, the verification apparatus 200 searches the target view having one or more identical attributes and predefined view tree information from the state information received from the terminal device 300, and performs verification of the corresponding view. A view is a frame for displaying a component of an application content displayed through an output window of a terminal, and is a unit frame capable of displaying various application components such as a button, a text field, and a check box. In implementing the present invention, a view is a basis for application verification, and the present invention is an operation for verifying an application by comparing a view of an application to be verified with a view currently being executed on the terminal device, .

As described above, the verification apparatus 200 assigns each job designated by the administrator terminal apparatus 100 to an actual terminal apparatus, and collects the results.

A detailed description of this verification apparatus 200 will be given with reference to FIG.

The terminal device 300 collects status information that changes in real time while executing the script file transmitted from the verification device 200, and transmits the collected status information to the verification device 200. Here, the status information may include various execution information, screen information, and the like, and various execution information may include terminal information, system resource information, and the like. The terminal information includes terminal specifications, execution time, network usage, and the like. The system resource information may include CPU usage, memory usage, network usage, execution service list, process termination, and the like.

The terminal device 300 executes an application to be verified and performs a function of transmitting screen information according to application execution to the verification device 200 as status information.

On the other hand, it is preferable that the plurality of terminal devices 300 have different hardware or software, so that when the same application is executed, it is possible to compare whether each terminal device operates correctly.

The status information transmitted from the terminal device 300 to the verification device 200 is preferably written in a script and can be written in a language that can parse the components constituting the content of the application separately .

The terminal device 300 transmits the status information that changes in real time to the verification device 200 while executing the assigned work and the verification device 200 receives the status information transmitted from the terminal device 300 It is possible to determine in real time whether the workpiece is normally driven in the terminal device 300 based on the state information.

2 is a block diagram showing an embodiment of the verification apparatus 200 of the present invention.

The verification apparatus 200 of the present invention includes an integration manager 210, an analysis manager 220, a database 230, and an output unit 240.

The integration manager 210 registers group creation information for at least one of a work group, a terminal group, and a script group in the database 230, sets a terminal group and a script group in each work group, Distributes the script included in the script group to terminal devices in the group.

The integration manager 210 registers the application and the test case in the database 230 when the registration of the application and the test case is requested from the administrator terminal device. Here, the test case is composed of data including information on a measurable state, a condition, an event, an input / output value, and the like.

The integration manager 210 stores group creation information in the database 230 when group creation information for at least one of a work group, a terminal group, and a script group is received from the administrator terminal device. Here, the script is a series of verification scenarios for verifying an application, and the script can be created by the user arbitrarily or can be downloaded (received) from the other server and used. The script consists of a set of instructions for testing, and the application verification according to the invention is made according to the verification scenario included in the script.

When the work manager 210 receives work assignment information including at least one of a terminal group and a script group to be assigned to each work group, work information of the work group, and reference terminal information from the administrator terminal device, Accordingly, a terminal group and a script group are set in each work group, and work information or reference terminal information of the work group is stored.

The analysis manager 220 receives status information on the script reproduction from the terminal device, analyzes the received status information, and determines whether the work is normally operated. For example, the analysis manager 220 compares the screen information of the collected state information with the previously stored view tree information, and when the ratio is equal to or more than a predetermined ratio, the analysis manager 220 determines that the work is normally driven, It is determined that the work is not normally driven.

As described above, the analysis manager 220 is a functional unit that substantially verifies whether a work (service) running in the test terminal apparatus is normally operated. The analysis manager 220 searches for a specific view in the service application and examines a test item for the view .

Specifically, the analysis manager 220 searches the predefined view tree information for a target view similar to the in-state information in the state information transmitted from the test terminal device, and performs one or more test item tests on the searched target view. In particular, the user can set the screen information reference setting value in advance. If the screen information of the state information is compared with the target view extracted from the view tree information and the match is lower than the reference setting value, When the degree of matching is high, it can be determined that it is successful.

The database 230 stores applications, test cases, group creation information, and the like. The database 230 stores a script file, status information of the test terminal device, and results of automatic verification. Here, the result of the automatic verification may include information on whether or not the work currently running in the test terminal apparatus is normally operated. Information on whether or not the work is normally performed may include error occurrence information and error occurrence information when an error occurs have.

In the database 230, work information assigned to each test terminal device is stored.

The output unit 240 may output the result of the automatic verification performed by the analysis manager 220. The output unit 240 may be a form of a display that can be visually confirmed, a form that can be visually perceived, such as a speaker, or the like, and includes any other form capable of confirming a comparison result.

3 is a block diagram showing an embodiment of the terminal device 300 of the present invention.

The terminal device 300 of the present invention includes a communication unit 310 for receiving a script file from the verification device, a user interface unit 320, a storage unit 330, and a terminal control unit 340.

The user interface unit 320 may operate as an input unit for receiving a user command or an output unit for outputting a user command.

The storage unit 330 stores a script for automatic verification. At this time, the script is a series of verification scenarios for verifying an application, and the script can be created by the user arbitrarily or downloaded (received) from the other server and used. The script is made up of a set of test instructions, and the application verification according to the invention is done according to the verification scenario included in the script.

The storage unit 330 stores various applications including an application automatic verification application.

The terminal control unit 340 collects status information that changes in real time while executing the script file stored in the storage unit 330 and transmits the collected status information to the verification apparatus through the communication unit 310. [

That is, the terminal control unit 340 inquires the work information allocated to the verification apparatus, checks whether or not the application for executing the assigned work information is stored in the storage unit 330, and if the application is stored, Run the script.

The terminal control unit 340 collects status information at the time of execution of the script, and transmits the collected status information to the verification apparatus. Here, the status information may include various execution information, screen information, and the like, and various execution information may include terminal information, system resource information, and the like. The terminal information includes terminal specifications, execution time, network usage, and the like. The system resource information may include CPU usage, memory usage, network usage, execution service list, process termination, and the like.

 That is, when reproducing the prepared script for the automatic verification, the terminal control unit 340 collects various status information of the terminal itself. Mainly, Hierarchy is stored as a view tree based on the view attribute of the activity, and information is stored by combining user input events and individual screens (idx) of the view tree at the time of script recording.

The terminal control unit 340 transmits the status information, which changes in real time, to the verification apparatus while reproducing the prepared script at a predetermined time interval. Then, the verification apparatus can judge in real time whether the workpiece is normally driven based on the state information.

4 is a diagram illustrating a method for automatic application verification of the present invention.

4, the administrator terminal 100 accesses the verification apparatus 200 via the Web (S401), and registers the application and the test case in the verification apparatus 200 (S403).

The administrator terminal 100 receives group creation information for at least one of a work group, a terminal group, and a script group, and requests registration to the verification apparatus 200 (S405). That is, the administrator inputs group creation information including a work group, a terminal group, a script group name, a description, and the like on the group creation screen, and requests registration to the verification apparatus 200.

The verification apparatus 200 registers the group creation information in the database at the request of the administrator terminal unit (S407).

The manager terminal 100 receives work assignment information including at least one of a terminal group and a script group to be assigned to each work group, work information of the work group, and reference terminal information, and transmits the work assignment information to the verification apparatus 200 S409). That is, the administrator can select a terminal device and a script to distribute the work (work) on the work assignment screen. Then, the manager inputs detailed information about work to be performed in the work group, that is, work information, and selects a reference terminal device among the terminal devices of the terminal group. Then, the manager sets the reference data of the reference terminal apparatus to success. Then, the administrator terminal device 100 transmits the work assignment information including the terminal group and the script group to be assigned to each work group, the work information of the work group, the reference terminal information, and the like to the verification apparatus 200.

The verification apparatus sets a terminal group and a script group in each work group according to the work assignment information, and stores work information or reference terminal information of the work group (S411).

The verification apparatus distributes the scripts included in the script group to the terminal devices in the terminal group set in each work group (S413).

Upon receiving the script from the verification device, the terminal device collects status information that changes in real time (S417) while executing the script (S415), and transmits the collected status information to the verification device (S419).

The verification apparatus analyzes the status information received from the terminal and determines whether the work is normally operated (S421).

The method for automatic verification of the application described above can be produced, used and transferred according to the form of a computer-readable recording medium containing a program for executing the method. In addition, when the program is transferred by a method of transmitting and receiving the program on-line, it goes without saying that the scope of the right and the device for transmission and reception and the transmission and reception of the program are also extended.

Thus, those skilled in the art will appreciate that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is therefore to be understood that the embodiments described above are to be considered in all respects only as illustrative and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

The present invention provides a verification apparatus, a terminal apparatus, a system, a method, and a computer-readable recording medium for automatic verification of an application, so that tests of the same conditions can be grouped without individual setting, .

100 administrator terminal device 200 verification device
210 Integration Manager 220 Analysis Manager
230 database 240 output unit
300 terminal apparatus 310 communication section
320 user interface unit 330 storage unit
340 terminal control section

Claims (10)

A database storing information on at least one of a work group, a terminal group, and a script group;
The group creation information for at least one of a work group, a terminal group, and a script group is registered in the database, a terminal group and a script group are set for each work group, An integration manager for distributing the scripts contained in the group; And
An analysis manager for receiving status information according to script reproduction from a terminal device and analyzing the received status information to determine whether the work is normally running;
/ RTI > 2. The verification apparatus of claim 1, wherein the integration manager sets reference terminal information including a reference terminal device and reference data among the terminal devices in the terminal group. The apparatus of claim 1, wherein the analysis manager compares the screen information of the status information with the previously stored view tree information and determines that an error has occurred by failing the processing if the ratio is not equal to or greater than a predetermined ratio A communication unit for receiving a script file from the verification apparatus;
A storage unit for storing a script file received through the communication unit;
A terminal control unit for collecting status information that changes in real time while executing a script file stored in the storage unit and transmitting the collected status information to a verification apparatus;
. 5. The terminal apparatus according to claim 4, wherein the status information includes at least one of terminal information, system resource information, An administrator terminal device that requests registration of group creation information for at least one of a work group, a terminal group, and a script group;
In accordance with a registration request of the administrator terminal device, registers the group creation information in a database, sets a terminal group and a script group in each work group, and includes terminal groups in the terminal group set in each work group A verification device that receives status information from a terminal device after script reproduction and analyzes the received status information to determine whether the corresponding work is normally running; And
At least one terminal device for collecting status information that changes in real time while executing a script file transmitted from the verification device and transmitting the collected status information to the verification device;
A system for automatic application verification comprising The method of claim 6, wherein the administrator terminal device receives work allocation information including at least one of a terminal group and a script group to be assigned to each work group, work information of the work group, and reference terminal information, ≪ RTI ID = 0.0 > A method for an application automatic verification of a verification device,
Registering group creation information for at least one of a work group, a terminal group, and a script group;
Setting a terminal group and a script group in each work group and distributing a script included in the script group to terminal devices in the terminal group set in each work group; And
Analyzing the received status information to determine whether the work is normally operated if state information according to script reproduction is received from the terminal device;
For automated application verification, including A computer-readable recording medium having recorded thereon a program for executing a method for automatic verification of an application according to claim 8 Requesting registration of group creation information for at least one of a work group, a terminal group, and a script group;
Registering the group creation information in a database in response to a registration request of an administrator terminal unit;
The manager terminal device receiving work allocation information including at least one of a terminal group and a script group to be assigned to each work group, work information of the work group, and reference terminal information, and transmitting the work assignment information to the verification device;
Wherein the verification apparatus sets a terminal group and a script group in each work group according to the work allocation information, and stores work information or reference terminal information of the work group;
Distributing a script included in the script group to the terminal devices in the terminal group set in each work group;
The terminal device receiving the script from the verification device collects status information that changes in real time while executing the script, and transmits the collected status information to the verification device. And
Analyzing state information received from the terminal device and determining whether the workpiece is normally driven;
The method comprising the steps of:

Images