KR20220049334A - Method and system for application test - Google Patents

Abstract

A method for operating a test management server includes: receiving a test terminal registration request including terminal information of terminals; storing the terminal information of the terminals in a test terminal pool; receiving a test request including at least one test application and scripts for defining an interaction execution operation through the test application; selecting the test terminals as a terminal group based on the terminal information stored in the test terminal pool, the test terminals configured to execute the test application according to each of the scripts; transmitting the test application and a script defined from among the scripts to the test terminals; and receiving execution results of executing the test application according to the transmitted script from the test terminals. According to the present invention, it is possible to test the application only with a simple procedure.

Description

Application test method and test system

This disclosure relates to application testing.

After testing whether there is any abnormality in the operation of the application, the developer distributes the application. After application deployment, if additional functions are developed or existing functions are changed, the developer must test the application again before deploying. Developers can manually test various operations of the application, but it requires a lot of time and money. There is a technology that automatically tests an application using a script, such as selenium, but it is configured to test each terminal or server, the entire test process is not automated, or the test program needs to be redeveloped for a new service. There are many cases where On the other hand, the developer can check the test result through the log left by the application. For this, the test code must be developed in advance in the application. This can result in a mix of test and functional code in commercial applications.

In particular, inter-terminal interaction tests such as making and receiving calls between terminals, order request and order reception, etc. require simultaneous testing. Manual testing is not easy, and for automatic testing, test codes must be put into the application.

Recently, kiosk terminals that receive user orders from fast food and concierge terminals that receive amenity/concierge requests from hotels are increasing. As non-face-to-face services through terminals increase and types of terminals are diversified, there is a need for a technology for quickly testing the integrity verification of an interaction between a terminal and a server or between a terminal and a terminal.

The task to be solved is that the test management server selects a terminal group for an interaction test from a test terminal pool, provides a script in which the execution operation of the application is defined to the terminal group, and then executes the application according to the script. It is to provide an application test method that obtains the result.

An object to be solved is to provide an application test method in which a terminal selected for testing executes an application according to a script in which an execution operation of the application is defined, and provides an execution result to a test management server.

A method of operating a test management server according to an embodiment, comprising: receiving a test terminal registration request including terminal information of terminals; storing terminal information of the terminals in a test terminal pool; at least one test Receiving a test request including an application and scripts in which an interaction execution operation through the test application is defined, based on terminal information stored in the test terminal pool, executing the test application according to each of the scripts Selecting test terminals as a terminal group, transmitting the test application and a specified one of the scripts to the test terminals, and executing the test application from the test terminals according to the transmitted script and receiving results.

In the step of selecting the test terminals as a terminal group, a test terminal to perform the role may be selected from the test terminal pool according to a role tested by each script.

The step of transmitting a specified script among the scripts may transmit a script corresponding to a role to each test terminal.

The scripts may include a calling-side script and a receiving-side script for testing the call function of the test application. The sender script may be transmitted to a test terminal serving as a sender, and the receiver script may be transmitted to a test terminal serving as a receiver.

The receiving of the execution result includes transmitting a script execution command to at least some of the test terminals and executing the test application according to the transmitted script from the test terminals receiving the script execution command. You can receive the execution result.

The test terminal registration request may be received from a terminal in which the test management program is installed.

The terminal information may include software information and hardware information required for application testing.

The scripts include a server-side script and a client-side script for testing an interaction between a server terminal and a client terminal, or a first client-side script and a second client-side script for testing an interaction between the first client terminal and the second client terminal It may include a script or a plurality of scripts for a 1:N interaction test between the server terminal and a plurality of client terminals.

The operating method may further include providing a test result including the execution results in response to the test request.

A method of operating a terminal according to an embodiment, comprising: installing a test management program, transmitting a test terminal registration request including terminal information to a test management server; receiving a test application and a script from the test management server; operating the test application according to the script, obtaining execution results of the test application, and transmitting the execution results to the test management server.

In the obtaining of the execution results, the information of the control constituting the screen of the application is checked from the operation information of the test application operated according to the script, and the execution results of the test application are checked based on the information of the control. can

According to an embodiment, since the interaction function of the application can be automatically tested with a script separate from the application, a test environment independent of the application can be built, the interaction function can be checked simultaneously on terminals, and the function of the application is added or If it changes, you can change the script to test the added or changed functionality.

According to the embodiment, it is possible to test the application after developing the application without needing to insert a test code into the application.

According to the embodiment, it is possible to check the execution result of the application through the terminal screen, and to check the test result through the execution result obtained from the terminal screen information (UI) without the need to analyze the log file in which the execution result is recorded in the terminal can

According to the embodiment, when the developer registers the application to be tested and the scripts in which the interaction execution operation of the application is defined in the test management server, the terminal selected in the test management server executes the script in which the execution operation of the application is defined. It can be obtained from the management server. Therefore, according to the embodiment, the developer does not need to build a test environment to install and test the application in the terminal, and without the need to go through a complicated test process, the application can be implemented with only a simple procedure of registering scripts in which the interaction execution operation of the application is defined. can be tested

1 is a configuration diagram of a test system according to an embodiment.
2 is a diagram illustrating an interaction test environment according to an exemplary embodiment.
3 is a diagram exemplarily illustrating an interaction test according to an embodiment.
4 is a flowchart of a method for a test management server to test an application according to an embodiment.
5 is a flowchart of a method for a test terminal to test an application according to an embodiment.
6 is a configuration diagram of a test management server according to an embodiment.
7 is a configuration diagram of a test terminal according to an embodiment.

Hereinafter, with reference to the accompanying drawings, the embodiments of the present disclosure will be described in detail so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them. However, the present disclosure may be implemented in several different forms and is not limited to the embodiments described herein. And in order to clearly explain the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

In the specification, when a part "includes" a certain component, it means that other components may be further included, rather than excluding other components, unless otherwise stated. The devices constituting the network may be implemented by hardware or software or a combination of hardware and software.

In the specification, the server and the terminal are devices operated by at least one processor, and may include one or more processors, a memory for loading a computer program executed by the processor, a storage for storing programs and various data, and a communication interface. . A computer program may include instructions that, when loaded into memory, cause a processor to perform methods/operations according to various embodiments of the present disclosure. That is, the processor may perform the method/operations according to various embodiments of the present disclosure by executing the instructions. An instruction refers to a set of computer readable instructions grouped by function, which is a component of a computer program and is executed by a processor.

1 is a configuration diagram of a test system according to an embodiment, and FIG. 2 is a diagram for explaining an interaction test environment according to an embodiment.

Referring to FIG. 1 , the test system 1 includes a test management server 100 , a plurality of terminals 200a , 200b , ..., 200n registered as test terminals in the test management server 100 , and a developer terminal ( 300) may be included. The terminals registered as test terminals may be general-purpose mobile terminals or dedicated terminals manufactured for a specific service.

The terminals 200a, 200b, . , a navigation terminal, etc. may be various. It is assumed that some terminals have the resources to test the server function and can test the server test application running on the server. In addition, some terminals may be equipped with an emulator of a terminal used for testing (eg, a kiosk terminal or a robot terminal). Some terminals may install a test management program and may be directly connected to the test management server 100 . Some terminals (eg, robot terminals) that are difficult to directly connect to the test management server 100 because the test management program cannot be installed may be connected to the test management server 100 through the relay terminal 400 . A plurality of terminals may be connected to the relay terminal 400 . The relay terminal 400 may install a test management program, and a terminal to which the test terminals can be connected by wire or wireless is sufficient, for example, a notebook terminal.

For example, the terminal 200a installs a test management program, is connected to the test management server 100 through the test management program, and transmits terminal information to the test management server 100 to request registration. The test management program extracts information of the executed terminal, transmits it to the test management server 100, and may include commands for requesting registration.

Alternatively, the relay terminal 400 installs the test management program, is connected to the test management server 100 through the test management program, and extracts information on the connected terminals 200c, 200d, and 200e, and the test management server ( 100), and may request registration of the terminals 200c, 200d, and 200e. The test management server 100 may register the mapping between the relay terminal 400 and the terminals 200c, 200d, and 200e. The terminals 200c, 200d, and 200e may execute an application under the control of the relay terminal 400 .

The test management server 100 registers various types of terminals 200a, 200b, ..., 200n used for testing in a test terminal pool, and manages terminal information. The terminal information may include software information, hardware information, setting information, etc. required to determine whether the test target application can be executed and tested. For example, the terminal information may include an installed operating system, an operating system version, an IP address, a phone number, affiliated carrier information, manufacturer information, camera, microphone, display size, sensor type, processor, memory, and the like. The terminal information may further include a terminal type.

The test management server 100 receives, from the developer terminal 300 , a test request including at least one test application to be tested and a script in which an interaction execution operation of the test application is defined. The test application to be tested may include the test application installed in the client terminal, and the script may include execution operations written for testing the interaction between the client terminals. The test application to be tested may include a client test application installed in a client terminal and a server test application installed in a server. In this case, the script may include execution actions written for testing the interaction between the client terminal and the server.

In the script, the execution environment of the test application, the test item of the test application, the test procedure, execution record information, error record information, etc. may be defined. For example, a script for testing the call function of the test application may include a calling-side script and a receiving-side script. The caller script may be defined to execute a test application, transmit a call to a designated recipient, and record an execution result (eg, call success or failure) when the call is terminated. The script on the receiving side runs the test application and waits, when a call comes in, selects the call button (for example, by touching or swiping) to accept the call, and when the call ends, the execution result (for example, call success or not) is recorded. can be defined to

The test management server 100 may assign an identifier to the test application and script included in the test request. The test management server 100 may set a test schedule of a test application included in the test request.

The test management server 100 may analyze errors in the script included in the test request, provide error information to the developer who requested the test, so that they can be corrected, or the error may be corrected in a specified manner.

The test management server 100 may perform the following operation when a test time is reached based on the test schedule.

The test management server 100 may check a test application and script as a test target, and select a terminal group that can be tested by executing the test application and script based on terminal information registered in the test terminal pool. For example, when testing the one-to-one communication function provided by the test application, the test management server 100 may select a sending terminal and a receiving terminal. When testing the multi-party communication function provided by the test application, the test management server 100 may select a plurality of terminals for a group call.

When testing the communication function between the server and the terminal provided by the test application, the test management server 100 may select a terminal serving as a server and a terminal serving as a client. For example, in the case of a test between a video call terminal used in a call center and a web server linked thereto, a terminal capable of executing a web browser is selected as the web server, and an Android terminal with specifications capable of executing the function of a video call terminal can be chosen. The selected terminals can obtain and execute test information through a predefined script. Through this, the web server makes a call to each video call terminal, and the video call terminal receives a call and waits for a certain period of time, then terminates the function test can be conducted, and the terminals selected for the test report the execution result to the test management server ( 100) can be transmitted.

The test management server 100 may transmit a test application and a script to the selected terminal group. At this time, if the test management server 100 is the terminal 200a capable of directly executing the script through the test management program, it transmits the script execution command, and the terminal 200a that receives the script execution command operates the test application according to the script. and record the execution results. Alternatively, if there is a terminal 200c participating in the test through the relay terminal 400 in the selected terminal group, the test management server 100 is a relay terminal 400 to which terminals participating in the test are connected, a test application and a script. can send an external control request with Then, the relay terminal 400 may install the test application in the terminal 200c, operate the test application of the terminal 200c according to the script, and record the execution result.

The test management server 100 may receive execution results from the selected terminal group and provide the test results including the execution results to the developer terminal 300 .

On the other hand, the execution result of the application may be confirmed through the terminal screen (UI) information. First, the UI is a collection of controls, and each control has a unique name and unique ID. Accordingly, the test management server 100 or the test terminal may obtain screen information executed in the terminal in various ways. For example, screen information of an executed application may be acquired through UIAutomator installed in an Android terminal, and it may be confirmed through existence of a control or screen change. Alternatively, through selenium, the value of a web control such as a text box can be retrieved or JavaScript can be executed. In the case of windows, the contents of the control can be obtained through the handle of the on-screen control with a unique ID.

Hereinafter, a case in which the test management server 100 selects the terminals 200a and 200b as test terminals for the application test will be described as an example.

Referring to FIG. 2 , the test management server 100 receives a test request from the developer terminal 300 , and includes a client test application 10 , a server test application 20 , and between the client and the server included in the test request. Assume that you save a script containing execution actions for an interaction test. In this case, the script may include a client-side script 11 for testing the client test application and a server-side script 21 for testing the server test application. The client-side script 11 and the server-side script 21 may include a procedure for exchanging each other in order to test the interaction between the client and the server.

The test management server 100 may select the terminals 200a and 200b as client terminals and server terminals for testing based on terminal information registered in the test terminal pool. It is assumed that each of the terminals 200a and 200b mounts the test management programs 30 and 32 , executes a script through the test management program to operate the application, and records the execution result of the application.

The test management server 100 transmits the client test application 10 and the client-side script 11 to the terminal 200a, and transmits the server test application 20 and the server-side script 21 to the terminal 200b. there is. The test management server 100 may transmit a script execution command to the terminal 200a and the terminal 200b.

At this time, the test management server 100 checks the terminal information (eg, phone number or IP address) required in the test item of the script, and the information of the terminals 200a and 200b selected from the terminal information stored in the test terminal pool. After extracting , a script to be transmitted to the terminals 200a and 200b may be completed.

The terminal 200a downloads the client test application 10 and the client-side script 11 , and the test management program 30 receiving the script execution command executes the client test application 10 according to the client-side script 11 . make it work

The terminal 200b stores the server test application 20 and the server-side script 21 , and the test management program 32 receiving the script execution command executes the server test application 20 according to the server-side script 21 . make it work

When the test management program 30 receives a script execution command from the test management server 100 , it executes the client-side script 11 to operate the client test application 10 , and returns the execution result of the application to the test management server 100 . ) can be transmitted.

When the test management program 32 receives a script execution command from the test management server 100 , it executes the server-side script 21 to operate the server test application 20 , and returns the execution result of the application to the test management server 100 . ) can be transmitted.

The test management server 100 may receive execution results from the terminal 200a and the terminal 200b and store the execution results in the execution result storage 50 . The test management server 100 may provide a test result page to the developer terminal 300 and display the execution result stored in the execution result storage 50 on the test result page.

3 is a diagram exemplarily illustrating an interaction test according to an embodiment.

Referring to FIG. 3 , the terminal 200a is equipped with a client test application 10 and a test management program 30 , and the test management program 30 executes the client-side script 11 to execute the client test application 10 . to operate, the client test application 10 may be a room application installed in the guest room terminal.

The terminal 200b is loaded with the server test application 20 and the test management program 32 , and the test management program 32 executes the server-side script 21 to operate the server test application 20 , the server test The application 20 may be a room management application installed in a hotel front terminal or a hotel management server.

It is assumed that the client test application 10 and the server test application 20 provide services such as a voice call, a video call, or a chatting based on Web Real-Time Communication (WebRTC). At this time, when testing the call function of the client test application 10 and the server test application 20, the server-side script 21 describes the recipient information (eg, No. 1001) for which the session is created, and the server It may be defined to execute the test application 20 to transmit a call to the receiver, and to record the execution result (eg, whether the call is successful, incoming/outgoing time, and call time) when the call is terminated. The client-side script 11 executes the client test application 10, selects the call button when a call comes in (for example, touch or swipe) to accept the call, and selects the end button after a certain period of time to end the call. After that, it may be defined to record the execution result (eg, call success, incoming/outgoing time, call time).

The test management program 32 executes the server test application 20, which is a room management application, according to the server-side script 21, controls the server test application 20 to send a call to the receiver, and the server test application 20 When the call is terminated, it is possible to control to record the execution result (eg, whether the call was successful, incoming/outgoing time, and call time). In addition, the test management program 32 may acquire the execution result recorded in the server test application 20 and transmit it to the test management server 100 .

The test management program 30 executes the client test application 20, which is a room application, according to the client-side script 11, controls the client test application 20 to select a call button when a call comes in, and the client test application ( 20) can be controlled to select the end button after a certain period of time, and to record the execution result after the call ends. The test management program 30 may acquire the execution result recorded in the client test application 20 and transmit it to the test management server 100 .

On the other hand, the test management server 100 is a plurality of test terminals corresponding to the guest room terminals and the front terminal when an interaction test of the room applications mounted on the plurality of guest room terminals and the room management application installed on the front terminal is requested. , and transmit the client test application and the client-side script to the test terminals corresponding to the guest room terminal among the selected plurality of test terminals, and transmit the server test application and the server-side script to the test terminal corresponding to the front terminal. . In this case, in the script transmitted to each test terminal, interaction execution operations determined according to a test scenario may be defined.

4 is a flowchart of a method for a test management server to test an application according to an embodiment.

Referring to FIG. 4 , the test management server 100 receives a test terminal registration request ( S110 ). The test management server 100 may receive a test terminal registration request including its own terminal information from terminals in which the test management program is installed. The test management server 100 may receive a test terminal registration request including connected terminal information from the relay terminal 400 in which the test management program is installed. The terminal information may include software information, hardware information, setting information, etc. required to determine whether the test target application can be executed and tested. For example, the terminal information may include an installed operating system, an operating system version, an IP address, a phone number, affiliated carrier information, manufacturer information, camera, microphone, display size, sensor type, processor, memory, and the like.

The test management server 100 checks the terminal information included in the test terminal registration request, and registers the test terminals in the test terminal pool (S120).

The test management server 100 receives, from the developer terminal 300, a test request including at least one test application and scripts in which an interaction execution operation through the test application is defined (S130). Each script may include execution actions written for an interaction test between terminals, and an execution environment of the test application, test items of the test application, test procedures, information recorded during execution, information recorded during error, etc. may be defined. . For example, the scripts may include a server-side script and a client-side script for testing an interaction between the server terminal and the client terminal. The scripts may include a first client-side script and a second client-side script for testing an interaction between the first client terminal and the second client terminal. The scripts may include a plurality of scripts for a 1:N interaction test between a server terminal and a plurality of client terminals.

The test management server 100 checks the test applications and scripts requested to be tested, and selects a terminal group that can be tested by executing the test application and script based on terminal information registered in the test terminal pool (S140). The test management server 100 may select a terminal according to a role (eg, a receiving terminal, an outgoing terminal) to be tested by each script, and may provide a script corresponding to the role of each terminal.

The test management server 100 transmits the test application and scripts to the selected terminal group (S150). The test management server 100 may transmit the script according to the role of the test terminal belonging to the terminal group.

The test management server 100 transmits a script execution command to at least some test terminals of the selected terminal group (S160). For example, in the case of a 1:N interaction test between a server terminal and a plurality of client terminals, the test management server 100 may sequentially transmit a script execution command to the client terminals. Alternatively, in the case of an interaction test between a server terminal and a client terminal or an interaction test between a client terminal and a client terminal, the test management server 100 may transmit a script execution command to the two terminals.

The test management server 100 receives execution results from the selected terminal group (S170).

The test management server 100 provides test results including execution results to the developer terminal 300 (S180). The test management server 100 may provide the test result in response to the test request.

5 is a flowchart of a method for a test terminal to test an application according to an embodiment.

Referring to FIG. 5 , the terminal 200a installs a test management program and transmits a test terminal registration request including its own terminal information to the test management server 100 ( S210 ).

The terminal 200a receives the test application and the script from the test management server 100 (S220). The script may include execution actions written for testing the interaction between terminals, and an execution environment of the test application, a test item of the test application, a test procedure, information recorded during execution, information recorded in case of an error, etc. may be defined.

The terminal 200a receives a script execution command from the test management server 100 (S230).

The terminal 200a operates the test application according to the script, and obtains execution results of the test application (S240). The operation information of the test application is stored as program information in the memory, and may include controls and control properties constituting a screen (UI) of the application. Accordingly, the terminal 200a may check the execution result including the test success/failure of the test application, the result text, or the presence or absence of the execution result control, based on the UI control and control properties confirmed by the program information. Here, the UI is a combination of controls composing the screen, and each control has a unique name and unique ID, so that the executed control can be checked.

The terminal 200a transmits the execution results to the test management server 100 (S250).

The terminal 200a checks the name of the test application or the package name in the script, and brings information about the executed program as the package name from the memory. The terminal 200a may check information of a control for which an execution result is to be confirmed from program information, and may check test success/failure based on the control information. Control information may include an object name (class name) and a control name (name property) among object properties. The terminal 200a may transmit an execution result including test success/failure of the test application, result text, or the presence or absence of an execution result control to the test management server 100 .

For example, when the test function is text output, the terminal 200a may check the text property of the corresponding control to determine whether it matches the result input in the script. Although the test function is text output, the terminal 200a is variable, and when it is used as an input value for another control, input the corresponding value to another control and perform other interaction actions such as clicking a button, and then check the execution result to obtain the expected result and You can check if it is correct. When the test function is a specific control exposure, the terminal 200a may check the execution result in the presence or absence of the searched control information.

When the test function does not operate properly or an error occurs, the terminal 200a may complete the test as a failure or move on to the next test function according to a script. For example, if there is no process for failure in the script, the terminal 200a may complete all tests as failures. When the test function is text output and the actual result is different from the script result, the terminal 200a checks the error content output on the screen and clicks the Previous button to skip the test on the corresponding screen. When there are several values to be input and only the results for some input values can be received, the terminal 200a may store both the success result and the error content and proceed to the next test. If it is not possible to move on to the next test, the terminal 200a re-enters one of the successful values to execute the function, then moves on to the next test or moves to the initial screen, and then proceeds with the next screen test. . When the terminal 200a cannot proceed with the next screen test, all subsequent tests may be completed as execution failure. When the program supports response to failure, the terminal 200a may call help, touch a specific control or change a screen to a previous screen, and then continue another test.

6 is a configuration diagram of a test management server according to an embodiment.

Referring to FIG. 6 , the test management server 100 may include a processor 110 that executes instructions of a computer program, a memory 120 , a storage device 130 , and a communication interface 140 , and via a bus can be connected A computer program includes instructions described to carry out the operations of the present disclosure. The computer program may be stored in a non-transitory computer readable storage medium.

The processor 110 is a device for controlling the operation of the test management server 100 , and may be various types of processors that process instructions included in a computer program, for example, a CPU (Central Processing Unit), MPU (Micro). processor unit), microcontroller unit (MCU), graphic processing unit (GPU), or the like.

The memory 120 stores various data, commands and/or information. The memory 120 may load a corresponding computer program from the storage device 130 so that the instructions described to execute the operations of the present disclosure are processed by the processor 110 . The memory 120 may be, for example, read only memory (ROM), random access memory (RAM), or the like. The storage device 130 may store various data, computer programs, etc. required to execute the operations of the present disclosure. The storage device 130 may non-temporarily store a computer program. The storage device 130 may be implemented as a non-volatile memory. The test terminal pool for storing information of the registered test terminals, the test application and script received from the developer terminal, and the execution results received from the test terminals may be stored in a designated place of the storage device 130 .

The communication interface 140 may be a wired/wireless communication module.

A computer program including instructions for executing an operation of the present disclosure is stored in a medium readable by a computing device, and the medium readable by the computing device may be a removable recording medium or a fixed recording medium. The computer program may be transmitted to another computing device through a network, such as the Internet, and installed and executed in the other computing device.

The processor 110 executes instructions of a computer program loaded into the memory 120 , which includes instructions described to execute the operations of the present disclosure.

The processor 110 may receive the test terminal registration request, check terminal information included in the test terminal registration request, and register the test terminals in the test terminal pool. The processor 110 receives a test request including at least one test application and scripts in which an interaction execution operation through the test application is defined, checks the test-requested test application and scripts, and then a terminal registered in the test terminal pool Based on the information, it is possible to select a terminal group that can be tested by executing test applications and scripts. The processor 110 may transmit a test application and scripts to the selected terminal group and transmit a script execution command to at least some test terminals of the selected terminal group. The processor 110 may receive execution results from the selected terminal group and provide a test result including the execution results to the developer who requested the test.

The computer program installed in the test management server 100 may include the following instructions, and may be stored in a non-transitory computer readable storage medium.

The computer program may include a command for receiving a test terminal registration request, a command for checking terminal information included in the test terminal registration request, and a command for registering test terminals in a test terminal pool. The computer program includes at least one test application, a command for receiving a test request including scripts in which an interaction execution operation through the test application is defined, a command for checking the requested test application and scripts, and a terminal registered in the test terminal pool Based on the information, a command to select a terminal group that can be tested by executing the test application and scripts, a command to transmit the test application and scripts to the selected terminal group, and a script execution command to at least some test terminals of the selected terminal group may include a command to transmit The computer program may include a command for receiving execution results from the selected terminal group and a command for providing a test result including the execution results to the developer who requested the test.

7 is a configuration diagram of a test terminal according to an embodiment.

Referring to FIG. 7 , the test terminal 200 may also include a processor 210 for executing instructions of a computer program, a memory 220 , a storage device 230 , a communication interface 240 , and a display 250 . and may be connected via a bus. The computer program includes instructions described to execute the operations of the present disclosure, and may include a test management program and various test applications and scripts. The computer program may be stored in a non-transitory computer readable storage medium.

The test application includes instructions that are described to operate in order to provide a service. The test application may be controlled by the test management program.

The test management program may include a command for collecting terminal information and a command for transmitting a test terminal registration request including the terminal information to the test management server. The test management program includes a command for receiving a test application and script and installing the test application, a command for receiving a script execution command, a command for operating the test application according to the script, a command for obtaining execution results of the test application, and a test It may include a command to transmit execution results to the management server.

Specifically, the test management program is installed in the terminal selected by the test management server 100, and includes instructions described so that the processor executes the operation of the present disclosure. The test management program may be stored in a non-transitory computer readable storage medium. For example, the test management program 30 of FIG. 2 is executed by the processor of the terminal 200a, operates the test application according to the script, and after obtaining the execution results of the test application, the test management server 100 Contains instructions that send execution results to

The test management program executed by the processor may operate as follows.

The test management program clicks a button at the location specified in the script in the test application or enters an input value in the input window. Thereafter, the test management program reads the result output on the screen of the terminal.

Specifically, the test management program brings the name of the test application or package name from the script, and brings the executed program information as the package name from memory. The program information is information that exists in a memory when the processor executes a test application, and may include UI controls and control properties.

The test management program brings the information of the control to check the execution result from the program information. Control information may include an object name (class name) and a control name (name property) among object properties. If the test management program can bring the control information by the control name, it brings the control information to the corresponding name from the program information. The properties of the control have a name property indicating the name and a text property to be displayed on the screen. On the other hand, if the test management program cannot bring control information by object name, it checks all the control lists by the class name of the control, and checks all the control names among the object properties of the control list. You can bring control information.

The test management program can check the test success/failure based on the control information. For example, if the test function is a text output, the test management program may check the text property of the corresponding control to see if it matches the result input in the script. In the test management program, if the test function is a test output but variable, and is used as an input value of another control, the value is input to another control and other interaction actions such as clicking a button are performed, then the execution result is checked and the expected result is You can check if it is correct. The test management program may check the execution result in the presence or absence of the retrieved control information when the test function is a specific control exposure.

If the test function does not work properly or an error occurs, the test management program may either complete the test as a failure or move on to the next test function according to the script. For example, if there is no handling for failure in the script, the test management program may complete the tests as all failures. In the test management program, if the test result is text output and the script result and the actual result are different, check the error content displayed on the screen and click the Previous button to skip the test on the screen. In the test management program, when there are several values to be input and only the results for some input values can be received, the test management program can store both the success result and the error content and move on to the next test. If it is impossible to move on to the next test, the test management program may execute a function by re-entering one of the successful values, then move on to the next test or move to the initial screen, and then proceed with the next screen test. If the test management program cannot proceed with the next screen test, all subsequent tests may be completed as execution failure. If the program supports the response to failure, the test management program can call help, touch a specific control or change the screen to the previous screen, and then continue other tests.

The test management program may transmit an execution result including test success/failure of the test application, result text, or presence or absence of an execution result control to the test management server 100 .

Alternatively, the test management server 100 may read the execution result of the test application executed according to the script from the test terminal, and check the success/failure of the test application, the result text, or the presence or absence of an execution result control.

As described above, according to the embodiment, the interaction function of the application can be automatically tested with a script separate from the application, so that a test environment independent of the application can be built, the interaction function can be simultaneously checked on terminals, and the function of the application When this is added or changed, you can change the script to test the added or changed functionality.

According to the embodiment, since the terminal screen information is recorded as the execution result, the developer can intuitively check the test result through the execution result in which the terminal screen information is recorded, without the need to analyze the log file in which the execution result is recorded in the terminal. can

According to an embodiment, when the developer registers the test target application and the scripts in which the interaction execution operation of the application is defined in the test management server, the terminal selected in the test management server executes the script in which the execution operation of the application is defined. It can be obtained from the management server. Therefore, according to the embodiment, the developer does not need to build a test environment to install and test the application in the terminal, and without the need to go through a complicated test process, the application can be implemented with only a simple procedure of registering the scripts in which the interaction execution operation of the application is defined. can be tested

The embodiments of the present disclosure described above are not implemented only through apparatus and methods, and may be implemented through a program for realizing a function corresponding to the configuration of the embodiment of the present disclosure or a recording medium in which the program is recorded.

Although the embodiment of the present disclosure has been described in detail above, the scope of the present disclosure is not limited thereto, and various modifications and improved forms of the present disclosure are also provided by those skilled in the art using the basic concept of the present disclosure as defined in the following claims. is within the scope of the right.

Claims (11)

As a method of operating a test management server,
Receiving a test terminal registration request including terminal information of terminals;
storing the terminal information of the terminals in a test terminal pool;
Receiving a test request including at least one test application and scripts in which an interaction execution operation through the test application is defined;
selecting, as a terminal group, test terminals capable of executing the test application according to each of the scripts based on terminal information stored in the test terminal pool;
transmitting the test application and a specified one of the scripts to the test terminals; and
Receiving execution results of executing the test application according to the transmitted script from the test terminals
operation method comprising In claim 1,
The step of selecting the test terminals as a terminal group is
An operation method of selecting a test terminal to perform the role from the test terminal pool according to a role tested by each script. In claim 2,
The step of transmitting a specified script among the scripts is
The operation method of sending the script corresponding to the role to each test terminal. In claim 2,
The scripts include a calling-side script and a receiving-side script for testing the call function of the test application,
The sender script is transmitted to a test terminal serving as a sender,
The receiving-side script is transmitted to a test terminal serving as a receiver, the operating method. In claim 1,
Receiving the execution result is
Transmitting a script execution command to at least some of the test terminals, and receiving an execution result of executing the test application according to the transmitted script from the test terminals receiving the script execution command . In claim 1,
The test terminal registration request is
Receiving from a terminal in which the test management program is installed, an operating method. In claim 1,
The terminal information is
A method of operation, comprising software information and hardware information required for application testing. In claim 1,
The scripts are
Includes a server-side script and a client-side script for testing the interaction between the server terminal and the client terminal, or
a first client-side script and a second client-side script for testing an interaction between the first client terminal and the second client terminal, or
A method of operation comprising a plurality of scripts for a 1:N interaction test between a server terminal and a plurality of client terminals. In claim 1,
providing a test result including the execution results in response to the test request;
An operation method further comprising a. As a method of operating a terminal,
Installing a test management program and transmitting a test terminal registration request including terminal information to the test management server;
receiving test applications and scripts from the test management server;
operating the test application according to the script and obtaining execution results of the test application; and
transmitting the execution results to the test management server
Including, a method of operation. In claim 10,
The step of obtaining the execution results is
An operation method of confirming information of a control constituting a screen of the application from operation information of the test application operated according to the script, and confirming execution results of the test application based on the information of the control.

Images