KR102173137B1 - Method for providing remote test service for mobile application - Google Patents

Abstract

Provided is a method for providing a remote test service of a mobile application, which comprises the steps of: displaying an execution screen of a previously stored test application program, when connecting from a client; receiving the selection of information on a model of at least one test terminal and an operating system (OS) from the client; receiving the setting of the time to execute the test application program in the at least one test terminal from the client; and controlling the test application program to be executed in the at least one test terminal at the set time.

Description

How to provide remote test service for mobile applications {METHOD FOR PROVIDING REMOTE TEST SERVICE FOR MOBILE APPLICATION}

The present invention relates to a method for providing a remote test service for a mobile application, and provides a platform for testing a mobile application using test terminals having different models and OSs.

In software development, software testing is a costly task that accounts for a majority of the total software development cost. The high cost required for software testing indicates that software testing is a very large part of the software development process. Testing is the activity of discovering defects inherent in software by creating test cases based on system requirements. In order to perform testing effectively, first, a good test plan must be established and faithful test cases must be generated. In other words, a clear plan for the test target, target, method, environment, procedure, etc., and test cases that can faithfully implement these plans must be developed. Second, you need to monitor whether the test is performing well according to the test plan you have written. Many studies related to testing suggest test automation methods, but most of them focus on the automation method from test case generation to test execution.

At this time, a configuration for testing and monitoring the app was researched and developed. In this regard, Korean Patent Publication No. 2015-0019684 (published on February 25, 2015) and Korean Patent Publication No. 2019-0120983 (published on February 25, 2015), which are prior art. October 25), in order to test the execution of the application on the test terminal, a data processing unit configured to communicate with a plurality of electronic terminals, a data processing unit configured to communicate with a user terminal, and to store terminal information of each of the plurality of electronic terminals. Including a management unit configured, the data processing unit is a configuration for testing an application on the test terminal based on the terminal mode of the electronic terminal requested to be used among a plurality of electronic terminals that are test terminals, and communicating with the terminal for app testing It includes a control unit that receives test-related information from the communication unit and the terminal under test of the app, filters the received information according to a preset driving condition to provide a driving situation of the app, and the control unit displays activity details according to the execution of the app. Disclosed is a configuration in which at least one condition of information on a state, an operating system version of a terminal, a terminal type of a terminal, and information about a terminal access area is set as a driving condition for filtering.

However, even if the above-described configuration is used, a method of automatically performing test monitoring itself remotely is not disclosed. In order to automate test monitoring, it is necessary to be able to observe the test activity. In order to observe the test activity without user intervention, the test monitoring system must be able to process various outputs generated from the test activity. However, in general, the outputs of the test activities are not in a form that can be read and processed by a computer, so test monitoring is performed based on the progress information of the test activities manually inputted by testers or developers participating in the test activities. Accordingly, research and development of a test monitoring automation platform for test monitoring automation is required.

According to an embodiment of the present invention, in a client and server structure, the server transmits and installs an application test application to at least one client, displays a remote test execution screen when the client connects to the server, and displays each model of the test terminal. You can select the Android or iOS version for each, and if you set a test time or set a test reservation, the test is performed at the set time, but the test terminal in which the test is in progress is displayed in color on the client screen to intuitively control the test terminal being tested from the outside. Remote of mobile application, which can provide a test monitoring automation platform for test monitoring automation remotely by providing a test monitoring automation platform for test monitoring automation by delivering the result report to the user after the test progress and charging according to the use time when the use is terminated. A method of providing test services can be provided. However, the technical problem to be achieved by the present embodiment is not limited to the technical problem as described above, and other technical problems may exist.

As a technical means for achieving the above-described technical problem, an embodiment of the present invention provides a step of displaying an execution screen of a pre-stored test application program when connected from a client, the model and OS of at least one test terminal from the client. (Operating System) includes the step of receiving selection of information, receiving setting a time to execute a test application program in at least one test terminal from a client, and controlling the test application program to be executed in at least one test terminal at a set time. .

According to any one of the problem solving means of the present invention described above, in the client and server structure, the server transmits and installs an application test application to at least one client, and displays a remote test execution screen when the client connects to the server. , Select the Android or iOS version for each model of the test terminal.If you set the test time or test reservation, the test is performed at the set time, but the test terminal in which the test is in progress is displayed in color on the client screen, so it is intuitive from the outside The test monitoring automation platform can be provided for test monitoring automation remotely by allowing the user to identify the test terminal under test, and by delivering the result report to the user after the test is completed and charging according to the usage time when the use is terminated. have.

1 is a diagram illustrating a system for providing a remote test service for a mobile application according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a remote test service providing server included in the system of FIG. 1.
3 and 4 are diagrams for explaining an embodiment in which a remote test service of a mobile application is implemented according to an embodiment of the present invention.
5 is a flowchart illustrating a method of providing a remote test service for a mobile application according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement the present invention. However, the present invention may be implemented in various different forms and is not limited to the embodiments described herein. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and similar reference numerals are assigned to similar parts throughout the specification.

Throughout the specification, when a part is said to be "connected" to another part, this includes not only "directly connected" but also "electrically connected" with another element interposed therebetween. . In addition, when a part "includes" a certain component, it means that other components may be further included, and one or more other features, not excluding other components, unless specifically stated to the contrary. It is to be understood that it does not preclude the presence or addition of any number, step, action, component, part, or combination thereof.

The terms "about", "substantially" and the like, as used throughout the specification, are used in or close to the numerical value when manufacturing and material tolerances specific to the stated meaning are presented, and are used in the sense of the present invention. To assist, accurate or absolute figures are used to prevent unfair use of the stated disclosure by unscrupulous infringers. As used throughout the specification of the present invention, the term "step (to)" or "step of" does not mean "step for".

In the present specification, the term "unit" includes a unit realized by hardware, a unit realized by software, and a unit realized using both. Further, one unit may be realized using two or more hardware, or two or more units may be realized using one hardware. Meanwhile,'~ unit' is not meant to be limited to software or hardware, and'~ unit' may be configured to be in an addressable storage medium or configured to reproduce one or more processors. Thus, as an example,'~ unit' refers to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and procedures. , Subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays and variables. The components and functions provided in the'~ units' may be combined into a smaller number of elements and'~ units', or may be further divided into additional elements and'~ units'. In addition, components and'~ units' may be implemented to play one or more CPUs in a device or a security multimedia card.

In this specification, some of the operations or functions described as being performed by the terminal, device, or device may be performed instead in a server connected to the terminal, device, or device. Likewise, some of the operations or functions described as being performed by the server may also be performed by a terminal, device, or device connected to the server.

In this specification, some of the operations or functions described as mapping or matching with the terminal means mapping or matching the unique number of the terminal or the identification information of the individual, which is the identification information of the terminal. Can be interpreted as.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a diagram illustrating a system for providing a remote test service for a mobile application according to an embodiment of the present invention. Referring to FIG. 1, a system 1 for providing a remote test service of a mobile application includes at least one client 100, a remote test service providing server 300, at least one test terminal 400, and at least one user terminal. It may include 500. However, since the remote test service providing system 1 of the mobile application of FIG. 1 is only an embodiment of the present invention, the present invention is not limitedly interpreted through FIG. 1.

In this case, each component of FIG. 1 is generally connected through a network 200. For example, as shown in FIG. 1, at least one client 100 may be connected to a remote test service providing server 300 through a network 200. In addition, the remote test service providing server 300 may be connected to at least one client 100, at least one test terminal 400, and at least one user terminal 500 through the network 200. In addition, at least one test terminal 400 may be connected to the remote test service providing server 300 through the network 200. In addition, at least one user terminal 500 may be connected to at least one client 100, a remote test service providing server 300, and at least one test terminal 400 through the network 200.

Here, the network refers to a connection structure in which information exchange is possible between respective nodes such as a plurality of terminals and servers, and examples of such networks include a local area network (LAN) and a wide area communication network (WAN: Wide Area Network), Internet (WWW: World Wide Web), wired/wireless data communication network, telephone network, wired/wireless television communication network, etc. Examples of wireless data networks include 3G, 4G, 5G, 3GPP (3rd Generation Partnership Project), 5GPP (5th Generation Partnership Project), LTE (Long Term Evolution), WIMAX (World Interoperability for Microwave Access), and Wi-Fi. , Internet, LAN(Local Area Network), Wireless LAN(Wireless Local Area Network), WAN(Wide Area Network), PAN(Personal Area Network), RF(Radio Frequency), Bluetooth(Bluetooth) network, NFC( Near-Field Communication) network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) network, etc. are included, but are not limited thereto.

In the following, the term “at least one” is defined as a term including the singular number and the plural number, and even if the term “at least one” does not exist, each component may exist in the singular or plural, and may mean the singular or plural. It will be self-evident. In addition, it will be possible to change according to the embodiment that each component is provided in a singular or plural.

The at least one client 100 may be a terminal of a developer or programmer requesting a test of a mobile application using a web page, an app page, a program, or an application related to a remote test service of the mobile application. At this time, at least one client 100 is a server-client structured client, and the developer has developed an application, but provides a remote test service when the test terminal 400 to be developed cannot be found or cannot be found, or additional tests are required. It may be a terminal that requests a remote connection of the test terminal 400 to the server 300. In addition, the at least one client 100 may be a terminal that selects the model and OS information of the test terminal 400 to be tested and runs the developed mobile application online. In addition, the at least one client 100 may be a terminal that monitors the progress of the test in the test terminal 400 at a remote location, and when the use is terminated, the amount of the use time is transferred to the remote test service providing server 300 It may be a payment terminal. Further, the at least one client 100 may be a terminal that receives the test result from the remote test service providing server 300 in a log format or a test result report format. In addition, the at least one client 100 may be a terminal that applies for connection to a beta tester, selects a beta tester, and collects test results when a model or terminal to be tested is required or omitted.

Here, the at least one client 100 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, a navigation system, a notebook equipped with a web browser, a desktop, a laptop, and the like. At this time, at least one client 100 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one client 100, for example, as a wireless communication device that is guaranteed portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, CDMA (Code Division Multiple Access)-2000, W-CDMA (W-Code Division Multiple Access), Wibro (Wireless Broadband Internet) It may include all types of handheld-based wireless communication devices such as terminals, smartphones, smart pads, and tablet PCs.

The remote test service providing server 300 may be a server that provides a remote test service web page, an app page, a program, or an application of a mobile application. In addition, the remote test service providing server 300 may be a server that provides a platform so that an online test can be performed when an individual or a small and medium developer requests a test because the type of terminal to be tested and the OS type are insufficient. To this end, the remote test service providing server 300 may be a server that maps and stores model and OS information of at least one test terminal 400 with an identification code or an identification code of at least one test terminal 400, and , When a test request is made by the client 100, the device type and OS information to be tested are received, or when all are selected, the test can be performed so that the mobile application of the client 100 is driven in all test terminals 400. It could be a server. In addition, the remote test service providing server 300 is a server that provides UI/UX so that the client 100 can check the test progress status, elapsed time, test completion, progress, etc. of each test terminal 400 It may be a server that allows you to set a reservation when the process is completed. In addition, the remote test service providing server 300 may be a server that charges a fee based on a usage time when the test is completed in selected or all test terminals 400. In this case, the remote test service providing server 300 may be a server that individually charges for the model, OS, and usage time of the used test terminal 400. In addition, the remote test service providing server 300 may be a server that transmits the test result to the client 100. If the client 100 requests a beta tester connection, it may be a server that selects a beta tester having a model or OS other than the model or OS of the tested test terminal 400 and performs the test.

Here, the remote test service providing server 300 may be implemented as a computer capable of accessing a remote server or terminal through a network. Here, the computer may include, for example, a navigation system, a notebook equipped with a web browser, a desktop, a laptop, and the like.

The at least one test terminal 400 may be a terminal that drives a mobile application of the client 100 by using a web page, an app page, a program, or an application related to a remote test service of the mobile application. At this time, the at least one test terminal 400 may transmit the process as a log to the remote test service providing server 300 while driving to correspond to the test scenario, and generate a screen as a video based on the point where an error occurs. It may be a terminal that shares the screen with the remote test service providing server 300 so that it can be performed. In addition, the at least one test terminal 400 shares whether or not the mobile application is running with the remote test service providing server 300, and which test terminal 400 is running or in an idle state in which operation is possible in the client 100. , If it is running, the elapsed time may be a terminal that shares the elapsed time with the remote test service providing server 300, and based on this, a terminal providing a reference value to calculate the usage fee in the remote test service providing server 300 Can be

Here, at least one test terminal 400 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, a navigation system, a notebook equipped with a web browser, a desktop, a laptop, and the like. In this case, the at least one test terminal 400 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one test terminal 400, for example, as a wireless communication device that is guaranteed portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) It may include all kinds of handheld-based wireless communication devices such as terminals, smart phones, smart pads, and tablet PCs.

At least one user terminal 500 receives a beta tester request from the remote test service providing server 300 using a web page, app page, program, or application related to the remote test service of the mobile application and transmits acceptance or rejection. It may be a terminal of the general public. At this time, when the user terminal 500 accepts the beta tester, it is connected to the remote test service providing server 300 at idle time of the user terminal 500, for example, early morning time, and forcibly wake-up and test can be performed. The result may be a terminal shared with the remote test service providing server 300 in the same manner as the test terminal 400. The user terminal 500 may be a terminal controlled by the remote test service providing server 300 to automatically delete a test application program installed for testing and delete all related data when testing is terminated.

Here, the at least one user terminal 500 may be implemented as a computer that can access a remote server or terminal through a network. Here, the computer may include, for example, a navigation system, a notebook equipped with a web browser, a desktop, a laptop, and the like. In this case, the at least one user terminal 500 may be implemented as a terminal capable of accessing a remote server or terminal through a network. At least one user terminal 500, for example, as a wireless communication device that is guaranteed portability and mobility, navigation, PCS (Personal Communication System), GSM (Global System for Mobile communications), PDC (Personal Digital Cellular), PHS(Personal Handyphone System), PDA(Personal Digital Assistant), IMT(International Mobile Telecommunication)-2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), Wibro(Wireless Broadband Internet) ) It may include all kinds of handheld-based wireless communication devices such as terminals, smart phones, smart pads, and tablet PCs.

FIG. 2 is a block diagram illustrating a remote test service providing server included in the system of FIG. 1, and FIGS. 3 and 4 are an embodiment of implementing a remote test service of a mobile application according to an embodiment of the present invention. It is a figure for explaining.

Referring to FIG. 2, the remote test service providing server 300 includes a display unit 310, a selection unit 320, a setting unit 330, a control unit 340, an output unit 350, an installation unit 360, A billing unit 370, a time alarm unit 380, and an omission alarm unit 390 may be included.

The remote test service providing server 300 according to an embodiment of the present invention or another server (not shown) operating in conjunction with at least one client 100, at least one test terminal 400, and at least one user When transmitting a remote test service application, program, app page, web page, etc. of a mobile application to the terminal 500, at least one client 100, at least one test terminal 400, and at least one user terminal ( 500) may install or open a remote test service application, program, app page, web page, etc. of the mobile application. In addition, a service program may be driven in at least one client 100, at least one test terminal 400, and at least one user terminal 500 by using a script executed in a web browser. Here, the web browser is a program that allows you to use the Web (WWW: World Wide Web) service, which means a program that receives and displays hypertext described in HTML (Hyper Text Mark-up Language). For example, Netscape , Explorer, Chrome, etc. In addition, the application refers to an application program on the terminal, and includes, for example, an app running on a mobile terminal (smartphone).

Referring to FIG. 2, the display unit 310 displays an execution screen of a previously stored test application program when connected from the client 100. For example, an individual or an app developer may perform basic tests or pretests using a few mobile phones of employees or their own, but it is necessary to catch errors that may occur while running on hardware/software in various environments. There may be a project to do, but at this time, it is not possible to have a few dozen or hundreds of mobile phones for one test, and each large company has more than 20 new products released a year, and the purchase cost is a price of 1 million won per unit. In reality, it is very difficult for small developers or individual developers to bear. Accordingly, when the client 100 requests a test of the mobile application, the display unit 310 installs and runs the test application and executes the test application. Allows you to test the developed application.

The selection unit 320 may receive a selection of a model and operating system (OS) information of at least one test terminal 400 from the client 100. The selection unit 320, when receiving the model and operating system (OS) information of the at least one test terminal 400 from the client 100, at least one test terminal located in the cell corresponding to the XY coordinates or XYZ coordinates The identification code of 400 and XY coordinates or XYZ coordinates can be mapped and stored, and model and OS information of at least one test terminal 400 in a cell corresponding to XY coordinates or XYZ coordinates on the screen of the client 100 You can choose For example, in column 1, S company's 2018 release model, S company's 2019 release model in column 2, and column 3 are 2020 release models, to visualize which model and OS the tester will select. At this time, the connection between the client-server-test terminals is established, but each test terminal 400 can be selected in a space consisting of a matrix or three dimensions so that the client 100 intuitively executes a desired test. For example, it is possible to provide the same effect as directly viewing the test terminal 400 in a manner in which the icon of the corresponding model and the OS and specifications are briefly described thereon.

In this case, the selection unit 320 may select only a specific test terminal 400 to be tested by the client 100 or may be tested by all the test terminals 400 that exist. In this case, the selection unit 320 may automate the construction and execution of a test environment based on abundant resources in a virtual environment so that cloud testing can be performed in the client 100. When using the test management method in a cloud-based network, test tools can be defined or provided for selection using the test API. The configured test tool is built in an individual cloud virtual environment allocated by the test management system, and may be provided so that the user can manage test activities in the provided cloud environment. In the case of using D-Cloud, if you input files such as test scenarios, environment setting scripts, and test data that reflect the intention of the tester (client, developer) into D-Cloud, a distributed system suitable for the conditions received from the cloud system controller called Eucalyptus You can also build a test environment and provide the tester with the results of performing tests. All of these can provide convenience by configuring a cloud-based TaaS (Testing as a Service) environment.

At this time, in the case that repetitive testing is required, such as regression testing, a new test environment is constructed at every time a test request is received even in the same test environment, so continuous testing to solve the problem of scalability and reusability while taking advantage of the accessibility of cloud. You can also use the platform. In continuous testing, DevOps' IaC technology can be used, and test infrastructure construction and execution can be written and operated in code. When using the CAP (Cloud Acceleration Program) framework, it is a method for automation of CI (Continuous Integration), CT (Continuous Testing), and CD (Continuous Delivery/Deployment). ) Method can also be applied.

You can also use CI, CT, and CD automation methods using some programs such as Jenkins CI server, Sonar test tool, and Maven in an AWS cloud-based environment using CIDD (Continuous Integration, Deployment and Delivery automation). Like cloud testing, CAP and CIDD studies are based on virtual environments, so they are efficient in resource management, and also have the efficiency of environment management by using IaC technology that automates environment construction, testing, and deployment with code. In order to reduce the expertise in general cloud and continuous testing and minimize user intervention, a method of replacing and providing the environment building code with a template can also be used. To simplify cloud environment deployment, CDL (Component Description Language) and TDL (Template Design Language) A template may be defined using, and a user (a tester, who is not a user of the user terminal 500) may receive a cloud environment by filling in a required setting value in the corresponding template code. In addition, the structure of the infrastructure is defined as an abstract model using ARGON (An infRastructure modeling tool for clOud provisioNing), and a script code is generated by receiving required environmental elements and relationship settings from the user, and then provided to the cloud environment. May be. Meanwhile, in order to simulate the fault tolerance environment using the reader selection algorithm, a method of verifying whether the reader selection algorithm is operating correctly by simulating a computer node with a Docker and executing the interaction between nodes in a docker environment is used. May be. Of course, it will be apparent that various methods and algorithms may be used in addition to the above-described algorithms and methods, and are not limited to those listed and are not excluded for reasons not listed.

The setting unit 330 may receive a time set by the client 100 to execute a test application program in at least one test terminal 400. When the setting unit 330 sets the time to execute the test application program in at least one test terminal 400 from the client 100, the time when the test application program is executed when at least one test terminal 400 is currently being tested You can make a reservation.

At this time, in order to perform test monitoring, it must be possible to determine whether the actual test execution process and contents match in light of the test plan. To make it easier for users (testers) to perform test monitoring, a tool that automatically performs test monitoring can be used. For example, Rational Quality Manager (RQM) is a web-based collaboration tool that provides extensive test planning, test creation, and test deliverable management capabilities throughout the software development lifecycle. Based on the test plan entered by the user, it supports the activities of the team performing tests at all stages of the test project. At this time, RQM is a process of manually inputting all of the start and end conditions, test cases, resources, etc. when the user creates a test project and performs the test for the first time, and the test result must also be input by the user. I can. Meanwhile, NEXCORE Test Manager provides an environment in which tests can be planned, designed, and executed according to the software project strategy. In addition, it provides an environment for allocating defects that occurred in the process of performing tests to developers, analyzing the causes of defects, and monitoring progress at all times. In this tool, the tester registers test scenarios and cases in the tool, and the test manager allocates it to a tester in charge of performing the registered test cases. In addition, the tester must directly record the test results, and it may be premised on the process of finding and registering defects.

The setting unit 330 can be set so that the client 100 does not manually input the test plan in the form of a document, and when the user creates a test plan through the UI, it is saved as an XML test plan and automatically read by the computer. have. That is, the tester may manually set the settings through the client 100 as in the two methods described above, but the test schedule definition, test resource allocation, and test progress monitoring can be prepared using the read test plan information. have. In addition, it can be set to automatically analyze the log information of the test result to determine the progress and to perform the test performance analysis. Accordingly, the client 100 may set or reserve only the use time, and the result may be provided in a report format or a bug report may be received as a log.

In order to build an automation-based test monitoring framework, above all, the monitoring system must be able to process the outputs of various test activities without user intervention. Test plans are mostly written in natural language, so computers cannot automatically recognize the information in the test plan. In addition, most of the information on the test progress was forced to rely on the information entered by the tester, but it is difficult to ensure that accurate test monitoring is performed in this situation. First of all, the test plan created by the tester is described in natural language and cannot be read by the computer, so the user must manually input the test plan information necessary for the test monitoring process. In order to establish the test plan description language, first, it is formalized. You can start by analyzing the standard documents related to the test plan to derive the items of the test plan document. The extracted information may include the purpose of the test, the scope of the test that is actually applied, the test strategy, the test target, the test schedule, the test resource, and the test process. In addition, by grasping the information to be described in the derived item, the information required to perform the test can be extracted. When the user fills in the items of the test plan through the UI, the system can generate the test plan expressed in XML. The test plan created in XML format can be recognized by a computer, so information necessary to build a test monitoring framework can be automatically extracted.

Second, it performs the task of deriving the function for test monitoring. Test monitoring activity is the process of observing the actual test execution process and contents in the light of the test plan. In order to build a meaningful test monitoring framework, it is necessary to grasp the test monitoring function required by the user. To this end, TMMI (Test Maturity Model Integration) as well as existing test monitoring tools can be analyzed to understand the function of test monitoring. Derivable functions may include, for example, monitoring the progress of the test, monitoring the provision and use of test environment resources, monitoring the participation of stakeholders, monitoring the progress of the test phase, checking the start/end of the test, and recording the test performance. However, it is not limited to those listed and is not excluded for reasons not listed.

Monitoring the test progress is necessary to monitor the test progress in terms of the test schedule. You can check the progress by comparing the actual executed schedule with the schedule described in the test plan. Monitoring of the provision and use of test environment resources may be a function to ensure that the test environment and resources that were intended to be provided in the test plan are provided and used correctly in terms of the provided test environment and resources. Monitoring of stakeholder engagement reveals information about stakeholders participating in the test. This allows you to verify that the test participants described in the test plan participate in the actual test execution. Test stage progress monitoring represents the stage of the test currently in progress. Among the test steps described in the test plan, it is possible to check where the currently ongoing test step is located. The test start/end time check is a function that indicates the start time and end time of the test being performed, and can inform the tester of the test execution start time and end time according to the test schedule described in the test plan. The test performance record indicates how many test cases have been covered for the test being performed, information on success and failure test cases, and the like, so that test performance can be checked.

Third, the process of extracting information for test monitoring is performed. Information necessary to perform the functions of test monitoring can be obtained from test plans, test cases, and test results. By deriving information on the test target from the test plan through the items of the test range, it is possible to check what the test target is being performed and whether the user is testing the correct test target. Through the test requirements of the test item, the user can check whether the requirements described in the test plan are satisfied by the test currently being performed. Through the test strategy items, information on test access and test coverage can be identified, and information on which test method is applied and coverage measurement for the test being performed can be checked. Through the schedule item, you can check information about when to perform the test, and indicate which stakeholders and organizations are participating in the test. The environment item indicates the environment and resources provided when performing the test, and through this, the user can check whether the test is being performed according to the test environment described in the test plan, and whether the resource is provided correctly. The progress of the test stage and test performance can be grasped through the test case list information and the number of test cases generated and the pass, failure, and pending information of the test result.

The controller 340 may control the test application program to be executed in at least one test terminal 400 at a set time. If the setting unit 330 automatically sets the source to be tested according to the test plan of the test terminal 400, the controller 340 may proceed with a process of testing the test terminal 400 according to the test scenario. When the UI/UX corresponding to the above-described item is input or uploaded by the client 100, the control unit 340 stores the test plan in an XML format and parses the test plan stored in XML to be a test target, Information such as requirements, test coverage, test schedule, tester, test environment and resources are read.

Through this, the control unit 340 can monitor the provision and use of test environment resources, monitor the participation of stakeholders, and check the start/end timing of the test. Next, the controller 340 reads information on a test case developed by a tester that is a user of the client 100. Subsequently, when a tester or developer performs a test using the prepared test case, the test execution environment generates a test result file. When the test result information such as success, failure, pending, etc. is acquired from the test case list and the total number of test cases applied from the test case information, the test step progress, progress, performance, etc. can be analyzed. You will be able to.

The output unit 350 controls the test application program to be executed in at least one test terminal 400 at a time set by the control unit 340, and then the test application program is being executed in at least one test terminal 400 When the red and test application programs are terminated or not in use, it may be controlled to be displayed in green on the client 100. In addition to this, the output unit 350 may visually provide the test performance analysis result to the user. First, the control unit 340 acquires test schedule information from the test plan, identifies the test task assigned to the tester from the information of a specific tester in the test plan, and divides the schedule by the number of tasks to be tested. As can be derived, the output unit 350 can further derive this information. In addition, the output unit 350 obtains test case list information from the test case information and outputs it through the screen of the client 100, and the test case list and number allocated to the corresponding tester from the test case list information Is identified, the number of test cases is projected to the allocated time per job, information on the number of test cases determined to be successful is obtained from the test result file, and then transmitted to the client 100. Test performance scores can also be provided, which can be provided as a percentage by dividing the number of completed test cases by the total number of test cases and multiplying by 100.

The installation unit 360 allows the display unit 310 to display an execution screen of a previously stored test application when the client 100 accesses it, and then displays at least one test terminal 400 interlocked with the client 100. It is possible to control to install a test application program on at least one registered and registered test terminal 400.

The billing unit 370 controls the test application to be executed in at least one test terminal 400 at a time set by the control unit 340, and then performs a test of the at least one test terminal 400 in the client 100. When finished or when the tests of at least one test terminal 400 are all finished, a cost corresponding to the use time may be charged to the client 100. At this time, the cost of each test terminal 400 may be different depending on the usage time, and the cost of using all the test terminals 400 may be charged, such as a flat rate, but this is a problem with the charging policy, so it can be changed according to the embodiment. It is defined as Here, it will be apparent that it may be possible depending on the amount of use of networking resources and computing resources, and that billing may be performed in various ways.

The time alarm unit 380 controls the test application program to be executed in at least one test terminal 400 at a time set by the control unit 340, and then the test use time or end of the at least one test terminal 400 The time may be output to be monitored on the screen of the client 100.

The omission notification unit 390 receives the model and OS (Operating System) information of the at least one test terminal 400 from the client 100 in the selection unit 320, and then the previously stored model and OS information list and the selected After comparing the model and OS information, the missing list can be extracted and transmitted to the client 100, extracting at least one user terminal 500 having the model and OS information corresponding to the missing list, and the extracted at least one user A beta tester request event may be transmitted to the terminal 500. For example, when mining on the blockchain to help transactions between both parties (branching and creating blocks and connecting), a node registered by volunteering as a beta tester, i.e., a user terminal, such as giving bitcoin as a reward to the miner. With 500, you can add such a reward system. Each user terminal 500 is connected to a network like a block chain to form each node, and a person registered with a private block chain is limited. Because testing is a technology (app) that has not yet been disclosed, you can configure a private blockchain that restricts registration to only those who have a trust relationship. At this time, since most of the users of the user terminal 500 are ordinary people, they do not know how to proceed with the test. Accordingly, the user terminal 100 can set only the authority to access its own terminal and use a method of obtaining a reward in return for using the own terminal (a method of receiving bitcoins).

At this time, it is assumed that the test application program of the present invention is basically installed as the user terminal 500 selected as the beta tester. At this time, the user terminal 500 allows the above-described automatic test to proceed through the test application program at a time when the user does not use the phone, for example, at dawn. That is, the user terminal 500 only lends mobile phone resources and does not perform a human operation. At this time, the user terminal 500 detects the time when its resources are fully available, for example, a pattern, and extracts the time that the user sleeps and does not use, and at this time, the omission notification unit 390 is tested Can be set to proceed. As described above, the test according to the test plan is performed online from a remote location, and after automatically collecting the result, the tested scenario and program are completely deleted from the user terminal 500. In this case, the user terminal 500 may be the same person as the tester of the client 100. For example, users in the same industry can share each other's mobile phones as test phones and manage them with a blockchain. Alternatively, a mobile phone displayed in a new product store may be the user terminal 500. This is because the cell phones on display are fully available after being displayed to customers during the day and after the agency closes in the evening.

Accordingly, when the at least one user terminal 500 responds to the request event as an approval event, the omission notification unit 390 controls to transmit and install a test application, and at least one user terminal 500 When executing a program, the execution situation may be transmitted to the client 100. At this time, the process of automatically executing the test application program from an online remote location is the same as described above, and thus the same contents are not repeated. However, after the test is completed, a process for completely deleting data remaining in the cache or memory and a process of paying the reward to the user terminal 500 may be further added.

The omission notification unit 390 may conclude a contract between the user terminal 500 and the server 300 according to an embodiment of the present invention using a smart contract. After the test is performed on the user terminal 500 and the result is obtained, a pre-set usage fee is provided to the user terminal 500, excluding fees, according to the model, OS, and usage time provided by the user terminal 500. It can be a contract. Smart contracts are Automated Self-Enforced Agreements, a concept that combines the two processes of contract establishment and execution into one by blockchain technology. The technical concept of smart contracts is that transaction records are distributed and stored, decentralized, and shared, and the duplicated ledger is operated and stored, and at the same time, it is a kind of program that automatically executes according to an event that directs the transfer of assets to the ledger. -Driven Program). A smart contract legally requires ① two or more parties, ② related to the transfer of assets from one party to the other, and ③ the implementation is automatic, and once the contract is initiated, It is a contract concept that does not require human intervention. In this respect, a smart contract as an element of contract law is a kind of algorithmic contract, and in an algorithmic contract, one party or both parties promises to use an algorithm to determine whether or not to conclude the contract and conditions.

Since smart contracts are automatically executed without human intervention, they do not value the trust of the parties. Therefore, the problem of contract default, the biggest weakness of the contract, is a kind of so-called conditional nature that is determined not by the credit of the other party, but by the achievement of the programmed conditions. Therefore, in smart contracts, interpreting, judging, and evaluating whether conditions are fulfilled becomes a legally important issue, and conditions can be set based on third-party relationships as described above. Transactions of smart contracts consist of ① writing programming code, ② signing code, ③ storing the block chain, and ④ executing the transaction. The program code executed here and its results are included in the transaction and stored in the form of a database in a block connected by a chain, so that all participants share transaction information, and the transaction details and contract details are distributed without any addition or change. ) Are stored independently of each other. Here, participants sign a contract by linking a wallet address created with public key cryptography with a blockchain and sign an electronic signature. Smart contract transaction is a computer protocol that is designed to make it easy and convenient to execute or verify the execution of a contract on the network, so it can prevent the occurrence of omission of reward settlement or delay in settlement, and obtain test terminals with more diverse resources from users. You will be able to.

Hereinafter, the operation process according to the configuration of the remote test service providing server of FIG. 2 will be described in detail with reference to FIGS. 3 and 4 as examples. However, it will be apparent that the embodiment is only any one of various embodiments of the present invention, and is not limited thereto.

Referring to FIG. 3, (a) the remote test service providing server 300 may receive a test request from the client 100 and provide a list to select a model and OS to be tested. In addition, (b) when the client 100 selectively selects the test terminal 400 or all of them are selected, the selected test terminal 400 wakes up to perform a test of the mobile application of the client 100. And, (c) the elapsed test time or whether or not the test can be monitored in real time from the client 100 through the remote test service providing server 300, and if an error occurs in the test terminal 400, the remote test service The providing server 300 may provide a video recorded on the screen before and after the point in time to the client 100. (d) In addition, the remote test service providing server 300 may provide a time setting function to set a test reservation from the client 100 to the test terminal 400 currently being tested.

On the other hand, since the remote test service providing server 300 cannot cover all models, the test terminal 400 may apply for a beta tester to the user terminal 500 having specifications that the test terminal 400 does not have. You can ask 100). At this time, when the client 100 applies for a beta tester, the remote test service providing server 300 extracts a user terminal 500 having a model or specification or OS that the test terminal 400 does not cover, such as sample collection. After that, the user terminal 500 receives whether or not to accept the beta tester. And, the remote test service providing server 300 (b) remotely controls the test scenario of the mobile application to be driven through the test application to the user terminal 500 that has sent the approval, (c) the result is real-time or periodic. It can be collected and included in the performance test result report.

The matters not described for the method of providing the remote test service of the mobile application of FIGS. 2 to 4 are the same as or easily from the description of the method of providing the remote test service of the mobile application through FIG. Since it can be inferred, the following description will be omitted.

5 is a diagram illustrating a process of transmitting and receiving data between components included in the system for providing a remote test service of the mobile application of FIG. 1 according to an embodiment of the present invention. Hereinafter, an example of a process in which data is transmitted/received between each component will be described with reference to FIG. 5, but the present application is not limitedly interpreted as such an embodiment, and is illustrated in FIG. 5 according to various embodiments described above. It is apparent to those skilled in the art that the process of transmitting and receiving data may be changed.

Referring to FIG. 5, the remote test service providing server displays an execution screen of a previously stored test application program when connected from a client (S5100).

In addition, the remote test service providing server receives the model and OS (Operating System) information of at least one test terminal from the client (S5200), and sets the time to execute the test application program in the at least one test terminal from the client ( S5300).

In addition, the remote test service providing server controls the test application program to be executed in at least one test terminal at a set time (S5400).

The order between the above-described steps S5100 to S5400 is only an example and is not limited thereto. That is, the order of the above-described steps (S5100 to S5400) may be mutually changed, and some of the steps may be executed or deleted at the same time.

The matters not described with respect to the method of providing the remote test service of the mobile application of FIG. 5 are the same as or easily from the description of the method of providing the remote test service of the mobile application through FIGS. 1 to 4 above. Since it can be inferred, the following description will be omitted.

The method for providing a remote test service for a mobile application according to the exemplary embodiment described with reference to FIG. 5 may be implemented in the form of a recording medium including instructions executable by a computer such as an application executed by a computer or a program module. have. Computer-readable media can be any available media that can be accessed by a computer, and includes both volatile and nonvolatile media, removable and non-removable media. Further, the computer-readable medium may include all computer storage media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.

The method for providing a remote test service for a mobile application according to an embodiment of the present invention described above is to be executed by an application basically installed in a terminal (this may include a program included in a platform or an operating system basically installed in the terminal). Alternatively, it may be executed by an application (that is, a program) directly installed on the master terminal by a user through an application providing server such as an application store server, an application, or a web server related to the service. In this sense, the method for providing a remote test service for a mobile application according to an embodiment of the present invention described above is implemented as an application (i.e., a program) installed basically in a terminal or directly installed by a user, and read by a computer such as a terminal. It can be recorded on a recordable medium.

The above description of the present invention is for illustrative purposes only, and those of ordinary skill in the art to which the present invention pertains will be able to understand that it can be easily modified into other specific forms without changing the technical spirit or essential features of the present invention. will be. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present invention is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be interpreted as being included in the scope of the present invention. do.

Claims (10)

In the remote test service providing method executed in the remote test service providing server,
Displaying an execution screen of a previously stored test application program when accessing from a client;
Receiving a model of at least one test terminal and OS (Operating System) information selected from the client;
Comparing a previously stored model and OS information list with the selected model and OS information, extracting a missing list, and transmitting the missing list to the client;
Extracting at least one user terminal having model and OS information corresponding to the missing list;
Transmitting a beta tester request event to the extracted at least one user terminal;
Controlling to transmit and install the test application when the at least one user terminal responds to the beta tester request event as an approval event;
When the at least one user terminal executes the test application program during an idle time of the user terminal, transmitting an execution status to the client;
Receiving from the client at the at least one test terminal a time when the test application is to be executed and when a user creates a test plan through a UI, it is stored as an XML test plan and is automatically read; And
And controlling the test application to be executed in the at least one test terminal at the set time,
The at least one test terminal,
While driving to respond to a test scenario, the driving process is transmitted as a log to the remote test service providing server, and a screen is shared with the remote test service providing server so that a screen can be generated as a video based on an error point,
When executing the test application program in the at least one user terminal during an idle time of the user terminal, transmitting an execution status to the client,
It is connected to the remote test service providing server at idle time of the user terminal to execute a forced wake-up and test application,
Controlling to run the test application program in the at least one test terminal at the set time,
By parsing the test plan in the XML format, information including test targets, requirements, test coverage, test schedule, tester, tester environment and resources are read, and test environment resource provision and use is monitored through the read information. , A method of providing a remote test service of a mobile application, characterized in that it provides monitoring of stakeholder participation and confirmation of test start/end points.
The method of claim 1,
After controlling to execute the test application program in the at least one test terminal at the set time,
Controlling the at least one test terminal to display red when the test application is running and green when the test application is terminated or not being used by the client;
The method of providing a remote test service of a mobile application further comprising.
The method of claim 1,
The step of receiving selection of a model and OS (Operating System) information of at least one test terminal from the client,
Mapping and storing an identification code of at least one test terminal located in a cell corresponding to XY coordinates or XYZ coordinates and the XY coordinates or XYZ coordinates;
Receiving model and OS information of the at least one test terminal in a cell corresponding to XY coordinates or XYZ coordinates on the screen of the client;
That is to be executed by performing, a method for providing a remote test service of a mobile application.
The method of claim 1,
The step of receiving setting a time for executing the test application program in the at least one test terminal from the client,
Receiving a reservation time for executing the test application program when the at least one test terminal is currently being tested;
That includes, a method for providing a remote test service of a mobile application.
The method of claim 1,
After the step of displaying an execution screen of a previously stored test application when accessing from the client,
Registering at least one test terminal linked with the client and controlling to install the test application program in the registered at least one test terminal;
The method of providing a remote test service of a mobile application further comprising.
The method of claim 1,
After controlling to execute the test application program in the at least one test terminal at the set time,
When the client ends the test of the at least one test terminal or when the tests of the at least one test terminal are all finished, charging a cost corresponding to the use time to the client;
The method of providing a remote test service of a mobile application further comprising.
The method of claim 1,
After controlling to execute the test application program in the at least one test terminal at the set time,
Outputting a test use time or an end scheduled time of the at least one test terminal to be monitored on a screen of the client;
The method of providing a remote test service of a mobile application further comprising.
delete delete delete

Images