KR102044068B1 - IoT Service Application Test Method and System using the Remote Control System for Mobile Terminal - Google Patents

Abstract

Provided are a method and a system for testing an IoT service application using a mobile terminal remote control system. Application test method according to an embodiment of the present invention, the server of the system is set so that the external terminal can remotely control the mobile terminal provided in the system to deliver the remote operation by the external terminal to the mobile terminal, the mobile terminal As a result of executing the remote operation, the screen is transmitted to the external terminal, and the mobile terminal installs and executes an application for controlling the external device. As a result, it is possible to easily test the normal operation of the application for mobile terminals of various models / OS at low cost without time and space constraints.

Description

IoT Service Application Test Method and System using the Remote Control System for Mobile Terminal}

The present invention relates to an application test technique, and more particularly, to a method and system for testing an application installed in a mobile terminal for IoT services.

Internet of Things (IoT) devices for smart home implementations, such as smart water purifiers, smart air purifiers, smart TVs and smart light bulbs, must be deployed to customers with IoT service applications that can control them via smartphones. do.

The manufacturer of the IoT device or the developer of the IoT service application needs to test whether the IoT service application is normally executed in the smartphone and whether the IoT device is normally controlled by the IoT service application before deployment of the IoT service application.

Such IoT service application test should be performed for each smartphone model and for each version of the OS (Operating System) even if the same model. This is because IoT service applications operate normally depending on the model and OS version.

However, it is practically impossible for a manufacturer or a developer to perform tests for each model of a smartphone and for each OS version, and thus only a test for a major model smartphone is performed.

Such a low coverage test may not lead to an operation problem of an IoT service application in a specific smartphone or a specific version of the OS in advance, which may lead to complaints from customers using the device and / or the OS.

The present invention has been made to solve the above problems, an object of the present invention, a method for enabling a simple test for a variety of mobile terminals, using a remote control system having a plurality of mobile terminals To provide a method and system for testing IoT service applications.

Application testing method according to an embodiment of the present invention for achieving the above object, the server of the system, setting the mobile terminal provided in the system so that the external terminal can remotely control; Transmitting, by the server, the remote operation contents by the external terminal to the mobile terminal; And transmitting, by the server, the result screen of the remote terminal to the external terminal to the external terminal, wherein the mobile terminal installs and executes an application for controlling the external device.

The mobile terminal installs and executes the application by remote operation by the external terminal, and the application can control the external device according to the remote operation by the external terminal.

Further, the setting step may be set so that the external terminal can remotely control the mobile terminal selected by the external terminal among the plurality of mobile terminals provided in the system.

In addition, the plurality of mobile terminals may include at least one of different models and versions of the installed OS.

In addition, the external terminal may receive and display an image photographing the external device.

The external terminal may display the screen and the captured image of the external device as a result of the mobile terminal executing the remote operation.

In addition, the result screen of the mobile terminal and the captured image of the external device may be used to determine whether the application is normally executed in the mobile terminal and whether the control of the external device by the application is normally performed.

The external terminal may analyze the result screen of the mobile terminal and the captured image of the external device to determine whether the application is normally executed in the mobile terminal and whether the control of the external device by the application is normally performed.

In addition, the mobile terminal installs and executes an application for controlling the external device by the test script, and the application can control the external device by the test script.

On the other hand, according to another embodiment of the present invention, a mobile terminal remote control system, a mobile terminal; And a server configured to remotely control the mobile terminal, to transmit the remote operation contents by the external terminal to the mobile terminal, and to transmit the result screen of the remote terminal to the external terminal. In addition, the mobile terminal installs and executes an application for controlling the external device.

As described above, according to embodiments of the present invention, by remotely manipulating mobile terminals to install an IoT service application, and remotely manipulating an IoT service application to control an IoT device and verify the result, It is easy to test whether the IoT service application is operating properly for mobile terminals.

In particular, according to embodiments of the present invention, an IoT service application developer or an IoT device developer may perform a test using a mobile terminal remote control system without securing various mobile terminals for testing purposes. The remote control system is accessible via the Internet, so there is no time and space constraint for testing, which is advantageous in terms of cost, time and effort.

Furthermore, according to embodiments of the present invention, the sharing of test results is easy, thereby facilitating collaboration among developers, between manufacturers, and even between developers and manufacturers.

1 is a diagram illustrating an IoT service application test system according to an embodiment of the present invention;
2 is a detailed block diagram of the mobile terminal remote control system shown in FIG.
3 is a flowchart provided to explain an IoT service application manual test method according to another embodiment of the present invention;
4 is a diagram illustrating an IoT service application manual test screen;
5 is a flowchart provided to explain an IoT service application automatic test method according to another embodiment of the present invention.

Hereinafter, with reference to the drawings will be described the present invention in more detail.

IoT Service Application Test System

1 is a diagram illustrating an IoT service application test system according to an embodiment of the present invention. IoT service application test system according to an embodiment of the present invention, as shown in Figure 1, PC 100, mobile terminal remote control system 200, IoT server 300, IoT device 400 and IP camera It is built including 500.

The illustrated IoT service application test system utilizes a mobile terminal remote control system 200 having various mobile terminals that can be controlled remotely, and thus, IoT service applications to various mobile terminals remotely through the PC 100. This is a system to install and test for normal operation.

The IoT service application is an application installed in a mobile terminal of a user for controlling the IoT device 400 through the IoT server 300, and the PC 100 is a PC used by an IoT service application developer.

In order to check whether the IoT service application installed in the mobile terminal is normally executed, the mobile terminal remote control system 200 transmits the screen of the mobile terminal on which the IoT service application is executed to the PC 100.

Furthermore, in order to confirm whether the IoT device 400 is normally controlled by the IoT service application executed in the mobile terminal, the IP camera 500 transmits an image of the IoT device 400 to the PC 100.

Thus, the worker may check the IoT service application execution state of the mobile terminal and the control state of the IoT device 400 by the IoT service application remotely through the PC 100.

2. Mobile terminal remote control system

2 is a detailed block diagram of the mobile terminal remote control system 200 shown in FIG. As shown in FIG. 2, the mobile terminal remote control system 200 includes a remote control server 210, a plurality of linked modules 220-1, 220-2,. Mobile terminals 230-1, 230-2,..., 230-n.

The mobile terminals 230-1, 230-2,..., 230-n are ideally composed of all the models currently used and preferably widely used. Furthermore, it is more preferable to configure the models for each OS version. For example, if the OS version used in the model # 1 is two versions 1.0 and 2.0, the mobile terminal (230-1, 230-2, ..., 230-n) and the model # 1 and 1.0 installed version This includes all models # 1 with version 2.0 installed.

The linking modules 220-1, 220-2,..., 220-n connect the mobile terminals 230-1, 230-2,..., 230-n and the remote control server 210. Each interface module connects. The linkage module 220-1, 220-2,..., 220-n transfers the screens of the mobile terminals 230-1, 230-2,..., 230-n to the remote control server 210. To pass.

The remote control server 210 synthesizes this screen with the external image of the mobile terminal and transmits the screen to the PC 100. The synthesis of the screen and the exterior image may be implemented to be performed by the associated modules 220-1, 220-2,..., 220-n instead of the remote control server 210.

Thus, the PC 100 displays a mobile terminal image (screen + exterior image). The developer may remotely operate the mobile terminal using a mouse, a keyboard, a touch pad, or the like, for the mobile terminal image displayed on the PC 100. The operation contents of the mobile terminal by the PC 100 are transmitted to the remote control server 210.

Then, the remote control server 210 transmits the received operation details to the mobile terminal, so that the mobile terminal executes the operation contents. That is, the remote control server 210 directly controls the mobile terminal according to the received operation content.

In addition, the remote control server 210 receives the screen of the mobile terminal that executes the operation contents, synthesizes the received screen with the appearance image of the mobile terminal, and transmits the received screen to the PC 100.

Accordingly, the mobile terminal image is displayed on the PC 100, and the IoT service application developer can check his or her remote control result.

When the remote control by the PC 100 is completed, the remote control server 210 initializes the mobile terminal that was remotely controlled by the PC 100 to restore the state before the remote control.

As such, the remote control server 210 sets / processes the PC 100 to remotely control the mobile terminals 230-1, 230-2,..., 230-n.

3. Mobile terminal remote operation

In the mobile terminal image displayed on the PC 100, the developer may remotely manipulate the mobile terminal selected / occupied by the mobile terminal remote control system 200 using a mouse or the like. The operation of the mobile terminal includes screen touch, button operation, terminal rotation, and multi-touch.

Touching the screen (for example, executing an IoT service application installed in the mobile terminal) may be performed by clicking an application icon displayed on the screen portion of the mobile terminal with a mouse.

4. IoT Service Application Manual Testing

3 is a flowchart provided to explain an IoT service application manual test method according to another embodiment of the present invention.

To test the IoT service application, first, a developer connects (logs in) the remote control server 210 of the mobile terminal remote control system 200 through the PC 100 (S605), and the mobile terminal remote control system 200 In order to occupy a desired one of the mobile terminals provided in the (S610).

Occupying the mobile terminal means setting the mobile terminal to be controlled remotely only through the PC 100.

Next, the developer manipulates the mobile terminal occupied via the PC 100 (S615), and installs an IoT service application on the mobile terminal (S620). This is by a procedure of remotely manipulating the mobile terminal to download and install the IoT service application by accessing a private URL from which the IoT service application under development can be downloaded.

Thereafter, the developer manipulates the mobile terminal occupied through the PC 100 (S625), and executes an IoT service application installed in the mobile terminal (S630). Next, the developer manipulates the IoT service application executed in the mobile terminal through the PC 100 (S635) and controls the IoT device 400 (S640).

Control of the IoT device 400 in step S640, the control command input by the developer operating the IoT service application to the PC 100 to the IoT device 400 via the IoT server 300 (not shown in Figure 3) Delivered, and performed by the IoT device 400 to execute it.

In the process of operating the mobile terminal (IoT service application) through the steps S615 to S640, the mobile terminal image in which the operation result is displayed is displayed on the PC 100 in real time.

In this process, the IP camera 500 captures the IoT device 400 (S645), and transfers the captured image to the PC 100 (S650). Then, the PC 100 displays the captured image of the IoT device 400 received in step S650 together with the mobile terminal image (S655).

The screen displayed on the PC 100 in step S655 is illustrated in FIG. 4. As shown in FIG. 4, a mobile terminal image is displayed on the left side of the screen, so that the developer may operate the mobile terminal (IoT service application) and check whether the IoT service application is normally executed.

In addition, since the captured image of the IoT device 400 is displayed on the right side of the screen, the developer may check whether the IoT device 400 is controlled according to the operation of the IoT service application.

The mobile terminal image and the captured image of the IP camera 500 are compressed to be transmitted to the PC 100 at high speed, so that real-time confirmation is possible.

The IoT service application manual test procedure shown in FIG. 3 is performed separately / sequentially for all mobile terminals 230-1, 230-2,..., 230-n provided in the mobile terminal remote control system 200. Perform.

Meanwhile, the IoT device 400 may include not one device but a plurality of devices, a smart water purifier, a smart air purifier, a smart TV, a smart bulb, etc. In this case, after selecting / occupying a mobile terminal in step S610, the IoT Procedures for selecting / occupying one of the devices may be added.

5. Automatic test result generation through image analysis

The PC 100 may automatically generate a test result by analyzing a mobile terminal image and an image of the IoT device 400 received from the IP camera 500 (hereinafter referred to as an 'IoT device image'). .

In detail, the PC 100 may determine whether the execution screen of the IoT service application is properly displayed through the analysis of the mobile terminal image, thereby determining whether the IoT service application is normally executed in the mobile terminal.

In addition, the PC 100 analyzes the mobile terminal image to grasp the control command input through the IoT service application, and analyzes the IoT device image at the same time to determine whether the IoT device 400 operates according to the identified control command. By grasping, it is possible to check whether the control of the IoT device 400 by the IoT service application is normally performed.

The input control command identifies and confirms which menu / function is selected in the IoT service application from the mobile terminal image, and the control of the IoT device 400 according to the control command is based on the state or operation of the IoT device 400 from the IoT device image. Check and figure out.

For example, when the IoT device 400 is a 'smart water purifier', after analyzing the mobile terminal image, it is confirmed that the 'hot water lock is set' through the IoT service application, and the result of analyzing the IoT device image at the same time ' When it is confirmed that the warm water lock indicator is turned on, it is treated as 'the IoT device 400 operates according to the control command'.

As another example, when the IoT device 400 is a 'smart bulb', as a result of analyzing the mobile terminal image, it is confirmed that the 'lighting command is input' through the IoT service application, and as a result of analyzing the IoT device image at the same time, When it is confirmed that the smart light bulb is turned off, the IoT device 400 is treated as not being operated according to the control command.

6. Automated IoT Service Application Testing

5 is a flowchart provided to explain an IoT service application automatic test method according to another embodiment of the present invention.

To test the IoT service application, first, a developer connects (logs in) the remote control server 210 of the mobile terminal remote control system 200 through the PC 100 (S710), and the mobile terminal remote control system 200. In step S720, a desired one is selected from the mobile terminals provided at the terminal.

Next, the developer uploads the IoT service application test script to the remote control server 210 using the PC 100 (S730), and reserves a test time (S740).

IoT service application test script, the mobile terminal automatically 1) download and install the IoT service application, 2) run the installed IoT service application, 3) control the IoT device 400 with the executed IoT service application 4) Test scenarios for sequentially inputting predetermined commands for collecting the command execution responses from the IoT device 400 and generating a test result are event-programmed programs.

When the reservation time arrives, the IoT service application test script uploaded to the remote control server 210 in step S730 is embedded in the mobile terminal occupied by the PC 100 in step S720 (S750).

Accordingly, the mobile terminal automatically performs a test for the IoT service application with the IoT service application test script (S760). In this process, the mobile terminal controls the IoT device 400 and receives a control response (S770).

When the mobile terminal transmits the result of the automatic test generated in steps S760 and S770 to the remote control server 210 (S780), the remote control server 210 transmits it to the PC 100 (S790).

The developer may check whether the IoT service application is normally executed in the mobile terminal or whether the IoT device 400 is normally controlled by the executed IoT service application through the automatic test results delivered to the PC 100 in operation S790.

The IoT service application automatic test procedure shown in FIG. 5 is individually / sequential for all mobile terminals 230-1, 230-2,..., 230-n provided in the mobile terminal remote control system 200. Perform.

On the other hand, if the IoT device 400 is a plurality of devices, after selecting the mobile terminal in step S720, a procedure for selecting / occupying one of the IoT devices may be added.

Furthermore, the mobile terminal selection and the IoT device selection may be implemented to be included in the IoT service application test script. That is, it is possible to perform the test while sequentially selecting and occupying the mobile terminals one by one by the IoT service application test script, while also sequentially selecting the IoT devices one by one.

7 modifications

So far, the IoT service application test method and system using the mobile terminal remote control system 200 have been described in detail with reference to a preferred embodiment.

In the above embodiment, it is assumed that there is only one mobile terminal that the PC 100 can select / occupy, but it is merely exemplary. The technical idea of the present invention can also be applied to the case where the mobile terminal controls multiple mobile terminals by selecting / occupying two or more mobile terminals.

In addition, in the above embodiment, there is no limitation on the specific type of the mobile terminal that is the object of remote occupation / control. Any type of mobile terminal can be used, such as a smart watch or a tablet PC, as well as a smart watch.

In addition, in the above embodiment, one mobile terminal remote control system 200 is shown and described as being linked to the PC 100, but it is merely exemplary. It is also possible to implement a plurality of mobile terminal remote control system 200 is interlocked with the PC (100).

In addition, it is possible to replace the PC 100 used by the development site to control the mobile terminal remotely with a smart device. At this time, the smart device may be provided with a touch screen as an input means.

Furthermore, the IoT service application under test in the above embodiment is referred to as a kind of application. Of course, the technical spirit of the present invention can also be applied to test applications other than IoT service applications.

On the other hand, the technical idea of the present invention can be applied to a computer-readable recording medium containing a computer program for performing the functions of the apparatus and method according to the present embodiment. In addition, the technical idea according to various embodiments of the present disclosure may be implemented in the form of computer readable codes recorded on a computer readable recording medium. The computer-readable recording medium can be any data storage device that can be read by a computer and can store data. For example, the computer-readable recording medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical disk, a hard disk drive, or the like. In addition, the computer-readable code or program stored in the computer-readable recording medium may be transmitted through a network connected between the computers.

In addition, while the above has been shown and described with respect to preferred embodiments of the present invention, the present invention is not limited to the specific embodiments described above, the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

100: PC
200: mobile terminal remote control system
210: remote control server
220-1, 220-2, ..., 220-n: linkage module
230-1, 230-2, ..., 230-n: mobile terminal
300: IoT server
400: IoT device
500: IP Camera

Claims (10)

Setting, by the server of the system, the external terminal to remotely control the mobile terminal provided in the system;
Transmitting, by the server, the remote operation contents by the external terminal to the mobile terminal; And
And transmitting, by the server, the result screen of the remote terminal to the external terminal to the external terminal.
The mobile terminal installs and executes an application for controlling an external device,
The application controls the external device according to the remote operation by the external terminal,
The external terminal receives an image of the external device and displays the screen and the captured image of the external device as a result of executing the remote operation by the mobile terminal.
In the setting step, at least one of a model and an OS version included in the system is set so that an external terminal can remotely control the plurality of mobile terminals sequentially one by one,
The external terminal analyzes the result screen of the mobile terminal to grasp the control command input through the application, analyzes the captured image of the external device at the same time to understand the operation of the external device, and then checks whether the external device operates according to the control command. And checking whether or not the control of the external device by the application is normally performed.
The method according to claim 1,
The mobile terminal installs and runs an application by remote operation by an external terminal.
delete delete delete delete The method according to claim 1,
The result screen of the mobile terminal and the captured image of the external device,
The application test method characterized in that it is used to check whether the application is normally executed in the mobile terminal and whether the control of the external device by the application is normally performed.
delete The method according to claim 1,
The mobile terminal installs and executes an application for control of an external device by a test script,
The application test method, characterized in that for controlling the external device by the test script.
A plurality of mobile terminals different in at least one of a model and an OS version; And
A server configured to remotely control the mobile terminal, to transmit the remote operation contents by the external terminal to the mobile terminal, and to transmit the screen to the external terminal as a result of the remote terminal executing the remote operation; and,
The mobile terminal installs and executes an application for controlling an external device,
The application controls the external device according to the remote operation by the external terminal,
The external terminal receives an image of the external device and displays the screen and the captured image of the external device as a result of executing the remote operation by the mobile terminal.
The server is set so that the mobile terminals can be controlled while the external terminals are occupied remotely one by one,
The external terminal analyzes the result screen of the mobile terminal to grasp the control command input through the application, analyzes the captured image of the external device at the same time to understand the operation of the external device, and then checks whether the external device operates according to the control command. The mobile terminal remote control system, characterized in that to determine whether the control of the external device by the application is normally performed.

Images