WO2013042815A1

WO2013042815A1 - Method of controlling an android platform-based application execution terminal using a smart terminal and computer-readable medium having a computer program for controlling the android platform-based application execution terminal using the smart terminal recorded thereon

Info

Publication number: WO2013042815A1
Application number: PCT/KR2011/007039
Authority: WO
Inventors: 변정섭; 김수한; 류혁곤
Original assignee: 주식회사 인프라웨어테크놀러지
Priority date: 2011-09-24
Filing date: 2011-09-25
Publication date: 2013-03-28
Also published as: KR20130032924A; KR101325026B1

Abstract

The present invention relates to a method of controlling an Android platform-based application execution terminal using a smart terminal and computer-readable medium having a computer program for controlling the Android platform-based application execution terminal using the smart terminal recorded thereon. When the smart terminal formed of a touch interface receives a touch down event from a user, the smart terminal determines whether to receive a touch up event as a next event. When determining to receive the touch up event, the smart terminal determines whether to re-receive the touch down event. When re-receiving the touch down event, the smart terminal determines the touch down event to be a double touch event. According to an event type created after the double touch, a request signal for an application execution terminal is created, transmitted and processed to be synchronized with an event which is input after the double touch. Therefore, complex controls for an Android application and a service using same executed in the application execution terminal can be manipulated using the smart terminal without a problem of a reduction in reaction speed according to communication load.

Description

A computer-readable recording medium recording an Android platform based application execution terminal control method using a smart terminal, and an Android platform based application execution terminal control program using a smart terminal

The present invention relates to an Android platform-based application execution terminal control method using a smart terminal, and a computer-readable recording medium recording an Android platform-based application execution terminal control program using a smart terminal, in more detail the application Android platform-based application execution terminal control method using a smart terminal, and the Android platform-based application execution terminal control program using a smart terminal to conveniently perform the control using a smart terminal by the user according to the operating characteristics of the execution terminal A computer-readable recording medium having recorded thereon.

Devices such as smart TVs and smart set-top boxes have been mainly controlled through remote controllers, but the remote controllers have been inconvenient to utilize various functions of such smart devices, and recently, they are controlled through handheld smart touch terminals such as smartphones or tablet terminals. The technique to say is proposed.

However, such a conventional control technology merely provides a relatively simple function of manipulating a mouse pointer through a handheld smart touch terminal by providing an interface identical to or similar to a conventional remote control interface or simply providing a touch pad area. . That is, it does not provide a precise control interface such as controlling the functions of the tablet terminal itself.

In particular, an application executable terminal (hereinafter referred to as an “application execution terminal”) such as an Android platform-based smart TV or smart set-top box may perform operations for controlling various Android applications or services using the same in the terminal device. In the case of the prior art there is a disadvantage that only simple operation can be supported.

In addition, a technique for remotely controlling a screen of a personal computer (PC) via a smart terminal has also been developed in the related art. However, in this technology, since the communication load for the remote control is very large, there is a problem that the response speed of the application execution terminal and the operation speed of the smart terminal are drastically reduced to support a relatively complex device control interface. Therefore, this conventional technology is not a very effective way to smoothly remotely control various functions provided by devices such as smart TVs and smart set-top boxes.

An object of the present invention can be controlled according to each function and operation method when performing the Android application and the service using the same in the application execution terminal utilizing the fact that the smart terminal and the application execution terminal adopts a common platform (for example, Android platform). It is to provide a remote UI screen and its control method suitable for the operation characteristics. Android platform-based application execution terminal control method using a smart terminal that allows the user to conveniently control the application execution terminal in the smart terminal, and a computer recording the application execution terminal control program based on the Android platform using the smart terminal It provides a recording medium that can be read.

According to an aspect of the present invention, there is provided a method of controlling an application execution terminal based on an Android platform using a smart terminal, the method comprising: mapping 1: 1 to a UI screen of an input / output unit of an smart terminal and an output unit of an application execution terminal; Determining whether the smart terminal formed as a touch interface receives a touchdown event as a next event; If it is determined that the smart terminal receives the touch-up event, determining whether the touch-down event is input again; When the smart terminal receives the touchdown event again, the smart terminal determines that the touchdown event is a double touch event and generates and transmits a request signal for the application execution terminal according to the type of event occurring after the double touch. Causing the processing to be synchronized.

In this case, in the event processing step, the smart terminal determines whether the touch drag event is received within a preset first time after the double touch event occurs, and the smart terminal inputs the touch drag event within the preset first time. If received, it is preferable to include a step of generating a drag request signal, and then transmits to the application execution terminal to process.

The transmitting of the drag request signal to the application execution terminal may include determining whether the touch down event is maintained for a preset second time in a state in which the touch down event is re-input when the smart terminal does not receive the touch drag event; The method may further include generating a long press request signal when the smart terminal is maintained for a preset second time and transmitting the long press request signal to the application execution terminal for processing.

In addition, the transmitting of the long press request signal to the application execution terminal may include restarting the touch-up event after the double-touch event occurs when the smart terminal does not receive the touchdown event again or is not maintained for a preset second time. The method may further include determining whether to receive an input, and generating a double-click request signal when the smart terminal receives the touch-up event again, and then transmitting the signal to the application execution terminal for processing.

In the transmitting of the double click request signal to the application execution terminal, when the smart terminal does not receive the touch-up event again, it is determined as a general click by the user to generate a click request signal and then transmits the signal to the application execution terminal. It is preferable to make the treatment.

In addition, the 1: 1 mapping step may include capturing the output unit screen of the application execution terminal by using the camera module of the smart terminal (g); Displaying the captured image on the input / output unit of the smart terminal (h); Step (i) to achieve the mapping for event processing by reflecting the resolution and aspect ratio of the smart terminal and the application execution terminal is preferably configured to include.

A computer-readable recording medium that records an application execution terminal control program based on an Android platform using a smart terminal according to the present invention for achieving the above object is provided with a remote control framework installed in a smart terminal and an application execution terminal on an Android platform. a request for an application execution terminal according to a synchronization-control means for performing a synchronization for a remote control through a control framework, and a double touch event input to an input / output unit of a smart terminal, and then an event occurring after the double touch event. The event-processing means for generating and transmitting a signal to be processed in synchronization with an event input after the double touch by the synchronization-control means, and during the event synchronization process by the event-processing means.And a mapping-processing means for controlling the UI screen of the output unit to be 1: 1 mapping.

At this time, the mapping-processing means implements a back-key implemented as a physical interface (PI) on the application execution terminal as a mapping icon at the input / output unit, and the back-key implemented as the mapping icon is When touched by the user, it is preferable to generate a back-key request signal and then transmit it to the application execution terminal for processing.

In addition, the application execution terminal control program is a mode for controlling control mode switching and control method switching when a drag event occurs in the upper, lower, left, and right corner regions of the remote control UI screen implemented in the input / output unit in the outer direction. It is preferable to further comprise the conversion-treatment means. Here, the control mode switch is a switch between the touch mode, the mouse mode, the keypad mode, the browser mode, and the game mode, and the control method is switched between the drag method, the zoom in / zoom out method, the movement using the mouse pointer, and the click method using the mouse pointer. Is preferably.

In this case, the application execution terminal control program implements a remote control UI screen of the input / output unit for controlling the application execution terminal. When the browser is executed in the application execution terminal, the control program may use a scrolling area by dragging, a zoom area for implementing screen zoom in / out, a touch for moving or clicking the mouse pointer. It is preferable to further include a remote UI-implementing means for controlling to output to a divided area divided into pad areas.

In addition, the remote UI-implementing means implements a QWERTY keypad screen in the input / output unit when a keypad input is required in the application execution terminal, and then inputs a character using the QWERTY keypad screen to generate a request signal for inputting the same character to execute the application. It is preferable to transmit to the terminal to process.

Further, the mapping-processing means captures the output unit screen of the application execution terminal using the camera module of the smart terminal, displays the captured image on the input / output unit of the smart terminal, and reflects the resolution and the aspect ratio of both terminals. It is desirable to achieve mapping for event processing.

According to the control technology of the present invention, the complex function control operation for various Android applications and services using the same in the application execution terminal can be operated using a smart terminal without a problem that the response speed is lowered according to the communication load. .

In addition, according to the present invention, it is possible to control various types of Android applications requiring various input methods through the remote control UI screen of the smart terminal that is always portable for each purpose, wherever there is an application execution terminal. It can be used.

1 is a diagram showing a system in which an Android platform-based application execution terminal control method using a smart terminal according to an embodiment of the present invention is implemented.

2 to 7 are diagrams showing examples of UI screens implemented in a smart terminal and an application execution terminal.

8 is a flowchart illustrating a method for controlling an application execution terminal based on the Android platform using a smart terminal according to an embodiment of the present invention.

Hereinafter, with reference to the drawings will be described in detail the present invention.

1 is a diagram illustrating a system in which an Android platform-based application execution terminal control method using a smart terminal according to an embodiment of the present invention is implemented, and FIGS. 2 to 7 illustrate a smart terminal 20 and an application execution terminal 10. A diagram illustrating an example of a UI screen implemented in FIG.

1 to 7, a system in which a control method for an application execution terminal 10 based on an Android platform is implemented includes an application execution terminal 10 and a smart terminal 20.

First, the application execution terminal 10 will be described as a concept including a smart TV, a smart set-top box, a personal computer (PC), etc., and refers to a terminal capable of executing an Android application. The internal configuration includes a first wireless transmission / reception unit 11, an output unit 12, a control unit 13, and a first storage unit 14, wherein the control unit 13 includes emulation-implementing means 13a. .

Here, the emulation-implementing means 13a is configured to receive various request signals received from the remote control-implementing means 25 and the remote UI-implementing means 26 of the smart terminal 20 to be described later through the remote control framework. Emulates the role as if made through the internal interface of the execution terminal (10).

In general, the Android application determines that a control event through a UI screen implemented in the output unit 12 itself of the terminal device is input, and since the software is developed, a separate process for processing a remote control by an external smart terminal 20 is performed. In order not to create a software version of the application execution terminal 10, it is preferable that an emulation-implementing means 13a is provided.

Subsequently, the smart terminal 20 will refer to various terminals (preferably handheld type) having a touch interface such as a smart phone and a smart pad and installed with a smart operating system. The internal configuration includes a second wireless transmission / reception unit 21, an input / output unit 22, a remote control function unit 23, and a second storage unit 27.

The second wireless transmitter / receiver 21 is a component for transmitting and receiving signals and data to and from the first wireless transmitter and receiver 11 of the application execution terminal 10 through a wireless method. As a wireless method used herein, wireless communication technologies such as WLAN, Zigbee, infrared, various mobile communication networks (eg, 3G, 4G) may be used.

The input / output unit 22 is formed as a touch interface capable of touch input by a user. The remote control UI screen by the remote control function unit 23 is implemented and may be implemented as a general touch screen.

The remote control function unit 23 comprises a synchronization-control means 24, a remote control-implementation means 25, a remote UI-implementation means 26, and corresponds to a control application for the application execution terminal 10. do.

Synchronization-control means 24 is a remote control framework is installed on both the smart terminal 20 and the application execution terminal 10 on the Android platform, thereby performing the synchronization for the remote control.

Specifically, the synchronization-control means 24 forms a data link between the smart terminal 20 and the application execution terminal 10, and the remote control-implementing means 25 and the remote UI-implementation of the smart terminal 20. Various request signals generated by the means 26 can be processed in the application execution terminal 10 in the same manner. Accordingly, the synchronization-control means 24 equally matches the clock frequency and the IP address to a specific value in the smart terminal 20 and the application execution terminal 10 so as to implement the remote control-implementation means 25 and the remote UI. Synchronization is performed through interworking with the implementation means 26.

The remote control-implementing means 25 serves as an interface for controlling the application execution terminal 10.

Basically, the remote control-implementing means 25 controls the UI screen of the remote control implemented by the input / output unit 22 of the smart terminal 20 by the user of the smart terminal 20, and additionally through the control. The role of transmitting the generated signal to the application execution terminal 10 is also parallel.

That is, the remote control-implementing means 25 is required for selecting and executing the correct position through the remote control by the smart terminal 20 when using the Android application and the service using the same on the application execution terminal 10. Used for control. To this end, the remote control-implementing means 25 is an event-processing means 25a, a mapping-processing means 25b, a mode switching-processing means 25c to enable precise control on the remote control UI screen of the mouse pointer. ).

The event-processing means 25a performs various event control so that the Android application and the service using the same can be controlled according to each function and operation method by the application execution terminal 10 through an input to the input / output unit 22.

In more detail, the event-processing means 25a receives a double touch event by the user to the input / output unit 22 and then, in response to the type of successively input events, the various types of the application execution terminal 10. After generating the request signal of, send it.

In addition, the event-processing means 25a controls the event occurring after the double touch to be simultaneously processed by the smart terminal 20 and the application execution terminal 10 according to the synchronization interworking performed by the synchronization-control means 24. do.

As a specific example, the event-processing means 25a determines whether a double touch event by a user is input to the input / output unit 22. For example, when the touch-down event (↓), the touch-up event (↑), or the touchdown event (↓) are continuously input to the input / output unit 22 by the user, the event-processing means 25a generates a double-touch event. I think that.

Thereafter, the event-processing means 25a generates a drag request signal to the application execution terminal 10 when a touch drag event occurs within a first preset time following the occurrence of the double touch event to the input / output unit 22. The second radio transceiver 21 is controlled to transmit. In this case, the touch drag event input through the input / output unit 22 occurs when the user slides with directionality without releasing the hand on the input / output unit 22 after the double touch event occurs.

On the other hand, when the event-processing means 25a maintains the last touch state (the state in which the touchdown event has occurred in the above-described example) for a preset second time following the occurrence of the double touch event to the input / output unit 22, After generating the long press request signal, the second radio transmitter / receiver 21 is controlled to transmit to the application execution terminal 10. Here, the second time may be the same as the first time described above, or may be set to a different time in order to recognize a different function setting by the user.

In addition, the event-processing means 25a is a touch event having a directionality of the last touch state and a massive touch after the occurrence of a double touch event to the input / output unit 22 (touch-up having a direction opposite to the touchdown event in the above-described example) Event), the second radio transmitter / receiver 21 is controlled to generate a double-click request signal and then transmit it to the application execution terminal 10.

In this case, the example of the double click request signal generated by the event-processing means 25a can be used in the same sense as the double click corresponding to the selection using the existing mouse input device.

In addition, the mapping-processing means 25b controls the synchronization-control means 24 when processing the event synchronization by the event-processing means 25a, thereby executing the application with the input / output unit 22 of the smart terminal 20. The screen of the output unit 12 of the terminal 10 controls the 1: 1 mapping.

Accordingly, the mapping-processing means 25b is located in the mapped position of the output unit 12 of the application execution terminal 10 when the user touches the target position of the input / output unit 22 of the smart terminal 20 by the user. After generating the touch request signal for the control, and controls the second radio transmitter and receiver 21 to transmit to the application execution terminal (10).

The concept of mapping processed by the mapping-processing means 25b as shown above is shown in FIG. In FIG. 2, when the aspect ratio remains the same and there is a difference only in the number of pixels (resolution), or when the aspect ratio is different, it may be converted according to a fixed aspect ratio setting.

In addition, the mapping-processing means 25b, when controlling the application execution terminal 10, the input-output unit 22 of the smart terminal 20 has a back-key implemented by a physical interface (PI). ) Can be implemented as a mapping icon. Accordingly, the mapping-processing means 25b generates a back-key request signal when the mapping icon embodying the back-key is touched by the user, and then transmits the second radio transmission / reception to transmit to the application execution terminal 10. The unit 21 is controlled.

On the other hand, the mapping-processing means 25b may be implemented by utilizing the camera module of the smart terminal 20. Referring to FIG. 2B, a camera module (not shown) of the smart terminal 20 captures a display screen of the application execution terminal 10 and transfers the captured screen to an input / output unit of the smart terminal 20. Display. The portion of matching the resolution and aspect ratio between the smart terminal 20 and the application execution terminal 10 is as described above. By using this, the screens of the input / output unit 22 of the smart terminal 20 and the output unit 12 of the application execution terminal 10 are controlled to have 1: 1 mapping.

Subsequently, the mode change-processing means 25c is illustrated in FIGS. 3 and 4 when a drag event occurs in an outward direction in the corner regions of the upper, lower, left, and right sides of the remote control UI screen of the smart terminal 20. As such, certain functional transitions may be performed.

The specific functions performed by the mode switching processing unit 25c include control mode switching and control method switching. Here, the 'control mode' may be a touch mode, a mouse mode, a keypad mode, a browser mode, a game mode, and the like, and the 'control method' may include dragging, zooming in and out, moving using a mouse pointer, and clicking using a mouse pointer. This can be

On the other hand, as shown in Figure 4, when the drag event occurs in the outer direction in the left corner area of the remote control UI screen is switched to the mouse mode, the control method is switched when the drag event occurs in the outer direction in the right corner area. . In the same way, the touch mode when the drag event occurs in the outer direction in the upper corner area can be switched to the touch mode, and the keypad mode can be switched when the drag event occurs in the outer direction in the lower corner area. It can be implemented by combining control method switching.

Here, when the control mode is switched to the keypad mode, as shown in FIG. 5, the mode switching-processing means 25c may apply various operation events generated in the smart terminal 20 through the second wireless transmission / reception unit 21. It transmits to the 1st wireless transmission / reception part 11 of the execution terminal 10. FIG.

The remote UI-implementing means 26 implements a remote control UI screen of the smart terminal 20 for controlling the application execution terminal 10.

More specifically, when the browser is executed in the application execution terminal 10, the scroll region 22a using dragging, the zoom region 22b for implementing screen zoom in / zoom out, the mouse pointer is moved or the mouse pointer is moved. Three control areas of the touchpad area 22c for clicking are required. Accordingly, the remote UI-implementing means 26 divides the three control areas into separate partition areas by dividing the remote control UI screen of the input / output unit 22, receives the events from them, and generates a request signal. . Meanwhile, the example output to the individual partitions may be implemented as shown in FIG. 6.

Accordingly, the remote UI-implementing means 26 controls the second radio transmitter / receiver 21 to transmit the request signal generated according to the event for the individual partition to the application execution terminal 10.

In addition, the remote UI-implementing means 26 implements a QWERTY keypad screen as shown in FIG. 7 in the input / output unit 22 of the smart terminal 20 when a keypad input is required in the application execution terminal 10. Accordingly, when characters such as English, Korean, and special characters are input by the user using the QWERTY keypad screen, a second request is made to generate a request signal for inputting the same character according to the corresponding input and transmit the same to the application execution terminal 10. The radio transmitter and receiver 21 is controlled.

The second storage unit 27 is installed with a remote control framework for performing a remote control based on the Android platform.

On the other hand, the remote control framework is similarly installed in the first storage unit 14 of the application execution terminal 10.

8 is a flowchart illustrating a method of controlling an application execution terminal based on an Android platform using a smart terminal according to an embodiment of the present invention. 1 to 8, the remote control function unit 23 recognizes that after the touchdown event is inputted to the input / output unit 22 (S1), the touchup event is input by the user as a subsequent event. (S2).

After step S2, the remote control function unit 23 determines whether the touchdown event as in step S1 is input again through the input / output unit 22 (S3). In this case, when the touchdown event is input again, the remote control function unit 23 performs processing according to the type of successively input events which are subsequently determined by judging as a double touch event.

After step S3, when it is determined that the touchdown event is re-entered, the remote control function unit 23 inputs the input / output unit 22 to the first time set in advance following the occurrence of the double touch event (eg, 1.0). In operation S4, it is determined whether a touch drag event is input.

When the touch drag event is input as a result of the determination in step S4, the remote control function unit 23 generates a drag request signal and transmits it to the application execution terminal 10 so that the touch drag event is synchronized and processed ( S5).

On the other hand, if the touch drag event is not input as a result of the determination in step S4, the remote control function unit 23 is a preset state in which the touch-down event is re-inputted after the double touch event is generated to the input / output unit 22. It is determined whether the second time (eg, 1.5 seconds) is maintained (S6).

As a result of the determination in step S6, when the state in which the touchdown event is re-entered is maintained for the second time, the remote control function unit 23 generates a long press request signal and transmits the long press request signal to the application execution terminal 10. The long press event is synchronized and processed (S7).

On the other hand, if the touchdown event is not re-entered or maintained for the second time as a result of the determination in step S6, the remote control function unit 23 determines whether the touch-up event is re-entered following the occurrence of the double-touch event. It is determined (S8).

When the touch-up event is input again as a result of the determination in step S8, the remote control function unit 23 generates a double-click request signal and transmits it to the application execution terminal 10 so that the double-click event is synchronized and processed. (S5).

On the other hand, if the touchdown event is not re-entered as a result of the determination in step S3, the remote control function unit 23 determines that it is a general click by the user, generates a click request signal, and then returns to the application execution terminal 10. By transmitting the click event is synchronized and processed (S10).

The invention can also be embodied as computer readable code on a computer readable recording medium. Computer-readable recording media include all kinds of recording devices that store data that can be read by a computer system.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disks, optical data storage devices, and the like, which may be implemented in the form of carrier waves (eg, transmission over the Internet). . The computer readable recording medium can also store and execute computer readable code in a distributed manner over networked computer systems. And functional programs, codes, and code segments for implementing the present invention can be easily inferred by programmers in the technical field to which the present invention belongs.

Claims

A method of controlling an application execution terminal using the smart terminal through a remote control framework installed on the smart terminal and the application execution terminal on the Android platform,

A first step of mapping 1: 1 to the UI screen of the input / output unit of the smart terminal and the output unit of the application execution terminal;

A second step of determining whether a touch-up event is input as a next event when the smart terminal formed with the touch interface receives a touchdown event from a user;

A third step of determining whether the touchdown event is input again when the smart terminal determines that the touchup event has been input;

When the smart terminal receives the touchdown event again, the smart terminal determines that it is a double touch event and generates and transmits a request signal for an application execution terminal according to the type of event occurring after the double touch. A fourth step of synchronizing and processing the input event;

Android platform-based application execution terminal control method using a smart terminal comprising a.
The method according to claim 1,

The fourth step,

Determining, by the smart terminal, whether the touch drag event has been input within a first preset time after the double touch event occurs;

(B) generating a drag request signal and transmitting the drag request signal to the application execution terminal when the smart terminal receives the touch drag event within the first time;

Android platform-based application execution terminal control method using a smart terminal comprising a.
The method according to claim 2,

Step (b) is,

If the smart terminal does not receive the touch drag event, determining whether the touchdown event is maintained for a preset second time in a re-input state;

(D) generating a long press request signal and transmitting the generated long press request signal to the application execution terminal when the smart terminal is maintained for the preset second time;

Android platform-based application execution terminal control method using a smart terminal further comprises a.
The method according to claim 3,

Step (d) is,

(E) determining whether the smart terminal receives the touch up event again after the double touch event occurs when the smart terminal does not receive the touch down event again or is not maintained for the preset second time;

If the smart terminal receives the touch-up event again, generating a double-click request signal and transmitting the processed signal to the application execution terminal for processing;

Android platform-based application execution terminal control method using a smart terminal further comprises a.
The method according to claim 4,

The first step is,

(G) capturing an output unit screen of the application execution terminal using the camera module of the smart terminal;

Displaying the captured image on an input / output unit of the smart terminal (h);

(I) achieving mapping for event processing by reflecting a resolution and an aspect ratio of the smart terminal and the application execution terminal;

Android platform-based application execution terminal control method using a smart terminal, characterized in that comprises a.
Synchronization-control means for performing synchronization for the remote control via a remote control framework installed on the smart terminal and the application execution terminal on the Android platform;

After receiving the double touch event from the user to the input / output unit of the smart terminal, the request signal for the application execution terminal is generated and transmitted according to the type of the event occurring after the double touch event, by the synchronization-control means. Event-processing means for processing in synchronization with an event input after the double touch;

Mapping-processing means for controlling the UI screen of the input / output unit and the output unit of the application execution terminal to be 1: 1 mapping during event synchronization processing by the event-processing means;

A computer-readable recording medium recording an application running terminal control program based on the Android platform using a smart terminal comprising a.
The method according to claim 6,

The mapping processing means,

When a back-key implemented as a physical interface (PI) on the application execution terminal is implemented as a mapping icon in the input / output unit, and the back-key implemented as the mapping icon is touched by the user, After generating the back-key request signal, and transmits to the application execution terminal to be processed by a computer-readable recording medium recording an application platform execution program control program based on the Android platform using a smart terminal.
The method according to claim 6,

Mode switching-processing means for controlling control mode switching and control method switching when a drag event occurs in the upper, lower, left, and right corners of the remote control UI screen implemented in the input / output unit in the outer direction;

A computer-readable recording medium recording an Android platform-based application execution terminal control program using a smart terminal further comprising.
The method according to claim 8,

The control mode switch is a switch between a touch mode, a mouse mode, a keypad mode, a browser mode, and a game mode.

The control method switching is a computer recording an Android platform based application execution terminal control program using a smart terminal, characterized in that switching between the drag method, the zoom in / zoom out method, the movement using a mouse pointer, the click method using a mouse pointer. Readable recording medium.
The method according to claim 6,

A remote control UI screen of the input / output unit for controlling the application execution terminal is implemented, and when the browser is executed in the application execution terminal, the scroll area using a drag and a zoom for implementing screen zoom in / zoom out Remote UI-implementing means for controlling output to a divided area divided into an area and a touchpad area for moving or clicking the mouse pointer;

A computer-readable recording medium recording an Android platform-based application execution terminal control program using a smart terminal further comprising.
The method according to claim 10,

The remote UI-implementing means,

If a keypad input is required in the application execution terminal, a QWERTY keypad screen may be implemented in the input / output unit. If a character is input using the QWERTY keypad screen, a request signal for inputting the same character is generated and transmitted to the application execution terminal. A computer-readable recording medium recording an Android platform-based application execution terminal control program using a smart terminal.
The method according to claim 7,

The mapping processing means,

After capturing the output unit screen of the application execution terminal by using the camera module of the smart terminal, and displaying the captured image on the input / output unit of the smart terminal, the resolution and aspect ratio of the smart terminal and the application execution terminal are determined. A computer-readable recording medium recording an Android platform based application execution terminal control program using a smart terminal, characterized in that to achieve mapping for event processing by reflecting.