KR101202447B1 - System and method of remote controlling mobile phone in computer - Google Patents

Abstract

The present invention can be remotely controlled by a method of connecting a computer terminal and a wired / wireless communication method without directly operating a mobile communication terminal and synchronizing an operation device (input device), a display device, an audio processing device, and the like of each device. A system and method thereof are provided.

The present invention provides the same user interface as the mobile communication terminal by applying the skin (SKIN) technology so that the user can intuitively remotely control the mobile communication terminal without learning a separate operation method, the screen of the mobile communication terminal computer We propose a method of synchronizing and displaying on the screen.

The present invention proposes a method of minimizing the effect on the original function of the mobile communication terminal by asynchronously processing the information exchanged in performing the remote control processing considering that the operating system of the mobile communication terminal is mostly a real-time operating system (RTOS). do.

Mobile terminal remote control, mobile terminal control, virtual device application, skin

Description

SYSTEM AND METHOD OF REMOTE CONTROLLING MOBILE PHONE IN COMPUTER}

In the present invention, when remotely operating a mobile communication terminal from a computer terminal, the mobile device is intuitively communicated using an input device such as a keyboard and a mouse of a computer in a virtual device application having the same key set and screen as the mobile communication terminal installed in the computer. A mobile communication terminal remote control system and method in a computer terminal for remote operation of a terminal.

In general, the mobile communication terminal is made small in size for portable purposes. Therefore, the user interface is also downsized, which makes the user's operability difficult and inconvenient to use. In recent years, many devices with larger LCD screens, touch screens, and Qwerty key pads have been released in consideration of their slightly larger size, but still have operability compared to a user interface device installed in a computer. This is bad.

This inconvenience in operation can be improved to some extent by connecting the mobile communication terminal from the computer to the remote control and controlling it using the keyboard of the computer. However, the fact that only the keyboard of a computer can be used does not necessarily mean that the operational inconvenience is completely eliminated. For more effective remote control from the user's point of view, in order to have the same intuition as directly controlling the mobile terminal, the user interface must be provided with the same look and fill as the mobile terminal. Rather, it should be able to control most of the functions remotely. It should also be configured to minimize the user learning the remote control application.

In addition, existing remote control should not be designed from the user's point of view alone. Due to the characteristics of the mobile terminal, the processing speed of the CPU is not as fast as that of the computer, and many of the original functions require temporal accuracy. It should be designed to minimize the impact on the system.

In the present invention, by providing a solution to the various problems described above, the ultimate goal is to make the user more convenient to use the remote control system between the computer and the mobile communication terminal.

An object of the present invention is a computer connected to a mobile communication terminal and a wired / wireless communication technology, the mobile communication terminal remote control system in a computer terminal for the user to remotely control the mobile communication terminal from the computer by synchronizing each input and output device and In providing a method.

delete

Another object of the present invention is to provide a remote control system and method for a mobile communication terminal in a computer terminal having a virtual device application on a computer having the same user interface (UI) in the same appearance as a mobile communication terminal for remote control. have.

Another object of the present invention is a skin (SKIN) file containing the external image information of the virtual device application may exist inside the mobile communication terminal, may be located inside a specific web server, the virtual device application is the skin (SKIN) The present invention provides a system and method for remotely controlling a mobile communication terminal in a computer terminal for downloading a file on a mobile communication terminal or a web server.

It is still another object of the present invention to provide a remote control system and method for a mobile communication terminal in a computer terminal in which a virtual device application can automatically set its appearance and user interface differently according to the type of mobile communication terminal to be remotely controlled. Is in.

It is still another object of the present invention that each key of the computer keyboard and each key of the mobile communication terminal are mapped and mapped in a 1: 1 manner so that each mapping information can be visually represented to the user through the virtual device application. The present invention provides a mobile communication terminal remote control system and method in a computer terminal.

It is still another object of the present invention to provide a mobile communication terminal remote control system and method in a computer terminal for allowing a mouse event of a computer to be synchronized with a touch screen event of a mobile communication terminal when the mobile communication terminal supports a touch screen. Is in.

Still another object of the present invention is to provide a remote control system and method for a mobile terminal in a computer terminal for providing intuitiveness such as a user directly operating the mobile terminal by displaying a screen of the mobile terminal through a virtual device application on a computer. In providing.

It is still another object of the present invention to provide a remote control system and method for a mobile terminal in a computer terminal that enables a user to view all functions stored in the mobile terminal on a computer screen as the screen of the mobile terminal is transmitted to the computer in real time. In providing.

Still another object of the present invention is that the audio system of the computer and the audio system of the mobile communication terminal is synchronized, so that the user can make a call using the audio system of the computer, and use a sound service or input a voice of the mobile communication terminal. A remote control system and method for a mobile communication terminal in a computer terminal capable of performing the present invention.

It is still another object of the present invention to provide a synchronization function for mobile communication terminal remote control in a computer terminal such that the synchronization capability is selectively applied according to a processing capability of a mobile communication terminal, a wired / wireless communication technology between a computer and a mobile communication terminal, or a user's selection. A system and method are provided.

It is still another object of the present invention to provide a mobile communication terminal remote control system and method in a computer terminal for providing a processing technique capable of performing effective remote control in consideration of hardware and software characteristics of the mobile communication terminal. have.

The remote control system of a mobile communication terminal in a computer terminal according to the present invention is a system for remotely controlling a mobile communication terminal capable of network connection with the computer terminal in a computer terminal capable of wired / wireless communication and internet connection, and a virtual device application. Connect and synchronize the mobile communication terminal by driving, configure a user interface (UI) to which the same skin is applied as the connected mobile communication terminal, and remotely operate the mobile communication terminal by key input through a mouse and a keyboard. A computer terminal for receiving screen output data from the mobile communication terminal and outputting the screen output data on a screen in real time; And a remote control application for receiving and synchronizing a remote control signal from the computer terminal when connected to the computer terminal, operating by receiving a control signal of the computer terminal, and outputting screen output data according to an operation. It characterized in that it comprises a mobile communication terminal for transmitting to.

According to the present invention, the computer terminal and a mobile communication terminal further comprises a web server for providing a virtual device application for remote control and synchronization with skin and user interface information.

According to the present invention, when a virtual device application of the computer terminal is connected to the mobile communication terminal, the same user interface as the connected mobile communication terminal is received by receiving skin and user interface information from at least one of the mobile communication terminal and the web server. It is characterized by configuring the display.

According to the present invention, the computer terminal includes a wired / wireless communication unit for receiving synchronization and skin and user interface information through a wired / wireless communication connection with the mobile communication terminal; A key input unit and a mouse input unit for remotely operating the mobile communication terminal through the virtual device application; A display unit configured to display and configure a user interface to which the same skin as the mobile communication terminal is applied; A multimedia processing unit for decoding the message information received through the wired / wireless communication unit and outputting the decoded message information on the screen through the display unit; A network connection unit for receiving skin and user interface information of a mobile communication terminal connected through the Internet or a network connection; And an application for remotely controlling the mobile communication terminal provided from the web server and operated on the computer. When the mobile communication terminal is connected, skin and user interface information corresponding to the mobile communication terminal is transmitted to the mobile communication terminal. And a virtual device application configured to receive from a terminal or a web server to configure a graphical user interface (GUI) to be displayed on the display unit and to remotely control the mobile communication terminal according to a user's manipulation.

According to the present invention, the computer terminal further comprises an audio processor for receiving audio data from the mobile communication terminal and outputting the same through a speaker.

According to the present invention, the virtual device application, the message processing unit for performing a simple operation to minimize the load of performing other applications according to the real-time remote control; A synchronization processor for processing a complex task without being operated in real time; And a message storage unit having a first-in, first-out queue structure for exchanging information asynchronously with the message processing unit.

According to the present invention, the mobile communication terminal, the wired and wireless communication unit for synchronizing with the virtual device application through the wired / wireless communication with the computer terminal; A file system for storing skin and user interface information of a mobile communication terminal to be transmitted to the computer terminal; An audio processor for receiving and processing at least one of audio and voice data from the computer terminal; A multimedia processing unit for decoding the multimedia information input from the computer terminal or encoding the screen output data; And a remote control application that decrypts and executes the remote control information transmitted from the virtual device application and periodically transmits screen information of the mobile communication terminal to the virtual device application.

According to the present invention, the audio input signal received from the computer is converted into an input signal of the mobile communication terminal to input, or further comprises an audio processor for obtaining an audio output signal of the mobile communication terminal.

According to the present invention, the remote control application includes a message processing unit for performing a simple operation to minimize the load of performing other applications according to the real-time remote control; A synchronization processor for processing a complex task without being operated in real time; And a message storage unit having a first-in, first-out queue structure for exchanging information asynchronously with the message processing unit, wherein the message processing unit transfers the synchronization message received from the wired / wireless communication unit to the message storage unit. Store and read the stored messages sequentially to perform the processing according to the message content.

According to the present invention, the remote control application is a key event of the mobile communication terminal through the key input unit of the mobile communication terminal when the content of the synchronization message delivered by the virtual device application (Key Event) generated in the computer ( Key event), and if the content of the message is an event of a mouse device, it is synchronized to the touch screen event of the mobile communication terminal through the touch screen unit. If the content of the message is audio information, the audio information is decoded through the multimedia processing unit. And converting the decoded information into a voice input of the mobile communication terminal through the audio processing unit, encoding screen output data or voice output data of the mobile communication terminal through the multimedia processing unit and periodically transmitting the encoded information to the computer terminal.

According to the present invention, the computer terminal and the mobile communication terminal at least any one of the USB (USB), Bluetooth (Bluetooth), Zigbee (NFC), WiFi (WIFI), the UWB (Ultra-WideBand) It is characterized in that connected in one way.

According to the present invention, the virtual device application is characterized in that to search for a mobile communication terminal to be connected and to select a device to be controlled by the user from among the mobile communication terminals searched through the user's query.

According to the present invention, the virtual device application is characterized in that the screen synchronization information transmitted from the control target mobile communication terminal to be synchronized to the screen of the computer terminal.

According to the present invention, the virtual device application is characterized in that the mobile communication terminal remote control state in the computer terminal can be connected / blocked.

The remote control method of a mobile communication terminal in a computer terminal according to the present invention is a method for remotely controlling a mobile communication terminal capable of network connection with the computer terminal in a computer terminal capable of wired / wireless communication and internet connection. Connecting and synchronizing the mobile terminal with a terminal by driving a virtual device application; Configuring, by the computer terminal, a graphic user interface (GUI) to which the same skin (SKIN) and user interface (UI) as the connected mobile communication terminal are applied; When the mobile communication terminal is connected to the computer terminal, running a remote control application for receiving and synchronizing a remote control signal from the computer terminal; Remotely operating the mobile communication terminal by key input via a mouse and a keyboard by the computer terminal; The mobile communication terminal receiving and operating a control signal of the computer terminal, and transmitting an event signal according to the operation to the computer terminal; And receiving, by the computer terminal, screen output data from the mobile communication terminal and outputting the screen output data on the screen of the computer.

According to the present invention, if there is no skin and user interface information for the mobile communication terminal to which the virtual device application of the computer terminal is connected, the skin and the user interface information corresponding to the mobile communication terminal are downloaded from the web server and the graphic user interface (GUI) is downloaded. It further comprises the step of configuring).

According to the present invention, the computer terminal further comprises the step of outputting through the speaker when receiving the audio data from the mobile communication terminal.

According to the present invention, the mobile communication terminal further comprises the step of switching to the audio input signal of the mobile communication terminal when receiving the audio signal from the computer terminal, and obtaining and outputting the audio output signal of the mobile communication terminal to the computer terminal; It is characterized by.

According to the present invention, the virtual device application is characterized in that the screen synchronization information transmitted from the control target mobile communication terminal to be synchronized to the computer terminal screen.

According to the present invention, the virtual device application is characterized in that it can connect / block the mobile communication terminal remote control state in the computer terminal.

According to the present invention, the virtual device application is at least one of sending an SMS, calling a phone number in the address book on the computer, storing the address information in the mobile communication terminal according to the high-level service list of the user interface information provided by the mobile communication terminal It is characterized by one high level remote control.

The present invention has an effect that the user can intuitively and efficiently control the mobile communication terminal when the user remotely controls the mobile communication terminal by using the input and output device of the computer having greater operability than the mobile communication terminal.

In addition, the present invention has the effect that the user interface (UI) of the mobile communication terminal in the computer terminal as it is, the user can use the remote control system without having to learn a separate operation method.

In addition to the remote control of the mobile communication terminal, the present invention has the effect that the contents of the mobile communication terminal can be used on the large screen on the computer terminal.

In addition, the present invention has the effect that one virtual device application can control heterogeneous mobile communication terminals by applying different appearance, operation device information, communication method, etc. according to the type of mobile communication terminal.

In addition, the present invention in designing the remote control unit of the mobile communication terminal, in consideration of the characteristics of the real-time processing operating system of the mobile communication terminal to minimize the load of the mobile communication terminal required for remote control, the execution speed of other applications of the mobile communication terminal By presenting a method to minimize the impact on the mobile terminal has an effect that can easily meet these requirements.

Hereinafter, a mobile communication terminal remote control system and method in a computer terminal according to the present invention will be described in detail with reference to the accompanying drawings.

The names of the configurations of the computer terminal 100 and the mobile communication terminal 200, which will be described later, are mostly the same, but are distinguished by reference numerals.

1 is a view showing the configuration of a remote control system of a mobile communication terminal via a computer terminal according to an embodiment of the present invention.

As shown in FIG. 1, a virtual device including a keyboard 103, a mouse 104, and a display device 101 for a user to operate a mobile communication terminal 200 and providing a remote control reception and a user interface. Skins for the mobile terminal 200 and the mobile terminal 200 that are remotely controlled by exchanging control information connected to the computer terminal 100 and the computer terminal 100 equipped with an application by wire / wireless communication technology. And a web server 300 for providing user interface information and a virtual device application.

The computer terminal 100 includes the mobile communication terminal 200, USB, Bluetooth, Zigbee, NFC, WIFI, and UWB (ultra-wideband). It may be connected in at least one of the short-range wired / wireless communication technology such as.

The communication method differs in bandwidth and communication distance according to its technical characteristics. In the present invention, in order to synchronize both the user input device and the screen, audio signals, etc., communication technologies such as USB, Bluetooth, Wi-Fi, and UBT, which can support a large amount of bandwidth, should be used. Zigbee or NFC technology is preferably used.

In order to provide an intuitive user interface for remotely controlling the mobile communication terminal 200 in the computer terminal 100, a virtual device application 106 is installed in the computer terminal 100, and the virtual device application 106 is configured as described above. When connected to the mobile communication terminal 200, skin and user interface information is received from at least one of a hard disk directory stored by the user in the mobile communication terminal 200, the web server 300 or the computer terminal 100. do.

Input devices such as a keyboard 103 and a mouse 104 connected to the computer terminal 100 are synchronized with the input device of the mobile communication terminal 200, and the voice output device 116 and the voice input of the computer terminal 100 are synchronized. The device 117 is synchronized with the voice output device 214 and the voice input device 215 of the mobile communication terminal 200.

The virtual device application 106 installed and executed in the computer terminal 100 may transmit the skin and user interface information to the web server 300 or the connected mobile communication terminal according to the terminal information of the connected mobile communication terminal 200. It is desirable to construct a new graphical user interface (GUI) upon receipt from 200.

2 is a diagram illustrating an example of a graphic user interface (GUI) of a virtual device application configured in a computer terminal according to an exemplary embodiment of the present invention.

As shown in FIG. 2, the appearance SKIN and the key set 108 of the virtual device application 106 executed on the screen 101 of the computer terminal 100 are the appearance and keys of the actual mobile communication terminal 200. Same as set 208.

Even when the user places and clicks the mouse cursor 109 on a specific key of the key set 108 displayed in the virtual device application 106, the corresponding key on the mobile terminal 200 is recognized as being pressed and the mobile terminal is pressed. The key operation event is transmitted to 200.

The screen 207 of the mobile communication terminal 200 is synchronized with the area of the screen 107 of the virtual device application 106 of the computer terminal 100 and displayed to the user.

The screen 107 of the mobile communication terminal 200 is preferably configured to be adjusted according to the resolution of the computer terminal 100.

When the mobile terminal 200 supports a touch screen, events occurring on the screen of the virtual device application 106 by the mouse cursor 109 of the computer terminal 100 are transferred to the mobile terminal 200. The mobile communication terminal 200 is synchronized with the operation as if the user directly performed the operation in his or her touch screen system.

 Skin (SKIN) file including the image and layout information of the appearance and key set of the mobile communication terminal 200, mapping between the keys (key) of all the mobile communication terminal and the key of the keyboard of the computer terminal 200 ( mapping information, and user interface information including whether the touch screen is supported and the resolution of the touch screen may be transmitted from the mobile communication terminal 200 when the computer terminal 100 and the mobile communication terminal 200 are initially connected. Delivered to the virtual device application 106.

 When there is no remote control command signal for a predetermined time from the user, the virtual device application 106 is preferably displayed as an icon 130 on the desktop, and the mobile communication terminal 200 is driven by a battery. In many cases, in order to save power, it is preferable to be configured to switch to the standby mode (Standby Mode, Idle Mode) when there is no user input for a certain time.

 In controlling the mobile communication terminal 200 from the virtual device application 106, instead of transmitting only a simple key input event and a mouse click event to the mobile communication terminal 200, calling an address book phone number on a computer, SMS It is also desirable to provide a high level of control, such as sending.

delete

3 is a block diagram illustrating a configuration of a computer terminal and a mobile communication terminal of a remote control system of a mobile communication terminal via a computer terminal according to an exemplary embodiment of the present invention.

As shown in FIG. 3, in the computer terminal 100, a virtual device application 106 is performed to perform remote control of the mobile communication terminal 200 on the computer terminal 100. Also at 200, a remote control application 206 for receiving a remote control signal from the computer terminal 100 and exchanging event information is performed.

Since the virtual device application 106 of the computer terminal 100 is operated in real time and should not burden the execution of other existing applications, the message processing unit 112 for performing a simple task having a relatively short processing time is performed. The process is divided into a synchronization processor 114 for performing a complex task and does not need to be operated in real time relatively.

Since the message exchange between the message processing unit 112 and the synchronization processing unit 114 must be performed asynchronously, the message processing unit 113 has a queue structure that can be processed sequentially.

The message processing unit 112 of the virtual device application 106 performing remote control on the computer terminal 100 stores the synchronization message received from the wired / wireless communication unit 102 in the message storage unit 113, and the synchronization processing unit 114. Reads the message and performs the processing according to its contents.

If the content of the message is the screen data of the mobile communication terminal 200, the multimedia processing unit 122 decodes this information and outputs it to the screen through the display unit 120. If the content of the message is audio information, the multimedia processing unit The information is decoded at 122 and output to the speaker through the audio processor 121.

The synchronization processing unit 114 of the virtual device application 106 transforms an event generated from the key input unit 123, the mouse input unit 124, and the audio processing unit 121 of the computer terminal 100 into a message format for remote control exchange. Store the message in the message storage unit 113.

The message processor 112 transmits the message to the wired / wireless communication unit 202 of the mobile communication terminal 200 through the wired / wireless communication unit 102.

The virtual device application 106 may download skin information of the web server 300 on the network through the network connection unit 110 or use skin information of the file system 125.

The mobile communication terminal 200 performs a remote control task through the remote control application 206.

Since the remote control application 206 of the mobile communication terminal 200 should be operated in real time in order not to put a load on the execution of other existing applications while the remote control is operated in real time, a simple task having a short processing time is performed. It is not necessary to operate in relatively real time with the message processing unit 212 to perform, the process is divided into a complicated synchronization processing unit 214, the information exchange between the two processes must be made asynchronously, first-in first-out (FIFO) form The message storage unit 213 having a queue structure is used.

The message processing unit 212 of the remote control application unit 206 stores the remote control message received from the wired / wireless communication unit 202 in the message storage unit 213, and the synchronization processing unit 214 reads the message content. And to perform the processing according to the above.

If the content of the message is key event information generated in the computer terminal 200, the key input unit 223 synchronizes with the key event of the mobile communication terminal 200.

If the content of the message is an event of the mouse device occurring in the computer terminal 100, the touch screen unit 224 synchronizes the touch screen event of the mobile communication terminal 200.

If the content of the message is audio information, the multimedia information is decoded through the multimedia processing unit 222 and the decoded information is converted into an audio input signal of the mobile communication terminal 200 through the audio processing unit 221.

The synchronization processing unit 214 of the remote control application 206 obtains screen output information from the display unit 220, encodes the information through the multimedia processing unit 222, and stores the information in the message storage unit 213.

The message processor 212 reads this information and transmits the information to the wired / wireless communication unit 102 of the computer through the wired / wireless communication unit 202.

The synchronization processing unit 214 of the remote control application 206 encodes the audio information generated from the audio processing unit 221 through the multimedia processing unit 222 and stores the audio information in the message storage unit 213. The message is read and transmitted to the wired / wireless communication unit 102 of the computer through the wired / wireless communication unit 202.

When the remote control application 206 requests the provision of the skin and user interface information from the virtual device application 106, the remote control application 206 delivers a skin (SKIN) file and a user interface information file stored in the file system 225. .

4 is a flowchart illustrating a method of remotely controlling a mobile communication terminal of a computer terminal according to an exemplary embodiment of the present invention.

As shown in FIG. 4, when the computer terminal 100 searches for a remotely controllable mobile communication terminal 200 through the virtual device application 106 (S300 and S302), the mobile communication terminal 200 may be used. Receive a wireless communication connection signal and transmits a response signal (S304).

The computer terminal 100 receives the response signal and displays a list of remotely controllable devices (S306).

When one device of the list is connected (S308, S310), the connected mobile communication terminal 200 transmits skin and user interface information (operation information, function information) necessary for remote control to the computer terminal 100 ( S312).

The computer terminal 100 receives the skin and user interface information transmitted from the mobile communication terminal 200 to configure a graphic user interface (GUI) (S316).

When the graphic user interface (GUI) to which the same skin is applied as the mobile communication terminal 200 is configured, the computer terminal 100 performs a synchronization operation so that the periodic control with the mobile communication terminal 200 and a constant phase relationship can be continued. It performs (S318, S320).

When the synchronization with the computer terminal 100 is completed, the mobile communication terminal 200 waits for a remote control signal (S322).

When the remote control event occurs from the computer terminal 100, the mobile communication terminal 200 performs an operation according to the present invention, and transmits an event for the operation state to the computer terminal 100 so as to be remotely controlled (S324). , S326).

The computer terminal 100 is configured to download the skin (SKIN) and user interface (UI) information by using the information of the mobile communication terminal 200 connected from the web server 300 to configure a graphical user interface (GUI). Do.

FIG. 5 is a diagram illustrating a configuration of skin information to be provided by a mobile communication terminal to a computer terminal in a preferred embodiment of the present invention, and FIG. 6 is a diagram of a mobile communication terminal provided to a computer terminal in a preferred embodiment of the present invention. FIG. 7 is a diagram illustrating user interface information of a mobile communication terminal, and FIG. 7 is a diagram showing message types exchanged between a computer terminal and a mobile communication terminal in a preferred embodiment of the present invention.

As shown in FIG. 5, the skin file includes a whole external image file of the mobile communication terminal 200, respective image files of all keys of the mobile communication terminal, and all keys of the mobile communication terminal 200. Each of the image files, the location information on the overall appearance image file of the key image of the mobile communication terminal 200, the position and size of the screen in the overall appearance of the terminal, is converted when the mouse cursor is located on the mobile communication terminal 200 It consists of the website URL where the mouse cursor image and skin information can be updated.

As shown in FIG. 6, the user interface information of the mobile communication terminal 200 includes a synchronization function (key input synchronization, touch screen synchronization, screen synchronization, audio signal synchronization) and key set information supported by the mobile communication terminal 200. (Information on the computer keyboard mapped to the key set of the mobile communication terminal 200), touch screen information (size and resolution of the touch screen), screen synchronization information (screen size and encoding information, number of supported frames), audio It consists of synchronization information (audio encoding information) and a high-level service list (high-performance services such as sending SMS, calling, and saving address book).

As shown in FIG. 7, the synchronization message includes control information (skin file / mobile communication terminal 200 operation information, standby mode entry and switching, remote control function (On / Off), input information (key operation information, mouse operation). Information), screen information, audio information, and high level service information.

As described above, the present invention does not directly manipulate various mobile communication terminals 200, but remotely connects to a device to be controlled by a desktop computer or a notebook computer, and uses a mobile communication terminal using an interface device of the computer terminal 100. By remotely manipulating the device 200, the user interface of the mobile communication terminal 200 can be overcome, thereby increasing the convenience of the user. In performing the remote operation, various devices can easily be standardized by simply standardizing a protocol or an interface method between devices. It is possible to provide a function, and through the virtual device application 106 having the same interface as the device to be remotely operated from the user's point of view, there is an effect that the remote control function can be used easily and intimately on a computer without learning a separate operation method. .

While the above has been shown and described with respect to preferred embodiments of the invention, the invention is not limited to the specific embodiments described above, it is usually in the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit of the present invention.

1 is a view showing the configuration of a remote control system of a mobile communication terminal via a computer terminal according to an embodiment of the present invention.

2 is a diagram illustrating an example of a UI of a virtual device application configured in a computer terminal according to an exemplary embodiment of the present invention.

3 is a block diagram showing the configuration of a computer terminal and a mobile communication terminal of the remote control system of a mobile communication terminal via a computer terminal according to an embodiment of the present invention.

4 is a flowchart illustrating a method of remotely controlling a mobile communication terminal of a computer terminal according to an exemplary embodiment of the present invention.

5 is a view showing the configuration information of the skin information to be provided by the mobile communication terminal to the computer terminal in a preferred embodiment of the present invention.

FIG. 6 is a diagram illustrating user interface information of a mobile communication terminal that a mobile communication terminal must provide to a computer terminal in a preferred embodiment of the present invention. FIG.

7 is a diagram showing the types of messages exchanged between a computer terminal and a mobile communication terminal in a preferred embodiment of the present invention.

Description of the Related Art [0002]

100: computer terminal 200: mobile communication terminal

300: web server

Claims (21)

A system for remotely controlling a mobile communication terminal capable of network connection with the computer terminal in a computer terminal capable of wired / wireless communication and internet connection, Connect and synchronize the mobile communication terminal by driving a virtual device application, configure a user interface (UI) to which the same skin is applied as the connected mobile communication terminal, and set the mobile communication terminal by key input through a mouse and a keyboard. A computer terminal operating remotely and receiving screen output data from the mobile communication terminal and outputting the screen output data on a screen in real time; And When connected to the computer terminal, a remote control application for receiving and synchronizing a remote control signal from the computer terminal is driven, operates by receiving a control signal of the computer terminal, and outputs screen output data according to the operation to the computer terminal. It includes a mobile communication terminal for transmitting, The virtual device application of the computer terminal, when connected to the mobile communication terminal, receives skin and user interface information from at least one of the mobile communication terminal and the web server to configure and display the same user interface as the connected mobile communication terminal. A mobile communication terminal remote control system in a computer terminal, characterized in that. The method of claim 1, And a web server for providing a virtual device application for remote control and synchronization with skin and user interface information to the computer terminal and the mobile communication terminal. delete 3. The method of claim 2, The computer terminal, A wired / wireless communication unit configured to receive synchronization and skin and user interface information through a wired / wireless communication connection with the mobile communication terminal; A key input unit and a mouse input unit for remotely operating the mobile communication terminal through the virtual device application; A display unit configured to display and configure a user interface to which the same skin as the mobile communication terminal is applied; A multimedia processing unit for decoding the message information received through the wire / wireless communication unit and outputting the decoded message information on the screen through the display unit; A network connection unit for receiving skin and user interface information of a mobile communication terminal connected through the Internet or a network connection; And An application for remotely controlling the mobile communication terminal is provided from the web server and is operated on the computer, and when the mobile communication terminal is connected, the skin (SKIN) and user interface information corresponding to the mobile communication terminal is connected to the mobile communication terminal. Or a virtual device application configured to receive from a web server to configure a graphical user interface (GUI) to be displayed on the display unit and to remotely control the mobile communication terminal according to a user's operation. Mobile terminal remote control system. 5. The method of claim 4, The computer terminal, And an audio processor for receiving audio data from the mobile communication terminal and outputting the audio data through a speaker. 5. The method of claim 4, The virtual device application, Message processing unit for performing a simple process to minimize the load of performing other applications according to the real-time remote control; A synchronization processor for processing a complex task without being operated in real time; And And a message storage unit having a first-in, first-out queue structure for exchanging information in an asynchronous manner with the message processing unit. The method of claim 1, The mobile communication terminal includes: A wired / wireless communication unit for synchronizing with a virtual device application through wired / wireless communication with the computer terminal; A file system for storing skin and user interface information of a mobile communication terminal to be transmitted to the computer terminal; An audio processor for receiving and processing at least one of audio and voice data from the computer terminal; A multimedia processing unit for decoding the multimedia information input from the computer terminal or encoding the screen output data; And And a remote control application for decrypting and executing the remote control information transmitted from the virtual device application and periodically transmitting screen information of the mobile communication terminal to the virtual device application. Control system. 8. The method of claim 7, And converting an audio input signal received from the computer into an input signal of a mobile communication terminal, or further comprising an audio processor for acquiring an audio output signal of the mobile communication terminal. Control system. 8. The method of claim 7, The remote control application, Message processing unit for performing a simple process to minimize the load of performing other applications according to the real-time remote control; A synchronization processor for processing a complex task without being operated in real time; And The synchronization processing unit is configured as a message storage unit having a first-in, first-out queue structure for exchanging information in an asynchronous manner with the message processing unit. The message processing unit stores the synchronization message received from the wired / wireless communication unit into a message storage unit, and the synchronization processing unit reads the stored messages sequentially and performs processing according to the contents of the message. system. 8. The method of claim 7, The remote control application synchronizes a key event of a mobile communication terminal through a key input unit of the mobile communication terminal when a content of a synchronization message delivered by the virtual device application is a key event generated in a computer. If the content of the message is an event of a mouse device, the message is synchronized with the touch screen event of the mobile communication terminal. If the content of the message is audio information, the multimedia information is decoded and the decoded information is decoded. Switching to the voice input of the mobile communication terminal through the audio processing unit, and encodes the screen output data or voice output data of the mobile communication terminal through the multimedia processing unit and periodically transmitted to the computer terminal, characterized in that the mobile communication terminal Remote control system. The method of claim 1, The computer terminal and the mobile terminal are connected in at least one of USB, Bluetooth, Zigbee, NFC, WIFI, and Ultra-WideBand. Mobile communication terminal remote control system in a computer terminal, characterized in that the. The method of claim 1, The virtual device application is a mobile communication terminal remote control system for a computer terminal, characterized in that for searching for the target mobile communication terminal to connect and the user to select a device to be controlled from among the mobile communication terminal found through the user's query. The method of claim 1, The virtual device application is a mobile communication terminal remote control system in a computer terminal, characterized in that to synchronize (sync) the screen synchronization information transmitted from the control target mobile communication terminal to the computer terminal screen. The method of claim 1, The virtual device application is a mobile communication terminal remote control system in a computer terminal, characterized in that for connecting / blocking the mobile communication terminal remote control state in the computer terminal. A method for remotely controlling a mobile communication terminal capable of network connection with the computer terminal in a computer terminal capable of wired / wireless communication and internet connection, The computer terminal connecting and synchronizing the mobile communication terminal by driving a virtual device application; Configuring, by the computer terminal, a graphic user interface (GUI) to which the same skin (SKIN) and user interface (UI) as the connected mobile communication terminal are applied; When the mobile communication terminal is connected to the computer terminal, running a remote control application for receiving and synchronizing a remote control signal from the computer terminal; Remotely operating the mobile communication terminal by key input via a mouse and a keyboard by the computer terminal; The mobile communication terminal receiving and operating a control signal of the computer terminal, and transmitting an event signal according to the operation to the computer terminal; And Receiving, by the computer terminal, screen output data from the mobile communication terminal and outputting the screen output data to a screen of the computer; If there is no skin and user interface information of the mobile communication terminal to which the virtual device application of the computer terminal is connected, downloading a skin and user interface information corresponding to the mobile communication terminal from a web server to configure a graphic user interface (GUI). A remote control method of a mobile communication terminal in a computer terminal. delete 16. The method of claim 15, And when the computer terminal receives audio data from the mobile communication terminal, outputting the audio data through a speaker. 16. The method of claim 15, The mobile communication terminal further comprises the step of switching to the audio input signal of the mobile communication terminal when receiving the audio signal from the computer terminal, and obtaining and outputting the audio output signal of the mobile communication terminal to the computer terminal Remote control method of mobile communication terminal in terminal. 16. The method of claim 15, The virtual device application is a remote control method for a mobile terminal in a computer terminal, characterized in that to synchronize the screen synchronization information transmitted from the control target mobile terminal to the computer terminal screen. 16. The method of claim 15, The virtual device application is a mobile communication terminal remote control method in a computer terminal, characterized in that for connecting / blocking the mobile communication terminal remote control state in the computer terminal. 16. The method of claim 15, The virtual device application may include at least one of a high-level remote of sending an SMS according to a high-level service list among user interface information provided by a mobile communication terminal, calling a phone number in an address book on a computer, and storing address information in the mobile communication terminal. A remote control method for a mobile communication terminal in a computer terminal, characterized in that for controlling.

Images