KR20130017406A - Server for supporting heterogeneous remote control service and method thereof - Google Patents

Abstract

PURPOSE: A heterogeneous remote control service supporting server and a method thereof are provided to switch a remote screen control service with a streaming service in an RDP(Remote Desktop Protocol) mode and a VNC(Virtual Network Computing) mode by considering a service providing environment for a terminal device. CONSTITUTION: A streaming service providing unit(230) provides a streaming service. A communication unit(250) communicates with a terminal device. A control unit(240) executes one or more applications related to an RDP service, a VNC service, or the streaming service. The control unit adaptively selects one or more services which are able to be used by the terminal device. The control unit provides the selected services to the terminal device. [Reference numerals] (210) RDP service providing unit; (220) VNC service providing unit; (230) Streaming service providing unit; (240) Control unit; (242) Switching unit; (244) Command processing unit; (246) Application implementing unit; (250) Communication unit; (252) RDP interface unit; (254) VNC interface unit; (256) Streaming interface unit; (260) Database

Description

Server and method for supporting heterogeneous remote control service

The present invention relates to a remote control service technology capable of providing a virtual desktop environment for a user terminal.

The use of virtual desktop services that provide data storage space and applications in the Internet space is increasing. Remote screen control methods that support these virtual desktop services include Remote Desktop Protocol (RDP) and Virtual Network Computing.

Remote Desktop Protocol (RDP) is a presentation protocol that allows a client to exchange information with a server device over a network. The server device runs the application program in response to a command remotely input by the client device, and the client device displays the driving state of the application program provided from the server device.

Virtual network computing is to provide a desktop environment from a computer anywhere on the Internet. Virtual network computing (VNC) clients and servers can be configured in a variety of environments, including Linux, Windows, and Mac computers. You can run an application under Linux and display its output in another Linux window. Java's clients can also provide a remote desktop environment from within a Web browser.

The VNC protocol method works by using the RFB (Remote Frame Buffer) protocol between the VNC server and the remote VNC client. In other words, if a server program (daemon) called a VNC server is placed on a server to be remotely controlled and monitored, the server is managed using a client program called 'VNC Viewer' anywhere a TCP / IP environment is supported. In addition, the VNC protocol is based on the concept of a remote frame buffer (RFB), which refers to a space for temporarily storing data to be displayed on a screen in a general graphical user interface (GUI) system. Therefore, when the contents of the frame buffer of the local system are updated, the VNC server delivers the changed contents to the frame buffer of the client computer using the VNC protocol, and the VNC viewer displays the contents on the screen of the client computer.

In general, a server providing a remote control service operates by using any one of an RDP method and a VNC method, making it difficult for user terminal devices having various specifications to use. In addition, an efficient data transmission method is required in the case of a reproduction service of multimedia content during a remote control service.

Provides RDP and VNC remote screen control services, and in consideration of service provision environment for terminal devices, enables switching between RDP and VNC remote screen control services and streaming services, optimizing for user terminals A server and method are provided for supporting heterogeneous remote control services that can provide advanced remote control services.

According to an aspect, a server supporting heterogeneous remote control services to a terminal device connected through a network may include: an RDP service providing unit providing an RDP service according to RDP, a VNC service providing unit providing a VNC service according to VNC, and a streaming service A streaming service providing unit for providing a communication unit, a communication unit for communicating with a terminal device and at least one application associated with at least one of an RDP service, a VNC service, and a streaming service, and available among the RDP service, VNC service, and streaming service. A control unit adaptively selects one service and provides the selected service to the terminal device.

The server stores a list of applications for each remote control service including a first application list driven in association with the RDP service, a second application list driven in association with the VNC service, and a third application list driven in association with the streaming service. And a database, wherein the controller switches to one of an RDP service, a VNC service, and a streaming service according to the type of application provided to the terminal device using a list of applications for each remote control service, and provides an application execution result. can do.

The controller may select the streaming service when the rate of change of the screen during the RDP service is equal to or greater than a preset threshold.

The controller may perform switching to select a streaming service when executing an additional program that provides a file of a format not provided by a currently running application.

Upon reception of a switching request message for selecting one of an RDP service, a VNC service, and a streaming service from the terminal device, the controller may select one of an RDP service, a VNC service, and a streaming service, and perform switching to the selected service. have.

 According to another aspect of the present invention, a method of supporting a remote control service of a server supporting heterogeneous remote control services may include selecting one of a RDP service, a VNC service, and a streaming service available to a terminal device connected to the server; Providing a service to the terminal device.

It provides a remote screen control service of the RDP method and VNC method, and in consideration of the service providing environment for the terminal device, it is possible to enable switching between the RDP method and the remote screen control service of the VNC method and the streaming service. Through this, it is possible to provide a server and a method for supporting heterogeneous remote control services capable of providing a remote control service optimized for a user terminal.

1 is a diagram illustrating a system for supporting heterogeneous remote control services to a terminal device connected through a network according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating an example of a configuration of a heterogeneous remote control service support server of FIG. 1.
FIG. 3 is a block diagram illustrating an example of a configuration of a terminal device that receives a remote control service from the heterogeneous remote control service support server of FIG. 1.
4 is a flowchart illustrating a heterogeneous remote control service supporting method according to an embodiment of the present invention.

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. In addition, the terms described below are defined in consideration of the functions of the present invention, and this may vary depending on the intention of the user, the operator, or the like. Therefore, the definition should be based on the contents throughout this specification.

1 is a diagram illustrating a system for supporting heterogeneous remote control services to a terminal device connected through a network according to an embodiment of the present invention.

The system 100 supporting heterogeneous remote control services includes a plurality of terminal devices 120 connected to the server 110 through heterogeneous remote control service support servers 110 (hereinafter referred to as servers) and a network 10. 130, 140).

The plurality of terminal devices 120, 130, and 140 may be various heterogeneous user terminals, such as personal computers, laptop computers, smartphones, mobile phones, Internet Protocol Television (IPTV), and set-top boxes. Although three terminal devices 120, 130, and 140 are illustrated in FIG. 1, the number of terminal devices is not limited. In addition, the plurality of terminal devices 120, 130, and 140 may be configured to use different remote control services, respectively. For example, the first terminal device 120 is configured to use both the remote control service according to the RDP and VNC, the second terminal device 130 is configured to use only the remote control service according to the RDP, The third terminal device 140 may be configured to only use the remote control service according to the VNC.

The server 110 provides a virtual desktop environment for the plurality of terminal devices 120, 130, and 140. The server 110 executes an application requested by each of the plurality of terminal devices 120, 130, and 140 through communication from each of the plurality of terminal devices 120, 130, and 140, and displays a screen indicating an application execution result. Provided to a plurality of terminal devices (120, 130, 140), respectively. The server 110 may be implemented as a fixed computer or a mobile computer, and is not limited to a particular type of device.

The server 110 may provide a remote control service suitable for the terminal devices 120, 130, and 140 regardless of whether the remote control service available to the heterogeneous terminal devices 120, 130, and 140 is RDP or VNC. . In addition, the server 110 may provide the terminal devices 120, 130, and 140 based streaming service based on Real Time Transport Protocol / Real Time Transport Control Protocol (RTP / RTCP) and Real Time Streaming Protocol (RTSP). . The server 110 according to the specification of the terminal devices (120, 130, 140), the state of use of the remote control service, the remote control service using environment of the terminal devices (120, 130, 140), RDP service according to RDP, One of a VNC service and a streaming service according to VNC may be selected and provided. Hereinafter, for convenience of description, the operation will be described based on the operation of the first terminal device 120.

The first terminal device 120 drives the remote control service application of the first terminal device 120 to use the remote control service of the server 110. For example, when the first terminal device 120 executes an RDP application that operates as an RDP client and accesses the server 110, the server 110 accesses the remote control service being used by the connected terminal device 120. Check with the RDP service and act as an RDP server. When the first terminal device 120 executes a VNC application that operates as a VNC client and accesses the server 110, the server 110 identifies the remote control service being used by the connected terminal device 120 as a VNC service. Can be operated as a VNC server. In addition, the server 110 may provide an application execution result as a streaming service according to a request of the first terminal device 120. As such, the server 110 may check the state of the terminal device 120 to execute a remote control service suitable for the terminal device 120.

In addition, the server 110 may switch the RDP service to a streaming service in consideration of an application being provided to the terminal device 120 through a remote control service and a screen change amount of an application execution result.

As described above, the server 110 may consider a remote control service in which the terminal device 120 is running, an application running in the actual server 110 through a remote control service, or characteristics of application execution result screen data. The remote control service may be adaptively selected in operation 120 and switching may be performed to operate a module that performs the selected remote control service. Through this, the terminal device 120 does not go through the process of confirming the specification, performance or capability of the remote control service of the server 110, and also sets a specific remote control service suitable according to the situation of the terminal device 120. Without operation, the remote control service provided by the server 110 can be used.

FIG. 2 is a block diagram illustrating an example of a configuration of the heterogeneous remote control service support server 110 of FIG. 1.

The server 110 includes an RDP service provider 210, a VNC service provider 220, a streaming service provider 230, a controller 240, a communicator 250, and a database 260.

The RDP service providing unit 210 provides an RDP server that provides an RDP service such as session management such as session connection and disconnection with an RDP client according to RDP, and encoding of screen and / or audio data to be provided to the RDP client by the server 110. Corresponds to. In addition, the RDP service provider 210 may remotely access and control the RDP service provider 210 of the server 110 in a terminal device corresponding to the RDP client. In addition, the RDP service provider 210 may check and control a communication state, a client state, and the like, such as a Real Time Control Protocol (RTCP) Receiver Report (RR) / Sender Report (SR) using the RDP extension protocol.

The VNC service provider 220 may manage sessions such as session connection and disconnection with the terminal device 120 corresponding to the VNC client according to VNC, screens to be provided to the VNC client (ie, the terminal device) by the server 110, and / Or a VNC server providing a VNC service such as encoding of audio data. In addition, the VNC service provider 220 provides an RFB protocol to remotely access and control the VNC service provider 220 from a VNC client, and provides an extended RFB protocol to process commands such as a keyboard and a mouse. .

The controller 240 may be configured to perform at least one application associated with at least one of an RDP service, a VNC service, and a streaming service. The controller 240 adaptively selects one service available to the terminal device among the RDP service, the VNC service, and the streaming service, and switches to one of the RDP service, the VNC service, and the streaming service so that the selected service is provided to the terminal device. . The control unit 240 may identify the port information receiving the signal transmitted from the terminal device currently connected in the communication unit 250, and check the type of remote control service available to the currently connected terminal device.

The controller 240 controls the communication unit 250 so that one of the RDP service provider 210, the VNC service provider 220, and the streaming service provider 230 that performs the selected service communicates with the terminal device 120. can do.

The communication unit 250 may be configured to include a plurality of wired and wireless communication interfaces to enable communication with heterogeneous terminal devices. The communication unit 250 may include an RDP interface unit 252 for communicating with the RDP client, a VNC interface unit 254 for communicating with the VNC client, and a streaming interface unit 256 for communicating with the streaming client.

The database 260 may include a physical memory for storing various types of applications for providing a remote desktop service to a terminal device, data stored by the terminal device, and the like. The database 260 may store a list of applications for each remote control service. The application list per remote control service is driven in association with a streaming service and a first application list representing at least one application driven in association with the RDP service, a second application list representing at least one application driven in association with the VNC service and It may include a third application list indicating at least one application.

For example, the first application list may include an Internet Explorer browser program, the second application list may include a Microsoft Office program, a mail program, and the like, and the third application list may include at least one streaming player program. . Each application list is not limited thereto, and the list may be modified, updated, and deleted according to a request of the terminal device or according to a configuration change.

The controller 240 may include a switching unit 242, a command processor 244, and an application execution unit 246.

The switching unit 242 adaptively selects one service available to the terminal device among the RDP service, the VNC service, and the streaming service, and switches to one of the RDP service, the VNC service, and the streaming service so that the selected service is provided to the terminal device. . For example, the switching unit 242 transmits the type of service session requested by the first terminal device 120 to the first terminal device (eg, an RDP session, a VNC session, or a streaming service session). The first terminal device 120 may select a service corresponding to a service session currently requested by the first terminal device 120 from among an RDP service, a VNC service, and a streaming service. Then, the switching unit 242 is a module that provides the selected service, that is, the module selected from the RDP service providing unit 210, VNC service providing unit 220 and streaming service providing unit 230 to the communication unit 250 It may be controlled to transmit and receive a control signal with the first terminal device 120 connected through.

The switching unit 242 monitors a predetermined situation, for example, an application type being provided and a screen characteristic being provided, for a terminal device currently providing a service, and switches an existing service to another service according to the result. Can be.

The switching unit 242 may switch to one of an RDP service, a VNC service, and a streaming service based on the type of application executed by the application execution unit 246. The switching unit 242 may switch to one of an RDP service, a VNC service, and a streaming service according to the type of application using the application list for each remote control service stored in the database 260 to provide an application execution result. .

The switching unit 242 may monitor the rate of change of the screen provided to the terminal device through the application, and switch the RDP service to the streaming service based on the rate of change of the monitored screen. In detail, the switching unit 242 may select the streaming service when the rate of change of the screen during the provision of the RDP service is greater than or equal to a preset threshold. Here, the threshold value may be set by an operator of the server 110 or may be set according to a monitoring result of communication efficiency or performance according to the rate of change of the screen of the server 110.

In addition, the switching unit 242 may perform switching so that the streaming service is selected when executing an additional program that provides a file of a format not provided by a currently running application. For example, a web page is currently provided to the first terminal device 120 on the Internet Explorer through the RDP service providing unit 210, and a web plug-in program for providing multimedia content is provided in the web page. If detected as, the switching unit 242 may control the streaming service provider 230 to process the multimedia content through the web plug-in program to provide as a streaming service.

The switching unit 242 selects one of an RDP service, a VNC service, and a streaming service and switches to the selected service according to the reception of a switching request message requesting selection of one of an RDP service, a VNC service, and a streaming service from a terminal device. You can also do

The command processing unit 244 may receive a command including request information including a command such as an application control of the terminal device, for example, the first terminal device 120, received through the RDP interface unit 252. The 210 may convert the form into a processable form and transmit the converted form to the RDP service provider 210. In addition, the command processing unit 244 converts a command including the request information of the terminal device received through the VNC interface unit 254 into a form that the VNC service providing unit 214 can process to the VNC service providing unit 220. I can deliver it. In addition, the command processing unit 244 processes the command including the playback related control request information such as the playback stop, playback start, playback speed, etc. of the terminal device received through the streaming interface unit 256, the streaming service provider 230 It can be converted into a possible form and delivered to the streaming service provider 230.

The application executor 246 may be configured to perform various kinds of applications for providing a virtual desktop infrastructure (VDI) based service to be provided to terminal devices. Applications can vary from document writing applications, Internet browsers, content creation applications, data management applications, and the like.

3 is a block diagram illustrating an example of a configuration of a first terminal device 120 that receives a remote control service from a heterogeneous remote control service support server of FIG. 1.

The first terminal device 120 may include an RDP processor 310, a VNC processor 320, a streaming processor 330, a controller 340, a communication unit 350, a user input unit 360, a display unit 370, and a storage unit ( 380).

The RDP processing unit 310 corresponds to an RDP client and provides an interface for allowing a user to remotely access and control the RDP service providing unit 210 of the server 110. The operation result of the server 110 received through the communication unit 350 based on the RDP processing unit 310 is converted into information in a form that can be displayed by the display unit 370 in the control unit 340 or the RDP processing unit 310 to be displayed. Can be.

The VNC processor 320 corresponds to a VNC client, and provides an RFB protocol so that a user can remotely access and control the VNC service provider 220 of the server 110. The operation result of the server 110 received through the communication unit 350 based on the VNC processing unit 320 is converted into information in a form that can be displayed by the display unit 370 in the control unit 340 or the VNC processing unit 320 to be displayed. Can be.

The streaming processor 330 corresponds to a streaming client, and processes the streaming provided by the server 110 to convert the display unit 370 into a displayable form. The streaming processor 330 may drive at least one streaming player program for processing and displaying the received stream, and a dedicated streaming player for the server 110 may be used.

Although the first terminal device 120 is illustrated as including both the RDP processing unit 310, the VNC processing unit 320, and the streaming processing unit 330, in the case of another terminal device using the server 110, the RDP processing unit 310 is included. It may include only at least one of the VNC processing unit 320 and the streaming processing unit 330.

The control unit 340 may include an RDP processing unit 310, a VNC processing unit 320, a streaming processing unit 330, a communication unit 350, a user input unit 360, a display unit 370, and a storage unit of the first terminal device 120. It is configured to transmit and receive data with the 380, it is possible to control the overall operation of the first terminal device 120. The controller 340 may process a packet of the server 110 received through the communication unit 350, and provide the processed packet to a user.

In detail, when the first terminal device 120 uses the remote control service of the server 110, the control unit 340 currently operates the remote control service processing unit, that is, the RDP processing unit 310 and the VNC processing unit 320. Alternatively, the communication unit 352 may establish a remote control service session in progress with the user input signal from the user input unit 360 so that the remote control service is performed by the server 110 in response to the user input signal in association with the streaming processor 330. It may be delivered to the server 110 via the interface 352, 354 or 356. In addition, the controller 340 is connected to the RDP processing unit 310, the VNC processing unit 320 or the streaming processing unit 330 remotely received from the server 110 through the interface 352, 354 or 356 of the communication unit 352 The processing result of the control service may be provided to the user through the display unit 370.

The communication unit 350 may include a plurality of wired and wireless communication interfaces. The communication unit 350 may include an RDP interface unit 352, a VNC interface unit 354, and a streaming interface unit 356.

The user input unit 360 transmits a user input signal to the controller 340. The user input unit 360 may be configured in various forms such as a keypad, a touch pad, a mouse, and a touch screen. When the user input unit 360 is configured as a touch pad or a touch screen, the user input unit 360 may be configured to receive and process various types of single gestures and multiple gestures.

The display unit 370 displays a screen of the server 110 received through the communication unit 350 through a remote control service. Although not shown, the first terminal device 120 may further include a speaker or the like capable of outputting the application processing result of the server 110 or audio data included in the streaming data.

The storage unit 380 stores an operating system, an application, and various types of data required for driving the first terminal device 120.

4 is a flowchart illustrating a heterogeneous remote control service supporting method according to an embodiment of the present invention.

When the terminal device connects, the server 110 supporting heterogeneous remote control services checks the remote control service available to the terminal device 120 (410). For convenience of explanation, it is assumed that the connected terminal device is the first terminal device 120.

The server 110 selects one service available to the first terminal device 120 connected to the server 110 among the RDP service, the VNC service, and the streaming service (420), and switches to the selected service (430). One service available to the first terminal device 120 may be a service requested by the first terminal device. For example, the first terminal device 120 may identify the service session requested by using port information or communication interface information, and may select and switch a service capable of providing the identified service session. In addition, one service available to the first terminal device 120 may be selected based on the type of application provided to the terminal device or the rate of change of the screen provided to the first terminal device 120. May be switched to another service. For example, the server 110 may monitor the rate of change of the screen while providing the RDP service to the first terminal device 120, and if the rate of change of the screen is greater than or equal to a preset threshold, select the streaming service to provide the streaming service with the first service. It may be provided to the terminal device 120.

Through this, a service session according to the selected remote control service is established with the terminal device 120, and the server 110 provides the selected service to the terminal device according to a control signal from the first terminal device 120 (440).

One aspect of the present invention may be embodied as computer readable code on a computer readable recording medium. The code and code segments implementing the above program can be easily deduced by a computer programmer in the field. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored. Examples of the computer-readable recording medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical disk, and the like. The computer-readable recording medium may also be distributed over a networked computer system and stored and executed in computer readable code in a distributed manner.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention. Therefore, the scope of the present invention should not be limited to the above-described embodiments, but should be construed to include various embodiments within the scope of the claims.

Claims (8)

A server that supports heterogeneous remote control services to terminal devices connected through a network,
An RDP service provider for providing an RDP service according to the RDP;
A VNC service provider for providing VNC services according to VNC;
A streaming service provider for providing a streaming service;
A communication unit communicating with the terminal device; And
Perform at least one application associated with at least one of the RDP service, the VNC service, and the streaming service, and adaptively select one of the RDP service, the VNC service, and the streaming service available to the terminal device And a controller for providing the selected service to the terminal device. The method of claim 1,
Storing an application list for each remote control service including a first application list driven in association with the RDP service, a second application list driven in association with the VNC service, and a third application list driven in association with the streaming service. A database;
The control unit switches to one of the RDP service, the VNC service, and the streaming service according to the type of application provided to the terminal device by using the application list for each remote control service, and provides a result of performing the application. Server characterized in that. The method of claim 1,
The controller selects the streaming service when the rate of change of the screen during the RDP service is more than a preset threshold. The method of claim 1,
The controller, when executing an additional program for providing a file of a format that is not provided by the currently running application, the server, characterized in that for switching so that the streaming service is selected. The method of claim 1,
In response to receiving a switching request message for selecting one of the RDP service, the VNC service, and the streaming service from the terminal device, the controller selects one of the RDP service, the VNC service, and the streaming service, Server for switching to the selected service. As a method of supporting a remote control service of a server supporting heterogeneous remote control services,
Selecting one service available to a terminal device connected to the server among an RDP service, a VNC service, and a streaming service; And
Providing the selected service to the terminal device. The method according to claim 6,
Selecting one of the RDP service, the VNC service and the streaming service available to the terminal device connected to the server,
And the type of application being provided to the terminal device through the remote control service. The method according to claim 6,
Monitoring a rate of change of a screen while providing the RDP service; And
And if the rate of change of the screen is equal to or greater than a preset threshold, providing the streaming service to the terminal device by selecting the streaming service.

Images