WO2012124862A1

WO2012124862A1 - System and method for virtualization service between heterogeneous server/client

Info

Publication number: WO2012124862A1
Application number: PCT/KR2011/004634
Authority: WO
Inventors: 정민재; 류승호
Original assignee: Chung Minjae; Ryu Seoungho
Priority date: 2011-03-16
Filing date: 2011-06-24
Publication date: 2012-09-20
Also published as: KR20120105688A

Abstract

The present invention relates to a system and a method for a virtualization service between a heterogeneous server/client, which can enhance efficiency, reduce power consumption and remarkably reduce maintenance costs of the server in comparison with an existing manner by encoding and packet-processing video data and voice data in real time through a high-efficient parallel processing manner of a GPU connected to a CPU in the service supply server including various contents, and transmitting the encoded and packet-processed data in a streaming manner. In addition, the data streamed through the server is decoded and executed by a GPU connected to a CPU of a client terminal so that the client terminal can be used as a device which requires only the minimum computing resources for using the contents, so as to minimize the initial construction costs of the client terminal, and to miniaturize, reduce power consumption and reduce the weight thereof.

Description

Heterogeneous server / client virtualization service system and method

The present invention relates to a heterogeneous server / client virtualization service system and method, and more particularly, to a client terminal for video, audio, and input / output data that is calculated in real time by a service providing server equipped with various contents and transmitted through a streaming method. General-Purpose Computing on Graphics Processing Units (GPGPU) technology, in conjunction with GPUs, encodes, decodes, and packetizes and executes the GPU, enabling client terminals to be used as devices that require minimal computing resources to use content. A heterogeneous server / client virtualization service system and method for enabling the same.

Recently, cloud and mobile computing services have attracted great attention as a trend that will lead the future of information and communication technology.

At this point, each IT company is researching and releasing new business models according to the above trends, but the cloud computing field has not changed much in the existing environment compared to the mobile field.

For example, conventionally used computing service environments, cloud and mobile computing service environments are as follows.

First, a conventional computing service environment may be broadly classified into a local service environment, a network service environment, and a real-time virtualization service environment between servers and clients.

Here, in the local service environment, programs such as programs already installed in the client terminal and contents such as files and media are provided without any network configuration through local resources. In addition, in the case of a network service environment, when all or part of programs and data are installed in a local client terminal, most of them provide services using local resources while exchanging data in asynchronous or synchronous manner. In addition, the server / client virtualization service environment uses the resources of the server, transmits after loss compression and synchronization of the contents in the server, and performs the service through the resources of the client terminal.

Next, the cloud and mobile computing service environment can be divided into two categories from the viewpoint of receiving the service.

In other words, it is the distinction between corporations and individuals on which organizations such as government and corporations are based. Recently, domestic and foreign governments and companies are trying to develop and accept the need for cloud and mobile based smart work and various services in an active form rather than a passive position. Such movements are manifested internally in the form of server-based virtual desktop services and mobile offices, and are pioneering new channels through mobile finance, games, shopping, content, and advertisements. In addition, for the personal use, external storage devices, backup services, etc. are typical, and programs can be downloaded and installed individually on a mobile or desktop, and then financed, games, shopping, and contents can be independently or through a network connection with a server. , Advertising and other services are provided.

Here, cloud services can be basically classified into IaaS, PaaS, SaaS, etc., and those who receive these services will be able to select, build, develop, and deploy the most efficient, convenient, and cost-saving method. However, services through this approach cannot provide unified support for various platforms, and must use separate methods for the development, distribution, and use of programs and content. In addition, mobile services are similar to the above cloud services, and the development, distribution, and use of programs and contents are carried out in different ways, locally and over the network, without platform unification.

As a result, these system architectures, infrastructures, and platform configurations result in a situation in which neither a service provider nor a service provider can be unified, and services are provided through separate program and individual program installation on each client terminal. In this case, the costs of separate development, patching, distribution, and distribution are incurred, while unification and program recycling are not easy. In addition, the consumer side must purchase, manage and use the same program or content for each platform individually, and it is impossible to synchronize between terminals.

That is, in the conventional server / client virtualization service method, the client terminal must have its own computing environment equipped with a CPU and an OS, and an application that can receive and process data of the virtualization server must be additionally installed. Decoding uses the SW method using only CPU resources, which not only slows down the processing of a large amount of data such as video in real time but also causes a load on CPU resources.

In other words, the conventional virtualization service method drops a frame or streams video and audio information in a proprietary format through lossy compression using only CPU resources to service a client terminal. Relatively high, real-time compressed streaming of dynamic video such as videos or games is not smooth and excessive use of server / client resources is inefficient and high power consumption, especially due to the service provider's proprietary format. There is a problem in that the platform of the server and the client is limited because only SW is used.

Therefore, both suppliers and consumers need to solve the conventional problems in all areas of supplying and consuming programs and contents, and to reduce costs and secure platform-independent flexibility through operational efficiency and elimination of redundant costs. Therefore, the configuration of such a system architecture is required.

SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and the object thereof is not only a server / client CPU resource, but also a digital content service and an end point of all computing environments through video, audio, and input / output. Heterogeneous server / client-to-client virtualization service system that requires minimal computing resources for client terminals to use content through high-efficiency parallel encoding / decoding and packet processing technology utilizing GPU's superior floating point arithmetic with GPGPU technology. To provide a way.

Heterogeneous server / client-to-client virtualization service system according to an aspect of the present invention for achieving the above object, the client terminal for requesting content related to video and audio to the service providing server 300 through the Internet network 200 ( And a service providing server 300 for providing contents related to video and audio requested from the client terminal 100, wherein the client terminal 100 is a CPU. And a GPU 160 for compressing content request data in connection with 170 or decompressing a content result transmitted from the service providing server 300, wherein the service providing server 300 is connected to the CPU 380. The content transmitted from the client terminal 100 is decompressed or transmitted to the client terminal 100. It includes a GPU (360) to compress the output.

Preferably, the client terminal 100, the interface unit 110 for exchanging information with the service providing server 300, the input unit 120 for retrieving content information and input a request signal, and the service provision And a display unit 130 for outputting an image of the content result provided from the server 300 and a voice output unit 140 for outputting the voice of the content result.

More preferably, the GPU 160 of the client terminal 100 includes an encoding unit 161 for encoding content request data through the input unit 120 in association with a CPU 170, and the service providing server 300. It further comprises a decoding unit 163 for decoding the content transmitted from the).

More preferably, the GPU 160 further includes a packet processor 165 for setting and releasing packets of content request data from the client terminal 100 and content output from the service providing server 300.

In addition, the service providing server 300, the interface unit 310 for exchanging information with the client terminal 100, and the service providing server in advance to update information related to the content according to the request of the client terminal 100 in advance. An input unit 320 for generating the 300, an output unit 330 for outputting a screen for inputting update information related to the contents, and operation information for operating the service providing server 300; The storage unit 340, and the content DB 350 for storing the content results provided by the request of the client terminal 100.

Preferably, the GPU 360 of the service providing server 300 includes a decoding unit 362 for decoding the content request data transmitted from the client terminal 100, and a result of the content transmitted to the client terminal 100. And an encoding unit 364 for encoding a packet, and a packet processing unit 366 for releasing and setting a packet of input data requested from the client terminal 100 and a content result transmitted from the service providing server 300.

More preferably, the service providing server 300 further includes a streaming processor 370 for streaming the content result encoded through the GPU 360 to be transmitted to the client terminal 100.

On the other hand, heterogeneous server / client-to-client virtualization service method according to another aspect of the present invention for achieving the above object, (A) the client terminal 100 is provided from the service providing server 300 via the Internet network 200 Inputting request data for content to be received (S510); (B) compressing the content request data by the GPU (160) of the client terminal (100) in association with the CPU (170); (C) transmitting, by the client terminal (100), the content request data compressed through the step (B) to a service providing server (S516) (S516); (D) the service providing server 300 receives the content request data from the client terminal 100, and the GPU 360 of the service providing server 300 cooperates with the CPU 380 to compress the compressed content. Decompressing request data (S520); (E) reading, by the CPU 380 of the service providing server 300, the content result according to the content request data decompressed through the step (D) (S522); (F) compressing the resultant content read through the step (E) by the GPU 360 of the service providing server 300 in cooperation with the CPU 380 (S524); (G) transmitting, by the service providing server (300), the result of the compressed content through the step (F) to the client terminal (S530); (H) The client terminal 100 receives the encoded content result from the service providing server 300, and the GPU 160 of the client terminal 100 cooperates with the CPU 170 to compress the compressed content. Decompressing the result (S534); And (I) the client terminal 100 outputting an image or an audio according to the decompressed content result through the step (H) (S536).

Preferably, between the steps (B) and (C), (B1) the GPU 160 of the client terminal 100 packetizes the compressed content request data through a packet processing unit 165 ( S514) is further included.

More preferably, between the steps (C) and (D), the step (C1) GPU (360) of the service providing server 300 releases the packet setting of the content request data through the packet processor 366 (S518) is further included.

More preferably, between the steps (F) and (G), (F1) the content of the GPU 360 of the service providing server 300 is compressed through the step (F) through the packet processor 366 Packetizing the resultant data (S526) is further included.

In addition, at the same time as the step (F1), (F2) the streaming processing unit 370 of the service providing server 300 in the client terminal 100 in real time by streaming the result of the compressed content through the step (F) It is preferable to further include the step (S528) to enable the reproduction.

Preferably, between the steps (G) and (H), (G1) the GPU 160 of the client terminal 100 releases the packet setting of the compressed content result through the packet processor 165 ( S532) is further included.

According to the heterogeneous server / client virtualization service system and method according to the present invention, the processing of all contents is performed by the service providing server, and the client terminal decodes the data transmitted from the service providing server through an input / output signal, thereby making video and audio. Since only the output is required, the service can be performed regardless of the platform with the minimum computing resources, thereby achieving miniaturization and lightening of the client terminal.

In addition, by using high efficiency parallel encoding / decoding and packet processing technology that utilizes the GPU's superior floating-point arithmetic capability through GPGPU technology as well as server / client CPU resources, the application is more efficient with relatively lower CPU resources. Program execution and faster response and lower power can be achieved.

In addition, the service provider can integrate the platform providing the service regardless of the service method into the service providing server, and the data can be integrated and delivered through one service and program regardless of the device and OS. In addition, maintenance costs and time can be significantly reduced, and all user actions take place on the server rather than on the client terminal, preventing intrusion and illegal downloads such as security or viruses.

In addition, the service user can receive the same service in any environment and can synchronize in real time without having to purchase various platforms, OSs and SWs in terms of computing resource and content consumption. . In addition, there is no need for additional initial and maintenance costs to build each client terminal as before, and by delegating the service to a supplier, it is possible to continuously receive professional services without the intermediate structure and time costs. . In addition, in terms of program and content consumption, it is possible to receive a higher level of service at a lower cost than before by reducing the processes and costs that are delivered through a change in distribution or usage.

Other objects and advantages of the present invention in addition to the above object will be apparent from the detailed description of the embodiments with reference to the accompanying drawings.

1 is a diagram schematically showing a heterogeneous server / client-to-client virtualization service system according to an aspect of the present invention.

2 is a view showing in detail the configuration of FIG.

3 is a flowchart illustrating a heterogeneous server / client virtualization service method according to another aspect of the present invention.

Hereinafter, a heterogeneous server / client virtualization service system and method according to the present invention will be described in detail with reference to the accompanying drawings.

First, a heterogeneous server / client virtualization service system according to an aspect of the present invention will be described.

FIG. 1 is a diagram schematically illustrating a heterogeneous server / client virtualization service system according to an aspect of the present invention, and FIG. 2 is a diagram illustrating the configuration of FIG. 1 in detail.

As shown in FIG. 1 and FIG. 2, the server / client virtualization service system according to an aspect of the present invention includes a client terminal 100, an internet network 200, and a service providing server 300.

The client terminal 100 is a smart phone, tablet, netbook, laptop, desktop computer, mobile terminal, MP3, game machine to search and request content related to video and audio to the service providing server 300 through the Internet network 200 , A terminal such as an IPTV and a PMP, etc., comprising an interface unit 110, an input unit 120, a display unit 130, a voice output unit 140, a storage unit 150, a GPU 160, and a CPU 170. do.

In detail, the interface unit 110 is a gateway for exchanging information by supporting a plurality of communication protocols required for data transmission and reception with the service providing server 300 through the Internet network 200.

The input unit 120 searches for video and audio related content information desired by a user of the client terminal 100 and requests the service providing server 300 such as a keyboard, a mouse, a touch pad, a joystick, a remote controller and a cam camera. Means.

The display 130 is a means such as a PDP, an LCD, a CRT, or the like for outputting content related to an image provided from the service providing server 300.

The voice output unit 140 is a means such as a speaker for outputting content related to voice provided from the service providing server 300.

The storage unit 150 stores an embedded OS for operating the client terminal 100 only as a player device.

The GPU (Graphics Processing Unit) 160 compresses the input data requested from the client terminal 100 or decompresses the data transmitted from the service providing server 300 in cooperation with the CPU 170 through GPGPU technology and performs packet processing. A graphics processing unit for accelerating and processing image information through floating-point arithmetic operations, comprising: an encoding unit 161 for encoding content request data through the input unit 120, and decoding contents transmitted from the service providing server 300. A decoding unit 163 and a packet processing unit 165 for setting and releasing packets of input data requested from the client terminal 100 and contents from the service providing server 300 are included.

The central processing unit (CPU) 170 controls the interface unit 110, the input unit 120, the display unit 130, the audio output unit 140, the storage unit 150, and the GPU 160 to provide a service. It provides a video and audio of the content transmitted from the server 300.

Meanwhile, the Internet network 200 is a wireless network such as a TCP / IP protocol that can be connected by wire through a variety of computing devices and a WAP protocol that can be wirelessly connected, and includes LAN, Wi-Fi, 3G / 4G, and Bluetooth. It is a relay network including.

In addition, the service providing server 300 may include a plurality of service providers such as a virtual desktop center, a web operating center, a broadcasting station center, and a game center that provide content related to video and audio requested from the client terminal 100 through the Internet network 200. As a personal computing device of an enterprise that can act as a physical or virtual cloud center or server, the interface unit 310, the input unit 320, the output unit 330, the storage unit 340, the content DB 350, The GPU 360, the streaming processor 370, and the CPU 380 are configured.

Specifically, the interface unit 310 is a gateway for exchanging information by supporting a plurality of communication protocols required for data transmission and reception with the client terminal 100 through the Internet network 200.

The input unit 320 is a means for generating, in advance, update information related to video and audio content according to a request of the client terminal 100 in the service providing server 300.

The output unit 330 outputs an input screen and various display screens for inputting update information related to video and audio contents.

The storage unit 340 stores operation information such as a platform and an OS for operating a service providing server.

The content DB 350 is a database that stores video and audio related contents provided at the request of the client terminal 100, for example, Linux applications, window applications, video and audio contents, and game contents.

The GPU 360 decompresses the content request data transmitted from the client terminal 100 in cooperation with the CPU 380, or compresses the video and audio related content transmitted to the client terminal 100 and accelerates the packet processing. Graphic processing means for processing information, comprising: a decoding unit 362 for decoding content request data transmitted from the client terminal 100, an encoding unit 364 for encoding a content result transmitted to the client terminal 100; And a packet processor 366 for releasing and setting a packet of the input data requested from the client terminal 100 and the content transmitted from the service providing server 300.

In this case, in the present specification, the GPU 360 is used as a means for processing video information by decompressing or compressing video and audio-related content in conjunction with the CPU 380 and accelerating packet processing. If the same function as 360) can be replaced by a digital signal processor (DSP) or an encoding / decoding chipset.

The streaming processor 370 processes the real-time encoded video and audio content through the encoding unit 364 of the GPU 360 to be transmitted to the client terminal 100 in real time.

The CPU 370 controls the interface unit 310, the input unit 320, the output unit 330, the storage unit 340, the content DB 350, the GPU 360, and the streaming processor 370 to control the client terminal. Provide content requested from 100.

Hereinafter, a heterogeneous server / client virtualization service method according to another aspect of the present invention will be described with reference to the above-described drawings and FIG. 3.

First, the client terminal 100 inputs request data for content to be provided from the service providing server 300 through the internet network 200 (S510).

In this case, the content may be a Linux application, a window application, video and audio content and game content provided from the service providing server 300, and the service method is video, audio and input / output data output from the service providing server. It is a method of streaming by encoding in real time, and also includes streaming content that is already stored according to the service method. At this time, the stored video contents are files with extensions such as avi, mpeg, asf, wmv, mkv, dv, and mov, and audio contents are wav, ape, flac, ra, mp3, wma, ogg, asf, mid, etc. For example, a file, an image, or a document file having the extension of may be used.

Next, the GPU 160 of the client terminal 100 compresses and encodes the content request data of step S510 in cooperation with the CPU 170 (S512).

Next, the GPU 160 packetizes the encoded content request data through the packet processor 165 (S514).

Thereafter, the client terminal 100 transmits the packetized content request data to the service providing server 300 through the interface unit 110 and the internet network 200 in step S514 (S516).

On the other hand, the service providing server 300 receives the content request data from the client terminal 100 through the interface unit 310, and in conjunction with the CPU 380 through the packet processor 366 of the GPU 360 The packet setting of the encoded content request data is released (S518).

Next, the GPU 360 of the service providing server 300 decompresses and decodes the encoded content request data in association with the CPU 380 (S520).

Next, the CPU 380 of the service providing server 300 reads content according to the content request data decoded through the step S520, for example, any one of a Linux application, a window application, video and audio content, and game content. (S522).

Subsequently, the GPU 360 of the service providing server 300 compresses and encodes the content result read through the step S522 in association with the CPU 380 (S524).

Thereafter, the GPU 360 of the service providing server 300 packetizes data of the content result encoded in step S524 through the packet processor 366 in cooperation with the CPU 380 (S526).

At this time, the streaming processing unit 370 of the service providing server 300 at the same time as the step S526 to stream the encoded video and audio-related content results in real time through the step S524 to be reproduced in real time on the client terminal 100 (S528).

Subsequently, the service providing server 300 transmits the encoded content result to the client terminal 100 through the interface unit 310 and the internet network 200 (S530).

Meanwhile, the client terminal 100 receives the encoded content result from the service providing server 300 through the interface unit 110, and the packet of the encoded content result through the packet processor 165 of the GPU 160. The setting is released (S532).

Next, the GPU 160 of the client terminal 100 decompresses and decodes the encoded content result in cooperation with the CPU 170 (S534).

Thereafter, the client terminal 100 outputs the user's request image or audio corresponding to the content result decoded in step S534 through the display 130 and the voice output unit 140 (S536).

Accordingly, processing and output of all contents are performed in the service providing server, and the client terminal simply sees and listens to the contents output from the service providing server and performs only a minimum function of local or remote control of the client and server. And light weight is possible.

Although the present invention has been described above according to an embodiment of the present invention, a person skilled in the art to which the present invention belongs has changed and modified within the scope without departing from the technical spirit of the present invention. Of course.

Claims

A client terminal 100 requesting contents related to video and audio to the service providing server 300 through the internet network 200, and a service providing contents related to video and audio requested from the client terminal 100. Heterogeneous server / client-to-client virtualization service system comprising a server 300,

The client terminal 100 includes a GPU 160 in cooperation with the CPU 170 to compress the content request data or to decompress the content result transmitted from the service providing server 300,

The service providing server 300 includes a GPU 360 that decompresses the content request data transmitted from the client terminal 100 in conjunction with the CPU 380 or compresses the content result transmitted to the client terminal 100. Heterogeneous server / client-to-client virtualization service system, characterized in that.
The method of claim 1,

The client terminal 100,

The interface unit 110 for exchanging information with the service providing server 300, the input unit 120 to search for content information and input a request signal, and the image of the content result provided from the service providing server 300 Heterogeneous server / client-to-client virtualization service system characterized in that it comprises a display unit for outputting the output 130, and a voice output unit for outputting the voice of the result of the content.
The method according to claim 1 or 2,

GPU 160 of the client terminal 100,

Heterogeneous server / characterized in that it further comprises an encoding unit 161 for encoding the content request data through the input unit 120, and a decoding unit 163 for decoding the content transmitted from the service providing server 300 Client-to-client virtualization service system.
The method of claim 3, wherein

The GPU 160,

Heterogeneous server / client-to-client virtualization service system, characterized in that it further comprises a packet processing unit (165) for setting and releasing the content request data from the client terminal (100) and the content output from the service providing server (300).
The method of claim 1,

The service providing server 300,

The interface unit 310 for exchanging information with the client terminal 100, and the input unit 320 for generating in advance in the service providing server 300, the update information related to the content according to the request of the client terminal 100; And an output unit 330 for outputting a screen for inputting update information related to the content, a storage unit 340 for storing operation information for operating the service providing server 300, and the client terminal. Heterogeneous server / client-to-client virtualization service system characterized in that it comprises a content DB (350) for storing the results of the content provided by the request of (100).
The method according to claim 1 or 5,

GPU 360 of the service providing server 300,

A decoding unit 362 for decoding the content request data transmitted from the client terminal 100, an encoding unit 364 for encoding a content result transmitted to the client terminal 100, and the client terminal 100 from the client terminal 100. Heterogeneous server / client-to-client virtualization service system, characterized in that it comprises a packet processor (366) for releasing and setting the requested input data and the content output from the service providing server (300).
The method of claim 6,

The service providing server 300,

Heterogeneous server / client-to-client virtualization service system further comprises a streaming processing unit (370) for streaming the resulting content encoded by the GPU 360 to be transmitted to the client terminal (100) in real time.
(A) inputting, by the client terminal 100, request data for content to be provided from the service providing server 300 through the Internet network 200 (S510);

(B) compressing the content request data by the GPU (160) of the client terminal (100) in association with the CPU (170);

(C) transmitting, by the client terminal (100), the content request data compressed through the step (B) to a service providing server (S516) (S516);

(D) the service providing server 300 receives the content request data from the client terminal 100, and the GPU 360 of the service providing server 300 cooperates with the CPU 380 to compress the compressed content. Decompressing request data (S520);

(E) reading, by the CPU 380 of the service providing server 300, the content result according to the content request data decompressed through the step (D) (S522);

(F) compressing the resultant content read through the step (E) by the GPU 360 of the service providing server 300 in cooperation with the CPU 380 (S524);

(G) transmitting, by the service providing server (300), the result of the compressed content through the step (F) to the client terminal (S530);

(H) The client terminal 100 receives the encoded content result from the service providing server 300, and the GPU 160 of the client terminal 100 cooperates with the CPU 170 to compress the compressed content. Decompressing the result (S534); And

(I) heterogeneous server / client-to-client virtualization service method, characterized in that the client terminal (100) outputting a video or audio according to the decompressed content result in the step (H).
The method of claim 8,

Between the step (B) and (C),

(B1) further comprising the step S514 of packetizing the compressed content request data through the packet processor 165 by the GPU 160 associated with the CPU 170 of the client terminal 100. Heterogeneous server / client virtualization service method.
The method of claim 8,

Between the steps (C) and (D),

In operation S518, the GPU 360 associated with the CPU 380 of the service providing server 300 releases the packet setting of the content request data through the packet processor 366. Heterogeneous server / client virtualization service method.
The method of claim 8,

Between the steps (F) and (G),

(F1) a step in which the GPU 360 associated with the CPU 380 of the service providing server 300 packetizes the data of the content result compressed in the step (F) through the packet processor 366 (S526). Heterogeneous server / client-to-client virtualization service method further comprising.
The method of claim 11,

At the same time as the above (F1) step,

(F2) allowing the streaming processing unit 370 of the service providing server 300 to stream the compressed content result product in real time through the step (F) so that the client terminal 100 can play it in real time (S528). Heterogeneous server / client-to-client virtualization service method further comprising a.
The method of claim 8,

Between the step (G) and (H),

(G1) further comprising the step of releasing the packet setting of the content result compressed by the GPU 160 associated with the CPU 170 of the client terminal 100 through the packet processor 165 (S532). Heterogeneous server / client virtualization service method.