KR20200105178A - Virtual desktop system for high-definition video service and method thereof - Google Patents

Abstract

The present specification discloses a virtualization system and a data processing method thereof. According to one embodiment of the present invention, the virtualization system comprises: a virtualization server which provides a virtual desktop; and a client, wherein the virtual desktop configures screen information from which a video source area is excluded to transmits the same to the client, transmits a video source area processing request signal to an external source, and controls the video source data processed in the external source according to the request to be transmitted to the client, when receiving a high-definition video streaming service request from the client.

Description

Virtual desktop system for high-definition video service and its data processing method {VIRTUAL DESKTOP SYSTEM FOR HIGH-DEFINITION VIDEO SERVICE AND METHOD THEREOF}

The present invention relates to a virtual desktop system and a data processing method thereof, and more particularly, to a virtual desktop system capable of providing a high-resolution video service by using resources flexibly and a data processing method thereof.

Research and development of a virtualization system that provides a virtual desktop in place of the conventional desktop has been continuously conducted.

Virtualization systems will be widely distributed in the future in line with various reasons such as ease of management and space efficiency, such as the use of virtualization systems in recent cryptocurrency systems, as well as rapidly changing markets.

The present invention makes it a task to provide a virtual desktop system that provides a high-resolution video source streaming service and a data processing method thereof.

The present invention provides a virtual desktop system and a data processing method for providing efficient and fast streaming of high-resolution video sources through flexible resource utilization by supporting the use of at least one external resource, that is, a source. Do what you do as another task.

A data processing method in a virtualization system according to an embodiment of the present invention includes: receiving a request for a high-resolution video streaming service from a client; Configuring screen information excluding a video source area and transmitting it to the client; Transmitting a signal for requesting processing of the video source region to an external source; And controlling the video source data processed by an external source to be transmitted to the client according to the request.

According to the present invention, the screen information transmitted from the client and the video source data processed by the external source are merged so as to be synchronized to form a single service screen.

According to the present invention, the external source includes a video platform providing corresponding video source data and a device capable of processing at least one corresponding video source data, and is capable of connecting wired/wireless to the client.

According to the present invention, a request for processing video source data to the video platform is characterized in that it is made in the form of link redirection.

According to the present invention, when configuring screen information from which the video source region is excluded, the step of determining whether or not to process the video source data is further included, but when the video source data is not directly processed as a result of the determination In relation to the request, a corresponding fact is notified to the client together with or separately from the configured screen information.

A virtualization system according to an embodiment of the present invention includes: a virtualization server that provides a virtual desktop; And a client; wherein, when a request for a high-resolution video streaming service is received from the client, the virtual desktop configures and transmits screen information excluding a video source area to the client, and sends the video source area processing request signal to an external device. The video source data transmitted to the source and processed by an external source are controlled to be transmitted to the client according to the request.

According to the present invention, the virtual desktop is characterized in that the screen information transmitted from the client and the video source data processed by the external source are merged so as to be synchronized to form one service screen.

According to the present invention, the external source includes a video platform providing corresponding video source data and a device capable of processing at least one corresponding video source data, and is capable of connecting wired/wireless to the client.

According to the present invention, the virtual desktop is characterized in that it requests the video platform to process the video source data in the form of link redirection.

According to the present invention, the virtual desktop configures screen information from which the video source area is excluded after determining whether to process the video source data, but when the video source data is not directly processed, the request and In connection, it is characterized in that the fact is notified to the client together with or separately from the configured screen information.

As explained above,

According to an embodiment of the present invention, there is an effect of providing a virtual desktop system that provides a high-resolution video source streaming service and a data processing method thereof.

According to an embodiment of the present invention, a virtual desktop system that supports at least one external resource, i.e., a source, can be utilized so that efficient and fast streaming of high-resolution video sources through flexible resource utilization can be performed without problems, and the same. There is an effect that can provide a data processing method.

1 is a diagram illustrating the structure of a VDI system 100 from a virtualization perspective according to an embodiment of the present invention.
2 is a diagram illustrating a container according to an embodiment of the present invention.
3 is a diagram illustrating a video compression format according to an embodiment of the present invention.
4 is a diagram illustrating a session gateway according to an embodiment of the present invention.
5 is a diagram illustrating data visualization according to an embodiment of the present invention.
6 to 9 are diagrams illustrating a virtualization system for processing high-resolution video data according to an embodiment of the present invention.
10 is a diagram illustrating a method of processing high-resolution video data according to an embodiment of the present invention in a virtual desktop system according to an embodiment of the present invention.

In the present invention, various changes may be made and various embodiments may be provided, and specific embodiments will be illustrated in the drawings and described in detail. However, this is not intended to limit the present invention to a specific embodiment, it should be understood to include all changes, equivalents, or substitutes included in the spirit and scope of the present invention. In describing each drawing, similar reference numerals have been used for similar elements.

Terms such as first, second, A, and B may be used to describe various elements, but the elements should not be limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term'and/or' includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

The terms used in the present application are used only to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "include" or "have" should be understood as not precluding the possibility of existence or addition of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification. .

Unless otherwise defined, all terms, including technical or scientific terms, used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs.

Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this application. Does not.

In the present specification, a virtualization system according to the present invention and a data processing method thereof are disclosed. In particular, in the present specification, in relation to providing a virtualization system and a data processing method for the convenience of using a virtual desktop of an arbitrary user, a fast virtual machine (VM: Virtual Machine) using a snapshot function in the virtualization system Machine) provides and describes embodiment(s) for efficiently utilizing system resources.

In other words, the virtualization system is also referred to as a Virtual Desktop Infrastructure (VDI) system.

1 is a diagram illustrating the structure of a VDI system 100 from a virtualization perspective according to an embodiment of the present invention.

Referring to FIG. 1, the VDI system 100 can be largely divided into a virtual desktop 110, a virtualization server 120, and a client 130. However, the present invention is not limited thereto, and may be implemented differently from the structure of the VDI system 100 illustrated in FIG. 1 according to a system or implementation method.

The virtualization server 120 may have a host OS 124 installed and a hypervisor 121 for virtualization. According to an embodiment, Linux and a QEMU/KVM hypervisor may be installed as the host OS 124 in the virtualization server 120.

The hypervisor 121 may allocate resources of the virtualization server 120 to the virtual desktop 110 generated by virtualizing the resources. Here, resources of the virtualization server 120 may include CPU, GPU, NIC, HDD, and the like. Although one virtual desktop 110 is illustrated in the virtualization server 120 in FIG. 1 for better understanding of the present invention and for convenience of explanation, the present invention is not limited thereto, and a plurality of virtual desktops 110 are included. I can.

A virtual desktop remote transfer protocol may be used for remote access to the hypervisor client 130 and the virtual desktop 110.

The client 130 includes not only data such as display information, audio, image, and video of the virtual desktop 110 from the virtual desktop remote transmission module 123 of the virtual desktop 110 according to the virtual desktop remote transmission protocol, but also a mouse ( It is possible to receive information on a cursor according to a mouse or touch input.

The operating system (OS) of the client 130 may be Linux or Windows, and an application for authentication and connection with a clipboard and a viewer app showing the display of the virtual desktop 110 are installed. Has been. The client 130 may also include a virtual desktop remote transmission-GTK library that assists access to the virtual desktop remote transmission module 123 of the virtualization server 120 and processes display graphics. The OS of the client 130 may be driven in the form of Windows, IOS, Linux, Android, or the like, and may be in the form of a thin client that uses only minimal resources for display output.

A hypervisor driven in the form of a Linux kernel module is installed in the virtualization server 120 to be compatible with a hypervisor in a user space. The hypervisor of the user space serves to virtualize devices to be used by the virtual desktop 110 and allocate them to each virtual desktop 110.

Virtualized devices include drivers 112. For example, a virtual NIC/Disk driver such as Virtio in charge of a virtual disk and a graphic output of the virtual desktop 110 are captured and the virtualization server 120 ), and a virtual graphics driver such as QXL that transmits to the virtual desktop remote transmission module 123.

The virtual desktop remote transmission module 123 helps the client 130 to access the guest OS (OS of the virtual desktop 110) 111.

The virtual desktop 110 is one virtual computer that a user can use in the VDI system, and a separate guest OS 111 may be installed in the virtual desktop 110. In this case, the guest OS 111 may be of the same type as the host OS 124 or may be of a different type. Meanwhile, virtual drivers 112 that can use virtualized devices 125 may be embedded in the guest OS 111. For example, the built-in virtual drivers 112 may include a virtual disk driver supporting a storage space, a virtual network driver supporting a network, a virtual graphic driver supporting graphics, and the like.

The guest agent 113 is an element for improving a user's experience using the virtual desktop 110 and for guest-centered management tasks. For example, if the client uses the mouse mode, information on the guest's mouse position is provided to the user on the screen, and information on policy settings such as URL/Printer Redirection, clipboard function, resolution, and limit on the number of multiple monitors Is received from the management server 140 and the guest agent 113 may control it.

The user can view the screen of the virtual desktop 110 through the client 130 through the terminal. The terminal may be a PC or a mobile terminal. In order to access the virtual desktop 110, a viewer may be viewed by accessing a user portal through a web browser. Here, the viewer means a program that displays the screen of the virtual desktop 110. Meanwhile, the virtualization server 120 may install a delivery module to transmit the screen of the virtual desktop 110, and the client may receive screen information through a delivery protocol designated by this module.

The management server 140 may include a connection broker, a user portal, and a management application. In the above, the connection broker identifies where the virtual desktop 110 to be used by the user is located so that the client can connect to the identified virtual desktop 110, and the client performs functions such as authentication for software approval, license check, etc. can do.

In addition, a user using a client through a browser-type user portal can control on/off the virtual desktop 110, and such a control signal is transmitted by a management protocol and installed in the virtualization server 120. A host agent (Libvirt) may control the virtual desktop 110.

The virtual desktop remote transmission module 123 supports a virtual graphic driver VDI interface. Virtual desktop delivery libraries such as Lispspice can be used with a hypervisor in user space to improve display performance using specific video devices.

The virtual desktop remote transfer protocol is an open remote computing solution or protocol that provides access of the client 130 to remote displays and devices. This is a remote access to a virtual machine (VM), provides a desktop-like user experience (UX: User eXperience), and can minimize the load on the user's computer.

Referring to FIG. 1, the structure of the VDI system 100 will be described as follows.

First, the virtual desktop 110 is a virtual desktop directly used by a user. The virtual desktop 110 is created by the hypervisor 121 of the virtualization server 120 and the screen information of the virtual desktop 110 is transmitted to the client 130 by a virtual desktop remote transmission protocol.

Next, the virtualization server 120 plays a pivotal role of the VDI system 100. In order to drive the VDI system 100, various programs for supporting various functions including the hypervisor 121 as well as the virtual desktop remote transmission module 123 are installed to drive the VDI system 100.

Meanwhile, the client 130 is a client that allows a user to access the virtual desktop 110. In the client 130, the user can view the screen of the virtual desktop 110 with a virtual desktop remote transmission client (Viewer) that retrieves and displays screen information to the user through the virtual desktop remote transmission protocol. In addition, a virtual desktop remote transmission-GTK library that assists access to the virtual desktop remote transmission module 123 in the virtualization server 120 and processes display graphics is also included. The OS of the client 130 may be driven in the form of Windows, IOS, Linux, Android, or the like, and may be in the form of a thin client using only a minimum resource for display output.

The guest OS 111 is an OS of the virtual desktop 110, that is, an OS that the VDI user will use. This can be not only Windows, but also OS such as Linux or Android. However, it is not limited thereto.

The OS of the virtual desktop 110 to be used by the VDI user includes drivers 112 for using devices provided by the virtualization server 120 for the virtual desktop 110. The two representative drivers are the virtual graphics driver and the virtual NIC/Disk driver. The virtual graphic driver is a graphic driver to support display performance improvement, and a virtual graphic driver is used for smooth operation of the virtual graphic driver display device. The virtual NIC/Disk driver is a virtual NIC/Disk driver for the device that supports the fast I/O provided by the hypervisor.

The virtual desktop remote transfer agent 113 is used as an option to improve tasks performed on the virtual desktop 110 and the client 130. For example, when the client 130 mouse mode is used, the agent injects the mouse position and state into the guest OS. Also, you can freely move the cursor between the guest and the client. In addition, there is a function that redirects URLs restricted to sharing and accessing the clipboard.

A hypervisor 121 is provided in the virtualization server 120, for example, a hypervisor driven in the form of a Linux kernel module is installed to be compatible with a hypervisor in a user space. In other words, in order to support CPU virtualization, the hypervisor requires a hypervisor in user space, and the slow speed due to binary conversion is compensated by using the hypervisor's acceleration function. The hypervisor of the user space serves to virtualize devices to be used by the virtual desktop 110 and allocate them to each virtual desktop. Virtualized devices include a virtual NIC/Disk driver in charge of a virtual disk and a virtual graphic driver that captures a graphic output of the virtual desktop 110 and sends it to the virtual desktop remote transmission module 123.

The host agent 122 refers to a collection of an application program interface (API) and a management tool configured to support virtualization. The information can be delivered to the hypervisor 121 by changing a compression setting of a display required by the virtual desktop 110 or a setting for USB support.

The hypervisor 121 provides remote access to the virtual desktop 110 using the virtual desktop remote transfer module 123. On one side of the virtualization server 120, the virtualization server 120 communicates with the client 130 using a virtual desktop remote transfer protocol, and the other side interacts with the hypervisor 121.

2 is a view illustrating a container according to an embodiment of the present invention.

A virtual machine (VM) literally virtualizes a computer environment and is implemented as software (SW). A hypervisor that can virtualize computing resources is essential, and it has the advantage of configuring multiple OSs in one server, and it is a concept that logically divides the server's resources, which can further increase the availability of resources.

The container 204 is an application-oriented concept unlike a computer environment compared to a virtual machine (VM). Like a virtual machine (VM), a separate OS or driver is not required, the kernel of the host OS 203 is shared, and a namespace is provided for individual applications. Therefore, compared to a virtual machine (VM) that requires another OS kernel, the application can be executed lighter and more efficiently, and it is easy to distribute.

Container operation management tools such as Kubernetes are an open source system for managing containerized applications, and a platform for automating the deployment and operation of application containers between hosts in multiple clusters ( platform).

The concept of creating an instance is different. The program used to create a virtual machine (VM) is a hypervisor, but the container 204 requires a separate container engine 201 and is typically a container engine such as Docker. There is this. However, the present invention is not limited thereto.

The OS that drives the hypervisor is the host OS 203, and the OS that runs in a virtual machine (VM) created by the hypervisor becomes the guest OS 202. The two OSs may or may not be the same operating system. In other words, it has the advantage of providing various OSs to a virtual machine (VM) and providing a completely isolated environment.

The container engine 201 creates a container image 204 by placing an application (program) to be containerized in an isolated space together with other binary files or libraries required for the application to execute and containerizing it. This image 204 may be distributed by storing it in a container hub or the like. In addition, the container does not have its own OS and shares the kernel of the OS where the container engine is installed.

3 is a diagram illustrating a video compression format according to an embodiment of the present invention.

In FIG. 3, an H.264 format is described as an example of a video compression format for convenience, but the present invention is not limited thereto. For example, the H.265 format can also be used with reference to the contents described below. However, to aid understanding of the present invention and for convenience of description, the following describes the H.264 format as an embodiment.

The H.264 format is a video compression standard based on motion compensation in block units, and is the most common among methods for video recording, compression, and distribution.

In connection with the present invention, in the VDI system 100, the virtual desktop remote transmission module 123 performs encoding with an H.264 encoder 302 on the area 301 to be processed as video streaming among the display areas. It is transmitted to the client 103.

The virtualization server 120 defines a video codec list that can be supported, and the codec having the highest priority in the list among the codecs supported by the client 130 is determined and used as a video codec.

In order to use the H.264 codec, it can be determined by a method of hardcoding the codec by default, a method of setting it through an API, and a method of receiving a message from a client and setting it.

In consideration of a streaming video option, the area 301 that satisfies a specific condition among the display areas may be determined to be processed as a video stream.

Compression is performed using a video codec on the region 301 to be processed as a video stream. When the compressed video stream is prepared, the video stream data is delivered to the client 130 using a message on the display channel (one of the virtual desktop remote transmission channels).

Referring to FIG. 3, the virtual desktop remote transmission module 123 transmits screen information to the client 130. Here, an encoder 302 related to video compression is embedded in the virtual desktop remote transmission module 123.

This is a part of screen information to be sent to the client 130 on the display 301 of the virtual desktop 110. In the present specification, for convenience of explanation, video partial processing is described, but the present invention is not limited thereto. For example, audio processing can also be handled by the audio codec and hence the audio encoder.

An open source based multimedia framework 303 such as Gstreamer is an encoder that performs video H.264 encoding. In order to use H.264 encoding in place of the virtual desktop remote transmission MJPEG 304 according to the MJPEG method, which uses a lot of network usage, the default video codec may be set to H.264, and the open source based multimedia framework 303 Can do this.

The compressed image information is transmitted to the client 130 through the display channel.

Although not shown, channels may be differentiated according to functions such as cursor channels and audio channels in addition to the display channels.

4 is a diagram illustrating a session gateway according to an embodiment of the present invention.

The session gateway 440 is operated by a session service and provides an external connection service of the client 130. That is, when the client 130 accesses from the outside due to network separation, a proxy is provided.

The user can access the VDI system 100 through the client 130 using a public network. However, the VDI system 120 is separated from the corporate network due to security issues, and access to the public network itself may be restricted. In such an environment, the session gateway 440 provides a service by interlocking with the virtualization server (server node on which the hypervisor is built) 120 for the connection of the client 130. Between the session gateway 440 and the client 130, a connection broker operates in the form of a micro service to deliver the access information of the virtual desktop 110 and externally It conveys information about the connection.

The process will be described in more detail with reference to FIG. 4 as follows.

The viewer 410 is a client that receives screen information to use the virtual desktop 110. The client 130 may request access to the virtual desktop 110 from the virtualization server 120.

In the VDI system 100, all tasks are handled by the microservice architecture 420. Through this, the application is divided into components of the smallest independent of each other to share similar processes, and by reducing the weight of the process processing, it is intended to accelerate deployment and increase stability. The connection broker also runs in the form of microservices. The connection broker may provide screen information to a user by providing an authentication token for accessing the virtual desktop 110 and store a connection request history. In addition, it helps efficient connection by providing a function to manage session gateway authentication and session connection information request.

This section is in charge of controlling various services and systems. It provides an interface to link microservices with functions such as standard cloud OS installed in the infrastructure and container operation management tools. Here, information on the external connection received from the client through the session gateway is set.

It is a session gateway 440 operated by a session service in charge of a service manager at the platform level. Processes connection information setting from session service and provides server connection usage for session. It also allows a third-party proxy in the session gateway to handle connections between clients and servers.

It is a virtualization server 120 in charge of the virtual desktop 110 to be used by the user. As the session gateway 440 connects an internal IP port and authenticates an access token, the client 130 can access the virtual desktop 110 from an external network.

5 is a diagram illustrating data visualization according to an embodiment of the present invention.

Portals have a user portal for users and an admin portal for administrators. The bare metal node for the admin portal includes data visualization tools such as grafana and ELK stacks (elasticsearch, logstach, kibana) that can visualize log data of the VDI system 100, and MariaDB, a DB engine. , Data distribution messaging system tools such as kafka, and monitoring system tools such as Prometheus may be built. Using these applications, the administrator can manage the VDI usage status using logs.

In the VDI system 100, various information such as a running microservice, a virtual machine state, storage and network usage, etc. may be stored as a log. In the log, a key value, a value for specific information, and a time value can be stored as text. Therefore, it is difficult to identify information such as usage trends, and when an error occurs, it may take a lot of time to resolve. Therefore, it may be necessary to collectively collect log data, process it, and visualize it. By using statistical information that visualizes log data, the time of error can be checked and by grasping data trends at a glance, administrators can efficiently perform not only system management, but also consulting about system services, and gain understanding of users' system use. I can help. Log data within the system may be defined as a topic for each item. Defined data can be integrated through distributed messaging system tools. In addition, service analysis statistics can be generated through a consumer client of a data distribution messaging system tool, and the generated statistical data can be configured in the form of graphs or charts through a data visualization tool.

Data visualization will be described with reference to FIG. 5 as follows.

The viewer 510 is a client capable of running the virtual desktop 110 and viewing a screen. Log collection starts at this stage, because logs related to the client's resource usage may also be required.

The log server 520 is a server for collecting a log of a client application. Here, the log is collected and processed at the same time. For log collection and processing, you can use a program called Fluent Bit.

Logs can be collected from not only log servers, but also from user portals, API gateways, virtualization servers, etc., and the collected logs are integrated by a data distribution messaging system tool, which corresponds to the management server 530. Data distribution messaging system tools are divided into producers and consumers, which can be monitored using the monitoring system tools in the producers. In addition, not only logs but also alarms and statistics related logs can be converted into information by a consumer client.

Information integrated by the data distribution messaging system tool is converted into a database 540 and stored, and the collected information may be visualized by tools such as kibana and grafana. Visualized graph or chart information may be provided to users and administrators who use the virtual desktop 110 through the client 130.

6 to 9 are diagrams illustrating a virtualization system for processing high-resolution video data according to an embodiment of the present invention.

Hereinafter, a data processing process based on the use of flexible resources of the VDI system 100 will be described with reference to the accompanying drawings.

The term "high resolution" described in the present specification mainly refers to a resolution of 2K or 4K or higher, that is, ultra high definition (UHD), but is not necessarily limited thereto, and full-HD (Full-HD) according to implementation examples. HD) cases may also be included. In relation to the recent, video platforms such as YouTube, Corn, and Netflix are trending to support 2K or 4K ultra-high definition (UHD) services following the conventional high-definition, that is, full-HD, which is likely to support 8K or higher-resolution services in the future. have.

In addition, the term "source" mainly means a video platform that provides a high-resolution video source, but is not limited thereto. According to an implementation example, all devices such as a digital TV capable of receiving and processing the high-resolution video source may be included in the source. In addition, even if the source is expressed in the singular number in this specification, it may be used as a meaning including a plurality of sources according to the meaning of the context.

Hereinafter, processing of high-resolution data according to the present invention will be described. Here, the data mainly refers to video data, but is not limited thereto, and data such as images and audio may be considered independently or together.

In addition, for better understanding of the present invention and for convenience of explanation, the description is mainly made by using streaming video data processing as an example, but this is not necessarily limited thereto.

In other words, when a user requests streaming of high-resolution video data while using the virtual desktop 110, a data processing method will be described below.

The user may request processing of high-resolution data while using the virtual desktop 110.

In relation to the related art, a conventional video source is processed within the virtual desktop 110 and the output is transmitted to the virtual desktop 110 to the client 130. In this case, the output for high-resolution video is the I/O bandwidth. Because of this fairly large size, the output is actually downsized resolution, despite requests for high-definition video streaming.

In the present invention, the request for the high-resolution video stream is made in the virtual desktop 110, but the screen space for outputting a video image can be resolved by the client 130. For example, the viewer of the virtual desktop 110 uses the resources of the virtual desktop 110 for output other than the image, but the high-resolution video streaming output is controlled to merge the output screen so that the viewer of the client 130 can process it. .

An embodiment of a method of processing the high-resolution video streaming will be described in more detail with reference to FIG. 8 as follows. Here, in FIG. 8, for convenience, the source is described by taking the video platform 6100 as an example.

The virtual desktop 110 driven by the VDI server 120 provides screen information from which the video output area (or space) has been removed to the client 130 in relation to the requested high resolution streaming output.

The VDI server 120 or the virtual desktop 110 driven by the server 120 requests a source for a high-resolution video through an application or a browser according to a high-resolution video streaming request from the client 130 (611), A request for a high-resolution video streaming service is transmitted to a video platform 610 that provides a high-resolution video source related to the request. When the request is received, the video platform 610 processes a high-resolution video source and communicates with the virtual desktop 110 rather than the requested server 120 or the virtual desktop 110 as in the related art. To the viewer of (612). Meanwhile, in the above, the video source processing request to the video platform 610 of the virtual desktop 110 may be made in the form of a link redirection, but the present invention is not limited thereto, and the video platform 610 is Any way to process the video source could be included. Meanwhile, when a video source is requested to the video platform 610, the virtual desktop 110 may further transmit a necessary request in addition to the video source processing request.

The virtual desktop viewer in the client 130 receives screen information of the virtual desktop 110 and a video source from the video platform 610, configures it as one screen, and provides it to a user.

In the above process, when the video platform 610 transmits a video source to the client 130, the virtual desktop 110 may transmit screen information to the client 130 at the same time. To this end, the virtual desktop 110 may request a notification at a time when the video source is transmitted to the client 130 in advance when the video source is requested, or the video platform 610 or the client 130 You can also monitor. However, the present invention is not limited thereto, and screen information may be transmitted in advance before (or immediately before) the time when the video platform 610 delivers the video source to the client 130, or a predefined time after the time point. The screen information can also be delivered within.

The viewer of the client 130 merges and synchronizes the video sources received from the video platform 610 on the basis of the screen information received from the virtual desktop 110 and provides it to the user. Here, the merging may be received with the video source region removed from the screen information received from the virtual desktop 110 for convenience, and the video source received from the video platform 610 is mapped to the region. ).

Hereinafter, in FIGS. 7 to 9, the contents described in FIG. 6 are referred to, and only related contents in the corresponding drawings are described.

First, referring to 7, in FIG. 6, one more source is added. Here, for convenience, the added source, that is, the first source 710 will be described as an example as a digital TV.

It is preferable that the added first source 710 basically includes a component capable of processing a video source provided from the video platform 610. Meanwhile, the first source 710 may be connected to the video platform 610 by wire/wireless. In addition, the first source 710 may also be connected to the client 130 via wired/wireless. Through this, the first source 710 receives the video source received from the video platform 610 that received the request of the virtual desktop 110, processes it according to the client 130, and transmits it to the client 130. . In the above, if the video source received from the video platform 610 in the first source 710 has already been video processed, it is converted and resized according to the client 130 and transmitted to the client 130, Otherwise, the video source is directly provided so that it can be streamed.

Meanwhile, in FIG. 7, although the first source 710 has been described and illustrated as providing a video source processed directly to the client 130, it is not limited thereto. For example, the first source 710 may return the directly processed video source back to the video platform 610 and transfer it from the video platform 610 to the client 130.

Since the first source 710 is preferably capable of connecting to the client 130 by wire/wireless, it does not necessarily have to be a device that exists near the client 130 and may be located remotely.

However, for convenience, in a relationship with the client 130, the first source 710 may be located in a short distance (or belonging to the same network as the client 130 ), for example. For example, when the client 130 requests a high-resolution video streaming service through the virtual desktop 110, if the video source area is removed from the screen information received from the virtual desktop 110, the A first source 710 capable of processing a high-resolution video streaming service may be searched, and a search result may be transmitted to the virtual desktop 110. In this case, the virtual desktop 110 may transmit this to the video platform 610 again, and process the video source after processing or immediately transmit the video source to the first source 710 for processing.

Alternatively, when the client 130 receives the return data of the separate virtual desktop 110 after requesting the high-resolution video streaming service to the virtual desktop 110, the client 130 searches for the first source 710 and processes as described above. can do. In the above, the return data may be viewed as information indicating that a request has been made to the video platform 610. That is, it can be viewed as information indicating that the virtual desktop 110 or the server 120 does not directly process it.

Alternatively, the client 130 searches for the first source 710 in advance according to a protocol promised in advance or when requesting a high-definition video streaming service arbitrarily, and includes or includes the search result with the request. ). Here, when the search is performed at the same time as or after the request, the search result may be transmitted to the virtual desktop 110 separately from the request.

In addition to or separately from the above-described high-resolution video streaming processing, if the first source 710 is adjacent to the client 130 or belongs to the same network, for example, the first source 710 is the client 130 ) May support high-definition video streaming service. Herein, the support may refer to, for example, the performance of the client 130, resources, modules, and the like to support this. For example, if the video performance of the client 130 is excellent but the audio performance is relatively low, and the audio performance of the first source 710 is excellent, the audio of the client 130 may be replaced and supported. Alternatively, when the client 130 provides the high-resolution video streaming service, if resources are insufficient due to an existing service or application, it may be processed using the resources of the first source 710 as necessary.

8 is a case where the first source 710 replaces the video platform 610 in FIG. 7.

Referring to FIG. 9, a case in which a plurality of sources 710, ..., 710-n, where n is a positive integer) operates in response to a request for a high-resolution video service from a client 130 is illustrated.

Here, the video platform 610 of FIGS. 6 to 7 described above may be included in one of the plurality of sources 710, ..., 710-n.

9 shows, for example, if a high-resolution video streaming service is processed through a single device, as described above, restrictions such as bandwidth may still exist or processing time may increase. Other devices available for smooth processing of the streaming service Can be used as a source. At this time, each source may divide and process one high-resolution video streaking service data, respectively, and transmit the same to the client 130. Alternatively, after processing from each source, it may be transmitted to the client 130 at a time synchronized according to the timing. These contents may be controlled by the server 120 or the virtual desktop 110 or the client 130.

As described above, when the requested high-definition video service is not a real-time or streaming method, the request may be processed using an appropriate source(s) in a non-real-time method.

In addition, when an artificial intelligence module based on big data is mounted through the server 120, etc., through user analysis related to the high-resolution video service, the next requestable high-resolution video service data is transmitted through the source(s). It can also be precoded. However, in this case, since there is a concern that the precoding may waste resources, it is not possible to pre-decode all data, but to pre-decode data at a predetermined interval at a start part or all. In the latter case, the data precoded through the above processing may be provided to the client 130 in the form of a storyline and provided together with advertisements, thereby inducing a user's selection or targeting the effect of advertisement exposure.

In addition, when only one source is used in FIGS. 7 to 9 and the client 130 pauses or stops, the other source may be used.

Meanwhile, although not shown, the source 710 other than the video platform 610 in FIGS. 7 to 9 may temporarily replace the client 130 for a specific high-resolution video streaming service. In this case, the client 130 may request a high-resolution video streaming service from the virtual desktop 110 and view the high-resolution video streaming service, for example, through the first source 710. At this time, the screen information of the virtual desktop 110 may be transmitted to the first source 710 through the client 130 or through information provision when the client 130 requests a service.

Alternatively, as described above, even if the client 130 configures screen information for a high-resolution video streaming service as shown in FIGS. 6 to 9, for example, having better performance through a mirroring or a Miracast method. , May be output from the first source 710.

10 is a diagram illustrating a method of processing high-resolution video data according to an embodiment of the present invention in a virtual desktop system according to an embodiment of the present invention.

In FIG. 10, only the client 130, the virtual desktop 110, and the source 1010 are illustrated for convenience.

Here, the source may be at least one of the first to n-th sources 710, ..., 710-n in FIGS. 6 to 9, and the video platform 610 may also be included.

In addition, only one source is illustrated in FIG. 10 for convenience, but as described above, the present invention is not limited thereto, and video source data processing by a plurality of sources can also be sufficiently inferred by those skilled in the art with reference to FIG. will be.

Referring to FIG. 10, the client 130 requests a high-resolution video streaming service from the virtual desktop 110 through a screen (S1001). Here, the request may be made through an input signal by at least one of a mouse, a keyboard, a touch, a gesture, an audio, and an iris recognition based on biometric information of the client 130.

When a request for a high-resolution video streaming service from the client 130 is received, the virtual desktop 110 configures screen information to be provided to the client 130 (S1002). In this case, in configuring the screen information, it may be determined whether or not to process the video source data for the video source region.

As a result of the determination, when the virtual desktop 110 does not directly process the corresponding video source data, the video source area may be emptied, that is, removed screen information may be configured and transmitted to the client 130. In addition, the virtual desktop 110 may request the source 1010 to process the corresponding video source data (S1003).

The source 1010 processes the requested video source according to the request of the virtual desktop 110 and transmits the processed video source data to the client 130 (S1004).

The client 130 constructs a high-resolution video streaming service screen by receiving and merging screen information from the virtual desktop 110 and video source data from the source 1010 (S1005), and provides the service to the user through the screen. Do (S1006).

The present invention is not necessarily limited to the time series sequence shown in FIG. 10. For example, certain steps or processes may be performed simultaneously or may be performed at different times depending on implementation examples.

Meanwhile, the steps shown in FIG. 10 can be implemented as computer-readable codes on a computer-readable recording medium. The computer-readable recording medium includes all types of recording devices that store data that can be read by a computer system. That is, the computer-readable recording medium is a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD-ROM, DVD, etc.), and carrier wave (e.g., Internet And storage media such as transmission through In addition, the computer-readable recording medium can be distributed over a computer system connected through a network to store and execute computer-readable codes in a distributed manner.

The above description is merely illustrative of the technical idea of the present embodiment, and those of ordinary skill in the technical field to which the present embodiment belongs will be able to make various modifications and variations without departing from the essential characteristics of the present embodiment. Accordingly, the present exemplary embodiments are not intended to limit the technical idea of the present exemplary embodiment, but are illustrative, and the scope of the technical idea of the present exemplary embodiment is not limited by these exemplary embodiments. The scope of protection of this embodiment should be interpreted by the following claims, and all technical ideas within the scope equivalent thereto should be construed as being included in the scope of the present embodiment.

Claims (10)

Receiving a request for a high-resolution video streaming service from a client;
Configuring screen information excluding a video source area and transmitting it to the client;
Transmitting a signal for requesting processing of the video source region to an external source; And
Controlling video source data processed by an external source to be delivered to the client according to the request;
Data processing method in a virtualization system comprising a.
The method of claim 1,
Merging the screen information transmitted from the client and the video source data processed by the external source so that a single service screen is formed;
Data processing method in a virtualization system, characterized in that comprising a further.
The method of claim 2,
The external source,
Includes a video platform that provides the video source data and a device capable of processing at least one video source data,
Data processing method in a virtualization system, characterized in that the wired / wireless connection with the client.
The method of claim 1,
The data processing method in a virtualization system, characterized in that the request for processing video source data to the video platform is made in the form of a link redirection.
The method of claim 1,
In configuring screen information from which the video source area is excluded,
And determining whether the video source data is processed or not,
When the video source data is not directly processed as a result of the determination, a corresponding fact is notified to the client together with or separately from the configured screen information in relation to the request.
A virtualization server that provides a virtual desktop; And
Including a client;
The virtual desktop,
When a request for a high-resolution video streaming service is received from the client, screen information excluding a video source region is configured and transmitted to the client, and the video source region processing request signal is transmitted to an external source, and according to the request, the external source A virtualization system, characterized in that controlling the processed video source data to be transmitted to the client.
The method of claim 6,
The virtual desktop,
A virtualization system comprising controlling the screen information transmitted from the client and the video source data processed by the external source to be synchronized to form a single service screen.
The method of claim 7,
The external source,
Includes a video platform that provides the video source data and a device capable of processing at least one video source data,
Virtualization system, characterized in that the wired / wireless connection with the client.
The method of claim 6,
The virtual desktop,
A virtualization system comprising requesting to process the video source data in the form of link redirection to the video platform.
The method of claim 6,
The virtual desktop,
After determining whether or not to process the video source data, configure screen information excluding the video source area,
When the video source data is not directly processed as a result of the determination, a corresponding fact is notified to the client together with or separately from the configured screen information in relation to the request.

Images