KR20170088232A - Graphic processing system possible rendering Performance elevation of VDI based web - Google Patents

Graphic processing system possible rendering Performance elevation of VDI based web Download PDF

Info

Publication number
KR20170088232A
KR20170088232A KR1020160008360A KR20160008360A KR20170088232A KR 20170088232 A KR20170088232 A KR 20170088232A KR 1020160008360 A KR1020160008360 A KR 1020160008360A KR 20160008360 A KR20160008360 A KR 20160008360A KR 20170088232 A KR20170088232 A KR 20170088232A
Authority
KR
South Korea
Prior art keywords
web
vdi
client
client device
processing system
Prior art date
Application number
KR1020160008360A
Other languages
Korean (ko)
Inventor
배병민
김갑용
조민기
Original Assignee
주식회사 스마트큐
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 스마트큐 filed Critical 주식회사 스마트큐
Priority to KR1020160008360A priority Critical patent/KR20170088232A/en
Publication of KR20170088232A publication Critical patent/KR20170088232A/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/455Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533Hypervisors; Virtual machine monitors
    • G06F9/45545Guest-host, i.e. hypervisor is an application program itself, e.g. VirtualBox
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60Network streaming of media packets
    • H04L67/16
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146Data rate or code amount at the encoder output

Abstract

The present invention relates to a graphics processing system for improving the rendering performance of a web-based VDI, and more particularly, to a web-based VDI protocol performance improvement function for improving graphics processing performance, And more particularly to a graphics processing system that improves the rendering performance of a web-based VDI that provides seamless web-based VDI services in response to an access environment.
The present invention provides a Web-based VDI protocol performance enhancement function for improving the graphics processing performance and provides a continuous web-based VDI service by adapting to various user access environments in consideration of a web standard, The VDI service provider will be able to adapt to the changing paradigm and contribute to the expansion of the VDI market.

Description

[0001] The present invention relates to a graphics processing system capable of improving the rendering performance of a web-based VDI,

The present invention relates to a graphics processing system for improving the rendering performance of a web-based VDI, and more particularly, to a web-based VDI protocol performance improvement function for improving graphics processing performance, And more particularly to a graphics processing system that improves the rendering performance of a web-based VDI that provides seamless web-based VDI services in response to an access environment.

Due to recent advances in hardware fabrication technologies such as CPU and memory, low-cost, high-performance personal computers (hereinafter referred to as PCs) are rapidly spreading, and the computing power of PCs has improved to the level of the initial supercomputer.

As the performance of personal computers is improved, the software used on personal computers is also demanding to accommodate increasingly colorful user interfaces and graphics intensive work.

In addition, graphics hardware technology is applied not only to existing graphics intensive tasks such as 2D / 3D and multimedia, but also to web browser rendering, flash, and Windows operating system.

Server-based software services (ie, server-based computing environments) are being applied to solve problems such as data security and PC management costs that occur in PC-based computing environments.

Technologies that support server-based software services include Citrix's XenDesktop, VMWare's VDI, and Microsoft's Terminal Services based on Remote Desktop Protocol (RDP).

For example, in order to service 3D and virtual reality contents, a 3D scene and related data are transmitted from a server to a client located at a remote place, and a technique of expressing the 3D scene and related data in a client of the user is provided. The 3D scene and related data generated by the vertex shader and the pixel shader, which require 3D acceleration for the server, are transmitted to the client of the user and the 3D streaming is realized through the 2D rasterizer at the user's client.

As described above, in the conventional server-based software service, the software is executed in the server, and the client PC performs only the terminal role. Therefore, the load of the server increases as the number of clients increases.

In addition, the conventional server-based software service has a limitation in processing high-performance graphics tasks such as 3D rendering by using a method of transmitting the result image executed in the server to the client.

Therefore, conventional server-based software services have problems such as resource waste of high-end client PCs, service limit due to server load, enormous server purchase cost, and slow service performance.

In a conventional server-based software service, a session management technology that is dependent on an operating system (OS) or a desktop service supports a plurality of users on a single server through a virtual machine.

This has a problem that OS dependency of a server providing a server-based software service, introduction cost of a server due to load of a virtual machine, and management constraints occur.

In recent years, with the spread of smartphone terminals and the development of wireless networks, VDI users' access environment has expanded from PCs to mobile terminals such as smart phones and tablets, and the need for web-based VDI protocols is increasing.

The existing web-based VDI protocol has a structure that is somewhat inappropriate for the web environment, such as client rendering and the use of the unsupported image format.

Accordingly, there is a need for a web-based concrete technique for improving the graphic processing performance in consideration of the web standard and adapted to various user access environments.

Korean Patent Publication No. 10-2014-0070200

SUMMARY OF THE INVENTION Accordingly, the present invention has been made keeping in mind the above problems occurring in the prior art,

It is an object of the present invention to provide a Web-based VDI protocol performance improvement function for enhancing graphic processing performance and to provide seamless Web-based VDI service by adapting to various user access environments considering web standards.

In order to achieve the object of the present invention,

A graphics processing system for providing improved rendering performance of a web based VDI according to an embodiment of the present invention includes:

An update detector 110 for detecting the updated area of the image by comparing the information obtained from the frame buffer 50 with the previous image in order to detect the updated area in comparison with the previous image and providing the detected image block to the video detector 110 )Wow;

A video detector 120 for classifying the video area among the updated areas continuously provided for a predetermined time and providing the classified area information to the smart encoder;

A smart encoder 130 for acquiring current network status information from the client monitoring unit 140 to the client device 200, and encoding the image and video data to provide a web socket packetizer;

A client monitor 140 for monitoring client device information accessed by using the network monitor module 141 and the navigator 142;

And a Web socket packetizer 150 for packing and decoding the encoded data obtained by the smart encoder into a Web socket packet to transmit the encoded data to the client device.

And a client device 200 for continuously providing connection information to the client monitoring unit 140, thereby solving the problems of the present invention.

A graphics processing system that provides improved rendering performance of a web-based VDI according to the present invention,

It provides web-based VDI protocol performance enhancement to improve the graphics processing performance. It provides web-based VDI service seamlessly by adapting to various user access environment considering web standard, so that any VDI Service, which will contribute to the expansion of the VDI market by adapting to the changing paradigm.

FIG. 1 is an overall configuration diagram of a graphics processing system that provides enhancement of rendering performance of a Web-based VDI according to an embodiment of the present invention.
2 is a block diagram of a VDI service means of a graphics processing system providing rendering enhancement of a web based VDI according to an embodiment of the present invention.

Hereinafter, an exemplary embodiment of a graphics processing system for improving the rendering performance of the web-based VDI according to the present invention will be described in detail.

FIG. 1 is an overall configuration diagram of a graphics processing system that provides enhancement of rendering performance of a Web-based VDI according to an embodiment of the present invention.

1, a graphics processing system for improving the rendering performance of a Web-based VDI according to an exemplary embodiment of the present invention includes a guest OS 10, a QEMU 30, a VDI service unit 100, , And a client device (200).

In order to provide a service pursued by the present invention, the VDI protocol is divided into three types, namely, host rendering, client rendering, and screen scraping, Loses.

Since the client rendering method performs graphic rendering at the client end, the amount of data to be transmitted from the host to the client is small, but a client with a certain performance or more is required.

The existing web-based VDI protocol mainly uses the client rendering method, but the client rendering method is not suitable because the web lacks the graphic rendering performance compared with the native application due to the multi-layer and hardware access restriction.

Disruption caused by graphic rendering delay degrades the quality of VDI service and user satisfaction.

And while the Web only supports limited image formats such as JPEG, GIF and PNG, the existing Web-based VDI protocol uses a variety of other image formats.

In addition, if a proxy server is used for communication with a web client, only a lot of computing resources are consumed and wasted only in data format conversion.

Accordingly, the present invention provides a Web-based VDI protocol structure for enhancing graphics processing performance that can improve the performance and resource efficiency of the Web-based VDI protocol because it minimizes the traffic according to the client access environment based on the host rendering.

2 is a block diagram of a VDI service means of a graphics processing system providing rendering enhancement of a web based VDI according to an embodiment of the present invention.

As shown in FIG. 2, the VDI service means 100 includes an update detector 110; A video detector 120; A smart encoder 130; A client monitoring unit 140; And a Web socket packetizer 150.

The update detector 110 is configured to detect an updated area in comparison with a previous screen.

Specifically, the information obtained from the frame buffer 50 is compared with a previous screen to detect the updated area, and the detected image block is provided to the video detector.

The video detector 120 classifies the video area among the updated areas continuously provided for a predetermined time and provides the classified area information to the smart encoder.

That is, the Video Detector detects a video area of the updated area. Generally, the video area generates a large amount of network traffic due to a large amount of screen variation.

Accordingly, the Video Detector detects an area continuously updated for a predetermined period of time and classifies it as a video area, and transmits the classified area information to the Smart Encoder 130.

The smart encoder 130 acquires current network status information from the client device 140 and the client device 200, and encodes the image and video data to provide the web socket packetizer.

Specifically, the Smart Encoder encodes the image / video area according to the client connection environment.

That is, the client monitor 140 receives the current network status information from the user access terminal and encodes the image / video data.

The access terminal information is used for image resizing to deliver a user-terminal customized image, and the network status information is used to control the amount of network traffic generated in the host by determining the image type and quality to provide seamless VDI service do.

At this time, the client monitoring unit 140 monitors the client device information connected using the network monitor module 141 and the navigator 142.

In order to perform the functions as described above, the client monitoring unit 140,

A network monitor module (141) for monitoring the current network status of the client device (200);

And a navigator 142 for monitoring connection information of the client device 200 and providing monitoring information to the smart encoder 130.

In order to control the network traffic described above, it is necessary to know the information of the client device. In the client monitor part, information of the connected user is monitored using the network monitor and the navigator.

Client Monitor monitors the user's current network status using Network Monitor.

Then, the access terminal information is monitored using the Navigator.

This monitoring information is continuously notified to the Smart Encoder and used to determine the encoding type, quality and image size.

The web socket packetizer 150 performs a function of packing-encapsulating the encoded data obtained by the smart encoder into a web socket packet to transmit to the client device.

That is, the encoded data is packetized into a Web socket packet to be transmitted to the Web client.

Meanwhile, the client device 200 performs a function of continuously providing connection information to the client monitoring unit 140, and generally includes a web browser.

The web-based VDI protocol performance improvement function is provided to improve the graphic processing performance through the above-described configuration and operation, and a seamless web-based VDI service is provided by adapting to various user access environments in consideration of the web standard, VDI services are provided on any device that can support the VDI market by adapting to the changing paradigm.

It will be appreciated by those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. It is to be understood, therefore, that the embodiments described above are to be considered in all respects as illustrative and not restrictive.

The scope of the present invention is defined by the appended claims rather than the detailed description and all changes or modifications derived from the meaning and scope of the claims and their equivalents are to be construed as being included within the scope of the present invention do.

100: VDI service means
110: Update Detector
120: Video detector
130: Smart Encoder
140: Client monitor section
150: Web Socket Packetizer
200: Client device

Claims (3)

A graphics processing system for providing rendering performance enhancement,
An update detector 110 for detecting the updated area of the image by comparing the information obtained from the frame buffer 50 with the previous image in order to detect the updated area in comparison with the previous image and providing the detected image block to the video detector 110 )Wow;
A video detector 120 for classifying the video area among the updated areas continuously provided for a predetermined time and providing the classified area information to the smart encoder;
A smart encoder 130 for acquiring current network status information from the client monitoring unit 140 to the client device 200, and encoding the image and video data to provide a web socket packetizer;
A client monitor 140 for monitoring client device information accessed by using the network monitor module 141 and the navigator 142;
And a Web socket packetizer 150 for packing and decoding the encoded data obtained by the smart encoder into a Web socket packet to transmit the encoded data to the client device.
And a client device (200) for continuously providing connection information to the client monitoring unit (140). ≪ Desc / Clms Page number 19 >
The method according to claim 1,
The update detector 110,
A graphics processing system (100) for providing a rendering performance enhancement of a web based VIDIA (200), the method comprising: comparing a captured image from a frame buffer with a previous capture screen to minimize traffic transmitted to the client device (200) .
The method according to claim 1,
The client monitoring unit 140,
A network monitor module (141) for monitoring the current network status of the client device (200);
And a navigator (142) for monitoring connection information of the client device (200) and providing monitoring information to the smart encoder (130). The web processing system according to claim 1, system.

KR1020160008360A 2016-01-22 2016-01-22 Graphic processing system possible rendering Performance elevation of VDI based web KR20170088232A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160008360A KR20170088232A (en) 2016-01-22 2016-01-22 Graphic processing system possible rendering Performance elevation of VDI based web

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160008360A KR20170088232A (en) 2016-01-22 2016-01-22 Graphic processing system possible rendering Performance elevation of VDI based web

Publications (1)

Publication Number Publication Date
KR20170088232A true KR20170088232A (en) 2017-08-01

Family

ID=59650443

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160008360A KR20170088232A (en) 2016-01-22 2016-01-22 Graphic processing system possible rendering Performance elevation of VDI based web

Country Status (1)

Country Link
KR (1) KR20170088232A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020045939A1 (en) * 2018-09-01 2020-03-05 Samsung Electronics Co., Ltd. Electronic device and method of partially updating screen using same
CN115499330A (en) * 2022-09-22 2022-12-20 江苏超正科技有限公司 VDI virtual machine terminal data acquisition method and control system

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020045939A1 (en) * 2018-09-01 2020-03-05 Samsung Electronics Co., Ltd. Electronic device and method of partially updating screen using same
KR20200026429A (en) * 2018-09-01 2020-03-11 삼성전자주식회사 Electronic device and method for partial screen update thereof
US11004428B2 (en) 2018-09-01 2021-05-11 Samsung Electronics Co., Ltd Electronic device and method of partially updating screen using same
CN115499330A (en) * 2022-09-22 2022-12-20 江苏超正科技有限公司 VDI virtual machine terminal data acquisition method and control system

Similar Documents

Publication Publication Date Title
KR101773638B1 (en) Methods for interfacing with a virtualized computing service over a network using a lightweight client
JP5451397B2 (en) An architecture for delivering video content in response to remote interaction
EP2624611B1 (en) Method and system for visualizing an adaptive screen according to a terminal
KR101966921B1 (en) Method and Apparatus of managing muti-session
CN111399964A (en) Cloud desktop platform based on video streaming technology
WO2014070561A1 (en) Home cloud with virtualized input and output over home network
US9264284B2 (en) Virtual desktop access using wireless devices
KR20170088232A (en) Graphic processing system possible rendering Performance elevation of VDI based web
CN114586325B (en) Method, apparatus and medium for content preparation for media streaming networks
US9307225B2 (en) Adaptive stereoscopic 3D streaming
US9875076B1 (en) Remoting client having GPU off-loader
KR102199270B1 (en) System for cloud streaming service, method of cloud streaming service based on still image and apparatus for the same
Zhang et al. A heterogeneous auto-offloading framework based on web browser for resource-constrained devices
EP1821490A1 (en) Method for transmitting graphical data to a thin client
Baig et al. Virtual Network Computing Based Remote Desktop Access
KR102247887B1 (en) System for cloud streaming service, method of cloud streaming service using source information and apparatus for the same
CN113472732B (en) Method, apparatus and storage medium for managing capabilities of a media streaming network
KR20230080078A (en) Processing system for imiproving rendering performance of web-based virtual desktop infrastructure
Li et al. iScreen: A Merged Screen of Local System with Remote Applications in a Mobile Cloud Environment
Soorajprasad Virtumob: Remote desktop virtualization solution for smarphones
US10367876B2 (en) Environmentally adaptive and segregated media pipeline architecture for multiple streaming sessions
KR101473463B1 (en) System for providing terminal service by providing compressed display information in server based computing system of terminal environment and method thereof
KR20210027341A (en) System for cloud streaming service, method of image cloud streaming service considering full screen transition and apparatus for the same
KR20160132607A (en) System for cloud streaming service, method of image cloud streaming service using data substitution and apparatus for the same
Mahesh et al. Desktop viewer solution for mobile computing using virtual network computing

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right