WO2017150792A1 - Apparatus and method for providing contents using web-based virtual desktop protocol - Google Patents

Apparatus and method for providing contents using web-based virtual desktop protocol Download PDF

Info

Publication number
WO2017150792A1
WO2017150792A1 PCT/KR2016/014706 KR2016014706W WO2017150792A1 WO 2017150792 A1 WO2017150792 A1 WO 2017150792A1 KR 2016014706 W KR2016014706 W KR 2016014706W WO 2017150792 A1 WO2017150792 A1 WO 2017150792A1
Authority
WO
WIPO (PCT)
Prior art keywords
client
virtual desktop
content
screen
control unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2016/014706
Other languages
French (fr)
Inventor
Eui Nam Huh
Ja Hun Ku
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kyung Hee University
Original Assignee
Kyung Hee University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kyung Hee University filed Critical Kyung Hee University
Priority to US16/081,004 priority Critical patent/US10868850B2/en
Publication of WO2017150792A1 publication Critical patent/WO2017150792A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/957—Browsing optimisation, e.g. caching or content distillation
    • G06F16/9574—Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00—Arrangements for monitoring or testing data switching networks
    • H04L43/08—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters
    • H04L43/0805—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability
    • H04L43/0817—Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters by checking availability by checking functioning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/80—Responding to QoS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/24—Monitoring of processes or resources, e.g. monitoring of server load, available bandwidth, upstream requests
    • H04N21/2402—Monitoring of the downstream path of the transmission network, e.g. bandwidth available
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25825—Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4782—Web browsing, e.g. WebTV

Definitions

  • the present invention relates to a virtual desktop protocol suitable for a web environment, and a method and apparatus using the same.
  • VDI Virtual Desktop Infrastructure
  • VDI provides a user with a virtual desktop that can be used anywhere and anytime.
  • performance of a remote desktop protocol is important.
  • the remote desktop protocol is not designed in consideration of a web environment, and thus it needs a proxy server to perform communication between a client and a web browser.
  • Korean Patent Application Publication No. 10-2014-0036220 (Publication Date: March 25, 2014) titled "WEB BROWSER BASED DESKTOP AND APPLICATION REMOTING SOLUTION" discloses that a proxy server exists between a remote presentation server and a client and establishes a remote presentation session comprising a hypertext transfer protocol (HTTP) session with the client, that the proxy server generates graphics encoded by the remote presentation protocol and transmits the graphics to the proxy server, that the proxy server encodes the graphics into a video and transmits the encoded video to the client to be displayed through a web browser, and that a web browser implemented on the client renders a web page including the video and displays the result on a display device of the client.
  • HTTP hypertext transfer protocol
  • rendering is performed at the client side degrades graphic processing performance, compared to the case of using a negative application, and thus it is not an adequate method.
  • the existing remote desktop protocols use various formats, such as Raw, Copyrect, and QUIC, to transmit a virtual desktop screen, but a web browser supports only a limited number of formats, such as Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG). If a non-supported format is used, a client needs to use an additional decoder which is not optimized for a web environment, thus degrading decoding performance.
  • JPEG Joint Photographic Coding Experts Group
  • PNG Portable Network Graphics
  • websocket needs to be used for real-time data transmission to a web browser.
  • the existing technologies utilize a proxy server which causes network delay.
  • An object of the present invention is to provide an apparatus and method of using a web-based virtual desktop protocol which enhances user accessibility and provides improved user experience.
  • Another object of the present invention is to provide an apparatus and method of using a web-based desktop protocol which is capable of reducing network traffic, regardless of rendering operation performed at a host side.
  • Another object of the present invention is to provide an apparatus and method of using a web-based virtual desktop protocol of using a protocol which is capable of controlling a virtual desktop at a client side.
  • Another object of the present invention is to provide an apparatus and method of using a web-based virtual desktop protocol which is capable of removing network delay.
  • a method of providing content by an apparatus of using a web-based virtual desktop protocol including: monitoring a network status of a client, adjusting encoding quality of the content based on the network status of the client, and providing the content of the adjusted encoding quality to the client, wherein the content of the adjusted encoding quality is displayed through a web browser of the client.
  • the method may further include, before the adjusting of encoding quality, capturing a screen of a virtual desktop allocated to the client.
  • the method may further include calculating an entropy value of the captured screen, and determining a compression format for the captured screen based on the calculated entropy value.
  • the captured screen may be compressed into one of Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG).
  • JPEG Joint Photographic Coding Experts Group
  • PNG Portable Network Graphics
  • the determining may include classifying the captured screen using an equation which is derived based on a PNG filter and Shannon Entropy Algorithm.
  • the network status of the client may be acquired by monitoring a transmission buffer of the apparatus and acquiring a network bandwidth of the client.
  • the adjusting may include monitoring resolution of the web browser of the client, and adjusting size of the content according to the resolution of the web browser.
  • the adjusting may include adjusting a frame of the content based on the network status.
  • the method may further include performing direct communication with the web browser of the client based on websocket.
  • the performing of direction communication may include receiving control information on at least one of a mouse, a keyboard, and a screen of the virtual desktop from the client, and controlling the mouse, the keyboard, and the screen based on the received control information.
  • an apparatus of using a web-based virtual desktop protocol including: a monitor configured to monitor a network status of a client, a control unit configured to control encoding quality of content based on the network status of the client, an encoder configured to encode the content by control of the control unit, and a connection managing unit configured to manage connection with the client, wherein the encoded content is provided to the client and displayed through a web browser of the client.
  • a server is able to adaptively perform encoding based on the network status of a client, so that network traffic may be reduced even when a host performs rendering.
  • a user is able to control a screen, a keyboard, and a mouse of a virtual desktop via a client.
  • Websocket-based connection management enables direct communication between a server and a client, so that network delay due to a proxy server may be removed.
  • FIG. 1 is a flowchart illustrating a method of providing content using a web-based virtual desktop protocol according to an embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating a server and a client, both of which utilize a web-based virtual desktop protocol according to an embodiment of the present invention.
  • FIG. 3 is a graph for comparison of CPU usage between a virtual desktop server according to the present invention and virtual desktop servers according to existing technologies.
  • FIG. 4 is a graph for comparison of CPU usage between a client according to the present invention and clients according to existing technologies.
  • FIG. 5 is a graph for comparison between network traffic between the present invention and network traffic according to existing technologies.
  • FIG. 6 is a graph for comparison of a frame rate according to the present invention and a frame rate according to existing technologies.
  • an expression such as “comprising” or “including” is intended to designate a characteristic, a number, a step, an operation, an element, a part or combinations thereof, and shall not be construed to preclude any presence or possibility of one or more other characteristics, numbers, steps, operations, elements, parts or combinations thereof.
  • an expression such as "unit” indicates a unit of performing at least one function or operation, and it may be implemented as hardware, software, or a combination of hardware and software.
  • FIG. 1 is a flowchart illustrating a method of providing content by use of a web-based virtual desktop protocol according to an embodiment of the present invention.
  • a virtual desktop server an apparatus of using a virtual desktop protocol (hereinafter, referred to as a virtual desktop server) according to the present invention.
  • a virtual desktop server may provide at least one virtual desktop to a client. To this end, the virtual desktop server may allocate at least one virtual desktop to each client.
  • the virtual desktop server may capture the screen of the virtual desktop allocated to the client in S110. Then, the virtual desktop server may classify the captured screen.
  • the virtual desktop server may compress the captured screen into a specific image format.
  • the specific image format may include, for example, Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG).
  • JPEG and PNG are merely exemplary, and the specific image format in this embodiment may include other various image formats, apart from JPEG and PNG.
  • the virtual desktop server may calculate an entropy value of the captured screen, and determine a compression format suitable for the captured screen or image among various image formats (e.g., JPEG and PNG) according to the entropy value. That is, network traffic may be reduced by use of a multi-codec.
  • the virtual desktop server may calculate an entropy value of the captured screen based on the following Equation 1.
  • Equation 1 may be derived based on an PNG filter and Shannon Entropy Algorithm.
  • the virtual desktop server is able to adjust encoding quality and/or frame of content to be provided to a client.
  • the encoding quality and/or frame of content may be adjusted based on a network status of the client.
  • the virtual desktop server may determine encoding quality by monitoring a network status of the client in S130.
  • the virtual desktop server may monitor the network status of the client periodically or at a time when a compression format is determined.
  • information on the network status of the client may be acquired by monitoring a transmission buffer of the virtual desktop and calculating a network bandwidth of the client. It is because the client is not capable of monitoring the network status by itself.
  • the virtual desktop server may encode a corresponding screen with low-quality for the purpose of seamlessly provision of a service. On contrary, if it is determined that the network quality is good, the virtual desktop server may encode the corresponding screen with high-quality.
  • the virtual desktop server may determine size of the content and adjust size (or resolution) of the corresponding screen (or image) in S140.
  • the virtual desktop server may further reduce network traffic by compressing the content into size suitable for a user device.
  • the virtual desktop server may perform operation S140 based on resolution of a web browser of the client, which is acquired by monitoring of the user device. For example, if the resolution of the web browser is lower than resolution of the virtual desktop server, the virtual desktop server may adjust the size of the corresponding screen in order to reduce network traffic.
  • the virtual desktop server may adaptively encode the content in the above-described procedures in S150 and provide the encoded content to the client in S160, and the client may display the content, received from the virtual desktop server, through the web browser.
  • the virtual desktop serer may perform direct communication with the web browser of the client based on websocket.
  • each of the virtual desktop server and the client may include a connection managing unit.
  • the client may transmit, to the virtual desktop server, control information on at least one of a mouse, a keyboard, and a screen of the virtual desktop.
  • the virtual desktop server may control an input/output operation and a mapping operation of the mouse, the keyboard, and the screen.
  • FIG. 2 is a block diagram illustrating a server and a client, both of which utilize a web-based virtual desktop protocol according to an embodiment of the present invention.
  • a virtual desktop server 200 includes a control unit 201, a monitor 202, an encoder 203, and a connection managing unit 204, and a client 250 includes a control unit 251 and a connection managing unit 252.
  • the client 250 may further include a monitor in addition to the control unit 251 and the connection managing unit 252, the monitor which is used to output a video or image received from the virtual desktop server 200.
  • the control unit 201 which controls overall operation of the virtual desktop server 200, may perform the following operations: allocating at least one virtual desktop to the client 250, capturing a screen of the virtual desktop; and controlling encoding quality of content based on a network status of the client 250.
  • a monitor 202 includes a buffer monitor and a network analyzer so as to monitor information on the network status of the client 250 and information on a web browser of the client.
  • the monitor 202 may acquires information on the network status of the client by monitoring a transmission buffer of the virtual desktop server 200 and calculating a network bandwidth of the client.
  • the monitor 202 may monitor resolution of the web browser of the client 250.
  • the control unit 201 may control encoding quality, a frame, and size of content based on information monitored by the monitor 202. Specifically, the control unit 201 may calculate an entropy value of the captured screen of the virtual desktop screen, and determine a compression format for the captured screen based on the entropy value. At this point, the control unit 201 may classify the captured screen, so that the captured screen is compressed into one format between JPEG and PNG based on an equation which is derived based on a PNG filter or Shannon Entropy Algorithm. Thus, the control unit 201 provides the content in a format supported by the web browser and therefore the client 250 does not need an additional decoder.
  • the encoder 203 adaptively encodes the content by control of the control unit 201.
  • the encoder 203 may include a JPEG encoder and a PNG encoder.
  • the connection managing unit 204 manages connection to the client 250, and may perform direct communication with the web browser of the client 250 based on the websocket. Thus, network delay due to a proxy server may be removed.
  • control unit 201 may control the mouse, the keyboard, and the screen based on the received control information.
  • control unit 210 may include a screen capture, a mouse handler, and a keyboard handler.
  • control unit 251 of the client 250 includes a canvas control unit, a mouse receiver, and a keyboard receiver
  • the control unit 251 may receive a keyboard input, a mouse input, etc. from a user and may display content, which is received from the virtual desktop server 200, on a canvas by controlling the web browser.
  • the connection managing unit 252 may manage connection to the connection managing unit 204 of the virtual desktop server 200.
  • FIG. 3 is a graph for comparison of CPU usage between a virtual desktop server according to the present invention and virtual desktop servers according to existing technologies
  • FIG. 4 is a graph for comparison of CPU usage between a client according to the present invention and clients according to existing technologies
  • FIG. 5 is a graph for comparison between network traffic between the present invention and network traffic according to existing technologies
  • FIG. 6 is a graph for comparison of a frame rate according to the present invention and a frame rate according to existing technologies.
  • the present invention and perform the existing technologies are compared based on four scenarios (DOCUMENT, INTERNET, 320p VIDEO, 720p VIDEO).
  • FIGS. 3 and 4 are results of comparison of CPU usage of a virtual desktop server and a client.
  • WARP graphic processing procedure of the present invention
  • the CPU usage of a client is decreased by 38% on average.
  • the present invention utilizes an adaptive encoder to reduce network traffic and thus it shows an average of 52 % reduction in network traffic compared with the existing technologies.
  • the frame rate measurement of the prevent invention is increased by 9 frames on average, compared with the existing technologies, and therefore, it is proved that the web-based virtual desktop protocol according to the present invention exhibits excellent performance.
  • the virtual desktop server may include at least one of a processor, a storage device, an output interface for outputting a result of the processor, an input interface for receiving information from a user, and a communication module for transmitting and receiving data over a wired or wireless network.
  • the processor may include application-specific integrated circuit (ASIC), a different chip set, a logical circuit, and/or a data processing device.
  • the storage device may include a disk drive, a read-only memory (ROM), a random access memory (RAM), a flash memory, a memory card, and a storage medium.
  • the communication module may be configured as a Radio Frequency (RF) antenna or modem, and it may especially include a baseband circuit for processing a wireless signal.
  • RF Radio Frequency
  • operations of the virtual desktop server according to the specification may be implemented by the above processor, storage device, output interface, input interface, and communication module.
  • the web-based virtual desktop protocol according to the specification may be stored in a memory and implemented by a processor.
  • the memory may be located inside or outside the processor, and may be connected to the processor through various well-known means.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Graphics (AREA)
  • Environmental & Geological Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Business, Economics & Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)

Abstract

A method and an apparatus of providing content using a web-based virtual desktop protocol are provided. The method of providing content by the apparatus of using a web-based virtual desktop protocol includes monitoring a network status of a client, adjusting encoding quality of content based on the network status of the client, and providing the content of the adjusted encoding quality to the client, wherein the content of the adjusted encoding quality is applied through a web browser of the client.

Description

APPARATUS AND METHOD FOR PROVIDING CONTENTS USING WEB-BASED VIRTUAL DESKTOP PROTOCOL
The present invention relates to a virtual desktop protocol suitable for a web environment, and a method and apparatus using the same.
Virtual Desktop Infrastructure (VDI) provides a user with a virtual desktop that can be used anywhere and anytime. To enable the user at a remote area to experience as if he or she uses a local desktop, performance of a remote desktop protocol is important. However, the remote desktop protocol is not designed in consideration of a web environment, and thus it needs a proxy server to perform communication between a client and a web browser.
For example, Korean Patent Application Publication No. 10-2014-0036220 (Publication Date: March 25, 2014) titled "WEB BROWSER BASED DESKTOP AND APPLICATION REMOTING SOLUTION" discloses that a proxy server exists between a remote presentation server and a client and establishes a remote presentation session comprising a hypertext transfer protocol (HTTP) session with the client, that the proxy server generates graphics encoded by the remote presentation protocol and transmits the graphics to the proxy server, that the proxy server encodes the graphics into a video and transmits the encoded video to the client to be displayed through a web browser, and that a web browser implemented on the client renders a web page including the video and displays the result on a display device of the client. However, rendering is performed at the client side degrades graphic processing performance, compared to the case of using a negative application, and thus it is not an adequate method.
Meanwhile, the existing remote desktop protocols use various formats, such as Raw, Copyrect, and QUIC, to transmit a virtual desktop screen, but a web browser supports only a limited number of formats, such as Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG). If a non-supported format is used, a client needs to use an additional decoder which is not optimized for a web environment, thus degrading decoding performance.
In addition, websocket needs to be used for real-time data transmission to a web browser. For websocket communication, the existing technologies utilize a proxy server which causes network delay.
An object of the present invention is to provide an apparatus and method of using a web-based virtual desktop protocol which enhances user accessibility and provides improved user experience.
Another object of the present invention is to provide an apparatus and method of using a web-based desktop protocol which is capable of reducing network traffic, regardless of rendering operation performed at a host side.
Another object of the present invention is to provide an apparatus and method of using a web-based virtual desktop protocol of using a protocol which is capable of controlling a virtual desktop at a client side.
Another object of the present invention is to provide an apparatus and method of using a web-based virtual desktop protocol which is capable of removing network delay.
In one general aspect of the present invention, there is provided a method of providing content by an apparatus of using a web-based virtual desktop protocol, the method including: monitoring a network status of a client, adjusting encoding quality of the content based on the network status of the client, and providing the content of the adjusted encoding quality to the client, wherein the content of the adjusted encoding quality is displayed through a web browser of the client.
The method may further include, before the adjusting of encoding quality, capturing a screen of a virtual desktop allocated to the client.
The method may further include calculating an entropy value of the captured screen, and determining a compression format for the captured screen based on the calculated entropy value.
The captured screen may be compressed into one of Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG).
The determining may include classifying the captured screen using an equation which is derived based on a PNG filter and Shannon Entropy Algorithm.
The network status of the client may be acquired by monitoring a transmission buffer of the apparatus and acquiring a network bandwidth of the client.
The adjusting may include monitoring resolution of the web browser of the client, and adjusting size of the content according to the resolution of the web browser.
The adjusting may include adjusting a frame of the content based on the network status.
The method may further include performing direct communication with the web browser of the client based on websocket.
The performing of direction communication may include receiving control information on at least one of a mouse, a keyboard, and a screen of the virtual desktop from the client, and controlling the mouse, the keyboard, and the screen based on the received control information.
In another general aspect of the present invention, there is provided an apparatus of using a web-based virtual desktop protocol, the apparatus including: a monitor configured to monitor a network status of a client, a control unit configured to control encoding quality of content based on the network status of the client, an encoder configured to encode the content by control of the control unit, and a connection managing unit configured to manage connection with the client, wherein the encoded content is provided to the client and displayed through a web browser of the client.
By providing a web-based virtual desktop, it is possible to enhance user accessibility and provide improved user experience.
A server is able to adaptively perform encoding based on the network status of a client, so that network traffic may be reduced even when a host performs rendering.
A user is able to control a screen, a keyboard, and a mouse of a virtual desktop via a client.
Websocket-based connection management enables direct communication between a server and a client, so that network delay due to a proxy server may be removed.
FIG. 1 is a flowchart illustrating a method of providing content using a web-based virtual desktop protocol according to an embodiment of the present invention.
FIG. 2 is a block diagram illustrating a server and a client, both of which utilize a web-based virtual desktop protocol according to an embodiment of the present invention.
FIG. 3 is a graph for comparison of CPU usage between a virtual desktop server according to the present invention and virtual desktop servers according to existing technologies.
FIG. 4 is a graph for comparison of CPU usage between a client according to the present invention and clients according to existing technologies.
FIG. 5 is a graph for comparison between network traffic between the present invention and network traffic according to existing technologies.
FIG. 6 is a graph for comparison of a frame rate according to the present invention and a frame rate according to existing technologies.
Hereinafter, with reference to accompanying drawings, embodiments of the present invention are described in detail to allow those skilled in the art to easily implement the embodiments. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. In addition, some portions unrelated to the descriptions are omitted for clarity of the descriptions, and like reference numerals generally denote like elements in the description of each drawing.
Throughout the specification, an expression such as "comprising" or "including" is intended to designate a characteristic, a number, a step, an operation, an element, a part or combinations thereof, and shall not be construed to preclude any presence or possibility of one or more other characteristics, numbers, steps, operations, elements, parts or combinations thereof. In addition, an expression such as "unit" indicates a unit of performing at least one function or operation, and it may be implemented as hardware, software, or a combination of hardware and software.
FIG. 1 is a flowchart illustrating a method of providing content by use of a web-based virtual desktop protocol according to an embodiment of the present invention. Hereinafter, with reference to FIG. 1, there is provided description about a method or providing content by an apparatus of using a virtual desktop protocol (hereinafter, referred to as a virtual desktop server) according to the present invention.
A virtual desktop server may provide at least one virtual desktop to a client. To this end, the virtual desktop server may allocate at least one virtual desktop to each client.
In order to provide a screen of a virtual desktop to a client, the virtual desktop server may capture the screen of the virtual desktop allocated to the client in S110. Then, the virtual desktop server may classify the captured screen.
According to an embodiment, based on the above classification, the virtual desktop server may compress the captured screen into a specific image format. The specific image format may include, for example, Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG). In this case, the virtual desktop server may compress the captured screen into the most suitable format between JPEG and PNG based on the above classification. Of course, JPEG and PNG are merely exemplary, and the specific image format in this embodiment may include other various image formats, apart from JPEG and PNG.
To this end, the virtual desktop server may calculate an entropy value of the captured screen, and determine a compression format suitable for the captured screen or image among various image formats (e.g., JPEG and PNG) according to the entropy value. That is, network traffic may be reduced by use of a multi-codec. For example, the virtual desktop server may calculate an entropy value of the captured screen based on the following Equation 1.
Figure PCTKR2016014706-appb-M000001
wherein E denotes an entropy value of an image, h denotes height of the image, w denotes width of the image, and Pi denotes a probability or frequency distribution for all pixels at the i-th row (scanline) of the image. The above Equation 1 may be derived based on an PNG filter and Shannon Entropy Algorithm.
In another embodiment, the virtual desktop server is able to adjust encoding quality and/or frame of content to be provided to a client. The encoding quality and/or frame of content may be adjusted based on a network status of the client. For example, the virtual desktop server may determine encoding quality by monitoring a network status of the client in S130. To this end, the virtual desktop server may monitor the network status of the client periodically or at a time when a compression format is determined. Here, information on the network status of the client may be acquired by monitoring a transmission buffer of the virtual desktop and calculating a network bandwidth of the client. It is because the client is not capable of monitoring the network status by itself. If it is determined that the network quality is bad, the virtual desktop server may encode a corresponding screen with low-quality for the purpose of seamlessly provision of a service. On contrary, if it is determined that the network quality is good, the virtual desktop server may encode the corresponding screen with high-quality.
In addition, the virtual desktop server may determine size of the content and adjust size (or resolution) of the corresponding screen (or image) in S140. The virtual desktop server may further reduce network traffic by compressing the content into size suitable for a user device. For example, the virtual desktop server may perform operation S140 based on resolution of a web browser of the client, which is acquired by monitoring of the user device. For example, if the resolution of the web browser is lower than resolution of the virtual desktop server, the virtual desktop server may adjust the size of the corresponding screen in order to reduce network traffic.
The virtual desktop server may adaptively encode the content in the above-described procedures in S150 and provide the encoded content to the client in S160, and the client may display the content, received from the virtual desktop server, through the web browser.
In yet another embodiment, the virtual desktop serer may perform direct communication with the web browser of the client based on websocket. To this end, each of the virtual desktop server and the client may include a connection managing unit. By using the connection managing unit, the client may transmit, to the virtual desktop server, control information on at least one of a mouse, a keyboard, and a screen of the virtual desktop. Based on the control information received from the client, the virtual desktop server may control an input/output operation and a mapping operation of the mouse, the keyboard, and the screen.
FIG. 2 is a block diagram illustrating a server and a client, both of which utilize a web-based virtual desktop protocol according to an embodiment of the present invention.
Referring to FIG. 2, a virtual desktop server 200 includes a control unit 201, a monitor 202, an encoder 203, and a connection managing unit 204, and a client 250 includes a control unit 251 and a connection managing unit 252. Although not illustrated in the drawings, the client 250 according to another embodiment may further include a monitor in addition to the control unit 251 and the connection managing unit 252, the monitor which is used to output a video or image received from the virtual desktop server 200.
The control unit 201, which controls overall operation of the virtual desktop server 200, may perform the following operations: allocating at least one virtual desktop to the client 250, capturing a screen of the virtual desktop; and controlling encoding quality of content based on a network status of the client 250.
To this end, a monitor 202 includes a buffer monitor and a network analyzer so as to monitor information on the network status of the client 250 and information on a web browser of the client. For example, the monitor 202 may acquires information on the network status of the client by monitoring a transmission buffer of the virtual desktop server 200 and calculating a network bandwidth of the client. In addition, the monitor 202 may monitor resolution of the web browser of the client 250.
The control unit 201 may control encoding quality, a frame, and size of content based on information monitored by the monitor 202. Specifically, the control unit 201 may calculate an entropy value of the captured screen of the virtual desktop screen, and determine a compression format for the captured screen based on the entropy value. At this point, the control unit 201 may classify the captured screen, so that the captured screen is compressed into one format between JPEG and PNG based on an equation which is derived based on a PNG filter or Shannon Entropy Algorithm. Thus, the control unit 201 provides the content in a format supported by the web browser and therefore the client 250 does not need an additional decoder.
The encoder 203 adaptively encodes the content by control of the control unit 201. To this end, the encoder 203 may include a JPEG encoder and a PNG encoder.
The connection managing unit 204 manages connection to the client 250, and may perform direct communication with the web browser of the client 250 based on the websocket. Thus, network delay due to a proxy server may be removed.
When the control information on at least one of the mouse, the keyboard, and the screen of the virtual desktop is received from the client 250 through the connection managing unit 205, the control unit 201 may control the mouse, the keyboard, and the screen based on the received control information. To this end, the control unit 210 may include a screen capture, a mouse handler, and a keyboard handler.
Meanwhile, as the control unit 251 of the client 250 includes a canvas control unit, a mouse receiver, and a keyboard receiver, the control unit 251 may receive a keyboard input, a mouse input, etc. from a user and may display content, which is received from the virtual desktop server 200, on a canvas by controlling the web browser.
The connection managing unit 252 may manage connection to the connection managing unit 204 of the virtual desktop server 200.
FIG. 3 is a graph for comparison of CPU usage between a virtual desktop server according to the present invention and virtual desktop servers according to existing technologies, FIG. 4 is a graph for comparison of CPU usage between a client according to the present invention and clients according to existing technologies, FIG. 5 is a graph for comparison between network traffic between the present invention and network traffic according to existing technologies, and FIG. 6 is a graph for comparison of a frame rate according to the present invention and a frame rate according to existing technologies.
Referring to FIGS. 3 to 6, the present invention and perform the existing technologies are compared based on four scenarios (DOCUMENT, INTERNET, 320p VIDEO, 720p VIDEO).
FIGS. 3 and 4 are results of comparison of CPU usage of a virtual desktop server and a client. First, referring to FIG 3, the graphic processing procedure of the present invention (WARP) is performed largely by a server, and thus the average CPU usage is increased by 15 % on average, compared with the existing methods (noVNC and SPICE-HTML5). On the other hand, referring to FIG. 4, the CPU usage of a client (a web browser) is decreased by 38% on average.
Referring to FIG. 5, the present invention utilizes an adaptive encoder to reduce network traffic and thus it shows an average of 52 % reduction in network traffic compared with the existing technologies. Lastly, referring to FIG. 6, the frame rate measurement of the prevent invention is increased by 9 frames on average, compared with the existing technologies, and therefore, it is proved that the web-based virtual desktop protocol according to the present invention exhibits excellent performance.
The virtual desktop server according to the present invention may include at least one of a processor, a storage device, an output interface for outputting a result of the processor, an input interface for receiving information from a user, and a communication module for transmitting and receiving data over a wired or wireless network. Here, the processor may include application-specific integrated circuit (ASIC), a different chip set, a logical circuit, and/or a data processing device. The storage device may include a disk drive, a read-only memory (ROM), a random access memory (RAM), a flash memory, a memory card, and a storage medium. The communication module may be configured as a Radio Frequency (RF) antenna or modem, and it may especially include a baseband circuit for processing a wireless signal.
When the above-described embodiments are implemented as software, operations of the virtual desktop server according to the specification may be implemented by the above processor, storage device, output interface, input interface, and communication module. The web-based virtual desktop protocol according to the specification may be stored in a memory and implemented by a processor. The memory may be located inside or outside the processor, and may be connected to the processor through various well-known means.

Claims (20)

  1. A method of providing content by an apparatus of using a web-based virtual desktop protocol, the method comprising:
    monitoring a network status of a client;
    adjusting encoding quality of the content based on the network status of the client; and
    providing the content of the adjusted encoding quality to the client,
    wherein the content of the adjusted encoding quality is displayed through a web browser of the client.
  2. The method of claim 1, further comprising, before the adjusting of encoding quality, capturing a screen of a virtual desktop allocated to the client.
  3. The method of claim 2, further comprising:
    calculating an entropy value of the captured screen; and
    determining a compression format for the captured screen based on the calculated entropy value.
  4. The method of claim 3, wherein the captured screen is compressed into one of Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG).
  5. The method of claim 4, wherein the determining comprising classifying the captured screen using an equation which is derived based on a PNG filter and Shannon Entropy Algorithm.
  6. The method of claim 1, wherein the network status of the client is acquired by monitoring a transmission buffer of the apparatus and acquiring a network bandwidth of the client.
  7. The method of claim 1, wherein the adjusting comprises:
    monitoring resolution of the web browser of the client; and
    adjusting size of the content according to the resolution of the web browser.
  8. The method of claim 1, wherein the adjusting comprises adjusting a frame of the content based on the network status.
  9. The method of claim 1, further comprising performing direct communication with the web browser of the client based on websocket.
  10. The method of claim 9, wherein the performing of direction communication comprises:
    receiving control information on at least one of a mouse, a keyboard, and a screen of the virtual desktop from the client; and
    controlling the mouse, the keyboard, and the screen based on the received control information.
  11. An apparatus of using a web-based virtual desktop protocol, comprising:
    a monitor configured to monitor a network status of a client;
    a control unit configured to control encoding quality of content based on the network status of the client;
    an encoder configured to encode the content by control of the control unit; and
    a connection managing unit configured to manage connection with the client,
    wherein the encoded content is provided to the client and displayed through a web browser of the client.
  12. The apparatus of claim 11, wherein the control unit allocates at least one virtual desktop to the client, and captures a screen of the virtual desktop.
  13. The apparatus of claim 12, wherein the control unit calculates an entropy value of the captured screen, and determines a compression format for the captured screen based on the calculated entropy value.
  14. The apparatus of claim 13, wherein the control unit determines one of Joint Photographic Coding Experts Group (JPEG) and Portable Network Graphics (PNG) to be the compression format for the captured screen.
  15. The apparatus of claim 14, wherein the control unit classifies the captured screen using an equation which is derived based on an PNG filter and Shannon Entropy Algorithm.
  16. The apparatus of claim 11, wherein the monitor acquires information on the network status of the client by monitoring a transmission buffer of the apparatus and calculating a network bandwidth of the client.
  17. The apparatus of claim 11, wherein the monitor monitors resolution of the web browser of the client, and the control unit controls size of the content according to the resolution of the web browser.
  18. The apparatus of claim 11, wherein the control unit controls a frame of the content based on the network status.
  19. The apparatus of claim 11, wherein the connection managing unit performs direct communication with the web browser of the client based on websocket.
  20. The apparatus of claim 19, wherein, when control information on at least one of a mouse, a keyboard, and a screen of the virtual desktop is received from the client through the connection managing unit, the control unit controls the mouse, the keyboard, and the screen based on the received control information.
PCT/KR2016/014706 2016-02-29 2016-12-15 Apparatus and method for providing contents using web-based virtual desktop protocol Ceased WO2017150792A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/081,004 US10868850B2 (en) 2016-02-29 2016-12-15 Apparatus and method for providing contents using web-based virtual desktop protocol

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2016-0024169 2016-02-29
KR1020160024169A KR101742258B1 (en) 2016-02-29 2016-02-29 Apparatus and method for providing contents using web-based virtual desktop protocol

Publications (1)

Publication Number Publication Date
WO2017150792A1 true WO2017150792A1 (en) 2017-09-08

Family

ID=59052338

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/014706 Ceased WO2017150792A1 (en) 2016-02-29 2016-12-15 Apparatus and method for providing contents using web-based virtual desktop protocol

Country Status (3)

Country Link
US (1) US10868850B2 (en)
KR (1) KR101742258B1 (en)
WO (1) WO2017150792A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110622449A (en) * 2017-11-06 2019-12-27 网络编码代码有限责任公司 System and technique for generating, sending, and receiving Network Coded (NC) fast UDP Internet connection (QUIC) packets

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101742258B1 (en) * 2016-02-29 2017-05-31 경희대학교 산학협력단 Apparatus and method for providing contents using web-based virtual desktop protocol
CN110058912A (en) * 2019-03-22 2019-07-26 山东超越数控电子股份有限公司 A method of Spice remote desktop is accessed by web browser
KR102848453B1 (en) * 2020-10-28 2025-08-20 삼성에스디에스 주식회사 Method for controlling virtual multi screen, method for sending and receiving virtual environment, and apparatus implementing the same method
CN113570238A (en) * 2021-07-26 2021-10-29 北京浩瀚深度信息技术股份有限公司 Internet quality index evaluation method and quality optimization method and system
CN113918858A (en) * 2021-10-15 2022-01-11 西安万像电子科技有限公司 Method, electronic device and storage medium for self-adapting screen resolution of web interface
WO2025084650A1 (en) * 2023-10-17 2025-04-24 삼성전자 주식회사 Electronic device and operating method thereof

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110028561A (en) * 2003-05-12 2011-03-18 구글 인코포레이티드 Video Compression Method
KR101237505B1 (en) * 2011-09-06 2013-02-27 주식회사 비티비솔루션 Apparatus and method for providing virtual desktop service providing multi-session
KR20140036220A (en) * 2011-06-10 2014-03-25 마이크로소프트 코포레이션 Web-browser based desktop and application remoting solution
KR20150040872A (en) * 2012-06-28 2015-04-15 엑시스 에이비 System and method for encoding video content using virtual intra-frames

Family Cites Families (47)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7171444B2 (en) * 2001-11-14 2007-01-30 Sharp Laboratories Of America, Inc. Remote desktop protocol compression system
US8711929B2 (en) * 2006-11-01 2014-04-29 Skyfire Labs, Inc. Network-based dynamic encoding
US20080313545A1 (en) * 2007-06-13 2008-12-18 Microsoft Corporation Systems and methods for providing desktop or application remoting to a web browser
US8560593B2 (en) * 2008-03-27 2013-10-15 Dell Software Inc. System for provisioning, allocating, and managing virtual and physical desktop computers in a network computing environment
WO2010021631A1 (en) * 2008-08-22 2010-02-25 Hewlett-Packard Development Company, L.P. Remote graphics console and virtual media access to virtual machine guests
US9223548B2 (en) * 2008-09-15 2015-12-29 Apple Inc. Method and apparatus for providing an application canvas framework
US8180905B2 (en) * 2008-12-09 2012-05-15 Microsoft Corporation User-mode based remote desktop protocol (RDP) encoding architecture
US8189661B2 (en) * 2009-03-09 2012-05-29 Microsoft Corporation Remote desktop protocol (RDP) tile image classification for improving compression efficiency and quality
US9459936B2 (en) * 2009-05-01 2016-10-04 Kaazing Corporation Enterprise client-server system and methods of providing web application support through distributed emulation of websocket communications
US8392596B2 (en) * 2009-05-26 2013-03-05 Red Hat Israel, Ltd. Methods for detecting and handling video and video-like content in remote display system
US9510048B2 (en) * 2009-05-26 2016-11-29 Red Hat Israel, Ltd. Dynamically changing streaming video quality
US8473958B2 (en) * 2009-05-31 2013-06-25 Red Hat Israel, Ltd. Adjusting client display devices based on settings included in a notification from remote virtual machine host prior to connection establishment
US8676949B2 (en) * 2009-11-25 2014-03-18 Citrix Systems, Inc. Methods for interfacing with a virtualized computing service over a network using a lightweight client
US8385666B2 (en) * 2010-03-31 2013-02-26 Microsoft Corporation Classification and encoder selection based on content
US8601129B2 (en) * 2010-06-30 2013-12-03 International Business Machines Corporation Hypervisor selection for hosting a virtual machine image
US8533166B1 (en) * 2010-08-20 2013-09-10 Brevity Ventures LLC Methods and systems for encoding/decoding files and transmission thereof
US20120075346A1 (en) * 2010-09-29 2012-03-29 Microsoft Corporation Low Complexity Method For Motion Compensation Of DWT Based Systems
US9244912B1 (en) * 2010-12-10 2016-01-26 Wyse Technology L.L.C. Methods and systems for facilitating a remote desktop redrawing session utilizing HTML
US9535560B1 (en) * 2010-12-10 2017-01-03 Wyse Technology L.L.C. Methods and systems for facilitating a remote desktop session for a web browser and a remote desktop server
US9430036B1 (en) * 2010-12-10 2016-08-30 Wyse Technology L.L.C. Methods and systems for facilitating accessing and controlling a remote desktop of a remote machine in real time by a windows web browser utilizing HTTP
US9395885B1 (en) * 2010-12-10 2016-07-19 Wyse Technology L.L.C. Methods and systems for a remote desktop session utilizing HTTP header
US9245047B2 (en) * 2010-12-10 2016-01-26 Wyse Technology L.L.C. Methods and systems for facilitating a remote desktop session utilizing a remote desktop client common interface
US20120246554A1 (en) * 2011-03-23 2012-09-27 Ericom Software Ltd. Performing binary composition of images onto an html canvas element
JP5699755B2 (en) * 2011-03-31 2015-04-15 富士通株式会社 Allocation method, allocation device, and allocation program
EP2719178B1 (en) * 2011-06-10 2022-02-16 Citrix Systems, Inc. Macroblock-level adaptive quantization in quality-aware video optimization
US8819171B2 (en) * 2011-09-07 2014-08-26 Microsoft Corporation Monitoring and benchmarking client performance from the server-side
US20140285437A1 (en) * 2011-10-28 2014-09-25 Thomson Licensing Method of internet browser-based remote user interface virtual mouse cursor positioning
US9582240B2 (en) * 2012-12-26 2017-02-28 Vmware, Inc. Using contextual and spatial awareness to improve remote desktop imaging fidelity
US9380562B1 (en) * 2013-01-22 2016-06-28 Hypori, Inc. System, method and computer program product for providing notifications from a virtual device to a disconnected physical device
US8933826B2 (en) * 2013-03-01 2015-01-13 Gurulogic Microsystems Oy Encoder apparatus, decoder apparatus and method
US20140267281A1 (en) * 2013-03-13 2014-09-18 Ericom Software Ltd. Method for displaying a remote desktop on a portable touch screen device
US9438917B2 (en) * 2013-04-18 2016-09-06 Futurewei Technologies, Inc. System and method for adaptive bandwidth management
US9124668B2 (en) * 2013-05-20 2015-09-01 Citrix Systems, Inc. Multimedia redirection in a virtualized environment using a proxy server
US9407725B2 (en) * 2013-06-14 2016-08-02 Dell Products L.P. Generic transcoding service for client-server communication
US9716740B2 (en) * 2013-06-14 2017-07-25 Dell Products L.P. Web-based transcoding to clients for client-server communication
SG10201912804TA (en) * 2013-12-26 2020-02-27 Univ Singapore Technology & Design A method and apparatus for reducing data bandwidth between a cloud server and a thin client
US9986242B2 (en) * 2014-01-28 2018-05-29 Vmware, Inc. Enhanced image encoding in a virtual desktop infrastructure environment
US9606769B2 (en) * 2014-04-05 2017-03-28 Qualcomm Incorporated System and method for adaptive compression mode selection for buffers in a portable computing device
WO2015155719A1 (en) * 2014-04-08 2015-10-15 eFace2Face, Inc. Methods, systems, and computer program products for operating a communication network to facilitate the secure sharing of content among multiple endpoints
US20150341472A1 (en) * 2014-05-20 2015-11-26 Jason Russell Yanofski System for real-time, graphics-based web communication using HTML 5 WebSockets
US10715577B2 (en) * 2014-09-09 2020-07-14 Vmware, Inc. Virtual desktop encoding based on user input behavior
US10114517B2 (en) * 2015-02-05 2018-10-30 Citrix Systems, Inc. Detecting content types and window regions in composited display frames
EP3292681B1 (en) * 2015-05-06 2022-07-06 Unify Patente GmbH & Co. KG Method, server and software product for controlling physical-side browser functions of remote desktop or virtual desktop environments
US20180167426A1 (en) * 2015-10-29 2018-06-14 CrankWheel ehf. Multiplatform Screen Sharing Solution for Software Demonstration
KR101742258B1 (en) * 2016-02-29 2017-05-31 경희대학교 산학협력단 Apparatus and method for providing contents using web-based virtual desktop protocol
WO2017171826A1 (en) * 2016-04-01 2017-10-05 Intel Corporation Entropic classification of objects
US20180234506A1 (en) * 2017-02-14 2018-08-16 Gu Zhang System and methods for establishing virtual connections between applications in different ip networks

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20110028561A (en) * 2003-05-12 2011-03-18 구글 인코포레이티드 Video Compression Method
KR20140036220A (en) * 2011-06-10 2014-03-25 마이크로소프트 코포레이션 Web-browser based desktop and application remoting solution
KR101237505B1 (en) * 2011-09-06 2013-02-27 주식회사 비티비솔루션 Apparatus and method for providing virtual desktop service providing multi-session
KR20150040872A (en) * 2012-06-28 2015-04-15 엑시스 에이비 System and method for encoding video content using virtual intra-frames

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
JA-HUN KU ET AL.: "Proposal of VDI Protocol Stucture based Web for Performan ce Improvemen t", PROCEEDINGS OF SYMPOSIUM OF THE KOREAN INSTITUTE OF COMMUNI CATIONS AND INFORMATION SCIENCES, June 2015 (2015-06-01), pages 820 - 821 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110622449A (en) * 2017-11-06 2019-12-27 网络编码代码有限责任公司 System and technique for generating, sending, and receiving Network Coded (NC) fast UDP Internet connection (QUIC) packets
CN110622449B (en) * 2017-11-06 2023-04-28 网络编码代码有限责任公司 Systems and techniques for processing network encoded packets

Also Published As

Publication number Publication date
US20190037000A1 (en) 2019-01-31
US10868850B2 (en) 2020-12-15
KR101742258B1 (en) 2017-05-31

Similar Documents

Publication Publication Date Title
WO2017150792A1 (en) Apparatus and method for providing contents using web-based virtual desktop protocol
KR101443070B1 (en) Method and system for low-latency transfer protocol
CN102457544B (en) Method and system for acquiring screen image in screen sharing system based on Internet
US7606314B2 (en) Method and apparatus for caching, compressing and transmitting video signals
US20090234919A1 (en) Method of Transmitting Data in a Communication System
CN105979216A (en) Video transmission method and device of region of interest
WO2014042662A1 (en) Bandwidth reduction system and method
CN112104918A (en) Image transmission method and device based on satellite network
EP2445168A1 (en) Method of transmitting data in a communication system
WO2018032696A1 (en) Method and system for desktop screenshot control
Boukerche et al. A reliable synchronous transport protocol for wireless image sensor networks
CN106899620A (en) A kind of data-sharing systems
US20120281757A1 (en) Scene change detection for video transmission system
CN110740352B (en) SPICE protocol-based difference image display method in video card transparent transmission environment
US20140297718A1 (en) Apparatus and method for transmitting image of multi-user
CN113596112A (en) Transmission method for video monitoring
CN110753243A (en) Image processing method, image processing server and image processing system
CN217240799U (en) Data transmission processing apparatus and vehicle
CN117255177A (en) Client self-adaptive video playing and requesting method, device, system and medium
CN111225238A (en) Information processing method and related equipment
CN110868614B (en) SPICE protocol-based difference image display system in video card transparent transmission environment
CN110798700B (en) Video processing method, video processing device, storage medium and electronic equipment
CN117692442A (en) Data transmission method, system, device, terminal equipment and readable storage medium
CN113965458A (en) Equipment parameter processing method and system
CN114615349B (en) Cloud VR interactive control data transmission method and device, intelligent terminal and storage medium

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16892805

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 16892805

Country of ref document: EP

Kind code of ref document: A1