CN105072190A - Method and system for realizing real-time desktop cloud - Google Patents

Method and system for realizing real-time desktop cloud Download PDF

Info

Publication number
CN105072190A
CN105072190A CN201510518532.9A CN201510518532A CN105072190A CN 105072190 A CN105072190 A CN 105072190A CN 201510518532 A CN201510518532 A CN 201510518532A CN 105072190 A CN105072190 A CN 105072190A
Authority
CN
China
Prior art keywords
module
desktop
data
virtual machine
terminal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201510518532.9A
Other languages
Chinese (zh)
Inventor
刘昌平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201510518532.9A priority Critical patent/CN105072190A/en
Publication of CN105072190A publication Critical patent/CN105072190A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/08Protocols specially adapted for terminal emulation, e.g. Telnet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L47/00Traffic control in data switching networks
    • H04L47/10Flow control; Congestion control
    • H04L47/38Flow control; Congestion control by adapting coding or compression rate
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4437Implementing a Virtual Machine [VM]

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The invention discloses a method and a system for realizing a real-time desktop cloud. The system comprises a terminal module, a server module, a desktop protocol module, a streaming media coding module, a streaming media service module, a portal module, an execution module and a database; the desktop protocol module acquires a desktop image and audio data from the virtual machine of the server module according to a remote desktop protocol, and then the desktop image and the audio data are transmitted to the terminal module for separate displaying and playing after being coded by the streaming media coding module and streamed by the streaming media service module. The terminal module sends an external device event message to the desktop protocol module and finally transfers the same to the virtual machine. The technical scheme of the present invention provides the method for realizing the real-time desktop cloud; a desktop cloud is deployed on a common assembled PC and an Android cellphone serves as the terminal module; the network time delay is about 0.1-0.3 second, and therefore, good real-time performance can be achieved.

Description

A kind of implementation method of real-time desktop cloud and system
Technical field
The invention belongs to field of cloud computer technology, particularly relate to little, the real-time desktop cloud implementation method of a kind of network delay and system.
Background technology
In desktop cloud application field, virtual machine runs on the remote server, by desktop picture and audio data transmission on terminal equipment (such as PC, thin-client, mobile terminal etc.).Terminal equipment exports desktop picture and audio signal, simultaneously acquisition terminal equipment peripheral hardware event (such as knocking keyboard, rolling mouse etc.) and feed back on the virtual machine of remote server, the desktop picture after renewal and voice data continue to be transferred to terminal equipment.After the real-time of desktop cloud refers to terminal equipment generation peripheral hardware event, the desktop picture that upgrades of virtual machine and voice data be sent to terminal equipment and exported complete, time delay between the two.Network delay is less, and the real-time of desktop cloud is better.
Because the data volume of desktop picture and audio frequency is very large, very high to the requirement of network transfer speeds, network bandwidth consumption is very large, and the communication protocol therefore between virtual machine and terminal equipment and communication mode just seem extremely important.Communication protocol main at present has the RDP (RemoteDesktopProtocol of Microsoft, RDP), the ICA agreement of Citrix, the PCoIP agreement of VMware and the SPICE agreement etc. of increasing income, the processing mode of most of communication protocol to desktop picture processes the image of region of variation and transmission after compressing.Nonetheless, in the significant situation of virtual machine desktop image change (such as played in full screen digital film, fast switching full screen window etc.), data traffic is still very large, the problem caused thus is, the image of terminal equipment shows zigzag, there is disconnection phenomenon in audio signal, and time delay is very large, the non-constant of real-time.
Existing patented technology is as follows:
Patent Application Publication No is that " CN102647456, denomination of invention is the cloud computing application that " method and system building desktop cloud " attempt to integrate applying virtual and desktop virtual, avoids loaded down with trivial details License Authorized operation.In this desktop cloud, subscriber terminal equipment is connected to virtual machine by remote protocol (RDP, ICA, PCoIP etc.) and is transmitted desktop picture and voice data.
Patent Application Publication No is CN103685508A, denomination of invention seeks the method for a kind of thin client to remote server transmission still image for " the videography transmission call method based under cloud desktop platform low bandwidth model ", and the picture file that thin client shooting generates is redirected client by thin-client TWAIN client transmissions to high in the clouds TWAIN.TWAIN agreement is that application software obtains the international standard of still image from computer peripheral equipment, can not transmit dynamic desktop picture and voice data.
" a kind of method of dynamic distribution cloud desktop " (invention Authorization Notice No.: CN102882968B) provides a kind of management method of virtual machine.In this desktop cloud, terminal equipment is connected to virtual machine by the agreement of RDP and so on, and it is still very poor that terminal use uses the real-time of desktop cloud to experience.
The terminal equipment of " a kind of cloud desktop based on OpenStack and Spice realizes " (patent application notification number: CN104580399A) utilizes SPICE agreement to be connected to virtual machine and transmitting image and voice data.SPICE protocol class is similar to the agreements such as RDP, ICA, very large to network bandwidth consumption, needs the resource of 10 ~ 20MBPS under normal circumstances, the poor real of desktop cloud.
" a kind of video stream processing method based on cloud desktop and device " (patent application notification number: CN104394486A) adjusts compression ratio and the frame per second of video image according to the network speed of terminal equipment, if the network speed of terminal equipment is fast, adopt lower video image compression rate and frame per second, otherwise, adopt higher compression ratio and frame per second; Communication protocol between terminal equipment and virtual machine is SPICE.
" a kind of use the method for cloud desktop, device and cloud desktop system " (patent application notification number: CN104735108A) provides the operation interface of desktop cloud and cloud application program according to dissimilar (such as the screen size) of terminal use, adopts the RDP of RDP and so between terminal equipment and virtual machine.
" a kind of long-distance cloud desktop operating system " (patent application notification number: CN103986786A), " processing method of cloud desktop and device " (patent application notification number: CN104468741A) adopt the RDP of RDP and so on to set up connection between terminal equipment and virtual machine." processing method of cloud desktop and device " (patent application notification number: CN104468741A) solves emphatically the switching problem of multiple desktop cloud window on terminal equipment.
" cloud desktop picture classification nad code method " (patent application notification number: CN103402091A) provides a kind of cloud desktop picture to classify and coding method.The method is processed for desktop still image, image transmitting amount is reduced under the prerequisite ensureing image definition,, desktop picture region of variation frequent in desktop picture change greatly, data traffic between terminal equipment and virtual machine is still very large, and does not support the voice data of desktop cloud.
" cloud desktop system " (patent application notification number: CN103841179A) is the special network system dish of terminal distribution and network data dish on the server, the data such as identify label, configuration file of network system disk storage terminal use, network data disk storage personal data, these data or regularly or in real time keep synchronous between terminal equipment with server.In this desktop cloud, the data between terminal equipment and server are not desktop picture and voice data, and data volume is also little.
The terminal equipment of " a kind of media control method based on desktop cloud and equipment " (patent application notification number: CN103475953A) gathers multi-medium data, according to the window adjustment instructions of Cloud Server, represent multi-medium data at the assigned address of terminal equipment.Cloud Server sends instruction to terminal equipment, and terminal equipment sends multimedia file to Cloud Server, and Cloud Server is not to desktop picture and the voice data of terminal equipment transfer of virtual machine.
" a kind of turn to the method for play multimedia file, virtual machine and system under desktop cloud " (patent application notification number: CN104349177A) provides a kind of terminal equipment with the method for multimedia file on Streaming Media form Play Server.Server needs Streaming Media address to inform terminal equipment, and this technological means of informing is desktop cloud, namely by desktop protocol, the network address of Streaming Media is passed to desktop cloud client, do not solve the desktop picture of virtual machine itself and the transmission of voice data.
(patent application notification number: CN103873568A) mode of obtaining virtual machine desktop image is not pass through virtual platform " to realize the system and method for remote virtual desktop display based on cloud computing ", but in VME operating system inside, special waiing upon is installed and admits defeated part ([0066] section), this is waitd upon part of admitting defeated and to operate in virtual machine and to adopt the mode of grabbing screen to obtain desktop picture, is completed the coding ([0068,0069] section) of desktop picture by virtual machine itself.In addition this is waitd upon part of admitting defeated and is also responsible for the communication with terminal, the instruction ([0074] section) of receiving terminal.This patent only can process desktop picture, the voice data of virtual machine and the situation of virtual machine change resolution can not be processed, do not solve the problem that terminal equipment starts, closes virtual machine, dynamic assignment and debugging management can not be carried out to the resource such as virtual machine, server.
The PCoIP agreement of the RDP agreement of Microsoft, the ICA agreement of Citrix, VMware and VNC, SPICE agreement of increasing income etc. are carried out Difference Calculation to desktop picture and are carried out Internet Transmission after compression, that is, only the region that desktop picture changes is sent to client.Resolution with 800 × 600,32 number of colours, 24 frames per second, 10% image compression ratio calculate, the bandwidth that virtual machine displaying video needs is 35.15625Mbps, adopts 1024 × 768 resolution then to need 57.6Mbps.As can be seen here, network traffics cause time delay large, poor real.
Summary of the invention
For solving the problems of the technologies described above, the object of this invention is to provide a kind of implementation method and system of real-time desktop cloud, the method and system reduce Internet Transmission time delay, and build real-time desktop cloud in this approach.
Object of the present invention is realized by following technical scheme:
An implementation method for real-time desktop cloud, comprising:
RDP is utilized to obtain desktop picture and the voice data of virtual machine, and receiving terminal apparatus connection request and peripheral hardware event data; And when desktop picture resolution changes, process in time;
The desktop picture of acquisition is become multimedia file format with audio data coding, and exports;
Fluidization treatment is carried out to the multimedia file format data exported, generates stream media format data;
Streaming media formatted data is carried out decoding and is exported desktop picture and voice data; And
Send peripheral hardware event data.
Real-time desktop cloud realize a system, comprising:
Server module, desktop protocol module, streaming coding module, streaming media service module, terminal module, portal module, database and Executive Module; Described streaming coding module, streaming media service module, desktop protocol module and described virtual machine one_to_one corresponding, start or close corresponding streaming coding module, streaming media service module and desktop protocol module while startup or closedown virtual machine; Described
Desktop protocol module, set up the connection with virtual machine, obtain desktop picture and voice data according to RDP from virtual machine, start or close described streaming coding module and streaming media service module, and receiving terminal apparatus connection request and peripheral hardware event data; And when desktop picture resolution changes, process in time;
Streaming coding module, receives desktop picture and the voice data of desktop protocol module transfer, and described desktop picture is become multimedia file format with audio data coding;
Streaming media service module, carries out fluidization treatment to the multimedia file format data exported, and generates stream media format data;
Terminal module, obtain stream media format data, and streaming media formatted data is decoded, and exports desktop picture and voice data, and sends peripheral hardware event data;
Portal module, the authentication of receiving terminal module, startup or close virtual machine request, and by described request write into Databasce;
Executive Module, polling data storehouse, and the request of taking out terminal module from database is to perform.
Compared with prior art, one or more embodiment of the present invention can have the following advantages by tool:
Even if 1 played in full screen movie file on a virtual machine, becomes stream medium data by the desktop picture of virtual machine with audio data coding, the desktop picture of terminal equipment display there will not be zigzag, and the sound of output there will not be intermittently.
2, compared with the agreements such as RDP, ICA, PCoIP, SPICE, when virtual machine played in full screen film, after being encoded into Streaming Media, network traffics are less, less to network bandwidth consumption, and therefore network delay is less, and real-time is better.
3, when virtual machine runs, desktop protocol module, streaming coding module, streaming media service module put into operation, and after virtual machine is closed, these modules are also closed, and can improve the resource utilization of server, alleviate the load of server.
Accompanying drawing explanation
Fig. 1 is the implementation method flow chart of real-time desktop cloud;
Fig. 2 is the general system set-up figure of real-time desktop cloud;
Fig. 3 is an embodiment schematic diagram of real-time desktop cloud;
Fig. 4 is the schematic flow sheet starting virtual machine;
Fig. 5 is the handling process schematic diagram of change resolution;
Fig. 6 is the handling process schematic diagram of external equipment event;
Fig. 7 is the schematic flow sheet of closing virtual machine;
Fig. 8 is the desktop cloud schematic diagram in Multi-Client Concurrency Access situation.
Embodiment
For making the object, technical solutions and advantages of the present invention clearly, below in conjunction with embodiment and accompanying drawing, the present invention is described in further detail.
As shown in Figure 1, be the implementation method of real-time desktop cloud, the method comprises:
RDP is utilized to obtain desktop picture and the voice data of virtual machine, and receiving terminal apparatus connection request and peripheral hardware event data; And when desktop picture resolution changes, process in time;
The desktop picture of acquisition is become multimedia file format with audio data coding, and exports;
Fluidization treatment is carried out to the multimedia file format data exported, generates stream media format data;
Streaming media formatted data is carried out decoding and is exported desktop picture and voice data; And
Send peripheral hardware event data.
Said method also comprises:
Send authentication, virtual machine activation request, and by described request write into Databasce;
Polling data storehouse, performs according to described request.
As shown in Figure 2, realize system for real-time desktop cloud, this system comprises: server module, desktop protocol module, streaming coding module, streaming media service module, terminal module, portal module, database and Executive Module; Described
Desktop protocol module and virtual machine one_to_one corresponding, set up the connection with virtual machine, desktop picture and voice data is obtained from the virtual machine of server module according to RDP, start or close described streaming coding module and streaming media service module, and receiving terminal apparatus connection request and peripheral hardware event data; And when desktop picture resolution changes, process in time;
Streaming coding module and desktop protocol module one_to_one corresponding, receive desktop picture and the voice data of desktop protocol module transfer, and described desktop picture become multimedia file format with audio data coding;
Streaming media service module and streaming coding module one_to_one corresponding, the multimedia file format data that streaming media coding module exports carry out fluidization treatment, and generate stream media format data;
Terminal module, obtains stream media format data from streaming media service module, and export desktop picture and voice data to decoding data, terminal module and desktop protocol module set up a special data channel, event data such as peripheral hardware such as transmission keyboard, mouse etc.;
Portal module, the authentication of receiving terminal module, the request of startup virtual machine, and by described request write into Databasce;
Executive Module, for polling data storehouse, and the request of taking out terminal module from database is to perform.
Above-mentioned server module is a virtualization modules, utilizes existing Intel Virtualization Technology and instrument (as KVM, VMware) to set up virtual machine.
Above-mentioned terminal module and described desktop protocol intermodule arrange a special data channel, for sending described peripheral hardware event data.
Above-mentioned database purchase has the identity information of terminal use and the virtual machine for this user distribution, after terminal use logs on portal module, can only use the virtual machine being under the jurisdiction of oneself.Respective request is write historical data table after performing the request instruction of terminal use by Executive Module; The state of Executive Module periodic monitoring virtual machine, and by it write into Databasce.
An embodiment of real-time desktop cloud as shown in Figure 3, server module CentOS is as operating system, adopt VirtualBox as virtual platform and create virtual machine, adopt MySQL as database, adopt ffmpeg as streaming coding module, adopt x264 code database, adopt ffserver as streaming media service module, adopt Android phone as terminal module.RDPE is desktop protocol module, is the expansion module of RDP agreement, is responsible for resolving RDP agreement, and sets up special data channel with terminal module, is responsible for starting or closing streaming coding module and streaming media service module.Executive Module calls the SDK of VirtualBox, starts or closes virtual machine.Except terminal module, other modules are deployed on same physical server.In order to improve the real-time of desktop cloud, data between virtual machine and desktop protocol module, between desktop protocol module and streaming coding module, between streaming coding module and streaming media service module reside in the User space memory headroom of operating system all the time, shorten the buffer time of terminal module streaming media data.
Using assembling PC (IntelI5,8GB internal memory) as physical server, real-time desktop cloud is disposed by above-described embodiment, take Android phone as terminal equipment, server module is connected to by WIFI network, start a virtual machine, this virtual machine runs a timing software automatically, for measuring the real-time of desktop cloud.Gather the time on virtual machine timing software, and the time that on terminal equipment, desktop picture exports, both time differences are network delays of desktop cloud, and embody the real-time of desktop cloud, network delay was at 0.1 ~ 0.3 second simultaneously.If use the server that performance is more excellent instead, more excellent real-time performance can be obtained.
As shown in Figure 4, the flow process of above-mentioned terminal module startup virtual machine is:
(1) terminal module sends the request starting virtual machine to portal module;
(2) portal module by this request together with user profile write into Databasce;
(3), after Executive Module is polled to this request, virtual machine and desktop protocol module is started successively;
(4) after desktop protocol module starts, be first connected to virtual machine, then start streaming coding module and streaming media service module successively, wait for the connection of terminal module;
(5) Executive Module is by the result write into Databasce of request, and portal module takes out result and feeds back to terminal use from database;
(6) terminal use sets up the special data channel with desktop protocol module according to result, is finally connected to streaming media service module, shows image, output sound after decode streaming media data.
The operating system (such as WindowsXP, Windows7 etc.) of virtual machine is in startup, use procedure, and the resolution of operating system will change, the handling process (as shown in Figure 5) of virtual machine change resolution:
(1) desktop protocol module detects that the resolution of VME operating system changes, and obtains up-to-date resolution, sends to terminal module by special data channel;
(2) the streaming coding module run of desktop protocol end-of-module and streaming media service module, then restart this two modules, waits for the connection of terminal module;
(3), after terminal module obtains the resolution upgraded, re-establish the special data channel with desktop protocol module, reconnect to streaming media service module.
As shown in Figure 6, be the handling process of the external equipment event of terminal module:
(1) event data of the peripheral hardware such as keyboard, mouse is sent to desktop protocol module by special data channel by terminal module;
(2) peripheral hardware event data is sent to virtual machine by desktop protocol module, and virtual machine accepts peripheral hardware event and processes, and causes the change of desktop picture and sound;
(3) desktop protocol module obtains the desktop picture and voice data that upgrade, through Streaming Media process, is transferred to terminal module, and terminal module obtains stream medium data, shows desktop picture, outputting audio data in real time.
As shown in Figure 7, for the flow process of virtual machine is closed in terminal module request:
(1) terminal module handles the peripheral hardware such as keyboard or mouse, sends the instruction of closedown to virtual machine;
(2) virtual machine is closed after receiving instruction voluntarily, and desktop protocol module detects that virtual machine is closed;
(3) desktop protocol module sends the information of virtual machine closedown to terminal module by special data channel, then closes streaming media service module, streaming coding module successively, and last desktop protocol module self is closed;
(4) after terminal module receives the information of virtual machine closedown, disconnect the connection with desktop protocol module, disconnect the connection with streaming media service module.
Desktop protocol module, streaming coding module, streaming media service module are dynamic assignment and the module performed, when there being new virtual machine to put into operation, distribute for it and perform above-mentioned module, virtual machine closes above-mentioned module while closing, and reclaims server resource (as shown in Figure 8).
Although the execution mode disclosed by the present invention is as above, the execution mode that described content just adopts for the ease of understanding the present invention, and be not used to limit the present invention.Technical staff in any the technical field of the invention; under the prerequisite not departing from the spirit and scope disclosed by the present invention; any amendment and change can be done what implement in form and in details; but scope of patent protection of the present invention, the scope that still must define with appending claims is as the criterion.

Claims (10)

1. an implementation method for real-time desktop cloud, is characterized in that, described method comprises:
RDP is utilized to obtain desktop picture and the voice data of virtual machine, and receiving terminal apparatus connection request and peripheral hardware event data; And when desktop picture resolution changes, process in time;
The desktop picture of acquisition is become multimedia file format with audio data coding, and exports;
Fluidization treatment is carried out to the multimedia file format data exported, generates stream media format data;
Streaming media formatted data is carried out decoding and is exported desktop picture and voice data; And
Send peripheral hardware event data.
2. the implementation method of real-time desktop cloud as claimed in claim 1, it is characterized in that, described method also comprises:
Send authentication, virtual machine activation request, and by described request write into Databasce;
Polling data storehouse, performs according to described request.
3. the implementation method of real-time desktop cloud as claimed in claim 1, it is characterized in that, described peripheral hardware event data comprises keyboard data, mouse data.
4. real-time desktop cloud realize a system, it is characterized in that, described system comprises: server module, desktop protocol module, streaming coding module, streaming media service module, terminal module, portal module, database and Executive Module; Described streaming coding module, streaming media service module, desktop protocol module and described virtual machine one_to_one corresponding, start or close corresponding streaming coding module, streaming media service module and desktop protocol module while startup or closedown virtual machine; Described
Desktop protocol module, set up the connection with virtual machine, obtain desktop picture and voice data according to RDP from virtual machine, start or close described streaming coding module and streaming media service module, and receiving terminal apparatus connection request and peripheral hardware event data; And when desktop picture resolution changes, process in time;
Streaming coding module, receives desktop picture and the voice data of desktop protocol module transfer, and described desktop picture is become multimedia file format with audio data coding;
Streaming media service module, carries out fluidization treatment to the multimedia file format data exported, and generates stream media format data;
Terminal module, obtain stream media format data, and streaming media formatted data is decoded, and exports desktop picture and voice data, and sends peripheral hardware event data;
Portal module, the authentication of receiving terminal module, startup or close virtual machine request, and by described request write into Databasce;
Executive Module, polling data storehouse, and the request of taking out terminal module from database is to perform.
5. real-time desktop cloud as claimed in claim 4 realize system, it is characterized in that, described terminal module and described desktop protocol intermodule arrange a special data channel, for sending described peripheral hardware event data.
6. real-time desktop cloud as claimed in claim 4 realize system, it is characterized in that, described terminal module request starts virtual machine and specifically comprises:
Terminal module sends to portal module and starts virtual machine request, and by portal module by described request data write into Databasce;
Executive Module is polled in database after related data request, starts virtual machine and desktop protocol module;
Desktop protocol model calling after startup, to virtual machine, then starts described streaming coding module and streaming media service module successively, and is connected with terminal module;
The result of request is also written in database by described Executive Module, extracts data result in database and feed back to terminal use by portal module;
Terminal is used for the data result after according to process and sets up the special data channel with desktop protocol module, shows image, output sound after finally obtaining stream medium data by streaming media service module.
7. real-time desktop cloud as claimed in claim 4 realize system, it is characterized in that, when described image resolution ratio changes, be then handled as follows:
Desktop protocol module detects that the resolution of VME operating system changes, and obtains up-to-date resolution, sends to terminal module by special data channel; And stop operating streaming coding module and streaming media service module;
Restart streaming coding module and streaming media service module, and be connected with terminal module;
Terminal module re-establishes the special data channel with desktop protocol module, and reconnects to streaming media service module after obtaining the resolution upgraded.
8. real-time desktop cloud as claimed in claim 4 realize system, it is characterized in that, described peripheral hardware event data comprises keyboard data, mouse data, comprises the process of keyboard data and mouse data:
Keyboard, mouse peripheral hardware event data are sent to desktop protocol module by special data channel by terminal module, by desktop protocol module, peripheral hardware event data are sent to virtual machine;
Virtual machine processes the peripheral hardware event data received, and causes the renewal of desktop picture and sound simultaneously;
Desktop protocol module obtains the desktop picture after upgrading and voice data, through Streaming Media process, transfers to terminal module;
Terminal module obtains stream medium data, shows desktop picture, outputting audio data in real time.
9. real-time desktop cloud as claimed in claim 4 realize system, it is characterized in that, specifically comprise when virtual machine is closed in described terminal module request:
Terminal module sends out code by keyboard or mouse to virtual machine;
Virtual machine is closed voluntarily according to the instruction received;
The virtual machine closing information detected is sent to terminal module by special data channel by desktop protocol module, then closes streaming coding module and streaming media service module successively, and closes voluntarily;
Terminal module, according to the closing information received, disconnects the connection with desktop protocol module and streaming media service module respectively.
10. real-time desktop cloud as claimed in claim 4 realize system, it is characterized in that, in assembling PC deploy real-time desktop cloud, Android phone as described terminal module, be connected to described real-time desktop cloud by WIFI, the network delay of virtual machine desktop image and voice data is between 0.1 ~ 0.3 second.
CN201510518532.9A 2015-08-21 2015-08-21 Method and system for realizing real-time desktop cloud Pending CN105072190A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201510518532.9A CN105072190A (en) 2015-08-21 2015-08-21 Method and system for realizing real-time desktop cloud

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510518532.9A CN105072190A (en) 2015-08-21 2015-08-21 Method and system for realizing real-time desktop cloud

Publications (1)

Publication Number Publication Date
CN105072190A true CN105072190A (en) 2015-11-18

Family

ID=54501469

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510518532.9A Pending CN105072190A (en) 2015-08-21 2015-08-21 Method and system for realizing real-time desktop cloud

Country Status (1)

Country Link
CN (1) CN105072190A (en)

Cited By (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105491021A (en) * 2015-11-24 2016-04-13 华东师范大学 Android cloud application server and Android cloud application server system
CN105577781A (en) * 2015-12-21 2016-05-11 福建时迅信息科技有限公司 Method and system for sound frequency redirection in virtualization desktop
CN105847332A (en) * 2016-03-17 2016-08-10 汉柏科技有限公司 Desktop virtualization method, client device and server-side device
CN106331733A (en) * 2016-09-28 2017-01-11 广东科学技术职业学院 Desktop cloud terminal's audio and video data real-time processing method and system
CN106791855A (en) * 2016-12-12 2017-05-31 广东威创视讯科技股份有限公司 A kind of method and system for reducing management system cost of attending a banquet
CN107872471A (en) * 2016-09-23 2018-04-03 深圳市傲冠软件股份有限公司 Remote desktop image command processing method and system
CN108156134A (en) * 2017-11-29 2018-06-12 北京京航计算通讯研究所 A kind of Spice protocol analysis systems based on FPGA
CN108449633A (en) * 2018-03-22 2018-08-24 烽火通信科技股份有限公司 Set-top box cloud frame based on NFV and service implementation method
CN108665749A (en) * 2017-08-15 2018-10-16 无锡辰云科技股份有限公司 The display device and multimedia education system of multimedia education system under cloud desktop
CN108717375A (en) * 2018-05-09 2018-10-30 新华三云计算技术有限公司 Resolution ratio synchronous method and device
CN109876434A (en) * 2019-02-20 2019-06-14 深圳威尔视觉传媒有限公司 A kind of cloud game image encoding method and relevant apparatus
CN110178357A (en) * 2017-01-13 2019-08-27 华为技术有限公司 Cellular service based on cloud in the accessible cloud of remote equipment
CN111083155A (en) * 2019-12-25 2020-04-28 斑马网络技术有限公司 Vehicle machine and cloud interaction method and device
CN112291586A (en) * 2020-09-08 2021-01-29 西安万像电子科技有限公司 Cloud terminal equipment and cloud terminal system
CN112532744A (en) * 2020-12-20 2021-03-19 南京南方电讯有限公司 Android system-based video terminal and desktop remote control method
CN112738628A (en) * 2020-12-24 2021-04-30 广东双泉云创科技有限公司 Intelligent setting and intelligent management method for desktop cloud protocol
CN112783384A (en) * 2019-11-08 2021-05-11 荣耀终端有限公司 Control method for cloud application operation and electronic equipment
CN113572851A (en) * 2021-07-29 2021-10-29 辽宁向日葵教育科技有限公司 Remote desktop connection method based on browser
WO2022068276A1 (en) * 2020-09-29 2022-04-07 华为云计算技术有限公司 Desktop cloud system and related method, apparatus, device, and medium
CN114356465A (en) * 2020-09-29 2022-04-15 华为云计算技术有限公司 Desktop cloud system and related methods, devices, equipment and media
CN114629897A (en) * 2022-03-08 2022-06-14 阿里巴巴(中国)有限公司 Data processing method and system
CN114827692A (en) * 2022-04-29 2022-07-29 深圳市瑞云科技有限公司 System for operating cloud desktop based on smart television
CN115052043A (en) * 2022-06-14 2022-09-13 北京淳中科技股份有限公司 Video transmission method, electronic equipment, device and medium of cloud desktop
CN115278366A (en) * 2022-09-28 2022-11-01 天津卓朗昆仑云软件技术有限公司 Data processing method and device for video stream of virtual machine and electronic equipment
CN115913939A (en) * 2022-11-02 2023-04-04 山东乾云启创信息科技股份有限公司 Method and device for modifying image data in real time in cloud desktop image transmission process
WO2023077766A1 (en) * 2021-11-05 2023-05-11 华为云计算技术有限公司 Virtual desktop data processing method, device and system
CN117544623A (en) * 2023-11-14 2024-02-09 江苏海辰云科信息技术有限公司 Desktop cloud remote display system based on predictive coding algorithm
CN118055151A (en) * 2024-04-15 2024-05-17 湖南马栏山视频先进技术研究院有限公司 Cloud desktop GPU (graphics processing unit) through virtualization redirection management system and method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012043962A1 (en) * 2010-09-30 2012-04-05 에스케이플래닛 주식회사 Method and system for visualizing an adaptive screen according to a terminal
CN103873568A (en) * 2014-03-04 2014-06-18 赛特斯信息科技股份有限公司 System and method for realizing remote virtual desktop display based on cloud computing
CN104660687A (en) * 2015-02-02 2015-05-27 上海视聪网络信息技术有限公司 Realization method and system for virtual desktop display

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012043962A1 (en) * 2010-09-30 2012-04-05 에스케이플래닛 주식회사 Method and system for visualizing an adaptive screen according to a terminal
CN103873568A (en) * 2014-03-04 2014-06-18 赛特斯信息科技股份有限公司 System and method for realizing remote virtual desktop display based on cloud computing
CN104660687A (en) * 2015-02-02 2015-05-27 上海视聪网络信息技术有限公司 Realization method and system for virtual desktop display

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
冯健等: "基于视频流的云桌面设计与实现", 《计算机工程》 *

Cited By (35)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105491021A (en) * 2015-11-24 2016-04-13 华东师范大学 Android cloud application server and Android cloud application server system
CN105577781A (en) * 2015-12-21 2016-05-11 福建时迅信息科技有限公司 Method and system for sound frequency redirection in virtualization desktop
CN105847332A (en) * 2016-03-17 2016-08-10 汉柏科技有限公司 Desktop virtualization method, client device and server-side device
CN107872471B (en) * 2016-09-23 2020-08-25 深圳市傲冠软件股份有限公司 Remote desktop image instruction processing method and system
CN107872471A (en) * 2016-09-23 2018-04-03 深圳市傲冠软件股份有限公司 Remote desktop image command processing method and system
CN106331733A (en) * 2016-09-28 2017-01-11 广东科学技术职业学院 Desktop cloud terminal's audio and video data real-time processing method and system
CN106791855B (en) * 2016-12-12 2020-04-03 广东威创视讯科技股份有限公司 Method and system for reducing cost of agent management system
CN106791855A (en) * 2016-12-12 2017-05-31 广东威创视讯科技股份有限公司 A kind of method and system for reducing management system cost of attending a banquet
CN110178357A (en) * 2017-01-13 2019-08-27 华为技术有限公司 Cellular service based on cloud in the accessible cloud of remote equipment
US11044591B2 (en) 2017-01-13 2021-06-22 Futurewei Technologies, Inc. Cloud based phone services accessible in the cloud by a remote device
CN108665749A (en) * 2017-08-15 2018-10-16 无锡辰云科技股份有限公司 The display device and multimedia education system of multimedia education system under cloud desktop
CN108156134A (en) * 2017-11-29 2018-06-12 北京京航计算通讯研究所 A kind of Spice protocol analysis systems based on FPGA
CN108449633A (en) * 2018-03-22 2018-08-24 烽火通信科技股份有限公司 Set-top box cloud frame based on NFV and service implementation method
CN108449633B (en) * 2018-03-22 2020-10-16 烽火通信科技股份有限公司 Set top box cloud system based on NFV and service implementation method
CN108717375A (en) * 2018-05-09 2018-10-30 新华三云计算技术有限公司 Resolution ratio synchronous method and device
CN109876434A (en) * 2019-02-20 2019-06-14 深圳威尔视觉传媒有限公司 A kind of cloud game image encoding method and relevant apparatus
CN112783384A (en) * 2019-11-08 2021-05-11 荣耀终端有限公司 Control method for cloud application operation and electronic equipment
CN111083155A (en) * 2019-12-25 2020-04-28 斑马网络技术有限公司 Vehicle machine and cloud interaction method and device
CN112291586A (en) * 2020-09-08 2021-01-29 西安万像电子科技有限公司 Cloud terminal equipment and cloud terminal system
WO2022068276A1 (en) * 2020-09-29 2022-04-07 华为云计算技术有限公司 Desktop cloud system and related method, apparatus, device, and medium
CN114356465A (en) * 2020-09-29 2022-04-15 华为云计算技术有限公司 Desktop cloud system and related methods, devices, equipment and media
CN112532744A (en) * 2020-12-20 2021-03-19 南京南方电讯有限公司 Android system-based video terminal and desktop remote control method
CN112738628A (en) * 2020-12-24 2021-04-30 广东双泉云创科技有限公司 Intelligent setting and intelligent management method for desktop cloud protocol
CN113572851A (en) * 2021-07-29 2021-10-29 辽宁向日葵教育科技有限公司 Remote desktop connection method based on browser
WO2023077766A1 (en) * 2021-11-05 2023-05-11 华为云计算技术有限公司 Virtual desktop data processing method, device and system
CN114629897A (en) * 2022-03-08 2022-06-14 阿里巴巴(中国)有限公司 Data processing method and system
CN114827692A (en) * 2022-04-29 2022-07-29 深圳市瑞云科技有限公司 System for operating cloud desktop based on smart television
CN115052043B (en) * 2022-06-14 2024-03-29 北京淳中科技股份有限公司 Video transmission method, electronic equipment, device and medium of cloud desktop
CN115052043A (en) * 2022-06-14 2022-09-13 北京淳中科技股份有限公司 Video transmission method, electronic equipment, device and medium of cloud desktop
CN115278366A (en) * 2022-09-28 2022-11-01 天津卓朗昆仑云软件技术有限公司 Data processing method and device for video stream of virtual machine and electronic equipment
CN115913939A (en) * 2022-11-02 2023-04-04 山东乾云启创信息科技股份有限公司 Method and device for modifying image data in real time in cloud desktop image transmission process
CN117544623A (en) * 2023-11-14 2024-02-09 江苏海辰云科信息技术有限公司 Desktop cloud remote display system based on predictive coding algorithm
CN117544623B (en) * 2023-11-14 2024-06-07 江苏海辰云科信息技术有限公司 Desktop cloud remote display system based on predictive coding algorithm
CN118055151A (en) * 2024-04-15 2024-05-17 湖南马栏山视频先进技术研究院有限公司 Cloud desktop GPU (graphics processing unit) through virtualization redirection management system and method
CN118055151B (en) * 2024-04-15 2024-06-14 湖南马栏山视频先进技术研究院有限公司 Cloud desktop GPU (graphics processing unit) through virtualization redirection management system and method

Similar Documents

Publication Publication Date Title
CN105072190A (en) Method and system for realizing real-time desktop cloud
CN106713485B (en) Cloud computing mobile terminal
CN102158553B (en) Method and device for playing multi-media files for remote desktop
CN106302366B (en) A kind of data transmission method, device and intelligent television system
CN104349177B (en) It is a kind of to turn to method, virtual machine and the system for playing multimedia file under desktop cloud
CN106331733A (en) Desktop cloud terminal's audio and video data real-time processing method and system
CN106303674B (en) Data transmission method, device and intelligent television system
US9521366B2 (en) Method and apparatus for playing conference signal, video conference terminal, and mobile device
WO2016197863A1 (en) Client, smart television system, and corresponding data transmission method
WO2014139269A1 (en) Method and apparatus for playing and processing videos based on a virtual desktop
CN109104416B (en) Multi-device cooperation cloud service platform based on PON (Passive optical network) local area network
CN102523435A (en) Mobile high-definition video surveillance method and apparatus based on 3G network
US9723337B2 (en) Distribution control system and distribution system
CN104168453A (en) Method for implementing video monitoring stream media application system
CN102387187A (en) Server, client as well as method and system for remotely playing video file by using client
CN102855133A (en) Interactive system of computer processing unit
CN105898506A (en) Method and system for multi-screen playing of media files
CN102546803B (en) Remote desktop communication method based on capability set
CN103139202A (en) Thin client, communication method and device thereof
WO2014121477A1 (en) Video redirection method, device and system, and computer readable medium
CN103561311A (en) Screen transmission method and television
CN205105347U (en) Video wireless transmission equipment, video playback devices and system
CN104837046A (en) Multi-media file processing method and device
CN112039961B (en) Streaming media system, data stream collection method, and storage medium
CN111385593A (en) Cross-platform live content synchronization method and device, storage medium and server

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20151118