CN106210036A - Video display accelerated method in virtual desktop display device - Google Patents
Video display accelerated method in virtual desktop display device Download PDFInfo
- Publication number
- CN106210036A CN106210036A CN201610534750.6A CN201610534750A CN106210036A CN 106210036 A CN106210036 A CN 106210036A CN 201610534750 A CN201610534750 A CN 201610534750A CN 106210036 A CN106210036 A CN 106210036A
- Authority
- CN
- China
- Prior art keywords
- streaming data
- multimedia streaming
- multimedia
- virtual desktop
- decoded
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/04—Protocols specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/08—Protocols specially adapted for terminal emulation, e.g. Telnet
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The present invention relates to the video display accelerated method in a kind of virtual desktop display device, including: S1: multimedia streaming data is encoded by service end, and the multimedia streaming data after coding is sent to client；After S2: client receives the multimedia streaming data after coding, identify its file fingerprint；S3: obtain the coded system of multimedia streaming data based on the file fingerprint identified, and judge whether the hardware multimedia decoding module in SoC exists the encoding and decoding submodule of correspondence, if yes, multimedia streaming data is decoded by the encoding and decoding submodule then using correspondence, if it has not, then use software mode that multimedia streaming data is decoded；S4: judge whether decoded multimedia streaming data supports Hardware Render, if it has, then use GPU to render multimedia streaming data, if it has not, then use software mode to render multimedia streaming data.Compared with prior art, the present invention has the advantages such as broadcasting speed is fast.
Description
Technical field
The present invention relates to a kind of video acceleration method, the video especially related in a kind of virtual desktop display device shows
Accelerated method.
Background technology
Current virtual desktop solution is broadly divided into two big class: VDI (Virtual Desktop
And SBC (Server-Based Computing) Infrastructure).
Virtual desktop solution based on VDI, its principle is to be that each user prepares its special void in server side
Plan machine also disposes the operating system needed for user and various application the most wherein, then by desktop display protocol by complete virtual
Machine desktop consigns to long-range user and uses.Therefore, the basis of this kind of solution is server virtualization.Server virtualization
Mainly having virtualization based on hardware auxiliary and virtualization two kinds based on operating system auxiliary, wherein, the former is a kind of complete
Virtualized method, it is possible to provide one and physical hardware identical virtual hardware ring for the operating system in virtual machine
Border；The latter is then a kind of method of partial virtual, needs to be deployed in void by amendment operating system system
In plan machine.
Virtual desktop solution based on SBC, its principle is to install unified for application software on the remote server, uses
Family by and the session set up of server server desktop and related application conducted interviews and operate, and between different user
Session is isolated from each other.This kind of solution is that (such as keyboard percussion, click, video show at OS Events
Update etc.) insert virtualization layer between layer and application software layer, thus weaken the close-coupled relation between two levels,
The operation making application is no longer limited to ordering about of native operating sys-tern event.In fact, this mode is in previous server version
Windows supports, but in application before, user environment has been fixed on particular server, causes server
Can not be according to loading condition adjustresources dispensing.It addition, application scenarios before is mainly conversational service, its application has
Limitation, does not the most support double-directional speech, supports poor etc. to transmission of video, and the communication between server and user side
There is insecurity.Therefore, novel virtual desktop solution based on SBC mainly provides in server version Windows
Terminal service ability on the basis of the aspects such as the function of virtual desktop, performance, Consumer's Experience are improved.
Regardless of whether be the virtual desktop solution of VDI or SBC, the mainly profit of the multimedia decoding in client device
With Software-only method realize, from server will coding after media stream one by one be transferred to client, soft in client
Directly render after part decoding.Which decoding speed is slow, is that video is the most smooth to user's impression the most intuitively.
Summary of the invention
Defect that the purpose of the present invention is contemplated to overcome above-mentioned prior art to exist and provide a kind of virtual desktop to present
Video display acceleration side in equipment.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of multimedia display accelerated method in virtual desktop display device, including:
S1: multimedia streaming data is encoded by service end, and the multimedia streaming data after coding is sent to client；
After S2: client receives the multimedia streaming data after coding, identify its file fingerprint；
S3: obtain the coded system of described multimedia streaming data based on the file fingerprint identified, and judge SoC
Whether interior hardware multimedia decoding module exists the encoding and decoding submodule of correspondence, if it has, then use corresponding encoding and decoding
Multimedia streaming data is decoded by module, if it has not, then use software mode to be decoded multimedia streaming data；
S4: judge whether decoded multimedia streaming data supports Hardware Render, if it has, then use GPU to multimedia
Flow data renders, if it has not, then use software mode to render multimedia streaming data.
Described hardware multimedia decoding module includes: H.246 encoding and decoding submodule, JPEG encoding and decoding submodule, MPEG4 compile
Decoding sub-module and MP3 encoding and decoding submodule.
Described step S4 specifically includes step:
S41: judge whether multimedia file is pure audio, if it has, then directly play, if it has not, then perform step
S42；
S42: judge whether decoded multimedia streaming data supports Hardware Render, if it has, then use GPU to multimedia
Flow data renders, if it has not, then use software mode to render multimedia streaming data.
H.246, JPEG, MPEG4 and RGB the multimedia streaming data coded system kind supporting Hardware Render includes:.
In described step S42, GPU process that multimedia streaming data is rendered is used to specifically include step:
S421: decoded multimedia streaming data is deposited in Installed System Memory；
The decoded multimedia streaming data deposited in S422:DMA controller control system internal memory transmits to GPU；
Multimedia streaming data is rendered by S423:GPU according to decoded multimedia streaming data.
During described step S422, the control of dma controller adapter system bus.
During described step S422, dma controller and CPU alternate access Installed System Memory.
Described Installed System Memory is physical memory and/or virtual memory.
Compared with prior art, the invention have the advantages that
1) mode that the multimedia streaming data supporting hard solution and Hardware Render preferentially uses hardware calculate, can save this
The most rare CPU calculates resource, promotes the response speed of client and plays experience.
2) make full use of software and hardware capability by the hardware multi-media decoding and encoding module in SoC, solve virtual desktop
The problem that the video playback performance of display device is not enough, to realize the function that Video processing is accelerated.
3) multimedia streaming data of various forms is carried out Screening Treatment, reduce the utilization rate of the network bandwidth, hold concurrently simultaneously
Turn round and look at compatibility.
4) data have employed dma mode to the process in GPU from internal memory, and this mode can need not CPU and perform
Transfer, therefore CPU can process the calculating task of oneself, will not be tied down, and improves the efficiency of CPU.
5) using the mode of DMA and CPU alternate access Installed System Memory, CPU neither stops the operation of mastery routine, does not enters
Waiting state, can be more efficient.
Accompanying drawing explanation
Fig. 1 is the key step schematic flow sheet of the inventive method；
Fig. 2 is the composition structural representation that the present invention realizes system；
Wherein 1, CPU, 2, GPU, 3, dma controller, 4, Installed System Memory, 5, SoC, 6, system bus.
Detailed description of the invention
The present invention is described in detail with specific embodiment below in conjunction with the accompanying drawings.The present embodiment is with technical solution of the present invention
Premised on implement, give detailed embodiment and concrete operating process, but protection scope of the present invention be not limited to
Following embodiment.
In order to realize the application, as in figure 2 it is shown, the SoC 5 of client comprises CPU 1, GPU 2 and DMA controller 3,
CPU 1, GPU 2 and dma controller are all connected with system bus 6, and Installed System Memory 4 is also connected to system bus 6 in addition.
A kind of multimedia display accelerated method in virtual desktop display device, as it is shown in figure 1, include:
S1: multimedia streaming data is encoded by service end, and the multimedia streaming data after coding is sent to client；
After S2: client receives the multimedia streaming data after coding, identify its file fingerprint；
S3: obtain the coded system of multimedia streaming data based on the file fingerprint identified, and in judging SoC 5
Hardware multimedia decoding module whether there is the encoding and decoding submodule of correspondence, if it has, then use corresponding encoding and decoding submodule
Multimedia streaming data is decoded by block, if it has not, then use software mode to be decoded multimedia streaming data, wherein, firmly
Part multimedia decoding module includes: H.246 encoding and decoding submodule, JPEG encoding and decoding submodule, MPEG4 encoding and decoding submodule and
MP3 encoding and decoding submodule；
S4: judge whether decoded multimedia streaming data supports Hardware Render, if it has, then use GPU 2 to many matchmakers
Body flow data renders, if it has not, then use software mode to render multimedia streaming data, supports that Hardware Render is many
H.246, JPEG, MPEG4 and RGB media stream data coded system kind includes:.
Step S4 specifically includes step:
S41: judge whether multimedia file is pure audio, if it has, then directly play, if it has not, then perform step
S42；
S42: judge whether decoded multimedia streaming data supports Hardware Render, if it has, then use GPU 2 to many matchmakers
Body flow data renders, if it has not, then use software mode to render multimedia streaming data, wherein, uses GPU 2 right
The process that multimedia streaming data carries out rendering specifically includes step:
S421: decoded multimedia streaming data is deposited in Installed System Memory 4, and wherein, Installed System Memory 4 is physical memory
And/or virtual memory, have and determined by operating system；
The decoded multimedia streaming data deposited in S422:DMA controller 3 control system internal memory 4 transmits to GPU 2
In, wherein, during step S422, the control of dma controller 3 adapter system bus 6, it is preferably, dma controller 3 He
CPU 1 alternate access Installed System Memory 4；
Multimedia streaming data is rendered by S423:GPU 2 according to decoded multimedia streaming data.
Using solution based on VDI, user is obtained in that a complete desktop operating system environment, with traditional
The experience of local computer is sufficiently close to.And in this kind of solution, user's virtual desktop can accomplish performance and
The isolation of safety, and have other advantage that server virtualization technology brings, service quality can be protected.But, this
Class solution needs, at server-side portion administration's server virtualization and management software thereof, to want with storage resource calculating resource
Ask higher, there is higher cost.
Using solution based on SBC, application software can install and deploy on server as traditional approach,
Then it is simultaneously supplied to multiple user use, there is relatively low resource requirement, but in terms of performance isolation and security isolation only
It is able to rely on the Windows operating system of bottom.It addition, because what this kind of solution installed on the server is server
Version Windows, desktop version operating system difference that its interface is usual with user, so in order to reduce user in use
Puzzlement, current solution the most only provide the user application software operation interface and and incomplete operating system table
Face.Therefore
The user that virtual desktop based on VDI is relatively more suitable for desktop function demand is perfect uses, based on SBC virtual
The internal user that desktop is more suitable for software requirement is single uses.Therefore the virtual desktop using VDI in the application can be more
Properly.
First the VDI module of server can automatically select current most suitable coded system to coding video data,
And the data stream after coding is sent to client.
Claims (8)
1. the multimedia display accelerated method in a virtual desktop display device, it is characterised in that including:
S1: multimedia streaming data is encoded by service end, and the multimedia streaming data after coding is sent to client；
After S2: client receives the multimedia streaming data after coding, identify its file fingerprint；
S3: obtain the coded system of described multimedia streaming data based on the file fingerprint identified, and in judging SoC
Whether hardware multimedia decoding module exists the encoding and decoding submodule of correspondence, if it has, then use corresponding encoding and decoding submodule
Multimedia streaming data is decoded, if it has not, then use software mode that multimedia streaming data is decoded；
S4: judge whether decoded multimedia streaming data supports Hardware Render, if it has, then use GPU to multimedia fluxion
According to rendering, if it has not, then use software mode that multimedia streaming data is rendered.
Video display accelerated method in a kind of virtual desktop display device the most according to claim 1, it is characterised in that
Described hardware multimedia decoding module includes: H.246 encoding and decoding submodule, JPEG encoding and decoding submodule, MPEG4 encoding and decoding submodule
Block and MP3 encoding and decoding submodule.
Video display accelerated method in a kind of virtual desktop display device the most according to claim 1, it is characterised in that
Described step S4 specifically includes step:
S41: judge whether multimedia file is pure audio, if it has, then directly play, if it has not, then perform step S42；
S42: judge whether decoded multimedia streaming data supports Hardware Render, if it has, then use GPU to multimedia fluxion
According to rendering, if it has not, then use software mode that multimedia streaming data is rendered.
Video display accelerated method in a kind of virtual desktop display device the most according to claim 3, it is characterised in that
H.246, JPEG, MPEG4 and RGB the multimedia streaming data coded system kind supporting Hardware Render includes:.
Video display accelerated method in a kind of virtual desktop display device the most according to claim 3, it is characterised in that
In described step S42, GPU process that multimedia streaming data is rendered is used to specifically include step:
S421: decoded multimedia streaming data is deposited in Installed System Memory；
The decoded multimedia streaming data deposited in S422:DMA controller control system internal memory transmits to GPU；
Multimedia streaming data is rendered by S423:GPU according to decoded multimedia streaming data.
Video display accelerated method in a kind of virtual desktop display device the most according to claim 5, it is characterised in that
During described step S422, the control of dma controller adapter system bus.
Video display accelerated method in a kind of virtual desktop display device the most according to claim 6, it is characterised in that
During described step S422, dma controller and CPU alternate access Installed System Memory.
Video display accelerated method in a kind of virtual desktop display device the most according to claim 5, it is characterised in that
Described Installed System Memory is physical memory and/or virtual memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610534750.6A CN106210036A (en) | 2016-07-08 | 2016-07-08 | Video display accelerated method in virtual desktop display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610534750.6A CN106210036A (en) | 2016-07-08 | 2016-07-08 | Video display accelerated method in virtual desktop display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106210036A true CN106210036A (en) | 2016-12-07 |
Family
ID=57472692
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610534750.6A Pending CN106210036A (en) | 2016-07-08 | 2016-07-08 | Video display accelerated method in virtual desktop display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106210036A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018119611A1 (en) * | 2016-12-26 | 2018-07-05 | 深圳前海达闼云端智能科技有限公司 | Multimedia data encoding/decoding method and device for multi-operating system, electronic device, and computer program product |
| CN108322781A (en) * | 2018-02-08 | 2018-07-24 | 武汉噢易云计算股份有限公司 | Promote the method and system that HD video effect is played in virtual desktop |
| CN108881916A (en) * | 2018-06-21 | 2018-11-23 | 深圳市斯迈龙科技有限公司 | The video optimized processing method and processing device of remote desktop |
| WO2021036784A1 (en) * | 2019-08-30 | 2021-03-04 | 中兴通讯股份有限公司 | Media data processing method and apparatus, media server and computer-readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103179431A (en) * | 2013-03-21 | 2013-06-26 | 福建升腾资讯有限公司 | Method for redirecting, transcoding and separating audio/video under VDI (Virtual Desktop Infrastructure) condition |
| CN103516762A (en) * | 2012-06-29 | 2014-01-15 | 华为技术有限公司 | Virtual desktop generation method, equipment and system |
| CN103905927A (en) * | 2012-12-26 | 2014-07-02 | 华为技术有限公司 | Video redirection method under virtual desktop scene, desktop server and system |
| CN104159150A (en) * | 2014-08-19 | 2014-11-19 | 龙芯中科技术有限公司 | Cloud terminal, cloud server, media data stream playing system and method |
-
2016
- 2016-07-08 CN CN201610534750.6A patent/CN106210036A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103516762A (en) * | 2012-06-29 | 2014-01-15 | 华为技术有限公司 | Virtual desktop generation method, equipment and system |
| CN103905927A (en) * | 2012-12-26 | 2014-07-02 | 华为技术有限公司 | Video redirection method under virtual desktop scene, desktop server and system |
| CN103179431A (en) * | 2013-03-21 | 2013-06-26 | 福建升腾资讯有限公司 | Method for redirecting, transcoding and separating audio/video under VDI (Virtual Desktop Infrastructure) condition |
| CN104159150A (en) * | 2014-08-19 | 2014-11-19 | 龙芯中科技术有限公司 | Cloud terminal, cloud server, media data stream playing system and method |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2018119611A1 (en) * | 2016-12-26 | 2018-07-05 | 深圳前海达闼云端智能科技有限公司 | Multimedia data encoding/decoding method and device for multi-operating system, electronic device, and computer program product |
| CN108322781A (en) * | 2018-02-08 | 2018-07-24 | 武汉噢易云计算股份有限公司 | Promote the method and system that HD video effect is played in virtual desktop |
| CN108881916A (en) * | 2018-06-21 | 2018-11-23 | 深圳市斯迈龙科技有限公司 | The video optimized processing method and processing device of remote desktop |
| WO2021036784A1 (en) * | 2019-08-30 | 2021-03-04 | 中兴通讯股份有限公司 | Media data processing method and apparatus, media server and computer-readable storage medium |
| CN112445605A (en) * | 2019-08-30 | 2021-03-05 | 中兴通讯股份有限公司 | Media data processing method and device and media server |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021008290A1 (en) | Video stream decoding method and apparatus, terminal device and storage medium | |
| US10275370B2 (en) | Operating system dongle | |
| WO2021143182A1 (en) | Game processing method and apparatus, electronic device, and computer-readable storage medium | |
| CN106797388B (en) | Cross-system multimedia data encoding and decoding method and device, electronic equipment and computer program product | |
| US9203883B2 (en) | Systems and methods for a client-side remote presentation of a multimedia stream | |
| TWI605345B (en) | File type association in a remote computing session | |
| CN106210036A (en) | Video display accelerated method in virtual desktop display device | |
| US10805570B2 (en) | System and method for streaming multimedia data | |
| CN103631634A (en) | Graphics processor virtualization achieving method and device | |
| US10678494B2 (en) | Controlling data streams in universal serial bus (USB) systems | |
| WO2015188575A1 (en) | Video data providing method, video playback method, device, and system | |
| WO2014089793A1 (en) | Method, device, and system for video redirection and computer readable medium | |
| US9936049B2 (en) | Protocol independent way for dynamically selecting data compression methods for redirected USB devices | |
| TW201810016A (en) | Systems and methods for using distributed universal serial bus (USB) host drivers | |
| CN114902686A (en) | Web browser multimedia redirection | |
| WO2018119711A1 (en) | Multimedia encoding/decoding method and device for multi-operating system, and electronic device | |
| WO2018119611A1 (en) | Multimedia data encoding/decoding method and device for multi-operating system, electronic device, and computer program product | |
| CN114902689A (en) | Multimedia redirection for media applications | |
| WO2015013981A1 (en) | Image display method and device | |
| WO2015196827A1 (en) | Display device and sharing control method therefor | |
| WO2014121477A1 (en) | Video redirection method, device and system, and computer readable medium | |
| US20170154018A1 (en) | System and method for display stream compression for remote desktop protocols | |
| CN106716998B (en) | Multiple operating system multi-medium data decoding method, device and electronic equipment | |
| CN102546803A (en) | Remote desktop communication method based on capability set | |
| CN112543374A (en) | Transcoding control method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20180613 Address after: 523000 A2, 7 floor, home town plaza, South five village, Houjie Town, Dongguan, Guangdong Applicant after: Dongguan Zheng Xun Industrial Investment Co., Ltd. Address before: 200070 8005, room 3, 533 Po Chang Road, Zhabei District, Shanghai. Applicant before: Ting Yun computing technology (Shanghai) Co., Ltd. |
|
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20161207 |