CN103269333A - Multimedia accelerating system based on virtualization - Google Patents

Multimedia accelerating system based on virtualization Download PDF

Info

Publication number
CN103269333A
CN103269333A CN2013101419319A CN201310141931A CN103269333A CN 103269333 A CN103269333 A CN 103269333A CN 2013101419319 A CN2013101419319 A CN 2013101419319A CN 201310141931 A CN201310141931 A CN 201310141931A CN 103269333 A CN103269333 A CN 103269333A
Authority
CN
China
Prior art keywords
layer
data
virtualization
decoding
multimedia
Prior art date
Application number
CN2013101419319A
Other languages
Chinese (zh)
Inventor
孙伟滔
Original Assignee
深圳市京华科讯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市京华科讯科技有限公司 filed Critical 深圳市京华科讯科技有限公司
Priority to CN2013101419319A priority Critical patent/CN103269333A/en
Publication of CN103269333A publication Critical patent/CN103269333A/en

Links

Abstract

The invention provides a multimedia accelerating system based on virtualization. The multimedia accelerating system based on the virtualization comprises a virtualized core layer, a decoding layer and a data source access layer, wherein the data source access layer is used for seeking out and accepting source data and then delivering the source data to the decoding layer after the source data are transcoded by a CODEC; the decoding layer is used for decoding received data source access layer data and then feeding the decoded data source access layer data back to the virtualized core layer for processing in an RTP package mode; the virtualized core layer is used for forwarding request and receipt data. The multimedia accelerating system based on the virtualization carries out audio and video coding and decoding by the utilization of a computer network processing accelerator card and the virtualization which are matched, greatly promotes hardware performance, promotes multimedia experience effect, and is simple, flexible and extensible in application.

Description

基于虚拟化的多媒体加速系统 Virtualized system based multimedia acceleration

技术领域 FIELD

[0001] 本发明涉及虚拟化技术领域,尤其涉及一种基于虚拟化的多媒体加速系统。 [0001] The present invention relates to the field of virtualization technology, particularly to a virtual multimedia-based acceleration system.

背景技术 Background technique

[0002] 服务器虚拟化、桌面虚拟化和应用虚拟化是现在计算机虚拟化中的三大虚拟化技术。 [0002] server virtualization, desktop virtualization and application virtualization is now three computer virtualization, virtualization technology. 也是未来云计算的一个重要技术。 Cloud computing is an important technology of the future. 目前在全球的各个行业,已经开始了虚拟化的技术的推广,并逐渐的在IT行业中盛行起来。 Currently in various industries around the world, we have started to promote virtualization technology, and gradually began to flourish in the IT industry.

[0003] 当前音视频编解码处理有硬解码与软解码两种方式,由于高清视频的分辨率远远高于一般格式视频,使得高清视频的码率非常高。 [0003] Current video codec processing audio decoding and hard soft decoding in two ways, as the resolution is much higher than the high-definition video format of the video, so that the bit rate is very high definition video. 再加上VC-1和H.264编码的压缩率很高,解码运算量很大。 Together with the VC-1 and H.264 high compression rate coding, decoding a large amount of computation. 因此直接使用CPU解码(即软解码)会极大地消耗CPU的运算能力,一些较老的CPU软解时占用率往往高达90%以上,尤其是在虚拟桌面的使用环境下,软解码依靠服务器CPU工作,那么在多用户并发的情况下往往会导致服务器宕机。 Therefore, direct use of CPU decoding (ie a soft decoding) will greatly consume computing power of the CPU, some of the time older software solution CPU occupancy rate is often as high as 90%, especially in a virtual desktop environment, soft decoding relies on server CPU work, then in the case of multi-user concurrent often lead to server downtime.

[0004] 而硬解码是依靠显卡的视频加速功能对高清视频进行解码,将数字编码还原成它所代表的内容或将电脉冲信号转换成它所代表的信息、数据等,启用硬解需要显卡、驱动、解码器以及播放器的支持。 [0004] The decoder relies on the graphics hardware video acceleration HD video decoding digitally encoded to restore the contents it represents, or to convert it into an electrical pulse signals representative of the information, data, etc., needed to enable the video card hardware solution to support the drive, decoder and player.

[0005]目前,各大虚拟化厂家对于处理多媒体时都有各自的协议,同时高昂的价格以及性价比使得显卡在虚拟化环境中很少被采用,因此真正意义上的“硬解码”在现阶段是不存在的,CPU依旧在发挥很重要的作用。 [0005] Currently, the major virtualization manufacturers for handling multimedia has its own protocol, while high prices and price makes graphics cards are rarely used in a virtualized environment, so "hard decoding" in the true sense at this stage does not exist, CPU still play a very important role. 面对如此情况,体验度与投入成本、资源的利用率往往让人感到矛盾。 Given this situation, the degree of experience and input costs, resource utilization often feel contradiction.

发明内容 SUMMARY

[0006] 本发明的目的在于提供一种基于虚拟化的多媒体加速系统,利用计算网络处理加速卡配合虚拟化进行音视频编解码及网络数据包处理等在内的通用计算加速,以最大限度的提高资源利用。 [0006] The object of the present invention is to provide a virtual multimedia-based acceleration system, using the calculated virtual network processing accelerator complex general-purpose computing network audio and video codecs and packet processing, etc., to accelerate to maximum improve resource utilization.

[0007] 本发明的目的是通过以下技术方案实现的。 [0007] The object of the present invention is achieved by the following technical solutions.

[0008] 一种基于虚拟化的多媒体加速系统,包括:虚拟化核心层、解码层、数据源访问层; [0008] A virtual multimedia acceleration system, including those based on: the virtualization core layer, layer decoding, the data access layer source;

[0009] 数据源访问层用于找到并接受源数据之后,经过CODEC转码后交由解码层; After the [0009] data source to locate and access layer for receiving the source data, after decoding CODEC referred transcoded layer;

[0010] 解码层用于对接收到的数据源访问层数据解码完成后以RTP包的形式反馈给虚拟化核心层处理; Decoding the data access layer data source [0010] layer for decoding received after completion of the core layer is fed back to the virtualization process in the form of an RTP packet;

[0011] 虚拟化核心层用于对请求及回执数据进行转发。 [0011] Virtualization core layer for receipt and forwards the data request.

[0012] 优选的,所述源数据包括流媒体文件或网络码流。 [0012] Preferably, said source data including streaming media files or network streams.

[0013] 本发明与现有技术相比,本发明提供的基于虚拟化的多媒体加速系统,利用计算网络处理加速卡配合虚拟化进行音视频编解码,大大提高硬件性能,提高了对多媒体的体验效果,且应用简单、灵活、可扩展。 [0013] Compared with the prior art, the present invention provides a virtual multimedia-based acceleration system, using the calculated virtual network processing accelerator with audio and video codecs, greatly improving hardware performance, improved multimedia experience effect, and the application is simple, flexible and scalable. 附图说明 BRIEF DESCRIPTION

[0014] 图1是本发明基于虚拟化的多媒体加速系统架构图。 [0014] FIG. 1 is a system architecture diagram of the present invention to accelerate the virtual multimedia-based.

具体实施方式 Detailed ways

[0015] 为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。 [0015] To make the objectives, technical solutions and advantages of the present invention will become more apparent hereinafter in conjunction with the accompanying drawings and embodiments of the present invention will be further described in detail. 应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。 It should be understood that the specific embodiments described herein are only intended to illustrate the present invention and are not intended to limit the present invention.

[0016] 利用计算网络处理加速卡配合虚拟桌面或服务器,可进行音视频编解码、网络数据包处理等在内的通用计算加速和高性能网络10。 [0016] The processing with a general purpose computing acceleration accelerator virtual desktop or server, may be audio and video codecs, network packet processing, etc., and high performance network 10 using the calculated network.

[0017] 使用高性能的PCIe接口通用计算网络处理加速卡,加速卡具有超过40GHz的处理能力。 [0017] PCIe interface using high-performance general-purpose computing network processing accelerator, accelerator having a processing capacity exceeding 40GHz. 加速卡与主机接口为8通道PCIe2.0,可以提供峰值达32Gbps的数据吞吐量,运行独立的SMP Linux系统,同时提供标准gcc及交叉编译环境,利用专用网络应用库或Linux协议栈,一个USB2.0端口用以开发和测试,用户可以快速定制网络数据的手法、分类、状态跟踪、统计功能,卸载主机上成为瓶颈的闻负荷处理部分。 Accelerator host channel interface 8 of PCIe2.0, provides peak data throughput up to 32Gbps, as SMP Linux operating system independently, and also provides a standard cross-gcc compiler environment, using a dedicated application library or Linux network protocol stack, a USB2 .0 port for the development and testing, users can quickly customize the way data network, classification, status tracking, statistical functions, uninstall become the bottleneck of the processing load on the host smell section.

[0018] 如图1所示基于虚拟化的多媒体加速系统,包括:虚拟化核心层、解码层、数据源访问层; [0018] 1 virtual multimedia-based acceleration system, comprising: a virtualization core layer, layer decoding, the data access layer source;

[0019] 数据源访问层用于找到并接受源数据(流媒体文件、网络码流等)之后,经过CODEC转码后交由解码层; After the [0019] data source to locate and access layer for receiving the source data (streaming media file, a network stream, etc.), after decoder CODEC referred transcoded layer;

[0020] 解码层用于对接收到的数据源访问层数据解码完成后以RTP包的形式反馈给虚拟化核心层处理; Decoding the data access layer data source [0020] layer for decoding received after completion of the core layer is fed back to the virtualization process in the form of an RTP packet;

[0021 ] 虚拟化核心层用于对请求及回执数据进行转发。 [0021] Virtualization core layer for receipt and forwards the data request.

[0022] 本发明提供的基于虚拟化的多媒体加速方法,利用计算网络处理加速卡配合虚拟化进行音视频编解码,大大提高硬件性能,提高了对多媒体的体验效果,且应用简单、灵活、可扩展。 [0022] The present invention provides a method to accelerate the virtual multimedia-based accelerator with the process using the calculated virtual network for audio and video codecs, greatly improving the performance of hardware, the multimedia experience to improve the effect, and the application is simple, flexible, extension.

[0023] 以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。 [0023] The foregoing is only preferred embodiments of the present invention but are not intended to limit the present invention, any modifications within the spirit and principle of the present invention, equivalent substitutions and improvements should be included in the present within the scope of the invention.

Claims (2)

1.一种基于虚拟化的多媒体加速系统,其特征在于,包括:虚拟化核心层、解码层、数据源访问层; 数据源访问层用于找到并接受源数据之后,经过CODEC转码后交由解码层; 解码层用于对接收到的数据源访问层数据解码完成后以RTP包的形式反馈给虚拟化核心层处理; 虚拟化核心层用于对请求及回执数据进行转发。 A virtual multimedia-based acceleration system, characterized by comprising: a virtualization core layer, layer decoding, the data access layer source; a data access layer for finding the source and the source data after receiving, after cross CODEC transcoded a decoding layer; layer decoding for decoding the data received after the completion of a data access layer source back to the virtualization layer processing core in the form of an RTP packet; for virtualization core layer forwards the data request and receipt.
2.如权利要求1所述的基于虚拟化的多媒体加速系统,其特征在于,所述源数据包括流媒体文件或网络码流。 2. The multimedia system virtualization acceleration according to claim 1 is based, wherein the source data comprises streaming media files or network streams.
CN2013101419319A 2013-04-23 2013-04-23 Multimedia accelerating system based on virtualization CN103269333A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2013101419319A CN103269333A (en) 2013-04-23 2013-04-23 Multimedia accelerating system based on virtualization

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2013101419319A CN103269333A (en) 2013-04-23 2013-04-23 Multimedia accelerating system based on virtualization

Publications (1)

Publication Number Publication Date
CN103269333A true CN103269333A (en) 2013-08-28

Family

ID=49012942

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2013101419319A CN103269333A (en) 2013-04-23 2013-04-23 Multimedia accelerating system based on virtualization

Country Status (1)

Country Link
CN (1) CN103269333A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107205048A (en) * 2017-07-21 2017-09-26 深圳市智网云联科技有限公司 Desktop cloud protocol coding system based on PCI-E (Peripheral Component Interconnect Express) bus
CN107423115A (en) * 2017-07-28 2017-12-01 西安万像电子科技有限公司 Graphics card virtualization method, device and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101151851A (en) * 2005-04-01 2008-03-26 国际商业机器公司 Host and network adapter for networking offload in server environment
US20080089358A1 (en) * 2005-04-01 2008-04-17 International Business Machines Corporation Configurable ports for a host ethernet adapter
CN101352012A (en) * 2005-10-07 2009-01-21 安吉尔系统公司 Media data processing using distinct elements for streaming and control processes
US8170123B1 (en) * 2008-04-15 2012-05-01 Desktone, Inc. Media acceleration for virtual computing services
US20120166585A1 (en) * 2010-12-23 2012-06-28 Electronics And Telecommunications Research Institute Apparatus and method for accelerating virtual desktop
CN202551089U (en) * 2012-03-21 2012-11-21 青岛百灵信息科技有限公司 Virtual media gateway device
CN202856917U (en) * 2012-09-27 2013-04-03 深圳市慧之星计算机有限公司 High-definition network television device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101151851A (en) * 2005-04-01 2008-03-26 国际商业机器公司 Host and network adapter for networking offload in server environment
US20080089358A1 (en) * 2005-04-01 2008-04-17 International Business Machines Corporation Configurable ports for a host ethernet adapter
CN101352012A (en) * 2005-10-07 2009-01-21 安吉尔系统公司 Media data processing using distinct elements for streaming and control processes
US8170123B1 (en) * 2008-04-15 2012-05-01 Desktone, Inc. Media acceleration for virtual computing services
US20120166585A1 (en) * 2010-12-23 2012-06-28 Electronics And Telecommunications Research Institute Apparatus and method for accelerating virtual desktop
CN202551089U (en) * 2012-03-21 2012-11-21 青岛百灵信息科技有限公司 Virtual media gateway device
CN202856917U (en) * 2012-09-27 2013-04-03 深圳市慧之星计算机有限公司 High-definition network television device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈洪彬: "《前沿流媒体实用手册》", 31 July 2003, 中国科学技术出版社,北京希望电子出版社 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107205048A (en) * 2017-07-21 2017-09-26 深圳市智网云联科技有限公司 Desktop cloud protocol coding system based on PCI-E (Peripheral Component Interconnect Express) bus
CN107423115A (en) * 2017-07-28 2017-12-01 西安万像电子科技有限公司 Graphics card virtualization method, device and system

Similar Documents

Publication Publication Date Title
US9514507B2 (en) Methods and systems for maintaining state in a virtual machine when disconnected from graphics hardware
JP5911892B2 (en) Multi-stage resume from Haibaneito
JP5021180B2 (en) Generic usb driver
US20120184373A1 (en) Apparatus and method for providing a game service in cloud computing environment
CN104094244B (en) A method and apparatus for direct coprocessor system for i / o access
CN101981558B (en) Systems and methods for managing multimedia operations in remote sessions
US9456229B2 (en) Parsing single source content for multi-channel publishing
US8405666B2 (en) Saving, transferring and recreating GPU context information across heterogeneous GPUs during hot migration of a virtual machine
US8612643B2 (en) Interfaces for digital media processing
CN102946409B (en) A plurality of end-user experience from a single delivery server to the client
CN103262057A (en) Cross-environment communication framework
CN102741830A (en) Systems and methods for a client-side remote presentation of a multimedia stream
CN101443762A (en) Back-off mechanism for search
WO2014085717A1 (en) Method and system for cloud based virtualized graphics processing for remote displays
CN103262025A (en) Cross-environment communication using application space API
CN102375687A (en) Cloning or extending a computer desktop on a wireless display surface
CN102171647A (en) File input/output scheduler using immediate data chunking
CN102713882A (en) Methods and systems for selective implementation of progressive display techniques
US20120198089A1 (en) System and method for custom segmentation for streaming video
US20120075346A1 (en) Low Complexity Method For Motion Compensation Of DWT Based Systems
CN103365724A (en) Detecting localizable native methods and systems
CN102695094B (en) Method for carrying out software and hardware integrated audio/video redirection in VDI (Virtual Device Interface) environment
CN102246154B (en) User-mode based remote desktop protocol (RDP) encoding architecture
US9317683B2 (en) Dynamic media content previews
US9465674B2 (en) Direct memory (DMA) based access to a device on a remote machine using stub driver and by synchronizing the DMA buffer

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C53 Correction of patent for invention or patent application
COR Change of bibliographic data

Free format text: CORRECT: INVENTOR; FROM: SUN WEITAO TO: SUN WEITAO CENG HAOWEN

RJ01 Rejection of invention patent application after publication