CN104159150B - Cloud terminal, Cloud Server, media data flow play system and method - Google Patents

Cloud terminal, Cloud Server, media data flow play system and method Download PDF

Info

Publication number
CN104159150B
CN104159150B CN201410409586.7A CN201410409586A CN104159150B CN 104159150 B CN104159150 B CN 104159150B CN 201410409586 A CN201410409586 A CN 201410409586A CN 104159150 B CN104159150 B CN 104159150B
Authority
CN
China
Prior art keywords
decoded
data flow
media data
hardware
decoding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201410409586.7A
Other languages
Chinese (zh)
Other versions
CN104159150A (en
Inventor
程愚
蔡万伟
吴松伟
凌杰
孙章质
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Loongson Technology Corp Ltd
Original Assignee
Loongson Technology Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Loongson Technology Corp Ltd filed Critical Loongson Technology Corp Ltd
Priority to CN201410409586.7A priority Critical patent/CN104159150B/en
Publication of CN104159150A publication Critical patent/CN104159150A/en
Application granted granted Critical
Publication of CN104159150B publication Critical patent/CN104159150B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the present invention provides a kind of cloud terminal, Cloud Server, media data flow play system and method.In the embodiment of the present invention, Cloud Server is not decoded and played to original audio and video data streams, but original audio and video data streams are sent to cloud terminal, hardware decoding is carried out to the original audio and video data streams using hardware decoder by cloud terminal, save network bandwidth, network load ability is improved, reduces the popularization cost of cloud terminal, improves the broadcast performance of media data flow.

Description

Cloud terminal, Cloud Server, media data flow play system and method
Technical field
The present embodiments relate to the communication technology, more particularly to a kind of cloud terminal, Cloud Server, media data stream broadcasting system System and method.
Background technology
Cloud terminal (Cloud Terminal) is terminal device and terminal platform clothes based on the application of cloud computing business model The general name of business, cloud terminal technology can realize shared host resource, hardware investment and software license expense be greatly decreased, and realize Unit multi-user, each user independently enjoy complete PC functions.
Existing audio and video playing technology, the decoding of audio and video data streams, cloud clothes are carried out in the virtual machine of Cloud Server The player being engaged on device calls decoder, audio and video data streams is decoded as into image and voice data frame by frame, then be rendered into void On desktop and virtual audio device in plan machine, then, Cloud Server will frame by frame image and voice data frame by frame with virtual desktop It is packaged with, compresses, then be dealt into cloud terminal, carries out last decoding again in cloud terminal and render.
In the prior art, most of audio frequency and video all use (the Moving Picture Experts of dynamic image expert group 4 Group4, abbreviation MPEG4) carry out audiovisual compression coding.Because the most frequently used MPEG4 forms are more complicated, the algorithm of decoding Also it is very complicated, cause the decoding operand of Cloud Server very big.And the behaviour such as conventional bit stream parsing, elongated entropy decoding Make to be adapted to parallel processing, and the CPU of Cloud Server is usually to be designed for general-purpose computations, is not fully adapted to parallel processing, because And take most CPU computing capabilitys.Therefore, virtual machine, which decodes, make it that the computing load of Cloud Server is excessive, causes every cloud The cloud terminal quantity that server can bear is less, it is necessary to which the more Cloud Server of actual deployment, adds the popularization of cloud terminal Cost.
In addition, in the prior art, Cloud Server by decoded audio, video data, frame by frame image and voice data with it is virtual Desktop packing compression is dealt into cloud terminal, and although this data transmitted frame by frame also go through compression, but its compression ratio has with MPEG4 Some inter-frame compression techniques are compared, and compression ratio is relatively low, and the requirement to network bandwidth is very high, cause network load ability to decline, Also, transmission audio frequency and video frame by frame have larger and unstable network delay, cause to play not smooth, poor user experience.
The content of the invention
The embodiment of the present invention provides a kind of cloud terminal, Cloud Server, media data flow play system and method, saves network Bandwidth, network load ability is improved, reduce the popularization cost of cloud terminal, improve the broadcast performance of media data flow.
In a first aspect, the embodiment of the present invention provides a kind of cloud terminal, the cloud terminal includes:
Receiver, for receiving the media data flow to be decoded and background data stream of Cloud Server transmission;
Primary processor, for after the receiver receives the media data flow to be decoded, to hardware decoder Send hardware decoding order;
The hardware decoder, the hardware for being sent according to the primary processor decodes order, to described to be decoded Media data flow is decoded, and obtains decoded media data flow, and, sent after decoding is completed to the primary processor Response is completed in hardware decoding;
The primary processor, it is additionally operable to after the hardware decoding completion response that the hardware decoder is sent is received, will Video data in the decoded media data flow carries out video with the background data in the background data stream and is superimposed, shape Into the display page and video frequency output is used as, and, the voice data in the decoded media data flow is defeated as audio Go out.
According in a first aspect, in the first possible implementation of first aspect, the cloud terminal also includes:Display Device;
The primary processor, it is additionally operable to, using the display page as during video frequency output, send to the display aobvious Show order;
The display, for according to the display command, being shown to the display page.
According to the first possible implementation of first aspect, in second of possible implementation of first aspect In, the cloud terminal also includes:Image processor, for when the display shows the display page, carrying out display and adding Speed.
According in a first aspect, in the third possible implementation of first aspect, the receiver includes:
Media data flow receiving module, the media data flow to be decoded sent for receiving the Cloud Server;
Background data stream receiving module, the background data stream sent for receiving the Cloud Server.
According in a first aspect, in the 4th kind of possible implementation of first aspect, the hardware decoder includes:
Hardware decoding control unit, for after the hardware decoding order that the primary processor is sent is received, referring to Show that hardware decoding execution unit carries out hardware decoding to the media data flow to be decoded;
The hardware decodes execution unit, for according to the instruction of the hardware decoding control unit to described to be decoded Media data flow carries out hardware decoding;
The hardware decoding control unit, is additionally operable to after the completion of decoding, indicates that the hardware decodes execution unit to institute State primary processor and send the hardware decoding completion response;
The hardware decodes execution unit, the instruction according to the hardware decoding control unit is additionally operable to, to the main place Manage device and send the hardware decoding completion response.
According to first aspect, first aspect the first to any one in the 4th kind of possible implementation, In 5th kind of possible implementation of one side, the cloud terminal also includes:Memory, for storing the matchmaker to be decoded Volume data stream and background data stream.
Second aspect, the embodiment of the present invention provide a kind of Cloud Server, and the Cloud Server includes:
Receiving unit, for receiving the playing request of cloud terminal transmission;
Acquiring unit, for when the receiving unit receives the playing request, obtaining media data to be decoded Stream and background data stream;
Unit is redirected, the media data flow to be decoded for the acquiring unit to be obtained is redirected to first Network link, the first network link is different from original network link;
Transmitting element, for the media data flow to be decoded and the background data stream to be passed through into described first respectively Network link and original network link are sent to the cloud terminal.
The third aspect, the embodiment of the present invention provide a kind of media data flow play system, the media data stream broadcasting system System includes any one cloud terminal that above-mentioned first aspect is provided, and, the Cloud Server that above-mentioned second aspect is provided.
Fourth aspect, the embodiment of the present invention provide a kind of media data flow player method, and methods described includes:
The media data flow to be decoded and background data stream that Cloud Server is sent are received respectively;
The media data flow to be decoded is decoded using hardware decoder, obtains decoded media data Stream;
Background data in video data in the decoded media data flow and the background data stream is carried out Video is superimposed, and is formed and is shown the page;
Using it is described display the page as video frequency output, and using the voice data in the decoded media data flow as Audio output.
According to fourth aspect, in the first possible implementation of fourth aspect, it is described formed show the page it Afterwards, methods described also includes:Accelerated using display of the image processor to the display page.
5th aspect, the embodiment of the present invention provide a kind of media data flow player method, and methods described includes:
When receiving the playing request of cloud terminal transmission, media data flow to be decoded is obtained;
The media data flow to be decoded is redirected to first network link, the first network link is different from original Network link;
The media data flow to be decoded and the background data stream are passed through into the first network link and institute respectively State original network link and be sent to the cloud terminal.
Using cloud terminal provided in an embodiment of the present invention, Cloud Server, media data flow play system and method, cloud service Device is not decoded and played to original audio and video data streams, but original audio and video data streams are sent into cloud terminal, by Cloud terminal carries out hardware decoding using hardware decoder to the original audio and video data streams, so as to avoid in Cloud Server Complicated decoding computing is carried out, reduces the computing pressure of Cloud Server so that under identical Cloud Server and network configuration, More cloud terminals can be accommodated while worked per Cloud Server, equivalent to the corollary equipment for reducing cloud terminal unit into This, that is, reduce the popularization cost of cloud terminal;Also, compared with prior art, transmitted in a network in the embodiment of the present invention It is the original audio and video data streams using MPEG4 interframe compressions, higher than the existing compression ratio sent frame by frame, data volume is small, passes The bandwidth taken when defeated is small, can save network bandwidth, improves network load ability, and original audio and video data streams are whole by cloud The hardware decoder at end carries out hardware decoding, and is shown after the decoding by display, decoded audio and video data streams Transmission frame by frame need not be carried out in a network again, it is not necessary to decoded audio, video data is compressed, height can be supported Clear video playback, therefore, the requirement to network bandwidth was both reduced, and had improved network load ability, also improve broadcast performance, Improve Consumer's Experience.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are this hairs Some bright embodiments, for those of ordinary skill in the art, without having to pay creative labor, can be with Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the structural representation of cloud terminal provided in an embodiment of the present invention;
Fig. 2 is another structural representation of cloud terminal provided in an embodiment of the present invention;
Fig. 3 is the another structural representation of cloud terminal provided in an embodiment of the present invention;
Fig. 4 is another structural representation of cloud terminal provided in an embodiment of the present invention;
Fig. 5 is cloud terminal provided in an embodiment of the present invention another structural representation again;
Fig. 6 is the structural representation of Cloud Server provided in an embodiment of the present invention;
Fig. 7 is the structural representation of media data flow play system provided in an embodiment of the present invention;
Fig. 8 is the flow chart of media data flow player method provided in an embodiment of the present invention;
Fig. 9 is another flow chart of media data flow player method provided in an embodiment of the present invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention In accompanying drawing, the technical scheme in the embodiment of the present invention is clearly and completely described, it is clear that described embodiment is Part of the embodiment of the present invention, rather than whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art The every other embodiment obtained under the premise of creative work is not made, belongs to the scope of protection of the invention.
Fig. 1 is the structural representation of cloud terminal provided in an embodiment of the present invention.As shown in figure 1, the embodiment of the present invention provides Cloud terminal 10, including:
Receiver 101, for receiving the media data flow to be decoded and background data stream of Cloud Server transmission;
Primary processor 102, for after the receiver receives the media data flow to be decoded, being decoded to hardware Device 103 sends hardware decoding order;
The hardware decoder 103, the hardware for being sent according to the primary processor 102 decode order, treated to described The media data flow of decoding is decoded, and obtains decoded media data flow, and, to the main process task after decoding is completed Device 102 sends hardware decoding and completes response;
The primary processor 102, it is additionally operable to complete response in the hardware decoding for receiving the transmission of hardware decoder 103 Afterwards, the video data in the decoded media data flow is carried out into video with the background data in the background data stream to fold Add, formed and show the page and be used as video frequency output, and, using the voice data in the decoded media data flow as sound Frequency exports.
Specifically, the media data flow can be audio and video data streams, and the media data flow to be decoded is original Audio and video data streams, the media data flow of audiovisual compression coding is usually carried out using MPEG4.Optionally, the background number According to for remote desktop data, referring to the part in addition to video playback interface in remote desktop window, the display page is Remote desktop window, video data and remote desktop data composition remote desktop window.If cloud terminal is provided with display, The display page can be shown on the display of cloud terminal;If being not provided with display in cloud terminal, by the display page of formation External display is given in face as video frequency output.
In the embodiment of the present invention, by being configured to realize resetting for multimedia redirection in the virtual machine of Cloud Server To plug-in unit, during playing audio-video, redirect after plug-in unit intercepts and captures original audio and video data streams, and without decoding and playing, but Original audio and video data streams are sent to cloud terminal, the original audio, video data flowed into using hardware decoder by cloud terminal Row hardware decodes, so as to, avoid and complicated decoding computing carried out in Cloud Server, reduce the computing pressure of Cloud Server, So that under identical Cloud Server and network configuration, it can accommodate more cloud terminals per Cloud Server while work, quite In the unit cost for the corollary equipment for reducing cloud terminal, that is, reduce the popularization cost of cloud terminal;Also, will with prior art Decoded audio, video data, image and voice data are compared with virtual desktop packing compression is dealt into cloud terminal frame by frame, the present invention In embodiment, what is transmitted in a network is the original audio and video data streams using MPEG4 interframe compressions, is sent frame by frame than existing Compression ratio it is high, data volume is small, and the bandwidth taken during transmission is small, can save network bandwidth, improve network load ability, and Original audio and video data streams carry out hardware decoding by the hardware decoder of cloud terminal, and are shown after the decoding by display Show, decoded audio and video data streams need not carry out transmission frame by frame in a network again, it is not necessary to decoded audio frequency and video Data are compressed, and HD video can be supported to play, and therefore, have both been reduced the requirement to network bandwidth, and have been also improved broadcasting Performance, improve Consumer's Experience.
Fig. 2 is another structural representation of cloud terminal provided in an embodiment of the present invention.The embodiment of the present invention is based on shown in Fig. 1 Cloud terminal realize, as shown in Fig. 2 cloud terminal 20 provided in an embodiment of the present invention also include receiver 101, primary processor 102 And hardware decoder 103, and each functional module also has the function shown in Fig. 1;Further, cloud provided in an embodiment of the present invention Also include display 201 in terminal 20;
The primary processor 102, it is additionally operable to using the display page as during video frequency output, to the display 201 Send display command;
The display 201, for according to the display command, being shown to the display page.
The cloud terminal 20 provided in an embodiment of the present invention, by display by comprising in decoded media data flow The display page of video data and the background data in background data stream carries out video frequency output.
Fig. 3 is the another structural representation of cloud terminal provided in an embodiment of the present invention.The embodiment of the present invention is based on shown in Fig. 2 Cloud terminal realize, as shown in figure 3, cloud terminal 30 provided in an embodiment of the present invention also include receiver 101, primary processor 102, Hardware decoder 103 and display 201, and each functional module also has the function shown in Fig. 2;It is provided in an embodiment of the present invention Cloud terminal 30 also includes:
Image processor 301, for when the display 201 shows the display page, carrying out display acceleration.Using Display of the described image processor 301 to the decoded media data flow accelerates, and reduces required during video display Clock cycle.
Optionally, the receiver 101 can include:Media data flow receiving module and background data stream receiving module; Wherein, the media data flow receiving module is used to receive the media data flow to be decoded that the Cloud Server is sent;It is described Background data stream receiving module is used to receive the background data stream that the Cloud Server is sent.
Fig. 4 is another structural representation of cloud terminal provided in an embodiment of the present invention.The embodiment of the present invention is based on shown in Fig. 1 Cloud terminal realize, as shown in figure 4, cloud terminal 40 provided in an embodiment of the present invention also include receiver 101, primary processor 102 And hardware decoder 103, and each functional module also has the function shown in Fig. 1;Further, it is provided in an embodiment of the present invention hard Part decoder 103 includes:
Hardware decoding control unit 4011, for decoding life in the hardware for receiving the transmission of primary processor 102 After order, instruction hardware decoding execution unit 4012 carries out hardware decoding to the media data flow to be decoded;
The hardware decodes execution unit 4012, for according to the instruction of the hardware decoding control unit 4011 to described Media data flow to be decoded carries out hardware decoding;
The hardware decoding control unit 4011, is additionally operable to after the completion of decoding, indicates the hardware decoding execution unit 4012 send the hardware decoding to the primary processor 102 completes response;
The hardware decodes execution unit 4012, is additionally operable to the instruction according to the hardware decoding control unit 4011, to The primary processor 102 sends the hardware decoding and completes response.
The cloud terminal 40 provided in an embodiment of the present invention, is realized in cloud terminal-pair by using hardware decoder 103 The hardware decoding of the audio and video data streams not decoded, avoids and complicated decoding computing is carried out in Cloud Server, improve cloud The quantity for the cloud terminal that server can be supported simultaneously, reduce the popularization cost of cloud terminal.Also, decoded audio, video data Stream need not carry out transmission frame by frame in a network again, therefore, both reduced the requirement to network bandwidth, and also improved playability Can, improve Consumer's Experience.
Optionally, on the basis of above-described embodiment, above-mentioned cloud terminal can also include memory, for storing described treat The media data flow and background data stream of decoding.
It should be noted that above-mentioned primary processor, hardware decoder, image processor can be separately independent modules, It can also be integrated in a processor chips.Fig. 5 is cloud terminal provided in an embodiment of the present invention another structural representation again, As shown in figure 5, the processor 51 of the cloud terminal includes:Processor core 511, image processor block (Graphic Processing Unit, abbreviation GPU) 512 and high definition decoder module (High Definition Video, abbreviation HDV) 513, Processor core 511 is used as above-mentioned primary processor, and HDV513 is as hardware decoder.In a kind of feasible implementation, processing Device 51 can use the processor chips of high integration, and for example with Godson 2H processors, its processor core can use 4 transmittings 64 primary processor cores (GS464), processor 51 possess Embedded fixed-point processor, floating point processor, Streaming Media processing and Graph and image processing function, and the support chip group function such as south bridge, north bridge.The cloud terminal also includes:Display, memory, Ethernet module, power supply, input-output apparatus (audio output, keyboard, mouse, USB controller etc.) etc..
In a kind of feasible implementation, high definition decoder module 513 mainly contains double with directed quantity coprocessor Launch 32 bit processor cores and one by decoder module and direct memory access (DMA) write access and its associated configuration register group Into decoding unit.32 bit processor cores of double transmittings, for example with 32 Godson GS232 processor cores of double transmittings.Decoding Unit can regard a black box as, by the software run in GS232 processor cores, can decode different media formats, The part acceleration function of decoding is completed by vectorial coprocessor, rather than special module.
After cloud terminal is configured with hardware decoder module, accordingly, it is also necessary at primary processor end (primary processor core GS464) Internet adapter software is configured, carries out the supporting processing on upper strata.Comprise at least HDV in primary processor to drive, as primary processor and HDV moulds The bridge that block is linked up, and initiate decoding order to HDV and receive the feedback for decoding and completing;In order to compatible with conventional playout software, Also need to supporting VAAPI interfaces, FFMpeg decodings storehouse etc..
Fig. 6 is the structural representation of Cloud Server provided in an embodiment of the present invention.As shown in fig. 6, the embodiment of the present invention carries The Cloud Server 60 of confession, including:
Receiving unit 601, for receiving the playing request of cloud terminal transmission;
Acquiring unit 602, for when the receiving unit 601 receives the playing request, obtaining matchmaker to be decoded Volume data stream and background data stream;
Unit 603 is redirected, the media data flow to be decoded for the acquiring unit 602 to be obtained redirects To first network link, the first network link is different from original network link;
Transmitting element 604, for by the media data flow to be decoded and the background data stream respectively by described First network link and original network link are sent to the cloud terminal.Wherein, plug-in unit can be passed through by redirecting operation Mode be registered in playout software, start the playout software then have redirect function, it is clear that the playout software is necessary It is the playout software for supporting plug-in unit.
Wherein, redirecting the redirector of unit can be registered in playout software by way of plug-in unit, the broadcasting Software is the playout software for supporting plug-in unit installation, for example, Media Player etc..When user asks to play video, in band Have in the playout software of the plug-in unit and play out, when acquiring unit gets media data flow to be decoded, acquisition is treated The media data flow of decoding redirects.
In the embodiment of the present invention, Cloud Server obtains original audio and video data streams by redirecting unit, and single by sending Original audio and video data streams are sent to cloud terminal by member, so that cloud terminal uses hardware decoder to the original audio, video data Stream carries out hardware decoding, avoids Cloud Server and carries out complicated decoding computing, reduces the computing pressure of Cloud Server, make Obtain under identical Cloud Server and network configuration, can accommodate more cloud terminals per Cloud Server while work, equivalent to Reduce the unit cost of the corollary equipment of cloud terminal, that is, reduce the popularization cost of cloud terminal;Also, with prior art phase Than original audio and video data streams are to carry out hardware decoding by the hardware decoder of cloud terminal in the embodiment of the present invention, and are being decoded Being shown afterwards by display, decoded audio and video data streams need not carry out transmission frame by frame in a network again, therefore, Both the requirement to network bandwidth had been reduced, has also improved broadcast performance, has improved Consumer's Experience.
Fig. 7 is the structural representation of media data flow play system provided in an embodiment of the present invention.As shown in fig. 7, this hair The media data flow play system 1 that bright embodiment provides, including:Cloud terminal 71 and Cloud Server 72;Wherein:
The cloud terminal 71 can use Fig. 1-Fig. 5 it is any shown in cloud terminal embodiment structure, its realization principle and Beneficial effect is similar, will not be repeated here.The Cloud Server 72 can use the knot of the Cloud Server embodiment shown in Fig. 6 Structure, its realization principle is similar with beneficial effect, will not be repeated here.
Fig. 8 is the flow chart of media data flow player method provided in an embodiment of the present invention.As shown in figure 8, the present invention is real The media data flow player method of example offer is provided, including:
801st, the media data flow to be decoded and background data stream that Cloud Server is sent are received respectively;
802nd, the media data flow to be decoded is decoded using hardware decoder, obtains decoded media number According to stream;
803rd, by the background data in the video data in the decoded media data flow and the background data stream Video superposition is carried out, is formed and shows the page;
804th, using the display page as video frequency output, and by the voice data in the decoded media data flow As audio output.
Specifically, methods described can use any shown cloud terminals of Fig. 1-Fig. 5 to perform.Wherein, the background data For example, remote desktop data, the display page is, for example, remote desktop window.
Optionally, after the formation shows the page, the cloud terminal is using image processor to the display page Display accelerated.
Fig. 9 is another flow chart of media data flow player method provided in an embodiment of the present invention.As shown in figure 9, this hair The media data flow player method that bright embodiment provides, including:
901st, when receiving the playing request of cloud terminal transmission, media data flow to be decoded is obtained;
902nd, the media data flow to be decoded is redirected to first network link, the first network link different from Original network link;
903rd, the media data flow to be decoded and the background data stream are passed through into the first network link respectively The cloud terminal is sent to original network link.
Specifically, methods described can use the Cloud Server shown in Fig. 6 to perform.Wherein, redirecting operation can pass through The mode of plug-in unit is registered in playout software, and starting the playout software then has the function of redirecting, it is clear that the playout software It must be the playout software for supporting plug-in unit.
In several embodiments provided by the present invention, it should be understood that disclosed apparatus and method, it can be passed through Its mode is realized.For example, device embodiment described above is only schematical, for example, the division of the unit, only Only a kind of division of logic function, there can be other dividing mode when actually realizing, such as multiple units or component can be tied Another system is closed or is desirably integrated into, or some features can be ignored, or do not perform.It is another, it is shown or discussed Mutual coupling or direct-coupling or communication connection can be the INDIRECT COUPLINGs or logical by some interfaces, device or unit Letter connection, can be electrical, mechanical or other forms.
The unit illustrated as separating component can be or may not be physically separate, show as unit The part shown can be or may not be physical location, you can with positioned at a place, or can also be distributed to multiple On NE.Some or all of unit therein can be selected to realize the mesh of this embodiment scheme according to the actual needs 's.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, can also That unit is individually physically present, can also two or more units it is integrated in a unit.Above-mentioned integrated list Member can both be realized in the form of hardware, can also be realized in the form of hardware adds SFU software functional unit.
The above-mentioned integrated unit realized in the form of SFU software functional unit, can be stored in one and computer-readable deposit In storage media.Above-mentioned SFU software functional unit is stored in a storage medium, including some instructions are causing a computer It is each that equipment (can be personal computer, server, or network equipment etc.) or processor (processor) perform the present invention The part steps of embodiment methods described.And foregoing storage medium includes:USB flash disk, mobile hard disk, read-only storage (Read- Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disc or CD etc. it is various Can be with the medium of store program codes.
Those skilled in the art can be understood that, for convenience and simplicity of description, only with above-mentioned each functional module Division progress for example, in practical application, can be complete by different functional modules by above-mentioned function distribution as needed Into the internal structure of device being divided into different functional modules, to complete all or part of function described above.On The specific work process of the device of description is stated, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
Finally it should be noted that:Various embodiments above is merely illustrative of the technical solution of the present invention, rather than its limitations;To the greatest extent The present invention is described in detail with reference to foregoing embodiments for pipe, it will be understood by those within the art that:Its according to The technical scheme described in foregoing embodiments can so be modified, either which part or all technical characteristic are entered Row equivalent substitution;And these modifications or replacement, the essence of appropriate technical solution is departed from various embodiments of the present invention technology The scope of scheme.

Claims (11)

  1. A kind of 1. cloud terminal, it is characterised in that including:
    Receiver, for receiving the media data flow to be decoded and background data stream of Cloud Server transmission;
    Primary processor, for after the receiver receives the media data flow to be decoded, being sent to hardware decoder Hardware decoding order;
    The hardware decoder, the hardware for being sent according to the primary processor decodes order, to the media to be decoded Data flow is decoded, and obtains decoded media data flow, and, send hardware to the primary processor after decoding is completed Response is completed in decoding;
    The hardware decoder is high definition decoder module, including 32 bit processor cores of double transmittings and a decoding unit, described double Launching 32 bit processor cores includes vectorial coprocessor, the decoding unit by decoder module, direct memory access write access and Configuration register forms;The decoding unit passes through the software run in 32 bit processor cores of double transmittings, decoding difference Media formats;The vectorial coprocessor, which is used to decode, to be accelerated;
    The primary processor, it is additionally operable to after the hardware decoding completion response that the hardware decoder is sent is received, by described in Video data in decoded media data flow carries out video with the background data in the background data stream and is superimposed, and is formed aobvious Show the page and be used as video frequency output, and, using the voice data in the decoded media data flow as audio output.
  2. 2. cloud terminal according to claim 1, it is characterised in that the cloud terminal also includes:Display;
    The primary processor, it is additionally operable to, using the display page as during video frequency output, display life be sent to the display Order;
    The display, for according to the display command, being shown to the display page.
  3. 3. cloud terminal according to claim 2, it is characterised in that the cloud terminal also includes:
    Image processor, for when the display shows the display page, carrying out display acceleration.
  4. 4. cloud terminal according to claim 1, it is characterised in that the receiver includes:
    Media data flow receiving module, the media data flow to be decoded sent for receiving the Cloud Server;
    Background data stream receiving module, the background data stream sent for receiving the Cloud Server.
  5. 5. cloud terminal according to claim 1, it is characterised in that the hardware decoder includes:
    Hardware decoding control unit, for after the hardware decoding order that the primary processor is sent is received, instruction to be hard Part decodes execution unit and carries out hardware decoding to the media data flow to be decoded;
    The hardware decodes execution unit, for the instruction according to the hardware decoding control unit to the media to be decoded Data flow carries out hardware decoding;
    The hardware decoding control unit, is additionally operable to after the completion of decoding, indicates that the hardware decodes execution unit to the master Processor sends the hardware decoding and completes response;
    The hardware decodes execution unit, the instruction according to the hardware decoding control unit is additionally operable to, to the primary processor Send the hardware decoding and complete response.
  6. 6. according to any described cloud terminals of claim 1-5, it is characterised in that the cloud terminal also includes:Memory, it is used for Store the media data flow to be decoded and background data stream.
  7. A kind of 7. Cloud Server, it is characterised in that including:
    Receiving unit, for receiving the playing request of cloud terminal transmission;
    Acquiring unit, for when the receiving unit receives the playing request, obtain media data flow to be decoded and Background data stream;
    Unit is redirected, the media data flow to be decoded for the acquiring unit to be obtained is redirected to first network Link, the first network link is different from original network link;
    Transmitting element, for the media data flow to be decoded and the background data stream to be passed through into the first network respectively Link and original network link are sent to the cloud terminal;
    The redirector for redirecting unit is registered in playout software by way of plug-in unit, and the playout software is supported Plug-in unit is installed.
  8. A kind of 8. media data flow play system, it is characterised in that including:Cloud terminal as described in claim 1-6 is any, with And Cloud Server as claimed in claim 7.
  9. A kind of 9. media data flow player method, it is characterised in that including:
    The media data flow to be decoded and background data stream that Cloud Server is sent are received respectively;
    The media data flow to be decoded is decoded using hardware decoder, obtains decoded media data flow;
    Background data in video data in the decoded media data flow and the background data stream is used into main place Manage device and carry out video superposition, formed and show the page;
    Using the display page as video frequency output, and using the voice data in the decoded media data flow as audio Output;
    The hardware decoder is high definition decoder module, including 32 bit processor cores of double transmittings and a decoding unit, described double Launching 32 bit processor cores includes vectorial coprocessor, the decoding unit by decoder module, direct memory access write access and Configuration register forms;The decoding unit passes through the software run in 32 bit processor cores of double transmittings, decoding difference Media formats;The vectorial coprocessor, which is used to decode, to be accelerated.
  10. 10. according to the method for claim 9, it is characterised in that after the formation shows the page, methods described is also wrapped Include:Accelerated using display of the image processor to the display page.
  11. A kind of 11. media data flow player method, it is characterised in that including:
    When receiving the playing request of cloud terminal transmission, media data flow to be decoded is obtained;
    The media data flow to be decoded is redirected to first network link, the first network link is different from original net Network link;
    The media data flow to be decoded and the background data stream are passed through into the first network link and the original respectively Some network links are sent to the cloud terminal;
    It is described that the media data flow to be decoded is redirected to first network link, including:
    Redirector is registered in playout software by way of plug-in unit, the playout software supports plug-in unit installation;
    Start the playout software, the media data flow to be decoded is reset into the first network link.
CN201410409586.7A 2014-08-19 2014-08-19 Cloud terminal, Cloud Server, media data flow play system and method Active CN104159150B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410409586.7A CN104159150B (en) 2014-08-19 2014-08-19 Cloud terminal, Cloud Server, media data flow play system and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410409586.7A CN104159150B (en) 2014-08-19 2014-08-19 Cloud terminal, Cloud Server, media data flow play system and method

Publications (2)

Publication Number Publication Date
CN104159150A CN104159150A (en) 2014-11-19
CN104159150B true CN104159150B (en) 2017-12-19

Family

ID=51884540

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410409586.7A Active CN104159150B (en) 2014-08-19 2014-08-19 Cloud terminal, Cloud Server, media data flow play system and method

Country Status (1)

Country Link
CN (1) CN104159150B (en)

Families Citing this family (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105740081A (en) * 2014-12-12 2016-07-06 华为技术有限公司 Client, universal serial bus (USB) device and display processing system and method
CN105760143B (en) * 2014-12-15 2019-03-05 龙芯中科技术有限公司 The reconstructing method and device of image procossing execution code
CN106034241B (en) * 2015-03-19 2019-04-26 华为技术有限公司 A kind of method, client, server and system that multimedia redirects
CN104837058A (en) * 2015-05-06 2015-08-12 湖南昇云科技有限公司 Method and system for improving video image quality displayed by cloud terminal
CN106210036A (en) * 2016-07-08 2016-12-07 中霆云计算科技(上海)有限公司 Video display accelerated method in virtual desktop display device
CN106131550B (en) * 2016-07-25 2020-02-14 合一网络技术(北京)有限公司 Method and device for playing multimedia file
CN106817570A (en) * 2017-02-22 2017-06-09 上海地壳信息科技有限公司 A kind of network video monitor and control system of cloud computing
CN107105048B (en) * 2017-05-10 2020-03-17 广州杰赛科技股份有限公司 Teaching control method and system based on cloud technology
CN107920259A (en) * 2017-10-31 2018-04-17 深信服科技股份有限公司 Virtual platform video playing accelerated method, virtual machine server and storage medium
CN108322781A (en) * 2018-02-08 2018-07-24 武汉噢易云计算股份有限公司 Promote the method and system that HD video effect is played in virtual desktop
CN108521581A (en) * 2018-03-05 2018-09-11 西安万像电子科技有限公司 Multi-medium data display methods, terminal and system
CN110324671B (en) * 2018-03-30 2021-06-08 中兴通讯股份有限公司 Webpage video playing method and device, electronic equipment and storage medium
CN111050192A (en) * 2018-10-12 2020-04-21 华为技术有限公司 Media processing method and device
CN113094253A (en) * 2019-12-23 2021-07-09 华为机器有限公司 Equipment debugging method and device
CN114401432B (en) * 2022-01-27 2024-01-26 广州艾美网络科技有限公司 MV playing method, playing terminal, server equipment and entertainment equipment system
CN115695843A (en) * 2022-10-27 2023-02-03 中国联合网络通信集团有限公司 Prefabricated video playing method, server, terminal, medium and system

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202373298U (en) * 2011-12-23 2012-08-08 天津航盛电子有限公司 Household multimedia playing device
CN103686208A (en) * 2013-12-11 2014-03-26 南宁眸博科技有限公司 Video cloud computing transmitting method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4577267B2 (en) * 2006-05-17 2010-11-10 株式会社日立製作所 Thin client system
US8417938B1 (en) * 2009-10-16 2013-04-09 Verizon Patent And Licensing Inc. Environment preserving cloud migration and management
US9037682B2 (en) * 2012-12-13 2015-05-19 Google Technology Holdings LLC System and methods for preventing interruptions due to battery drain during streaming media sessions between devices

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN202373298U (en) * 2011-12-23 2012-08-08 天津航盛电子有限公司 Household multimedia playing device
CN103686208A (en) * 2013-12-11 2014-03-26 南宁眸博科技有限公司 Video cloud computing transmitting method

Also Published As

Publication number Publication date
CN104159150A (en) 2014-11-19

Similar Documents

Publication Publication Date Title
CN104159150B (en) Cloud terminal, Cloud Server, media data flow play system and method
CN103023872B (en) A kind of cloud game service platform
CN108881916A (en) The video optimized processing method and processing device of remote desktop
CN109304031B (en) Virtual cloud game platform based on heterogeneous intelligent terminal
CN106034241B (en) A kind of method, client, server and system that multimedia redirects
CN101964202B (en) Audio data file playback processing method mixed with multiple encoded formats
KR101312268B1 (en) Method, cloud computing server, and cloud computing system for providing game service in cloud computing environment
CN106817613B (en) Method and device for playing audio and video contents
CN105262825A (en) SPICE cloud desktop transporting and displaying method and system on the basis of H.265 algorithm
CN111355976B (en) Video live broadcast method and system based on HEVC standard
CN106254867A (en) Based on picture group, video file is carried out the method and system of transcoding
CN103631634A (en) Graphics processor virtualization achieving method and device
CN109862357A (en) Cloud game image encoding method, device, equipment and the storage medium of low latency
CN106131550A (en) Play the method and device of multimedia file
CN102510543A (en) Method and system for playing audio/video
CN102855133A (en) Interactive system of computer processing unit
CN104067627B (en) Method, device, system and computer-readable medium that a kind of video is redirected
CN104301742A (en) Video redirecting device between virtual machine and client and use method thereof
CN105491021A (en) Android cloud application server and Android cloud application server system
CN102609048B (en) Computer and method for playing audio and video files on demand
CN104202656B (en) Network audio MP3 flows out of order segmentation decoding method
US11968380B2 (en) Encoding and decoding video
KR102035759B1 (en) Multi-threaded texture decoding
CN103957445A (en) Video redirecting system and method based on application virtualization technology
CN102299900A (en) Game operating method based on real-time video stream media coding

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CP01 Change in the name or title of a patent holder
CP01 Change in the name or title of a patent holder

Address after: 100095 Building 2, Longxin Industrial Park, Zhongguancun environmental protection technology demonstration park, Haidian District, Beijing

Patentee after: Loongson Zhongke Technology Co.,Ltd.

Address before: 100095 Building 2, Longxin Industrial Park, Zhongguancun environmental protection technology demonstration park, Haidian District, Beijing

Patentee before: LOONGSON TECHNOLOGY Corp.,Ltd.