CN107948731A - Video stream merging method, server and computer-readable recording medium - Google Patents
Video stream merging method, server and computer-readable recording medium Download PDFInfo
- Publication number
- CN107948731A CN107948731A CN201711055808.XA CN201711055808A CN107948731A CN 107948731 A CN107948731 A CN 107948731A CN 201711055808 A CN201711055808 A CN 201711055808A CN 107948731 A CN107948731 A CN 107948731A
- Authority
- CN
- China
- Prior art keywords
- video stream
- target
- terminal device
- current
- order
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 75
- 230000005540 biological transmission Effects 0.000 claims abstract description 84
- 238000007596 consolidation process Methods 0.000 claims description 26
- 238000013507 mapping Methods 0.000 claims description 10
- GOLXNESZZPUPJE-UHFFFAOYSA-N spiromesifen Chemical compound CC1=CC(C)=CC(C)=C1C(C(O1)=O)=C(OC(=O)CC(C)(C)C)C11CCCC1 GOLXNESZZPUPJE-UHFFFAOYSA-N 0.000 claims description 2
- 238000009877 rendering Methods 0.000 description 12
- 230000006870 function Effects 0.000 description 9
- 230000007812 deficiency Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 238000011176 pooling Methods 0.000 description 5
- 230000000149 penetrating effect Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 241000208340 Araliaceae Species 0.000 description 2
- 235000005035 Panax pseudoginseng ssp. pseudoginseng Nutrition 0.000 description 2
- 235000003140 Panax quinquefolius Nutrition 0.000 description 2
- 230000006978 adaptation Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 235000008434 ginseng Nutrition 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000000712 assembly Effects 0.000 description 1
- 238000000429 assembly Methods 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000005611 electricity Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 241000894007 species Species 0.000 description 1
- 230000006641 stabilisation Effects 0.000 description 1
- 238000011105 stabilization Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
- H04N21/647—Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
- H04N21/64746—Control signals issued by the network directed to the server or the client
- H04N21/64761—Control signals issued by the network directed to the server or the client directed to the server
- H04N21/64769—Control signals issued by the network directed to the server or the client directed to the server for rate control
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of video stream merging method, server and computer-readable recording medium, the present invention is by obtaining multiple current video streams, judge whether the current video stream needs while shown on same terminal device, when the current video stream needs showing on same terminal device at the same time, the current video stream is merged, using the video flowing after merging as target video stream, corresponding target is generated according to the target video stream and renders order, the target video stream and the target are rendered order to send to the terminal device, the target video stream is rendered so that the terminal device renders order according to the target, the present invention inhibits flow by the merging to video flowing, render order storm, improve the fluency of video flowing transmission speed and picture, improve user experience.
Description
Technical field
The present invention relates to computer and video technique field, more particularly to a kind of video stream merging method, server and meter
Calculation machine readable storage medium storing program for executing.
Background technology
With the decline of server and carrying cost, the continuous lifting of network bandwidth, and client is to security and concentration
The demand of management is more and more vigorous, and desktop virtualization increasingly becomes a kind of trend.It is past due to the physical characteristic of desktop virtualization
Toward using display terminal access way, display terminal only needs to render, show corresponding virtual machine (Virtual Machine,
VM) the drawing command produced, result in a kind of special application can't accomplish the complete experience as local program, wherein
The application of video conference class is exactly a typical example.
Video conference class is using there are a comparison with other video classes application (multimedia player, flash websites etc.)
Big difference：The more video window accesses (multi-path video stream) of video conference class application requirement, need individually real per road video
Shi Gengxin：If the species video conference application runs on virtual desktop architecture (Virtual Desktop
Infrastructure, VDI) under scene, the display terminal of any participant needs to update all participant's video datas, this
The concurrent scene of multi-path video stream produces the data packet for rendering order of flood tide, not only possesses the feature of big flow, Er Qiexuan
It is huge to contaminate order data bag data, gives VDI display terminals, particularly the thin display terminal of some operational capabilities deficiency, causes down
Row pressure, causes video high latency, or even can not show that certain all the way or a few road video two sides, can not meet normal use demand.
Existing scheme has multi-path video stream under video conference scene, so as to produce a large amount of flows and render order, whole with display
During the interaction of end, be limited by the deficiency of the limitation of network traffics and the computing capability of display terminal, cause display terminal without
The defects of method normal experience, picture is not smooth, and multiple video strems render order and easily produce storm, cause video conference class should
It is bad or even can not use with experiencing.
The content of the invention
It is a primary object of the present invention to propose a kind of video stream merging method and server, it is intended to solve in the prior art
A large amount of flows are produced when running multi-path video stream and render order and cause the slack problem of display terminal picture.
To achieve the above object, the present invention provides a kind of video stream merging method, the video stream merging method include with
Lower step：
Multiple current video streams are obtained, judge whether the current video stream needs while opened up on same terminal device
Show；
When the current video stream needs showing on same terminal device at the same time, the current video stream is closed
And using the video flowing after merging as target video stream；
Corresponding target is generated according to the target video stream and renders order, by the target video stream and the target wash with watercolours
Dye order is sent to the terminal device, so that the terminal device renders order to the target video stream according to the target
Rendered.
Preferably, it is described to merge the current video stream, using the video flowing after merging as target video stream, tool
Body includes：
By the current video stream be rendered into it is default render area, by it is described it is default render the video flowing in area and merge,
Using the video flowing after merging as the target video stream.
Preferably, it is described by the current video stream be rendered into it is default render area before, the method further includes：
The code check of the current video stream is obtained, and receives the configuration parameter that the terminal device is sent；
Created in virtual machine according to the code check of the current video stream and the configuration parameter and virtually render area, by described in
The virtual area that renders renders area as described preset.
Preferably, it is described that order is rendered according to the corresponding target of target video stream generation, by the target video stream
Order is rendered with the target to send to the terminal device, so that the terminal device renders order to institute according to the target
State target video stream to be rendered, specifically include：
Receive the object transmission frame per second that the terminal device is sent；
The target is generated according to the object transmission frame per second and the target video stream and renders order, the target is regarded
Frequency stream and the target render order and send to the terminal device, so that the terminal device renders order according to the target
The target video stream is rendered.
Preferably, the object transmission frame per second for receiving the terminal device and sending, specifically includes：
Receive the processor performance parameter and current network transmission rate of the terminal device；
The equipment for determining the terminal device according to the processor performance parameter and the current network transmission rate passes
Defeated frame per second, frame per second is transmitted as the object transmission frame per second using the equipment of the terminal device.
Preferably, it is described to determine that the terminal is set according to the processor performance parameter and the current network transmission rate
Standby equipment transmission frame per second, transmits frame per second as the object transmission frame per second using the equipment of the terminal device, specifically includes：
Identify the current video type of the current video stream；
Frame per second value range corresponding with the current video type is searched in default mapping table, described preset is reflected
Penetrating relation table includes the correspondence of video type and frame per second value range；
According to the processor performance parameter and the current network transmission rate in the frame per second value range found
The equipment transmission frame per second of the terminal device is chosen, the equipment of the terminal device is transmitted into frame per second as the object transmission frame
Rate.
Preferably, it is described according to the target video stream generate corresponding with target video stream target render order it
Afterwards, the method further includes：
The performance utilization rate of the current video stream and the target video stream is calculated, the performance utilization rate is video flowing
The ratio of the terminal device over-all properties is accounted for using the performance of the terminal device；
When the performance utilization rate of the current video stream is more than the performance utilization rate of the target video stream, it is allowed to by institute
State target video stream and the target renders order and sends to the terminal device.
Preferably, after the performance utilization rate for calculating the current video stream and the target video stream, the side
Method further includes：
When the performance utilization rate of the current video stream is less than or equal to the performance utilization rate of the target video stream, prohibit
The target video stream and the target only are rendered order to send to the terminal device.
In addition, to achieve the above object, the present invention also proposes that a kind of video flowing merges server, it is characterised in that described
Video flowing merges server and includes：Memory, processor and it is stored on the memory and can runs on the processor
Video flowing consolidation procedure, the video flowing consolidation procedure is arranged for carrying out the step of video stream merging method as described above
Suddenly.
In addition, to achieve the above object, the present invention also proposes a kind of computer-readable recording medium, it is characterised in that institute
State and video flowing consolidation procedure is stored with computer-readable recording medium, it is real when the video flowing consolidation procedure is executed by processor
Now the step of video stream merging method as described above.
Video stream merging method proposed by the present invention, obtains multiple current video streams, whether judges the current video stream
Need while shown on same terminal device, when the current video stream needs showing on same terminal device at the same time,
The current video stream is merged, using the video flowing after merging as target video stream, is given birth to according to the target video stream
Order is rendered into corresponding target, the target video stream and the target are rendered order sends to the terminal device, with
Make the terminal device render order according to the target to render the target video stream, the present invention is by video flowing
Merging inhibit flow, render order storm, improve the fluency of video flowing transmission speed and picture, improve user's body
Test.
Brief description of the drawings
Fig. 1 is that the video flowing for the hardware running environment that the embodiment of the present invention is related to merges server architecture schematic diagram；
Fig. 2 is the flow diagram of video stream merging method first embodiment of the present invention；
Fig. 3 is the flow diagram of video stream merging method second embodiment of the present invention；
Fig. 4 is the flow diagram of video stream merging method 3rd embodiment of the present invention.
The embodiments will be further described with reference to the accompanying drawings for the realization, the function and the advantages of the object of the present invention.
Embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The solution of the embodiment of the present invention is mainly：Multiple current video streams are obtained, judge that the current video stream is
No needs are shown on same terminal device at the same time, need to show on same terminal device at the same time in the current video stream
When, the current video stream is merged, using the video flowing after merging as target video stream, according to the target video stream
Generating corresponding target and render order, the target video stream and the target are rendered order sends to the terminal device,
The target video stream is rendered so that the terminal device renders order according to the target, the present invention is by video
The merging of stream inhibits flow, renders order storm, improves the fluency of video flowing transmission speed and picture, improves user
Experience.By the technical solution of the embodiment of the present invention, solution produces a large amount of flows when running multi-path video stream in the prior art
The slack problem of picture is caused with rendering order.
With reference to Fig. 1, Fig. 1 is that the video flowing for the hardware running environment that the embodiment of the present invention is related to merges server architecture
Schematic diagram.
It can include as shown in Figure 1, the video flowing merges server：Processor 1001, such as CPU, communication bus 1002,
User interface 1003, network interface 1004, memory 1005.Wherein, communication bus 1002 is used for realization between these components
Connection communication.User interface 1003 can include display screen (Display), input unit such as keyboard (Keyboard), optional
User interface 1003 can also include standard wireline interface and wireless interface.Network interface 1004 can optionally include standard
Wireline interface, wave point (such as WI-FI interfaces).Memory 1005 can be high-speed RAM memory or stabilization
Memory (non-volatile memory), such as magnetic disk storage.Memory 1005 optionally can also be independently of foregoing
The storage device of processor 1001.
Do not formed to video it will be understood by those skilled in the art that the video flowing shown in Fig. 1 merges server architecture
Stream merges the restriction of server, can include than illustrating more or fewer components, either combine some components or different
Component is arranged.
In the concrete realization, the video flowing, which merges server, can also include three components, and video flowing is realized with auxiliary
The function of merging, three components can be video stream management component, and video frame control assembly and mirror image virtually render area
Component, the mirror image virtually render area assembly operation, mirror image in virtual machine monitor (Hypervisor) and virtually render
Area assembly sets corresponding mirror image for each terminal device and virtually renders area, and the virtual machine monitor is used for by any wash with watercolours
Dye order is sent to before corresponding terminal device shows, by the frame control assembly by this render order render it is virtual in mirror image
Render in area；The video stream management component is responsible for monitoring, identifying video flowing region and start and stop video flowing pooling function, described
Video frame control assembly consults when terminal device is shown and records counterpart terminal rendering capability, with reference to current network conditions, shows
Show computing capability of terminal etc., calculate the frame per second of a suitable counterpart terminal, certainly described video flowing merges server and may be used also
With including other assemblies or accessory, to realize video flowing pooling function, the present embodiment is not any limitation as this.
It is understood that Hypervisor is a kind of middleware software operated between physical server and operating system
Layer, allows multiple operating systems and a set of underlying physical hardware of Application share, therefore can also regard as in virtual environment
" member " operating system, it can coordinate to access all physical equipments and virtual machine on server, also be virtual machine monitor
(Virtual Machine Monitor).Hypervisor is the core of all virtualization technologies.Multiplexing is supported to make non-interruptedly
The ability of load migration is the basic function of Hypervisor.When startup of server and when performing Hypervisor, it can give every
One virtual machine distributes suitable memory, CPU, network and disk, and loads the client operating system of all virtual machines.
As shown in Figure 1, it can lead to as in a kind of memory 1005 of computer-readable storage medium including operating system, network
Believe module, Subscriber Interface Module SIM and video flowing consolidation procedure.
Processor 1001, the memory 1005 that video flowing of the present invention merges in server can be arranged on video flowing and merge dress
In putting, the video flowing merges device and calls the video flowing consolidation procedure stored in memory 1005 by processor 1001, and
Perform following operation：
Multiple current video streams are obtained, judge whether the current video stream needs while opened up on same terminal device
Show；
When the current video stream needs showing on same terminal device at the same time, the current video stream is closed
And using the video flowing after merging as target video stream；
Corresponding target is generated according to the target video stream and renders order, by the target video stream and the target wash with watercolours
Dye order is sent to the terminal device, so that the terminal device renders order to the target video stream according to the target
Rendered.
Further, processor 1001 can call the video flowing consolidation procedure stored in memory 1005, also perform with
Lower operation：
By the current video stream be rendered into it is default render area, by it is described it is default render the video flowing in area and merge,
Using the video flowing after merging as the target video stream.
Further, processor 1001 can call the video flowing consolidation procedure stored in memory 1005, also perform with
Lower operation：
The code check of the current video stream is obtained, and receives the configuration parameter that the terminal device is sent；
Created in virtual machine according to the code check of the current video stream and the configuration parameter and virtually render area, by described in
The virtual area that renders renders area as described preset.
Further, processor 1001 can call the video flowing consolidation procedure stored in memory 1005, also perform with
Lower operation：
Receive the object transmission frame per second that the terminal device is sent；
The target is generated according to the object transmission frame per second and the target video stream and renders order, the target is regarded
Frequency stream and the target render order and send to the terminal device, so that the terminal device renders order according to the target
The target video stream is rendered.
Further, processor 1001 can call the video flowing consolidation procedure stored in memory 1005, also perform with
Lower operation：
Receive the processor performance parameter and current network transmission rate of the terminal device；
The equipment for determining the terminal device according to the processor performance parameter and the current network transmission rate passes
Defeated frame per second, frame per second is transmitted as the object transmission frame per second using the equipment of the terminal device.
Further, processor 1001 can call the video flowing consolidation procedure stored in memory 1005, also perform with
Lower operation：
Identify the current video type of the current video stream；
Frame per second value range corresponding with the current video type is searched in default mapping table, described preset is reflected
Penetrating relation table includes the correspondence of video type and frame per second value range；
According to the processor performance parameter and the current network transmission rate in the frame per second value range found
The equipment transmission frame per second of the terminal device is chosen, the equipment of the terminal device is transmitted into frame per second as the object transmission frame
Rate.
Further, processor 1001 can call the video flowing consolidation procedure stored in memory 1005, also perform with
Lower operation：
The performance utilization rate of the current video stream and the target video stream is calculated, the performance utilization rate is video flowing
The ratio of the terminal device over-all properties is accounted for using the performance of the terminal device；
When the performance utilization rate of the current video stream is more than the performance utilization rate of the target video stream, it is allowed to by institute
State target video stream and the target renders order and sends to the terminal device.
Further, processor 1001 can call the video flowing consolidation procedure stored in memory 1005, also perform with
Lower operation：
When the performance utilization rate of the current video stream is less than or equal to the performance utilization rate of the target video stream, prohibit
The target video stream and the target only are rendered order to send to the terminal device.
The present embodiment judges whether the current video stream needed while at same end by obtaining multiple current video streams
Shown in end equipment, when the current video stream needs showing on same terminal device at the same time, by the current video stream
Merge, using the video flowing after merging as target video stream, corresponding target is generated according to the target video stream and is rendered
Order, renders order by the target video stream and the target and sends to the terminal device, so that the terminal device root
Order is rendered according to the target to render the target video stream, the present invention inhibits stream by the merging to video flowing
Measure, render order storm, improve the fluency of video flowing transmission speed and picture, improve user experience.
Based on above-mentioned hardware configuration, video stream merging method embodiment of the present invention is proposed.
With reference to Fig. 2, Fig. 2 is the flow diagram of video stream merging method first embodiment of the present invention.
In the first embodiment, the video stream merging method comprises the following steps：
Step S10, obtains multiple current video streams, judges whether the current video stream needs while set in same terminal
Standby upper displaying；
It should be noted that the current video stream is the current video data transmitted, multiple current videos are obtained
After stream, judge whether the current video stream needs to show on same terminal device, that is, whether judge the current video stream
Belong in same terminal device display interface the video data shown, be different from video flowing institute different in different display interfaces
The situation of the current video stream of composition；Judge whether the current video stream needs while shown on same terminal device, i.e.,
Judge the current video stream whether be at the same time or the video data that is shown in the display interface of terminal device of period,
It is different from the situation of the multi-path video data of different time generation.
It is understood that whether need while shown on same terminal device by judging the current video stream,
It can understand that screening limits current video stream of the qualified video flowing as subsequent operation, avoiding other need not be at the same time
The interference of the video flowing shown on same terminal device.
In the concrete realization, video flowing can be monitored by video stream management component, when detect it is current
The current video stream that can select to monitor when the video data of transmission all obtains, or is advised according to default obtain
Then or condition only selects the video data of interception part as the current video stream, certainly can also be true in other way
The fixed current video stream, the present embodiment are not any limitation as this.
Step S20, when the current video stream needs showing on same terminal device at the same time, by the current video
Stream merges, using the video flowing after merging as target video stream；
It should be noted that the current video stream for needing to show on same terminal device at the same time is in the same time
In the video data that the display interface of same terminal device is shown, needed at the same time in same terminal display in the current video stream
When can be in the case of video conference the corresponding multi-path video stream of different participants in the display interface of same terminal device
Be shown, naturally it is also possible to be video flowing while to be shown on same terminal device in the case of other, the present embodiment to this not
It is any limitation as.
It is understood that the current video stream shown at the same time on same terminal device can be merged, will close
Video flowing after and is as target video stream, you can be that multi-path video stream is merged into video flowing all the way, because multi-channel video
Stream can concurrently produce and largely render order and data packet, can effectively be reduced after multi-path video stream is merged into video flowing all the way
Render order and data packet, it is suppressed that flow, render order storm, naturally it is also possible to be that multi-path video stream is merged into present count
The video flowing of amount, the default quantity are less than the quantity of the current video stream, naturally it is also possible to are by working as forward sight by described in
Frequency stream is merged into the video flowing of other forms, and the present embodiment is not any limitation as this.
In the concrete realization, can be video when the current video stream needs showing on same terminal device at the same time
The situation of meeting, by video conference class application operation in virtual desktop architecture (Virtual Desktop
Infrastructure, VDI) under scene, video stream management component can obtain shown on same terminal device work as forward sight
The scene of frequency, searches the mapping relations of different default scenes and start/stop video flowing pooling function, by searching for knot
Fruit merges to judge under the scene of current video whether the current video stream opens video flowing；Can certainly be described in acquisition
The quantity of current video stream, searches the mapping relations of different default quantity and start/stop video flowing pooling function, according to looking into
The result found judges whether the current video stream carries out video flowing merging, by Intelligent Dynamic start/stop video
Pooling function is flowed, video conference class can be effectively improved and apply usage experience and practicality under VDI scenes, naturally it is also possible to
It is that definite unlatching or stopping video flowing merging by other means, the present embodiment is not any limitation as this.
It should be appreciated that VDI, that is, virtual desktop architecture, is operated by running desktop in the server of data center
System, user are attached by the transport protocol of client device (the client computer or PC) desktop long-range with these so that are used
It is like to access traditional local desktop that family, which accesses their desktop, is needed at the same time same in the current video stream certainly
Other multi-channel videos are same on same terminal device when being shown on one terminal device or in addition to video conference class is applied
When situation about showing, the present embodiment is not any limitation as this.
Step S30, generates corresponding target according to the target video stream and renders order, by the target video stream and institute
State target and render order and send to the terminal device, so that the terminal device renders order to the mesh according to the target
Mark video flowing is rendered.
It should be noted that since multiple current video streams are merged the generation target video stream, reduce indirectly
Order largely is rendered, target video stream can be adapted to the terminal device of various computing capability deficiencies, ensure that video
The fluency of broadcasting, the solution prior art produce a large amount of flows under video conference scene and cause picture not flow with rendering order
The problem of smooth.
It is understood that the terminal device can be mobile terminal such as mobile phone, tablet computer and notebook electricity
Brain etc. or PC, LCD TV and game machine etc., can also be other with display function and certain computing capability certainly
Terminal device, the present embodiment is not any limitation as this.
In the concrete realization, the video flowing generated after the current video stream is merged is as the target video
Stream, according to the target video, generation target renders order, and video stream management component monitors the scene notification frame control group
Part, the frame control assembly send the target and render order to corresponding terminal device, and the terminal device is according to the mesh
Mark renders order and the target video stream is rendered.
The present embodiment judges whether the current video stream needed while at same end by obtaining multiple current video streams
Shown in end equipment, when the current video stream needs showing on same terminal device at the same time, by the current video stream
Merge, using the video flowing after merging as target video stream, corresponding target is generated according to the target video stream and is rendered
Order, renders order by the target video stream and the target and sends to the terminal device, so that the terminal device root
Order is rendered according to the target to render the target video stream, the present invention inhibits stream by the merging to video flowing
Measure, render order storm, improve the fluency of video flowing transmission speed and picture, improve user experience.
Further, as shown in figure 3, proposing video stream merging method second embodiment of the present invention based on first embodiment,
In the present embodiment, the step S20 specifically includes following steps：
Step S21, by the current video stream be rendered into it is default render area, default render the video in area by described and flow into
Row merges, using the video flowing after merging as the target video stream.
It should be noted that the default area that renders renders area to be set in advance, because each video flowing can correspond to phase
That answers renders order, and the current video stream is rendered into and default render area and accordingly renders life according to each video flowing is corresponding
Order by the current video stream be rendered into it is default renders area, default render the video flowing in area by described after the completion of rendering and closed
And using the video flowing after merging as the target video stream, the default area that renders is similar to an area for being used for buffered video stream
Domain, can by be sent directly to terminal device render order and video flowing is intercepted and captured, merge processing after again by target
Video flowing and target render order and send to the terminal device, can effectively suppress flow, render order storm, meet to calculate
The terminal device of scarce capacity carries out normal video playing, ensure that the fluency of video playing.
In the concrete realization, can nature production when video to be presented runs on virtual machine (Virtual Machine, VM)
Raw 1~N number of video flowing, the scene that video stream management component monitors the corresponding current video stream of the video to be presented belong to and regard
Notification frame control assembly during frequency meeting class scene, the video conference class scene include other multi-path video streams in addition to video conference
Application scenarios, frame control assembly pause sends that the current video stream is corresponding to render order to counterpart terminal equipment,
Directly by the current video stream it is corresponding render order and be rendered into virtually render area, virtual render video in area by described and flow into
Row merges, using the video flowing after merging as the target video stream.
Further, before step S21, the method is further comprising the steps of：
S201, the code check for obtaining the current video stream, and receive the configuration parameter that the terminal device is sent；
It should be noted that the code check of the current video stream is the bit number of current video stream transmission per second, show to work as
The transmission rate of the video data of preceding transmission, the configuration parameter can be CPU, memory and display of the terminal device etc.
The parameter of configuration, the configuration parameter for the terminal device that the present embodiment is used is mainly the configuration parameter of display, i.e. display
Screen size and resolution sizes, can also be what hard disk of other kinds of configuration parameter such as video card, mainboard etc., this implementation certainly
Example is not any limitation as this.
S202, according to the code check of the current video stream and the configuration parameter create in virtual machine and virtually render area,
The virtual area that renders is rendered into area as described preset.
It is understood that the configuration ginseng that the code check for the current video stream for passing through acquisition and the reception terminal device are sent
Number, can obtain the relevant parameter that the page is shown with terminal device, can be in virtual machine according to the relevant parameter of display interface
Determine it is corresponding it is virtual render area, it is described it is virtual render area i.e. it is described it is default render area, code check and end by current video stream
The virtual area that renders that the configuration parameter of end equipment determines can be such that the current video stream is closed in default render in area
And the video flowing after merging is more in line with the display requirement of terminal device as the target video stream, the target video stream
And configuration, the fluency that terminal device shows video can be further improved, lifts user experience.
In the concrete realization, the frame control assembly pause transmission current video stream is corresponding renders order to correspondence
Terminal device, directly by the current video stream it is corresponding render order and be rendered into virtually render area, virtually render area by described
Middle video flowing merges, using the video flowing after merging as the target video stream.
The present embodiment receives the configuration ginseng that the terminal device is sent by obtaining the code check of the current video stream
Number, creates in virtual machine according to the code check of the current video stream and the configuration parameter and virtually renders area, will be described virtual
Render area as it is described it is default render area, by the current video stream be rendered into it is default render area, default rendered described in area
Video flowing merge, using the video flowing after merging as the target video stream, it is possible to reduce render order, adaptation is various
The terminal device of computing capability deficiency, further improves the fluency that terminal device shows video, lifts user experience.
Further, as shown in figure 4, proposing video stream merging method 3rd embodiment of the present invention based on second embodiment,
In the present embodiment, the step S30 specifically includes following steps：
S31, receive the object transmission frame per second that the terminal device is sent；
S32, generate the target according to the object transmission frame per second and the target video stream and render order, by the mesh
Mark video flowing and the target render order and send to the terminal device, so that the terminal device is rendered according to the target
Order renders the target video stream.
It should be noted that the object transmission frame per second shows the biography of the target video stream in the page for the terminal device
Defeated frame per second, renders order according to the target that the object transmission frame per second and the target video stream generate, is more in line with end
The display requirement and configuration of end equipment, can further improve the fluency that terminal device shows video, lift user experience.
In the concrete realization, the target render instruction is rendered into and virtually renders area by the frame control assembly, described
Virtual render in area merges the video flowing after rendering, can basis using the video flowing after merging as target video stream
The transmission frame per second and the target video stream that the terminal device is sent generate the target and render order, and the target is rendered
Order and the target video stream are sent to the terminal device, so that the terminal device renders order pair according to the target
The target video stream is rendered；It can also be the transmission frame per second sent according to the terminal device by the target video stream
Order is rendered with corresponding target to send to terminal device to be shown, can also be certainly sets terminal by other means
Target video stream is rendered for order is rendered according to object transmission frame per second and target, the present embodiment is not any limitation as this.
In order to improve the smooth flow degree that the terminal device plays video, the rendering capability of terminal device is adapted to, into
One step, the step S31 specifically includes following steps：
Receive the processor performance parameter and current network transmission rate of the terminal device；
The equipment for determining the terminal device according to the processor performance parameter and the current network transmission rate passes
Defeated frame per second, frame per second is transmitted as the object transmission frame per second using the equipment of the terminal device.
It should be noted that the processor performance parameter of the terminal device can be cpu performance parameter or
GPU performance parameters, can also be the performance parameter of other kinds of processor, and the present embodiment is not any limitation as this, described to work as
Preceding network transmission speed, that is, current network bandwidth speed.
It is understood that the terminal is determined according to the processor performance parameter and the current network transmission rate
The equipment transmission frame per second of equipment, the transmission frame per second determined by processor performance parameter and current network transmission rate are more smart
Really, the display capabilities of terminal device are more in line with, the fluency that the terminal device plays video can be further improved, adaptation
In the rendering capability of terminal device, user experience is lifted.
In the concrete realization, Hypervisor virtually renders area for each maintaining terminal equipment one, will arbitrarily work as
Preceding video flowing is corresponding to be rendered order and is sent to before corresponding terminal device shows, by the frame control assembly according to working as forward sight
Frequency flow it is corresponding render order and render current video stream rendered virtually in area, the frame control assembly is shown in terminal device
Before, the frame of a suitable counterpart terminal equipment is determined with reference to current network transmission rate, the processor parameter of terminal device
Rate, the terminal device render order, Jin Ergen according to corresponding object transmission frame per second and target video stream generation target
Order is rendered according to the target to render target video stream.
In order to reduce the scope that terminal device transmission frame per second is chosen, the transmission frame per second for reducing inaccuracy causes terminal device to show
When showing video can not normal experience and the slack situation of picture occur, further, the step is according to the processor
Energy parameter and the current network transmission rate determine the equipment transmission frame per second of the terminal device, by setting for the terminal device
Standby transmission frame per second specifically includes following steps as the object transmission frame per second：
Identify the current video type of the current video stream；
Frame per second value range corresponding with the current video type is searched in default mapping table, described preset is reflected
Penetrating relation table includes the correspondence of video type and frame per second value range；
According to the processor performance parameter and the current network transmission rate in the frame per second value range found
The equipment transmission frame per second of the terminal device is chosen, the equipment of the terminal device is transmitted into frame per second as the object transmission frame
Rate.
It should be noted that the current video type is the corresponding type of video content in the current video stream, depending on
Frequency type can be video conference or one-to-one Video chat, remote teaching and amusement explanation, can also be that other are regarded
Frequency type, the present embodiment are not any limitation as this.
It is understood that the required transmission frame per second value range of different video types is different, pass through foundation
Default mapping table can quickly find very much the corresponding frame per second value range of current video type, be closed from the default mapping
It is the frame per second value range obtained in table, can further reduces the scope that terminal device transmission frame per second is chosen, reduce inaccurate
Transmission frame per second cause terminal device show during video can not normal experience and the slack situation of picture occur, improve terminal and set
The fluency of standby video playing, lifts user experience.
It should be appreciated that except can looked into according to the processor performance parameter and the current network transmission rate
The equipment transmission frame per second is chosen in the frame per second value range found, can also be that the Preset Transfer frame per second of user's sets itself is made
Frame per second is transmitted for equipment or determines different type video flowing by carrying out largely training or the collection of experimental data
Corresponding frame per second value range, can also be and determines the frame per second value range by other means, the present embodiment is to this certainly
It is not any limitation as.
In the concrete realization, can by the frame control assembly before terminal device shows the target video stream,
Determine that the factors such as rendering capability combination current network conditions, the computing capability of display terminal of counterpart terminal equipment calculate
The transmission frame per second of one suitable counterpart terminal equipment.
Further, still propose that video stream merging method the 4th of the present invention is implemented based on first embodiment with reference to Fig. 2
Example, in the present embodiment, after rendering order according to the corresponding target of target video stream generation in the step S30, institute
It is further comprising the steps of to state method：
The performance utilization rate of the current video stream and target frequency stream is calculated, the performance utilization rate is fluent for video
The ratio of the terminal device over-all properties is accounted for the performance of the terminal device；
When the performance utilization rate of the current video stream is more than the performance utilization rate of the target video stream, it is allowed to by institute
State target video stream and the target renders order and sends to the terminal device.
Set it is understood that the performance utilization rate accounts for the terminal for video flowing using the performance of the terminal device
The ratio of standby over-all properties, the performance utilization rate can be CPU usage, network bandwidth occupancy and memory usage,
Can render utilization rate and file I/O utilization rate, can also be that other can show that video flowing is set using the terminal certainly
Standby performance accounts for the other specification of the ratio of the terminal device over-all properties, and the present embodiment is not any limitation as this.
It should be noted that the performance for being more than the target video stream when the performance utilization rate of the current video stream utilizes
During rate, it is allowed to the target video stream and the target are rendered order and sent to the terminal device, that is, is shown described current
The target video stream after the performance of institute's using terminal equipment merges higher than the current video stream before video flowing merges
The performance of institute's using terminal equipment, illustrates the target video stream after merging better than the current video before merging
Stream, after merging operation, is conducive to save the resource of terminal device, video flowing is adapted to various computing capability deficiencies
Terminal device, improves the fluency of video playing, improves user experience indirectly.
In the concrete realization, the performance that the target video stream is more than when the performance utilization rate of the current video stream utilizes
During rate, the video stream management component allows the target video stream and the target renders order and sends to the terminal and sets
It is standby, for example, CPU usage is 70% before the current video stream merges, the mesh after the current video stream merging
It is 50% to mark video flowing CPU usage, that is, shows that the target video stream CPU usage after merging works as forward sight better than before merging
The CPU usage of frequency stream, it is allowed to the target video stream and the target are rendered into order and sent to the terminal device.
Correspondingly, after the step calculates the performance utilization rate of the current video stream and the target video stream, institute
It is further comprising the steps of to state method：
When the performance utilization rate of the current video stream is less than or equal to the performance utilization rate of the target video stream, prohibit
The target video stream and the target only are rendered order to send to the terminal device.
It should be noted that when the performance utilization rate of the current video stream is less than or equal to the property of the target video stream
Can utilization rate when, forbid the target video stream and the target rendering order sending to the terminal device, that is, show institute
The performance of institute's using terminal equipment before current video stream merges is stated less than the target after current video stream merging
The performance of video flowing institute using terminal equipment, illustrate the target video stream after merging be inferior to merge before it is described current
Video flowing, after merging operation, can cause the resource for wasting great amount of terminals equipment.
In the concrete realization, the performance that the target video stream is more than when the performance utilization rate of the current video stream utilizes
During rate, the video stream management component allows the target video stream and the target renders order and sends to the terminal and sets
It is standby, for example, CPU usage is 50% before the current video stream merges, the mesh after the current video stream merging
It is 70% to mark video flowing CPU usage, that is, shows that the target video stream CPU usage after merging is inferior to work as forward sight before merging
The CPU usage of frequency stream, forbids the target video stream and the target rendering order sending to the terminal device.
It should be appreciated that judge that the performance utilization rate of the current video stream is sentenced except through CPU usage
It is disconnected outer, it can also be used as by other specifications such as current network bandwidth occupancies and this is not any limitation as with reference to value, the present embodiment.
The present embodiment is relatively more described to work as by calculating the performance utilization rate of the current video stream and the target video stream
Whether the performance utilization rate of preceding video flowing decides whether to allow by the mesh more than the performance utilization rate of the target video stream
Mark video flowing and the target render order and send to the terminal device, can play the supervision current video stream and merge it
Whether target video stream afterwards is conducive to the effect that terminal device is shown, can effectively prevent that video flowing is than merging after merging
More situations of video flowing occupied terminal device resource before occur, and are conducive to save the resource of terminal device, make video
Stream adapts to the terminal device of various computing capability deficiencies, improves the fluency of video playing indirectly, improves user experience.
In addition, the embodiment of the present invention also proposes a kind of computer-readable recording medium, the computer-readable recording medium
On be stored with video flowing consolidation procedure, following operation is realized when the video flowing consolidation procedure is executed by processor：
Multiple current video streams are obtained, judge whether the current video stream needs while opened up on same terminal device
Show；
When the current video stream needs showing on same terminal device at the same time, the current video stream is closed
And using the video flowing after merging as target video stream；
Corresponding target is generated according to the target video stream and renders order, by the target video stream and the target wash with watercolours
Dye order is sent to the terminal device, so that the terminal device renders order to the target video stream according to the target
Rendered.
Further, following operation is also realized when the video flowing consolidation procedure is executed by processor：
By the current video stream be rendered into it is default render area, by it is described it is default render the video flowing in area and merge,
Using the video flowing after merging as the target video stream.
Further, following operation is also realized when the video flowing consolidation procedure is executed by processor：
The code check of the current video stream is obtained, and receives the configuration parameter that the terminal device is sent；
Created in virtual machine according to the code check of the current video stream and the configuration parameter and virtually render area, by described in
The virtual area that renders renders area as described preset.
Further, following operation is also realized when the video flowing consolidation procedure is executed by processor：
Receive the object transmission frame per second that the terminal device is sent；
The target is generated according to the object transmission frame per second and the target video stream and renders order, the target is regarded
Frequency stream and the target render order and send to the terminal device, so that the terminal device renders order according to the target
The target video stream is rendered.
Further, following operation is also realized when the video flowing consolidation procedure is executed by processor：
Receive the processor performance parameter and current network transmission rate of the terminal device；
The equipment for determining the terminal device according to the processor performance parameter and the current network transmission rate passes
Defeated frame per second, frame per second is transmitted as the object transmission frame per second using the equipment of the terminal device.
Further, following operation is also realized when the video flowing consolidation procedure is executed by processor：
Identify the current video type of the current video stream；
Frame per second value range corresponding with the current video type is searched in default mapping table, described preset is reflected
Penetrating relation table includes the correspondence of video type and frame per second value range；
According to the processor performance parameter and the current network transmission rate in the frame per second value range found
The equipment transmission frame per second of the terminal device is chosen, the equipment of the terminal device is transmitted into frame per second as the object transmission frame
Rate.
Further, following operation is also realized when the video flowing consolidation procedure is executed by processor：
The performance utilization rate of the current video stream and the target video stream is calculated, the performance utilization rate is video flowing
The ratio of the terminal device over-all properties is accounted for using the performance of the terminal device；
When the performance utilization rate of the current video stream is more than the performance utilization rate of the target video stream, it is allowed to by institute
State target video stream and the target renders order and sends to the terminal device.
Further, following operation is also realized when the video flowing consolidation procedure is executed by processor：
When the performance utilization rate of the current video stream is less than or equal to the performance utilization rate of the target video stream, prohibit
The target video stream and the target only are rendered order to send to the terminal device.
The present embodiment is through the above scheme：Multiple current video streams are obtained, judge whether the current video stream needs together
When shown on same terminal device, the current video stream need at the same time shown on same terminal device when, will described in
Current video stream merges, and using the video flowing after merging as target video stream, is generated and corresponded to according to the target video stream
Target render order, the target video stream and the target are rendered order sends to the terminal device, so that described
Terminal device renders order according to the target and the target video stream is rendered, and the present invention passes through the merging to video flowing
Inhibit flow, render order storm, improve the fluency of video flowing transmission speed and picture, improve user experience.
It should be noted that herein, term " comprising ", "comprising" or its any other variant are intended to non-row
His property includes, so that process, method, article or system including a series of elements not only include those key elements, and
And other elements that are not explicitly listed are further included, or further include as this process, method, article or system institute inherently
Key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that including this
Also there are other identical element in the process of key element, method, article or system.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
Through the above description of the embodiments, those skilled in the art can be understood that above-described embodiment side
Method can add the mode of required general hardware platform to realize by software, naturally it is also possible to by hardware, but in many cases
The former is more preferably embodiment.Based on such understanding, technical scheme substantially in other words does the prior art
Going out the part of contribution can be embodied in the form of software product, which is stored in one as described above
In storage medium (such as ROM/RAM, magnetic disc, CD), including some instructions use so that a station terminal equipment (can be mobile phone,
Computer, server, air conditioner, or network equipment etc.) perform method described in each embodiment of the present invention.
It these are only the preferred embodiment of the present invention, be not intended to limit the scope of the invention, it is every to utilize this hair
The equivalent structure or equivalent flow shift that bright specification and accompanying drawing content are made, is directly or indirectly used in other relevant skills
Art field, is included within the scope of the present invention.
Claims (10)
- A kind of 1. video stream merging method, it is characterised in that the described method includes：Multiple current video streams are obtained, judge whether the current video stream needs while shown on same terminal device；When the current video stream needs showing on same terminal device at the same time, the current video stream is merged, Using the video flowing after merging as target video stream；Corresponding target is generated according to the target video stream and renders order, the target video stream and the target are rendered into life Order is sent to the terminal device, and the target video stream is carried out so that the terminal device renders order according to the target Render.
- 2. the method as described in claim 1, it is characterised in that it is described to merge the current video stream, after merging Video flowing as target video stream, specifically include：By the current video stream be rendered into it is default render area, by it is described it is default render the video flowing in area and merge, will close Video flowing after and is as the target video stream.
- 3. method as claimed in claim 2, it is characterised in that it is described by the current video stream be rendered into it is default render area it Before, the method further includes：The code check of the current video stream is obtained, and receives the configuration parameter that the terminal device is sent；Created in virtual machine according to the code check of the current video stream and the configuration parameter and virtually render area, will be described virtual Render area and render area as described preset.
- 4. method as claimed in claim 3, it is characterised in that described that corresponding target wash with watercolours is generated according to the target video stream Dye order, renders order by the target video stream and the target and sends to the terminal device, so that the terminal device Order is rendered according to the target to render the target video stream, is specifically included：Receive the object transmission frame per second that the terminal device is sent；The target is generated according to the object transmission frame per second and the target video stream and renders order by the target video stream Order is rendered with the target to send to the terminal device, so that the terminal device renders order to institute according to the target Target video stream is stated to be rendered.
- 5. method as claimed in claim 4, it is characterised in that the object transmission frame for receiving the terminal device and sending Rate, specifically includes：Receive the processor performance parameter and current network transmission rate of the terminal device；The equipment transmission frame of the terminal device is determined according to the processor performance parameter and the current network transmission rate Rate, frame per second is transmitted as the object transmission frame per second using the equipment of the terminal device.
- 6. method as claimed in claim 5, it is characterised in that described according to the processor performance parameter and the current net Network transmission rate determines the equipment transmission frame per second of the terminal device, and the equipment of the terminal device is transmitted frame per second as described in Object transmission frame per second, specifically includes：Identify the current video type of the current video stream；Frame per second value range corresponding with the current video type is searched in default mapping table, the default mapping is closed It is the correspondence that table includes video type and frame per second value range；Chosen according to the processor performance parameter and the current network transmission rate in the frame per second value range found The equipment transmission frame per second of the terminal device, frame per second is transmitted as the object transmission frame per second using the equipment of the terminal device.
- 7. such as claim 1-6 any one of them methods, it is characterised in that described according to target video stream generation and institute State after the corresponding target of target video stream renders order, the method further includes：The performance utilization rate of the current video stream and the target video stream is calculated, the performance utilization rate utilizes for video flowing The performance of the terminal device accounts for the ratio of the terminal device over-all properties；When the performance utilization rate of the current video stream is more than the performance utilization rate of the target video stream, it is allowed to by the mesh Mark video flowing and the target render order and send to the terminal device.
- 8. the method for claim 7, it is characterised in that the calculating current video stream and the target video stream Performance utilization rate after, the method further includes：When the current video stream performance utilization rate be less than or equal to the target video stream performance utilization rate when, forbid by The target video stream and the target render order and send to the terminal device.
- 9. a kind of video flowing merges server, it is characterised in that the video flowing merges server and includes：Memory, processor And the video flowing consolidation procedure that can be run on the memory and on the processor is stored in, the video flowing consolidation procedure It is arranged for carrying out such as the step of video stream merging method described in any item of the claim 1 to 8.
- 10. a kind of computer-readable recording medium, it is characterised in that be stored with video flowing on the computer-readable recording medium Consolidation procedure, realizes such as video described in any item of the claim 1 to 8 when the video flowing consolidation procedure is executed by processor The step of stream merging method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711055808.XA CN107948731B (en) | 2017-10-31 | 2017-10-31 | Video stream merging method, server and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711055808.XA CN107948731B (en) | 2017-10-31 | 2017-10-31 | Video stream merging method, server and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107948731A true CN107948731A (en) | 2018-04-20 |
| CN107948731B CN107948731B (en) | 2020-07-28 |
Family
ID=61933066
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711055808.XA Active CN107948731B (en) | 2017-10-31 | 2017-10-31 | Video stream merging method, server and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107948731B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110393921A (en) * | 2019-08-08 | 2019-11-01 | 腾讯科技（深圳）有限公司 | Processing method, device, terminal, server and the storage medium of cloud game |
| CN112235626A (en) * | 2020-10-15 | 2021-01-15 | Oppo广东移动通信有限公司 | Video rendering method and device, electronic equipment and storage medium |
| CN112637636A (en) * | 2020-12-23 | 2021-04-09 | 新华三大数据技术有限公司 | Video stream processing method and device |
| CN112672210A (en) * | 2020-12-18 | 2021-04-16 | 杭州叙简科技股份有限公司 | Variable frame rate multi-channel video rendering method and system |
| CN113015000A (en) * | 2019-12-19 | 2021-06-22 | 中兴通讯股份有限公司 | Rendering and displaying method, server, terminal, and computer-readable medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101984661A (en) * | 2010-11-23 | 2011-03-09 | 广东威创视讯科技股份有限公司 | Information transmission method of video conference system and video conference system |
| CN102177693A (en) * | 2008-10-08 | 2011-09-07 | 日本电气株式会社 | Method for establishing a thin client session |
| CN103259833A (en) * | 2011-12-29 | 2013-08-21 | 吉菲斯股份有限公司 | Cloud-based content mixing into one stream |
| CN104270655A (en) * | 2014-10-24 | 2015-01-07 | 四川省科本哈根能源科技有限公司 | Multi-point video converging system |
| CN106488261A (en) * | 2015-08-31 | 2017-03-08 | 中兴通讯股份有限公司 | Resource request method and device |
| US20170091992A1 (en) * | 2015-09-28 | 2017-03-30 | Douglas Rogers | Hierarchical continuous level of detail for three-dimentional meshes |
| US9681154B2 (en) * | 2012-12-06 | 2017-06-13 | Patent Capital Group | System and method for depth-guided filtering in a video conference environment |
-
2017
- 2017-10-31 CN CN201711055808.XA patent/CN107948731B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102177693A (en) * | 2008-10-08 | 2011-09-07 | 日本电气株式会社 | Method for establishing a thin client session |
| CN101984661A (en) * | 2010-11-23 | 2011-03-09 | 广东威创视讯科技股份有限公司 | Information transmission method of video conference system and video conference system |
| CN103259833A (en) * | 2011-12-29 | 2013-08-21 | 吉菲斯股份有限公司 | Cloud-based content mixing into one stream |
| US9681154B2 (en) * | 2012-12-06 | 2017-06-13 | Patent Capital Group | System and method for depth-guided filtering in a video conference environment |
| CN104270655A (en) * | 2014-10-24 | 2015-01-07 | 四川省科本哈根能源科技有限公司 | Multi-point video converging system |
| CN106488261A (en) * | 2015-08-31 | 2017-03-08 | 中兴通讯股份有限公司 | Resource request method and device |
| US20170091992A1 (en) * | 2015-09-28 | 2017-03-30 | Douglas Rogers | Hierarchical continuous level of detail for three-dimentional meshes |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110393921A (en) * | 2019-08-08 | 2019-11-01 | 腾讯科技（深圳）有限公司 | Processing method, device, terminal, server and the storage medium of cloud game |
| CN110393921B (en) * | 2019-08-08 | 2022-08-26 | 腾讯科技（深圳）有限公司 | Cloud game processing method and device, terminal, server and storage medium |
| CN113015000A (en) * | 2019-12-19 | 2021-06-22 | 中兴通讯股份有限公司 | Rendering and displaying method, server, terminal, and computer-readable medium |
| CN112235626A (en) * | 2020-10-15 | 2021-01-15 | Oppo广东移动通信有限公司 | Video rendering method and device, electronic equipment and storage medium |
| CN112235626B (en) * | 2020-10-15 | 2023-06-13 | Oppo广东移动通信有限公司 | Video rendering method and device, electronic equipment and storage medium |
| CN112672210A (en) * | 2020-12-18 | 2021-04-16 | 杭州叙简科技股份有限公司 | Variable frame rate multi-channel video rendering method and system |
| CN112637636A (en) * | 2020-12-23 | 2021-04-09 | 新华三大数据技术有限公司 | Video stream processing method and device |
| CN112637636B (en) * | 2020-12-23 | 2022-02-22 | 新华三大数据技术有限公司 | Video stream processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107948731B (en) | 2020-07-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107948731A (en) | Video stream merging method, server and computer-readable recording medium | |
| Xu et al. | A survey of mobile cloud computing for rich media applications | |
| CN107465936A (en) | A kind of live list mirror image methods of exhibiting, live Platform Server and client | |
| CN107451066A (en) | Interim card treating method and apparatus, storage medium, terminal | |
| Zhang et al. | Rendering multi-party mobile augmented reality from edge | |
| CN112203034B (en) | Frame rate control method and device and electronic equipment | |
| CN106254259B (en) | A kind of method and device of flow control | |
| CN106303111A (en) | Call routing distribution method, Apparatus and system | |
| Hosseini et al. | Energy-budget-compliant adaptive 3D texture streaming in mobile games | |
| US20220239920A1 (en) | Video processing method, related apparatus, storage medium, and program product | |
| Lin et al. | Performance evaluation of remote display access for mobile cloud computing | |
| CN107509113A (en) | Virtual objects display methods, terminal and computer-readable recording medium | |
| CN104954286B (en) | The method and device of bandwidth allocation | |
| WO2021139345A1 (en) | Method and apparatus for displaying network state during call process, and computer device and medium | |
| US20130286227A1 (en) | Data Transfer Reduction During Video Broadcasts | |
| US20240098316A1 (en) | Video encoding method and apparatus, real-time communication method and apparatus, device, and storage medium | |
| CN105578073B (en) | A kind of video monitoring picture display process and device | |
| WO2023231829A1 (en) | Carrier aggregation control method and apparatus, and terminal and network-side device | |
| Wu et al. | Butterfly: Mobile collaborative rendering over GPU workload migration | |
| Wei et al. | FoV privacy-aware VR streaming | |
| Ma et al. | Interactive screen video streaming-based pervasive mobile workstyle | |
| US20230018087A1 (en) | Data coding method and apparatus, and computer-readable storage medium | |
| DE112009004319T5 (en) | Communicate data accesses between a first and a second computer connected via a network | |
| CN115701003A (en) | Antenna switching method and device, storage medium and electronic equipment | |
| Imai et al. | An adaptive desktop transfer protocol for mobile Thin Client |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |