CN110366012A - A kind of playback method and electronic equipment of multi-angle video - Google Patents
A kind of playback method and electronic equipment of multi-angle video Download PDFInfo
- Publication number
- CN110366012A CN110366012A CN201910618987.6A CN201910618987A CN110366012A CN 110366012 A CN110366012 A CN 110366012A CN 201910618987 A CN201910618987 A CN 201910618987A CN 110366012 A CN110366012 A CN 110366012A
- Authority
- CN
- China
- Prior art keywords
- terminal
- video
- video playing
- angle
- terminals
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 230000000007 visual effect Effects 0.000 claims abstract description 96
- 230000006870 function Effects 0.000 claims description 21
- 238000004590 computer program Methods 0.000 claims description 6
- 238000004422 calculation algorithm Methods 0.000 claims description 3
- 230000001052 transient effect Effects 0.000 claims description 3
- 238000004891 communication Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000006116 polymerization reaction Methods 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
- H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/482—End-user interface for program selection
- H04N21/4825—End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The embodiment of the present invention provides the playback method and electronic equipment of a kind of multi-angle video, and wherein method includes: at least one second terminal obtained with multi-angle of view collaboration playing function in preset range;The end message of all terminals is obtained, wherein all terminals include first terminal and at least one second terminal;According to the end message of all terminals, video playing information list is obtained;It wherein include the corresponding relationship between terminal iidentification and video playing visual angle in the video playing information list;According to the video playing information list, the video playing that each terminal carries out corresponding video playing visual angle is controlled.The embodiment of the present invention is realized to be played by the collaboration that multiple terminals carries out multi-angle video.
Description
Technical field
The present invention relates to field of communication technology more particularly to the playback methods and electronic equipment of a kind of multi-angle video.
Background technique
With popularizing for broadband network, video becomes one of the main contents in internet.At present in addition to mentioning in internet
It is serviced for video on demand, downloading etc., also while providing net cast service, the content of live streaming covers TV programme or scene is living
It is dynamic.And user often wants to the live video for watching different perspectives simultaneously when watching live video, to deepen to live content
Understanding.
For the demand of user, the mode of picture-in-picture is generallyd use at present to realize the video playing of different perspectives.
Wherein, when carrying out the video playing of different perspectives by picture-in-picture mode, show that the big window in equipment plays visual angle all the way
Video, wicket play another way visual angle video, at this time user can by simultaneously watch display equipment in big window
And wicket, realize the viewing to different perspectives video in live video.
But although the mode of above-mentioned picture-in-picture can be realized the video playing to different perspectives, but can only be same aobvious
Show in equipment while playing the broadcasting of the different perspectives video on less road, and needs to watch the different perspectives view of more multichannel in user
When frequency, aforesaid way cannot then be met the needs of users well, and multiple terminals collaboration is needed to play multichannel different perspectives at this time
Video, with meet user to and meanwhile viewing compared with multi-channel video the needs of.
Summary of the invention
The embodiment of the present invention provides the playback method and electronic equipment of a kind of multi-angle video, to realize multiple terminal collaborations
Show the video of different perspectives in same live streaming.
To achieve the above object, the embodiment of the present invention provides a kind of playback method of multi-angle video, is applied to first eventually
End, the playback method include:
Obtain at least one second terminal with multi-angle of view collaboration playing function in preset range;
The end message of all terminals is obtained, wherein all terminals include first terminal and at least one second end
End;
According to the end message of all terminals, video playing information list is obtained;The wherein video playing information list
In include corresponding relationship between terminal iidentification and video playing visual angle;
According to the video playing information list, the video playing that each terminal carries out corresponding video playing visual angle is controlled.
Optionally, described at least one second terminal obtained with multi-angle of view collaboration playing function in preset range, packet
It includes:
When first terminal receives user for the clicking operation of preset function key on terminal player, pass through UPnP
Agreement obtains at least one described second terminal.
Optionally, the end message for obtaining all terminals, comprising:
First terminal obtains the end message of itself;
Connection is established respectively with each second terminal, and obtains the end message of each second terminal;Wherein,
The end message includes at least: terminal iidentification, screen size, screen resolution, terminal computing capability and broadcasting
Device decoding capability.
Optionally, the end message according to all terminals obtains video playing information list, comprising:
According to the screen size and player decoding capability in the end message, determine that main view frequency is broadcast from all terminals
Put main playback terminal corresponding to visual angle;
Video playing visual angle all the way is randomly assigned to each residual terminal in addition to the main playback terminal;
It records the corresponding relationship between the terminal iidentification of the main playback terminal and main video playing visual angle and each remains
Corresponding relationship between the terminal iidentification of remaining terminal and the video playing visual angle of corresponding distribution obtains the video playing information column
Table.
Optionally, further include in the video playing information list between terminal iidentification and video playing code rate it is corresponding pass
System;
The end message according to all terminals obtains video playing information list, further includes:
Main broadcaster needed for obtaining the main video playing visual angle puts code rate, and the main broadcaster is put code rate and is determined as the master
Video playing code rate corresponding to playback terminal;
Code rate is put according to the network bandwidth of network and the main broadcaster where all terminals, the total surplus of network bandwidth is calculated
Yu Keyong code rate;
According to the screen resolution and player decoding capability in the end message, each residual terminal institute is determined
Corresponding video playing code rate;Wherein, video playing code rate corresponding to each residual terminal is total less than described with value
Residue can use code rate;
The terminal iidentification and main broadcaster for recording the main playback terminal put corresponding relationship and each remaining end between code rate
Corresponding relationship between the terminal iidentification at end and corresponding video playing code rate obtains the video playing information list.
Optionally, the screen size and player decoding capability according in the end message, from all terminals
Determine main playback terminal corresponding to main video playing visual angle, comprising:
According to the screen size and player decoding capability in the end message, by following formula, it is calculated every
Video playing fractional value corresponding to a terminal, and terminal corresponding to maximum video playing fractional value is determined as the main broadcaster
Put terminal;Wherein,
P=V1×W1+V2×W2+V3;
P indicates the terminal iidentification of the main playback terminal, V1Indicate score value corresponding to the screen size of terminal, W1It indicates
Default weighted value, V corresponding to screen size2Indicate score value corresponding to player decoding capability, W2Indicate that player decodes energy
Default weighted value, V corresponding to power3It is expressed as the pre-assigned score value of each terminal.
Optionally, described according to the video playing information list, it controls each terminal and carries out corresponding video playing visual angle
Video playing before, the playback method further include:
According to the end message of all terminals, a view for being used to carry out multichannel multi-view video distribution is selected from all terminals
Frequency division sends out terminal;
It is described according to the video playing information list, control each terminal and carry out the video at corresponding video playing visual angle and broadcast
It puts, comprising:
By the video distribution terminal, the video playing that each terminal carries out corresponding video playing visual angle is controlled.
Optionally, the end message according to all terminals selects one to be used to carry out multichannel visual angle from all terminals
The video distribution terminal of video distribution, comprising:
It is according to the terminal computing capability in the end message, the strongest terminal of terminal computing capability in all terminals is true
It is set to the video distribution terminal.
Optionally, described by the video distribution terminal, control the view that each terminal carries out corresponding video playing visual angle
Frequency plays, comprising:
When the first terminal is the video distribution terminal, the first terminal is directly believed according to the video playing
List is ceased, to from the aggregate video stream that server is got, branch corresponding with the video playing visual angle of first terminal is regarded
Frequency stream plays out, and the branch video flowing for each second terminal video playing visual angle being corresponded to from the aggregate video stream,
Correspondence is sent to each second terminal, so that each second terminal plays out the branch video flowing received;
When the first terminal is not the video distribution terminal, first terminal sends out the video playing information list
It send to the video distribution terminal, so that the video distribution terminal is to from the aggregate video stream that server is got, with institute
The corresponding branch video flowing in video playing visual angle for stating video distribution terminal plays out, and will be right in the aggregate video stream
The branch video flowing at third terminal video playing visual angle is answered, correspondence is sent to each third terminal, so that each third is whole
End plays out the branch video flowing received;Wherein, the third terminal is in all terminals except the video distribution is whole
Terminal except end.
Optionally, it controls each terminal according to the video playing information list described and carries out corresponding video playing view
After the video playing at angle, the playback method further include:
When the first terminal exits video playing, send a notification message at least one described second terminal, so that
At least one described second terminal can be according to the notification message, using Gossip algorithm, from least one described second end
Select a second terminal as first terminal in end.
Optionally, after the end message for obtaining all terminals, the playback method further include:
Video collaboration play session table is established, and is shown;
By Gossip agreement, video collaboration play session table is shared to each second terminal, so that each the
Video described in two terminal simultaneous displays cooperates with play session table;It wherein, include described in the video collaboration play session table
End message.
It optionally, further include the play time at main video playing visual angle in the video collaboration play session table, so that institute
Other terminals in all terminals in addition to the terminal for playing the main video playing visual angle are stated, can be broadcast according to the main view frequency
The play time at visual angle is put, the audio video synchronization for carrying out corresponding video playing visual angle plays.
The embodiment of the present invention provides a kind of electronic equipment, including memory, processor and storage are on a memory and can be
The computer program run on processor, the processor realize the broadcasting side of the multi-angle video when executing described program
The step of method.
The embodiment of the present invention provides a kind of non-transient computer readable storage medium, is stored thereon with computer program, should
The step of playback method of the multi-angle video is realized when computer program is executed by processor.
The playback method and electronic equipment of multi-angle video provided in an embodiment of the present invention, first terminal obtain preset range
For it is interior with multi-angle of view cooperate with playing function at least one second terminal, and obtain include first terminal and at least one second
The end message of all terminals of terminal, then according to the end message of all terminals, obtaining includes that terminal iidentification and video are broadcast
The video playing information list of the corresponding relationship between visual angle is put, finally according to video playing information list, controls each terminal
The video playing for carrying out corresponding video playing visual angle is realized by the way that equally as the first terminal of playback terminal, control is all
Each terminal plays correspond to the video at visual angle in terminal, are regarded by multiple terminals to visual angles multiple in same video to realize
The collaboration of frequency plays, and while ensure that the convenience that multi-angle video collaboration in multiple terminals plays, meets user to simultaneously
Watch the demand of the video compared with multichannel.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair
Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the step flow chart of the playback method of multi-angle video in the embodiment of the present invention;
Fig. 2 is the end message in the embodiment of the present invention according to all terminals, obtains the process of video playing information list
Schematic diagram;
Fig. 3 is the structural schematic diagram of electronic equipment in the embodiment of the present invention.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention
In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is
A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art
Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
As shown in Figure 1, for the step flow chart of the playback method of multi-angle video in the embodiment of the present invention, this method includes
Following steps:
Step 101: obtaining at least one second terminal with multi-angle of view collaboration playing function in preset range.
In this step, specifically, first terminal can be obtained first default when the collaboration for organizing multi-angle video plays
At least one second terminal with multi-angle of view collaboration playing function in range enables to total at least one second terminal
It is played with the collaboration for carrying out multi-angle video.
In addition, specifically, preset range can be when first terminal obtains at least one second terminal in preset range
In default geographic range, such as obtain the second terminal within the scope of 3 meters of first terminal;In addition, preset range can be with
Refer within the scope of same local area network, such as obtains and be in the second terminal in same local area network simultaneously with first terminal.In this way, passing through
The second terminal obtained in preset range is limited, facilitates first terminal to the acquisition of second terminal and first terminal and second
Collaborative work between terminal.
In addition, specifically, obtaining at least one second terminal with multi-angle of view collaboration playing function in preset range
When, it can be when first terminal receives user for the clicking operation of preset function key on terminal player, described in acquisition
At least one second terminal.
Specifically, the preset function key can cooperate with playing function key for multi-angle of view, i.e. first terminal has more views
Angle cooperates with playing function;In addition, by increasing the preset function key on terminal player, so that when first terminal receives
User is for when the clicking operation of preset function key, first terminal can be positioned according to the clicking operation on terminal player
At least one second terminal in preset range equally with multi-angle of view collaboration playing function, so that first terminal energy
It is enough independently to choose whether to need to cooperate with broadcasting with multiple second terminals progress video.
Certainly, it should be noted that first terminal can pass through local area network lookup, UPnP protocol technology, shifting first
All second terminals in the technological orientations to preset range such as the terminal positioning of dynamic net or terminal sensing device, then carry out letter again
Breath interaction is linked up, such as finds method by D2D richness message, specifies whether second terminal is mounted with to play with multi-angle of view collaboration
The video player of function, to obtain at least one second terminal with multi-angle of view collaboration playing function.
Step 102: obtaining the end message of all terminals.
Specifically, all terminals include first terminal and at least one second terminal.
In this step, first terminal obtains the end message of all terminals, in order to be able to according to the end of all terminals
Client information obtains video playing information list, carries out the broadcasting of collaboration video.
Wherein, end message includes at least: terminal iidentification, screen size, screen resolution, terminal computing capability and broadcasting
Device decoding capability.Specifically, those end messages are related to the ability of terminal plays video, enable first terminal according to
Accessed end message is determined the video playing visual angle of each terminal.
In addition, first terminal can first obtain the end message of itself, then when obtaining the end message of all terminals
Connection is established respectively with each second terminal, and obtains the end message of each second terminal.
Specifically, can be sent to each second terminal more when first terminal and each second terminal establish connection respectively
The message request that visual angle collaboration plays, then receives each second terminal according to the invitation that message request is fed back and receives information, and
Receive information according to invitation, establish point-to-point connection with each second terminal, to obtain each second terminal according to the connection
End message.
Certainly, it should be noted that can use when first terminal and each second terminal establish point-to-point connection
UPnP technology establishes connection;In addition, second terminal feedback invite receive information when, can by with first terminal contact induction
Mode fed back, can also send invite receive information by way of be fed back, herein not to the mode of feedback
It is defined.
Step 103: according to the end message of all terminals, obtaining video playing information list.
In this step, specifically, including between terminal iidentification and video playing visual angle in video playing information list
Corresponding relationship.
In this way, being made it possible to by obtaining above-mentioned video playing information list according to terminal in video playing information list
Corresponding relationship between mark and video playing visual angle, determines video playing visual angle corresponding to each terminal, thus for mostly eventually
End collaboration plays the video that different video plays visual angle, provides convenience.
Step 104: according to video playing information list, controlling each terminal and carry out the video at corresponding video playing visual angle and broadcast
It puts.
It in this step, can be directly according to the video playing specifically, after getting video playing information list
Corresponding relationship in information list between terminal iidentification and video playing visual angle controls each terminal and carries out corresponding video playing view
The video playing at angle is being protected to realize the control that first terminal directly plays the multi-angle video collaboration multiple terminals
Demonstrate,proved multiple terminals multi-angle video collaboration play control convenience while, meet user to simultaneously watch compared with multichannel view
The demand of frequency.
In this way, first terminal passes through the end message for obtaining all terminals in the present embodiment, and according to the end of all terminals
Client information obtains video playing information list, finally according to video playing information list, controls each terminal and carries out corresponding video
The video playing for playing visual angle realizes first terminal directly to the control that multi-angle video collaboration plays multiple terminals, is protecting
While having demonstrate,proved the convenience that multi-angle video collaboration in multiple terminals plays, user is met to the video watched simultaneously compared with multichannel
Demand.
Further, the present embodiment can establish video collaboration and play meeting after the end message for obtaining all terminals
Table is talked about, and is shown;Then by Gossip agreement, video collaboration play session table is shared to each second eventually
End, so that video described in each second terminal simultaneous display cooperates with play session table;Wherein, the video cooperates with play session table
In include the end message.Play session is cooperateed with by establishing and having synchronized in all terminals identical video in this way
Table improves the concertation between terminal so that each terminal can get the end message of all terminals.
It certainly, can also include the play time at main video playing visual angle in video collaboration play session table, so that described
Other terminals in all terminals in addition to the terminal for playing the main video playing visual angle, can be according to the main video playing
The play time at visual angle, the audio video synchronization for carrying out corresponding video playing visual angle play.In this way, by cooperateing with play session in video
It include the play time at main video playing visual angle in table, so that all terminals can be according to the broadcasting at the main video playing visual angle
Time carries out the time synchronization of multi-angle video broadcasting, and then when further ensuring the corresponding multi-view video of each terminal plays
Synchronism, improve the viewing experience of user.
In addition, further, as shown in Fig. 2, obtaining video according to the end message of all terminals in step 103 and broadcasting
When putting information list, it may include steps of:
Step 201: according to the screen size and player decoding capability in end message, main view is determined from all terminals
Frequency plays main playback terminal corresponding to visual angle.
It in this step, can be according to the screen in end message specifically, after the end message for obtaining all terminals
Curtain size and player decoding capability determine main playback terminal corresponding to main video playing visual angle from all terminals.
In this way, first determining main video playing view by according to the screen size and player decoding capability in end message
Main playback terminal corresponding to angle, so that preferentially ensure that the result of broadcast of main perspective video, to improve user to video
Viewing experience.
In addition, specifically, according to the screen size and player decoding capability in end message, from all terminals really
It, can be according to the screen size and player decoding in end message when main playback terminal corresponding to fixed main video playing visual angle
Video playing fractional value corresponding to each terminal is calculated by following formula in ability, and by maximum video playing score
The corresponding terminal of value is determined as the main playback terminal;Wherein,
P=V1×W1+V2×W2+V3;
P indicates the terminal iidentification of the main playback terminal, V1Indicate score value corresponding to the screen size of terminal, W1It indicates
Default weighted value, V corresponding to screen size2Indicate score value corresponding to player decoding capability, W2Indicate that player decodes energy
Default weighted value, V corresponding to power3It is expressed as the pre-assigned score value of each terminal.
Specifically, having corresponding relationship between the default screen size and default score value of terminal, terminal is being got in this way
Screen size after, score value corresponding to the screen size of terminal can be got according to above-mentioned corresponding relationship;Likewise,
Equally there is corresponding relationship, and after getting player decoding capability between player decryption capabilities and default score value, energy
Score value corresponding to player decoding capability enough is got to relationship according to above-mentioned.
In addition, terminal corresponding to maximum video playing fractional value is determined as main playback terminal by above-mentioned, based on view
It is to be obtained according to the screen size and player decoding capability of terminal that frequency, which plays fractional value, when video playing fractional value is higher, is said
The integration capability of bright screen size and broadcast decoder ability is higher, and the performances such as clarity when terminal plays video are higher at this time,
Performance highest when the corresponding main broadcaster of i.e. maximum video playing fractional value puts terminal plays video, to ensure that by maximum video
When terminal corresponding to broadcasting fractional value is determined as main playback terminal, main perspective plays the result of broadcast of video, improves user
Viewing experience.
Step 202: video playing visual angle all the way is randomly assigned to each residual terminal in addition to main playback terminal.
In this step, specifically, after determining main playback terminal, can in all terminals remove main playback terminal it
Outer each residual terminal, is randomly assigned video playing visual angle all the way.
Since in addition to main video playing visual angle, the significance level at other video playing visual angles is almost the same in video, this
When allowing first terminal to be at random that each residual terminal distributes video playing visual angle all the way, the perception of user will not influence
Experience.
Step 203: recording corresponding relationship between the terminal iidentification of main playback terminal and main video playing visual angle and every
Corresponding relationship between the terminal iidentification of a residual terminal and the video playing visual angle of corresponding distribution obtains video playing information column
Table.
It in this step, specifically, can be directly by the terminal iidentification of identified main playback terminal and main video playing
Pair between the terminal iidentification of corresponding relationship and each residual terminal between visual angle and the video playing visual angle of corresponding distribution
It should be related to, be determined as video playing information list.
In this way, enabling first terminal to be believed according to above-mentioned video playing by obtaining above-mentioned video playing information list
List is ceased, is the corresponding video playing visual angle of each terminal distribution, so that the collaboration of multiple terminals multi-angle of view can be controlled
Video playing.
In addition, herein it should also be noted that, can also include that terminal iidentification is broadcast with video in video playing information list
Put the corresponding relationship between code rate.
At this point, when obtaining video playing information list, can first obtain the master in the end message according to all terminals
Main broadcaster needed for video playing visual angle puts code rate, and the main broadcaster is put code rate and is determined as view corresponding to the main playback terminal
Frequency plays code rate;Then code rate is put according to the network bandwidth of network and the main broadcaster where all terminals, Netowrk tape is calculated
Wide total surplus can use code rate;Finally according to the screen resolution and player decoding capability in the end message, institute is determined
State video playing code rate corresponding to each residual terminal;Wherein, video playing code rate corresponding to each residual terminal
And value can use code rate less than the total surplus;And record the terminal iidentification of the main playback terminal and main broadcaster is put between code rate
Corresponding relationship between the terminal iidentification of corresponding relationship and each residual terminal and corresponding video playing code rate, obtains the view
Frequency broadcast information list.
Specifically, current embodiment require that video playing code rate corresponding to main playback terminal is first determined, to guarantee main view
Frequency plays the result of broadcast at visual angle.In addition, specifically, the total surplus of network bandwidth can be that network bandwidth and main broadcaster put code with code rate
Difference between rate.In addition, specifically, being determined each remaining whole according to the screen resolution of terminal and player decoding capability
When video playing code rate corresponding to end, the resolution ratio that can be suitble to first for the selection of each residual terminal, then according to screen
Refresh rate and player decoding capability, select suitable frame per second, last synthetic resolution and frame per second, obtain video playing code
Rate, need to guarantee video playing code rate corresponding to each residual terminal certainly can use code rate less than total surplus with value.
Certainly, it should be noted that if being greater than with value for video playing code rate corresponding to each residual terminal is total
Residue can use code rate, then can be according in residual terminal, and the size of video playing code rate puts in order, successively to video playing code
Rate reduces level-one, until video playing code rate corresponding to each residual terminal can use code rate less than total surplus with value.
It should also be noted that, then needing to redefine corresponding to each residual terminal when network bandwidth changes
Video playing code rate, to guarantee that video playing code rate is always video playing code rate the most suitable.
In this way, by the way that the corresponding relationship between terminal iidentification and video playing code rate is added to video playing information list
In, enable each terminal to play corresponding multi-view video according to determining video playing code rate, ensure that every road visual angle view
Effect when frequency plays.
In addition, further, in first terminal according to the video playing information list, controlling each terminal and being corresponded to
Before the video playing at video playing visual angle, the playback method can also include the following steps:
Step A: according to the end message of all terminals, one is selected to divide from all terminals for carrying out multichannel multi-view video
The video distribution terminal of hair.
At this point, first terminal controls each terminal and carries out corresponding video playing view according to the video playing information list
It, then can be according to step B when the video playing at angle: by the video distribution terminal, controlling each terminal and carry out corresponding video
Play the video playing at visual angle.
In this way, by selecting a video distribution terminal for being used to carry out multichannel multi-view video distribution from all terminals, so
The video playing for carrying out corresponding video playing visual angle by each terminal of video distribution terminal control afterwards, makes it possible to pass through guarantee
The video distribution ability of video distribution terminal, guarantees effect when each terminal plays correspond to multi-view video.
Specifically, in step, it can be according to the terminal computing capability in the end message, it will be whole in all terminals
The end strongest terminal of computing capability is determined as the video distribution terminal.This makes video distribution terminal be terminal in all terminals
The strongest terminal of computing capability, so that stream of the video distribution terminal when distributing every road video, when can guarantee distributed
Smooth property and stability.
In addition, specifically, controlling each terminal by video distribution terminal in stepb and carrying out corresponding video playing view
When the video playing at angle, the following two kinds situation can be divided into:
First, the first terminal is directly according to the video when the first terminal is the video distribution terminal
Broadcast information list, it is corresponding with the video playing visual angle of first terminal to from the aggregate video stream that server is got
Branch video flowing plays out, and the branch that each second terminal video playing visual angle is corresponded to from the aggregate video stream is regarded
Frequency flows, and correspondence is sent to each second terminal, so that each second terminal plays out the branch video flowing received.
Specifically, when first terminal is video distribution terminal, first terminal can direct basis in this kind of situation
Acquired video playing information list plays the video flowing at itself corresponding visual angle, then will be opposite with each second terminal
The branch video flowing at the video playing visual angle answered, correspondence are distributed to each second terminal, so that first terminal and each the
Two terminals can play out the branch video flowing being distributed to, and then realize the collaboration of the multi-angle video between multiple terminals
It plays.
Second, when the first terminal is not the video distribution terminal, first terminal is by the video playing information
List is sent to the video distribution terminal, so that the video distribution terminal is to the aggregate video stream got from server
In, branch video flowing corresponding with the video playing visual angle of the video distribution terminal plays out, and the polymerization is regarded
The branch video flowing at third terminal video playing visual angle is corresponded in frequency stream, correspondence is sent to each third terminal, so that described every
A third terminal plays out the branch video flowing received;Wherein, the third terminal is that the view is removed in all terminals
Frequency division sends out the terminal except terminal.
Specifically, when first terminal is not video distribution terminal, then first terminal is needed video in this kind of situation
Broadcast information list is sent to video distribution terminal so that video distribution terminal can according to video playing information list,
Play the video flowing at itself corresponding video playing visual angle, and by video playing visual angle corresponding to terminal each in addition to itself
Video flowing, correspondence is sent to each terminal, so that each terminal can play out the branch video flowing being distributed to,
And then realize that the collaboration of the multi-angle video between multiple terminals plays.
In this way, by above-mentioned determining video distribution terminal, by video distribution terminal to the road aggregate video Liu Zhongmei video flowing
It is distributed, is the strongest terminal of terminal computing capability in all terminals based on video distribution terminal, so that video distribution
Terminal is when distributing every road video, fluency and stability when can guarantee distributed.
In addition, it should be noted that when video distribution terminal exits video playing, first terminal can root again
According to the end message of all terminals, a video distribution terminal for being used to carry out multichannel multi-view video distribution is selected from all terminals
The step of, to guarantee to there is new video distribution terminal to generate, the distribution of video flowing is carried out, to guarantee the distribution of video flowing
It is able to maintain that, and other terminal unawares, and then guarantees stability when multi-channel video collaboration plays.
In addition, it should also be noted that, controlling each terminal according to the video playing information list and carrying out corresponding view
After frequency plays the video playing at visual angle, when first terminal exits video playing, sent at least one described second terminal
Notification message so that at least one described second terminal can according to the notification message, using Gossip algorithm, from it is described to
Select a second terminal as first terminal in a few second terminal.This makes it possible to other terminal unawares the case where
Under, guarantee that multi-angle video cooperates in the terminal played, there can be the first terminal in control position always, to ensure that
The stability that multi-angle video collaboration plays.
In this way, the playback method of multi-angle video provided in this embodiment, realizes by equally as playback terminal
First terminal controls each terminal plays in all terminals and corresponds to the video at visual angle, is carried out together to realize by multiple terminals
The collaboration of multiple multi-view videos plays in one video, ensure that the same of the convenience of multiple terminals multi-angle video collaboration broadcasting
When, meet user to and meanwhile viewing compared with multichannel video demand.
In addition, as shown in figure 3, being the entity structure schematic diagram of electronic equipment provided in an embodiment of the present invention, which sets
Standby may include: processor (processor) 310,320, memory communication interface (Communications Interface)
(memory) 330 and communication bus 340, wherein processor 310, communication interface 320, memory 330 pass through communication bus 340
Complete mutual communication.Processor 310 can call the meter that is stored on memory 330 and can run on processor 310
Calculation machine program, the method to execute the various embodiments described above offer, for example, obtaining in preset range, there is multi-angle of view collaboration to broadcast
At least one second terminal of playing function;The end message of all terminals is obtained, wherein all terminals include first terminal
With at least one second terminal;According to the end message of all terminals, video playing information list is obtained;Wherein the video is broadcast
It puts in information list including the corresponding relationship between terminal iidentification and video playing visual angle;It is arranged according to the video playing information
Table controls the video playing that each terminal carries out corresponding video playing visual angle.
In addition, the logical order in above-mentioned memory 330 can be realized by way of SFU software functional unit and conduct
Independent product when selling or using, can store in a computer readable storage medium.Based on this understanding, originally
Substantially the part of the part that contributes to existing technology or the technical solution can be in other words for the technical solution of invention
The form of software product embodies, which is stored in a storage medium, including some instructions to
So that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation of the present invention
The all or part of the steps of example the method.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (ROM,
Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. it is various
It can store the medium of program code.
The embodiment of the present invention also provides a kind of non-transient computer readable storage medium, is stored thereon with computer program,
The computer program is implemented to carry out the various embodiments described above offer method when being executed by processor, for example, obtain default
At least one second terminal with multi-angle of view collaboration playing function in range;The end message of all terminals is obtained, wherein institute
Stating all terminals includes first terminal and at least one second terminal;According to the end message of all terminals, video playing is obtained
Information list;It wherein include the corresponding relationship between terminal iidentification and video playing visual angle in the video playing information list;
According to the video playing information list, the video playing that each terminal carries out corresponding video playing visual angle is controlled.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member
It is physically separated with being or may not be, component shown as a unit may or may not be physics list
Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs
In some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness
Labour in the case where, it can understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on
Stating technical solution, substantially the part that contributes to existing technology can be embodied in the form of software products in other words, should
Computer software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including several fingers
It enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation
Method described in certain parts of example or embodiment.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although
Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used
To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features;
And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and
Range.
Claims (14)
1. a kind of playback method of multi-angle video, it is applied to first terminal, which is characterized in that the playback method includes:
Obtain at least one second terminal with multi-angle of view collaboration playing function in preset range;
The end message of all terminals is obtained, wherein all terminals include first terminal and at least one second terminal;
According to the end message of all terminals, video playing information list is obtained;Wherein wrapped in the video playing information list
Include the corresponding relationship between terminal iidentification and video playing visual angle;
According to the video playing information list, the video playing that each terminal carries out corresponding video playing visual angle is controlled.
2. the playback method of multi-angle video according to claim 1, which is characterized in that tool in the acquisition preset range
There is at least one second terminal of multi-angle of view collaboration playing function, comprising:
When first terminal receives user for the clicking operation of preset function key on terminal player, acquisition is described at least
One second terminal.
3. the playback method of multi-angle video according to claim 1, which is characterized in that the end for obtaining all terminals
Client information, comprising:
First terminal obtains the end message of itself;
Connection is established respectively with each second terminal, and obtains the end message of each second terminal;Wherein,
The end message includes at least: terminal iidentification, screen size, screen resolution, terminal computing capability and player solution
Code ability.
4. the playback method of multi-angle video according to claim 1, which is characterized in that the end according to all terminals
Client information obtains video playing information list, comprising:
According to the screen size and player decoding capability in the end message, main video playing view is determined from all terminals
Main playback terminal corresponding to angle;
Video playing visual angle all the way is randomly assigned to each residual terminal in addition to the main playback terminal;
Record the corresponding relationship between the terminal iidentification of the main playback terminal and main video playing visual angle and each remaining end
Corresponding relationship between the terminal iidentification at end and the video playing visual angle of corresponding distribution obtains the video playing information list.
5. the playback method of multi-angle video according to claim 4, which is characterized in that the video playing information list
In further include corresponding relationship between terminal iidentification and video playing code rate;
The end message according to all terminals obtains video playing information list, further includes:
Main broadcaster needed for obtaining the main video playing visual angle puts code rate, and the main broadcaster put code rate is determined as the main broadcaster and put
Video playing code rate corresponding to terminal;
Code rate is put according to the network bandwidth of network and the main broadcaster where all terminals, the total surplus that network bandwidth is calculated can
Use code rate;
According to the screen resolution and player decoding capability in the end message, determine corresponding to each residual terminal
Video playing code rate;Wherein, video playing code rate corresponding to each residual terminal and value be less than the total surplus
Code rate can be used;
The terminal iidentification and main broadcaster for recording the main playback terminal put corresponding relationship between code rate and each residual terminal
Corresponding relationship between terminal iidentification and corresponding video playing code rate obtains the video playing information list.
6. the playback method of multi-angle video according to claim 4, which is characterized in that described according to the end message
In screen size and player decoding capability, determine that main broadcaster corresponding to main video playing visual angle puts end from all terminals
End, comprising:
Each end is calculated by following formula according to the screen size and player decoding capability in the end message
The corresponding video playing fractional value in end, and terminal corresponding to maximum video playing fractional value is determined as the main broadcaster and puts end
End;Wherein,
P=V1×W1+V2×W2+V3;
P indicates the terminal iidentification of the main playback terminal, V1Indicate score value corresponding to the screen size of terminal, W1Indicate screen
Default weighted value, V corresponding to size2Indicate score value corresponding to player decoding capability, W2Indicate player decoding capability institute
Corresponding default weighted value, V3It is expressed as the pre-assigned score value of each terminal.
7. the playback method of multi-angle video according to claim 1, which is characterized in that described according to the video playing
Information list, before controlling the video playing that each terminal carries out corresponding video playing visual angle, the playback method further include:
According to the end message of all terminals, one is selected to divide from all terminals for carrying out the video of multichannel multi-view video distribution
Send out terminal;
It is described that the video playing that each terminal carries out corresponding video playing visual angle is controlled according to the video playing information list,
Include:
By the video distribution terminal, the video playing that each terminal carries out corresponding video playing visual angle is controlled.
8. the playback method of multi-angle video according to claim 7, which is characterized in that the end according to all terminals
Client information selects a video distribution terminal for being used to carry out multichannel multi-view video distribution from all terminals, comprising:
According to the terminal computing capability in the end message, the strongest terminal of terminal computing capability in all terminals is determined as
The video distribution terminal.
9. the playback method of multi-angle video according to claim 7, which is characterized in that described to pass through the video distribution
Terminal controls the video playing that each terminal carries out corresponding video playing visual angle, comprising:
When the first terminal is the video distribution terminal, the first terminal is directly arranged according to the video playing information
Table, to from the aggregate video stream that server is got, branch video flowing corresponding with the video playing visual angle of first terminal
The branch video flowing for playing out, and each second terminal video playing visual angle being corresponded to from the aggregate video stream, it is corresponding
It is sent to each second terminal, so that each second terminal plays out the branch video flowing received;
When the first terminal is not the video distribution terminal, the video playing information list is sent to by first terminal
The video distribution terminal, so that the video distribution terminal is to from the aggregate video stream that server is got, with the view
The corresponding branch video flowing in video playing visual angle of frequency division hair terminal plays out, and will be corresponding the in the aggregate video stream
Three terminal videos play the branch video flowing at visual angle, and correspondence is sent to each third terminal, so that each third terminal pair
The branch video flowing received plays out;Wherein, the third terminal be all terminals in except the video distribution terminal it
Outer terminal.
10. the playback method of multi-angle video according to claim 1, which is characterized in that described according to the video
Broadcast information list, after controlling the video playing that each terminal carries out corresponding video playing visual angle, the playback method is also wrapped
It includes:
When the first terminal exits video playing, send a notification message at least one described second terminal, so that described
At least one second terminal can be according to the notification message, using Gossip algorithm, from least one described second terminal
Select a second terminal as first terminal.
11. the playback method of multi-angle video according to claim 1, which is characterized in that obtain all terminals described
End message after, the playback method further include:
Video collaboration play session table is established, and is shown;
By Gossip agreement, video collaboration play session table is shared to each second terminal, so that each second is whole
Video described in simultaneous display is held to cooperate with play session table;It wherein, include the terminal in the video collaboration play session table
Information.
12. the playback method of multi-angle video according to claim 11, which is characterized in that the video collaboration plays meeting
It further include the play time at main video playing visual angle in words table, so that except the broadcasting main video playing view in all terminals
Other terminals except the terminal at angle can carry out corresponding video playing according to the play time at the main video playing visual angle
The audio video synchronization at visual angle plays.
13. a kind of electronic equipment including memory, processor and stores the journey that can be run on a memory and on a processor
Sequence, which is characterized in that the processor is realized when executing described program such as the described in any item multi-angle of view views of claim 1 to 12
The step of playback method of frequency.
14. a kind of non-transient computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer
The step of playback method such as the described in any item multi-angle videos of claim 1 to 12 is realized when program is executed by processor.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910618987.6A CN110366012B (en) | 2019-07-10 | 2019-07-10 | Multi-view video playing method and electronic equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910618987.6A CN110366012B (en) | 2019-07-10 | 2019-07-10 | Multi-view video playing method and electronic equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110366012A true CN110366012A (en) | 2019-10-22 |
CN110366012B CN110366012B (en) | 2021-12-03 |
Family
ID=68218478
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910618987.6A Active CN110366012B (en) | 2019-07-10 | 2019-07-10 | Multi-view video playing method and electronic equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110366012B (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113194277A (en) * | 2021-03-12 | 2021-07-30 | 广州朗国电子科技有限公司 | Method, device and storage medium for multi-screen video of conference terminal |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102833584A (en) * | 2012-05-22 | 2012-12-19 | 中华电信股份有限公司 | Video streaming method of multi-view interactive television |
CN103368932A (en) * | 2012-04-06 | 2013-10-23 | 瑞昱半导体股份有限公司 | Multi-screen video playback system and related multi-screen control device |
CN103853518A (en) * | 2012-12-06 | 2014-06-11 | 财团法人资讯工业策进会 | Synchronous display system and method for multi-view pictures |
JP5773389B2 (en) * | 2012-04-24 | 2015-09-02 | フリュー株式会社 | Photo sticker creation apparatus and method, and program |
CN108900857A (en) * | 2018-08-03 | 2018-11-27 | 东方明珠新媒体股份有限公司 | A kind of multi-visual angle video stream treating method and apparatus |
-
2019
- 2019-07-10 CN CN201910618987.6A patent/CN110366012B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103368932A (en) * | 2012-04-06 | 2013-10-23 | 瑞昱半导体股份有限公司 | Multi-screen video playback system and related multi-screen control device |
JP5773389B2 (en) * | 2012-04-24 | 2015-09-02 | フリュー株式会社 | Photo sticker creation apparatus and method, and program |
CN102833584A (en) * | 2012-05-22 | 2012-12-19 | 中华电信股份有限公司 | Video streaming method of multi-view interactive television |
CN103853518A (en) * | 2012-12-06 | 2014-06-11 | 财团法人资讯工业策进会 | Synchronous display system and method for multi-view pictures |
CN108900857A (en) * | 2018-08-03 | 2018-11-27 | 东方明珠新媒体股份有限公司 | A kind of multi-visual angle video stream treating method and apparatus |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113194277A (en) * | 2021-03-12 | 2021-07-30 | 广州朗国电子科技有限公司 | Method, device and storage medium for multi-screen video of conference terminal |
CN113194277B (en) * | 2021-03-12 | 2023-02-28 | 广州朗国电子科技股份有限公司 | Method, device and storage medium for multi-screen video of conference terminal |
Also Published As
Publication number | Publication date |
---|---|
CN110366012B (en) | 2021-12-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106161219B (en) | Message treatment method and device | |
US10560732B2 (en) | Method and system for the delivery and storage of high definition audio-visual content | |
JP6284132B2 (en) | Dynamic bit rate encoding and distribution according to the content situation | |
CN104754284B (en) | A kind of live broadcast of video conference method, equipment and system | |
CN105491393A (en) | Method for implementing multi-user live video business | |
CN109889855A (en) | Intelligent panoramic net cast networked shopping system and method based on mobile APP | |
US20130173709A1 (en) | Cloud-based content mixing into one stream | |
CN101272478A (en) | Content delivery system and method, and server apparatus and receiving apparatus | |
WO2007133385A2 (en) | Transmission of sd/hd pip video signals | |
CN102790923A (en) | User comment information sharing method, instant information server and user terminal | |
JP2006217611A (en) | Virtual radio station by client side | |
US20100154003A1 (en) | Providing report of popular channels at present time | |
CN108174233A (en) | A kind of live broadcasting method, device, server and medium | |
CN105915996A (en) | Multipath stream media playing method and equipment | |
CN108200458A (en) | Video interaction method, subscription client, server and storage medium | |
CN108012168A (en) | A kind of live control method of multi-path video stream and video living transmission system | |
CN113542781A (en) | Live broadcast room game interaction method and related device | |
Yao et al. | Video streaming adaptation strategy for multiview navigation over DASH | |
Yaqoob et al. | Dynamic viewport selection-based prioritized bitrate adaptation for tile-based 360° video streaming | |
WO2017075539A1 (en) | Apparatus and method for distributing multimedia events from a client | |
DE112016004560T5 (en) | Gateway multi-view video stream processing for second screen content overlay | |
CN108124193A (en) | Method for processing video frequency and device | |
CN107318052A (en) | Player method, television set and the storage medium of television video | |
Polakovič et al. | User gaze-driven adaptation of omnidirectional video delivery using spatial tiling and scalable video encoding | |
EP3398346A1 (en) | Video streams |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |