CN110366012B - Multi-view video playing method and electronic equipment - Google Patents

Multi-view video playing method and electronic equipment Download PDF

Info

Publication number
CN110366012B
CN110366012B CN201910618987.6A CN201910618987A CN110366012B CN 110366012 B CN110366012 B CN 110366012B CN 201910618987 A CN201910618987 A CN 201910618987A CN 110366012 B CN110366012 B CN 110366012B
Authority
CN
China
Prior art keywords
terminal
video
playing
terminals
play
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910618987.6A
Other languages
Chinese (zh)
Other versions
CN110366012A (en
Inventor
莫东松
刘昕
张进
钟宜峰
赵璐
张健
马晓琳
马丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MIGU Culture Technology Co Ltd
Original Assignee
MIGU Culture Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MIGU Culture Technology Co Ltd filed Critical MIGU Culture Technology Co Ltd
Priority to CN201910618987.6A priority Critical patent/CN110366012B/en
Publication of CN110366012A publication Critical patent/CN110366012A/en
Application granted granted Critical
Publication of CN110366012B publication Critical patent/CN110366012B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2662—Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/482—End-user interface for program selection
    • H04N21/4825—End-user interface for program selection using a list of items to be played back in a given order, e.g. playlists
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The embodiment of the invention provides a multi-view video playing method and electronic equipment, wherein the method comprises the following steps: acquiring at least one second terminal with a multi-view collaborative playing function in a preset range; acquiring terminal information of all terminals, wherein the all terminals comprise a first terminal and at least one second terminal; acquiring a video playing information list according to the terminal information of all the terminals; the video playing information list comprises a corresponding relation between a terminal identifier and a video playing visual angle; and controlling each terminal to play the video corresponding to the video playing visual angle according to the video playing information list. The embodiment of the invention realizes the collaborative playing of the multi-view video through the multiple terminals.

Description

Multi-view video playing method and electronic equipment
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a method for playing a multi-view video and an electronic device.
Background
With the popularization of broadband networks, video has become one of the main contents in the internet. At present, in the internet, not only services such as video on demand, downloading and the like are provided, but also live video broadcast services are provided, and live broadcast contents cover television programs or live activities. When watching a live video, a user generally wants to watch the live video from different viewing angles at the same time to deepen the understanding of the live content.
In response to the above requirements of users, picture-in-picture is generally adopted to implement video playing from different viewing angles. When videos at different visual angles are played in a picture-in-picture mode, a large window in the display device plays a video at one visual angle, a small window plays a video at the other visual angle, and at the moment, a user can watch the large window and the small window in the display device simultaneously to watch the videos at different visual angles in the live broadcast video.
However, although the picture-in-picture mode can realize video playing at different viewing angles, the mode can only play a few channels of videos at different viewing angles on the same display device at the same time, and when a user needs to watch more channels of videos at different viewing angles, the mode cannot well meet the requirements of the user, and at this time, multiple terminals need to cooperatively play multiple channels of videos at different viewing angles, so as to meet the requirements of the user on watching more channels of videos at the same time.
Disclosure of Invention
The embodiment of the invention provides a playing method of a multi-view video and electronic equipment, which are used for realizing that a plurality of terminals cooperatively display videos of different views in the same live broadcast.
In order to achieve the above object, an embodiment of the present invention provides a method for playing a multi-view video, which is applied to a first terminal, where the method includes:
acquiring at least one second terminal with a multi-view collaborative playing function in a preset range;
acquiring terminal information of all terminals, wherein the all terminals comprise a first terminal and at least one second terminal;
acquiring a video playing information list according to the terminal information of all the terminals; the video playing information list comprises a corresponding relation between a terminal identifier and a video playing visual angle;
and controlling each terminal to play the video corresponding to the video playing visual angle according to the video playing information list.
Optionally, the acquiring at least one second terminal having a multi-view cooperative play function within a preset range includes:
and when the first terminal receives the click operation of the user on the preset function key on the terminal player, acquiring the at least one second terminal through the UPnP protocol.
Optionally, the acquiring terminal information of all terminals includes:
a first terminal acquires terminal information of the first terminal;
establishing connection with each second terminal respectively, and acquiring terminal information of each second terminal; wherein the content of the first and second substances,
the terminal information at least includes: terminal identification, screen size, screen resolution, terminal computing power, and player decoding power.
Optionally, the obtaining a video playing information list according to the terminal information of all the terminals includes:
determining a main playing terminal corresponding to a main video playing visual angle from all terminals according to the screen size and the player decoding capacity in the terminal information;
randomly distributing a video playing visual angle to each remaining terminal except the main playing terminal;
and recording the corresponding relation between the terminal identification of the main playing terminal and the main video playing visual angle and the corresponding relation between the terminal identification of each residual terminal and the video playing visual angle which is correspondingly distributed, so as to obtain the video playing information list.
Optionally, the video playing information list further includes a corresponding relationship between a terminal identifier and a video playing code rate;
the acquiring a video playing information list according to the terminal information of all the terminals further includes:
acquiring a main play code rate required by the main video play visual angle, and determining the main play code rate as a video play code rate corresponding to the main play terminal;
calculating to obtain the total residual available code rate of the network bandwidth according to the network bandwidth of the network where all the terminals are located and the main playing code rate;
determining a video playing code rate corresponding to each residual terminal according to the screen resolution and the player decoding capability in the terminal information; the sum of the video playing code rates corresponding to each residual terminal is smaller than the total residual available code rate;
and recording the corresponding relation between the terminal identification of the main playing terminal and the main playing code rate and the corresponding relation between the terminal identification of each residual terminal and the corresponding video playing code rate to obtain the video playing information list.
Optionally, the determining, according to the screen size and the player decoding capability in the terminal information, a main play terminal corresponding to a main video play view angle from all terminals includes:
according to the screen size and the player decoding capacity in the terminal information, calculating to obtain a video playing score value corresponding to each terminal through the following formula, and determining the terminal corresponding to the maximum video playing score value as the main playing terminal; wherein the content of the first and second substances,
P＝V1×W1+V2×W2+V3；
p represents the terminal identification of the main play terminal, V1A score, W, corresponding to the screen size of the terminal1A preset weight value V corresponding to the screen size2A score, W, representing the player's decoding capability2A preset weight value V corresponding to the decoding capability of the player3Indicating the pre-assigned score for each terminal.
Optionally, before controlling each terminal to perform video playing at a corresponding video playing view angle according to the video playing information list, the playing method further includes:
selecting a video distribution terminal for multi-channel visual angle video distribution from all terminals according to the terminal information of all terminals;
and controlling each terminal to play the video corresponding to the video playing view angle according to the video playing information list, wherein the method comprises the following steps:
and controlling each terminal to play the video corresponding to the video playing view angle through the video distribution terminal.
Optionally, the selecting, according to the terminal information of all the terminals, a video distribution terminal for performing multi-view video distribution from all the terminals includes:
and determining the terminal with the strongest terminal computing capability in all the terminals as the video distribution terminal according to the terminal computing capability in the terminal information.
Optionally, the controlling, by the video distribution terminal, each terminal to perform video playing corresponding to a video playing view angle includes:
when the first terminal is the video distribution terminal, the first terminal directly plays the branch video stream corresponding to the video playing visual angle of the first terminal in the aggregated video stream obtained from the server according to the video playing information list, and correspondingly sends the branch video stream corresponding to the video playing visual angle of each second terminal in the aggregated video stream to each second terminal, so that each second terminal plays the received branch video stream;
when the first terminal is not the video distribution terminal, the first terminal sends the video playing information list to the video distribution terminal, so that the video distribution terminal plays the branch video stream corresponding to the video playing visual angle of the video distribution terminal in the aggregated video stream acquired from the server, and correspondingly sends the branch video stream corresponding to the video playing visual angle of the third terminal in the aggregated video stream to each third terminal, so that each third terminal plays the received branch video stream; and the third terminal is a terminal except the video distribution terminal in all terminals.
Optionally, after the controlling each terminal to perform video playing corresponding to the video playing view angle according to the video playing information list, the playing method further includes:
and when the first terminal quits the video playing, sending a notification message to the at least one second terminal so that the at least one second terminal can select one second terminal from the at least one second terminal as the first terminal by adopting a Gossip algorithm according to the notification message.
Optionally, after the obtaining of the terminal information of all the terminals, the playing method further includes:
establishing a video collaborative play session table and displaying the video collaborative play session table;
sharing the video collaborative play session table to each second terminal through a Gossip protocol so as to enable each second terminal to synchronously display the video collaborative play session table; and the video collaborative play session table comprises the terminal information.
Optionally, the video collaborative play session table further includes a play time of a main video play view, so that other terminals except the terminal that plays the main video play view in all the terminals can perform video synchronous play corresponding to the video play view according to the play time of the main video play view.
The embodiment of the invention provides electronic equipment, which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor executes the program to realize the steps of the playing method of the multi-view video.
An embodiment of the present invention provides a non-transitory computer readable storage medium, on which a computer program is stored, and the computer program, when executed by a processor, implements the steps of the method for playing a multi-view video.
The multi-view video playing method and the electronic device provided by the embodiment of the invention have the advantages that the first terminal acquires at least one second terminal with a multi-view collaborative playing function in a preset range, acquires the terminal information of all terminals including the first terminal and the at least one second terminal, acquires the video playing information list including the corresponding relation between the terminal identifier and the video playing view angle according to the terminal information of all terminals, and finally controls each terminal to play the video with the corresponding video playing view angle according to the video playing information list, so that the video with the corresponding view angle is controlled to be played by each terminal in all terminals through the first terminal which is also used as the playing terminal, the collaborative playing of multiple view-angle videos in the same video is realized through the multiple terminals, the convenience of the multi-terminal multi-view-angle video collaborative playing is ensured, the requirement of the user on watching more channels of videos at the same time is met.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and those skilled in the art can also obtain other drawings according to the drawings without creative efforts.
FIG. 1 is a flowchart illustrating steps of a method for playing a multi-view video according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating a process of acquiring a video playing information list according to terminal information of all terminals in the embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device in an embodiment of the invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As shown in fig. 1, a flowchart of steps of a method for playing a multi-view video according to an embodiment of the present invention is shown, where the method includes the following steps:
step 101: and acquiring at least one second terminal with a multi-view collaborative playing function in a preset range.
In this step, specifically, when the first terminal organizes the collaborative playing of the multi-view video, at least one second terminal having a multi-view collaborative playing function within a preset range may be obtained first, so that the first terminal and the at least one second terminal can cooperatively play the multi-view video.
In addition, specifically, when the first terminal acquires at least one second terminal within a preset range, the preset range may be within a preset geographic range, for example, the second terminal within a range of 3 meters from the first terminal is acquired; in addition, the preset range may also refer to a range of the same lan, for example, a second terminal that is in the same lan with the first terminal is acquired. Therefore, the second terminal in the preset range is obtained in a limited mode, so that the first terminal can conveniently obtain the second terminal and the first terminal and the second terminal can conveniently cooperate with each other.
In addition, specifically, when at least one second terminal having a multi-view cooperative play function within a preset range is obtained, the at least one second terminal may be obtained when the first terminal receives a click operation of a user on a preset function key on the terminal player.
Specifically, the preset function key may be a multi-view cooperative play function key, that is, the first terminal has a multi-view cooperative play function; in addition, the preset function key is added on the terminal player, so that when the first terminal receives the click operation of the user on the preset function key on the terminal player, the first terminal can be positioned to at least one second terminal which also has the multi-view collaborative play function in the preset range according to the click operation, and the first terminal can autonomously select whether the collaborative play of the video with the plurality of second terminals is required.
It should be noted that, the first terminal may first locate all the second terminals within the preset range through technologies such as local area network search, UPnP protocol technology, terminal location of a mobile network, or a terminal sensing device, and then perform information interaction communication, for example, through a D2D rich message discovery method, to determine whether the second terminal is installed with a video player having a multi-view cooperative play function, so as to obtain at least one second terminal having a multi-view cooperative play function.
Step 102: and acquiring the terminal information of all the terminals.
Specifically, all the terminals include a first terminal and at least one second terminal.
In this step, the first terminal acquires the terminal information of all terminals, so that the video playing information list can be acquired according to the terminal information of all terminals, and the collaborative video can be played.
Wherein the terminal information at least includes: terminal identification, screen size, screen resolution, terminal computing power, and player decoding power. Specifically, the terminal information is related to the video playing capability of the terminal, so that the first terminal can determine the video playing view angle of each terminal according to the acquired terminal information.
In addition, when acquiring the terminal information of all the terminals, the first terminal may acquire the terminal information of itself, then establish a connection with each second terminal, and acquire the terminal information of each second terminal.
Specifically, when the first terminal establishes a connection with each second terminal, the invitation information of the multi-view collaborative play may be sent to each second terminal, then the invitation acceptance information fed back by each second terminal according to the invitation information is received, and a point-to-point connection is established with each second terminal according to the invitation acceptance information, so as to obtain the terminal information of each second terminal according to the connection.
Of course, it should be noted herein that when the first terminal establishes the point-to-point connection with each second terminal, the connection may be established by using the UPnP technology; in addition, when feeding back the invitation acceptance information, the second terminal may feed back the invitation acceptance information in a contact sensing manner with the first terminal, or may feed back the invitation acceptance information in a manner of sending the invitation acceptance information, where the feedback manner is not limited.
Step 103: and acquiring a video playing information list according to the terminal information of all the terminals.
In this step, specifically, the video playing information list includes a corresponding relationship between the terminal identifier and the video playing view angle.
Therefore, by acquiring the video playing information list, the video playing visual angle corresponding to each terminal can be determined according to the corresponding relation between the terminal identification and the video playing visual angle in the video playing information list, so that convenience is provided for the multi-terminal collaborative playing of videos with different video playing visual angles.
Step 104: and controlling each terminal to play the video corresponding to the video playing visual angle according to the video playing information list.
In this step, specifically, after the video playing information list is obtained, each terminal can be directly controlled to play the video corresponding to the video playing view angle according to the corresponding relationship between the terminal identifier and the video playing view angle in the video playing information list, so that the control of the first terminal on the multi-view-angle video collaborative playing among the multiple terminals is directly realized, the convenience of the multi-terminal multi-view-angle video collaborative playing control is ensured, and meanwhile, the requirement of a user on watching multiple channels of videos at the same time is met.
Therefore, in this embodiment, the first terminal acquires the terminal information of all terminals, acquires the video playing information list according to the terminal information of all terminals, and finally controls each terminal to play the video corresponding to the video playing view angle according to the video playing information list, so that the first terminal directly controls the multi-view-angle video collaborative playing among multiple terminals, and the requirement of a user on watching multiple channels of videos at the same time is met while the convenience of the multi-terminal multi-view-angle video collaborative playing is ensured.
Further, after the terminal information of all the terminals is acquired, the video collaborative play session table can be established and displayed; then sharing the video collaborative play session table to each second terminal through a Gossip protocol so as to enable each second terminal to synchronously display the video collaborative play session table; and the video collaborative play session table comprises the terminal information. Therefore, by establishing and synchronizing the same video collaborative play session table in all the terminals, each terminal can acquire the terminal information of all the terminals, and the collaboration coordination between the terminals is improved.
Of course, the video cooperative play session table may further include the play time of the main video play view, so that other terminals in all the terminals except the terminal that plays the main video play view can perform video synchronous play corresponding to the video play view according to the play time of the main video play view. Therefore, the video collaborative play session table comprises the play time of the main video play visual angle, so that all the terminals can carry out multi-visual angle video play time synchronization according to the play time of the main video play visual angle, the synchronism of each terminal when playing the corresponding visual angle video is further ensured, and the watching experience of a user is improved.
Further, as shown in fig. 2, when the video playing information list is acquired according to the terminal information of all the terminals in step 103, the following steps may be included:
step 201: and determining a main playing terminal corresponding to the main video playing visual angle from all the terminals according to the screen size and the player decoding capacity in the terminal information.
In this step, specifically, after the terminal information of all terminals is acquired, the main playing terminal corresponding to the main video playing view angle may be determined from all terminals according to the screen size and the player decoding capability in the terminal information.
Therefore, the main playing terminal corresponding to the main video playing visual angle is determined firstly according to the screen size and the player decoding capacity in the terminal information, so that the playing effect of the main visual angle video is preferentially ensured, and the watching experience of a user on the video is improved.
In addition, specifically, when a main playing terminal corresponding to a main video playing view angle is determined from all terminals according to the screen size and the player decoding capability in the terminal information, a video playing score value corresponding to each terminal can be calculated according to the screen size and the player decoding capability in the terminal information through the following formula, and a terminal corresponding to a maximum video playing score value is determined as the main playing terminal; wherein the content of the first and second substances,
P＝V1×W1+V2×W2+V3；
p represents the terminal identification of the main play terminal, V1A score, W, corresponding to the screen size of the terminal1A preset weight value V corresponding to the screen size2A score, W, representing the player's decoding capability2A preset weight value V corresponding to the decoding capability of the player3Indicating the pre-assigned score for each terminal.
Specifically, a corresponding relation exists between a preset screen size of the terminal and a preset score, so that after the screen size of the terminal is obtained, the score corresponding to the screen size of the terminal can be obtained according to the corresponding relation; similarly, the player decryption capability and the preset score have a corresponding relationship, and after the player decoding capability is obtained, the score corresponding to the player decoding capability can be obtained according to the corresponding relationship.
In addition, the terminal corresponding to the maximum video playing score value is determined to be the main playing terminal, the terminal is obtained according to the screen size and the player decoding capacity of the terminal based on the video playing score value, when the video playing score value is higher, the comprehensive capacity of the screen size and the playing decoding capacity is higher, the performance such as definition and the like when the terminal plays the video is higher, namely the performance is highest when the main playing terminal corresponding to the maximum video playing score value plays the video, so that the playing effect of the main visual angle playing the video is ensured when the terminal corresponding to the maximum video playing score value is determined to be the main playing terminal, and the watching experience of a user is improved.
Step 202: and randomly distributing a video playing visual angle to each remaining terminal except the main playing terminal.
In this step, specifically, after the main play terminal is determined, a path of video play view may be randomly allocated to each remaining terminal except the main play terminal in all terminals.
Because the importance degrees of other video playing visual angles are basically consistent except the main video playing visual angle in the video, the first terminal can not influence the impression experience of the user when randomly distributing one video playing visual angle for each remaining terminal.
Step 203: and recording the corresponding relation between the terminal identification of the main playing terminal and the main video playing visual angle and the corresponding relation between the terminal identification of each residual terminal and the video playing visual angle which is correspondingly distributed to obtain a video playing information list.
In this step, specifically, the determined correspondence between the terminal identifier of the main playback terminal and the main video playback view angle and the correspondence between the terminal identifier of each remaining terminal and the video playback view angle that is correspondingly allocated may be directly determined as the video playback information list.
Therefore, by acquiring the video playing information list, the first terminal can allocate a corresponding video playing visual angle to each terminal according to the video playing information list, and further can control multi-terminal multi-visual-angle collaborative video playing.
In addition, it should be noted here that the video playing information list may further include a correspondence between the terminal identifier and the video playing bitrate.
At this time, when a video playing information list is obtained according to the terminal information of all terminals, a main playing code rate required by the main video playing view angle may be obtained first, and the main playing code rate is determined as the video playing code rate corresponding to the main playing terminal; then, according to the network bandwidth of the network where all the terminals are located and the main playing code rate, calculating to obtain the total remaining available code rate of the network bandwidth; finally, according to the screen resolution and the player decoding capability in the terminal information, determining the video playing code rate corresponding to each residual terminal; the sum of the video playing code rates corresponding to each residual terminal is smaller than the total residual available code rate; and recording the corresponding relation between the terminal identification of the main playing terminal and the main playing code rate and the corresponding relation between the terminal identification of each remaining terminal and the corresponding video playing code rate to obtain the video playing information list.
Specifically, in this embodiment, the video playing code rate corresponding to the main playing terminal needs to be determined first, so as to ensure the playing effect of the main video playing view angle. In addition, specifically, the total remaining available bitrate of the network bandwidth is a difference between the network bandwidth and the main play rate. In addition, specifically, when determining the video playing code rate corresponding to each remaining terminal according to the screen resolution and the player decoding capability of the terminal, a suitable resolution may be selected for each remaining terminal, then a suitable frame rate is selected according to the screen refresh rate and the player decoding capability, and finally the resolution and the frame rate are integrated to obtain the video playing code rate.
Of course, it should be noted here that, if the sum of the video playing code rates corresponding to each remaining terminal is greater than the total remaining available code rate, the video playing code rates may be sequentially reduced by one stage according to the order of the video playing code rates in the remaining terminals until the sum of the video playing code rates corresponding to each remaining terminal is less than the total remaining available code rate.
It should be further noted that, when the network bandwidth changes, the video playing code rate corresponding to each remaining terminal needs to be determined again, so as to ensure that the video playing code rate is always the most appropriate video playing code rate.
Therefore, the corresponding relation between the terminal identification and the video playing code rate is added to the video playing information list, so that each terminal can play the corresponding visual angle video according to the determined video playing code rate, and the effect of each path of visual angle video during playing is ensured.
In addition, further, before the first terminal controls each terminal to play the video corresponding to the video playing view angle according to the video playing information list, the playing method may further include the following steps:
step A: and selecting a video distribution terminal for multi-channel visual angle video distribution from all the terminals according to the terminal information of all the terminals.
At this time, when the first terminal controls each terminal to perform video playing corresponding to the video playing view angle according to the video playing information list, the first terminal may perform the following steps: and controlling each terminal to play the video corresponding to the video playing view angle through the video distribution terminal.
Therefore, the video distribution terminal used for distributing the multi-channel visual angle videos is selected from all the terminals, and then each terminal is controlled to play the videos corresponding to the video playing visual angles through the video distribution terminal, so that the effect of each terminal when playing the videos corresponding to the visual angles can be ensured by ensuring the video distribution capability of the video distribution terminal.
Specifically, in step a, according to the terminal computing capabilities in the terminal information, the terminal with the strongest terminal computing capability in all terminals may be determined as the video distribution terminal. The video distribution terminal is the terminal with the strongest terminal computing capability in all the terminals, so that the video distribution terminal can ensure the fluency and stability in distribution when distributing each path of video.
In addition, specifically, when each terminal is controlled to perform video playing corresponding to a video playing view angle through the video distribution terminal in step B, the following two situations can be distinguished:
firstly, when the first terminal is the video distribution terminal, the first terminal directly plays the branch video stream corresponding to the video playing view angle of the first terminal in the aggregated video stream acquired from the server according to the video playing information list, and correspondingly sends the branch video stream corresponding to the video playing view angle of each second terminal in the aggregated video stream to each second terminal, so that each second terminal plays the received branch video stream.
Specifically, in this case, when the first terminal is the video distribution terminal, the first terminal may directly play the video stream at the viewing angle corresponding to the first terminal according to the obtained video playing information list, and then correspondingly distribute the split video stream at the video playing viewing angle corresponding to each second terminal, so that the first terminal and each second terminal can play the distributed split video stream, thereby implementing the collaborative playing of the multi-view video among the multiple terminals.
The second step is as follows: when the first terminal is not the video distribution terminal, the first terminal sends the video playing information list to the video distribution terminal, so that the video distribution terminal plays the branch video stream corresponding to the video playing visual angle of the video distribution terminal in the aggregated video stream acquired from the server, and correspondingly sends the branch video stream corresponding to the video playing visual angle of the third terminal in the aggregated video stream to each third terminal, so that each third terminal plays the received branch video stream; and the third terminal is a terminal except the video distribution terminal in all terminals.
Specifically, in this case, when the first terminal is not a video distribution terminal, the first terminal needs to send the video playing information list to the video distribution terminal, so that the video distribution terminal can play the video stream at the video playing angle corresponding to the first terminal according to the video playing information list, and correspondingly send the video stream at the video playing angle corresponding to each terminal except the first terminal to each terminal, so that each terminal can play the distributed shunt video stream, and further realize the collaborative playing of the multi-angle video among the multiple terminals.
Therefore, by determining the video distribution terminal, the video distribution terminal distributes each path of video stream in the aggregated video stream, and the terminal with the strongest computing capability is the terminal with the strongest terminal in all the terminals based on the video distribution terminal, so that the video distribution terminal can ensure the fluency and stability in distribution when distributing each path of video.
In addition, it should be noted herein that, when the video distribution terminal exits from the video playing, the first terminal may select a video distribution terminal for multi-view video distribution from all terminals according to the terminal information of all terminals again, so as to ensure that a new video distribution terminal can be generated and the video stream is distributed, thereby ensuring that the distribution of the video stream can be maintained and that other terminals have no perception, and further ensuring the stability of the multi-view video collaborative playing.
In addition, it should be noted that, after controlling each terminal to perform video playing corresponding to a video playing view angle according to the video playing information list, when the first terminal exits from the video playing, a notification message is sent to the at least one second terminal, so that the at least one second terminal can select one second terminal from the at least one second terminal as the first terminal by using a Gossip algorithm according to the notification message. Therefore, the first terminal in the control position can always exist in the terminal for the collaborative playing of the multi-view video under the condition that other terminals do not sense, and the stability of the collaborative playing of the multi-view video is ensured.
In this way, the playing method of the multi-view video provided by this embodiment realizes that each terminal in all terminals is controlled to play the video at the corresponding view angle through the first terminal which is also used as the playing terminal, thereby realizing that the multi-view videos in the same video are cooperatively played through the multiple terminals, and satisfying the user's requirement for simultaneously watching multiple videos while ensuring the convenience of the multi-terminal multi-view video cooperative playing.
In addition, as shown in fig. 3, an entity structure schematic diagram of the electronic device provided in the embodiment of the present invention is shown, where the electronic device may include: a processor (processor)310, a communication Interface (communication Interface)320, a memory (memory)330 and a communication bus 340, wherein the processor 310, the communication Interface 320 and the memory 330 communicate with each other via the communication bus 340. The processor 310 may invoke a computer program stored on the memory 330 and executable on the processor 310 to perform the methods provided by the various embodiments described above, including, for example: acquiring at least one second terminal with a multi-view collaborative playing function in a preset range; acquiring terminal information of all terminals, wherein the all terminals comprise a first terminal and at least one second terminal; acquiring a video playing information list according to the terminal information of all the terminals; the video playing information list comprises a corresponding relation between a terminal identifier and a video playing visual angle; and controlling each terminal to play the video corresponding to the video playing visual angle according to the video playing information list.
In addition, the logic instructions in the memory 330 may be implemented in the form of software functional units and stored in a computer readable storage medium when the software functional units are sold or used as independent products. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Embodiments of the present invention further provide a non-transitory computer-readable storage medium, on which a computer program is stored, where the computer program is implemented to perform the method provided in the foregoing embodiments when executed by a processor, and the method includes: acquiring at least one second terminal with a multi-view collaborative playing function in a preset range; acquiring terminal information of all terminals, wherein the all terminals comprise a first terminal and at least one second terminal; acquiring a video playing information list according to the terminal information of all the terminals; the video playing information list comprises a corresponding relation between a terminal identifier and a video playing visual angle; and controlling each terminal to play the video corresponding to the video playing visual angle according to the video playing information list.
The above-described embodiments of the apparatus are merely illustrative, and the units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. One of ordinary skill in the art can understand and implement it without inventive effort.
Through the above description of the embodiments, those skilled in the art will clearly understand that each embodiment can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware. With this understanding in mind, the above-described technical solutions may be embodied in the form of a software product, which can be stored in a computer-readable storage medium such as ROM/RAM, magnetic disk, optical disk, etc., and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods described in the embodiments or some parts of the embodiments.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (12)

1. A playing method of a multi-view video is applied to a first terminal, and is characterized in that the playing method comprises the following steps:
acquiring at least one second terminal with a multi-view collaborative playing function in a preset range;
acquiring terminal information of all terminals, wherein the all terminals comprise a first terminal and at least one second terminal;
acquiring a video playing information list according to the terminal information of all the terminals; the video playing information list comprises a corresponding relation between a terminal identifier and a video playing visual angle;
selecting a video distribution terminal for multi-channel visual angle video distribution from all terminals according to the terminal information of all terminals;
controlling each terminal to play the video corresponding to the video playing view angle according to the video playing information list, comprising:
through the video distribution terminal, each terminal is controlled to play the video corresponding to the video playing view angle, and the method specifically comprises the following steps:
when the first terminal is the video distribution terminal, the first terminal directly plays the branch video stream corresponding to the video playing visual angle of the first terminal in the aggregated video stream obtained from the server according to the video playing information list, and correspondingly sends the branch video stream corresponding to the video playing visual angle of each second terminal in the aggregated video stream to each second terminal, so that each second terminal plays the received branch video stream;
when the first terminal is not the video distribution terminal, the first terminal sends the video playing information list to the video distribution terminal, so that the video distribution terminal plays the branch video stream corresponding to the video playing visual angle of the video distribution terminal in the aggregated video stream acquired from the server, and correspondingly sends the branch video stream corresponding to the video playing visual angle of the third terminal in the aggregated video stream to each third terminal, so that each third terminal plays the received branch video stream; and the third terminal is a terminal except the video distribution terminal in all terminals.
2. The method for playing the multiview video according to claim 1, wherein the obtaining of the at least one second terminal having the multiview collaborative playing function within the preset range comprises:
and when the first terminal receives the click operation of the user on a preset function key on the terminal player, acquiring the at least one second terminal.
3. The method for playing the multi-view video according to claim 1, wherein the acquiring the terminal information of all the terminals comprises:
a first terminal acquires terminal information of the first terminal;
establishing connection with each second terminal respectively, and acquiring terminal information of each second terminal; wherein the content of the first and second substances,
the terminal information at least includes: terminal identification, screen size, screen resolution, terminal computing power, and player decoding power.
4. The method for playing the multi-view video according to claim 1, wherein the obtaining the video playing information list according to the terminal information of all the terminals comprises:
determining a main playing terminal corresponding to a main video playing visual angle from all terminals according to the screen size and the player decoding capacity in the terminal information;
randomly distributing a video playing visual angle to each remaining terminal except the main playing terminal;
and recording the corresponding relation between the terminal identification of the main playing terminal and the main video playing visual angle and the corresponding relation between the terminal identification of each residual terminal and the video playing visual angle which is correspondingly distributed, so as to obtain the video playing information list.
5. The playing method of the multi-view video according to claim 4, wherein the video playing information list further includes a correspondence between a terminal identifier and a video playing code rate;
the acquiring a video playing information list according to the terminal information of all the terminals further includes:
acquiring a main play code rate required by the main video play visual angle, and determining the main play code rate as a video play code rate corresponding to the main play terminal;
calculating to obtain the total residual available code rate of the network bandwidth according to the network bandwidth of the network where all the terminals are located and the main playing code rate;
determining a video playing code rate corresponding to each residual terminal according to the screen resolution and the player decoding capability in the terminal information; the sum of the video playing code rates corresponding to each residual terminal is smaller than the total residual available code rate;
and recording the corresponding relation between the terminal identification of the main playing terminal and the main playing code rate and the corresponding relation between the terminal identification of each residual terminal and the corresponding video playing code rate to obtain the video playing information list.
6. The method for playing the multi-view video according to claim 4, wherein the determining the main playing terminal corresponding to the main video playing view from all terminals according to the screen size and the player decoding capability in the terminal information comprises:
according to the screen size and the player decoding capacity in the terminal information, calculating to obtain a video playing score value corresponding to each terminal through the following formula, and determining the terminal corresponding to the maximum video playing score value as the main playing terminal; wherein the content of the first and second substances,
P＝V1×W1+V2×W2+V3；
p represents the terminal identification of the main play terminal, V1A score, W, corresponding to the screen size of the terminal1A preset weight value V corresponding to the screen size2A score, W, representing the player's decoding capability2A preset weight value V corresponding to the decoding capability of the player3Indicating the pre-assigned score for each terminal.
7. The method for playing the multiview video according to claim 1, wherein the selecting a video distribution terminal for performing the multiview video distribution from all terminals according to the terminal information of all terminals comprises:
and determining the terminal with the strongest terminal computing capability in all the terminals as the video distribution terminal according to the terminal computing capability in the terminal information.
8. The method for playing a multi-view video according to claim 1, wherein after the controlling each terminal to play the video at the corresponding video playing view according to the video playing information list, the method further comprises:
and when the first terminal quits the video playing, sending a notification message to the at least one second terminal so that the at least one second terminal can select one second terminal from the at least one second terminal as the first terminal by adopting a Gossip algorithm according to the notification message.
9. The method for playing multi-view video according to claim 1, wherein after said obtaining terminal information of all terminals, said playing method further comprises:
establishing a video collaborative play session table and displaying the video collaborative play session table;
sharing the video collaborative play session table to each second terminal through a Gossip protocol so as to enable each second terminal to synchronously display the video collaborative play session table; and the video collaborative play session table comprises the terminal information.
10. The method for playing a multiview video according to claim 9, wherein the video collaborative play session table further includes a play time of a main video play view, so that other terminals in the all terminals except the terminal that plays the main video play view can perform video synchronous play corresponding to the video play view according to the play time of the main video play view.
11. An electronic device comprising a memory, a processor and a program stored on the memory and executable on the processor, wherein the processor implements the steps of the method for playing a multi-view video according to any one of claims 1 to 10 when executing the program.
12. A non-transitory computer-readable storage medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the method for playing a multiview video according to any one of claims 1 to 10.
CN201910618987.6A 2019-07-10 2019-07-10 Multi-view video playing method and electronic equipment Active CN110366012B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910618987.6A CN110366012B (en) 2019-07-10 2019-07-10 Multi-view video playing method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910618987.6A CN110366012B (en) 2019-07-10 2019-07-10 Multi-view video playing method and electronic equipment

Publications (2)

Publication Number Publication Date
CN110366012A CN110366012A (en) 2019-10-22
CN110366012B true CN110366012B (en) 2021-12-03

Family

ID=68218478

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910618987.6A Active CN110366012B (en) 2019-07-10 2019-07-10 Multi-view video playing method and electronic equipment

Country Status (1)

Country Link
CN (1) CN110366012B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113194277B (en) * 2021-03-12 2023-02-28 广州朗国电子科技股份有限公司 Method, device and storage medium for multi-screen video of conference terminal

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103368932A (en) * 2012-04-06 2013-10-23 瑞昱半导体股份有限公司 Multi-screen video playback system and related multi-screen control device
JP5773389B2 (en) * 2012-04-24 2015-09-02 フリュー株式会社 Photo sticker creation apparatus and method, and program
TW201349848A (en) * 2012-05-22 2013-12-01 Chunghwa Telecom Co Ltd Video and audio streaming method of multi-view interactive TV
TWI505698B (en) * 2012-12-06 2015-10-21 Inst Information Industry Synchronous displaying system for displaying multi-view frame and method for synchronously displaying muti-view frame
CN108900857B (en) * 2018-08-03 2020-12-11 东方明珠新媒体股份有限公司 Multi-view video stream processing method and device

Also Published As

Publication number Publication date
CN110366012A (en) 2019-10-22

Similar Documents

Publication Publication Date Title
US10841660B2 (en) System and method for multi-user digital interactive experience
CN106161219B (en) Message treatment method and device
CN105763832B (en) A kind of video interactive, control method and device
CN104754284B (en) A kind of live broadcast of video conference method, equipment and system
CN108235042B (en) Multi-user network live broadcast method, device, joining device, system, server and computer readable storage medium
US20130159126A1 (en) With-me social interactivity platform
US20140237530A1 (en) Methods, computer program products, and virtual servers for a virtual collaborative environment
CN113457123B (en) Interaction method and device based on cloud game, electronic equipment and readable storage medium
CN106303648A (en) A kind of method and device synchronizing to play multi-medium data
CN111711840B (en) Non-transitory computer readable medium for content display
US11889159B2 (en) System and method for multi-user digital interactive experience
EP3070935B1 (en) Apparatus, system, and method of controlling output of content data, and carrier means
CN108174233A (en) A kind of live broadcasting method, device, server and medium
US20170171509A1 (en) Method and electronic apparatus for realizing two-person simultaneous live video
CN113518247A (en) Video playing method, related equipment and computer readable storage medium
KR100607223B1 (en) Method and System for Providing Joint Viewing Service of Moving Picture
CN114546308A (en) Application interface screen projection method, device, equipment and storage medium
CN111741353A (en) Method for device cooperative work, terminal device and readable storage medium
CN106817628A (en) A kind of network direct broadcasting platform
CN110662119A (en) Video splicing method and device
CN110366012B (en) Multi-view video playing method and electronic equipment
EP3316593B1 (en) Method and device for implementing synchronous playing
CN109756744A (en) Data processing method, electronic equipment and computer storage medium
CN106792237B (en) Message display method and system
US20210227005A1 (en) Multi-user instant messaging method, system, apparatus, and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant