CN111263177A - Video interactive live broadcast method and system - Google Patents
Video interactive live broadcast method and system Download PDFInfo
- Publication number
- CN111263177A CN111263177A CN202010073057.XA CN202010073057A CN111263177A CN 111263177 A CN111263177 A CN 111263177A CN 202010073057 A CN202010073057 A CN 202010073057A CN 111263177 A CN111263177 A CN 111263177A
- Authority
- CN
- China
- Prior art keywords
- video
- visual angle
- client terminal
- display
- transition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
Abstract
The invention discloses a video interactive live broadcast method and a system, wherein the method comprises the following steps: the client terminal receives and decodes the surround video sent by the live broadcast server, and displays the video of partial angles of the surround video on a display screen; the client terminal detects a sliding gesture of a user on a display screen and generates a display visual angle switching instruction according to the sliding gesture; the client terminal acquires current display visual angle information of a video with partial angles, and calculates target display visual angle information at the next moment according to a display visual angle switching instruction and the current display visual angle information; and the client terminal acquires the video of the target visual angle according to the target display visual angle information at the next moment and switches and displays the video of the target display visual angle. The system comprises: the system comprises a live video sending module, a live video receiving module, a visual angle switching instruction generating module, a visual angle information acquiring module and a visual angle switching module. By the method and the device, the user can independently select the visual angle for watching the video and can freely switch the visual angle for displaying the video.
Description
Technical Field
The invention relates to the technical field of video live broadcast, in particular to a video interactive live broadcast method and system.
Background
In the field of live video, a plurality of video acquisition systems at different machine positions are generally used for acquiring video images at a plurality of visual angles, and then the video images of a plurality of videos are selected, spliced and switched through a broadcast guide system so as to realize video presentation at a plurality of angles. In the technology, the selection and the switching of the video are finished in the director system, so that a user cannot select the video image at the angle which the user wants to watch according to the self requirement, the interest of the live video is reduced, and the switching process has discontinuous pictures, larger jump and poorer experience.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a video interactive live broadcast method and a video interactive live broadcast system, so that a user can independently select a video watching visual angle and can freely switch the video displaying visual angles.
In order to solve the technical problems, the invention is realized by the following technical scheme:
the invention provides a video interactive live broadcasting method, which comprises the following steps:
s11: the client terminal receives and decodes the surround video sent by the live broadcast server, and displays the video of partial angles of the surround video on a display screen;
s12: the method comprises the steps that a client terminal detects a sliding gesture of a user on a display screen, and a display visual angle switching instruction is generated according to the sliding gesture;
s13: the client terminal acquires the current display visual angle information of the video with the partial angle, and calculates the target display visual angle information at the next moment according to the display visual angle switching instruction and the current display visual angle information;
s14: and the client terminal acquires the video of the target visual angle according to the target display visual angle information at the next moment and switches and displays the video of the target display visual angle.
Preferably, the S14 further includes:
step S141: the client terminal calculates the number of transition visual angles of an interval between the current display visual angle information and the target display visual angle information, and generates a transition video according to the number of the transition visual angles;
step S142: and the client terminal gradually switches to display the video of the partial angle corresponding to the target display visual angle from displaying the video of the partial angle corresponding to the current display visual angle through displaying the transition video.
Preferably, the S14 further includes:
s31: and the client terminal detects whether the user triggers a sharing button of the transition video, and if so, the transition video is shared.
Preferably, the step S14 is followed by:
s41: the client terminal detects a zooming gesture of a user on a display screen and generates a video zooming instruction according to the zooming gesture;
s42: and the client terminal generates a zoom video according to the zoom instruction of the display video and displays the zoom video on a display screen.
Preferably, the surround video is a video obtained by the director equipment receiving a plurality of videos collected by the camera array and subjected to coordinate correction, splicing, fusion and chromatic aberration compensation;
and the director equipment sends the obtained surrounding video to a live broadcast server so that the live broadcast server carries out live broadcast on the surrounding video.
Preferably, the surround video is: the video is a 360-degree cylindrical surround video or a spherical surround video with a preset angle.
The invention also provides a video interactive live broadcast system, which comprises: the system comprises a live video sending module, a live video receiving module, a visual angle switching instruction generating module, a visual angle information acquiring module and a visual angle switching module; wherein the content of the first and second substances,
the live video sending module is used for the live server to send the surrounding video to the client terminal;
the live video receiving module is used for receiving and decoding the surround video by the client terminal and displaying partial angle video of the surround video on a display screen of the client terminal;
the visual angle switching instruction generating module is used for detecting a sliding gesture of a user on a display screen by the client terminal and generating a display visual angle switching instruction according to the sliding gesture;
the visual angle information acquisition module is used for the client terminal to acquire the current display visual angle information of the video with the partial angle and calculate the target display visual angle information at the next moment according to the display visual angle switching instruction and the current display visual angle information;
and the visual angle switching module is used for acquiring the video of the target visual angle and switching and displaying the video of the target display visual angle by the client terminal according to the target display visual angle information at the next moment.
Preferably, the viewing angle switching module further comprises: a transition video generation module and a transition video display module; wherein the content of the first and second substances,
the transition video generation module is used for calculating the number of transition visual angles of an interval between the current display visual angle information and the target display visual angle information by the client terminal and generating a transition video according to the number of the transition visual angles;
and the transition video display module is used for gradually switching the client terminal to display the video of the partial angle corresponding to the target display visual angle from the video of the partial angle corresponding to the current display visual angle through displaying the transition video.
Preferably, the method further comprises the following steps: a transition video sharing module;
the transition video sharing module is used for detecting whether a user triggers a sharing button of a transition video or not by the client terminal, and if so, sharing the transition video.
Preferably, the method further comprises the following steps: the zooming gesture detection module and the zooming video display module; wherein the content of the first and second substances,
the zooming gesture detection module is used for detecting a zooming gesture of a user on a display screen by the client terminal and generating a video zooming instruction according to the zooming gesture;
and the zooming video display module is used for generating a zooming video by the client terminal according to the zooming instruction of the display video and displaying the zooming video on a display screen.
Preferably, the method further comprises the following steps: the system comprises a camera array and a broadcast directing device; wherein the content of the first and second substances,
the camera array is used for acquiring a plurality of videos;
the director equipment is used for receiving a surrounding video obtained by coordinate correction, splicing, fusion and chromatic aberration compensation of a plurality of videos collected by the camera array; and the system is also used for sending the obtained surround video to a live broadcast server so that the live broadcast server carries out live broadcast on the surround video.
Preferably, the surround video is: the video is a 360-degree cylindrical surround video, a cylindrical surround video with a preset angle, or a spherical surround video.
Compared with the prior art, the invention has the following advantages:
(1) according to the video interactive live broadcast method and system, a user can independently select the visual angle for watching the video and can freely switch the visual angle for displaying the video;
(2) compared with the method and the system for video interactive live broadcast, which send instructions to the live broadcast server by the user terminal to request videos with different viewing angles, the method and the system provided by the invention do not increase network load and the computational complexity of the live broadcast server;
(3) the video interactive live broadcasting method and system can rapidly complete the visual angle switching of the displayed video.
Of course, it is not necessary for any product in which the invention is practiced to achieve all of the above-described advantages at the same time.
Drawings
Embodiments of the invention are further described below with reference to the accompanying drawings:
fig. 1 is a schematic diagram of a video live broadcast method in the prior art;
fig. 2 is a flowchart of a video interactive live broadcasting method according to an embodiment of the present invention;
fig. 3 is a schematic diagram of the arrangement of the camera array according to an embodiment of the present invention;
fig. 4 is a schematic diagram of a video currently displayed by the client terminal, a transition video in the process of switching the viewing angle, and a video displayed at the next moment of the client terminal after the display viewing angle is switched according to an embodiment of the present invention;
FIG. 5 is a diagram illustrating display effects before and after video scaling according to an embodiment of the present invention;
fig. 6 is a diagram of display effects before and after video enlargement according to an embodiment of the present invention.
Detailed Description
The following examples are given for the detailed implementation and specific operation of the present invention, but the scope of the present invention is not limited to the following examples.
As shown in fig. 1, in the prior art, M (M is a positive integer greater than 1) cameras at different positions are arranged on a live broadcast site, the M cameras are connected to the same broadcast directing equipment, and the broadcast directing equipment controls the cameras to simultaneously acquire M channels of video images and receives the M channels of video images; the method comprises the steps that a broadcast guide device automatically or manually selects N paths of videos (N is a positive integer larger than 1 and smaller than or equal to M) in M paths of video images, the N paths of videos are spliced and synthesized to generate a path of target video image, the target image is transmitted to a live broadcast server, and the live broadcast server sends the target video to a user terminal according to a request of a user.
In this way, although a plurality of cameras capture images of a plurality of viewing angles, the video specifically selected from which viewing angle or angles is determined by the director, and the user cannot autonomously select the video corresponding to the desired viewing angle or freely switch the viewing angle of the viewed video.
Embodiments of the present invention are further described below with reference to the accompanying drawings.
Fig. 2 is a flowchart illustrating a video interactive live broadcasting method according to an embodiment of the present invention.
Referring to fig. 2, the video interactive live broadcasting method of the present embodiment includes the following steps:
s11: the client terminal receives and decodes the surround video sent by the live broadcast server, and displays the video of partial angles of the surround video on a display screen;
the surround video is a compressed video after being coded, and the partial angle video can be a partial angle video of a default angle or a partial angle video of an angle manually selected by a user;
s12: the client terminal detects a sliding gesture of a user on a display screen and generates a display visual angle switching instruction according to the sliding gesture;
s13: the client terminal acquires current display visual angle information of a video with partial angles, and calculates target display visual angle information at the next moment according to a display visual angle switching instruction and the current display visual angle information;
s14: and the client terminal acquires the video of the target visual angle according to the target display visual angle information at the next moment and switches and displays the video of the target display visual angle.
In one embodiment, the surround video in S11 is a surround video pre-stored in the live server or a surround video generated in real time by the receiving director device and sent to the live server.
In a preferred embodiment, the surround video in S11 may be a 360-degree cylindrical surround video, a cylindrical surround video with a preset angle, or a spherical surround video.
In one embodiment, the surround video may be generated in the director device in the following manner:
arranging M cameras around a shooting target, wherein the shooting direction of the cameras is aligned to the shooting target; the shooting target can be a specific person or a specific object, such as: when a dance video is shot, the shooting target is a dance actor; when shooting a basketball game, shooting the whole sports field as a target; the M cameras can surround the shot target in a one-dimensional mode or surround the shot target in a multi-dimensional mode, the shot target can be surrounded by a cylindrical surface, a spherical surface or a rectangle, and the surrounding angle can be any angle of 0-360 degrees.
When shooting a shot object or a person, the number and arrangement mode of the cameras required by the camera array can be selected according to specific needs, as shown in fig. 3, when only a common 360-degree surrounding video needs to be shot, a plurality of cameras can be arranged in 360-dimensional arrangement around the shot object or person, that is, arranged in the left-side mode of fig. 3; when a high-quality 360-degree surround video needs to be shot, a plurality of cameras can be arranged in 360-degree three-dimensional arrangement around a subject or person, namely, arranged in the right-hand manner of fig. 3. When only partial angle surround video is required, the number of cameras can be reduced.
Taking a three-dimensional mode to carry out 360-degree cylindrical surface surrounding on a target as an example, assuming that a shooting target is an independent dancer, the number M of cameras is 36, 12 cameras (the serial numbers of the cameras are 1-12) are uniformly arranged in a range of 360 degrees around the independent dancer at the ground level outside a certain distance (for example, 10 meters) from the performance center of the dancer, 12 cameras (the serial numbers of the cameras are 13-24) are uniformly arranged in a range of 360 degrees around the independent dancer at a position 0.8 meter away from the ground, and 12 cameras (the serial numbers of the cameras are 23-36) are uniformly arranged in a range of 360 degrees around the independent dancer at a position 1.6 meters away from the ground, wherein the 36 cameras jointly form a camera array for collecting live video in real time; the M cameras are all connected with the same director equipment through a network, and when the surround video is shot, the director equipment simultaneously sends synchronous shooting instructions to the M cameras to control the M cameras to collect M videos; the director equipment receives the M videos, performs coordinate correction on the M videos, and performs splicing, fusion and chromatic aberration compensation on corrected video information to generate a 360-degree cylindrical surrounding video; when the camera is surrounded by a spherical surface, a spherical surrounding video is generated; the horizontal shooting range of each camera is slightly larger than 30 degrees, so that 12 paths of videos shot by 12 cameras in the horizontal direction can be spliced into a complete 360-degree surrounding video. The surround video further comprises camera number information and video number information of part of angles in the surround video corresponding to the camera number information. And sending the surround video (the 360-degree cylindrical surround video or the spherical surround video) to a live broadcast server so that the live broadcast server can live the surround video.
In other embodiments, the surround video is still a cylindrical surround video, and the preset surround angle is 60 degrees; assuming that a shooting target is a network anchor, three cameras (numbered 1-3) are arranged to carry out video shooting on the network anchor, wherein the No. 2 camera is over against the front side of the network anchor, the No. 1 and the No. 3 cameras are respectively arranged on the left side and the right side of the No. 2 camera, and an included angle between a connecting line between the No. 1 camera and the network anchor and a connecting line between the No. 2 camera and the network anchor is 30 degrees; and the included angle between the connecting line between the No. 3 camera and the network anchor and the included angle between the connecting line between the No. 2 camera and the network anchor are also 30 degrees.
In one embodiment, when the surround video is displayed on the display in S11, only a part of the angle of the video is displayed, and the size of the display angle may be determined according to the size of the display screen or may be manually set by the user. Take 360 degrees cylinder around video of shooting the independent actor for example, the display screen at customer end can only show 90 degrees around video in 360 degrees cylinder around video when the size of detection screen discovers that the display screen of customer end to the corresponding camera serial number of independent actor front is: 1,13, 25. Then the sum of the numbers in the 360 degree cylindrical surround video should be displayed as: 12,1, 2; 24,13, 14; 36,25 and 26, and displaying the videos shot by the cameras with the camera numbers 1,13 and 25 at the middle position of the display screen.
In a preferred embodiment, the client terminal in S12 detects a sliding gesture of the user on the display screen, including detecting: the sliding direction and the sliding amplitude;
reviewing a display visual angle switching instruction according to the sliding direction and the sliding amplitude, wherein the display visual angle switching instruction comprises: sliding direction information and sliding magnitude. Wherein, the sliding direction can be left, right, down, up and other directions; the sliding amplitude is divided into three grades, which are respectively: small, normal, large.
The sliding amplitude is obtained by calculating the sliding speed and the sliding distance length grade when the user slides on the display screen; the sliding speed and the length grade of the sliding distance comprise three grades of small, medium and large, specifically, when the duration of the sliding process is less than 0.2 second, the sliding speed is small, when the duration is 0.2-0.5 second, the sliding speed is medium, and when the duration is more than 0.5 second, the sliding speed is large; the length grade of the sliding distance is small when the sliding distance is less than 1 cm, the length grade of the sliding distance is medium when the sliding distance is less than 3 cm, and the length grade of the sliding distance is large when the sliding distance is more than 3 cm.
When the length grade of the sliding distance is large, the sliding amplitude is large no matter which grade the sliding speed is at; when the length scale of the sliding distance is medium, the sliding speed is small, and the sliding amplitude is large. When the length grade of the sliding distance is small, the sliding amplitude is small no matter which grade the sliding speed is at; when the length scale of the sliding distance is medium, and the sliding speed is large, the sliding amplitude is small. In other cases than the above, the sliding amplitude is normal.
Specifically, when leftward sliding is detected and the sliding amplitude is small, a display view angle switching instruction is generated, which includes sliding direction information: leftward, sliding amplitude: is small.
In one embodiment, the step of obtaining the current display viewing angle information in S13 includes: and the camera number corresponding to the video of the display screen is arranged in the middle of the display screen. As shown in fig. 4, the uppermost image in fig. 4 represents a video corresponding to the current display angle, and at this time, the camera numbers corresponding to the video of the display screen at the middle position of the display screen are 1,13, and 25, so that the current display angle information is:
1,13,25. The user then slides the video on the display screen to the right by a small amount. According to the current display visual angle information: 1,13,25, and the sliding direction information in the display view angle switching instruction: rightward, and sliding amplitude information: and calculating the display visual angle information at the next moment. Since the sliding direction is rightward, the display view angle information at the next moment should be the camera numbers of the left sides of the cameras 1,13 and 25; when the sliding amplitude is small, the camera with 3 numbers needs to be moved in sequence, so that the information of the display visual angle at the next moment is as follows: 10,22, 34; in addition, when the sliding amplitude information is: when normal or large, the camera with 6 numbers needs to be moved in sequence and the camera with 9 numbers needs to be moved in sequence respectively.
In one embodiment, in S14, the target display viewing angle information at the next moment is: 10,22,34, then the next time 360 degree cylindrical surround video should be displayed with the numbers: 9,10, 11; 21,22, 23; 33,34 and 35, and displaying the videos shot by the cameras with the camera numbers of 10,22 and 34 at the middle position of the display screen. Therefore, displaying the target display video at the next moment is specifically: the sum numbers in displaying the 360-degree cylindrical surrounding video are as follows: 9,10, 11; 21,22, 23; 33,34 and 35, displaying the videos shot by the cameras with the camera numbers of 10,22 and 34 at the middle position of the display screen; the lowermost image in fig. 4 represents a video corresponding to the target view angle.
In one embodiment, S14 further includes:
s141: the client terminal calculates the number of transition visual angles of an interval between the current display visual angle information and the target display visual angle information, and generates a transition video according to the number of the transition visual angles;
s142: and the client terminal gradually switches to display the video of the partial angle corresponding to the target display visual angle from displaying the video of the partial angle corresponding to the current display visual angle through displaying the transition video.
In a preferred embodiment, the generating the transition video according to the number of transition views specifically includes:
and acquiring the length of the transition video to be generated. The transition video may be of a length: system defaults, such as: any value between 0 and 1 second; or may be a value set by the user himself.
Determining the video length required to be sent of each transition view according to the number of the transition views and the length of the transition video: l is L/V; wherein L is the length of the video to be displayed at each transition visual angle, L is the length of the transition video, and V is the number of the transition visual angles;
determining the number of video frames required to be displayed at each view angle according to the length of the video required to be displayed at each transition view angle and the current frame rate of the video: f ═ l × F; wherein, F is the number of video frames to be transmitted at each visual angle, and F is the current frame rate of the video; "+" is a multiplication number.
Respectively extracting F frame videos from each transition visual angle to generate new transition videos, wherein the total video frame number of the transition videos is as follows: v F.
Also taking the cylindrical surround video as an example, the above process is specifically expressed as:
because the current display visual angle information is as follows: 1,13,25, and the target display viewing angle information is: 4,16,28, and two transition viewing angles are spaced between them, respectively: 2,14, 26; and 3,15, 27. Assume that the length of the transition video to be generated is: 0.6 second; the current frame rate of the video is: 30 frames/second; then, the video length that needs to be transmitted per transition view: 0.6 sec/2-0.3 sec; the number of video frames required to be displayed for each view is: 0.3 sec 30 frames/sec 9 frames; that is, the transition video includes video frames of 8 views 2,14,26 and video frames of 8 views 3,15,27, for a total of 16 frames of video.
The client terminal gradually switches to the video of the partial angle corresponding to the target display visual angle from displaying the video of the partial angle corresponding to the current display visual angle through displaying the transition video, and specifically comprises the following steps:
when the display video of the display target display visual angle is switched, the part of the angle video corresponding to the current display visual angle (1,13,25), namely the display number is: 12,1, 2; 24,13, 14; 36,25 and 26, partial videos of the corresponding positions of the videos shot by the cameras; transition videos corresponding to two transition views (views 2,14,26 and views 3,15,27) are displayed, namely the display numbers are: 1,2, 3; 13,14, 15; the 8 frames of videos of the corresponding positions of the videos shot by the cameras 25,26 and 27, and the numbers are: 2,3, 4; 14,15, 16; 26,27 and 28 cameras shoot transition videos consisting of 8 frames of videos at corresponding positions of the videos; gradually displaying the partial angle video corresponding to the target display visual angle (4,16,28) on the screen, namely numbering as: 3,4, 5; 15,16, 17; 27,28 and 29 cameras shoot partial videos of corresponding positions of the videos.
As shown in fig. 4, the transition video represented by the middle two images in fig. 4 is displayed on the display screen;
that is, it is assumed that the video currently displayed by the client terminal is the video shown by the top image in fig. 4, at this time, the user slides the video in the display screen, the client terminal generates the transition video and the video of the target view angle, then the client terminal displays the transition video, that is, the transition video shown by the middle two images in fig. 4, and after the transition video is displayed, the video corresponding to the target view angle is continuously displayed, that is, the video corresponding to the target view angle is shown by the bottom image in fig. 4. And the client terminal stops the display picture on the video corresponding to the target visual angle and continues to wait for the next operation of the user on the display video.
In a preferred embodiment, S14 is followed by:
s31: the client terminal detects whether the user triggers a sharing button of the transition video, and if yes, the transition video is shared.
The sharing button may be a software button or a hardware button, or may be a gesture with a certain characteristic, for example, a V-shaped gesture drawn on the screen by the user. The transition video is shared, the client terminal can send the transition video to a live broadcast server, and the live broadcast server sends the transition video to other client terminals; social media may also be passed through, for example: wechat, a microblog and the like are sent to other users, and can also be published on social media of the account corresponding to the current client terminal, for example, in a WeChat friend circle corresponding to the current client terminal.
In a preferred embodiment, S14 is followed by:
s41: the client terminal detects a zooming gesture of a user on a display screen and generates a video zooming instruction according to the zooming gesture;
s42: the client terminal generates a zoom video according to the zoom instruction of the display video and displays the zoom video on a display screen; the generating of the zoom video specifically includes: when the zooming gesture contained in the zooming instruction is a zooming-out gesture, generating a zooming-out video; and when the zooming gesture contained in the zooming instruction is a zooming-in gesture, generating a zoomed-in video. FIG. 5 illustrates an effect diagram of a video display before and after zooming out; fig. 6 shows an effect diagram of an enlarged video display.
The zoom gesture may include: a zoom-out gesture and a zoom-in gesture.
In a preferred embodiment, the zoom-out gesture may be: two fingers slide on the display screen in a direction of closing, and the magnification gesture can be: two fingers slide on the display screen in a direction away.
The invention also provides a video interactive live broadcast system, which comprises: the system comprises a live video sending module, a live video receiving module, a visual angle switching instruction generating module, a visual angle information acquiring module and a visual angle switching module. The live video sending module is used for the live server to send the surrounding video to the client terminal; the live video receiving module is used for receiving and decoding the surrounding video by the client terminal and displaying partial angle video of the surrounding video on a display screen of the client terminal; the visual angle switching instruction generating module is used for detecting a sliding gesture of a user on the display screen by the client terminal and generating a display visual angle switching instruction according to the sliding gesture; the visual angle information acquisition module is used for the client terminal to acquire current display visual angle information of the video with partial angles and calculate target display visual angle information at the next moment according to the display visual angle switching instruction and the current display visual angle information; and the visual angle switching module is used for acquiring the video of the target visual angle and switching and displaying the video of the target display visual angle by the client terminal according to the target display visual angle information at the next moment.
In a preferred embodiment, the video interactive live system further comprises: camera array and director equipment. The camera array is used for acquiring a plurality of videos; the director equipment is used for receiving a surrounding video obtained by coordinate correction, splicing, fusion and chromatic aberration compensation of a plurality of videos collected by the camera array; and the system is also used for sending the obtained surround video to a live broadcast server so that the live broadcast server carries out live broadcast on the surround video.
In a preferred embodiment, the surround video may be a 360-degree cylindrical surround video, a cylindrical surround video with a preset angle, or a spherical surround video.
In a preferred embodiment, the surround video is a surround video pre-stored in a live server or a surround video which is generated in real time by a receiving director device and is sent to the live server; in the interactive video live broadcast system, the process of generating the surround video in real time by the director equipment corresponds to the process of generating the surround video in real time by the director equipment in the method embodiment.
In a preferred embodiment, the view switching module further comprises: transition video generation module and transition video display module. The transition video generation module is used for calculating the number of transition visual angles of an interval between current display visual angle information and target display visual angle information by the client terminal and generating a transition video according to the number of the transition visual angles; and the transition video display module is used for gradually switching the client terminal to display the video of the partial angle corresponding to the target display visual angle through displaying the transition video from the video of the partial angle corresponding to the current display visual angle.
In a preferred embodiment, the video interactive live system further comprises: a transition video sharing module; the method is used for detecting whether a user triggers a sharing button of the transition video or not by the client terminal, and if so, the transition video is shared.
In a preferred embodiment, the video interactive live system further comprises: the zooming gesture detection module and the zooming video display module. The client terminal is used for detecting a zooming gesture of a user on the display screen and generating a video zooming instruction according to the zooming gesture; and the zooming video display module is used for generating a zooming video by the client terminal according to the zooming instruction of the display video and displaying the zooming video on the display screen.
In the video interactive live broadcasting system, further related specific operation processes correspond to the specific operation processes related to the video interactive live broadcasting method in the method embodiment, and are not described herein again.
The embodiments were chosen and described in order to best explain the principles of the invention and the practical application, and not to limit the invention. Any modifications and variations within the scope of the description, which may occur to those skilled in the art, are intended to be within the scope of the invention.
Claims (12)
1. A video interactive live broadcasting method is characterized by comprising the following steps:
s11: the client terminal receives and decodes the surround video sent by the live broadcast server, and displays the video of partial angles of the surround video on a display screen;
s12: the method comprises the steps that a client terminal detects a sliding gesture of a user on a display screen, and a display visual angle switching instruction is generated according to the sliding gesture;
s13: the client terminal acquires the current display visual angle information of the video with the partial angle, and calculates the target display visual angle information at the next moment according to the display visual angle switching instruction and the current display visual angle information;
s14: and the client terminal acquires the video of the target visual angle according to the target display visual angle information at the next moment and switches and displays the video of the target display visual angle.
2. The video interactive live broadcasting method of claim 1, wherein the S14 further comprises:
s141: the client terminal calculates the number of transition visual angles of an interval between the current display visual angle information and the target display visual angle information, and generates a transition video according to the number of the transition visual angles;
s142: and the client terminal gradually switches to display the video of the partial angle corresponding to the target display visual angle from displaying the video of the partial angle corresponding to the current display visual angle through displaying the transition video.
3. The interactive live video broadcasting method of claim 2, wherein the S14 further comprises:
s31: and the client terminal detects whether the user triggers a sharing button of the transition video, and if so, the transition video is shared.
4. The interactive live video broadcasting method according to claim 1, wherein said S14 is followed by further comprising:
s41: the client terminal detects a zooming gesture of a user on a display screen and generates a video zooming instruction according to the zooming gesture;
s42: and the client terminal generates a zoom video according to the zoom instruction of the display video and displays the zoom video on a display screen.
5. The video interaction live broadcasting method according to claim 1, wherein the surround video is a video obtained by a video director receiving a plurality of videos collected by a camera array through coordinate correction, splicing, fusion and chromatic aberration compensation;
and the director equipment sends the obtained surrounding video to a live broadcast server so that the live broadcast server carries out live broadcast on the surrounding video.
6. The video interactive live broadcasting method of any one of claims 1 to 5, wherein the surround video is: the video is a 360-degree cylindrical surround video or a spherical surround video with a preset angle.
7. A video interactive live system, comprising: the system comprises a live video sending module, a live video receiving module, a visual angle switching instruction generating module, a visual angle information acquiring module and a visual angle switching module; wherein the content of the first and second substances,
the live video sending module is used for the live server to send the surrounding video to the client terminal;
the live video receiving module is used for receiving and decoding the surround video by the client terminal and displaying partial angle video of the surround video on a display screen of the client terminal;
the visual angle switching instruction generating module is used for detecting a sliding gesture of a user on a display screen by the client terminal and generating a display visual angle switching instruction according to the sliding gesture;
the visual angle information acquisition module is used for the client terminal to acquire the current display visual angle information of the video with the partial angle and calculate the target display visual angle information at the next moment according to the display visual angle switching instruction and the current display visual angle information;
and the visual angle switching module is used for acquiring the video of the target visual angle and switching and displaying the video of the target display visual angle by the client terminal according to the target display visual angle information at the next moment.
8. The interactive live video system of claim 7, wherein the view switching module further comprises: a transition video generation module and a transition video display module; wherein the content of the first and second substances,
the transition video generation module is used for calculating the number of transition visual angles of an interval between the current display visual angle information and the target display visual angle information by the client terminal and generating a transition video according to the number of the transition visual angles;
and the transition video display module is used for gradually switching the client terminal to display the video of the partial angle corresponding to the target display visual angle from the video of the partial angle corresponding to the current display visual angle through displaying the transition video.
9. The interactive live video system of claim 8, further comprising: a transition video sharing module;
the transition video sharing module is used for detecting whether a user triggers a sharing button of a transition video or not by the client terminal, and if so, sharing the transition video.
10. The interactive live video system of claim 7, further comprising: the zooming gesture detection module and the zooming video display module; wherein the content of the first and second substances,
the zooming gesture detection module is used for detecting a zooming gesture of a user on a display screen by the client terminal and generating a video zooming instruction according to the zooming gesture;
and the zooming video display module is used for generating a zooming video by the client terminal according to the zooming instruction of the display video and displaying the zooming video on a display screen.
11. The interactive live video system of claim 7, further comprising: the system comprises a camera array and a broadcast directing device; wherein the content of the first and second substances,
the camera array is used for acquiring a plurality of videos;
the director equipment is used for receiving a surrounding video obtained by coordinate correction, splicing, fusion and chromatic aberration compensation of a plurality of videos collected by the camera array; and the system is also used for sending the obtained surround video to a live broadcast server so that the live broadcast server carries out live broadcast on the surround video.
12. The video interactive live system of any one of claims 7 to 11, wherein the surround video is: the video is a 360-degree cylindrical surround video, a cylindrical surround video with a preset angle, or a spherical surround video.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010073057.XA CN111263177A (en) | 2020-01-22 | 2020-01-22 | Video interactive live broadcast method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010073057.XA CN111263177A (en) | 2020-01-22 | 2020-01-22 | Video interactive live broadcast method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111263177A true CN111263177A (en) | 2020-06-09 |
Family
ID=70950991
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010073057.XA Pending CN111263177A (en) | 2020-01-22 | 2020-01-22 | Video interactive live broadcast method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111263177A (en) |
Cited By (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111698436A (en) * | 2020-06-22 | 2020-09-22 | 杭州晶一智能科技有限公司 | Range hood capable of being used for live video and control method thereof |
| CN111918079A (en) * | 2020-07-30 | 2020-11-10 | 广州世祥教育科技有限公司 | Multi-mode live broadcast and automatic editing teaching system and method and electronic equipment |
| CN112019930A (en) * | 2020-07-26 | 2020-12-01 | 杭州皮克皮克科技有限公司 | Interactive display method and device for live video |
| CN112218174A (en) * | 2020-09-21 | 2021-01-12 | 烽火通信科技股份有限公司 | Switching method of multi-view video and server |
| CN112770130A (en) * | 2020-12-30 | 2021-05-07 | 咪咕互动娱乐有限公司 | Live broadcast control method, electronic equipment and storage equipment |
| CN113139480A (en) * | 2021-04-28 | 2021-07-20 | 艾拉物联网络(深圳)有限公司 | Gesture detection method based on improved VIBE |
| CN113676744A (en) * | 2021-07-28 | 2021-11-19 | 北京百度网讯科技有限公司 | Switching control method and device for live broadcast room, electronic equipment and storage medium |
| CN113794836A (en) * | 2021-09-09 | 2021-12-14 | 北京字节跳动网络技术有限公司 | Bullet time video generation method, device, system, equipment and medium |
| CN113810609A (en) * | 2021-09-15 | 2021-12-17 | 宁波达丽光信息科技有限公司 | Video transmission method, server, user terminal and video transmission system |
| CN114513674A (en) * | 2020-11-16 | 2022-05-17 | 上海科技大学 | Interactive live broadcast data transmission/processing method, processing system, medium and server |
| CN114979732A (en) * | 2022-05-12 | 2022-08-30 | 咪咕数字传媒有限公司 | Video stream pushing method and device, electronic equipment and medium |
| CN115379134A (en) * | 2022-10-26 | 2022-11-22 | 四川中绳矩阵技术发展有限公司 | Image acquisition device, method, equipment and medium |
| CN115550544A (en) * | 2022-08-19 | 2022-12-30 | 荣耀终端有限公司 | Image processing method and device |
| CN115550544B (en) * | 2022-08-19 | 2024-04-12 | 荣耀终端有限公司 | Image processing method and device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103051830A (en) * | 2012-12-31 | 2013-04-17 | 北京中科大洋科技发展股份有限公司 | System and method for multi-angle real-time rebroadcasting of shot targets |
| CN106254916A (en) * | 2016-08-09 | 2016-12-21 | 乐视控股（北京）有限公司 | Live play method and device |
| CN106550239A (en) * | 2015-09-22 | 2017-03-29 | 北京同步科技有限公司 | 360 degree of panoramic video live broadcast systems and its implementation |
| CN106873933A (en) * | 2017-02-24 | 2017-06-20 | 联想(北京)有限公司 | Display methods and electronic equipment |
| CN106921864A (en) * | 2015-12-25 | 2017-07-04 | 北京奇虎科技有限公司 | Video broadcasting method and device |
| CN107694087A (en) * | 2017-10-23 | 2018-02-16 | 网易（杭州）网络有限公司 | Information processing method and terminal device |
| CN108170295A (en) * | 2017-12-21 | 2018-06-15 | 网易（杭州）网络有限公司 | Virtual camera condition control method, device, electronic equipment and storage medium |
| CN108616557A (en) * | 2016-12-13 | 2018-10-02 | 中兴通讯股份有限公司 | A kind of panoramic video transmission method, device, terminal, server and system |
| CN108920084A (en) * | 2018-06-29 | 2018-11-30 | 网易（杭州）网络有限公司 | Visual field control method and device in a kind of game |
-
2020
- 2020-01-22 CN CN202010073057.XA patent/CN111263177A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103051830A (en) * | 2012-12-31 | 2013-04-17 | 北京中科大洋科技发展股份有限公司 | System and method for multi-angle real-time rebroadcasting of shot targets |
| CN106550239A (en) * | 2015-09-22 | 2017-03-29 | 北京同步科技有限公司 | 360 degree of panoramic video live broadcast systems and its implementation |
| CN106921864A (en) * | 2015-12-25 | 2017-07-04 | 北京奇虎科技有限公司 | Video broadcasting method and device |
| CN106254916A (en) * | 2016-08-09 | 2016-12-21 | 乐视控股（北京）有限公司 | Live play method and device |
| CN108616557A (en) * | 2016-12-13 | 2018-10-02 | 中兴通讯股份有限公司 | A kind of panoramic video transmission method, device, terminal, server and system |
| CN106873933A (en) * | 2017-02-24 | 2017-06-20 | 联想(北京)有限公司 | Display methods and electronic equipment |
| CN107694087A (en) * | 2017-10-23 | 2018-02-16 | 网易（杭州）网络有限公司 | Information processing method and terminal device |
| CN108170295A (en) * | 2017-12-21 | 2018-06-15 | 网易（杭州）网络有限公司 | Virtual camera condition control method, device, electronic equipment and storage medium |
| CN108920084A (en) * | 2018-06-29 | 2018-11-30 | 网易（杭州）网络有限公司 | Visual field control method and device in a kind of game |
Cited By (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111698436A (en) * | 2020-06-22 | 2020-09-22 | 杭州晶一智能科技有限公司 | Range hood capable of being used for live video and control method thereof |
| CN112019930A (en) * | 2020-07-26 | 2020-12-01 | 杭州皮克皮克科技有限公司 | Interactive display method and device for live video |
| CN111918079A (en) * | 2020-07-30 | 2020-11-10 | 广州世祥教育科技有限公司 | Multi-mode live broadcast and automatic editing teaching system and method and electronic equipment |
| CN112218174A (en) * | 2020-09-21 | 2021-01-12 | 烽火通信科技股份有限公司 | Switching method of multi-view video and server |
| CN112218174B (en) * | 2020-09-21 | 2022-11-08 | 烽火通信科技股份有限公司 | Switching method of multi-view video and server |
| CN114513674A (en) * | 2020-11-16 | 2022-05-17 | 上海科技大学 | Interactive live broadcast data transmission/processing method, processing system, medium and server |
| CN112770130A (en) * | 2020-12-30 | 2021-05-07 | 咪咕互动娱乐有限公司 | Live broadcast control method, electronic equipment and storage equipment |
| CN112770130B (en) * | 2020-12-30 | 2022-10-14 | 咪咕互动娱乐有限公司 | Live broadcast control method, electronic equipment and storage equipment |
| CN113139480A (en) * | 2021-04-28 | 2021-07-20 | 艾拉物联网络(深圳)有限公司 | Gesture detection method based on improved VIBE |
| CN113139480B (en) * | 2021-04-28 | 2022-03-15 | 艾拉物联网络(深圳)有限公司 | Gesture detection method based on improved VIBE |
| CN113676744A (en) * | 2021-07-28 | 2021-11-19 | 北京百度网讯科技有限公司 | Switching control method and device for live broadcast room, electronic equipment and storage medium |
| CN113794836A (en) * | 2021-09-09 | 2021-12-14 | 北京字节跳动网络技术有限公司 | Bullet time video generation method, device, system, equipment and medium |
| CN113794836B (en) * | 2021-09-09 | 2023-10-13 | 北京字节跳动网络技术有限公司 | Bullet time video generation method, device, system, equipment and medium |
| CN113810609A (en) * | 2021-09-15 | 2021-12-17 | 宁波达丽光信息科技有限公司 | Video transmission method, server, user terminal and video transmission system |
| CN113810609B (en) * | 2021-09-15 | 2023-09-08 | 宁波达丽光信息科技有限公司 | Video transmission method, server, user terminal and video transmission system |
| CN114979732A (en) * | 2022-05-12 | 2022-08-30 | 咪咕数字传媒有限公司 | Video stream pushing method and device, electronic equipment and medium |
| CN114979732B (en) * | 2022-05-12 | 2023-10-20 | 咪咕数字传媒有限公司 | Video stream pushing method and device, electronic equipment and medium |
| CN115550544A (en) * | 2022-08-19 | 2022-12-30 | 荣耀终端有限公司 | Image processing method and device |
| CN115550544B (en) * | 2022-08-19 | 2024-04-12 | 荣耀终端有限公司 | Image processing method and device |
| CN115379134A (en) * | 2022-10-26 | 2022-11-22 | 四川中绳矩阵技术发展有限公司 | Image acquisition device, method, equipment and medium |
| CN115379134B (en) * | 2022-10-26 | 2023-02-03 | 四川中绳矩阵技术发展有限公司 | Image acquisition device, method, equipment and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111263177A (en) | Video interactive live broadcast method and system | |
| US10438633B2 (en) | Method and system for low cost television production | |
| Uyttendaele et al. | Image-based interactive exploration of real-world environments | |
| CN101552874B (en) | Image processing apparatus, display control method, program, and storage medium | |
| US20020054211A1 (en) | Surveillance video camera enhancement system | |
| US20080109729A1 (en) | Method and apparatus for control and processing of video images | |
| CN109587401B (en) | Electronic cloud deck multi-scene shooting implementation method and system | |
| WO2012037075A1 (en) | Method of presenting three-dimensional content with disparity adjustments | |
| JP6622650B2 (en) | Information processing apparatus, control method therefor, and imaging system | |
| US10764493B2 (en) | Display method and electronic device | |
| JP2014529930A (en) | Selective capture and display of a portion of a native image | |
| JP2006119408A (en) | Video display method and device | |
| CN105635675A (en) | Panorama playing method and device | |
| KR20150097609A (en) | Immersion communication client and server, and method for obtaining content view | |
| CN113099245A (en) | Panoramic video live broadcast method, system and computer readable storage medium | |
| CN106254940A (en) | Play the method and device of panorama content | |
| CN101090460B (en) | Method for switchover between multiple full view image | |
| CN113286138A (en) | Panoramic video display method and display equipment | |
| JP5370380B2 (en) | Video display method and video display device | |
| CN111147883A (en) | Live broadcast method and device, head-mounted display equipment and readable storage medium | |
| CN113259764A (en) | Video playing method, video playing device, electronic equipment and video playing system | |
| CN113963094A (en) | Depth map and video processing and reconstruction method, device, equipment and storage medium | |
| CN112887603B (en) | Shooting preview method and device and electronic equipment | |
| CN113452913B (en) | Zooming system and method | |
| US10674207B1 (en) | Dynamic media placement in video feed |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200609 |
|
| WD01 | Invention patent application deemed withdrawn after publication |