CN113794836A

CN113794836A - Bullet time video generation method, device, system, equipment and medium

Info

Publication number: CN113794836A
Application number: CN202111057559.4A
Authority: CN
Inventors: 金友芝
Original assignee: Beijing ByteDance Network Technology Co Ltd
Current assignee: Beijing ByteDance Network Technology Co Ltd
Priority date: 2021-09-09
Filing date: 2021-09-09
Publication date: 2021-12-14
Anticipated expiration: 2041-09-09
Also published as: CN113794836B

Abstract

The embodiment of the disclosure discloses a bullet time video generation method, a device, a system, equipment and a medium, wherein the method is applied to a user side and comprises the following steps: if detecting bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in the free visual angle video, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame; sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from the video stream under each view angle according to the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side; the bullet time video composed of the received target video frames is played on the playing interface, so that the multi-view video with the bullet time effect can be automatically generated, the view angle does not need to be manually switched by a user, and the watching experience of the user is improved.

Description

Bullet time video generation method, device, system, equipment and medium

Technical Field

The embodiment of the disclosure relates to the internet technology, and in particular, to a method, an apparatus, a system, a device, and a medium for generating a bullet time video.

Background

With the rapid development of internet technology and the increasing demand of users, a free-view video is developed so that users can watch videos from different viewing angles. However, in the process of watching a free view video, a user can only select to watch a video stream at one view, and if the user wants to watch a picture change situation at a different view, the user needs to manually and frequently switch the watching view, which greatly reduces the watching experience of the user.

Disclosure of Invention

The embodiment of the disclosure provides a bullet time video generation method, a bullet time video generation device, a bullet time video generation system, equipment and a medium, so that a multi-view video with a bullet time effect is automatically generated, a user does not need to manually switch view angles, a video playing effect is enriched, and the watching experience of the user is improved.

In a first aspect, an embodiment of the present disclosure provides a method for generating a bullet time video, which is applied to a user side, and includes:

if detecting bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in a free visual angle video, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame;

sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from a video stream under each view angle according to current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side;

and playing a bullet time video consisting of the received target video frames on a playing interface.

In a second aspect, an embodiment of the present disclosure further provides a method for generating a bullet time video, which is applied to a media server, and includes:

receiving a bullet time video generation request sent by a user side, wherein the bullet time video generation request is determined by the user side according to current video frame identification information corresponding to a current video frame when detecting a bullet time video generation operation triggered by the user aiming at the current video frame currently displayed in a free view video;

and determining a target video frame corresponding to each bullet time point from the video stream under each visual angle according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays a bullet time video consisting of each received target video frame on a playing interface.

In a third aspect, an embodiment of the present disclosure further provides a bullet time video generating device, integrated at a user end, including:

the bullet time video generation request determining module is used for determining a bullet time video generation request according to current video frame identification information corresponding to a current video frame if a bullet time video generation operation triggered by a user aiming at the current video frame currently displayed in a free view video is detected;

a bullet time video generation request sending module, configured to send the bullet time video generation request to a media server, so that the media server determines, according to current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from a video stream at each view angle, and sends each target video frame corresponding to each bullet time point to the user side;

and the bullet time video playing module is used for playing a bullet time video consisting of the received target video frames on a playing interface.

In a fourth aspect, an embodiment of the present disclosure further provides a bullet time video generating apparatus, integrated in a media server, including:

the bullet time video generation request receiving module is used for receiving a bullet time video generation request sent by a user side, wherein the bullet time video generation request is determined by the user side according to current video frame identification information corresponding to a current video frame when detecting a bullet time video generation operation triggered by the user aiming at the current video frame currently displayed in a free view video;

and the target video frame sending module is used for determining a target video frame corresponding to each bullet time point from the video stream under each visual angle according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays the bullet time video consisting of each received target video frame on a playing interface.

In a fifth aspect, an embodiment of the present disclosure further provides a bullet time video generation system, where the system includes: a user terminal and a media server;

wherein the user terminal is configured to implement the bullet time video generation method according to the first aspect of the present disclosure;

the media server is used for realizing the bullet time video generation method provided by the second aspect of the disclosure.

In a sixth aspect, an embodiment of the present disclosure further provides an electronic device, where the electronic device includes:

one or more processors;

a memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement a bullet time video generation method as in any of the embodiments of the present disclosure.

In a seventh aspect, the disclosed embodiments also provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the bullet time video generation method according to any one of the disclosed embodiments.

According to the technical scheme, when detecting bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in a free visual angle video, a user side determines a bullet time video generation request according to current video frame identification information corresponding to the current video frame, and sends the bullet time video generation request to a media server. And the media server determines a target video frame corresponding to each bullet time point from the video stream under each visual angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side. The user side plays the bullet time video consisting of the received target video frames on the playing interface, so that the automatic generation of the bullet time video is realized, a user can directly watch the multi-view video with the bullet time effect, the view angle does not need to be manually switched by the user, the video playing effect is enriched, and the watching experience of the user is improved.

Drawings

The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and features are not necessarily drawn to scale.

Fig. 1 is a flowchart of a method for generating a sub-bomb-time video according to an embodiment of the disclosure;

fig. 2 is a flowchart of a method for generating a sub-bomb-time video according to a second embodiment of the disclosure;

fig. 3 is an example of a process for generating a sub-bomb-time video according to a second embodiment of the disclosure;

fig. 4 is a schematic structural diagram of a bullet time video generating apparatus according to a third embodiment of the present disclosure;

fig. 5 is a schematic structural diagram of a bullet time video generating apparatus according to a fourth embodiment of the present disclosure;

fig. 6 is a schematic structural diagram of a bullet time video generation system according to a fifth embodiment of the present disclosure;

fig. 7 is a schematic structural diagram of an electronic device according to a sixth embodiment of the present disclosure.

Detailed Description

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.

It should be understood that the various steps recited in the method embodiments of the present disclosure may be performed in a different order, and/or performed in parallel. Moreover, method embodiments may include additional steps and/or omit performing the illustrated steps. The scope of the present disclosure is not limited in this respect.

The term "include" and variations thereof as used herein are open-ended, i.e., "including but not limited to". The term "based on" is "based, at least in part, on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions for other terms will be given in the following description.

It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence relationship of the functions performed by the devices, modules or units.

It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.

The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.

Example one

Fig. 1 is a flowchart of a method for generating a bullet time video according to an embodiment of the present disclosure, which is applicable to a case where a multi-view video with a bullet time effect is generated for a free-view video, and especially applicable to an application scenario where a bullet time video is generated in a live or on-demand free-view video. The method can be executed by a bullet time video generating device, which can be implemented by software and/or hardware, and is integrated in a user terminal. As shown in fig. 1, the method specifically includes the following steps:

s110, if a bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in the free view video is detected, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame.

The free-view video may be a video shot in real time, that is, a live video. For example, live videos obtained by shooting the same object in real time by using cameras at different viewing angles. The free-view video may also be a video that has already been shot, i.e., an on-demand video. For example, the video-on-demand obtained after shooting the same object by using cameras at different viewing angles is performed in advance. The current video frame may refer to a video frame currently presented on the play interface when the bullet time video generation operation is triggered by the user. The current video frame can be used to represent the starting playing time corresponding to the bullet time video that the user wants to watch. For example, the current playing time corresponding to the current video frame may be used as the first bullet time point of the bullet time video, or the next playing time of the current playing time corresponding to the current video frame may be used as the first bullet time point of the bullet time video. Each video frame in the free-view video can be uniquely identified by using the identification information so as to distinguish the video frames at different playing moments. For example, the current video frame identification information may be, but is not limited to, a play time stamp or a frame sequence number corresponding to the current video frame. The playing time stamp may refer to a playing time at which the current video frame is located in the free-view video. The frame number may refer to a playing position of the current video frame in the video stream at the current viewing angle.

Specifically, when a user watches a video stream at a certain viewing angle on a playing interface of a user side, if the user wants to watch a bullet time video corresponding to a certain video frame, the user may pause the video to the video frame, for example, the user may pause the video to a playing start time corresponding to the bullet time video to be generated or to be played at a playing start time in a manner of dragging a video playing progress or directly clicking the pause. The user may trigger the bullet time video generation operation in a preset trigger mode on the basis of the currently displayed current video frame after the video is paused, for example, the user may trigger the bullet time video generation operation in a mode of clicking a preset button, so that when the user detects the bullet time video generation operation triggered by the user, the user obtains a bullet time video generation request based on the current video frame identification information corresponding to the currently displayed current video frame. For example, the user terminal may generate a bullet time video generation request including a play time stamp corresponding to the current video frame, or generate a bullet time video generation request including a frame number corresponding to the current video frame.

And S120, sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from the video stream under each view angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side.

The media server may refer to a background server for storing video streams at each view angle. The bullet time point may refer to a play time in the bullet time video. The number of bullet time points may be equal to the number of viewing angles supported by the freeview video. That is, the bullet time points may correspond one-to-one with the viewing angle. The target video frame may refer to a video frame that needs to be presented at the bullet time point. The viewing visual angles corresponding to different bullet time points are different, so that the target video frames under different visual angles can be displayed at different bullet time points.

Specifically, the user side sends a bullet time video generation request to the media server, and after receiving the bullet time video generation request, the media server can determine a target video frame corresponding to each bullet time point in the rotation direction of the default view angle from the video stream corresponding to each view angle based on the current video frame identification information in the bullet time video generation request, and can send each target video frame with different viewing view angles to the user side. For example, the media server may send all the target video frames to the user side at one time, or send each target video frame to the user side one by one according to the default view angle rotation direction.

And S130, playing the bullet time video consisting of the received target video frames on the playing interface.

Specifically, after receiving all target video frames issued by the media server at one time, the user side can display each target video frame corresponding to the default view angle rotation direction on the playing interface, that is, play the bullet time video with the view angle rotation effect; and the target video frame received in real time can be displayed on the playing interface after receiving one target video frame issued by the media server, so that the time of the user waiting for playing the bullet time video is reduced. The bullet time video can be played on the playing interface by the user side in a popup window mode, so that a user can directly watch the multi-view video with a bullet time effect, the visual angle does not need to be manually switched by the user, the video playing effect is enriched, automatic generation of the bullet time video is realized, the user can trigger bullet time video generation operation aiming at the video frame at any playing time, the bullet time video corresponding to any video frame can be dynamically generated and played, the personalized requirement of the user is met, and the watching experience of the user is greatly improved.

Illustratively, S130 may include: acquiring a target playing speed selected by a user; and playing the bullet time video consisting of the received target video frames on the playing interface according to the target playing speed.

Wherein the target playing speed may refer to a speed selected by the user for playing the bullet time video. The target playing speed can be the original playing speed of the free visual angle video; or the speed is higher than the original playing speed, so that the bullet time video can be played quickly, and the playing time is reduced; it may also be a speed less than the original play speed in order to play the bullet time video slower, making it more clear for the user to view the individual target video frames.

Specifically, the user may select a target playback speed to be played back by clicking a preset button on the playback interface. The user side plays the bullet time video according to the target playing speed selected by the user, so that the personalized requirements of the user can be further met, and the watching experience of the user is further improved.

On the basis of the above technical solution, as an implementation manner of generating the bullet time video, S130 may include: receiving and caching each target video frame corresponding to a clockwise visual angle rotation direction and each target video frame corresponding to a counterclockwise visual angle rotation direction which are sent by a media server; if the clockwise watching operation triggered by the user is detected, playing a clockwise bullet time video consisting of all target video frames corresponding to the clockwise visual angle rotation direction on a playing interface; and if the anticlockwise watching operation triggered by the user is detected, playing an anticlockwise bullet time video consisting of all target video frames corresponding to the anticlockwise visual angle rotating direction on the playing interface.

The clockwise viewing angle rotation direction may refer to that all viewing angles change in a clockwise direction when the bullet time video is played. The counterclockwise viewing angle rotation direction may refer to that all viewing angles change in a counterclockwise direction when the bullet time video is played.

Specifically, after receiving the bullet time video generation request, the media server may determine, based on the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point corresponding to the clockwise view angle rotation direction from the video stream corresponding to each view angle, and determine a target video frame corresponding to each bullet time point corresponding to the counterclockwise view angle rotation direction from the video stream corresponding to each view angle, that is, determine two target video frames corresponding to each bullet time point, that is, a target video frame corresponding to the clockwise view angle rotation direction and a target video frame corresponding to the counterclockwise view angle rotation direction. The media server may send each target video frame corresponding to the clockwise view rotation direction and each target video frame corresponding to the counterclockwise view rotation direction to the user side. The user side caches each received target video frame corresponding to the two visual angle rotation directions, and detects the viewing operation triggered by the user in real time, for example, the user can trigger a clockwise viewing operation by clicking a clockwise viewing button, or trigger an anticlockwise viewing operation by clicking an anticlockwise viewing button. When detecting the clockwise watching operation triggered by the user, each target video frame corresponding to the clockwise visual angle rotation direction, namely the clockwise bullet time video, can be played on the playing interface, so that the user can quickly watch the bullet time video with the clockwise visual angle rotation effect. When the anticlockwise watching operation triggered by the user is detected, each target video frame corresponding to the anticlockwise visual angle rotating direction, namely the anticlockwise bullet time video, can be played on the playing interface, so that the user can quickly watch the bullet time video with the anticlockwise visual angle rotating effect. The bullet time video playing method and device can support the user to selectively watch the bullet time videos in the two directions, and can play the bullet time videos more quickly by caching the bullet time videos corresponding to the two visual angle rotation directions, so that the waiting time of the user is reduced, and the watching experience of the user is further improved.

On the basis of the above technical solutions, as another implementation manner of generating the bullet time video, the operations of steps S110 and S120 may include: acquiring a target visual angle rotation direction selected by a user, wherein the target visual angle rotation direction comprises a clockwise visual angle rotation direction or an anticlockwise visual angle rotation direction; determining a bullet time video generation request according to the current video frame identification information corresponding to the current video frame and the target visual angle rotation direction; and sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from the video stream under each visual angle according to the current video frame identification information and the target visual angle rotation direction in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side.

Specifically, when triggering the bullet time video generation operation, the user may select a target view angle rotation direction that the user wants to watch, that is, a clockwise view angle rotation direction or a counterclockwise view angle rotation direction, so that the user can obtain the target view angle rotation direction selected by the user, and can generate a bullet time video generation request including the current video frame identification information and the target view angle rotation direction and send the bullet time video generation request to the media server. And the media server determines a target video frame corresponding to each bullet time point corresponding to the target visual angle rotation direction from the video stream corresponding to each visual angle based on the current video frame identification information, and sends each target video frame corresponding to the target visual angle rotation direction to the user side. The user side can play each target video frame corresponding to the target visual angle rotation direction on the playing interface, so that the user can directly view the bullet time video with the selected target visual angle rotation effect. The media server in the embodiment of the disclosure only needs to issue each target video frame corresponding to the target view angle rotation direction selected by the user, thereby realizing dynamic downloading of the bullet time video, saving the cache space and improving the operation performance on the basis of supporting the user to select the view angle rotation direction.

Example two

Fig. 2 is a flowchart of a method for generating a bullet time video according to a second embodiment of the present disclosure, which is applicable to a case where a multi-view video with a bullet time effect is generated for a free-view video, and especially applicable to an application scenario where a bullet time video is generated in a live or on-demand free-view video. The method may be performed by a bullet time video generating device, which may be implemented by means of software and/or hardware, integrated in a media server. As shown in fig. 2, the method specifically includes the following steps:

s210, receiving a bullet time video generation request sent by a user side, wherein the bullet time video generation request is determined by the user side according to current video frame identification information corresponding to a current video frame when detecting a bullet time video generation operation triggered by the user aiming at the current video frame currently displayed in the free view video.

The media server may refer to a background server for storing video streams corresponding to each view.

Specifically, the specific determination process of the bullet time video generation request can refer to the related description in the above embodiment, and is not described herein again. The media server can receive a bullet time video generation request which is sent by the user terminal and contains the identification information of the current video frame.

S220, according to the current video frame identification information in the bullet time video generation request, determining a target video frame corresponding to each bullet time point from the video stream under each visual angle, and sending each target video frame corresponding to each bullet time point to the user side so that the user side can play the bullet time video consisting of each received target video frame on a playing interface.

The bullet time point may refer to a playing time in the bullet time video. The number of bullet time points may be equal to the number of viewing angles supported by the freeview video. That is, the bullet time points may correspond one-to-one with the viewing angle. The target video frame may refer to a video frame that needs to be presented at the bullet time point. The viewing visual angles corresponding to different bullet time points are different, so that the target video frames under different visual angles can be displayed at different bullet time points.

Specifically, the media server may parse the bullet time video generation request to obtain current video frame identification information, determine, based on the current video frame identification information, a target video frame corresponding to each bullet time point in the rotation direction of the default view angle from the video stream corresponding to each view angle, and send each target video frame having different viewing view angles to the user side. The user side displays each target video frame corresponding to the default visual angle rotation direction on the playing interface, namely, plays the bullet time video with the visual angle rotation effect, so that a user can directly view the multi-visual-angle video with the bullet time effect, the visual angle does not need to be manually switched by the user, the video playing effect is enriched, the automatic generation of the bullet time video is realized, the user can trigger the bullet time video generation operation aiming at the video frame at any playing moment, the bullet time video corresponding to any video frame can be dynamically generated and played, the personalized requirement of the user is met, and the watching experience of the user is greatly improved.

Based on the above technical solution, "determining a target video frame corresponding to each bullet time point from a video stream under each view angle according to the current video frame identification information in the bullet time video generation request" in S220 may include: and determining a watching visual angle corresponding to each bullet time point, and determining a target video frame corresponding to the bullet time point from the video stream under the watching visual angle according to the current video frame identification information in the bullet time video generation request.

In particular, one viewing perspective corresponding to each bullet time point may be determined based on the perspective rotation direction and all viewing perspectives supported for viewing. The number of bullet time points may be equal to the number of viewing angles. Different bullet time points correspond to different viewing angles. The view angle rotation direction may be a default view angle rotation direction set, or may be a target view angle rotation direction selected by the user. According to the current video frame identification information in the bullet time video generation request, the target video frame corresponding to the corresponding bullet time point can be sequentially determined from the video stream under each watching visual angle according to the visual angle rotation direction.

For example, the target video frame corresponding to the first bullet time point can be determined by the following step S210, and the target video frames corresponding to the second bullet time point and the subsequent bullet time points can be determined by the following step S220:

s210, a first watching visual angle corresponding to the first bullet time point is determined, and a first target video frame corresponding to the first bullet time point is determined from the video stream under the first watching visual angle according to the current video frame identification information in the bullet time video generation request.

Wherein, the first bullet time point may refer to a play start time in the bullet time video. The first viewing perspective may refer to a first perspective viewed by a user in the bullet time video. The first target video frame may refer to a first target video frame in the bullet time video, i.e., a target video frame corresponding to the first viewing perspective. For example, any one of all the viewing perspectives may be used as a first viewing perspective corresponding to the first bullet time point, and a video frame having the same identification information as the current video frame may be determined as the first target video frame from a video stream corresponding to the first viewing perspective, so as to play the bullet time video from the current play time corresponding to the current video frame.

For example, determining a first viewing perspective corresponding to a first bullet time point may include: if the visual angle change range corresponding to the free visual angle video is 360 degrees, acquiring a user watching visual angle when a user triggers bullet time video generation operation, and determining the user watching visual angle as a first watching visual angle corresponding to a first bullet time point; and if the view angle change range corresponding to the free view angle video is not 360 degrees, determining the leftmost or rightmost view angle as a first viewing view angle corresponding to the first bullet time point.

Specifically, when the visual angle variation range is 360 degrees, the user side can acquire the user viewing visual angle during the bullet time video generation operation, namely the current viewing visual angle corresponding to the current video frame, and send the user viewing visual angle to the media server, so that the media server can acquire the user viewing visual angle and take the user viewing visual angle as the first viewing visual angle, so that the visual angle rotation can be performed from the user viewing visual angle, the corresponding bullet time video is played, and the playing effect of the bullet time video is further improved. When the viewing angle variation range is not 360 degrees, for example, the viewing angle variation range is 270 degrees, the media server may use the leftmost or rightmost viewing angle as the first viewing angle, so that the viewing angle rotation is performed from the leftmost or rightmost viewing angle, and the corresponding bullet time video is played. For example, FIG. 3 shows an example of a process for bullet time video generation. As shown in fig. 3, the media server stores N video streams corresponding to the aligned N views. When the user triggers a bullet time video generation operation for a current video frame currently shown in the video stream (i.e., the user trigger time identified in fig. 3), the media server may determine, based on the viewing angle rotation direction, whether to use the leftmost viewing angle as the first viewing angle or the rightmost viewing angle as the first viewing angle. For example, when the viewing angle rotation direction is a clockwise rotation direction in fig. 3, the leftmost viewing angle (i.e., viewing angle 1) may be taken as the first viewing angle; when the visual angle rotating direction is the anticlockwise rotating direction, the rightmost visual angle (namely the visual angle N) can be used as a first watching visual angle, so that the visual angle rotating effect can be displayed more continuously, and the playing effect of the bullet time video is further improved.

For example, determining a first target video frame corresponding to a first bullet time point from a video stream in a first viewing perspective according to current video frame identification information in a bullet time video generation request may include: determining a first video frame which is the same as the identification information of the current video frame from the video stream under the first viewing visual angle; and taking the next video frame of the first video frame in the video stream under the first watching visual angle as the first target video frame corresponding to the first bullet time point.

Specifically, the media server determines, from the video stream corresponding to the first viewing perspective, a next video frame having a video frame identical to the current video frame identification information as the first target video frame, so that the bullet time video can be played from a next playing time of the current playing time corresponding to the current video frame, thereby further improving the diversity of bullet time video display.

S220, determining a current viewing angle corresponding to the current bullet time point according to the viewing angle rotation direction and a previous viewing angle corresponding to the previous bullet time point, and determining a current target video frame corresponding to the current bullet time point from a video stream under the current viewing angle according to identification information of a previous target video frame corresponding to the previous bullet time point.

Specifically, the viewing perspective corresponding to each bullet time point after the first bullet time point may be determined based on the viewing perspective corresponding to the last bullet time point in the viewing angle rotation direction. For example, when the view angle rotation direction is a clockwise view angle rotation manner, a next view angle of a previous view angle corresponding to a previous bullet time point may be taken as a current view angle corresponding to a current bullet time point along the view angle rotation direction. For example, as shown in fig. 3, when the viewing angle rotation direction is a clockwise viewing angle rotation manner, the viewing angle 2 may be determined as the viewing angle corresponding to the second bullet time point, the viewing angle 3 may be determined as the viewing angle corresponding to the third bullet time point, and so on. When the visual angle rotating direction is an anticlockwise visual angle rotating mode, the visual angle N-1 can be determined as a watching visual angle corresponding to the time point of the second bullet, the visual angle N-2 is determined as a watching visual angle corresponding to the time point of the third bullet, and the like. The target video frame corresponding to each bullet time point after the first bullet time point may be determined based on the target video frame corresponding to the last bullet time point. For example, from the video stream at the current viewing angle corresponding to the current bullet time point, the next video frame of the video frames that are the same as the identification information of the previous target video frame may be used as the current target video frame corresponding to the current bullet time point. As shown in fig. 3, for the case that the viewing angle rotation direction is the clockwise viewing angle rotation direction, the viewing angle corresponding to the second bullet time point is viewing angle 2, at this time, the next video frame of the video frame that is the same as the identification information of viewing angle 1 can be taken as the target video frame corresponding to the second bullet time point from the video stream corresponding to viewing angle 2, and so on, the target video frame corresponding to each bullet time point in the clockwise viewing angle rotation direction can be determined, so that the clockwise bullet time video from viewing angle 1 to viewing angle N can be played. Similarly, the target video frame corresponding to each bullet time point in the counterclockwise rotation direction of the view angle may also be determined, so that the counterclockwise bullet time video from view angle N to view angle 1 may be played.

On the basis of the above technical solutions, as an implementation manner of generating the bullet time video, S220 may include: determining a target video frame corresponding to each bullet time point in the clockwise view angle rotation direction and a target video frame corresponding to each bullet time point in the counterclockwise view angle rotation direction according to the bullet time video generation request and the video stream in each view angle; and sending each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction to a user side so that the user side plays a clockwise bullet time video consisting of each target video frame corresponding to the clockwise visual angle rotation direction or an anticlockwise bullet time video consisting of each target video frame corresponding to the anticlockwise visual angle rotation direction on a playing interface based on a watching operation triggered by a user.

Specifically, for the determination process of the target video frame corresponding to each bullet time point in the clockwise view rotation direction, and the determination process of the target video frame corresponding to each bullet time point in the counterclockwise view rotation direction, reference may be made to the above description, and details are not described here again. The media server sends each target video frame corresponding to the clockwise view angle rotating direction and each target video frame corresponding to the anticlockwise view angle rotating direction to the user side. And the user side caches each target video frame corresponding to the received two visual angle rotation directions, and detects the watching operation triggered by the user in real time. When detecting the clockwise watching operation triggered by the user, each target video frame corresponding to the clockwise visual angle rotation direction, namely the clockwise bullet time video, can be played on the playing interface, so that the user can quickly watch the bullet time video with the clockwise visual angle rotation effect. When the anticlockwise watching operation triggered by the user is detected, each target video frame corresponding to the anticlockwise visual angle rotating direction, namely the anticlockwise bullet time video, can be played on the playing interface, so that the user can quickly watch the bullet time video with the anticlockwise visual angle rotating effect. The bullet time video that this disclosed embodiment corresponds through with two visual angle rotation directions sends to the user, can support the user to watch the bullet time video of two directions selectively to the user can play bullet time video more fast through caching the bullet time video that two visual angle rotation directions correspond, reduces user's latency, has further promoted the user and has watched experience.

On the basis of the technical schemes, as another implementation mode for generating the bullet time video, the bullet time video generation request is determined according to the identification information of the current video frame corresponding to the current video frame and the target view angle rotation direction selected by the user; accordingly, S220 may include: and determining a target video frame corresponding to each bullet time point in the rotation direction of the target visual angle according to the bullet time video generation request and the video stream at each visual angle, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays the bullet time video consisting of each received target video frame on a playing interface.

Specifically, when triggering the bullet time video generation operation, the user may select a target view angle rotation direction that the user wants to watch, that is, a clockwise view angle rotation direction or a counterclockwise view angle rotation direction, so that the user can obtain the target view angle rotation direction selected by the user, and can generate a bullet time video generation request including the current video frame identification information and the target view angle rotation direction and send the bullet time video generation request to the media server. The media server determines, based on the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point corresponding to the target view rotation direction from the video stream corresponding to each view, and the specific determination process may refer to the above-mentioned related description, which is not described herein again. And the media server sends each target video frame corresponding to the target visual angle rotation direction to the user side. The user side can play each target video frame corresponding to the target visual angle rotation direction on the playing interface, so that the user can directly view the bullet time video with the selected target visual angle rotation effect. The media server in the embodiment of the disclosure only needs to issue each target video frame corresponding to the target view angle rotation direction selected by the user, so that the dynamic downloading of the bullet time video can be realized by the user side on the basis of supporting the user to select the view angle rotation direction, the cache space is saved, and the operation performance is improved.

The following is an embodiment of a bullet time video generating device provided in the embodiment of the present disclosure, which belongs to the same inventive concept as the bullet time video generating method of the first embodiment, and reference may be made to the bullet time video generating method provided in the first embodiment for details not described in detail in the embodiment of the bullet time video generating device.

EXAMPLE III

Fig. 4 is a schematic structural diagram of a bullet time video generation device according to a third embodiment of the present disclosure, which is applicable to a case where a multi-view video with a bullet time effect is generated for a free-view video, and especially applicable to an application scenario where a bullet time video is generated in a live or on-demand free-view video. The device is integrated at the user side. As shown in fig. 4, the apparatus specifically includes: a bullet time video generation request determination module 410, a bullet time video generation request transmission module 420, and a bullet time video playing module 430.

The bullet time video generation request determining module 410 is configured to determine a bullet time video generation request according to current video frame identification information corresponding to a current video frame if a bullet time video generation operation triggered by a user for a current video frame currently displayed in a free view video is detected; a bullet time video generation request sending module 420, configured to send a bullet time video generation request to the media server, so that the media server determines, according to current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from the video stream at each view angle, and sends each target video frame corresponding to each bullet time point to the user end; and the bullet time video playing module 430 is configured to play a bullet time video composed of the received target video frames on the playing interface.

On the basis of the above technical solution, the current video frame identification information is a playing time stamp or a frame number corresponding to the current video frame.

On the basis of the above technical solutions, the bullet time video playing module 430 is specifically configured to:

receiving and caching each target video frame corresponding to a clockwise visual angle rotation direction and each target video frame corresponding to a counterclockwise visual angle rotation direction which are sent by a media server; if the clockwise watching operation triggered by the user is detected, playing a clockwise bullet time video consisting of all target video frames corresponding to the clockwise visual angle rotation direction on a playing interface; and if the anticlockwise watching operation triggered by the user is detected, playing an anticlockwise bullet time video consisting of all target video frames corresponding to the anticlockwise visual angle rotating direction on the playing interface.

On the basis of the above technical solutions, the bullet time video generation request determining module 410 and the bullet time video generation request sending module 420 are specifically configured to:

acquiring a target visual angle rotation direction selected by a user, wherein the target visual angle rotation direction comprises a clockwise visual angle rotation direction or an anticlockwise visual angle rotation direction; determining a bullet time video generation request according to the current video frame identification information corresponding to the current video frame and the target visual angle rotation direction; and sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from the video stream under each visual angle according to the current video frame identification information and the target visual angle rotation direction in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side.

acquiring a target playing speed selected by a user; and playing the bullet time video consisting of the received target video frames on the playing interface according to the target playing speed.

The bullet time video generation device provided by the embodiment of the disclosure can execute the bullet time video generation method provided by the embodiment of the disclosure, and has corresponding functional modules and beneficial effects for executing the bullet time video generation method.

It should be noted that, the units and modules included in the apparatus are merely divided according to functional logic, but are not limited to the above division as long as the corresponding functions can be implemented; in addition, specific names of the functional units are only used for distinguishing one functional unit from another, and are not used for limiting the protection scope of the embodiments of the present disclosure.

The following is an embodiment of the bullet time video generating device provided in the embodiment of the present disclosure, which belongs to the same inventive concept as the bullet time video generating method of the second embodiment, and reference may be made to the bullet time video generating method provided in the second embodiment for details that are not described in detail in the embodiment of the bullet time video generating device.

Example four

Fig. 5 is a schematic structural diagram of a bullet time video generation device according to a fourth embodiment of the present disclosure, which is applicable to a case where a multi-view video with a bullet time effect is generated for a free-view video, and especially applicable to an application scenario where a bullet time video is generated in a live or on-demand free-view video. The device is integrated with a media server. As shown in fig. 5, the apparatus specifically includes: a bullet time video generation request receiving module 510 and a target video frame transmitting module 520.

The bullet time video generation request receiving module 510 is configured to receive a bullet time video generation request sent by a user side, where the bullet time video generation request is determined by the user side according to current video frame identification information corresponding to a current video frame when detecting a bullet time video generation operation triggered by the user for a current video frame currently displayed in a free view video; a target video frame sending module 520, configured to determine, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from the video stream at each view angle, and send each target video frame corresponding to each bullet time point to the user end, so that the user end plays the bullet time video composed of each received target video frame on the play interface.

On the basis of the above technical solution, the target video frame sending module 520 includes: the target video frame determination unit is specifically configured to: and determining a watching visual angle corresponding to each bullet time point, and determining a target video frame corresponding to the bullet time point from the video stream under the watching visual angle according to the current video frame identification information in the bullet time video generation request.

On the basis of the above technical solutions, the target video frame determining unit includes:

the first target video frame determining subunit is used for determining a first watching visual angle corresponding to the first bullet time point, and determining a first target video frame corresponding to the first bullet time point from the video stream under the first watching visual angle according to the current video frame identification information in the bullet time video generation request;

and the current target video frame determining subunit is used for determining a current watching visual angle corresponding to the current bullet time point according to the visual angle rotation direction and a previous watching visual angle corresponding to the previous bullet time point, and determining a current target video frame corresponding to the current bullet time point from the video stream under the current watching visual angle according to the identification information of the previous target video frame corresponding to the previous bullet time point.

On the basis of the above technical solutions, the first target video frame determination subunit is further specifically configured to:

if the visual angle change range corresponding to the free visual angle video is 360 degrees, acquiring a user watching visual angle when a user triggers bullet time video generation operation, and determining the user watching visual angle as a first watching visual angle corresponding to a first bullet time point;

and if the view angle change range corresponding to the free view angle video is not 360 degrees, determining the leftmost or rightmost view angle as a first viewing view angle corresponding to the first bullet time point.

determining a first video frame which is the same as the identification information of the current video frame from the video stream under the first viewing visual angle; and taking the next video frame of the first video frame in the video stream under the first watching visual angle as the first target video frame corresponding to the first bullet time point.

On the basis of the above technical solutions, the target video frame sending module 520 is specifically configured to:

determining a target video frame corresponding to each bullet time point in the clockwise view angle rotation direction and a target video frame corresponding to each bullet time point in the counterclockwise view angle rotation direction according to the bullet time video generation request and the video stream in each view angle; and sending each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction to a user side so that the user side plays a clockwise bullet time video consisting of each target video frame corresponding to the clockwise visual angle rotation direction or an anticlockwise bullet time video consisting of each target video frame corresponding to the anticlockwise visual angle rotation direction on a playing interface based on a watching operation triggered by a user.

On the basis of the technical schemes, a bullet time video generation request is determined according to current video frame identification information corresponding to a current video frame and a target visual angle rotation direction selected by a user;

accordingly, the target video frame sending module 520 is further specifically configured to:

and determining a target video frame corresponding to each bullet time point in the rotation direction of the target visual angle according to the bullet time video generation request and the video stream at each visual angle, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays the bullet time video consisting of each received target video frame on a playing interface.

The bullet time video generation device provided by the embodiment of the disclosure can execute the bullet time video generation method provided by the second embodiment of the disclosure, and has corresponding functional modules and beneficial effects for executing the bullet time video generation method.

EXAMPLE five

Fig. 6 is a schematic structural diagram of a bullet time video generation system according to a fifth embodiment of the present disclosure. The embodiment is applicable to the case of generating multi-view video with bullet time effect for free view video, and especially can be used for generating application scenes of bullet time video in live or on-demand free view video. As shown in fig. 6, the system includes: a user terminal 610 and a media server 620.

The user end 610 can be used to implement the bullet time video generation method provided in the first embodiment of the present disclosure; the media server 620 may be used to implement the bullet time video generation method provided in the second embodiment of the present disclosure.

As an implementation manner, the working process of the bullet time video generation system in the embodiment of the present disclosure may be: if the user terminal 610 detects a bullet time video generation operation triggered by the user with respect to a current video frame currently displayed in the free-view video, a bullet time video generation request is determined according to current video frame identification information corresponding to the current video frame, and the bullet time video generation request is sent to the media server 620. The media server 620 determines a target video frame corresponding to each bullet time point in the rotation direction of the default view angle from the video stream at each view angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user terminal 610. The user terminal 610 plays the bullet time video composed of the received target video frames on the playing interface, so that a user can directly view the multi-view video with the bullet time effect, the view angle does not need to be manually switched by the user, the video playing effect is enriched, automatic generation of the bullet time video is realized, the user can trigger bullet time video generation operation aiming at the video frames at any playing time, bullet time videos corresponding to any video frames can be dynamically generated and played, the personalized requirements of the user are met, and the watching experience of the user is greatly improved.

As another implementation manner, the working process of the bullet time video generation system in the embodiment of the present disclosure may further be: if the user terminal 610 detects a bullet time video generation operation triggered by the user with respect to a current video frame currently displayed in the free-view video, a bullet time video generation request is determined according to current video frame identification information corresponding to the current video frame, and the bullet time video generation request is sent to the media server 620. The media server 620 determines, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point in the clockwise view rotation direction and a target video frame corresponding to each bullet time point in the counterclockwise view rotation direction from the video stream in each view, and sends each target video frame corresponding to the clockwise view rotation direction and each target video frame corresponding to the counterclockwise view rotation direction to the user terminal 610. The user terminal 610 caches each received target video frame corresponding to the two visual angle rotation directions, and if a clockwise watching operation triggered by the user is detected, a clockwise bullet time video composed of each target video frame corresponding to the clockwise visual angle rotation direction is played on a playing interface; and if the anticlockwise watching operation triggered by the user is detected, playing an anticlockwise bullet time video consisting of all target video frames corresponding to the anticlockwise visual angle rotating direction on the playing interface. The bullet time video playing method and device can support the user to selectively watch the bullet time videos in the two directions, and can play the bullet time videos more quickly by caching the bullet time videos corresponding to the two visual angle rotation directions, so that the waiting time of the user is reduced, and the watching experience of the user is further improved.

As another implementation manner, the working process of the bullet time video generation system in the embodiment of the present disclosure may further be: if the user terminal 610 detects a bullet time video generation operation triggered by the user with respect to a current video frame currently displayed in the free view video, a target view rotation direction selected by the user is obtained, a bullet time video generation request is determined according to current video frame identification information corresponding to the current video frame and the target view rotation direction, and the bullet time video generation request is sent to the media server 620. The media server 620 determines a target video frame corresponding to each bullet time point from the video stream at each view angle according to the current video frame identification information and the target view angle rotation direction in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user terminal 610. The user terminal 610 can play each target video frame corresponding to the target view angle rotation direction on the playing interface, so that the user can directly view the bullet time video with the selected target view angle rotation effect. The media server 620 in the embodiment of the present disclosure only needs to issue each target video frame corresponding to the target view rotation direction selected by the user, thereby realizing dynamic downloading of the bullet time video, saving the cache space, and improving the operation performance on the basis of supporting the user to select the view rotation direction.

In the bullet time video generation system provided by the embodiment of the present disclosure, when detecting a bullet time video generation operation triggered by a user with respect to a current video frame currently displayed in a free-view video, the user terminal 610 determines a bullet time video generation request according to current video frame identification information corresponding to the current video frame, and sends the bullet time video generation request to the media server 620. The media server 620 determines a target video frame corresponding to each bullet time point from the video stream at each view angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user terminal 610. The user terminal 610 plays the bullet time video composed of the received target video frames on the playing interface, so that automatic generation of the bullet time video is achieved, a user can directly watch the multi-view video with the bullet time effect, manual visual angle switching by the user is not needed, the video playing effect is enriched, and the watching experience of the user is improved.

EXAMPLE six

Referring now to fig. 7, a schematic diagram of an electronic device (e.g., a client or server in fig. 7) 900 suitable for implementing embodiments of the present disclosure is shown. The terminal device in the embodiments of the present disclosure may include, but is not limited to, a mobile terminal such as a mobile phone, a notebook computer, a digital broadcast receiver, a PDA (personal digital assistant), a PAD (tablet computer), a PMP (portable multimedia player), a vehicle terminal (e.g., a car navigation terminal), and the like, and a stationary terminal such as a digital TV, a desktop computer, and the like. The electronic device shown in fig. 7 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.

As shown in fig. 7, the electronic device 900 may include a processing means (e.g., a central processing unit, a graphics processor, etc.) 901 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)902 or a program loaded from a storage means 908 into a Random Access Memory (RAM) 903. In the RAM 903, various programs and data necessary for the operation of the electronic apparatus 900 are also stored. The processing apparatus 901, the ROM 902, and the RAM 903 are connected to each other through a bus 904. An input/output (I/O) interface 905 is also connected to bus 904.

Generally, the following devices may be connected to the I/O interface 905: input devices 906 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 907 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage 908 including, for example, magnetic tape, hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic apparatus 900 to perform wireless or wired communication with other apparatuses to exchange data. While fig. 7 illustrates an electronic device 900 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program carried on a non-transitory computer readable medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication device 909, or installed from the storage device 908, or installed from the ROM 902. The computer program performs the above-described functions defined in the methods of the embodiments of the present disclosure when executed by the processing apparatus 901.

The electronic device provided by the embodiment of the present disclosure and the bullet time video generation method provided by the embodiment of the present disclosure belong to the same inventive concept, and the technical details that are not described in detail in the embodiment of the present disclosure can be referred to the embodiment of the present disclosure, and the embodiment of the present disclosure have the same beneficial effects.

EXAMPLE seven

The disclosed embodiments provide a computer storage medium having stored thereon a computer program that, when executed by a processor, implements the bullet time video generation method provided by any of the above embodiments.

It should be noted that the computer readable medium in the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may interconnect with any form or medium of digital data communication (e.g., a communications network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device.

The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to:

if detecting bullet time video generation operation triggered by a user aiming at a current video frame currently displayed in the free visual angle video, determining a bullet time video generation request according to current video frame identification information corresponding to the current video frame; sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from the video stream under each view angle according to the current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to a user side; and playing the bullet time video consisting of the received target video frames on the playing interface.

Alternatively, the first and second electrodes may be,

receiving a bullet time video generation request sent by a user side, wherein the bullet time video generation request is determined by the user side according to current video frame identification information corresponding to a current video frame when detecting bullet time video generation operation triggered by the user aiming at the current video frame currently displayed in the free view video; and determining a target video frame corresponding to each bullet time point from the video stream under each visual angle according to the current video frame identification information in the bullet time video generation request, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays the bullet time video consisting of each received target video frame on a playing interface.

Computer program code for carrying out operations for the present disclosure may be written in any combination of one or more programming languages, including but not limited to an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The units described in the embodiments of the present disclosure may be implemented by software or hardware. Where the name of a cell does not in some cases constitute a limitation on the cell itself, for example, an editable content display cell may also be described as an "editing cell".

The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

According to one or more embodiments of the present disclosure, [ example one ] there is provided a bullet time video generation method, applied to a user side, the method including:

According to one or more embodiments of the present disclosure, [ example two ] there is provided a bullet time video generation method, applied to a user side, the method further comprising:

optionally, the current video frame identification information is a playing time stamp or a frame sequence number corresponding to the current video frame.

According to one or more embodiments of the present disclosure, [ example three ] there is provided a bullet time video generation method, applied to a user side, the method further comprising:

optionally, the playing, on the playing interface, the bullet time video composed of the received target video frames includes:

receiving and caching each target video frame corresponding to a clockwise visual angle rotation direction and each target video frame corresponding to a counterclockwise visual angle rotation direction which are sent by the media server;

if the clockwise watching operation triggered by the user is detected, playing a clockwise bullet time video consisting of all target video frames corresponding to the clockwise visual angle rotation direction on a playing interface;

and if the anticlockwise watching operation triggered by the user is detected, playing an anticlockwise bullet time video consisting of all target video frames corresponding to the anticlockwise visual angle rotating direction on a playing interface.

According to one or more embodiments of the present disclosure, [ example four ] there is provided a bullet time video generation method, applied to a user side, the method further comprising:

optionally, the bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame; sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from video streams under each view angle according to current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side, wherein the bullet time video generation request comprises:

acquiring a target visual angle rotation direction selected by a user, wherein the target visual angle rotation direction comprises a clockwise visual angle rotation direction or an anticlockwise visual angle rotation direction;

determining a bullet time video generation request according to the current video frame identification information corresponding to the current video frame and the target view angle rotation direction;

and sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from the video stream under each visual angle according to the current video frame identification information and the target visual angle rotation direction in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side.

According to one or more embodiments of the present disclosure, [ example five ] there is provided a bullet time video generation method, applied to a user side, the method further comprising:

acquiring a target playing speed selected by a user;

and playing the bullet time video consisting of the received target video frames on a playing interface according to the target playing speed.

According to one or more embodiments of the present disclosure, [ example six ] there is provided a bullet time video generation method applied to a media server, the method comprising:

According to one or more embodiments of the present disclosure, [ example seven ] there is provided a bullet time video generation method applied to a media server, the method further comprising:

optionally, the determining, according to the current video frame identification information in the bullet time video generation request, a target video frame corresponding to each bullet time point from the video stream in each view angle includes:

and determining a watching visual angle corresponding to each bullet time point, and determining a target video frame corresponding to the bullet time point from the video stream under the watching visual angle according to the current video frame identification information in the bullet time video generation request.

According to one or more embodiments of the present disclosure, [ example eight ] there is provided a bullet time video generation method applied to a media server, the method further comprising:

optionally, the determining a viewing angle corresponding to each bullet time point, and determining a target video frame corresponding to the corresponding bullet time point from a video stream under the viewing angle according to current video frame identification information in the bullet time video generation request includes:

determining a first watching visual angle corresponding to a first bullet time point, and determining a first target video frame corresponding to the first bullet time point from a video stream under the first watching visual angle according to current video frame identification information in the bullet time video generation request;

and determining a current viewing angle corresponding to the current bullet time point according to the viewing angle rotation direction and a previous viewing angle corresponding to the previous bullet time point, and determining a current target video frame corresponding to the current bullet time point from the video stream under the current viewing angle according to the identification information of the previous target video frame corresponding to the previous bullet time point.

According to one or more embodiments of the present disclosure, [ example nine ] there is provided a bullet time video generation method applied to a media server, the method further comprising:

optionally, the determining a first viewing perspective corresponding to the first bullet time point includes:

if the view angle change range corresponding to the free view angle video is 360 degrees, acquiring a user watching view angle when a user triggers the bullet time video generation operation, and determining the user watching view angle as a first watching view angle corresponding to a first bullet time point;

and if the change range of the view angle corresponding to the free view angle video is not 360 degrees, determining the leftmost or rightmost view angle as a first viewing view angle corresponding to the first bullet time point.

According to one or more embodiments of the present disclosure, [ example ten ] there is provided a bullet time video generation method applied to a media server, the method further comprising:

optionally, the determining, according to the current video frame identification information in the bullet time video generation request, a first target video frame corresponding to a first bullet time point from the video stream at the first viewing perspective includes:

determining a first video frame which is the same as the identification information of the current video frame from the video stream under the first viewing visual angle;

and taking a next video frame of the first video frame in the video stream under the first viewing perspective as a first target video frame corresponding to a first bullet time point.

According to one or more embodiments of the present disclosure, [ example eleven ] there is provided a method of generating a bullet time video, applied to a media server, the method further comprising:

optionally, the determining, according to the bullet time video generation request and the video stream at each view angle, a target video frame corresponding to each bullet time point, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays the bullet time video composed of each received target video frame on a playing interface, includes:

determining a target video frame corresponding to each bullet time point in the clockwise view angle rotation direction and a target video frame corresponding to each bullet time point in the counterclockwise view angle rotation direction according to the bullet time video generation request and the video stream in each view angle;

and sending each target video frame corresponding to the clockwise visual angle rotation direction and each target video frame corresponding to the anticlockwise visual angle rotation direction to the user side, so that the user side plays a clockwise bullet time video formed by each target video frame corresponding to the clockwise visual angle rotation direction or an anticlockwise bullet time video formed by each target video frame corresponding to the anticlockwise visual angle rotation direction on a playing interface based on a watching operation triggered by the user.

According to one or more embodiments of the present disclosure, [ example twelve ] there is provided a method of bullet time video generation, applied to a media server, the method further comprising:

optionally, the bullet time video generation request is determined according to the current video frame identification information corresponding to the current video frame and a target view rotation direction selected by a user;

the determining, according to the bullet time video generation request and the video stream at each view angle, a target video frame corresponding to each bullet time point, and sending each target video frame corresponding to each bullet time point to the user side, so that the user side plays a bullet time video composed of each received target video frame on a playing interface, includes:

and determining a target video frame corresponding to each bullet time point in the rotation direction of the target visual angle according to the bullet time video generation request and the video stream at each visual angle, and sending each target video frame corresponding to each bullet time point to the user side so that the user side plays a bullet time video consisting of each received target video frame on a playing interface.

According to one or more embodiments of the present disclosure, [ example thirteen ] there is provided a bullet time video generating apparatus integrated at a user side, the apparatus comprising:

According to one or more embodiments of the present disclosure, [ example fourteen ] there is provided a bullet time video generating apparatus integrated with a media server, the apparatus comprising:

The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the disclosure herein is not limited to the particular combination of features described above, but also encompasses other embodiments in which any combination of the features described above or their equivalents does not depart from the spirit of the disclosure. For example, the above features and (but not limited to) the features disclosed in this disclosure having similar functions are replaced with each other to form the technical solution.

Further, while operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, while several specific implementation details are included in the above discussion, these should not be construed as limitations on the scope of the disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

Claims

1. A bullet time video generation method is applied to a user side and comprises the following steps:

2. The method according to claim 1, wherein the current video frame identification information is a playing time stamp or a frame sequence number corresponding to the current video frame.

3. The method of claim 1, wherein said playing a bullet time video comprised of received respective target video frames on a playing interface comprises:

4. The method of claim 1, wherein the bullet time video generation request is determined according to current video frame identification information corresponding to the current video frame; sending the bullet time video generation request to a media server, so that the media server determines a target video frame corresponding to each bullet time point from video streams under each view angle according to current video frame identification information in the bullet time video generation request, and sends each target video frame corresponding to each bullet time point to the user side, wherein the bullet time video generation request comprises:

5. The method of claim 1, wherein said playing a bullet time video comprised of received respective target video frames on a playing interface comprises:

acquiring a target playing speed selected by a user;

6. A method for generating a bullet time video, which is applied to a media server, comprises the following steps:

7. The method of claim 6, wherein determining the target video frame corresponding to each bullet time point from the video stream in each view according to the current video frame identification information in the bullet time video generation request comprises:

8. The method of claim 7, wherein the determining a viewing perspective corresponding to each bullet time point and determining a target video frame corresponding to the corresponding bullet time point from the video stream under the viewing perspective according to the current video frame identification information in the bullet time video generation request comprises:

9. The method of claim 8, wherein said determining a first viewing perspective corresponding to a first bullet time point comprises:

10. The method of claim 8, wherein determining a first target video frame corresponding to a first bullet time point from the video stream from the first viewing perspective based on current video frame identification information in the bullet time video generation request comprises:

11. The method of claim 6, wherein the determining a target video frame corresponding to each bullet time point according to the bullet time video generation request and the video stream at each viewing angle, and sending each target video frame corresponding to each bullet time point to the user end, so that the user end plays the bullet time video consisting of each received target video frame on a playing interface, comprises:

12. The method of claim 6, wherein the bullet time video generation request is determined according to current video frame identification information corresponding to the current video frame and a user-selected target view rotation direction;

the method for playing the bullet time video comprises the steps of determining a target video frame corresponding to each bullet time point according to the bullet time video generation request and the video stream at each visual angle, and sending each target video frame corresponding to each bullet time point to a user side so that the user side can play the bullet time video consisting of each received target video frame on a playing interface, and further comprises the following steps:

13. A bullet time video generation device, which is integrated at a user end, comprises:

14. A apparatus for generating a bullet time video, integrated in a media server, comprising:

15. A system for bullet time video generation, the system comprising: a user terminal, a media server and a low-delay server;

wherein the user terminal is used for implementing the bullet time video generation method according to any one of claims 1 to 5;

the media server is for implementing a bullet time video generation method according to any one of claims 6-12.

16. An electronic device, characterized in that the electronic device comprises:

one or more processors;

a memory for storing one or more programs;

when executed by the one or more processors, cause the one or more processors to implement the bullet time video generation method of any one of claims 1-12.

17. A computer-readable storage medium, on which a computer program is stored, which program, when being executed by a processor, carries out a bullet time video generation method according to any one of claims 1 to 12.