CN113382267B - Viewing angle switching method, device, terminal and storage medium - Google Patents

Viewing angle switching method, device, terminal and storage medium Download PDF

Info

Publication number
CN113382267B
CN113382267B CN202110506722.4A CN202110506722A CN113382267B CN 113382267 B CN113382267 B CN 113382267B CN 202110506722 A CN202110506722 A CN 202110506722A CN 113382267 B CN113382267 B CN 113382267B
Authority
CN
China
Prior art keywords
view
key frame
switching
frame image
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110506722.4A
Other languages
Chinese (zh)
Other versions
CN113382267A (en
Inventor
娄志云
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing QIYI Century Science and Technology Co Ltd
Original Assignee
Beijing QIYI Century Science and Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing QIYI Century Science and Technology Co Ltd filed Critical Beijing QIYI Century Science and Technology Co Ltd
Priority to CN202110506722.4A priority Critical patent/CN113382267B/en
Publication of CN113382267A publication Critical patent/CN113382267A/en
Application granted granted Critical
Publication of CN113382267B publication Critical patent/CN113382267B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21Server components or server architectures
    • H04N21/218Source of audio or video content, e.g. local disk arrays
    • H04N21/21805Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/232Content retrieval operation locally within server, e.g. reading video streams from disk arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65Transmission of management data between client and server
    • H04N21/658Transmission by the client directed to the server
    • H04N21/6587Control parameters, e.g. trick play commands, viewpoint selection

Abstract

The embodiment of the invention provides a viewing angle switching method, a viewing angle switching device, a terminal and a storage medium, wherein the method comprises the following steps: determining a viewing angle switching moment in response to a switching instruction operation performed by a user during the playing period of the video at the current viewing angle; searching a key frame image of a switching view angle from a key frame image set corresponding to the view angle switching moment in a plurality of key frame image sets, and playing the key frame image of the switching view angle; and responding to the confirmation indication operation of the user, and acquiring video data of the target video clip so as to play the target video clip. The terminal with common configuration can also switch the view angle under the condition that the provided network bandwidth is the common network bandwidth, thereby improving the applicability of the view angle switching.

Description

Viewing angle switching method, device, terminal and storage medium
Technical Field
The present invention relates to the field of video, and in particular, to a method, an apparatus, a terminal, and a storage medium for switching viewing angles.
Background
The free view angle technology is a technology in which a plurality of cameras with different view angles shoot the same scene to obtain videos with different view angles, and a user can see the videos with different view angles through view angle switching.
When playing multi-view video, a user may switch from the current view to any view different from the current view, so that smoothness of video switching is ensured. Currently, the implementation of the view angle switching is: the terminal of the user needs to acquire video data of videos of all view angles from the server in real time, decode the video data of all videos in parallel, and play the video data of the switched view angles obtained by decoding at the switching moment.
Acquiring video data of videos of all perspectives from a server in real time requires a high network bandwidth provided by a network provider to a user's terminal, and decoding video data of all videos in parallel requires a high configuration of the user's terminal equipment. The user terminal needs to have high configuration and high network bandwidth, and the user terminal can be provided with the high network bandwidth, so that the current view angle switching has poor applicability and cannot be applied to the terminal with common configuration and/or the provided network bandwidth being the common network bandwidth.
Disclosure of Invention
The embodiment of the invention aims to provide a viewing angle switching method, a viewing angle switching device, a terminal and a storage medium, so as to improve the applicability of viewing angle switching. The specific technical scheme is as follows:
In a first aspect of the present invention, there is provided a viewing angle switching method, including:
determining a viewing angle switching moment in response to a switching instruction operation performed by a user during the playing period of the video at the current viewing angle;
searching a key frame image of a switching view angle from a key frame image set corresponding to a view angle switching moment in a plurality of key frame image sets, and playing the key frame image of the switching view angle, wherein the key frame image of the switching view angle belongs to a view angle video with the switching view angle, the switching view angle is different from the view angle of the current view angle video, each key frame image in the key frame image set is from a different view angle video, and the playing moment corresponding to each key frame image in the key frame image set is the same;
and responding to the confirmation indication operation of the user, acquiring video data of a target video segment from a server to play the target video segment, wherein the target video segment belongs to a view angle video with a target view angle, and the target view angle is a view angle corresponding to a key frame image aimed by the confirmation indication operation.
In a second aspect of the present invention, there is also provided a viewing angle switching method applied to a viewing angle switching system, where the viewing angle switching system includes a terminal and a server, and the method includes:
The terminal responds to switching indication operation carried out by a user in the playing period of the video at the current visual angle, and the visual angle switching moment is determined;
the server receives the view angle switching moment sent by the terminal, searches a key frame image of a switching view angle from a key frame image set corresponding to the view angle switching moment in a plurality of key frame image sets, and plays the key frame image of the switching view angle, wherein the key frame image of the switching view angle belongs to a view angle video with the switching view angle, the switching view angle is different from the view angle of the current view angle video, each key frame image in the key frame image set is from a different view angle video, and the playing moment corresponding to each key frame image in the key frame image set is the same;
the terminal receives the key frame image of switching the visual angle sent by the server and plays the key frame image of switching the visual angle;
and the terminal responds to the confirmation indication operation of the user, and acquires video data of a target video clip from a server to play the target video clip, wherein the target video clip belongs to a view angle video with a target view angle, and the target view angle is a view angle corresponding to a key frame image aimed by the confirmation indication operation.
In a third aspect of the present invention, there is also provided a viewing angle switching apparatus, including:
a first response unit configured to determine a viewing angle switching time in response to a switching instruction operation performed by a user during a play period of a current viewing angle video;
a second response unit configured to find a key frame image of a switching view angle from a key frame image set corresponding to a view angle switching time in a plurality of key frame image sets, and play the key frame image of the switching view angle, wherein the key frame image of the switching view angle belongs to a view angle video having the switching view angle, and the switching view angle is different from a view angle of a current view angle video, each key frame image in the key frame image set is from a different view angle video, and play time corresponding to each key frame image in the key frame image set is the same;
and a third response unit configured to obtain video data of a target video clip from a server in response to a confirmation instruction operation of the user, so as to play the target video clip, wherein the target video clip belongs to a view angle video with a target view angle, and the target view angle is a view angle corresponding to a key frame image for which the confirmation instruction operation is directed.
In yet another aspect of the present invention, there is also provided a computer-readable storage medium having instructions stored therein, which when executed on a computer, cause the computer to perform any of the above-described viewing angle switching methods.
In yet another aspect of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform any of the above-described viewing angle switching methods.
The visual angle switching method and the visual angle switching device realize that when a user watches a video, a key frame image for switching the visual angle is searched from a key frame image set corresponding to the visual angle switching moment, the key frame image for switching the visual angle is played, and video data of a target video clip are obtained to play the target video clip. Compared with the method for decoding video data of all videos in parallel, only one image is required to be located in one image set, and the cost for searching one image in one image set is very low for a processor of a terminal, so that the processor of the terminal is not required to have very high decoding capability, and a normally configured terminal can realize the purpose of searching a key frame image of a switching view from a key frame image set corresponding to the switching time of the view. Meanwhile, the video data of the target video clip is only the video data of one view angle video, and the network bandwidth required for acquiring the video data of the target video clip is far smaller than the network bandwidth required for acquiring the video data of the videos of all view angles from the server in real time. Therefore, the terminal with common configuration can also perform the view angle switching under the condition that the provided network bandwidth is the common network bandwidth, and the applicability of the view angle switching is improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below.
Fig. 1 is a flowchart of a first embodiment of a viewing angle switching method according to an embodiment of the present invention;
fig. 2 is a flowchart of a second embodiment of a viewing angle switching method according to an embodiment of the present invention;
fig. 3 is a flowchart of a third embodiment of a viewing angle switching method according to an embodiment of the present invention;
fig. 4 is a flowchart of a fourth embodiment of a viewing angle switching method according to an embodiment of the present invention;
FIG. 5 is a schematic illustration of one effect of storing a set of key frame images via folders;
FIG. 6 is a schematic diagram showing an effect of the view angle switching;
fig. 7 is a flowchart of a fifth embodiment of a viewing angle switching method according to an embodiment of the present invention;
fig. 8 is a schematic structural diagram of a viewing angle switching device according to an embodiment of the present invention;
fig. 9 is a block diagram of a terminal adapted to implement a method provided by an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.
Referring to fig. 1, a flowchart of a first embodiment of a viewing angle switching method according to an embodiment of the invention is shown.
Step 101, determining the view angle switching moment in response to the switching instruction operation performed by the user during the playing period of the video at the current view angle.
Each of a plurality of videos obtained by shooting the same scene by a plurality of cameras with different corresponding viewing angles can be called a viewing angle video. For each of the plurality of cameras, the corresponding viewing angle of the camera is the viewing angle adopted by the camera in shooting. That is, the view angle video is obtained by shooting the same scene by a plurality of cameras, and the view angles adopted by any two cameras in the plurality of cameras are different in shooting.
For example, for one scene, camera 1 shoots the scene at view angle 1 to obtain view angle video 1, camera 2 shoots the scene at a second view angle to obtain view angle video 2.
Each view video in the plurality of view videos has a view, and the view of each view video is different, and for each view video, the view of the view video is the view adopted by a camera shooting the view video when shooting.
In the present embodiment, when the user desires to view a view video different from the current view video among the plurality of view videos during the play of the current view video, the user performs a switch instruction operation. The switching indication operation indicates that a viewing angle switching is required. For example, the user clicks a button in the play interface indicating that a view switch is required.
The current view video is a view video of the plurality of view videos currently being played. The play period of the current view video may refer to a period of time during which the current view video is played.
The viewing angle switching time, the playing time, the candidate viewing angle switching time, the current playing time and the like in the various embodiments of the invention are all the time of 0 time relative to the playing time axis on the playing time axis. For example, the current playing time is 10s, and the time interval between the current playing time and the 0 time of the playing time axis is 10s.
In this embodiment, a plurality of candidate view angle switching moments may be preset based on a preset duration. A time interval between 0 time of the play time axis before the end time of the view video is an integer multiple of the preset duration may be set as the candidate view switching time. The end time of the view video is also a time on the playback time axis relative to the time 0 of the playback time axis. For example, the preset duration is 1s, the duration of the view video is 100s, and the end time of the view video is 100s. A time 1s of a time interval 1 times a preset time period from a time 0 of the play time axis, a time 2s of a time interval 2 times the preset time period from a time 0 of the play time axis, and a time ns of a time interval n times the preset time period from a time 0 of the play time axis may be set as the candidate angle of view switching time, n being greater than 2 and less than 100.
In the present embodiment, when determining the view angle switching timing, the candidate view angle switching timing, which is later than the end timing of the switching instruction operation of the user, among all the candidate view angle switching timings may be first determined. Then, the view angle switching time of the candidate closest to the end time of the switching instruction operation of the user among all the view angle switching times of the candidates later than the end time of the switching instruction operation of the user may be determined as the view angle switching time.
In this embodiment, when determining the viewing angle switching time, the current switching interval may also be determined first, where the current switching interval may indicate: the switching is performed after the current switching interval from the end time of the switching instruction operation of the user, that is, the switching is performed at the reference time obtained by adding the end time of the switching instruction operation of the user and the current switching interval, so that smoother switching can be realized. If the reference time is exactly a certain candidate view angle switching time, the reference time can be directly determined as the view angle switching time. If the reference time is not the candidate view angle switching time, the view angle switching time which is the closest candidate to the reference time may be determined as the view angle switching time.
In this embodiment, the current switching interval may be a priori long. The correspondence of the handover association condition and the a priori handover interval may be pre-established. The handover association condition includes data items that may affect the smoothness of handover, such as the data transmission rate of the network, the video frame rate, etc. In the corresponding relation between the switching association condition and the prior switching interval, each preset switching association condition corresponds to one prior switching interval respectively.
When determining the current switching interval, the data transmission rate of the current network, the frame rate of the current view video, and the like may be acquired to determine the current switching association condition. The current switching association condition is one preset switching condition of all preset switching conditions, the prior switching interval corresponding to the current switching association condition can be found out from the corresponding relation between the switching association condition and the prior switching interval, and the found prior switching interval is determined as the current switching interval.
For each switching association condition, the prior switching interval corresponding to the switching association condition can be obtained by performing multiple tests under the switching association condition, wherein the prior switching interval corresponding to the switching association condition indicates: under the switching association condition, from the ending time of the switching instruction operation, switching is performed after the prior switching interval corresponding to the switching association condition, so that smoother switching can be realized. For any one of the switching association conditions, each time the test is performed under the switching association condition, the test can be performed after a candidate switching interval from the end time of the switching instruction operation of the operation and maintenance engineer under the switching association condition, then, the switching fluency corresponding to the candidate switching interval can be determined according to the index for evaluating the fluency of the switching, and the switching interval of the candidate with the highest corresponding switching fluency in all the candidate switching intervals participating in the test can be determined as the prior switching interval corresponding to the switching association condition.
In this embodiment, a neural network, such as a convolutional neural network, may also be trained in advance in a supervised learning manner, so that the neural network learns the association relationship between the switching association condition and the switching interval. When determining the current switching interval, the data transmission rate of the current network, the frame rate of the current view video, and the like may be acquired to determine the current switching association condition. The current switching association condition is input into the neural network, and the current switching interval is output by the neural network.
Each training data of the neural network includes: the method comprises the steps of switching association conditions for training and expected switching intervals corresponding to the switching association conditions for training. The handoff association conditions used for training include data items such as data transmission rate of the network, video frame rate, etc. The expected switch interval indication corresponding to the switch association condition for training: under the switching association condition for training, from the end time of the switching indication operation, the switching is performed after the expected switching interval, so that smoother switching can be realized, and the expected switching interval corresponding to the switching association condition for training can be obtained through testing. When training the neural network, the neural network outputs a predicted switching interval by taking a switching association condition for training as an input, and updates parameters of the neural network according to a loss between the predicted switching interval and an expected switching interval corresponding to the switching association condition for training.
Step 102, finding out the key frame image of the switching view angle from the key frame image set corresponding to the view angle switching time in the plurality of key frame image sets, and playing the key frame image of the switching view angle.
In this embodiment, the plurality of keyframe image sets may be generated by the server prior to performing step 101. Before performing step 101, the user's terminal may obtain a plurality of keyframe image sets from the server, store the plurality of keyframe image sets locally, and store the plurality of keyframe image sets in a storage space of the user's terminal.
The server may combine, for each of a plurality of preset candidate view angle switching times, the image in each view angle video whose corresponding playing time is the candidate view angle switching time into a key frame image set, where the key frame image set corresponds to the candidate view angle switching time.
In this embodiment, for each set of key frame images, each key frame image in the set of key frame images is from one of a plurality of view videos, and each key frame image in the set of key frame images is from a different view video.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. For a set of key frame images, the set of key frame images includes: one key frame image from a view video having a view 1, one key frame image from a view video having a view 2.
In this embodiment, for any one frame of image, the playing time corresponding to the one frame of image is: when the video of the view angle to which the one frame image belongs is played independently, namely, the video of the view angle to which the one frame image belongs is played from the 0 moment of the playing time axis, the moment of the one frame image is played.
In other words, for any one frame image, when the video of the view angle to which the one frame image belongs is played alone, the one frame image is played at the play time corresponding to the one frame image, and thus, the user can see the one frame image.
For example, when the view video having the view 1 is played alone for a frame image having the corresponding play time of 10s in the video having the view 1, the frame image having the corresponding play time of 10s in the view video having the view 1 is played at 10 s. For a frame image having a corresponding play time of 10s in the video having the angle of view 2, when the video having the angle of view 2 is played alone, a frame image having a corresponding play time of 10s in the video having the angle of view 2 is played at 10 s.
In this embodiment, for each key frame image set, the play time corresponding to each key frame image in the key frame image set is the same.
Each key frame image set corresponds to a candidate view angle switching time, and for each key frame image set, the candidate view angle switching time corresponding to the key frame image set is the same as the playing time corresponding to the key frame image in the key frame image set.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. For a keyframe image set, the candidate view switching time corresponding to the keyframe image set is 10s, and the keyframe image set comprises: key frame images having a corresponding play time of 10s in view video having view 1, key frame images having a corresponding play time of 10s in view video having view 2.
In this embodiment, the key frame image for switching the view belongs to a view video having a switching view different from the view of the current view video.
When the key frame image for switching the view angle is found out from the key frame image sets corresponding to the view angle switching times among the plurality of key frame image sets, since each key frame image set corresponds to one candidate view angle switching time, respectively, the view angle switching time of one candidate of all the candidate view angle switching times is determined as the view angle switching time by step 101, it is possible to first determine the key frame image set corresponding to the one candidate of the view angle switching time among the plurality of key frame image sets, that is, the key frame image set corresponding to the view angle switching time. The key frame image for switching the view may then be found from the set of key frame images corresponding to the view switching instant.
When the key frame images of the switching view angles are searched out from the key frame image sets corresponding to the view angle switching moments in the key frame image sets, and the key frame images of the switching view angles are played, the key frame images of each switching view angle can be searched out from the key frame image sets corresponding to the view angle switching moments in the key frame image sets, and the key frame images of each switching view angle can be played, so that the key frame images of each switching view angle are displayed to a user, and the user can see the key frame images of each switching view angle. And playing part of the searched key frame images of the switching view angles in all the key frame images of the switching view angles, and displaying part of the key frame images of the switching view angles to the user. The key frame image of the key frame image different from the played switching view among the key frame images of all the searched switching views may be played in response to an instruction operation by the user, the key frame image of the key frame image different from the played switching view being presented to the user, the instruction operation by the user indicating that the key frame image of the key frame image different from the played switching view is desired to be seen.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. The current view video has a view of view 1 and a view 2. Assuming that the determined view switching time is 10s, a key frame image of view 2 and a key frame image of view 3 can be found from a set of key frame images played corresponding to 10 s. Play the keyframe image of view 2, the keyframe image of view 3. Assuming that in the case of playing a part of the view-switching key frame images in the key frame image set corresponding to 10s, the played part of the view-switching key frame images is composed of the view 2 key frame image and the view 3 key frame image, the key frame images other than the view 2 key frame image and the view 3 key frame image in the key frame image set corresponding to 10s may be played in response to the instruction operation of the user.
In this embodiment, for any frame of image, playing the frame of image may be: and rendering the frame of image to obtain a rendered image, and displaying the rendered image.
And step 103, responding to the confirmation indication operation of the user, and acquiring the video data of the target video clip from the server so as to play the target video clip.
In this embodiment, the target video clip belongs to a view video having a target view, which is a view corresponding to a key frame image for which a confirmation instruction operation of a user is directed.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. Assuming that the determined view switching time is 10s, a key frame image having a corresponding play time of 10s in a view video having a view 2, a key frame image having a corresponding play time of 10s in a view video having a view 3.
Assuming that the user desires to switch from view 1 to view 2, the user performs a confirmation instruction operation, for example, clicks on a key frame image with a corresponding play time of 10s in a view video with view 2, the key frame image targeted by the user's confirmation instruction operation is a key frame image with a corresponding play time of 10s in a view video with view 2, and the view corresponding to the key frame image targeted by the user's confirmation instruction operation is view 2.
In this embodiment, the first frame image of the target video clip may be an image in which the corresponding playing time in the view angle video having the target view angle is the end time of the confirmation instruction operation of the user, or an image in which the corresponding playing time in the view angle video having the target view angle is later than the end time of the confirmation instruction operation of the user and the corresponding playing time is closest to the end time. The last frame of image of the target video clip may be the last frame of image of the view video having the target view.
In this embodiment, the video data of the target video clip may include encoded data of images in the target video clip. When the video data of the target video clip is acquired, a request may be sent to the server, the video data of the target video clip sent by the server is received, and the video data of the target video clip is sent in a streaming manner. And the player running on the terminal of the user decodes the received coded data of each frame of image according to the sequence from the receiving moment to the late moment, and each time obtains a frame of image through decoding, plays a frame of image, and plays the target video clip.
In this embodiment, during the video watching period of the user, when the viewing angle is switched, the key frame image of the switching viewing angle is found out from the key frame image set corresponding to the moment of switching the viewing angle, the key frame image of the switching viewing angle is played, and the video data of the target video clip is obtained to play the target video clip. The commonly configured terminal can find out the key frame image of the switching view from the key frame image set corresponding to the view switching time. Meanwhile, the video data of the target video clip is only the video data of one view angle video, and the network bandwidth required for acquiring the video data of the target video clip is far smaller than the network bandwidth required for acquiring the video data of the videos of all view angles from the server in real time. Therefore, the terminal with common configuration can also perform the view angle switching under the condition that the provided network bandwidth is the common network bandwidth, and the applicability of the view angle switching is improved.
Referring to fig. 2, a flowchart of a second embodiment of a viewing angle switching method according to an embodiment of the invention is shown.
In step 201, in response to a user performing a switching instruction operation during the playing period of the video at the current viewing angle, a viewing angle switching time is determined.
Step 202, finding out the key frame image of the switching view angle from the key frame image sets corresponding to the view angle switching time in the plurality of key frame image sets, and playing the key frame image of the switching view angle.
In this embodiment, the switching view angle is any view angle different from the current view angle, and the current view angle is the view angle corresponding to the currently playing video.
In this embodiment, the plurality of views may have a predetermined order, and the predetermined order of the plurality of views may be an order in which the sequence numbers of the views are from small to large. When a key frame image of a switching view is found out from a key frame image set corresponding to a view switching time among a plurality of key frame image sets, a key frame image of a next view of a current view video may be found out from the key frame image set corresponding to the view switching time. If the view of the current view video is the last view of the plurality of views, i.e. the view with the largest sequence number, the next view of the current view video may be: the first view of the plurality of views, i.e., the view with the smallest sequence number.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. If the current view video has a view 1, the next view of the view 1 is a view 2, and the view 2 is a switching view with respect to the view 1, the key frame image of the view 2 can be found from the key frame image set corresponding to the view switching time. If the view angle of the current view angle video is view angle N, the next view angle of view angle N may be view angle 1, and with respect to view angle N, view angle N is a switching view angle, the key frame image of view angle 1 may be found out from the key frame image set corresponding to the view angle switching time.
In this embodiment, when the key frame image of the switching view angle is found out from the key frame image set corresponding to the view angle switching time, one key frame image may be randomly selected from the key frame images of all view angles different from the view angle of the current view angle video belonging to the key frame image set, and the randomly selected key frame image may be used as the found key frame image of the switching view angle.
In step 203, in response to a selection operation of the user, a key frame image of a selected view angle is found out from the key frame image set corresponding to the view angle switching time, and the key frame image of the selected view angle is played, wherein the selected view angle is different from the view angle corresponding to the key frame image played previously.
In this embodiment, the user's selection operation may be to slide left or slide right on the screen of the terminal. The user's selection operation may be a rotation operation performed by the user on the user's terminal. Each time the user performs a rotation operation, the user starts rotating the user's terminal at one time, and when the user stops rotating the user's terminal, the user is regarded as performing a rotation operation. The rotation operation may be a rotation of the user's terminal about the z-axis of the user's terminal coordinate system. The origin of the user terminal coordinate system may be the center of gravity of the user's terminal, the x-axis of the user terminal coordinate system is a coordinate axis in the horizontal direction, the y-axis of the user terminal coordinate system is a coordinate axis in the vertical direction, and the z-axis of the user terminal coordinate system is perpendicular to both the x-axis and the y-axis.
In this embodiment, the previously played key frame image may refer to a key frame image that has been played after the user performs the switching instruction operation. A previously played key frame image may be a view-switching key frame image that is found and played, or a view-selecting key frame image that is played as a result of a selection operation having been performed.
In this embodiment, after all the keyframe images of the selected view angle in the keyframe image set corresponding to the view angle switching time are played, the user may be notified that all the view angles are already displayed, specifically, a prompt message is displayed on the playing interface, where the prompt message is used to prompt the user that there is no keyframe image of the selected view angle other than the played keyframe image of the selected view angle. In addition, a selective review operation can be provided for the user, wherein the review operation is the key frame image played before the user plays. And responding to the review operation of the user, searching out a keyframe image of a review view angle from a keyframe image set corresponding to the view angle switching moment, and playing the keyframe image of the review view angle, wherein the review view angle is any view angle different from the view angle of the currently played keyframe image.
In step 204, in response to the confirmation instruction operation of the user, video data of the target video clip is acquired from the server to play the target video clip.
In this embodiment, the target video clip belongs to a view video having a target view, which is a view corresponding to a key frame image for which a confirmation instruction operation of a user is directed.
In this embodiment, the key frame image targeted by the confirmation instruction operation of the user is the key frame image currently played when the user performs the confirmation instruction operation. If the number of times of the selection operation of the user is one, the key frame image targeted by the confirmation instruction operation of the user is: and responding to the key frame image of the selected view which is searched by one selection operation. If the number of times of the selection operation of the user is multiple times, the key frame image aimed at by the confirmation instruction operation of the user is: and responding to the key frame image of the selected view, which is found by the last selection operation.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. The view angle of the current view angle video is view angle 1, the switching view angle corresponding to the searched key frame image is view angle 2, the view angle 2 is not the view angle which the user expects to switch to, and the user performs selection operation.
The user performs the selection operation for the 1 st time, and in response to the selection operation performed for the 1 st time, the key frame image of the selected view angle found from the key frame image set corresponding to the view angle switching time is the key frame image of the view angle 3, and the key frame image of the view angle 3 is played.
If the user desires to switch from view 1 to view 3, the user performs a confirmation instruction operation, the number of times of performing the selection operation of the user is one, and the key frame image targeted by the confirmation instruction operation of the user is: and responding to the key frame image of the view 3 searched by the selection operation of the user. The target view is a view 3 corresponding to the key frame image for which the user's confirmation instruction operation is directed.
If the user does not desire to switch from the view angle 1 to the view angle 3, the user performs the selection operation for the 2 nd time, and in response to the selection operation performed for the 2 nd time, the key frame image of the selected view angle found from the key frame image set corresponding to the view angle switching time is the key frame image of the view angle 4, and the key frame image of the view angle 4 is played.
If the user desires to switch from view 1 to view 4, the user performs a confirmation instruction operation, the number of times of the user's selection operation is multiple, and the key frame image of the selected view found in response to the last performed selection operation is the key frame image of view 4, where the key frame image targeted by the user's confirmation instruction operation is: key frame image for view 4. The target view is a view corresponding to the key frame image for which the user's confirmation instruction operation is directed, i.e., view 4.
In this embodiment, during the video watching period of the user, when the viewing angle is switched, the key frame image of the switching viewing angle may be first found, the key frame image of the switching viewing angle may be played, or further in response to the selection operation of the user, the key frame image of the corresponding selected viewing angle may be found, and the key frame image of the corresponding selected viewing angle may be played. Therefore, when the viewing angle is switched, the user can independently watch the key frame image corresponding to the corresponding viewing angle, so that the user can know the playing effect of the corresponding viewing angle conveniently, and the viewing angle which is expected to be switched to can be confirmed finally.
Referring to fig. 3, a flowchart of a third embodiment of a viewing angle switching method according to an embodiment of the invention is shown.
In step 301, in response to a switching instruction operation performed by a user during a playing period of a video at a current viewing angle, a viewing angle switching time is determined.
Step 302, stopping playing the video at the current viewing angle when the current playing time reaches the viewing angle switching time.
In this embodiment, when the current playing time reaches the viewing angle switching time, an image with the corresponding playing time in the current viewing angle video being the viewing angle switching time is played, and then, any frame of image with the corresponding playing time later than the viewing angle switching time in the current viewing angle video is not played any more, so that the playing of the current viewing angle video is stopped. After stopping playing the current view video and before the user performs a selection operation, the user can see an image in the current view video whose corresponding playing time is the view switching time.
For example, the view angle switching time is 10s, when the current playing time reaches 10s, an image with the corresponding playing time of 10s in the current view angle video is played, and then any frame of image with the corresponding playing time later than 10s in the current view angle video is not played any more, so that the playing of the current view angle video is stopped. After stopping playing the current view video and before the user performs a selection operation, the user can see an image of the current view video corresponding to 10s at the playing time.
Step 303, in response to a selection operation of a user, a key frame image of a switching view angle is found out from a key frame image set corresponding to a view angle switching time in a plurality of key frame image sets, and the key frame image of the switching view angle is played.
In this embodiment, after stopping playing the video at the current angle of view, the user may perform a selection operation. In the present embodiment, the switching view is a view selected by a user's selection operation, which is different from the view of the current view video. In other words, the user can select a switching view different from the view of the current view video through a selection operation.
In the present embodiment, the number of times of execution of the selection operation by the user may be one or more times. If the number of times of the user's selection operation is performed is one, step 303 is performed once. If the number of times of the selection operation by the user is multiple, step 303 is performed multiple times, and each time the switching view angle selected by the selection operation is different.
The plurality of views may have a predetermined order, and the predetermined order of the plurality of views may be an order in which the sequence numbers of the views are small to large. The switching view selected by the user through the first selection operation may be a next view of the views of the current view video among the plurality of views, and if the view of the current view video is a last view, the next view of the views of the current view video may be a first view among the plurality of views. The switching view angle selected by the user through the non-first selection operation may be: the next view of the switching view selected by the last selection operation of the non-first selection operation among all the selectable views. Any view angle different from the view angle of the current view angle video may be used as the optional view angle. If the switching view angle selected by the previous selection operation is the view angle with the largest sequence number in all the selectable view angles, the next view angle may be: the lowest numbered view among all the selectable views.
In this embodiment, a key frame image may also be selected randomly from all the selectable key frame images in response to a selection operation by the user, and the randomly selected key frame image may be used as the key frame image for switching the viewing angle. All the selectable key frame images are composed of key frame images except the currently played key frame image among the key frame images of all the selectable views, and any one view different from the view of the current view video can be used as the selectable view.
In this embodiment, each time the user performs a selection operation, the user may search for the key frame image of the switching view angle selected by the selection operation from the key frame image set corresponding to the view angle switching time, play the searched key frame image of the switching view angle, and the user may see the played key frame image of the switching view angle.
In this embodiment, if the user performs the selection operation multiple times, the switching view angle selected by the selection operation is different each time, and the found key frame images of the switching view angle are different.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. The view of the current view video is view 1.
The user performs the selection operation for the 1 st time, the switching view angle selected by the selection operation for the 1 st time is view angle 2, the key frame image of view angle 2 is searched out from the key frame image set corresponding to the view angle switching time in response to the selection operation for the 1 st time, and the key frame image of view angle 2 is played, so that after the selection operation for the 1 st time is finished, the user can see the searched key frame image of view angle 2. The searched key frame image of the view angle 2 is a frame image played at the time of switching the view angle under the condition that the view angle video with the view angle 2 is independently played.
The user performs the selection operation for the 2 nd time, the switching view angle selected by the selection operation for the 2 nd time is view angle 3, and in response to the selection operation for the 2 nd time, the key frame image of view angle 3 is searched out from the key frame image set corresponding to the view angle switching time, and the key frame image of view angle 3 is played, so that after the selection operation for the 2 nd time is finished, the user can see the searched key frame image of view angle 3. The searched key frame image of the view angle 3 is a frame image played at the time of switching the view angle under the condition that the view angle video with the view angle 3 is independently played.
In step 304, in response to the confirmation instruction operation of the user, video data of the target video clip is obtained from the server to play the target video clip.
In this embodiment, the target video clip belongs to a view video having a target view, which is a view corresponding to a key frame image for which a confirmation instruction operation of a user is directed.
In this embodiment, the key frame image targeted by the confirmation instruction operation of the user is the key frame image currently played when the user performs the confirmation instruction operation.
If the number of times of the selection operation performed by the user is one, the user may perform the confirmation instruction operation after the end of the selection operation. If the number of times of the selection operation performed by the user is a plurality of times, the user may perform the confirmation instruction operation after the end of the selection operation performed last time.
In this embodiment, if the number of times of the user's selection operation is performed is one, the key frame image targeted by the user's confirmation instruction operation is: and switching the key frame image of the view angle selected by one-time selection operation. If the number of times of the selection operation of the user is multiple times, the key frame image aimed at by the confirmation instruction operation of the user is: and the key frame image of the switching view angle is selected through the last selection operation.
For example, the plurality of viewing angles includes: viewing angle 1, viewing angle 2. The view angle of the current view angle video is view angle 1, the user carries out selection operation for the 1 st time, the switching view angle selected by the selection operation carried out for the 1 st time is view angle 2, and in response to the selection operation carried out for the 1 st time, the key frame image of the view angle 2 is searched out from the key frame image set corresponding to the view angle switching moment, and the key frame image of the view angle 2 is played.
If the user desires to switch from view 1 to view 2, the user performs a confirmation instruction operation, the number of times of performing the selection operation of the user is one, and the key frame image targeted by the confirmation instruction operation of the user is: a key frame image of view 2 in the set of key frame images corresponding to the view switching instant. The target view is a view corresponding to the key frame image for which the user's confirmation instruction operation is directed, i.e., view 2.
If the user does not desire to switch from the view angle 1 to the view angle 2, the user performs the selection operation for the 2 nd time, the selected switching view angle is the view angle 3 through the selection operation performed for the 2 nd time, and in response to the selection operation performed for the 2 nd time, the key frame image of the view angle 3 is searched out from the key frame image set corresponding to the view angle switching time, and the key frame image of the view angle 3 is played.
If the user desires to switch from view 1 to view 3, the user performs a confirmation instruction operation, the number of times of the user's selection operation is multiple times, and the switch view selected by the last selection operation is view 3. The key frame image of the switching view angle selected by the last selection operation is: a key frame image of view 3 in the set of key frame images corresponding to the view switching instant. The key frame image aimed by the user's confirmation indication operation is: a key frame image of view 3 in the set of key frame images corresponding to the view switching instant. The target view is a view 3 corresponding to the key frame image for which the user's confirmation instruction operation is directed.
In this embodiment, the target video clip belongs to a view video having a target view, which is a view corresponding to a key frame image for which the confirmation instruction operation is directed. The first frame image of the target video clip may be a subsequent frame image of the key frame image for which the user's acknowledgement indication operation is directed. The last frame of image of the target video clip may be the last frame of image of the view video having the target view.
In other words, the target video clip is a video clip played after the view switching time in the view video having the target view in the case where the view video having the target view is played alone.
For example, the determined view switching time is 10s, the current view video is view video 1, the target view is view 2, and the target video clip is a video clip played after 10s in the view video having view 2 in the case of individually playing the view video having view 2. The first frame image of the target video clip is the next frame image of a frame image with the corresponding playing time of 10s in the video with the view angle 2, and the last frame image of the target video clip is the last frame image in the video with the view angle 2.
In this embodiment, during the video watching period of the user, when the viewing angle is switched, and when the current playing time reaches the viewing angle switching time, the playing of the current viewing angle video is stopped, so that the overhead and network resources of the terminal of the user can be saved. And responding to the selection operation of the user, searching out the key frame image of the corresponding selected view angle, and playing the key frame image of the corresponding selected view angle. Therefore, when the viewing angle is switched, the user can independently watch the key frame image corresponding to the corresponding viewing angle, so that the user can know the playing effect of the corresponding viewing angle conveniently, and the viewing angle which is expected to be switched to can be confirmed finally.
Referring to fig. 4, a flowchart of a fourth embodiment of a viewing angle switching method according to an embodiment of the present invention is shown.
Step 401, acquiring a plurality of keyframe image sets from a server, wherein the plurality of keyframe image sets are generated by the server.
In this embodiment, all the keyframe image sets may be generated by the server, and the user's terminal may acquire a plurality of keyframe image sets from the server, store the plurality of keyframe image sets locally, and store the plurality of keyframe image sets in the storage space of the user's terminal.
In this embodiment, the plurality of keyframe image sets acquired from the server may be all keyframe image sets, in other words, acquiring the plurality of keyframe image sets from the server may refer to acquiring all keyframe image sets from the server.
In this embodiment, the plurality of keyframe image sets acquired from the server may be some keyframe image sets of all keyframe image sets. When a key frame image set other than the part of key frame image set needs to be acquired, acquiring the key frame image set other than the part of key frame image set from the server. For example, in the case where a part of the acquired set of key frame images does not include the set of key frame images corresponding to the view angle switching time, another part of the set of key frame images including the set of key frame images corresponding to the view angle switching time is acquired from the server.
In this embodiment, for each of the plurality of view videos, a key frame image may be extracted from the view video based on a preset duration, and a key frame image whose time interval between the corresponding playing time and the 0 time of the playing time axis before the end time of the view video is an integer multiple of the preset duration may be extracted.
For example, the preset duration is 1s, for each of the plurality of view videos, a key frame image having a time interval between a corresponding playing time and a 0 time of a playing time axis of 1s, which is a key frame image having a corresponding playing time of 1s, a key frame image having a time interval between a corresponding playing time and a 0 time of a playing time axis of 2s, which is a key frame image having a corresponding playing time of 2s, is extracted from the view video.
In this embodiment, a plurality of key frame images corresponding to the same playing time may be extracted from a plurality of view video at a time, and a plurality of key frame images corresponding to the same playing time extracted from a plurality of view video at a time may directly constitute a key frame image set, so that all the key frame image sets may be obtained.
For example, based on the preset duration 1s, a key frame image is extracted from each view video, a plurality of key frame images corresponding to the same playing time 1s extracted from a plurality of view videos at the 1 st time may directly form a key frame image, a plurality of key frame images corresponding to the same playing time 2s extracted from a plurality of view videos at the 2 nd time may directly form a key frame image, and so on.
In this embodiment, for each view video, all key frame images extracted from the view video may be first formed into an extracted image set of the view video.
For each view video, in the extracted image set of the view video, the key frame images extracted from the view video may be arranged in the order from early to late at the corresponding playing time. The key frame images at the same position in the extracted image set of each view video correspond to the same playing time, and the key frame images at the same position in the extracted image set of each view video can be aggregated into a key frame image set, so that all the key frame image sets can be obtained.
For example, for each of a plurality of view videos, the decimated image set of that view video, in turn, includes: the key frame image with the corresponding playing time of 1s in the visual angle video and the key frame image with the corresponding playing time of 2s in the visual angle video.
The 1 st key frame image in the extracted image set of each view video corresponds to the same playing time, namely 1s, and the 1 st key frame image in the extracted image set of each view video is aggregated into a key frame image set 1, wherein the key frame image set 1 comprises: and the corresponding playing time of the key frame image with the playing time of 1s in the extracted image set of each visual angle video. The 2 nd key frame image in the extracted image set of each view video corresponds to the same playing time, namely 2s, and the 2 nd key frame image in the extracted image set of each view video is aggregated into a key frame image set 2, wherein the key frame image set 2 comprises: the corresponding key frame image with playing time of 2s in the extracted image set of each view video, and so on.
In this embodiment, an identifier may also be allocated to each key frame image in the extracted image set of each view video. The identification of the key frame image may represent, in order from early to late according to the corresponding playing time, what key frame image is in the extraction image set to which the key frame image belongs. The identified same key frame images in the decimated image sets of each view video may then be aggregated into a set of key frame images.
In this embodiment, for each view video, the extracted image set of the view video may be stored in a folder corresponding to the extracted image set of the view video, where the file name of the image in the folder corresponding to the extracted image set of the view video indicates the position of the image in the extracted image set of the view video.
For example, the name of a folder corresponding to the extracted image set of the view video 1 is S1, the name of a folder corresponding to the extracted image set of the view video 2 is S2.
The folder named S1 includes: keyframe image with file name t1, keyframe image with file name t 2. The folder named S2 includes: keyframe image with file name t1, keyframe image with file name t 2. The folder named S20 includes: keyframe image with file name t1, keyframe image with file name t 2.
The key frame image of the file name t1 in the folder named S1 indicates: the key frame image with the file name t1 in the folder with the name S1 is the 1 st key frame image in the extraction image set of the view video 1. The key frame image of the file name t2 in the folder named S1 indicates: the key frame image with the file name t2 in the folder with the name S1 is the 2 nd key frame image in the extraction image set of the view video 1, and so on. The key frame image of the file name t1 in the folder named S2 indicates: the key frame image with the file name t1 in the folder with the name S2 is the 2 nd key frame image in the extraction image set of the view video 2. The key frame image with file name t2 in the folder with name S2 indicates: the key frame image in the folder named S2 with the file name t2 is the 2 nd key frame image in the decimated image set of view video 2, and so on.
When generating each key frame image set, the server can read out the key frame images with the same file name in the folder corresponding to each view video, and aggregate the key frame images with the same file name in the folder corresponding to each view video into the key frame image set.
For example, the name of a folder corresponding to the extracted image set of the view video 1 is S1, the name of a folder corresponding to the extracted image set of the view video 2 is S2. And reading a plurality of key frame images with the same file name in the folder named S1 and the folder named S20, and aggregating the plurality of key frame images with the same file name into a key frame image set. The key frame images with the file name t1 in the folder with the name S1 and the folder with the name S20 are aggregated into a key frame image set 1, the key frame images with the file name t2 in the folder with the name S1 and the folder with the name S20 are aggregated into a key frame image set 2, and the like.
In this embodiment, for each key frame image set, the key frame image set may be stored in a folder corresponding to the key frame image set. For each key frame image set, in a folder corresponding to the key frame image set, the file name of the key frame image in the key frame image set is the sequence number of the view angle video to which the key frame image belongs.
For each key frame image set, the file name of each key frame image in the key frame image set can be modified to be the sequence number of the view angle video to which the key frame image belongs, and then the file name of each key frame image in the key frame image set is in the corresponding file folder.
Referring to fig. 5, an effect diagram of storing a set of key frame images through a folder is shown.
T1, T2, T3. The plurality of view videos is 20 view videos.
The folder named T1 includes 1.jpg, 2.jpg, and 20.jpg, 1.jpg in the folder named T1 belongs to view video 1, 2.jpg in the folder named T1 belongs to view video 2, and 20.jpg in the folder named T1 belongs to view video 20. Assume that a set of key frame images corresponding to a folder named T1 corresponds to a candidate view switching time 1s. The play time corresponding to 1.Jpg in the T1 folder and the play time corresponding to 2.Jpg in the T1 folder are 1s. The designation T2 folder includes 1.jpg, 2.jpg, and 20.jpg, 1.jpg in the designation T2 folder belongs to view video 1, 2.jpg in the designation T2 folder belongs to view video 2, and 20.jpg in the designation T2 folder belongs to view video 20. Assume that a set of key frame images corresponding to a folder named T2 corresponds to a candidate view switching time 2s. The play time corresponding to 1.Jpg in the T2 folder and the play time corresponding to 2.Jpg in the T2 folder are both 2s.
In step 402, in response to a play instruction operation of a user, one view video is selected from a plurality of view videos as a current view video, and video data of the current view video is acquired to play the current view video.
In this embodiment, in response to a play instruction operation of a user, one view video may be selected from multiple view videos as a current view video, one view video may be selected randomly, one video selected randomly is selected as the current view video, a screenshot of each view video may be displayed, the user clicks one screenshot of the view video, the view video to which the screenshot clicked by the user belongs is indicated as the current video, and the view video to which the screenshot clicked by the user belongs is selected as the current video. After the current view video is selected, video data of the current view video is acquired, the video data of the current view video is provided for a player running on a terminal of a user, and the player plays the current view video based on the video data of the current view video. The play indication operation of the user may be clicking a button in the video play page indicating to play the video.
Step 403, determining the view angle switching time in response to the user performing the switching instruction operation during the playing period of the video at the current view angle.
And step 404, stopping playing the video at the current viewing angle when the current playing time reaches the viewing angle switching time.
Step 405, in response to a selection operation of a user, searching a key frame image of the switching view angle from a key frame image set corresponding to the view angle switching time in a plurality of key frame image sets, and playing the key frame image of the switching view angle.
In step 406, in response to the confirmation indication operation of the user, the video data of the target video clip is obtained to play the target video clip.
In this embodiment, a plurality of keyframe image sets are obtained from the server in advance, and the plurality of keyframe image sets are generated by the server, so that the overhead of performing view angle switching by the terminal of the user can be saved.
Please refer to fig. 6, which illustrates an effect diagram of the view angle switching.
The current view video is view video m. During the playing period of the visual angle video m, video data of the visual angle video m are acquired from the server, and a player running on a terminal of a user plays the visual angle video m based on the video data of the visual angle video m. During the play period of the view video m, the user desires to switch from the view m to the view n, and during the play period of the view video m, the user performs a switch instruction operation. When the current playing time reaches 10s, the determined viewing angle switching time 10s plays an image m.jpg of which the corresponding playing time is 10s in the viewing angle video m, and then any frame of image of which the corresponding playing time is later than 10s in the viewing angle video m is not played any more, so that the playing of the viewing angle video m is stopped, and after the playing of the viewing angle video m is stopped and before a user performs a selection operation, the image seen by the user is m.jpg. The key frame image aimed by the user's confirmation indication operation is: a key frame image of view n in the set of key frame images corresponding to the view switching instant. The target view is a view n corresponding to the key frame image for which the user's confirmation instruction operation is directed. After the user performs the confirmation instruction operation, the video data of the target video clip is acquired. The first frame image of the target video clip may be a subsequent frame image of n.jpg in the view video n, and the last frame image of the target video clip may be a last frame image in the view video n. A player running on the user's terminal plays the target video clip based on the video data of the target video clip.
Fig. 7 is a flowchart illustrating a fifth embodiment of a viewing angle switching method according to an embodiment of the present invention.
In step 701, the terminal determines a viewing angle switching time in response to a switching instruction operation performed by a user during a playing period of a video of a current viewing angle.
The specific implementation of step 701 in the present embodiment may refer to the specific implementation of step 101 in the first embodiment.
In some implementations of the present embodiment, further comprising: the terminal obtains a plurality of keyframe image sets from a server before determining the view angle switching moment in response to the switching instruction operation performed by a user in the playing period of the video of the current view angle, and the server generates the keyframe image sets by the following steps: for each view angle video, extracting a key frame image from the view angle video to obtain an extracted image set of the view angle video, and storing the extracted image set of the view angle video in a folder corresponding to the view angle video, wherein key frame images in the extracted image set of the view angle video are arranged in an order from early to late according to corresponding playing moments, and in the folder corresponding to the extracted image set of the view angle video, the file name of the key frame image indicates the position of the key frame image in the extracted image set of the view angle video; and reading out the key frame images with the same file name in the folder corresponding to each view video, and aggregating the key frame images with the same file name in the folder corresponding to each view video into a key frame image set.
In some implementations of the present embodiment, further comprising: the terminal responds to the switching instruction operation of a user in the playing period of the current visual angle video, and before the visual angle switching moment is determined, responds to the playing instruction operation of the user, and selects one visual angle video from a plurality of visual angle videos as the current visual angle video; and acquiring video data of the current visual angle video to play the current visual angle video.
Step 702, the server receives the view angle switching time sent by the terminal, searches the key frame image for switching the view angle from the key frame image set corresponding to the view angle switching time in the plurality of key frame image sets, and plays the key frame image for switching the view angle.
In this embodiment, the key frame images of the switching view belong to the view video with the switching view, and the switching view is different from the view of the current view video, each key frame image in the key frame image set is from a different view video, and the playing time corresponding to each key frame image in the key frame image set is the same. The specific implementation of step 702 in this embodiment is the same as that of step 102 in the first embodiment, except that the execution body is different.
In some implementations of the present embodiment, further comprising: after the terminal responds to the switching instruction operation of the user in the playing period of the video at the current visual angle and determines the visual angle switching time, stopping playing the video at the current visual angle by the terminal when the current playing time reaches the visual angle switching time; and the server responds to the selection operation of the user, searches the key frame image of the switching view angle from the key frame image sets corresponding to the view angle switching time in the key frame image sets, and plays the key frame image of the switching view angle, wherein the switching view angle is the view angle which is selected by the selection operation and is different from the view angle of the video of the current view angle.
In step 703, the terminal receives the view-switching key frame image sent by the server, and plays the view-switching key frame image.
In step 704, the terminal obtains video data of the target video clip from the server in response to the confirmation instruction operation of the user, so as to play the target video clip.
In this embodiment, the target video clip belongs to a view video having a target view, which is a view corresponding to a key frame image for which the confirmation instruction operation is directed. The specific implementation of step 704 in this embodiment may refer to the specific implementation of step 103 in the first embodiment.
In some implementations of the present embodiment, further comprising: before the terminal responds to the confirmation indication operation of the user, the server responds to the selection operation of the user, searches the key frame image of the selected view angle from the key frame image set corresponding to the view angle switching moment, and plays the key frame image of the selected view angle, wherein the selected view angle is different from the view angle corresponding to the key frame image played before.
In some optional implementations of this embodiment, the first frame image of the target video clip is a subsequent frame image to the key frame image for which the confirmation indication operation is directed.
Fig. 8 is a schematic structural diagram of a viewing angle switching device according to an embodiment of the invention. The specific implementation of the operations performed by the respective units or sub-units in the apparatus may be the specific implementation of the corresponding operations described in the above-mentioned reference method embodiments.
As shown in fig. 8, the viewing angle switching device provided in the embodiment of the present invention includes: a first response unit 801, a second response unit 802, and a third response unit 803.
The first response unit 801 is configured to determine a viewing angle switching timing in response to a switching instruction operation performed by a user during a playing period of a current viewing angle video;
The second response unit 802 is configured to find a key frame image of a switching view angle from a key frame image set corresponding to a view angle switching time in a plurality of key frame image sets, and play the key frame image of the switching view angle, where the key frame image of the switching view angle belongs to a view angle video with the switching view angle, and the switching view angle is different from a view angle of a current view angle video, each key frame image in the key frame image set is from a different view angle video, and play time corresponding to each key frame image in the key frame image set is the same;
the third response unit 803 is configured to obtain, in response to a confirmation instruction operation of the user, video data of a target video clip from a server to play the target video clip, where the target video clip belongs to a view video having a target view angle, the target view angle being a view angle corresponding to a key frame image for which the confirmation instruction operation is directed.
In some embodiments, the viewing angle switching device further comprises:
and a fourth response unit configured to, before the confirmation instruction operation in response to the user, search, in response to a selection operation by the user, a key frame image of a selected view from a set of key frame images corresponding to a view switching time, and play the key frame image of the selected view, wherein the selected view is different from a view corresponding to a key frame image played previously.
In some embodiments, the viewing angle switching device further comprises:
a stop play unit configured to stop playing the current view video when the current play time reaches the view switching time after determining the view switching time in response to a switching instruction operation by a user during play of the current view video; the second response unit 802 is further configured to, in response to a selection operation by the user, search a key frame image of a switching view from a key frame image set corresponding to a view switching time among a plurality of key frame image sets, and play the key frame image of the switching view, wherein the switching view is a view different from a view of a current view video selected by the selection operation.
In some embodiments, the viewing angle switching device further comprises:
an acquisition unit configured to acquire a plurality of key frame image sets from a server before determining a view switching timing in response to a switching instruction operation by a user during a play period of a current view video, wherein the key frame image sets are generated by the server by: for each view video, extracting a key frame image from the view video to obtain an extracted image set of the view video, and storing the extracted image set of the view video in a folder corresponding to the view video, wherein the key frame images in the extracted image set of the view video are arranged in an early-to-late order according to corresponding playing moments, and in the folder corresponding to the extracted image set of the view video, the file names of the key frame images indicate the positions of the key frame images in the extracted image set of the view video; and reading out the key frame images with the same file name in the folder corresponding to each view video, and aggregating the key frame images with the same file name in the folder corresponding to each view video into a key frame image set.
In some embodiments, the first frame image of the target video clip is a subsequent frame image to the key frame image for which the acknowledgement indication operation was directed.
In some embodiments, the viewing angle switching device further comprises:
a selection playing unit configured to select one view video from among the plurality of view videos as a current view video in response to a play instruction operation by a user before determining a view switching time in response to a switch instruction operation by the user during a play period of the current view video; and acquiring video data of the current visual angle video to play the current visual angle video.
The embodiment of the present invention also provides a terminal, as shown in the figure, including a processor 901, a communication interface 902, a memory 903, and a communication bus 904, where the processor 901, the communication interface 902, the memory 903 utilize the communication bus 904 to perform communication with each other,
a memory 903 for storing a computer program;
the processor 901 is configured to execute a program stored in the memory 903, and implement the following steps:
determining a viewing angle switching moment in response to a switching instruction operation performed by a user during the playing period of the video at the current viewing angle; searching a key frame image of a switching view angle from a key frame image set corresponding to a view angle switching moment in a plurality of key frame image sets, and playing the key frame image of the switching view angle, wherein the key frame image of the switching view angle belongs to a view angle video with the switching view angle, the switching view angle is different from the view angle of the current view angle video, each key frame image in the key frame image set is from a different view angle video, and the playing moment corresponding to each key frame image in the key frame image set is the same; and responding to the confirmation indication operation of the user, acquiring video data of a target video segment from a server to play the target video segment, wherein the target video segment belongs to a view angle video with a target view angle, and the target view angle is a view angle corresponding to a key frame image aimed by the confirmation indication operation.
The communication bus mentioned by the above terminal may be a peripheral component interconnect standard (Peripheral Component Interconnect, abbreviated as PCI) bus or an extended industry standard architecture (Extended Industry Standard Architecture, abbreviated as EISA) bus, etc. The communication bus may be classified as an address bus, a data bus, a control bus, or the like. For ease of illustration, the figures are shown with only one bold line, but not with only one bus or one type of bus.
The communication interface is used for communication between the terminal and other devices.
The memory may include random access memory (RandomAccess Memory, RAM) or non-volatile memory (non-volatile memory), such as all disk memory. Alternatively, the memory may be all storage devices located remotely from the aforementioned processor.
The processor may be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU for short), a network processor (Network Processor, NP for short), etc.; but also digital signal processors (Digital Signal Processing, DSP for short), application specific integrated circuits (Application Specific Integrated Circuit, ASIC for short), field-programmable gate arrays (Field-Programmable Gate Array, FPGA for short) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
In yet another embodiment of the present invention, a computer readable storage medium having instructions stored therein, which when run on a computer, cause the computer to perform the method of any of the above embodiments is also provided.
In a further embodiment of the present invention, there is also provided a computer program product containing instructions which, when run on a computer, cause the computer to perform the method of any of the above embodiments.
In the above embodiments, it may be implemented in whole or in part using software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, produces a flow or function in accordance with embodiments of the present invention, in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable apparatus. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another, for example, by wired (e.g., coaxial cable, optical fiber, digital Subscriber Line (DSL)), or wireless (e.g., infrared, wireless, microwave, etc.). The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that contains an integration of one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), etc.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
In this specification, each embodiment is described in a related manner, and identical and similar parts of each embodiment are all referred to each other, and each embodiment mainly describes differences from other embodiments. In particular, for system embodiments, since they are substantially similar to method embodiments, the description is relatively simple, as relevant to see a section of the description of method embodiments.
The foregoing description is only of the preferred embodiments of the present invention and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included in the protection scope of the present invention.

Claims (10)

1. A viewing angle switching method applied to a terminal, the method comprising:
in response to a user performing a switching instruction operation during a play period of a current view video, determining a view angle switching time, wherein the determining of the view angle switching time includes determining, as the view angle switching time, a candidate view angle switching time closest to an end time of the switching instruction operation of the user among all candidate view angle switching times later than the end time of the switching instruction operation of the user, wherein the candidate view angle switching time includes a time, which is an integer multiple of a preset duration, of time intervals between 0 times of a play time axis before the end time of the view video;
searching a key frame image of a switching view angle from a key frame image set corresponding to a view angle switching moment in a plurality of key frame image sets, and playing the key frame image of the switching view angle, wherein the key frame image of the switching view angle belongs to a view angle video with the switching view angle, the switching view angle is different from the view angle of the current view angle video, each key frame image in the key frame image set is from a different view angle video, and the playing moment corresponding to each key frame image in the key frame image set is the same;
And responding to the confirmation indication operation of the user, acquiring video data of a target video segment from a server to play the target video segment, wherein the target video segment belongs to a view angle video with a target view angle, and the target view angle is a view angle corresponding to a key frame image aimed by the confirmation indication operation.
2. The method of claim 1, wherein prior to said indicating operation in response to said user's acknowledgement, the method further comprises:
and responding to the selection operation of the user, searching a key frame image of a selected view angle from a key frame image set corresponding to the view angle switching moment, and playing the key frame image of the selected view angle, wherein the selected view angle is different from the view angle corresponding to the key frame image played before.
3. The method according to claim 1, wherein after determining the view switching timing in response to a user's switch instruction operation during the playing of the current view video, the method further comprises:
stopping playing the video at the current visual angle when the current playing time reaches the visual angle switching time;
the step of searching the key frame image of the switching view angle from the key frame image set corresponding to the view angle switching moment in the plurality of key frame image sets, and playing the key frame image of the switching view angle includes:
And responding to the selection operation of the user, searching a key frame image of a switching view angle from a key frame image set corresponding to the view angle switching moment in a plurality of key frame image sets, and playing the key frame image of the switching view angle, wherein the switching view angle is a view angle which is selected by the selection operation and is different from the view angle of the video of the current view angle.
4. The method of claim 1, wherein prior to determining the view switch moment in response to a switch indication operation by a user during playback of the current view video, the method further comprises:
obtaining a plurality of keyframe image sets from a server, wherein the keyframe image sets are generated by the server by:
for each view video, extracting a key frame image from the view video to obtain an extracted image set of the view video, and storing the extracted image set of the view video in a folder corresponding to the view video, wherein the key frame images in the extracted image set of the view video are arranged in an early-to-late order according to corresponding playing moments, and in the folder corresponding to the extracted image set of the view video, the file names of the key frame images indicate the positions of the key frame images in the extracted image set of the view video;
And reading out the key frame images with the same file name in the folder corresponding to each view video, and aggregating the key frame images with the same file name in the folder corresponding to each view video into a key frame image set.
5. The method of claim 1, wherein the first frame image of the target video segment is a subsequent frame image to the key frame image for which the acknowledgment indication operation was directed.
6. The method of claim 1, wherein prior to determining the view switch moment in response to a switch indication operation by a user during playback of the current view video, the method further comprises:
responding to a play indication operation of a user, and selecting one view video from a plurality of view videos as a current view video;
and acquiring video data of the current visual angle video to play the current visual angle video.
7. A viewing angle switching method applied to a viewing angle switching system, wherein the viewing angle switching system comprises a terminal and a server, the method comprising:
the terminal responds to a switching instruction operation performed by a user in the playing period of the current visual angle video, and determines visual angle switching time, wherein the determining of the visual angle switching time comprises the step of determining the visual angle switching time of the candidate closest to the ending time of the switching instruction operation of the user from all the visual angle switching time of the candidate later than the ending time of the switching instruction operation of the user as the visual angle switching time, and the time of the candidate between the visual angle switching time and the 0 time of the playing time axis, which is before the ending time of the visual angle video, is an integral multiple of a preset duration, as the visual angle switching time of the candidate;
The server receives the view angle switching moment sent by the terminal, searches a key frame image of a switching view angle from a key frame image set corresponding to the view angle switching moment in a plurality of key frame image sets, and plays the key frame image of the switching view angle, wherein the key frame image of the switching view angle belongs to a view angle video with the switching view angle, the switching view angle is different from the view angle of the current view angle video, each key frame image in the key frame image set is from a different view angle video, and the playing moment corresponding to each key frame image in the key frame image set is the same;
the terminal receives the key frame image of switching the visual angle sent by the server and plays the key frame image of switching the visual angle;
and the terminal responds to the confirmation indication operation of the user, and acquires video data of a target video clip from a server to play the target video clip, wherein the target video clip belongs to a view angle video with a target view angle, and the target view angle is a view angle corresponding to a key frame image aimed by the confirmation indication operation.
8. A viewing angle switching device, the device comprising:
A first response unit configured to determine, in response to a switching instruction operation by a user during a play period of a current view video, a view switching time, wherein the determining of the view switching time includes determining, as the view switching time, a candidate view switching time closest to an end time of the switching instruction operation by the user among all candidate view switching times later than the end time of the switching instruction operation by the user, wherein the candidate view switching time includes a time, which is an integer multiple of a preset duration, of time intervals between 0 times of a play time axis before the end time of the view video as the candidate view switching time;
a second response unit configured to find a key frame image of a switching view angle from a key frame image set corresponding to a view angle switching time in a plurality of key frame image sets, and play the key frame image of the switching view angle, wherein the key frame image of the switching view angle belongs to a view angle video having the switching view angle, and the switching view angle is different from a view angle of a current view angle video, each key frame image in the key frame image set is from a different view angle video, and play time corresponding to each key frame image in the key frame image set is the same;
And a third response unit configured to obtain video data of a target video clip from a server in response to a confirmation instruction operation of the user, so as to play the target video clip, wherein the target video clip belongs to a view angle video with a target view angle, and the target view angle is a view angle corresponding to a key frame image for which the confirmation instruction operation is directed.
9. The terminal is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory use the communication bus to complete communication;
a memory for storing a computer program;
a processor for carrying out the method steps of any one of claims 1-6 when executing a program stored on a memory.
10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method according to any of claims 1-6.
CN202110506722.4A 2021-05-10 2021-05-10 Viewing angle switching method, device, terminal and storage medium Active CN113382267B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110506722.4A CN113382267B (en) 2021-05-10 2021-05-10 Viewing angle switching method, device, terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110506722.4A CN113382267B (en) 2021-05-10 2021-05-10 Viewing angle switching method, device, terminal and storage medium

Publications (2)

Publication Number Publication Date
CN113382267A CN113382267A (en) 2021-09-10
CN113382267B true CN113382267B (en) 2023-08-08

Family

ID=77572411

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110506722.4A Active CN113382267B (en) 2021-05-10 2021-05-10 Viewing angle switching method, device, terminal and storage medium

Country Status (1)

Country Link
CN (1) CN113382267B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10191261A (en) * 1996-12-20 1998-07-21 Nippon Telegr & Teleph Corp <Ntt> Multiple viewpoint video reproducing method
CN101300840A (en) * 2005-11-04 2008-11-05 微软公司 Multi-view video delivery
CN102833584A (en) * 2012-05-22 2012-12-19 中华电信股份有限公司 Video streaming method of multi-view interactive television
CN106341711A (en) * 2016-09-27 2017-01-18 成都西可科技有限公司 Multi-position video live broadcast playback method and system
CN109257611A (en) * 2017-07-12 2019-01-22 阿里巴巴集团控股有限公司 A kind of video broadcasting method, device, terminal device and server
CN110225369A (en) * 2019-07-16 2019-09-10 百度在线网络技术(北京)有限公司 Video selection playback method, device, equipment and readable storage medium storing program for executing
CN111356018A (en) * 2020-03-06 2020-06-30 北京奇艺世纪科技有限公司 Play control method and device, electronic equipment and storage medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8737816B2 (en) * 2002-08-07 2014-05-27 Hollinbeck Mgmt. Gmbh, Llc System for selecting video tracks during playback of a media production

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10191261A (en) * 1996-12-20 1998-07-21 Nippon Telegr & Teleph Corp <Ntt> Multiple viewpoint video reproducing method
CN101300840A (en) * 2005-11-04 2008-11-05 微软公司 Multi-view video delivery
CN102833584A (en) * 2012-05-22 2012-12-19 中华电信股份有限公司 Video streaming method of multi-view interactive television
CN106341711A (en) * 2016-09-27 2017-01-18 成都西可科技有限公司 Multi-position video live broadcast playback method and system
CN109257611A (en) * 2017-07-12 2019-01-22 阿里巴巴集团控股有限公司 A kind of video broadcasting method, device, terminal device and server
CN110225369A (en) * 2019-07-16 2019-09-10 百度在线网络技术(北京)有限公司 Video selection playback method, device, equipment and readable storage medium storing program for executing
CN111356018A (en) * 2020-03-06 2020-06-30 北京奇艺世纪科技有限公司 Play control method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN113382267A (en) 2021-09-10

Similar Documents

Publication Publication Date Title
CN106658199B (en) Video content display method and device
US9066145B2 (en) Commenting correlated to temporal point of video data
US11068720B2 (en) Method and apparatus for adding augmented reality data in live video, and storage medium
US20210160577A1 (en) Method for playing video, electronic device and storage medium
CN104243590B (en) Resource object recommends method and apparatus
CN109996110B (en) Video playing method, terminal, server and storage medium
CN108076377B (en) Video storage and playing method and device, electronic equipment and storage medium
WO2021213191A1 (en) Video processing method, terminal, and computer readable storage medium
US20150104149A1 (en) Video summary apparatus and method
CN110913135A (en) Video shooting method and device, electronic equipment and storage medium
WO2019114330A1 (en) Video playback method and apparatus, and terminal device
US10021433B1 (en) Video-production system with social-media features
CN110944123A (en) Intelligent guide method for sports events
US20210127147A1 (en) Method and apparatus for providing content using edge computing service
CN111279709A (en) Providing video recommendations
CN111163306B (en) VR video processing method and related device
CN113382267B (en) Viewing angle switching method, device, terminal and storage medium
CN113556568B (en) Cloud application running method, system, device and storage medium
CN105763930B (en) A kind of method, intelligent TV set and set-top box pushing TV programme two dimensional code
CN110213596A (en) Switching method, device, computer equipment and storage medium is broadcast live
US10674188B2 (en) Playback apparatus, method of controlling playback apparatus, playback method and server apparatus
CN116049490A (en) Material searching method and device and electronic equipment
CN105812865A (en) Information processing method and electronic device
EP3598738A1 (en) Video synthesis method, apparatus and device, and video playing method, apparatus and device
CN110287934A (en) A kind of method for checking object, device, client and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant