CN110225405B - Panoramic video playing method and device - Google Patents
Panoramic video playing method and device Download PDFInfo
- Publication number
- CN110225405B CN110225405B CN201910629361.5A CN201910629361A CN110225405B CN 110225405 B CN110225405 B CN 110225405B CN 201910629361 A CN201910629361 A CN 201910629361A CN 110225405 B CN110225405 B CN 110225405B
- Authority
- CN
- China
- Prior art keywords
- playing
- panoramic video
- frame rate
- configuration file
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client
- H04N21/65—Transmission of management data between client and server
- H04N21/658—Transmission by the client directed to the server
- H04N21/6587—Control parameters, e.g. trick play commands, viewpoint selection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Abstract
The invention provides a panoramic video playing method and device. The panoramic video playing method comprises the following steps: acquiring panoramic video data; adding a guide playing parameter to the panoramic video data and forming a configuration file containing the parameter set; when a command for guiding playing is received, playing the panoramic video according to a configuration file corresponding to the command; each configuration file comprises a plurality of guide playing parameters corresponding to a plurality of panoramic video frame sequences in the panoramic video data, the plurality of playing parameters form a parameter set corresponding to the configuration file, and the guide playing parameters at least comprise a view angle parameter and a frame rate; the viewing angle parameters at least comprise a viewing angle, a horizontal angle and a vertical angle. The panoramic video playing method and the panoramic video playing device can enable the view angle of the panoramic video watched by the user to be changed like the shooting skill of professional photographers or the post processing skill of the panoramic video.
Description
Technical Field
The present invention relates to video processing technologies, and in particular, to a method and an apparatus for playing a panoramic video.
Background
Generally, when the smart terminal plays the panoramic video, the playing device plays only a part of the pictures in a certain orientation in the panoramic video. In fact, the panoramic video is a scene in which an observer is centered and an omnidirectional 360-degree field of view is observed by rotating around a fixed point. During playing, the intelligent terminal can determine which partial image in the current frame image of the panoramic video is displayed by sliding a screen or moving hardware equipment by a user, the partial image is equivalent to the partial image seen when the user is used as an observer to watch the panoramic video at a certain watching visual angle, and the watching visual angle is the playing visual angle of the current video.
However, when watching a panoramic video, a user may interact with a panoramic video playing device through a specific hardware device, and input viewing angle control information in real time to realize free switching of viewing angles, which is disadvantageous in that the panoramic video is not added with an artistic clip of a photographer or a producer during shooting or recording, the user lacks grasp of the entire content of the video during watching, and easily misses a highlight, which results in a video work that should be very wonderful but does not bring a wonderful presentation to the user. Furthermore, it is also possible that the user does not have a scene of interest at any moment, but has to act from moment to moment since a viewing perspective instruction has to be given; it is also possible that the user needs to slowly watch some highlights, but the user is inconvenienced by having to manually play back and input viewing angle information.
Disclosure of Invention
The following presents a simplified summary of the invention in order to provide a basic understanding of some aspects of the invention. It should be understood that this summary is not an exhaustive overview of the invention. It is not intended to identify key or critical elements of the invention or to delineate the scope of the invention. Its sole purpose is to present some concepts in a simplified form as a prelude to the more detailed description that is discussed later.
In view of this, the present invention provides a method and an apparatus for playing a panoramic video, so as to at least solve the problems in the prior art that a wonderful shot is easily missed and manual playback is required when playing the panoramic video.
The invention provides a panoramic video playing method, which comprises the following steps: acquiring panoramic video data; adding a guide playing parameter to the panoramic video data and forming a configuration file containing the parameter set; when a command for guiding playing is received, playing the panoramic video according to a configuration file corresponding to the command; each configuration file comprises a plurality of guide playing parameters corresponding to a plurality of panoramic video frame sequences in the panoramic video data, the plurality of playing parameters form a parameter set corresponding to the configuration file, and the guide playing parameters at least comprise a view angle parameter and a frame rate; the viewing angle parameters at least comprise a viewing angle, a horizontal angle and a vertical angle.
Further, by setting the view angle parameter and the frame rate of the configuration file, it is possible to: the playing frame rate corresponding to the wonderful pictures is a first frame rate, and the playing frame rate corresponding to the non-wonderful pictures is a second frame rate, wherein the first frame rate is less than the second frame rate.
Further, by setting the view angle parameter and the frame rate of the configuration file, it is possible to: the playing frame rate corresponding to part of the wonderful pictures in the same continuous video frame is a first frame rate, and the playing frame rate corresponding to the rest parts in the continuous video frame is a second frame rate, wherein the first frame rate is less than the second frame rate.
Further, by setting the view parameters of different sequences of video frames in the configuration file, such that: and displaying the preset target moment.
Further, the current frame rate is changed according to a user selection or input.
Further, the configuration file is in an editable format; adding the same or different guide playing parameters to a certain section or a plurality of sections of the same panoramic video source:
further, a different view parameter is added to each frame or several frames of the sequence of video frames MS:
furthermore, one or more corresponding video frame sequences in the same configuration file are provided with playing parameters, and the other video frame sequences are not provided with the playing parameters, or all corresponding video frame sequences in the same configuration file are provided with the playing parameters; and/or one or several of the view parameters in the plurality of profiles may be the same or different.
Further, the received instruction for guiding playing comprises an automatic mode playing instruction and a non-automatic mode playing instruction; if the received instruction for guiding the playing is an automatic mode playing instruction, when a user slides a screen to watch the panoramic video, if the user does not interact with the playing device for a long time, the judgment is carried out by the preset interval time n seconds of two input instructions, and if the user does not operate the playing device for more than n seconds, the instruction for guiding the playing is automatically triggered; firstly, determining a triggering time point and a user visual angle during triggering, then searching a visual angle parameter which corresponds to the triggering time point and is closest to the user visual angle in a plurality of configuration files, and playing the panoramic video according to the configuration file corresponding to the searched visual angle parameter, wherein the method for judging the wonderful visual angle which corresponds to the triggering time point and is closest to the user visual angle comprises the following steps: judging and searching for the maximum value of the overlapping parts of the display area corresponding to the user visual angle of the trigger time point and the display areas corresponding to all the wonderful visual angles of the trigger time point, and taking the wonderful visual angle corresponding to the maximum value as the wonderful visual angle closest to the user visual angle; and if the received instruction for guiding the visual angle playing is a non-automatic mode playing instruction, a user inputs a certain configuration file by a button to play the panoramic video according to the configuration file.
In addition, another aspect of the present invention provides a panoramic video playing apparatus, including: a video acquisition unit adapted to acquire panoramic video data; the configuration unit is suitable for adding a guide playing parameter to the panoramic video data and forming a configuration file containing the parameter set; the playing unit is suitable for playing the panoramic video according to the configuration file corresponding to the instruction when the instruction for guiding playing is received; each configuration file comprises a plurality of guiding playing parameters corresponding to a plurality of panoramic video frame sequences in the panoramic video data, the plurality of playing parameters form a parameter set corresponding to the configuration file, and the guiding playing parameters at least comprise a view angle parameter and a frame rate.
The panoramic video playing method and the panoramic video playing device can enable the user to obtain the visual change similar to the shooting skill of professional photographers or the post processing skill of videos in the mode of watching the panoramic video.
These and other advantages of the present invention will become more apparent from the following detailed description of the preferred embodiments of the present invention, taken in conjunction with the accompanying drawings.
Drawings
The invention may be better understood by referring to the following description in conjunction with the accompanying drawings, in which like reference numerals are used throughout the figures to indicate like or similar parts. The accompanying drawings, which are incorporated in and form a part of this specification, illustrate preferred embodiments of the present invention and, together with the detailed description, serve to further explain the principles and advantages of the invention. Wherein:
FIG. 1 is a flow chart illustrating an exemplary process of a panoramic video playback method of the present invention;
fig. 2 is a block diagram showing a configuration of an example of a panoramic video playback apparatus of the present invention.
Skilled artisans appreciate that elements in the figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be exaggerated relative to other elements to help improve the understanding of the embodiments of the present invention.
Detailed Description
Exemplary embodiments of the present invention will be described hereinafter with reference to the accompanying drawings. In the interest of clarity and conciseness, not all features of an actual implementation are described in the specification. It will of course be appreciated that in the development of any such actual embodiment, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which will vary from one implementation to another. Moreover, it will be appreciated that such a development effort might be complex and time-consuming, but would nevertheless be a routine undertaking for those of ordinary skill in the art having the benefit of this disclosure.
It should be noted that, in order to avoid obscuring the present invention with unnecessary details, only the device structures and/or processing steps closely related to the solution according to the present invention are shown in the drawings, and other details not so relevant to the present invention are omitted.
Fig. 1 shows an exemplary process of one panoramic video playing method described above.
In the embodiment of the present invention, the highlight is, for example, a screen including a designated object, and the designated object is, for example, a certain sight spot, a certain target (such as a statue, a building, etc.), a certain person, or the like. In addition, the number of designated objects included in the highlight may be one or more.
As shown in fig. 1, in step S1, panoramic video data is acquired. Then, step S2 is executed.
In step S2, a guide play parameter is added to the panoramic video data, and a profile containing the parameter set is formed. Then, step S3 is executed.
As an example, in step S2, the configuration file is, for example, an editable format, and one or more, the user may select a certain configuration file when watching the panoramic video, and the configuration file enables the panoramic video to automatically change the playing view angle and/or the playing mode according to the video content of different angles in the video frame, and enables the playing of the panoramic video to present different wonderful content according to different configuration files. And adding the same or different guide playing parameters to a certain section or a plurality of sections of the same panoramic video source, as shown in the table I.
Watch 1
As shown in table one, the guiding playback parameters include, for example, a view parameter (F), a frame rate (Fr), and the like. The play parameters in the video frame sequence M1 include, for example, a view parameter F11, a frame rate Fr11, and the like; the play parameters in the video frame sequence M2 include, for example, a view parameter F12, a frame rate Fr12, and the like; … …, respectively; the play parameters in the video frame sequence MS include, for example, a view parameter F1S, a frame rate Fr1S, and the like.
The viewing angle parameters include, for example, at least a field angle (FOV), a horizontal angle, and a vertical angle (i.e., a pitch angle).
Wherein the video frame sequences M1, M2, … and MS represent S video frame sequences in the same panoramic video source, S being, for example, 1, 2 or more.
The profiles 1, 2, …, N indicate N profiles corresponding to the panoramic video source, where N is, for example, 1 or more.
As shown in table one, the parameter set in the profile 1 includes the playing parameters (F11, Fr11, … …) of the video frame sequence M1, the playing parameters (F12, Fr12, … …) of the video frame sequence M2, … …, and the playing parameters (F1S, Fr1S, … …) of the video frame sequence MS.
It should be noted that only a certain segment, i.e., a certain video frame sequence, in the same configuration file may be configured with the playing parameters, while the remaining video frame sequences are not configured.
In addition, only a plurality of segments, namely a plurality of video frame sequences, can be configured with the playing parameters in the same configuration file, and the rest video frame sequences are not configured; alternatively, the same configuration file may also configure the playing parameters for all video frame sequences.
Furthermore, one or several of the view parameters may be the same or different in the plurality of profiles.
As an example, it is also possible to add different view angle parameters to each frame or several frames (i.e. multiframes) of the sequence of video frames MS, as shown in table two.
Watch two
Wherein MSI1, MSI2, …, MSIw represent the w frames in the sequence of video frames MS (it should be understood that MSI1 does not necessarily represent the first frame of the sequence, but one of the w frames). The sequence of video frames MS corresponds to N profiles, i.e. profiles 10, 20, …, N0, where N is for example 1 or more.
By way of example, the combined sequence of playback parameters in the profile may cause the sequence of video frames to be played in, but not limited to, the manner one through the manner three described below.
In one approach, the scene picture can be skipped quickly by increasing the frame rate, for example, when the video content is not wonderful or has not changed significantly for a long time, and can be played slowly by decreasing the frame rate when the video content is wonderful or needs to be viewed carefully.
As an example, by setting the view angle parameter and the frame rate of the configuration file, it is made such that: the playing frame rate corresponding to the wonderful pictures is a first frame rate, and the playing frame rate corresponding to the non-wonderful pictures is a second frame rate, wherein the first frame rate is less than the second frame rate.
As an example, by setting the view angle parameter and the frame rate of the configuration file, it is made such that: the playing frame rate corresponding to part of the wonderful pictures in the same continuous video frame is a first frame rate, and the playing frame rate corresponding to the rest parts in the continuous video frame is a second frame rate, wherein the first frame rate is less than the second frame rate.
For example, the highlight can be at a preset frame rate a, and the non-highlight can be at a preset frame rate b, where a is smaller than b.
For another example, a frame rate a may be preset for a part of the highlight in the same continuous video frame, and a frame rate b is preset for the rest of the continuous video frame, where a is smaller than b, for example.
In the second mode, for example, one or more target time points in the panoramic video may be always displayed.
In the third mode, for example, a view angle change may be implemented, for example, a continuous rotation effect of a video picture of a certain playing view angle may be achieved by a fast change of the view angle.
For example, the panoramic video shows that the playing angle of view is unchanged when the player is looking down at the overhead bridge within a certain time, so that the playing angle of view can be slightly changed within several continuous frames, and the playing angle of view can be rotated to look down at the overhead bridge.
As an example, the current frame rate may be changed according to a user selection or input.
For example, assume a preset configuration file p1, which is played at a default configured frame rate Frp1, and the viewing angle parameters corresponding to different video frame sequences in the configuration file are changed so that the video frames are displayed at a predetermined target (such as a tower) time; when the display screen has not changed for a long time (e.g. more than 15 seconds, etc.), the user may select to change the frame rate playing, for example, select another preset frame rate (e.g. accelerate playing), or may manually input the frame rate playing, etc.
As an example, the above table one and table two may be inclusion relations (table one may include table two). For example, the configuration file 10 may be a view parameter (F101, F102, … …, F10w) added in each frame or several frames in the panoramic video frame sequence M1 to satisfy the view transformation playing requirement; the view parameters in the playing parameters in the video frame sequence M1 in the profile 1 are changed according to the view parameters (F101, F102, … …, F10w) of the profile 10, and the rest of the playing parameters, such as the frame rate, are not changed.
In addition, the above table one and table two may be independent of each other.
As shown in fig. 1, after step S2 is completed, when a guide play instruction is received, the panoramic video may be played according to a profile corresponding to the instruction in step S3.
The instruction playback instruction received in S3 includes, for example, an automatic mode playback instruction and a non-automatic mode playback instruction. When receiving the instruction of playing of user, firstly, judging whether the triggering instruction of user is the playing instruction of automatic mode or the playing instruction of non-automatic mode.
As an example, if the instruction is an automatic mode playing instruction, when the user slides the screen to watch the panoramic video, if the user does not interact with the playing device for a long time, the judgment is made by a preset interval time n seconds between two input instructions (n is, for example, 2 seconds, 3 seconds, 5 seconds, 10 seconds, or the like), and if the user does not operate the playing device for more than n seconds, the instruction for guiding the playing is automatically triggered; at this time, the playing device firstly determines a triggering time point and a user visual angle during triggering, then searches a visual angle parameter which corresponds to the triggering time point and is closest to the user visual angle in a plurality of configuration files, and plays the panoramic video according to the configuration file corresponding to the searched visual angle parameter. The number of the "configuration files corresponding to the view parameters" may be one or more, and when the number of the "configuration files corresponding to the view parameters" exceeds two, the playing device may match one configuration file randomly for playing, for example.
For example, the method for determining the view angle parameter closest to the user view angle at the trigger time point includes: and judging and searching the maximum value of the overlapping part of the display area S0 corresponding to the user visual angle at the trigger time point and the display area (S1, S2, … …, SN) corresponding to the visual angle parameter in all the playing parameters at the trigger time point.
As an example, a prompt may be given when the overlapping portions are both 0, for example.
For example, if the user selects the automatic mode in the instruction for guiding playing in the initial selection of the panoramic video playing, the user view is projected to the spherical surface, the playing scene picture corresponding to the spherical attitude angle (90 degrees and 80 degrees) in the first minute of the panoramic video is a sky, when the user enters the automatic mode for guiding playing, the spherical attitude angle of the user when triggered is (80 degrees and 70 degrees), and the corresponding display area is S0; if the display area corresponding to the view angle parameter in all the playing parameters of the trigger time point in the configuration file is (S1, S2, … …, SN), the overlapping portion of S1 and S0 is 30%, the overlapping portion of S2 and S0 is 50%, the overlapping portion of S3 and S0 is 80%, and the overlapping portion of the display area corresponding to the remaining view angles and the display area S0 corresponding to the user view angle is 0, then the view angle parameter corresponding to S3 is selected to be, for example, the spherical attitude angle (90 °, 80 °), since the sky scene corresponding to the angle does not change for a long time, the frame rate parameter in the playing parameters including the view angle parameter has been set to 60, and the frame rate of the panoramic video frame mapping in the first minute is increased; namely, the playing device plays the panoramic video according to the configuration file where the playing parameter is located, and the playing device continues to play the panoramic video according to the configuration file on the premise that the user does not trigger any other playing instruction.
For another example, a playing scene picture corresponding to a spherical attitude angle (120 ° or 30 °) in a second minute of the panoramic video includes a stationary target high tower, and when a user enters a guidance playing automatic mode and the spherical attitude angle of the user during triggering is just close to the attitude angle (120 ° or 30 °), a configuration file containing the attitude angle (120 ° or 30 °) is automatically matched, so that the playing angle after the panoramic video can be displayed in the video picture while keeping the stationary target;
for another example, when the playback scene screen corresponding to the spherical attitude angle (120 ° -80 °) in the third minute of the panoramic video overlooks a bridge and the user enters the automatic guided playback mode, and the spherical attitude angle of the user at the time of triggering is just close to the attitude angle (120 ° -80 °), the profile including the attitude angle (120 ° -80 °) is automatically matched, and the subsequent playback angle is slightly rotated so that the screen rotates when overlooking the bridge.
In addition, as an example, if the instruction is a non-automatic mode playing instruction, the user inputs a button to select a certain configuration file, and the playing device plays the panoramic video according to the configuration file. In this mode of playback, the user can manually select different profiles to view different highlights at the same time.
For example, a user view angle is projected to a spherical surface, a spherical attitude angle at a certain moment when the user watches a panoramic video is (90 degrees and 80 degrees), a video picture corresponding to the angle can only see a piece of sky, at the moment, the user triggers a guidance playing non-automatic mode, a user button inputs and selects a configuration file N, a wonderful picture corresponding to the triggering time point in the configuration file N runs through a fawn, a spherical attitude angle corresponding to the configuration file N is (60 degrees and 60 degrees), the current user view angle is adjusted to (60 degrees and 60 degrees), and the playing device continues to play the panoramic video according to the configuration file N on the premise that the user does not trigger any other playing instructions until the configuration file finishes automatically jumping out the guidance playing non-automatic mode.
It should be noted that, when the panoramic video enters the guidance mode for playing, the user can enter the panoramic video free mode (sliding the screen or moving the hardware device) for playing through interaction with the playing device at any time.
It should be noted that the viewing angle parameter can take various expressions, such as coordinates, attitude angle, space vector, and the like.
Therefore, the scene pictures watched by the same user when the same panoramic video is watched and the guiding play mode is triggered at different angles and different moments are different; because the video source file is not modified, the viewing angle and/or the viewing mode are/is adjusted correspondingly by the playing device according to different trigger modes, and the interest and experience of a user in viewing the panoramic video are enhanced.
In addition, the embodiment of the invention also provides a panoramic video playing device.
Fig. 2 is a block diagram showing the structure of an example of the panoramic video playback apparatus.
As shown in fig. 2, the panoramic video playback apparatus includes a video acquisition unit 210, a configuration unit 220, and a playback unit 230.
As shown in fig. 2, the video acquisition unit 210 is configured to acquire panoramic video data.
The configuration unit 220 is configured to add a guidance playing parameter to the panoramic video data, and form a configuration file containing the parameter set.
As an example, the configuration files are, for example, in an editable format, and one or more configuration files may be selected by the user when watching the panoramic video, where the configuration files enable the panoramic video to automatically change the playing view angle and/or the playing mode according to the video content at different angles in the video frame, and enable the playing of the panoramic video to show different wonderful content according to different configuration files. The same or different guide play parameters are added to a certain segment or several segments of the same panoramic video source, as shown in table one above.
Wherein the video frame sequences M1, M2, … and MS represent S video frame sequences in the same panoramic video source, S being, for example, 1, 2 or more.
The profiles 1, 2, …, N indicate N profiles corresponding to the panoramic video source, where N is, for example, 1 or more.
It should be noted that only a certain segment, i.e., a certain video frame sequence, in the configuration file may be configured with the playing parameters, while the remaining video frame sequences are not configured.
In addition, only a plurality of segments, namely a plurality of video frame sequences, can be configured with the playing parameters, and the rest of the video frame sequences are not configured; alternatively, the configuration file may also configure the playing parameters for all video frame sequences.
Furthermore, one or several of the view parameters may be the same or different in the plurality of profiles.
As an example, the configuration unit 220 may also add different view parameters to each frame or several frames in the sequence of video frames MS, as shown in table two above.
Wherein MSI1, MSI2, …, MSIw represent the w frames in the sequence of video frames MS (it should be understood that MSI1 does not necessarily represent the first frame of the sequence, but one of the w frames). The sequence of video frames MS corresponds to N profiles, i.e. profiles 10, 20, …, N0, where N is for example 1 or more.
The parameters for guiding playing include, for example, a viewing angle parameter, a frame rate, and the like, where the viewing angle parameter includes, for example, at least a viewing angle, a horizontal angle, and a vertical angle.
For example, the combined sequence of playback parameters in the profile may cause the sequence of video frames to be played back in, but not limited to, the manner one through the manner three described below.
In one approach, the scene picture can be skipped quickly by increasing the frame rate, for example, when the video content is not wonderful or has not changed significantly for a long time, and can be played slowly by decreasing the frame rate when the video content is wonderful or needs to be viewed carefully.
In the second mode, for example, one or more target time points in the panoramic video may be always displayed.
In the third mode, for example, a view angle change may be implemented, for example, a continuous rotation effect of a video picture of a certain playing view angle may be achieved by a fast change of the view angle.
As an example, the above table one and table two may be inclusion relations (table one may include table two). For example, the configuration file 10 may be a view parameter (F101, F102, … …, F10w) added in each frame or several frames in the panoramic video frame sequence M1 to satisfy the view transformation playing requirement; the view parameters in the playing parameters in the video frame sequence M1 in the profile 1 are changed according to the view parameters (F101, F102, … …, F10w) of the profile 10, and the rest of the playing parameters, such as the frame rate, are not changed.
In addition, the above table one and table two may be independent of each other.
As shown in fig. 2, when receiving a guide playing instruction, the playing unit 230 may play the panoramic video according to a configuration file corresponding to the instruction.
As an example, the instruction play instruction received by the play unit 230 includes, for example, an automatic mode play instruction and a non-automatic mode play instruction. When receiving the instruction of playing of user, firstly, judging whether the triggering instruction of user is the playing instruction of automatic mode or the playing instruction of non-automatic mode.
As an example, if the instruction is an automatic mode playing instruction, when the user slides the screen to watch the panoramic video, if the user does not interact with the playing device for a long time, the playing unit 230 may determine that the user has a preset interval time of n seconds between two times of inputting the instruction (where n is, for example, 2 seconds, 3 seconds, 5 seconds, or 10 seconds), and if the user does not operate the playing device for more than n seconds, automatically trigger to guide the playing instruction; at this time, the playing device firstly determines a triggering time point and a user visual angle during triggering, then searches a visual angle parameter which corresponds to the triggering time point and is closest to the user visual angle in a plurality of configuration files, and plays the panoramic video according to the configuration file corresponding to the searched visual angle parameter. The number of the "configuration files corresponding to the view parameters" may be one or more, and when the number of the "configuration files corresponding to the view parameters" exceeds two, the playing device may match one configuration file randomly for playing, for example.
For example, the playing unit 230 may determine the view angle parameter whose trigger time point is closest to the user view angle by the following processing: and judging and searching the maximum value of the overlapping part of the display area S0 corresponding to the user visual angle at the trigger time point and the display area (S1, S2, … …, SN) corresponding to the visual angle parameter in all the playing parameters at the trigger time point.
As an example, the playing unit 230 may give a prompt when the overlapping portions are both 0, for example.
For example, if the user selects the automatic mode in the instruction for guiding playing in the initial selection of the panoramic video playing, the user view is projected to the spherical surface, the playing scene picture corresponding to the spherical attitude angle (90 degrees and 80 degrees) in the first minute of the panoramic video is a sky, when the user enters the automatic mode for guiding playing, the spherical attitude angle of the user when triggered is (80 degrees and 70 degrees), and the corresponding display area is S0; if the display area corresponding to the view angle parameter in all the playing parameters of the trigger time point in the configuration file is (S1, S2, … …, SN), the overlapping portion of S1 and S0 is 30%, the overlapping portion of S2 and S0 is 50%, the overlapping portion of S3 and S0 is 80%, and the overlapping portion of the display area corresponding to the remaining view angles and the display area S0 corresponding to the user view angle is 0, then the view angle parameter corresponding to S3 is selected to be, for example, the spherical attitude angle (90 °, 80 °), since the sky scene corresponding to the angle does not change for a long time, the frame rate parameter in the playing parameters including the view angle parameter has been set to 60, and the frame rate of the panoramic video frame mapping in the first minute is increased; namely, the playing device plays the panoramic video according to the configuration file where the playing parameter is located, and the playing device continues to play the panoramic video according to the configuration file on the premise that the user does not trigger any other playing instruction.
For another example, a playing scene picture corresponding to a spherical attitude angle (120 ° or 30 °) in a second minute of the panoramic video includes a stationary target high tower, and when a user enters a guidance playing automatic mode and the spherical attitude angle of the user during triggering is just close to the attitude angle (120 ° or 30 °), a configuration file containing the attitude angle (120 ° or 30 °) is automatically matched, so that the playing angle after the panoramic video can be displayed in the video picture while keeping the stationary target;
for another example, when the playback scene screen corresponding to the spherical attitude angle (120 ° -80 °) in the third minute of the panoramic video overlooks a bridge and the user enters the automatic guided playback mode, and the spherical attitude angle of the user at the time of triggering is just close to the attitude angle (120 ° -80 °), the profile including the attitude angle (120 ° -80 °) is automatically matched, and the subsequent playback angle is slightly rotated so that the screen rotates when overlooking the bridge.
In addition, as an example, if the instruction is a non-automatic mode playing instruction, the user inputs a button to select a certain configuration file, and the playing unit 230 plays the panoramic video according to the configuration file. In this mode of playback, the user can manually select different profiles to view different highlights at the same time.
For example, a user view angle is projected to a spherical surface, a spherical attitude angle at a certain moment when the user watches a panoramic video is (90 degrees and 80 degrees), a video picture corresponding to the angle can only see a piece of sky, at the moment, the user triggers a guidance playing non-automatic mode, a user button inputs and selects a configuration file N, a wonderful picture corresponding to the triggering time point in the configuration file N runs through a fawn, a spherical attitude angle corresponding to the configuration file N is (60 degrees and 60 degrees), the current user view angle is adjusted to (60 degrees and 60 degrees), and the playing device continues to play the panoramic video according to the configuration file N on the premise that the user does not trigger any other playing instructions until the configuration file finishes automatically jumping out the guidance playing non-automatic mode.
It should be noted that, when the panoramic video enters the guidance mode for playing, the user can enter the panoramic video free mode (sliding the screen or moving the hardware device) for playing through interaction with the playing device at any time.
It should be noted that the viewing angle parameter can take various expressions, such as coordinates, attitude angle, space vector, and the like.
Therefore, the scene pictures watched by the same user when the same panoramic video is watched and the guiding play mode is triggered at different angles and different moments are different; because the video source file is not modified, the viewing angle and/or the viewing mode are/is adjusted correspondingly by the playing device according to different trigger modes, and the interest and experience of a user in viewing the panoramic video are enhanced.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; although the present invention and the advantageous effects thereof have been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions.
Claims (8)
1. A panoramic video playing method is characterized by comprising the following steps:
acquiring panoramic video data;
adding a guide playing parameter to the panoramic video data and forming a configuration file containing a plurality of guide playing parameters; and
when a play instruction is received, playing the panoramic video according to a configuration file corresponding to the instruction;
each configuration file comprises a plurality of guide playing parameters corresponding to a plurality of panoramic video frame sequences in the panoramic video data, the plurality of guide playing parameters form a parameter set corresponding to the configuration file, and the guide playing parameters at least comprise a view angle parameter and a frame rate; the viewing angle parameters at least comprise a viewing angle, a horizontal angle and a vertical angle; setting the view angle parameter and the frame rate of the configuration file to enable: the playing frame rate corresponding to part of wonderful pictures in the same continuous video frame is a first frame rate, and the playing frame rate corresponding to the rest parts in the continuous video frame is a second frame rate, wherein the first frame rate is less than the second frame rate; setting the view angle parameter and the frame rate of the configuration file to enable: the playing frame rate corresponding to the wonderful pictures is a first frame rate, and the playing frame rate corresponding to the non-wonderful pictures is a second frame rate, wherein the first frame rate is less than the second frame rate;
the received instruction for guiding playing comprises an automatic mode playing instruction and a non-automatic mode playing instruction; if the received instruction for guiding the playing is an automatic mode playing instruction, when a user slides a screen to watch the panoramic video, if the user does not interact with the playing device for a long time, the judgment is carried out by the preset interval time n seconds of two input instructions, and if the user does not operate the playing device for more than n seconds, the instruction for guiding the playing is automatically triggered; firstly, determining a triggering time point and a user visual angle during triggering, searching a visual angle parameter which corresponds to the triggering time point and is closest to the user visual angle in a plurality of configuration files, and playing the panoramic video according to the configuration file corresponding to the searched visual angle parameter; and if the received instruction for guiding the visual angle playing is a non-automatic mode playing instruction, a user inputs a certain configuration file by a button to play the panoramic video according to the configuration file.
2. The panoramic video playback method of claim 1, wherein the view parameters of different video frame sequences in the configuration file are set such that: and displaying the preset target moment.
3. The panoramic video playback method of claim 2, wherein the current frame rate is changed according to a user selection or input.
4. The panoramic video playing method according to claim 3, wherein the configuration file is in an editable format; adding the same or different guide playing parameters to a certain section or a plurality of sections of the same panoramic video source:
5. the panoramic video playing method according to claim 3, characterized in that different view angle parameters are added to each frame or several frames in the video frame sequence MS:
6. the panoramic video playing method according to claim 1, characterized in that:
one or more corresponding video frame sequences in the same configuration file are provided with playing parameters, and the other video frame sequences are not provided with the playing parameters, or all corresponding video frame sequences in the same configuration file are provided with the playing parameters; and/or one or several of the view parameters in the plurality of profiles may be the same or different.
7. The panoramic video playback method of claim 1,
the method for searching the view angle parameter closest to the user view angle corresponding to the trigger time point in the plurality of configuration files comprises the following steps: and judging and searching the maximum value of the overlapping parts of the display area corresponding to the user visual angle of the trigger time point and the display areas corresponding to all the wonderful visual angles of the trigger time point, and taking the wonderful visual angle corresponding to the maximum value as the wonderful visual angle closest to the user visual angle.
8. A panoramic video playback apparatus, comprising:
a video acquisition unit adapted to acquire panoramic video data;
the configuration unit is suitable for adding guide playing parameters to the panoramic video data and forming a configuration file containing a plurality of guide playing parameters; each configuration file comprises a plurality of guide playing parameters corresponding to a plurality of panoramic video frame sequences in the panoramic video data, the plurality of guide playing parameters form a parameter set corresponding to the configuration file, and the guide playing parameters at least comprise a view angle parameter and a frame rate; setting the view angle parameter and the frame rate of the configuration file to enable: the playing frame rate corresponding to part of wonderful pictures in the same continuous video frame is a first frame rate, and the playing frame rate corresponding to the rest parts in the continuous video frame is a second frame rate, wherein the first frame rate is less than the second frame rate; setting the view angle parameter and the frame rate of the configuration file to enable: the playing frame rate corresponding to the wonderful pictures is a first frame rate, and the playing frame rate corresponding to the non-wonderful pictures is a second frame rate, wherein the first frame rate is less than the second frame rate;
the playing unit is suitable for playing the panoramic video according to the configuration file corresponding to the instruction when the instruction for guiding playing is received; the received instruction for guiding playing comprises an automatic mode playing instruction and a non-automatic mode playing instruction; if the received instruction for guiding the playing is an automatic mode playing instruction, when a user slides a screen to watch the panoramic video, if the user does not interact with the playing device for a long time, the judgment is carried out by the preset interval time n seconds of two input instructions, and if the user does not operate the playing device for more than n seconds, the instruction for guiding the playing is automatically triggered; firstly, determining a triggering time point and a user visual angle during triggering, searching a visual angle parameter which corresponds to the triggering time point and is closest to the user visual angle in a plurality of configuration files, and playing the panoramic video according to the configuration file corresponding to the searched visual angle parameter; and if the received instruction for guiding the visual angle playing is a non-automatic mode playing instruction, a user inputs a certain configuration file by a button to play the panoramic video according to the configuration file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910629361.5A CN110225405B (en) | 2019-07-12 | 2019-07-12 | Panoramic video playing method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910629361.5A CN110225405B (en) | 2019-07-12 | 2019-07-12 | Panoramic video playing method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110225405A CN110225405A (en) | 2019-09-10 |
| CN110225405B true CN110225405B (en) | 2021-06-25 |
Family
ID=67813341
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910629361.5A Active CN110225405B (en) | 2019-07-12 | 2019-07-12 | Panoramic video playing method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110225405B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110944123A (en) * | 2019-12-09 | 2020-03-31 | 北京理工大学 | Intelligent guide method for sports events |
| CN113099237B (en) * | 2021-04-02 | 2023-06-27 | 深圳市帧彩影视科技有限公司 | Video processing method and device |
| CN114866837B (en) * | 2022-05-26 | 2023-10-13 | 影石创新科技股份有限公司 | Video processing method, device, computer equipment and storage medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106331732A (en) * | 2016-09-26 | 2017-01-11 | 北京疯景科技有限公司 | Method for generating panoramic content, method for displaying panoramic content and corresponding devices |
| CN106358036A (en) * | 2016-08-31 | 2017-01-25 | 杭州当虹科技有限公司 | Method for watching virtual reality video at preset view angle |
| CN107872731A (en) * | 2017-11-22 | 2018-04-03 | 三星电子（中国）研发中心 | Panoramic video player method and device |
| CN107888987A (en) * | 2016-09-29 | 2018-04-06 | 华为技术有限公司 | A kind of panoramic video player method and device |
| CN108307219A (en) * | 2017-11-07 | 2018-07-20 | 深圳市佳创视讯技术股份有限公司 | A kind of high definition television panoramic video intelligence methods of exhibiting |
| CN109309880A (en) * | 2018-10-08 | 2019-02-05 | 腾讯科技（深圳）有限公司 | Video broadcasting method, device, computer equipment and storage medium |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101844032B1 (en) * | 2014-12-26 | 2018-05-14 | 주식회사 케이티 | Method for sending video in region of interest from panoramic-video, server and device |
| CN104918011B (en) * | 2015-05-29 | 2018-04-27 | 华为技术有限公司 | A kind of method and device for playing video |
-
2019
- 2019-07-12 CN CN201910629361.5A patent/CN110225405B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106358036A (en) * | 2016-08-31 | 2017-01-25 | 杭州当虹科技有限公司 | Method for watching virtual reality video at preset view angle |
| CN106331732A (en) * | 2016-09-26 | 2017-01-11 | 北京疯景科技有限公司 | Method for generating panoramic content, method for displaying panoramic content and corresponding devices |
| CN107888987A (en) * | 2016-09-29 | 2018-04-06 | 华为技术有限公司 | A kind of panoramic video player method and device |
| CN108307219A (en) * | 2017-11-07 | 2018-07-20 | 深圳市佳创视讯技术股份有限公司 | A kind of high definition television panoramic video intelligence methods of exhibiting |
| CN107872731A (en) * | 2017-11-22 | 2018-04-03 | 三星电子（中国）研发中心 | Panoramic video player method and device |
| CN109309880A (en) * | 2018-10-08 | 2019-02-05 | 腾讯科技（深圳）有限公司 | Video broadcasting method, device, computer equipment and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110225405A (en) | 2019-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110225405B (en) | Panoramic video playing method and device | |
| AU2019216671B2 (en) | Method and apparatus for playing video content from any location and any time | |
| CN107872731B (en) | Panoramic video playing method and device | |
| CN108900771B (en) | Video processing method and device, terminal equipment and storage medium | |
| CN109416931A (en) | Device and method for eye tracking | |
| CN110225401B (en) | Video playing method and device capable of adjusting visual angle | |
| US20160255282A1 (en) | Interactive surveillance overlay | |
| CN110225402B (en) | Method and device for intelligently keeping interesting target time display in panoramic video | |
| BRPI0807370A2 (en) | IMAGE PROCESSING APPARATUS AND METHOD, MOBILE IMAGE REPRODUCTION APPLIANCE, AND, PROGRAM. | |
| CN108702464B (en) | Video processing method, control terminal and mobile device | |
| US20100226622A1 (en) | Video player and video playback method | |
| CN101552874A (en) | Image processing apparatus, display control method, program, and storage medium | |
| KR101830786B1 (en) | Apparatus for generating script, apparatus for playing video, and method for controlling screen relating to video based on 360 degree | |
| CN110324641B (en) | Method and device for keeping interest target moment display in panoramic video | |
| US8260119B2 (en) | Content editing apparatus | |
| WO2022083696A1 (en) | Photographing method and apparatus, and electronic device | |
| CN112346798A (en) | Information acquisition method and device | |
| CN113256491A (en) | Free visual angle data processing method, device, equipment and storage medium | |
| CN112166599A (en) | Video editing method and terminal equipment | |
| JP5532645B2 (en) | Video editing program and video editing apparatus | |
| CN110324640B (en) | Intelligent panoramic video playing method and device | |
| CN110312170B (en) | Video playing method and device capable of intelligently adjusting visual angle | |
| BR112019024498A2 (en) | METHODS, SYSTEMS AND MEDIA FOR PRESENTING MEDIA CONTENT PREVIEWS | |
| KR102372181B1 (en) | Display device and method for control thereof | |
| WO2022226745A1 (en) | Photographing method, control apparatus, photographing device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |