CN111491203A - Video playback method, device, equipment and computer readable storage medium - Google Patents
Video playback method, device, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN111491203A CN111491203A CN202010180224.0A CN202010180224A CN111491203A CN 111491203 A CN111491203 A CN 111491203A CN 202010180224 A CN202010180224 A CN 202010180224A CN 111491203 A CN111491203 A CN 111491203A
- Authority
- CN
- China
- Prior art keywords
- event type
- video
- played back
- video frame
- frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 58
- 238000001514 detection method Methods 0.000 claims description 41
- 238000004590 computer program Methods 0.000 claims description 11
- 239000000126 substance Substances 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 4
- 238000004891 communication Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000007689 inspection Methods 0.000 description 5
- 230000000694 effects Effects 0.000 description 3
- 238000012545 processing Methods 0.000 description 3
- 230000000153 supplemental effect Effects 0.000 description 2
- 230000001351 cycling effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
- H04N21/4755—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for defining user preferences, e.g. favourite actors or genre
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Databases & Information Systems (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
The embodiment of the invention provides a video playback method, a video playback device, video playback equipment and a computer-readable storage medium. Wherein, the method comprises the following steps: acquiring event type information of a video frame to be played back, wherein the event type information is used for indicating the event type of the video frame to be played back; determining the video playback speed of the video frame to be played back according to the event type; and playing back the video frame to be played back according to the video playback speed. By the method and the device, the problem of low video playback efficiency in the related technology is solved, and the video playback efficiency is improved.
Description
Technical Field
The present invention relates to the field of video processing technologies, and in particular, to a video playback method, apparatus, device, and computer-readable storage medium.
Background
There is an increasing interest in using personal electronic devices to record events such as birthday parties, sporting events, outdoor activities, and the like. In many instances, users make long video clips that contain relatively few events of interest. For example, a user may have recorded three hours of cycling through a mountain, where only a few minutes may be considered interesting. When reviewing the video, the user may have to watch a large number of uninteresting videos before reaching the interesting portions of the videos. Although the user may manually fast forward through the uninteresting portions, this may cause the user to miss interesting portions of the video unless the fast forward playback speed is reduced.
In order to solve the problems, in the related art, the time period range of the video file to be browsed and the number of split screen windows for simultaneously performing multi-window playback are controlled by automatically equally dividing and segmenting the designated time period of the video, so that the playback of the monitoring video is realized. However, in the above scheme, the segments are automatically equally divided according to the time period, and there still exist some portions that are not interested by the user in some time period, so that the user has to watch some videos of the non-interested portions before watching the interested portions of the videos, so that the user cannot quickly browse important information, and the video playback efficiency is low.
Disclosure of Invention
Based on this, embodiments of the present invention provide a video playback method, apparatus, device, and computer-readable storage medium, so as to solve the problem of low efficiency of video playback in the related art.
In a first aspect, an embodiment of the present invention provides a video playback method, where the method includes:
acquiring event type information of a video frame to be played back, wherein the event type information is used for indicating the event type of the video frame to be played back;
determining the video playback speed of the video frame to be played back according to the event type;
and playing back the video frame to be played back according to the video playback speed.
In some embodiments, the obtaining the event type information of the video frame to be played back includes:
acquiring an event type auxiliary frame, wherein the event type auxiliary frame carries event type information of the video frame to be played back;
and analyzing the event type auxiliary frame to obtain the event type information of the video frame to be played back.
In some embodiments, before obtaining the event type information of the video frame to be played back, the method includes:
acquiring a video stream, wherein the video stream includes a first event type auxiliary frame and the video frame to be played back, the first event type auxiliary frame is inserted before the video frame to be played back, and the first event type auxiliary frame is further used for indicating a start position of the video frame to be played back.
In some of these embodiments, the video stream further comprises: a second event type auxiliary frame, wherein the second event type auxiliary frame is inserted after the video frame to be played back, and the second event type auxiliary frame is further used for indicating the end position of the video frame to be played back.
In some embodiments, the determining, according to the event type, the video playback multiple speed of the video frame to be played back includes:
judging whether the event type of the video frame to be played back is a first preset event type;
and under the condition that the event type of the video frame to be played back is judged to be the first preset event type, playing back the video frame to be played back according to the video playback double speed corresponding to the first preset event type.
In some of these embodiments, the method further comprises:
and skipping the playback of the video frame to be played back under the condition that the event type corresponding to the video frame to be played back is judged not to be the first preset event type.
In some of these embodiments, the first preset event type includes at least one of: common event type, alarm event type, motion detection event type and human face event type.
In some embodiments, the playing back the video frame to be played back according to the video playback double speed corresponding to the first preset event type includes:
obtaining interest level information of the video frame to be played back, wherein the interest level information is used for indicating the interest level of a user on the video to be played back;
determining the video playback speed according to the first preset event type and the interest level of the video frame to be played back;
and playing back the video frame to be played back according to the video playback speed.
In some embodiments, for each event type in the first preset event type, the interest level includes a first interest level and a second interest level in order of increasing interest level of the user in the video to be played back; wherein the content of the first and second substances,
and the video playback speed corresponding to the first interest level is lower than that corresponding to the second interest level.
In some embodiments, the level of interest is determined based on an amount of information of interest to a user in the video frame to be played back.
In a second aspect, an embodiment of the present invention provides a video playback apparatus, including:
the device comprises an acquisition module, a playback module and a display module, wherein the acquisition module is used for acquiring event type information of a video frame to be played back, and the event type information is used for indicating the event type of the video frame to be played back;
the determining module is used for determining the video playback speed of the video frame to be played back according to the event type information;
and the playback module is used for playing back the video frame to be played back according to the video playback speed.
In a third aspect, an embodiment of the present invention provides a video playback device, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the video playback method described above when executing the computer program.
In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the video playback method described above.
The embodiment of the invention provides a video playback method, a video playback device, video playback equipment and a computer-readable storage medium, wherein event type information of a video frame to be played back is acquired, and the event type information is used for indicating the event type of the video frame to be played back; determining the video playback speed of the video frame to be played back according to the event type; the method for playing back the video frame to be played back according to the video playback speed solves the problem of low video playback efficiency in the related technology, and improves the video playback efficiency.
The details of one or more embodiments of the invention are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the invention.
Drawings
In order to more clearly illustrate the embodiments of the present invention or technical solutions in related arts, the drawings needed to be used in the description of the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without inventive labor.
Fig. 1 is a flowchart of a video playback method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of calculating an area fraction of a motion detection region according to an embodiment of the invention;
fig. 3 is a flowchart of a video playback method according to a preferred embodiment of the present invention;
fig. 4 is a block diagram of the structure of a video playback apparatus according to an embodiment of the present invention;
fig. 5 is a hardware configuration diagram of a video playback device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. All other examples, which can be obtained by a person skilled in the art without making any creative effort based on the examples in the present invention, belong to the protection scope of the present invention.
It is obvious that the drawings in the following description are only examples or embodiments of the application, from which the application can also be applied to other similar scenarios without inventive effort for a person skilled in the art. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is explicitly and implicitly understood by one skilled in the art that the embodiments described herein can be combined with other embodiments.
Unless otherwise defined, technical or scientific terms used in the claims and the specification should have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. The use of the terms "a" and "an" and "the" and similar referents in the context of describing and claiming the application are not to be construed as limiting in any way, but rather as indicating the singular or plural. The word "comprise" or "comprises", and the like, means that the element or item listed before "comprises" or "comprising" covers the element or item listed after "comprising" or "comprises" and its equivalent, and does not exclude other elements or items. "connected" or "coupled" and similar terms are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect. As used in the specification and claims of this application, "a plurality" means two or more. "and/or" describes the association relationship of the associated objects, meaning that there may be three relationships, e.g., a and/or B, which may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship.
The method embodiment provided by the embodiment can be executed in a video server. The video playback method according to the embodiment of the present invention will be described and explained below by taking a video server as an example.
In the present embodiment, a video playback method is provided. Fig. 1 is a flowchart of a video playback method according to an embodiment of the present invention, and as shown in fig. 1, the flowchart includes the following steps:
step S102: the video server obtains event type information of the video frame to be played back, wherein the event type information is used for indicating the event type of the video frame to be played back.
Step S104: and the video server determines the video playback speed of the video frame to be played back according to the event type.
Step S106: and the video server plays back the video frame to be played back according to the video playback speed.
In this embodiment, the video server determines the event type of each to-be-played back video frame in the video, determines the video playback speed of each to-be-played back video frame in the video according to the event type, and finally plays back the to-be-played back video frame at the video playback speed corresponding to each to-be-played back video frame in the video, so that accurate control over the playback speed of each to-be-played back video frame in the video is achieved, a technical effect of quickly browsing a part which is interested by a user and filtering out a part which is not interested by the user is achieved, a problem of low video playback efficiency in the related art is solved, and video playback efficiency is improved.
In this embodiment, the video server may obtain the event type of the video frame to be played back in various ways.
For example, in some embodiments, before obtaining the event type information of the video frame to be played back, the video server may obtain a video stream, where the video stream includes a first event type auxiliary frame, the video frame to be played back, and the first event type auxiliary frame is inserted before the video frame to be played back, and the first event type auxiliary frame is also used to indicate a start position of the video frame to be played back. In this embodiment, the video server inserts the first event type auxiliary frame before the video frame to be played back and is used to indicate the starting position of the video frame to be played back, so that when the user plays back the video frame to be played back, the video conference server can directly parse the first event type auxiliary frame to determine the event type and the starting position of the video frame to be played back, and further determine the starting playback time and the playback speed of the video frame to be played back. By the method, the starting time of the video frame to be played back and the event type of the video frame to be played back can be acquired in real time.
In this embodiment, the video stream may further include a second event type auxiliary frame, where the second event type auxiliary frame is inserted after the video frame to be played back, and the second event type auxiliary frame is further used for indicating an end position of the video frame to be played back. Wherein, the video server inserts the second event type auxiliary frame after the video frame to be played back, the second event type auxiliary frame can be used for determining that the video frame to be played back with the event type indicated by the first event type auxiliary frame is finished; in the case that the event type of the next video frame to be played back is indicated in the second event type auxiliary frame, the event type of the next video frame to be played back may also be determined, and the next video frame to be played back may be played back according to the video playback double speed corresponding to the event type. By the method, the starting position of the video frame to be played back of each event type can be positioned, and the continuity of the whole video playback can be ensured.
For another example, in some embodiments, the video server may further store a configuration file corresponding to the video frame to be played back in the storage unit in advance, and when the video server plays back the video frame to be played back, the video server may directly obtain the configuration file corresponding to the video frame to be played back from the storage unit, and further obtain the event type information of the video frame to be played back according to the configuration file, so as to determine the playback speed, the playback start time, and the playback end time of the video frame to be played back.
Based on the above embodiment, the manner in which the video server obtains the event type information corresponding to the video frame to be played back is not limited to obtaining the event type auxiliary frame by analyzing the video corresponding to the video frame to be played back, where the event type auxiliary frame carries the event type information of the video frame to be played back, and then obtaining the event type information of the video frame to be played back by analyzing the event type auxiliary frame; the method and the device for obtaining the event type information of the video frame to be played back are not limited to the method and the device for obtaining the event type information of the video frame to be played back from the storage unit when the video frame to be played back is played back, and the method and the device for obtaining the event type information can also be other methods capable of obtaining the event type information. By the method, the event type information corresponding to the video frame to be played back is acquired.
In the above embodiment, after determining the event type of the video frame to be played back, the video server may determine the video playback double speed of the video frame to be played back according to the event type.
For example, in some embodiments, the video server determines whether the event type of the video frame to be played back is a first preset event type; and under the condition that the event type of the video frame to be played back is judged to be a first preset event type, playing back the video frame to be played back according to the video playback double speed corresponding to the first preset event type.
In this embodiment, the user configures the basic playback speed for the preset event type and configures different basic playback speeds for different preset event types, so that the video server can configure different playback speeds for video frames to be played back of different event types, thereby improving playback efficiency and facilitating the user to quickly browse an interested part.
In this embodiment, the first preset event type may be an event type used to represent interest of the user, for example, the first preset event type may be, but is not limited to, at least one of the following: common event type, alarm event type, motion detection event type and human face event type.
In this embodiment, the video server may also skip the playback of the video frame to be played back when it is determined that the event type corresponding to the video frame to be played back is not the first preset event type. By the method, the video server can accurately exclude the video frames which are not interesting or unimportant to the user according to the first preset event type set by the user, so that the effect of quickly and effectively playing back the interesting parts or important parts of the user in the video is achieved.
Based on the above embodiment, when it is determined that the event type corresponding to the video frame to be played back is the first preset event type, the video server may play back the video frame to be played back according to the video playback double speed corresponding to the first preset event type.
For example, in some embodiments, the video server obtains interest level information of a video frame to be played back, where the interest level information is used to indicate a user interest level of the video to be played back; determining video playback speed according to the first preset event type and the interest level of the video frame to be played back; and playing back the video frame to be played back according to the video playback speed. By the method, the video server can further realize further subdivision regulation and control of the playback speed of the video frame to be played back corresponding to the event type which is interested by the user according to the interest level, so that the details of the video frame to be played back corresponding to the event type which is interested by the user can be better displayed.
In some embodiments, assuming that the basic video playback speed corresponding to the first preset event type is a, and the interest level may be a coefficient B, the video playback speed C of the video frame to be played back may be a × B, where the higher the interest level is, the smaller the value of the coefficient B is, i.e., the smaller the video playback speed of the video frame to be played back is.
The method for acquiring the interest level information in this embodiment may be directly acquiring from the storage unit, or may directly insert the interest auxiliary frame before the video frame to be played back, and meanwhile, the interest level information may also be directly written in the field of the event type auxiliary frame.
In some embodiments, for each event type in the first preset event type, the interest levels include a first interest level and a second interest level in order of increasing interest level of the user in the video to be played back; and the video playback speed corresponding to the first interest level is lower than that corresponding to the second interest level.
In this embodiment, when the first preset event types corresponding to different video frames to be played back are the same, the video playback speed of the different video frames to be played back is determined by the interest level corresponding to the different video frames to be played back, that is, the higher the interest level of the video frame to be played back is, the smaller the video playback speed of the video frame to be played back is. By the mode, the video server can further slow down the playback speed of the video frames to be played back with high interest level, so that the user can better grasp the details of the video frames to be played back with high interest level.
In the present embodiment, the level of interest is determined based on the amount of information of interest to the user in the video frame to be played back.
For example, in a video of a face event type, the information that the user is interested in is a face, and the video server classifies the face level according to the number of faces detected in a video frame to be played back and/or the size of a face region, that is, when the number of faces is larger or the size of the face region is smaller, the face level that the user is interested in is higher. In some embodiments, the face level of the current video frame to be played back may be classified into 1 to 10 levels, with the level corresponding to level 1 being the highest level.
For another example, in a video of the motion detection event type, the information of interest to the user is a motion detection event, and the video server calculates an area ratio of a motion detection image corresponding to the motion detection region to the entire playing screen according to the motion detection region in the video frame to be played back, in some embodiments, the motion detection level of the current video frame to be played back may be classified into 1 to 10 levels, the motion detection image corresponding to the motion detection region with the level 1 being the highest level and the corresponding motion detection region occupying 100% of the area of the entire playing screen, and the motion detection image corresponding to the motion detection region with the level 10 being the lowest level and the corresponding motion detection region occupying the smallest area ratio of the entire playing screen.
In this embodiment, the video server classifies the motion detection event type corresponding to the video frame to be played back into a class according to the motion detection region, or classifies the class according to the face event type corresponding to the video frame to be played back, according to the size of the face in the playing picture or the size of the face region, thereby implementing fine-division control of the playback speed of the video frame to be played back corresponding to the motion detection event type or the face event type.
By adopting the video playback method, compared with the prior art, the method introduces the relation between the video frames to be played back and the event types, the video server quickly filters unimportant information or uninteresting parts of the user according to the first preset event type configured by the user, and simultaneously further adjusts the important video frames to be played back in the video or the interesting video frames to be played back of the user according to the interesting grades so as to improve the playback efficiency of the video.
Embodiments of the invention will be described and illustrated in the following preferred embodiments and drawings.
In one embodiment, as shown in table 1, the event type auxiliary frame may include:
(1) event type assistance data: an 8-byte 64-bit data representation is employed, with each bit representing an event type.
For example: the 0 bit represents the alarm type, the 1 bit represents the motion detection type, and the 2 bit represents the face detection.
(2) The remaining data bits represent supplemental information for each event type (i.e., the level of interest information in the above embodiment):
for example: the dynamic inspection event type corresponds to a dynamic inspection grade, and the face event type corresponds to a face grade.
Table 1 event type auxiliary frame field allocation table
In some of these embodiments, generating the event type assistance frame may be by:
(1) when a video channel generates an alarm event, a motion detection event, a human face event or other events during recording a video, the start and end of the event can be written into an event type auxiliary frame in the video, for example:
(a) when an event starts, the video server generates an event type auxiliary frame corresponding to the event, sets the flag bit corresponding to the event type to 1, for example, when an event occurs, sets the 1-bit data corresponding to the event type in table 1 to 1, then writes the event type auxiliary frame into the event type data, and the event type auxiliary frame is reserved.
(b) When the event is finished, setting the flag bit corresponding to the auxiliary frame of the event type as 0 according to the event type, and then writing the flag bit into the video event type data. And each time the event type auxiliary frame to be written in the video recording video can be modified on the data of the previous auxiliary frame so as to confirm the changed event type.
(2) While writing the event type, it is also possible to add supplemental information (i.e. level of interest information) to the auxiliary frame for different event types, for example:
(a) the supplementary information is the dynamic inspection grade: when a motion detection event occurs, as shown in fig. 2, the video server calculates the ratio of the area of the motion detection image corresponding to the motion detection region to the area of the whole playing picture, assuming that the motion detection level of the current video frame to be played back is classified into 1 to 10 levels, where 1 level is the highest level and the motion detection region occupies 100% of the whole picture, and 10 level is the lowest level and the motion detection region is the smallest. And finally, the video server calculates the dynamic inspection grade through an intelligent algorithm and writes the dynamic inspection grade into the corresponding data bit.
(b) The supplementary information is face grade: when the human face is detected, dividing the human face grade according to the number of the detected human face and the size of the human face area; the more the number of the faces or the smaller the face area, the higher the face level, and similarly, the face level of the current video frame to be played back is divided into 1 to 10 levels, wherein the level 1 is the highest level, the area ratio of the face area to the whole picture is the smallest, and/or the number of the faces is the largest; and level 10 is the lowest level and the face area accounts for 100% of the whole picture and/or the number of faces is the smallest. And finally, the video server calculates the face grade through an intelligent algorithm and writes the face grade into the corresponding data bit.
In one embodiment, a playback speed adjustment method is provided, the method comprising:
(1) when the event type of the video frame to be played back is judged to be the event type which is interested by the user, the playback speed of the video frame to be played back is determined by the event type and the interested level information.
(2) And directly playing back the event type without the interest of the user by using the playback speed configured by the user.
(3) The playback speed of the video frame to be played back corresponding to the dynamic detection event needs to be adjusted according to the actual dynamic detection level, and the higher the dynamic detection level is, the slower the playback speed is. For example, if the basic playback speed of the video frame to be played back corresponding to the motion detection event type is configured by the user to be x times, the motion detection levels 1 to 10 correspond to 1 time to x times of the playback speed respectively.
(4) And adjusting the playback speed of the video frame to be played back corresponding to the face event according to the face grade, wherein the playback speed is slower when the face grade is higher. For example, if the basic playback speed of the face detection video is configured to be y times by the user, the levels 1 to 10 of the face correspond to the playback speeds of 1 time to y times, respectively.
In one embodiment, fig. 3 is a flow chart of a video playback method according to a preferred embodiment of the present invention, as shown in fig. 3, the method comprising:
step S302: the video server starts playing back the video frame to be played back.
Step S304: and the video server analyzes the event type auxiliary frame corresponding to the video frame to be played back to obtain the event type.
Step S306: the video server determines whether the event type is in a first preset event type configured by the user, if so, step S308 is executed, and if not, step S322 is executed.
Step S308: the video server determines that the event type is a motion detection event type, or a face event type, or neither a motion detection event type nor a face event type, and if the event type is determined to be a motion detection event type, step S310 is performed, if the event type is determined to be a face event type, step S314 is performed, and if the event type is determined to be neither a motion detection event type nor a face event type, step S318 is performed.
Step S310: and the video server acquires the dynamic examination grade of the dynamic examination event type.
Step S312: and the video server determines the video playback speed of the video to be played back according to the playback speed and the dynamic detection level corresponding to the dynamic detection event type configured by the user.
Step S314: the video server obtains the face grade of the face event type.
Step S316: and the video server determines the video playback speed of the video frame to be played back according to the playback speed and the face grade corresponding to the face event type configured by the user.
Step S318: the video server directly finds the playback speed corresponding to the event type according to a strategy configured by the user in advance.
Step S320: and the video server sets the playback speed of the current video frame to be played back.
Step S322: the video server continues playback at the set playback speed until the next event type auxiliary frame is acquired.
In this embodiment, a video playback apparatus is further provided, and the apparatus is used to implement the foregoing embodiments and preferred embodiments, and the description already made is omitted. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 4 is a block diagram of a video playback apparatus according to an embodiment of the present invention, as shown in fig. 4, the apparatus including:
a first obtaining module 410, configured to obtain event type information of a video frame to be played back, where the event type information is used to indicate an event type of the video frame to be played back;
a first determining module 420, coupled to the first obtaining module 410, for determining a video playback speed of the video frame to be played back according to the event type information;
the first playback module 430 is coupled to the first determining module 420, and configured to play back the video frames to be played back according to the video playback double speed.
In some of these embodiments, the apparatus further comprises: the second acquisition module is used for acquiring the event type auxiliary frame, wherein the event type auxiliary frame carries event type information of the video frame to be played back; and the analysis module is used for analyzing the event type auxiliary frame to obtain the event type information of the video frame to be played back.
In some of these embodiments, the apparatus further comprises: and a third obtaining module, configured to obtain a video stream, where the video stream includes a first event type auxiliary frame and a video frame to be played back, the first event type auxiliary frame is inserted before the video frame to be played back, and the first event type auxiliary frame is further used to indicate a start position of the video frame to be played back.
In some of these embodiments, the video stream may further include: a second event type auxiliary frame, wherein the second event type auxiliary frame is inserted after the video frame to be played back, and the second event type auxiliary frame is also used for indicating the end position of the video frame to be played back.
In some embodiments, the apparatus further includes a first determining module, configured to determine whether an event type of the video frame to be played back is a first preset event type; and the second playback module is used for playing back the video frame to be played back according to the video playback double speed corresponding to the first preset event type under the condition that the event type of the video frame to be played back is judged to be the first preset event type.
In some of these embodiments, the apparatus further comprises: and the skipping module is used for skipping the playback of the video frame to be played back under the condition that the event type corresponding to the video frame to be played back is judged not to be the first preset event type.
In some of these embodiments, the first preset event type includes, but is not limited to, at least one of: common event type, alarm event type, motion detection event type and human face event type.
In some of these embodiments, the apparatus further comprises: the fourth acquisition module is used for acquiring the interest level information of the video frame to be played back, and the interest level information is used for indicating the interest level of the video to be played back of the user; the second determining module is used for determining the video playback speed according to the first preset event type and the interest level of the video frame to be played back; and the third playback module is used for playing back the video frame to be played back according to the video playback double speed.
In some embodiments, for each event type in the first preset event type, the interest levels include a first interest level and a second interest level in order of increasing interest level of the user in the video to be played back; and the video playback speed corresponding to the first interest level is lower than that corresponding to the second interest level.
In some of these embodiments, the level of interest is determined based on the amount of information of interest to the user in the frame of video to be played back.
In addition, the video playback method described in conjunction with fig. 5 according to the embodiment of the present invention can be implemented by a video playback device. Fig. 5 is a schematic diagram of a hardware configuration of a video playback device according to an embodiment of the present invention.
The video playback device may include a processor 51 and a memory 52 having stored computer program instructions.
Specifically, the processor 51 may include a Central Processing Unit (CPU), or an Application Specific Integrated Circuit (ASIC), or may be configured as one or more Integrated circuits implementing the embodiments of the present invention.
Memory 52 may include mass storage for data or instructions. By way of example, and not limitation, memory 52 may include a Hard Disk Drive (HDD), a floppy Disk Drive, flash memory, an optical Disk, a magneto-optical Disk, tape, or a Universal Serial Bus (USB) Drive or a combination of two or more of these. Memory 52 may include removable or non-removable (or fixed) media, where appropriate. The memory 52 may be internal or external to the data processing apparatus, where appropriate. In a particular embodiment, the memory 52 is a non-volatile solid-state memory. In particular embodiments, memory 52 includes Read Only Memory (ROM). Where appropriate, the ROM may be mask-programmed ROM, Programmable ROM (PROM), Erasable PROM (EPROM), Electrically Erasable PROM (EEPROM), electrically rewritable ROM (EAROM), or flash memory or a combination of two or more of these.
The processor 51 implements any of the video playback methods in the above embodiments by reading and executing computer program instructions stored in the memory 52.
In one example, the video playback device may also include a communication interface 53 and bus 50. As shown in fig. 5, the processor 51, the memory 52, and the communication interface 53 are connected via the bus 50 to complete mutual communication.
The communication interface 53 is mainly used for implementing communication between modules, apparatuses, units and/or devices in the embodiments of the present invention.
The bus 50 comprises hardware, software, or both that couple the components of the video playback device to one another, by way of example and not limitation, may comprise an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a low pin count (L PC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (V L B) bus, or other suitable bus or combinations of two or more of these.
The video playback device may execute the video playback method in the embodiment of the present invention based on the acquired event type information of the video frame to be played back, so as to implement the video playback method described in conjunction with fig. 1.
In addition, in combination with the video playback method in the above embodiments, the embodiments of the present invention may be implemented by providing a computer-readable storage medium. The computer readable storage medium having stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the video playback methods in the above embodiments.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present invention, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the inventive concept, which falls within the scope of the present invention. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (13)
1. A method of video playback, the method comprising:
acquiring event type information of a video frame to be played back, wherein the event type information is used for indicating the event type of the video frame to be played back;
determining the video playback speed of the video frame to be played back according to the event type;
and playing back the video frame to be played back according to the video playback speed.
2. The video playback method according to claim 1, wherein the obtaining event type information of the video frame to be played back comprises:
acquiring an event type auxiliary frame, wherein the event type auxiliary frame carries event type information of the video frame to be played back;
and analyzing the event type auxiliary frame to obtain the event type information of the video frame to be played back.
3. The video playback method according to claim 2, wherein before acquiring the event type information of the video frame to be played back, the method comprises:
acquiring a video stream, wherein the video stream includes a first event type auxiliary frame and the video frame to be played back, the first event type auxiliary frame is inserted before the video frame to be played back, and the first event type auxiliary frame is further used for indicating a start position of the video frame to be played back.
4. The video playback method according to claim 3, wherein the video stream further includes: a second event type auxiliary frame, wherein the second event type auxiliary frame is inserted after the video frame to be played back, and the second event type auxiliary frame is further used for indicating the end position of the video frame to be played back.
5. The video playback method according to claim 1, wherein the determining the video playback double speed of the video frame to be played back according to the event type comprises:
judging whether the event type of the video frame to be played back is a first preset event type;
and under the condition that the event type of the video frame to be played back is judged to be the first preset event type, playing back the video frame to be played back according to the video playback double speed corresponding to the first preset event type.
6. The video playback method of claim 5, wherein the method further comprises:
and skipping the playback of the video frame to be played back under the condition that the event type corresponding to the video frame to be played back is judged not to be the first preset event type.
7. The video playback method of claim 5, wherein the first preset event type comprises at least one of: common event type, alarm event type, motion detection event type and human face event type.
8. The video playback method according to claim 5, wherein the playing back the video frame to be played back according to the video playback double speed corresponding to the first preset event type comprises:
obtaining interest level information of the video frame to be played back, wherein the interest level information is used for indicating the interest level of a user on the video to be played back;
determining the video playback speed according to the first preset event type and the interest level of the video frame to be played back;
and playing back the video frame to be played back according to the video playback speed.
9. The video playback method according to claim 8, wherein the interest levels include a first interest level and a second interest level in order of increasing interest level of the user in the video to be played back, for each of the first preset event types; wherein the content of the first and second substances,
and the video playback speed corresponding to the first interest level is lower than that corresponding to the second interest level.
10. The video playback method according to claim 8, wherein the level of interest is determined based on an amount of information of user interest in the video frame to be played back.
11. A video playback apparatus, characterized in that the apparatus comprises:
the device comprises an acquisition module, a playback module and a display module, wherein the acquisition module is used for acquiring event type information of a video frame to be played back, and the event type information is used for indicating the event type of the video frame to be played back;
the determining module is used for determining the video playback speed of the video frame to be played back according to the event type information;
and the playback module is used for playing back the video frame to be played back according to the video playback speed.
12. A video playback device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the video playback method as claimed in any one of claims 1 to 10 when executing the computer program.
13. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out a video playback method according to any one of claims 1 to 10.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010180224.0A CN111491203B (en) | 2020-03-16 | 2020-03-16 | Video playback method, device, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010180224.0A CN111491203B (en) | 2020-03-16 | 2020-03-16 | Video playback method, device, equipment and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111491203A true CN111491203A (en) | 2020-08-04 |
| CN111491203B CN111491203B (en) | 2023-01-24 |
Family
ID=71812457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010180224.0A Active CN111491203B (en) | 2020-03-16 | 2020-03-16 | Video playback method, device, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111491203B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112235645A (en) * | 2020-10-10 | 2021-01-15 | 维沃移动通信有限公司 | Multimedia content playing method and device |
| CN112437270A (en) * | 2020-11-13 | 2021-03-02 | 珠海大横琴科技发展有限公司 | Monitoring video playing method and device and readable storage medium |
| CN112839256A (en) * | 2020-12-30 | 2021-05-25 | 珠海极海半导体有限公司 | Video playing method and device and electronic equipment |
| CN112929706A (en) * | 2021-03-05 | 2021-06-08 | 浙江大华技术股份有限公司 | Video data playback method, device, storage medium, and electronic device |
| CN114205631A (en) * | 2021-10-28 | 2022-03-18 | 浙江大华技术股份有限公司 | Video storage, catalog generation and migration methods, devices, equipment and medium |
| CN114245167A (en) * | 2021-11-08 | 2022-03-25 | 浙江大华技术股份有限公司 | Video storage method and device and computer readable storage medium |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100322594A1 (en) * | 2009-06-19 | 2010-12-23 | National Taiwan University | Video Playback System And Method |
| CN102598657A (en) * | 2009-10-27 | 2012-07-18 | 佳能株式会社 | Video playback device and control method for a video playback device |
| US20140178033A1 (en) * | 2012-12-25 | 2014-06-26 | Huawei Technologies Co., Ltd. | Video playback method, terminal, and system |
| CN105578258A (en) * | 2015-12-11 | 2016-05-11 | 浙江大华技术股份有限公司 | Method and device of video preprocessing and video playback |
| CN107105314A (en) * | 2017-05-12 | 2017-08-29 | 北京小米移动软件有限公司 | Video broadcasting method and device |
| US20180070132A1 (en) * | 2013-06-17 | 2018-03-08 | Echostar Technologies L.L.C. | Event-based media playback |
| CN110121098A (en) * | 2018-02-05 | 2019-08-13 | 腾讯科技（深圳）有限公司 | Video broadcasting method, device, storage medium and electronic device |
| WO2019156380A1 (en) * | 2018-02-09 | 2019-08-15 | 삼성전자주식회사 | Display device and control method thereof |
-
2020
- 2020-03-16 CN CN202010180224.0A patent/CN111491203B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100322594A1 (en) * | 2009-06-19 | 2010-12-23 | National Taiwan University | Video Playback System And Method |
| CN102598657A (en) * | 2009-10-27 | 2012-07-18 | 佳能株式会社 | Video playback device and control method for a video playback device |
| US20140178033A1 (en) * | 2012-12-25 | 2014-06-26 | Huawei Technologies Co., Ltd. | Video playback method, terminal, and system |
| US20180070132A1 (en) * | 2013-06-17 | 2018-03-08 | Echostar Technologies L.L.C. | Event-based media playback |
| CN105578258A (en) * | 2015-12-11 | 2016-05-11 | 浙江大华技术股份有限公司 | Method and device of video preprocessing and video playback |
| CN107105314A (en) * | 2017-05-12 | 2017-08-29 | 北京小米移动软件有限公司 | Video broadcasting method and device |
| CN110121098A (en) * | 2018-02-05 | 2019-08-13 | 腾讯科技（深圳）有限公司 | Video broadcasting method, device, storage medium and electronic device |
| WO2019156380A1 (en) * | 2018-02-09 | 2019-08-15 | 삼성전자주식회사 | Display device and control method thereof |
Non-Patent Citations (1)
| Title |
|---|
| 刘宇帅等: "基于相似性判断的广告片段检索", 《软件》 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112235645A (en) * | 2020-10-10 | 2021-01-15 | 维沃移动通信有限公司 | Multimedia content playing method and device |
| CN112437270A (en) * | 2020-11-13 | 2021-03-02 | 珠海大横琴科技发展有限公司 | Monitoring video playing method and device and readable storage medium |
| CN112437270B (en) * | 2020-11-13 | 2021-09-28 | 珠海大横琴科技发展有限公司 | Monitoring video playing method and device and readable storage medium |
| CN112839256A (en) * | 2020-12-30 | 2021-05-25 | 珠海极海半导体有限公司 | Video playing method and device and electronic equipment |
| CN112929706A (en) * | 2021-03-05 | 2021-06-08 | 浙江大华技术股份有限公司 | Video data playback method, device, storage medium, and electronic device |
| CN114205631A (en) * | 2021-10-28 | 2022-03-18 | 浙江大华技术股份有限公司 | Video storage, catalog generation and migration methods, devices, equipment and medium |
| CN114245167A (en) * | 2021-11-08 | 2022-03-25 | 浙江大华技术股份有限公司 | Video storage method and device and computer readable storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111491203B (en) | 2023-01-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111491203B (en) | Video playback method, device, equipment and computer readable storage medium | |
| US10062412B2 (en) | Hierarchical segmentation and quality measurement for video editing | |
| US8559683B2 (en) | Electronic apparatus and scene-type display method | |
| US8594429B2 (en) | Method and apparatus for processing a video stream | |
| US8503832B2 (en) | Electronic device and facial image display apparatus | |
| KR101318459B1 (en) | Method of viewing audiovisual documents on a receiver, and receiver for viewing such documents | |
| US9685199B2 (en) | Editing apparatus and editing method | |
| US20070266322A1 (en) | Video browsing user interface | |
| US20130014149A1 (en) | Electronic Apparatus and Display Process | |
| US9240216B2 (en) | Display device for having a function of searching a divided screen, and the method for controlling the same | |
| JP4987943B2 (en) | Electronic apparatus and image display method | |
| US20100275164A1 (en) | Authoring apparatus | |
| US8897603B2 (en) | Image processing apparatus that selects a plurality of video frames and creates an image based on a plurality of images extracted and selected from the frames | |
| US20080055314A1 (en) | Pillarboxing correction | |
| US8988457B2 (en) | Multi image-output display mode apparatus and method | |
| US7929028B2 (en) | Method and system for facilitating creation of content | |
| US11211097B2 (en) | Generating method and playing method of multimedia file, multimedia file generation apparatus and multimedia file playback apparatus | |
| KR101440168B1 (en) | Method for creating a new summary of an audiovisual document that already includes a summary and reports and a receiver that can implement said method | |
| WO2022087826A1 (en) | Video processing method and apparatus, mobile device, and readable storage medium | |
| JP2000350156A (en) | Method for storing moving picture information and recording medium recording the information | |
| US20110064319A1 (en) | Electronic apparatus, image display method, and content reproduction program | |
| US20110110564A1 (en) | Electronic apparatus and image display | |
| US20020168181A1 (en) | Method and device for digital video capture | |
| CN102474585B (en) | Image processing apparatus and image processing method | |
| EP3547698A1 (en) | Method and device for determining inter-cut time bucket in audio/video |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |