CN109194965B - Processing method, processing device, display method and display device - Google Patents
Processing method, processing device, display method and display device Download PDFInfo
- Publication number
- CN109194965B CN109194965B CN201811398094.7A CN201811398094A CN109194965B CN 109194965 B CN109194965 B CN 109194965B CN 201811398094 A CN201811398094 A CN 201811398094A CN 109194965 B CN109194965 B CN 109194965B
- Authority
- CN
- China
- Prior art keywords
- key frame
- frame
- initial
- video file
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The application discloses a processing method, a processing device, a display method and a display device, aiming at the problem that the storage space required by the compression of a monitoring video by adopting the current national standard AVS or the international standard AVC/H.264 is still very high at the present stage, the original video file is recompressed by independently processing the key frames in the monitoring video file, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and the method has considerable economic benefit.
Description
Technical Field
The present application relates to the field of monitoring technologies, and in particular, to a processing method, a processing apparatus, a display method, and a display apparatus.
Background
Along with the progress of science and technology, the resolution ratio of camera constantly promotes, leads to the memory space of the image of storage camera collection bigger and bigger.
Disclosure of Invention
In order to solve the above problems, the present application provides the following technical solutions:
a method of processing, comprising:
obtaining an initial video file comprising a sequence of images including an initial image and a difference image comprising difference data at least with the initial image;
performing key frame detection on the image sequence, and generating an identification video frame for identifying a key frame under the condition that the key frame exists in the image sequence, wherein the key frame comprises at least one frame image in the initial image and the difference image;
replacing the key frame in the initial video file with the identification video frame to obtain a first video file;
processing the key frames to obtain a second video file, wherein the second video file comprises initial key frames and difference key frames, the difference key frames comprise difference data at least with the initial key frames, and the identification video frames in the first video file have an association relationship with the initial key frames/the difference key frames corresponding to the identified key frames.
Preferably, the performing key frame detection on the image sequence includes:
and performing key frame detection on the image sequence in the specified divided area.
Preferably, the performing key frame detection on the image sequence includes:
and performing key frame detection on the image sequence with the specified coding format.
Preferably, the performing key frame detection on the image sequence includes:
and performing key frame detection on the image sequence according to a preset detection period.
Preferably, the processing the key frame to obtain a second video file includes:
and processing the key frame at least based on the image sequence where the key frame is located to obtain a second video file.
Preferably, the processing the key frame based on at least the image sequence where the key frame is located to obtain a second video file includes:
obtaining the compression rate of the image sequence where the key frame is located;
and determining a target coding format at least based on the compression rate of the image sequence, and coding the key frame according to the target coding format to obtain a second video file.
Preferably, the method further comprises:
and generating a key frame record table, wherein the incidence relation is recorded in the key frame record table.
A processing apparatus, comprising:
a first obtaining module, configured to obtain an initial video file, where the initial video file includes an image sequence, where the image sequence includes an initial image and a difference image, and the difference image includes difference data at least with the initial image;
a detection module, configured to perform key frame detection on the image sequence, and generate an identification video frame for identifying a key frame when the key frame exists in the image sequence, where the key frame includes at least one frame image of the initial image and the difference image;
the replacing module is used for replacing the key frame in the initial video file with the identification video frame to obtain a first video file;
a first processing module, configured to process the key frames to obtain a second video file, where the second video file includes an initial key frame and a difference key frame, the difference key frame includes difference data at least with the initial key frame, and the identified video frame in the first video file has an association relationship with the initial key frame/the difference key frame corresponding to the identified key frame.
A display method, comprising:
obtaining an operation to determine a target video file to be displayed, where the target video file is a first video file obtained by replacing a key frame in an initial video file with an identification video frame, where the initial video file includes an image sequence, the image sequence includes an initial image and a difference image, the difference image includes difference data at least with the initial image, the identification video frame is generated under a condition that key frame detection is performed on the image sequence and the key frame exists in the image sequence, the identification video frame is used for identifying the key frame, and the key frame includes at least one of the initial image and the difference image;
under the condition that the identification video frame in the target video file is read, determining an initial key frame/difference key frame associated with the identification video frame in a second video file based on an association relation, wherein the second video file is obtained by processing the key frame, the second video file comprises the initial key frame and the difference key frame, the difference key frame comprises difference data at least with the initial key frame, and the association relation is used for associating the identification video frame in the target video file with the initial key frame/difference key frame corresponding to the identified key frame;
and processing the initial key frame/the difference key frame to obtain the key frame and outputting the key frame.
A display device, comprising:
a second obtaining module, configured to obtain a target video file to be displayed, where the target video file is a first video file obtained by replacing a key frame in an initial video file with an identification video frame, where the initial video file includes an image sequence, the image sequence includes an initial image and a difference image, the difference image includes difference data at least between the initial image and the difference image, the identification video frame is generated when key frame detection is performed on the image sequence and the key frame exists in the image sequence, the identification video frame is used to identify the key frame, and the key frame includes at least one of the initial image and the difference image;
a determining module, configured to determine, in a second video file based on an association relationship when the identified video frame in the target video file is read, an initial key frame/difference key frame associated with the identified video frame in the second video file, where the second video file is obtained by processing the key frame, the second video file includes the initial key frame and the difference key frame, the difference key frame includes difference data at least with the initial key frame, and the association relationship is used to associate the identified video frame in the target video file with the initial key frame/difference key frame corresponding to the identified key frame;
and the second processing module is used for processing the initial key frame/the difference key frame to obtain the key frame and outputting the key frame.
Through the technical means, the following beneficial effects can be realized:
according to the technical scheme, the processing method provided by the embodiment of the application aims at the problem that the storage space required by the compressed monitoring video is still high after the current national standard AVS or international standard AVC/H.264 is adopted at the present stage, the original video file is recompressed by independently processing the key frames in the compressed monitoring video, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and the processing method has considerable economic benefits.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only embodiments of the present application, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a schematic flow chart of a processing method disclosed in an embodiment of the present application;
FIG. 2 is an example of an initial video file;
FIG. 3 is an example of a second video file;
FIG. 4 is a schematic flow chart of a processing method disclosed in the second embodiment of the present application;
fig. 5 is a schematic flow chart of a processing method disclosed in the third embodiment of the present application;
fig. 6 is a schematic flow chart of a processing method disclosed in the fourth embodiment of the present application;
fig. 7 is a schematic flow chart of a processing method disclosed in the fifth embodiment of the present application;
FIG. 8 is a schematic diagram of a processing apparatus according to the present disclosure;
FIG. 9 is a schematic flow chart of a display method disclosed herein;
fig. 10 is a schematic flowchart of a display device disclosed in the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
In a first embodiment of the processing method disclosed in the present application, as shown in fig. 1, the method includes the following steps:
step 101: an initial video file is obtained, the initial video file comprising a sequence of images, the sequence of images comprising an initial image and a difference image, the difference image comprising at least difference data from the initial image.
First, the method disclosed in this embodiment may be applied to a server of a monitoring video storage system, specifically, a service device disposed on a network side, which may be implemented by a single server or a server group consisting of multiple servers, and this embodiment is not limited thereto. The method disclosed by the embodiment does not need to upgrade a hardware system and a tool of the server, and replaces a large amount of storage space with extremely low calculation cost.
Next, the initial video file is a compressed surveillance video file, and is generally compressed by using H264 coding, and the following description will take H264 coding as an example. The following introduces H264 coding:
the H264 coding mainly considers the temporal correlation of video, and its basic principle is: for example, the first frame of the surveillance video file is used as the starting frame, the subsequent frame refers to the previous frame, and only the difference (the moving place) is recorded, so that the effect of video compression is achieved.
In order to reduce the influence of frame loss (such as network packet loss, data damage and the like) and prediction errors on the whole monitoring video, the concept of GOP (group of pittimes) is introduced into video coding. A GOP represents a sequence of decodable pictures, typically consisting of 1I frame, several P frames, and B frames. In this embodiment, one image sequence included in the initial video file is a GOP, the initial image included in the corresponding image sequence is an I frame, and the included difference image is at least a P frame. The following briefly introduces I-frames, P-frames, and B-frames:
i frame: key frames, independent of other frames, with a compression rate of typically 1/7;
p frame: the compression rate of the unidirectional prediction frame can reach 1/20-1/30 depending on the previous I frame or P frame;
b frame: the compression rate of bidirectional prediction frames can reach 1/150-1/200 depending on previous and subsequent I frames or P frames.
Finally, for the setting of the image sequence in the initial video file, a GOP configuration may be adopted, taking M (P frame interval) 3 and N (I frame interval) 13 as examples, and an example of the initial video file is shown in fig. 2, where I, B, P denotes an I frame, a B frame, and a P frame, respectively.
Step 102: and performing key frame detection on the image sequence, and generating an identification video frame for identifying the key frame under the condition that the key frame exists in the image sequence, wherein the key frame comprises at least one frame image in the initial image and the difference image.
First, a key frame may be previously designated by a user, including at least one of an initial image and a difference image, that is, a video frame belonging to at least one of an I frame, a P frame, and a B frame may be designated as a key frame. Of course, based on the above description of the GOP, it can be determined that the compression rate of the I frame is low and the compression space with respect to the B frame and the P frame is large. Thus, the key frames include at least the original image, i.e., the video frames belonging to the I-frame.
Next, key frame detection is introduced as follows:
an initial video file obtained by H264 coding is transmitted in a network in a NALU format, and for a certain video frame in the initial video file, the TYPE, I frame or P frame or B frame, to which the video frame belongs, can be determined by detecting the NAL TYPE with 5 bits lower than the byte where the NAL head is located.
Taking a key frame as a video frame belonging to an I frame as an example, for a GOP1 in the initial video file shown in fig. 2, if it is detected that a video frame 1 in a GOP1 is an I frame, it may be determined that the video frame 1 is a key frame, so as to generate an identification video frame for identifying the video frame 1, and specifically, the identification video frame carries an identification of the video frame 1. The identifier may be a position of the video frame 1, or may also be a serial number of the video frame 1, and the like, which is not limited in this embodiment, and the video frame 1 may be uniquely identified.
Step 103: and replacing the key frame in the initial video file with the identification video frame to obtain a first video file.
Continuing with the example of the key frame being the video frame belonging to the I frame, for the GOP1 in the initial video file shown in fig. 2, first, the video frame 1 is extracted from the initial video file, and then the identification video frame corresponding to the video frame 1 is disposed at the position of the video frame 1. Since the identification video frame only carries the identification of the video frame 1, the occupied storage space is much smaller than that of the video frame 1. At this time, the storage space occupied by the first video file is much smaller than that occupied by the initial video file.
In addition, no processing may be done for other video frames in the initial video file that do not belong to an I-frame.
Step 104: and processing the key frames to obtain a second video file, wherein the second video file comprises initial key frames and difference key frames, the difference key frames comprise difference data at least between the initial key frames, and the identification video frames in the first video file have an association relationship with the initial key frames/difference key frames corresponding to the identified key frames.
Continuing with the example of the key frame being a video frame belonging to an I frame, assume that there are 10 GOPs in the initial video file shown in fig. 2, namely GOP1, GOP2, … …, and GOP 10. One video frame 1, one video frame 2, one video frame … …, and one video frame 10 may be respectively extracted from the GOP1, the GOP2, the GOP … …, and the GOP10, respectively, via step 103. At this time, a key frame file composed of video frame 1, video frames 2 and … …, and video frame 10 can be obtained, and the key frame file can be compressed by adopting a specified encoding format to obtain a second video file.
The specified encoding format may be any one of H264 encoding, H265 encoding, and MPEG, and the description will continue with the H264 encoding as an example:
assuming that the GOP configuration of the second video file is M (P frame interval) 1 and N (I frame interval) 5, an example of the second video file is shown in fig. 3, where I, B, P denotes an I frame, a B frame, and a P frame, respectively. It can be seen that the video frame belonging to the I frame in the second video file is an initial key frame, the video frame belonging to the B frame or the P frame is a difference key frame, and the difference data included in the difference key frame can refer to the description of the B frame and the P frame, which is not described herein again.
In addition, in order to visualize the association relationship, a key frame record table may be further generated, in which the association relationship is recorded.
To show the application effect of the present application, taking a GOP configuration M (P frame interval) commonly used in current surveillance video as 3 and an I frame interval N (I frame interval) as 60 as an example, assuming that the data amount per frame is f (mb), the frame rate of the camera is 20FPS, and 1 month of data IB B P B … is stored.
Using the size of the initial video file before this application:
S1＝F*(1/7+14*1/30+45*1/200)*(20*3600*24*30)/30(MB)
reduced size after use of the present application:
S2＝F(1/7)*(20*3600*24*30)/30-F*(20*3600*24*30/30)/200(MB)
the proportion of space saved after using the application can be calculated:
S2/S1＝(1/7-1/200)/(1/7+14*1/30+45*1/200)＝16.52％。
the following table 1 is an effective effect table corresponding to a common GOP configuration after the application is used:
| GOP List | Save the storage space% |
| M＝3,N＝30 | 28.354554 |
| M＝2,N＝30 | 25.394737 |
| M＝3,N＝60 | 16.519258 |
| M＝2,N＝30 | 14.121951 |
| M＝3,N＝90 | 11.654589 |
| M＝4,N＝90 | 13.610719 |
| M＝3,N＝120 | 8.8396947 |
| M＝4,N＝120 | 9.9211789 |
TABLE 1
Therefore, the key frames in the initial video file are independently processed to recompress the initial video file, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and considerable economic benefits are achieved.
As an implementation manner of performing key frame detection on an image sequence, the second embodiment of the present application discloses a processing method, as shown in fig. 4, the method includes the following steps:
an initial video file is obtained, the initial video file comprises an image sequence, the image sequence comprises an initial image and a difference image, and the difference image comprises at least difference data with the initial image.
Step 202: and performing key frame detection on the image sequence located in the specified divided area, and generating an identification video frame for identifying the key frame under the condition that the key frame exists in the image sequence, wherein the key frame comprises at least one frame image of the initial image and the difference image.
In this embodiment, in combination with different compression-coded scenes, the importance degree of the region may be combined, for example, the importance degree of the non-attention region is lower than that of the attention region, so that the non-attention region may be specified, and then the non-attention region may be compressed. Of course, an area with a lower compression rate in the initial video file may also be specified, which is not limited in this embodiment and may be set according to actual needs.
Therefore, it is possible to previously divide and specify an area that needs to be recompressed, perform key frame detection only for the specified divided area, and perform the subsequent steps. Further, different encoding formats may also be specified for different divided regions.
Step 203: and replacing the key frame in the initial video file with the identification video frame to obtain a first video file.
Step 204: and processing the key frames to obtain a second video file, wherein the second video file comprises initial key frames and difference key frames, the difference key frames comprise difference data at least between the initial key frames, and the identification video frames in the first video file have an association relationship with the initial key frames/difference key frames corresponding to the identified key frames.
Therefore, the key frames of the designated division areas in the initial video file are independently processed to recompress the initial video file, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and considerable economic benefits are achieved.
As an implementation manner of performing key frame detection on an image sequence, a third embodiment of the present application discloses a processing method, as shown in fig. 5, the method includes the following steps:
an initial video file is obtained, the initial video file comprising a sequence of images, the sequence of images comprising an initial image and a difference image, the difference image comprising at least difference data from the initial image.
Step 302: and performing key frame detection on the image sequence in the specified coding format, and generating an identification video frame for identifying the key frame under the condition that the key frame exists in the image sequence, wherein the key frame comprises at least one frame image in the initial image and the difference image.
In this embodiment, in combination with scenes of different compression codes, the coding format of the image sequence in the initial video file may be combined, for example, the compression effect of the H261 coding is far worse than that of the H264 coding and the H265 coding, so that the image sequence encoded by the H261 may be further compressed, and the image sequence compressed by the H264 or the H265 may not be compressed.
Therefore, it is possible to specify an encoding format that needs to be recompressed in advance, perform key frame detection only for an image sequence of the specified encoding format, and perform the subsequent steps.
Step 303: and replacing the key frame in the initial video file with the identification video frame to obtain a first video file.
Step 304: and processing the key frames to obtain a second video file, wherein the second video file comprises initial key frames and difference key frames, the difference key frames comprise difference data at least between the initial key frames, and the identification video frames in the first video file have an association relationship with the initial key frames/difference key frames corresponding to the identified key frames.
Therefore, the key frames in the specified encoding format in the initial video file are independently processed to recompress the initial video file, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and considerable economic benefit is achieved.
As an implementation manner of performing key frame detection on an image sequence, a fourth embodiment of the present application discloses a processing method, as shown in fig. 6, the method includes the following steps:
step 401, obtaining an initial video file, wherein the initial video file comprises an image sequence, the image sequence comprises an initial image and a difference image, and the difference image comprises at least difference data with the initial image.
Step 402: and performing key frame detection on the image sequence according to a preset detection period, and generating an identification video frame for identifying the key frame under the condition that the key frame exists in the image sequence, wherein the key frame comprises at least one frame image in the initial image and the difference image.
Since the monitoring scene is usually fixed, in general, cameras are divided into two categories: one is a fixed camera, which takes a picture of a certain position fixedly; the other type is a non-fixed camera, such as a pan-tilt camera, which can rotatably monitor a certain area.
For a fixed camera, since the shooting position is fixed, the scene similarity between images in the same GOP (picture sequence) in the initial video file is high, and therefore, the key frame detection can be performed in real time.
On the contrary, for a non-fixed camera, since the shooting position is not fixed, the scene similarity between images in the same GOP (picture sequence) in the initial video file is low. Taking a frame rate of 10FPS and a rotation period of 3S, GOP, where M (P frame interval) is 2 and N (I frame interval) is 10 as an example, one rotation period corresponds to 3 GOPs. Therefore, the video frames are shot once every 3 seconds for a certain shooting position, so if a certain video frame is detected to be a key frame, the key frame detection can be carried out on the video frames separated by one rotation period every 3S, and the detected key frame is the video frame of the same shooting position, so that the basis is provided for removing redundancy in a wide area period (rotation period, hourly and daily).
Step 403: and replacing the key frame in the initial video file with the identification video frame to obtain a first video file.
Step 404: and processing the key frames to obtain a second video file, wherein the second video file comprises initial key frames and difference key frames, the difference key frames comprise difference data at least between the initial key frames, and the identification video frames in the first video file have an association relationship with the initial key frames/difference key frames corresponding to the identified key frames.
Therefore, the key frames in the initial video file are independently processed according to the preset detection period to recompress the initial video file, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and considerable economic benefits are achieved.
As an implementation manner of processing the key frame to obtain the second video file, a fifth embodiment of the present application discloses a processing method, as shown in fig. 7, the method includes the following steps:
step 501: an initial video file is obtained, the initial video file comprising a sequence of images, the sequence of images comprising an initial image and a difference image, the difference image comprising at least difference data from the initial image.
Step 502: and performing key frame detection on the image sequence, and generating an identification video frame for identifying the key frame under the condition that the key frame exists in the image sequence, wherein the key frame comprises at least one frame image in the initial image and the difference image.
Step 503: and replacing the key frame in the initial video file with the identification video frame to obtain a first video file.
Step 504: and processing the key frames at least based on the image sequence where the key frames are located to obtain a second video file, wherein the second video file comprises initial key frames and difference key frames, the difference key frames comprise difference data at least between the initial key frames, and the identification video frames in the first video file have an association relation with the initial key frames/the difference key frames corresponding to the identified key frames.
In this embodiment, different encoding formats may be specified for different image sequences to adapt to different monitoring scenes, and specifically, the correspondence between the image sequences and the encoding formats may be preset, and the encoding formats corresponding to the image sequences may also be determined based on attributes of the image sequences, such as length, and compression ratio.
Taking the example of determining the encoding format of an image sequence by the compression rate, the following will be explained:
firstly, obtaining the compression rate of an image sequence where a key frame is located; and then determining a target encoding format at least based on the compression rate of the image sequence, specifically, determining by combining preset corresponding relations between different compression rates and encoding formats, and then encoding the key frame according to the target encoding format to obtain a second video file.
Therefore, the key frames in the initial video file are independently processed to recompress the initial video file, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and considerable economic benefits are achieved.
Corresponding to the above processing method, the present application also discloses a processing apparatus, as shown in fig. 8, the processing apparatus includes:
a first obtaining module 100 is configured to obtain an initial video file, where the initial video file includes a sequence of images, the sequence of images includes an initial image and a difference image, and the difference image includes at least difference data from the initial image.
The detecting module 200 is configured to perform key frame detection on the image sequence, and generate an identification video frame for identifying the key frame when the key frame exists in the image sequence, where the key frame includes at least one frame image of the initial image and the difference image.
And a replacing module 300, configured to replace the key frame in the initial video file with the identified video frame to obtain a first video file.
The first processing module 400 is configured to process the key frames to obtain a second video file, where the second video file includes an initial key frame and a difference key frame, the difference key frame includes difference data at least between the initial key frame and the difference key frame, and the identified video frame in the first video file has an association relationship with the initial key frame/difference key frame corresponding to the identified key frame.
Therefore, the key frames in the initial video file are independently processed to recompress the initial video file, so that the storage volume of the monitoring video is reduced, a large amount of storage space is replaced by extremely low calculation cost, and considerable economic benefits are achieved.
In another embodiment of the processing apparatus disclosed in the present application, the detecting module 20 performs key frame detection on the image sequence, including:
and performing key frame detection on the image sequence in the specified divided area.
In another embodiment of the processing apparatus disclosed in the present application, the detecting module 20 performs key frame detection on the image sequence, including:
and performing key frame detection on the image sequence with the specified coding format.
In another embodiment of the processing apparatus disclosed in the present application, the detecting module 20 performs key frame detection on the image sequence, including:
and performing key frame detection on the image sequence according to a preset detection period.
In another embodiment of the processing apparatus disclosed in the present application, the first processing module 40 processes the key frames to obtain a second video file, including:
and processing the key frame at least based on the image sequence where the key frame is located to obtain a second video file.
In another embodiment of the processing apparatus disclosed in the present application, the first processing module 40 processes the key frame based on at least the image sequence where the key frame is located to obtain the second video file, including:
obtaining the compression rate of the image sequence where the key frame is located;
and determining a target coding format at least based on the compression rate of the image sequence, and coding the key frame according to the target coding format to obtain a second video file.
In another embodiment of the processing apparatus disclosed in the present application, the first processing module 40 is further configured to:
and generating a key frame record table, wherein the key frame record table records the association relation.
Corresponding to the above processing method, the present application also discloses a display method, as shown in fig. 9, the method includes the following steps:
step 601: the method comprises the steps of obtaining operation to determine a target video file to be displayed, wherein the target video file is a first video file obtained by replacing a key frame in an initial video file with an identification video frame, the initial video file comprises an image sequence, the image sequence comprises an initial image and a difference image, the difference image comprises difference data at least between the initial image and the difference image, the identification video frame is generated under the condition that key frame detection is carried out on the image sequence and the key frame exists in the image sequence, the identification video frame is used for identifying the key frame, and the key frame comprises at least one of the initial image and the difference image.
In this embodiment, the target video file to be displayed may be determined by responding to a touch screen operation or a key operation input by a user. Of course, the target video file can also be searched and determined by obtaining the storage path of the target video file. It is understood that other ways of determining the target video file are within the scope of the present application.
In addition, in this embodiment, the process of obtaining the first video file, the second video file, and the association relationship may refer to the disclosure of any one of the first to fifth embodiments, which is not described in detail in this embodiment.
Step 602: under the condition that the identification video frame in the target video file is read, determining an initial key frame/difference key frame associated with the identification video frame in a second video file based on an association relation, wherein the second video file is obtained by processing the key frame, the second video file comprises the initial key frame and the difference key frame, the difference key frame comprises difference data at least between the difference data and the initial key frame, and the association relation is used for associating the identification video frame in the target video file with the initial key frame/difference key frame corresponding to the identified key frame.
Step S603: and processing the initial key frame/difference key frame to obtain a key frame and outputting the key frame.
In this embodiment, the key frame is obtained by decoding the initial key frame/difference key frame, where the decoding format corresponds to the encoding format of the initial key frame/difference key frame.
Therefore, the high-quality monitoring video can be output on the premise of reducing the storage volume of the monitoring video.
Corresponding to the above display method, the present application also discloses a display device, as shown in fig. 10, including:
a second obtaining module 500, configured to obtain a target video file to be displayed, where the target video file is a first video file obtained by replacing a key frame in an initial video file with an identification video frame, the initial video file includes an image sequence, the image sequence includes an initial image and a difference image, the difference image includes difference data at least between the initial image and the difference image, the identification video frame is generated when key frame detection is performed on the image sequence and a key frame exists in the image sequence, the identification video frame is used for identifying the key frame, and the key frame includes at least one of the initial image and the difference image.
The determining module 600 is configured to, when an identified video frame in a target video file is read, determine an initial key frame/a difference key frame associated with the identified video frame in a second video file based on an association relationship, where the second video file is obtained by processing the key frame, the second video file includes the initial key frame and the difference key frame, the difference key frame includes difference data at least between the initial key frame and the difference key frame, and the association relationship is obtained by associating the identified video frame in the target video file with the initial key frame/the difference key frame corresponding to the identified key frame.
The second processing module 700 is configured to process the initial key frame/difference key frame to obtain a key frame, and output the key frame.
Therefore, the high-quality monitoring video can be output on the premise of reducing the storage volume of the monitoring video.
The embodiments in the present specification are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (9)
1. A method of processing, comprising:
obtaining an initial video file comprising a sequence of images including an initial image and a difference image comprising difference data at least with the initial image;
performing key frame detection on the image sequence, and generating an identification video frame for identifying a key frame under the condition that the key frame exists in the image sequence, wherein the key frame comprises at least one frame image in the initial image and the difference image;
replacing the key frame in the initial video file with the identification video frame to obtain a first video file;
and compressing the key frames by adopting a specified coding format at least based on the configuration information of the image sequence where the key frames are located to obtain a second video file, wherein the second video file comprises initial key frames and difference key frames, the difference key frames comprise difference data at least between the initial key frames, and the identification video frames in the first video file have an association relationship with the initial key frames/the difference key frames corresponding to the identified key frames.
2. The method of claim 1, wherein the keyframe detecting the sequence of images comprises:
and performing key frame detection on the image sequence in the specified divided area.
3. The method of claim 1, wherein the keyframe detecting the sequence of images comprises:
and performing key frame detection on the image sequence with the specified coding format.
4. The method of claim 1, wherein the keyframe detecting the sequence of images comprises:
and performing key frame detection on the image sequence according to a preset detection period.
5. The method according to claim 1, wherein the compressing the key frame in a specified encoding format based on at least configuration information of the image sequence in which the key frame is located to obtain a second video file comprises:
obtaining the compression rate of the image sequence where the key frame is located;
and determining a target coding format at least based on the compression rate of the image sequence, and coding the key frame according to the target coding format to obtain a second video file.
6. The method of claim 1, further comprising:
and generating a key frame record table, wherein the incidence relation is recorded in the key frame record table.
7. A processing apparatus, comprising:
a first obtaining module, configured to obtain an initial video file, where the initial video file includes an image sequence, where the image sequence includes an initial image and a difference image, and the difference image includes difference data at least with the initial image;
a detection module, configured to perform key frame detection on the image sequence, and generate an identification video frame for identifying a key frame when the key frame exists in the image sequence, where the key frame includes at least one frame image of the initial image and the difference image;
the replacing module is used for replacing the key frame in the initial video file with the identification video frame to obtain a first video file;
a first processing module, configured to perform compression processing on the key frames by using a specified encoding format based on at least configuration information of the image sequence where the key frames are located, to obtain a second video file, where the second video file includes an initial key frame and a difference key frame, the difference key frame includes difference data at least with the initial key frame, and the identified video frame in the first video file has an association relationship with the initial key frame/the difference key frame corresponding to the identified key frame.
8. A display method, comprising:
obtaining an operation to determine a target video file to be displayed, where the target video file is a first video file obtained by replacing a key frame in an initial video file with an identification video frame, where the initial video file includes an image sequence, the image sequence includes an initial image and a difference image, the difference image includes difference data at least with the initial image, the identification video frame is generated under a condition that key frame detection is performed on the image sequence and the key frame exists in the image sequence, the identification video frame is used for identifying the key frame, and the key frame includes at least one of the initial image and the difference image;
under the condition that the identification video frame in the target video file is read, determining an initial key frame/difference key frame associated with the identification video frame in a second video file based on an association relation, wherein the second video file is obtained by compressing the key frame in a specified coding format at least based on configuration information of the image sequence where the key frame is located, the second video file comprises the initial key frame and the difference key frame, the difference key frame comprises difference data at least between the difference key frame and the initial key frame, and the association relation is used for associating the identification video frame in the target video file with the initial key frame/difference key frame corresponding to the identified key frame;
and processing the initial key frame/the difference key frame to obtain the key frame and outputting the key frame.
9. A display device, comprising:
a second obtaining module, configured to obtain a target video file to be displayed, where the target video file is a first video file obtained by replacing a key frame in an initial video file with an identification video frame, where the initial video file includes an image sequence, the image sequence includes an initial image and a difference image, the difference image includes difference data at least between the initial image and the difference image, the identification video frame is generated when key frame detection is performed on the image sequence and the key frame exists in the image sequence, the identification video frame is used to identify the key frame, and the key frame includes at least one of the initial image and the difference image;
a determining module, configured to determine, in a second video file based on an association relationship when the identified video frame in the target video file is read, an initial key frame/difference key frame associated with the identified video frame in the second video file, where the second video file is obtained by compressing the key frame in a specified encoding format based on at least configuration information of the image sequence in which the key frame is located, the second video file includes the initial key frame and the difference key frame, the difference key frame includes difference data at least between the initial key frame and the difference key frame, and the association relationship is used for associating the identified video frame in the target video file with the initial key frame/difference key frame corresponding to the identified key frame;
and the second processing module is used for processing the initial key frame/the difference key frame to obtain the key frame and outputting the key frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811398094.7A CN109194965B (en) | 2018-11-22 | 2018-11-22 | Processing method, processing device, display method and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811398094.7A CN109194965B (en) | 2018-11-22 | 2018-11-22 | Processing method, processing device, display method and display device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109194965A CN109194965A (en) | 2019-01-11 |
| CN109194965B true CN109194965B (en) | 2021-05-18 |
Family
ID=64940473
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811398094.7A Active CN109194965B (en) | 2018-11-22 | 2018-11-22 | Processing method, processing device, display method and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109194965B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110505534B (en) * | 2019-08-26 | 2022-03-08 | 腾讯科技（深圳）有限公司 | Monitoring video processing method, device and storage medium |
| CN116189063B (en) * | 2023-04-24 | 2023-07-18 | 青岛润邦泽业信息技术有限公司 | Key frame optimization method and device for intelligent video monitoring |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108174057A (en) * | 2018-01-10 | 2018-06-15 | 武汉烛照科技有限公司 | It is a kind of using video image interframe difference to the method and device of picture fast noise reduction |
-
2018
- 2018-11-22 CN CN201811398094.7A patent/CN109194965B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108174057A (en) * | 2018-01-10 | 2018-06-15 | 武汉烛照科技有限公司 | It is a kind of using video image interframe difference to the method and device of picture fast noise reduction |
Non-Patent Citations (1)
| Title |
|---|
| 视频编码技术的若干新进展;黎洪松 程福林 艾新宇;《计算机应用研究》;20160111;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109194965A (en) | 2019-01-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10037606B2 (en) | Video analysis apparatus, monitoring system, and video analysis method | |
| EP0895694B1 (en) | System and method for creating trick play video streams from a compressed normal play video bitstream | |
| US10382830B2 (en) | Trick play in digital video streaming | |
| US10009628B2 (en) | Tuning video compression for high frame rate and variable frame rate capture | |
| US10109316B2 (en) | Method and apparatus for playing back recorded video | |
| US9756348B2 (en) | Method, device and system for producing a merged digital video sequence | |
| CN107800989B (en) | Video display method and system based on dynamic frame rate detection and network video recorder | |
| US10165290B2 (en) | Method for encoding digital video data | |
| JP6686541B2 (en) | Information processing system | |
| CN109194965B (en) | Processing method, processing device, display method and display device | |
| CN111277800A (en) | Monitoring video coding and playing method and device, electronic equipment and storage medium | |
| US9275081B2 (en) | Data management apparatus and data management method | |
| US8311103B2 (en) | Image recording apparatus for recording image data with display order field | |
| CN112235600B (en) | Method, device and system for processing video data and video service request | |
| CN107623852B (en) | Method and device for coding and frame reduction of digital video signal | |
| TWI680668B (en) | Screen image transmission method, image restoration method, screen image transmission system, image restoration system, screen image transmission program, image restoration program, image compression method, image compression system, and image compression program | |
| US6438318B2 (en) | Method for regenerating the original data of a digitally coded video film, and apparatus for carrying out the method | |
| CN114531528A (en) | Method for video processing and image processing apparatus | |
| TWI439137B (en) | A method and apparatus for restructuring a group of pictures to provide for random access into the group of pictures | |
| US20070053015A1 (en) | Still image printing method and apparatus corresponding to printing request timing | |
| US20230262274A1 (en) | video processing method of image quality compensation | |
| CN113556564A (en) | Scene recovery method and device | |
| KR20230053288A (en) | Method and apparatus for storing video data using event detection | |
| CN117082249A (en) | Video encoding method, video decoding method, encoder, decoder, and medium | |
| KR20200113477A (en) | Method and Apparatus for Processing Image in Compressed Domain |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |