CN112272297B - Image quality still frame detection method embedded in decoder - Google Patents
Image quality still frame detection method embedded in decoder Download PDFInfo
- Publication number
- CN112272297B CN112272297B CN202011173932.8A CN202011173932A CN112272297B CN 112272297 B CN112272297 B CN 112272297B CN 202011173932 A CN202011173932 A CN 202011173932A CN 112272297 B CN112272297 B CN 112272297B
- Authority
- CN
- China
- Prior art keywords
- frame
- image
- calculating
- decoder
- static
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
- H04N17/004—Diagnosis, testing or measuring for television systems or their details for digital television systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
Abstract
The invention discloses a method for detecting an image quality static frame embedded in a decoder, which comprises the steps of decoding received video image information at the decoder, sequentially acquiring GOP data, inversely quantized data and reconstructed image data in the decoding process, calculating the modulus and local histogram of the GOP data, a macro block DCT coefficient and a motion estimation vector, setting a corresponding statistical threshold value, and judging whether the static frame is a static frame or not and the length and the position of the static frame according to the statistical threshold value. The method can detect the still frame and continuous still frame in the audio-visual information stream in real time, judge the position of the still frame, fully utilize the computing resource of the decoder, store BUFF resource and intermediate result generated in the decoding process, and save the computing cost greatly without adding additional resources (computing resource and storage resource). The real-time responsiveness of static frame detection alarm is improved; the recognition rate of the static frame reaches more than 99 percent, and the method meets the relevant requirements of the national radio and television bureau.
Description
Technical Field
The invention belongs to the field of broadcast television image processing, and particularly relates to a method for detecting an image quality static frame embedded in a decoder.
Background
The quality of a video image needs to be detected in the monitoring and supervision of the new media audiovisual information of the broadcast television internet, and a static frame is a static picture which appears in continuous (at least 2 frames) frames of image contents in a video image sequence;
there are 2 reasons for the occurrence of a still frame in a sequence of video images:
1. to that end, video content requires a still picture;
2. when a digital television is broadcasted, interference and faults occur in the transmission process or the decoding process of a television receiver, and a still picture appears.
At present, the method for monitoring still pictures by a digital television (only a few parts of an analog television are running) is as follows:
1. the set-top box of the television receiver decodes the received (video compression image transmission format) TS stream into an original video image stream;
2. capturing one frame of image in the original video image stream (the capture rate is 1 or a few frames per second);
3. calculating the frame difference of the previous frame image and the next frame image, and calculating the histogram of the frame difference image;
4. judging whether the image is a still picture image or not according to an experience threshold and frame difference image histogram data;
the limitations of this approach are as follows:
performing still picture determination on the decoded image;
the possibility of missing the judgment of the still picture is extremely high;
the calculated amount is large; time and resources are wasted, and the cost is high;
it is very critical and related to the problem that the position where the still picture appears cannot be determined whether the still picture is generated when the client (television set-top box) decodes the still picture or generated during the previous broadcasting and transmission process.
Disclosure of Invention
The technical problem to be solved by the invention is as follows: the method for detecting the image quality static frame embedded in the decoder end is provided, and solves the problems that in the prior art, the static frame detection accuracy is low, the resource consumption is large, and the position of the generated static frame cannot be accurately judged.
The invention adopts the following technical scheme for solving the technical problems:
a method for detecting image quality static frame embedded in decoder end includes decoding received video image information at decoder end, obtaining GOP data, inverse quantized data and reconstructed image data in sequence in decoding process, calculating modulus and local histogram of GOP data, DCT coefficient of macro block and motion estimation vector, setting up relevant statistical threshold value and judging whether it is static frame and length and position of static frame according to statistical threshold value.
The method for detecting the static frame specifically comprises the following steps:
step 1, calculating GOP data volume, and setting a statistical threshold value GopValue according to the pixel attribute of a still frame of an image;
step 2, calculating DCT coefficients of the macro blocks, and setting a statistical threshold DctValue according to the frequency domain attribute of the image static frame;
step 3, calculating the modulus of the motion estimation vector in the interframe prediction process, and setting a statistical threshold MoveValue;
step 4, calculating a local histogram of a frame difference image before and after an image area corresponding to a macro block address, and setting a statistical threshold value group, hisValue [ I | I =0, \ 8230; 255], according to the histogram attribute of a still frame of the image;
and 5, judging whether the image is a static frame, the length of the static frame and the possible position of the static frame according to GopValue, dctValue, moveValue and HisValue [ i | i =0, \8230255 ].
Possible locations for the generation of a still frame include before the client decoder, during the decoder decoding process, or after the reconstructed image has been decoded.
The formats of I frame, P frame and B frame are adopted when calculating GOP data quantity, and the intra-frame prediction and inter-frame prediction algorithms are adopted.
And calculating DCT coefficients of the macro blocks, and judging the energy characteristics of the still frame image data in the frequency domain by adopting a Zigzeg indexing method.
And calculating a local histogram of a frame difference image before and after the image area corresponding to the macro block address for judging the position of the static frame.
Compared with the prior art, the invention has the following beneficial effects:
1. the presence of still frames, consecutive still frames, in the stream of audiovisual information is detected in real time.
2. The position where the still frame appears can be judged: before the input of the client decoder or during the decoding process.
3. The method fully utilizes the computing resources of the decoder, stores the BUFF resources and intermediate results generated in the decoding process, does not need to additionally increase the resources (computing resources and storage resources), and saves the cost of computing and storage resources.
4. The static frame recognition rate in the test and the practical application reaches more than 99 percent, and the relevant requirements of the national radio and television bureau are met.
Drawings
Fig. 1 is a flow chart of the method for detecting the image quality still frame embedded in the decoder according to the present invention.
Detailed Description
The structure and operation of the present invention will be further described with reference to the accompanying drawings.
A method for detecting image quality static frame embedded in decoder end includes decoding received video image information at decoder end, obtaining GOP data, inverse quantized data and reconstructed image data in sequence in decoding process, calculating modulus and local histogram of GOP data, DCT coefficient of macro block and motion estimation vector, setting up relevant statistical threshold value and judging whether it is static frame and length and position of static frame according to statistical threshold value.
In a specific embodiment, as shown in figure 1,
a method for detecting image quality static frame embedded in decoder end decodes the received video image information, in the decoding process, the decoding process includes the steps of entropy decoding, inverse quantization, inverse transformation, intra-frame or inter-frame prediction, filtering and image reconstruction in turn;
in the decoding process, data at different positions are acquired for processing, and a static frame is judged, and the specific steps are as follows:
step 1, setting a statistical threshold value according to the pixel attribute of a static frame of an image, calculating GOP data volume, and marking as GopValue; setting a statistical threshold according to the frequency domain attribute of the image static frame, and calculating the DCT coefficient of the macro block and recording the DCT coefficient as DctValue; calculating the modulus of a motion estimation vector in an inter-frame prediction process, setting a statistical threshold value and recording as MoveValue; setting a statistical threshold group according to the histogram attribute of the image static frame, and calculating a local histogram of a frame difference image before and after an image area corresponding to a macro block address, and marking the local histogram as HisValue [ I | I =0, \ 8230; 255];
step 2, after receiving video image information, a decoder acquires GOP data, calculates GOP data volume and records the GOP data volume as GopValue _1;
step 3, after inverse quantization, acquiring data before inverse transformation after inverse quantization, and calculating a DCT coefficient of a macro block, and marking the DCT coefficient as DctValue _1;
step 4, calculating a motion vector mode and setting a statistical threshold MoveValue _1 during the motion estimation inter-frame prediction process;
step 5, after reconstructing the image, acquiring reconstructed image data, and calculating a local histogram of an image area corresponding to the macro block address and recording the local histogram as HisValue [ I | I =0, \ 8230; 255] _1;
and 6, comparing the GopValue _1, the DctValue _1, the MoveValue _1 and the HisValue [ i | i =0, \ 8230255 ] _1 with corresponding threshold values, and analyzing and judging whether the image is a static frame, the length of the static frame and the possible position of the static frame.
The static frame detection method of the scheme is embedded in a decoder end, fully utilizes the calculation resources of the decoder, stores the BUFF resources and generates an intermediate result in the decoding process; the extra resources (computing resources and storage resources) are not required to be added, and the cost is saved.
Uses MPEG2, H.264 and H.265 coding and decoding international standard and domestic standard protocol to define, format, technique and algorithm, including:
defining and dividing a macro block format;
formats and intra-prediction and inter-prediction techniques and algorithms for I-frames, P-frames, B-frames in a GOP (group of pictures); the formats of I frame, P frame and B frame are adopted when calculating GOP data quantity, and the intra-frame prediction and inter-frame prediction algorithms are adopted.
Coefficients of DCT (discrete cosine transform) and a zigbee indexing method; and judging the energy characteristics of the still frame image data in the frequency domain. And calculating DCT coefficients of the macro blocks, and judging the energy characteristics of the still frame image data in the frequency domain by adopting a Zigzeg indexing method.
CABAC (Context-based Adaptive Binary Arithmetic Coding) Context-dependent Adaptive Binary Arithmetic Coding, and the like.
According to the method, the local histogram of the frame difference image before and after the image area corresponding to the macro block address is calculated, and an important basis is provided for judging the position of the static frame.
And calculating a local histogram of a frame difference image before and after the image area corresponding to the macro block address for judging the position of the static frame. Possible locations for the generation of the still frame include before the decoder of the client, during the decoding process of the decoder, or after the reconstructed image is decoded.
Whether a still frame occurs before decoding and the length of the still frame can be determined by comparing GopValue _1 with a corresponding threshold.
Whether a still frame occurs during decoding and the length of the still frame can be determined by comparing the DctValue _1 and MoveValue _1 with corresponding thresholds.
Whether a still frame appears after the reconstructed image is decoded and the length of the still frame can be judged by comparing HisValue [ i | i =0, \8230 # _ 255 _1with a corresponding threshold value.
The above description is of the preferred embodiment of the invention. It is to be understood that the invention is not limited to the particular embodiments described above, in which details that are not described in detail are to be understood as being carried out in a manner that is conventional in the art; those skilled in the art can make many possible variations and modifications to the disclosed solution, or modify the equivalent embodiments with equivalent variations, without departing from the scope of the solution, without thereby affecting the spirit of the invention. Therefore, any simple modification, equivalent change and modification made to the above embodiments according to the technical essence of the present invention are within the scope of the technical solution of the present invention, unless the technical essence of the present invention is not departed from the content of the technical solution of the present invention.
Claims (5)
1. A method for detecting a still frame of picture quality embedded in a decoder, characterized by: decoding the received video image information at a decoder end, sequentially acquiring GOP data, inversely quantized data and reconstructed image data in the decoding process, calculating the modulus and local histogram of the GOP data, the DCT coefficient of a macro block and a motion estimation vector, setting a corresponding statistical threshold, and judging whether the frame is a static frame and the length and position of the static frame according to the statistical threshold, wherein the method specifically comprises the following steps:
step 1, setting a statistical threshold value according to the pixel attribute of a static frame of an image, calculating GOP data volume, and marking as GopValue; setting a statistical threshold value according to the frequency domain attribute of the image static frame, and calculating the DCT coefficient of the macro block and recording the DCT coefficient as DctValue; calculating the modulus of the motion estimation vector in the interframe prediction process, setting a statistical threshold value and recording as MoveValue; setting a statistical threshold group according to the histogram attribute of the image static frame, and calculating a local histogram of a frame difference image before and after an image area corresponding to a macro block address, and marking as HisValue [ I | I =0, \ 8230; 255];
step 2, after the decoder receives the video image information, obtaining GOP data, calculating GOP data quantity, and recording the GOP data quantity as GopValue _1;
step 3, after inverse quantization, acquiring data after inverse quantization and before inverse transformation, and calculating a DCT coefficient of a macro block, and marking the DCT coefficient as DctValue _1;
step 4, calculating a motion vector mode and setting a statistical threshold MoveValue _1 during the motion estimation inter-frame prediction process;
step 5, after reconstructing the image, acquiring reconstructed image data, and calculating a local histogram of an image area corresponding to the macro block address and recording the local histogram as HisValue [ I | I =0, \ 8230; 255] _1;
and 6, comparing the GopValue _1, the DctValue _1, the MoveValue _1 and the HisValue [ i | i =0, \ 8230255 ] _1 with corresponding threshold values, and analyzing and judging whether the image is a static frame, the length of the static frame and the possible position of the static frame.
2. The image quality still frame detection method embedded in a decoder side according to claim 1, wherein: possible locations for the generation of the still frame include before the decoder of the client, during the decoding process of the decoder, or after the reconstructed image is decoded.
3. The image quality still frame detection method embedded in a decoder side according to claim 1, wherein: the formats of I frame, P frame and B frame are adopted when calculating GOP data quantity, and the intra-frame prediction and inter-frame prediction algorithms are adopted.
4. The image quality still frame detection method embedded in a decoder side according to claim 1, wherein: and calculating DCT coefficients of the macro blocks, and judging the energy characteristics of the still frame image data in the frequency domain by adopting a Zigzeg indexing method.
5. The image quality still frame detection method embedded in a decoder side according to claim 1, wherein: and calculating a local histogram of a frame difference image before and after the image area corresponding to the macro block address for judging the position of the static frame.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011173932.8A CN112272297B (en) | 2020-10-28 | 2020-10-28 | Image quality still frame detection method embedded in decoder |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011173932.8A CN112272297B (en) | 2020-10-28 | 2020-10-28 | Image quality still frame detection method embedded in decoder |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112272297A CN112272297A (en) | 2021-01-26 |
| CN112272297B true CN112272297B (en) | 2023-01-31 |
Family
ID=74344459
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011173932.8A Active CN112272297B (en) | 2020-10-28 | 2020-10-28 | Image quality still frame detection method embedded in decoder |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112272297B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113542804B (en) * | 2021-07-09 | 2023-10-27 | 杭州当虹科技股份有限公司 | Method for detecting static frame sequence based on code stream statistical characteristics |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127912A (en) * | 2007-09-14 | 2008-02-20 | 浙江大学 | Video coding method for dynamic background frames |
| CN101330619A (en) * | 2008-07-29 | 2008-12-24 | 北京中星微电子有限公司 | Method for compressing video image and corresponding method for decoding video |
| CN105323465A (en) * | 2014-06-27 | 2016-02-10 | 佳能株式会社 | Image processing apparatus and method for controlling the same |
| CN105578177A (en) * | 2015-12-15 | 2016-05-11 | 浙江广播电视集团 | Video static frame detection system based on CRC check and method thereof |
| CN107194952A (en) * | 2017-05-08 | 2017-09-22 | 武汉大学 | A kind of screen scroll detection method of screen-oriented Video coding |
| WO2018228130A1 (en) * | 2017-06-15 | 2018-12-20 | 腾讯科技（深圳）有限公司 | Video encoding method, apparatus, device, and storage medium |
| CN110312163A (en) * | 2019-07-10 | 2019-10-08 | 湖南快乐阳光互动娱乐传媒有限公司 | A kind of digital video static frame detection and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120133659A1 (en) * | 2010-11-30 | 2012-05-31 | Ati Technologies Ulc | Method and apparatus for providing static frame |
-
2020
- 2020-10-28 CN CN202011173932.8A patent/CN112272297B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101127912A (en) * | 2007-09-14 | 2008-02-20 | 浙江大学 | Video coding method for dynamic background frames |
| CN101330619A (en) * | 2008-07-29 | 2008-12-24 | 北京中星微电子有限公司 | Method for compressing video image and corresponding method for decoding video |
| CN105323465A (en) * | 2014-06-27 | 2016-02-10 | 佳能株式会社 | Image processing apparatus and method for controlling the same |
| CN105578177A (en) * | 2015-12-15 | 2016-05-11 | 浙江广播电视集团 | Video static frame detection system based on CRC check and method thereof |
| CN107194952A (en) * | 2017-05-08 | 2017-09-22 | 武汉大学 | A kind of screen scroll detection method of screen-oriented Video coding |
| WO2018228130A1 (en) * | 2017-06-15 | 2018-12-20 | 腾讯科技（深圳）有限公司 | Video encoding method, apparatus, device, and storage medium |
| CN110312163A (en) * | 2019-07-10 | 2019-10-08 | 湖南快乐阳光互动娱乐传媒有限公司 | A kind of digital video static frame detection and system |
Non-Patent Citations (2)
| Title |
|---|
| Computational optimization for violent scenes detection;Vu Lam;《2016 International Conference on Computer, Control, Informatics and its Applications (IC3INA)》;20170228;全文 * |
| 数字电视图像层静帧和黑场报警的判断算法;李瑞民;《电视技术》;20141202;全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112272297A (en) | 2021-01-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| RU2377737C2 (en) | Method and apparatus for encoder assisted frame rate up conversion (ea-fruc) for video compression | |
| JP3609965B2 (en) | Method for processing digital video data in compressed format | |
| US6327390B1 (en) | Methods of scene fade detection for indexing of video sequences | |
| JP2006519565A (en) | Video encoding | |
| US8363728B2 (en) | Block based codec friendly edge detection and transform selection | |
| US20150312575A1 (en) | Advanced video coding method, system, apparatus, and storage medium | |
| CN108989802B (en) | HEVC video stream quality estimation method and system by utilizing inter-frame relation | |
| TW201127064A (en) | System and method to process motion vectors of video data | |
| JP2006519564A (en) | Video encoding | |
| WO2013071669A1 (en) | Motion analysis method based on video compression code stream, code stream conversion method and apparatus thereof | |
| US20060093232A1 (en) | Unified metric for digital video processing (umdvp) | |
| CN111010495A (en) | Video denoising processing method and device | |
| CN106550237B (en) | Monitoring video compression method | |
| JP2006524460A (en) | Content analysis of encoded video data | |
| CN112272297B (en) | Image quality still frame detection method embedded in decoder | |
| CN109803146B (en) | Method, apparatus, medium, and device for secondary compression of video | |
| WO2005094083A1 (en) | A video encoder and method of video encoding | |
| JP2009535881A (en) | Method and apparatus for encoding / transcoding and decoding | |
| WO2005086491A1 (en) | System and method for global indication of mpeg impairments in compressed digital video | |
| CN112261404B (en) | Image quality black field detection method embedded in decoder | |
| US20120133836A1 (en) | Frame level quantization estimation | |
| CN110446042B (en) | Coding method for improving P frame quality in H.264 | |
| US20160360219A1 (en) | Preventing i-frame popping in video encoding and decoding | |
| US9542611B1 (en) | Logo detection for macroblock-based video processing | |
| KR20070090494A (en) | Inter frame error concealment method and apparatus using the average motion vector |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |