CN102223539A - Processing method for splash screen caused by picture coding frame loss - Google Patents

Processing method for splash screen caused by picture coding frame loss Download PDF

Info

Publication number
CN102223539A
CN102223539A CN 201110172869 CN201110172869A CN102223539A CN 102223539 A CN102223539 A CN 102223539A CN 201110172869 CN201110172869 CN 201110172869 CN 201110172869 A CN201110172869 A CN 201110172869A CN 102223539 A CN102223539 A CN 102223539A
Authority
CN
China
Prior art keywords
frame
framing
current
normal
time
Prior art date
Application number
CN 201110172869
Other languages
Chinese (zh)
Inventor
董明洲
陈春汉
王季炜
黄伟
黄莹
吴松
Original Assignee
武汉长江通信产业集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 武汉长江通信产业集团股份有限公司 filed Critical 武汉长江通信产业集团股份有限公司
Priority to CN 201110172869 priority Critical patent/CN102223539A/en
Publication of CN102223539A publication Critical patent/CN102223539A/en

Links

Abstract

The invention provides a processing method for splash screen caused by picture coding frame loss, mainly comprising the following steps: firstly, keeping the nearest normal frame I as a frame P coding reference to correct the frame loss and the splash screen of a picture, and secondly, In the first method, if the normal frame I is kept for too long, the frame I is reconstructed by utilizing the newest YUV (luma and chroma) data in a buffer memory, and the newest frame I is used as a frame P coding reference frame. In the invention, the generated splash screen, the frame loss and time delay are controlled in an acceptable range, so as to ensure the normal working and working efficiency of real-time video monitoring.

Description

The processing method of image encoding frame losing flower screen

Technical field

The present invention relates to a kind of is the processing method of image encoding frame losing flower screen of the H.264 video encoder of display terminal with video (television set), the processing when particularly relating to multiplexer channel CIF format-pattern coding frame losing flower screen.

Background technology

Along with the fast development of Internet and multimedia technology, the network real-time Transmission of video becomes one of research focus of network application.H.264 standard becomes the main form and the standard of multimedia transmission on present and the next generation network with its high compression rate, high-quality, low code check.The time delay of the real-time Transmission requirement transmission of video is little, packet loss is low.As based on H.264 video server, show to the terminal coding by network transmitted image packet in front end hardware coding back.When encoder is accepted data and is encoded, can be because a variety of causes, the data that encoder is received have buffer memory and overflow and causing that time-delay produces, perhaps because coding rate is slow, will cause this moment image inevitably to produce the problem of frame losing and Hua Ping, and this image problem is expendable, the quality of influence monitoring in when coding, lost the original intention and the effect of video monitoring, made real-time monitoring become an empty verbiage.

Characteristics such as video (television set) is extensive, the most the most frequently used solution as the monitor terminal of output, and it is low to have a cost, and effect is directly perceived, and is easy to operate.Because the more uncertainty that the network real-time Transmission of video faces, the fluctuation ratio of Network Transmission quality is more common.So, when with video (television set) being the terminal demonstration, must consider to guarantee that just few as far as possible generation flower shields and the frame losing problem when leading portion carries out coded image data.Video encoder in the case has very urgent requirement for the delay process of image data packets.Therefore, along with further developing of streaming media service, this class processing method just is being subjected to increasing attention.

Summary of the invention

Technical problem to be solved by this invention is: the processing method that a kind of image encoding frame losing flower screen is provided, adopt processing method of the present invention can come the correction image time-delay, the time-delay that is produced is controlled within the acceptable scope, guarantees the normal and operating efficiency of real-time video monitoring.

The technical solution adopted in the present invention is: a kind of processing method of image encoding frame losing flower screen may further comprise the steps:

100) in encoder-side a buffering area is set and receives view data, and high some mark and low spot mark are set in buffering area;

200) when from buffering area, receiving image data packets,, suspend the reception of video data ground when buffer data bag quantity checks that network connects during less than low spot; When buffer data bag quantity during more than or equal to low spot, current framing object is judged, if present frame is the I frame, then directly carry out framing, then next framing object is judged; If present frame is the P frame, then enter next step;

300) when data packet number in the buffering area is put greater than height, enter next step; When buffer data bag quantity is between spikes/low-points, go to 500);

400) the P frame with previous normally framing replaces current P frame or carries out the frame-skipping processing, goes to 200 then);

500) judge according to the absolute value of the difference of the timestamp of timestamp in the I frame image data bag of a last normal framing of energy and the current P frame of organizing, when the absolute value of this time difference less than predetermined normal packet receiving during the time, to the normal framing of current P frame, go to 200 then); During the time, reformulate the I frame with yuv data up-to-date in the buffer area, and utilize this up-to-date I frame more than or equal to predetermined normal packet receiving when the absolute value of this time difference, current P frame is carried out framing, go to 200 then) as reference coding frame.

Described method, the normal packet receiving time T of step 500=| T Ginseng 1-T Ginseng 2|+Δ T, T herein Ginseng 1, T Ginseng 2Be respectively the timestamp in the I frame image data bag of a normal framing of energy, the timestamp of the current P frame of organizing, the scope of Δ T is 0.5~2s.

Described method after the current I frame is carried out framing, is also carried out CRC check, and verification is by then continuing coding; Not by then abandoning, reformulate the I frame then.

Advantage of the present invention: be used as P frame reference coding frame according to up-to-date I frame.The frame losing and the Hua Ping problem that are produced when control is encoded flexibly adopt processing method of the present invention can come the correction image quality, guarantee the normal and operating efficiency of real-time video monitoring.

Description of drawings

Fig. 1 is that buffering area is provided with schematic diagram.

Fig. 2 is the processing method of H.264 video encoder multiway images coding frame losing flower screen provided by the invention.

Embodiment

The invention provides a kind of processing method, the particularly situation of multiplexer channel CIF form encoding time delay of delaying time at the image encoding frame losing flower screen that with video (television set) is the H.264 video encoder of display terminal.

Adopt method of the present invention then can pass through: 1, to keep nearest normal I frame as P frame coded reference, come the frame losing and the Hua Ping of correction image.If in 2 first methods, the time of the recently normal I frame that keeps is of a specified duration excessively, then reformulate the I frame with yuv data up-to-date in the buffer memory, and utilize this up-to-date I frame to be used as P frame reference coding frame, the colored screen, frame losing and the time-delay that are produced are controlled within the acceptable scope, guarantee the normal and operating efficiency of real-time video monitoring.

Embodiment of the present invention is:

Step 1, in encoder-side a buffering area is set and receives view data.

Step 2, one high some mark (highwater) and low spot mark (lowwater) are set in buffering area.The height point mark (highwater) of buffering area and low spot mark (lowwater) are empirical values big or small according to hardware buffer and that the framing time (time of each frame all writes down, and dynamic change) is decided.When packet in the buffering area during greater than highwater, abandon unnecessary packet, if the I frame then carries out framing, carry out CRC check according to the framing result after finishing, verification is by then continuing coding by normal flow, not by then abandoning.If P frame, then replace the normally wrong P frame of framing with previous normal P frame, or carry out frame-skipping within a certain period of time and handle, such as: P frames such as reservation 1,3,5,7, P frames such as jumping 2,4,6,8 stop such frame-skipping processing again and change normal encoding into after data return to normal level in the buffering area.When wrapping between highwater and the lowwater, buffer data carries out normal framing, when the buffer data bag checks that video line connects during less than lowwater.

Step 3, when from buffering area, receiving image data packets, judge according to the absolute value of the difference of the timestamp of timestamp in the I frame image data bag of a last energy framing and the current P frame of organizing.When the absolute value of this time difference during less than predetermined normal time, we think that flow process is normal, if when the absolute value of this time difference during greater than predetermined normal time, we think occur unusual, think that this I frame holding time is of a specified duration excessively, may cause flower screen or frame losing.Then reformulate the I frame with yuv data up-to-date in the buffer memory this moment.And utilize this up-to-date I frame to be used as P frame reference coding frame.The colored screen, frame losing and the time-delay that are produced are controlled within the acceptable scope.

Comprise following steps in the step 3:

Step 3.1: the timestamp of establishing the I frame of the last energy framing of T1=;

The timestamp of the P frame that T2=is current group;

T0=|T1-T2| (absolute value of the difference of T1 and T2);

Upper limit memory time of the normal I frame that T3=preserves recently, this value can be set at fixedly empirical value, also can be set at the dynamic change value.

Step 3.2: when T0>T3, think that this I frame holding time is of a specified duration excessively, may cause flower screen or frame losing.Then reformulate the I frame with yuv data up-to-date in the buffer memory this moment.And utilize this up-to-date I frame to be used as P frame reference coding frame.The colored screen, frame losing and the time-delay that are produced are controlled within the acceptable scope.

When T0<T3, think that coding is normal, no matter be I frame or the equal normal encoding of P frame.

Wherein step 3.1 occurs in and receives the vedio data bag, carries out putting into buffering area after the judgement of timestamp; Step 3.2 occurs in when getting the package frame from buffering area, decides according to the judgement of step 3.1 and continues framing or abandon, or adopt nearest frame to replace erroneous frame.

Claims (3)

1. the processing method of shielding is spent in an image encoding frame losing, it is characterized in that may further comprise the steps:
100) in encoder-side a buffering area is set and receives view data, and high some mark and low spot mark are set in buffering area;
200) when from buffering area, receiving image data packets,, suspend the reception of video data ground when buffer data bag quantity checks that network connects during less than low spot; When buffer data bag quantity during more than or equal to low spot, current framing object is judged, if present frame is the I frame, then directly carry out framing, then next framing object is judged; If present frame is the P frame, then enter next step;
300) when data packet number in the buffering area is put greater than height, enter next step; When buffer data bag quantity is between spikes/low-points, go to 500);
400) the P frame with previous normally framing replaces current P frame or carries out the frame-skipping processing, goes to 200 then);
500) judge according to the absolute value of the difference of the timestamp of timestamp in the I frame image data bag of a last normal framing of energy and the current P frame of organizing, when the absolute value of this time difference less than predetermined normal packet receiving during the time, to the normal framing of current P frame, go to 200 then); During the time, reformulate the I frame with yuv data up-to-date in the buffer area, and utilize this up-to-date I frame more than or equal to predetermined normal packet receiving when the absolute value of this time difference, current P frame is carried out framing, go to 200 then) as reference coding frame.
2. the method for claim 1 is characterized in that: the normal packet receiving time T of step 500=| T Ginseng 1-T Ginseng 2|+Δ T, T herein Ginseng 1, T Ginseng 2Be respectively the timestamp in the I frame image data bag of a normal framing of energy, the timestamp of the current P frame of organizing, the scope of Δ T is 0.5~2s.
3. method according to claim 1 is characterized in that: after the current I frame is carried out framing, also carry out CRC check, verification is by then continuing coding; Not by then abandoning, reformulate the I frame then.
CN 201110172869 2011-06-24 2011-06-24 Processing method for splash screen caused by picture coding frame loss CN102223539A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110172869 CN102223539A (en) 2011-06-24 2011-06-24 Processing method for splash screen caused by picture coding frame loss

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110172869 CN102223539A (en) 2011-06-24 2011-06-24 Processing method for splash screen caused by picture coding frame loss

Publications (1)

Publication Number Publication Date
CN102223539A true CN102223539A (en) 2011-10-19

Family

ID=44779946

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110172869 CN102223539A (en) 2011-06-24 2011-06-24 Processing method for splash screen caused by picture coding frame loss

Country Status (1)

Country Link
CN (1) CN102223539A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107657591A (en) * 2017-09-05 2018-02-02 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN107801049A (en) * 2016-09-05 2018-03-13 杭州海康威视数字技术股份有限公司 A kind of real-time video transmission, player method and device
CN108881775A (en) * 2018-05-30 2018-11-23 维沃移动通信有限公司 A kind of video communication method and mobile terminal

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020071662A1 (en) * 1996-10-15 2002-06-13 Matsushita Electric Industrial Co., Ltd. Video and audio coding method, coding apparatus, and coding program recording medium
CN101060633A (en) * 2006-04-17 2007-10-24 株式会社日立制作所 Image display apparatus
CN101316357A (en) * 2008-06-30 2008-12-03 华为技术有限公司 Channel switching method, terminal and medium service apparatus
CN101557512A (en) * 2009-05-19 2009-10-14 武汉长江通信产业集团股份有限公司 Method for processing time delay when video terminal receives video data
EP2247111A1 (en) * 2004-12-30 2010-11-03 Microsoft Corporation Use of frame caching to improve packet loss recovery

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020071662A1 (en) * 1996-10-15 2002-06-13 Matsushita Electric Industrial Co., Ltd. Video and audio coding method, coding apparatus, and coding program recording medium
EP2247111A1 (en) * 2004-12-30 2010-11-03 Microsoft Corporation Use of frame caching to improve packet loss recovery
CN101060633A (en) * 2006-04-17 2007-10-24 株式会社日立制作所 Image display apparatus
CN101316357A (en) * 2008-06-30 2008-12-03 华为技术有限公司 Channel switching method, terminal and medium service apparatus
CN101557512A (en) * 2009-05-19 2009-10-14 武汉长江通信产业集团股份有限公司 Method for processing time delay when video terminal receives video data

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107801049A (en) * 2016-09-05 2018-03-13 杭州海康威视数字技术股份有限公司 A kind of real-time video transmission, player method and device
CN107801049B (en) * 2016-09-05 2020-01-17 杭州海康威视数字技术股份有限公司 Real-time video transmission and playing method and device
CN107657591A (en) * 2017-09-05 2018-02-02 维沃移动通信有限公司 A kind of image processing method and mobile terminal
CN108881775A (en) * 2018-05-30 2018-11-23 维沃移动通信有限公司 A kind of video communication method and mobile terminal

Similar Documents

Publication Publication Date Title
CN104885473B (en) Live timing method for the dynamic self-adapting stream transmission (DASH) via HTTP
JP6240224B2 (en) Determining available media data for network streaming
US9456209B2 (en) Method of multiplexing H.264 elementary streams without timing information coded
JP5788101B2 (en) network streaming of media data
US9204203B2 (en) Reduction of latency in video distribution networks using adaptive bit rates
KR101396628B1 (en) Streaming encoded video data
KR101558116B1 (en) Switching between representations during network streaming of coded multimedia data
US7778372B2 (en) Data delivery system and method, and receiver and transmitter
US9973345B2 (en) Calculating and signaling segment availability times for segments of media data
EP2171903B1 (en) Simultaneous processing of media and redundancy streams for mitigating impairments
JP4965059B2 (en) Switching video streams
CN1146159C (en) Data multiplexer, data multiplexer method
KR101248371B1 (en) Power and computational load management techniques in video processing
TWI357739B (en) Assembling forward error correction frames
CN100504757C (en) Method and system for buffering streamed data
CN105791841B (en) The methods, devices and systems of the self adaptation stream processing of video data on network
KR100968928B1 (en) Apparatus and method for synchronization of audio and video streams
US8458744B2 (en) Method for reducing channel change times and synchronizing audio/video content during channel change
KR101414435B1 (en) Method and apparatus for assessing quality of video stream
US20130314553A1 (en) Video Data Quality Assessment Method and Apparatus
US6081299A (en) Methods and systems for encoding real time multimedia data
TWI544791B (en) Decoder and method at the decoder for synchronizing the rendering of contents received through different networks
EP2227910B1 (en) Reducing media stream delay through independent decoder clocks
US9319626B2 (en) Decoding of closed captions at a media server
CA2749160C (en) Informative data streaming server

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20111019

C12 Rejection of a patent application after its publication