WO2001026379A1 - Self adapting frame intervals - Google Patents

Self adapting frame intervals Download PDF

Info

Publication number
WO2001026379A1
WO2001026379A1 PCT/US2000/027687 US0027687W WO0126379A1 WO 2001026379 A1 WO2001026379 A1 WO 2001026379A1 US 0027687 W US0027687 W US 0027687W WO 0126379 A1 WO0126379 A1 WO 0126379A1
Authority
WO
Grant status
Application
Patent type
Prior art keywords
video
frame
determined
frame interval
video motion
Prior art date
Application number
PCT/US2000/027687
Other languages
French (fr)
Inventor
Ian A. Stewart
Original Assignee
World Multicast.Com, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/177Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103Selection of coding mode or of prediction mode
    • H04N19/114Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/172Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
    • H04N19/61Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding

Abstract

A computer processor implemented video compression method and computer program product (20) for automatically adjusting frame interval during compression of a video signal. The method determines a video motion value (22) from the video signal, determines frame interval (24) according to the determined video motion value, and automatically adjusts the frame interval according to the determined frame interval.

Description

SELF ADAPTING FRAME INTERVALS

FIELD OF THE INVENTION

The present invention relates to video compression and, more particularly, to improving video compression quality.

BACKGROUND OF THE INVENTION

Although the Joint Photographic Experts Group (JPEG) compression standard is very effective at compressing streaming still images, further compression can be achieved using the Motion Picture Experts Group (MPEG) video standard. MPEG augments JPEG with motion compensation, a form of differential encoding, and achieves compression ratios as high as 200 to 1. In MPEG, each frame in a video sequence is encoded. There are three kinds of MPEG video frames: intra (I), predictive (P), and bi-directional predicted (B). I-frames are independent of other frames, and their encoding is almost identical to JPEG. I-frames are encoded using information entirely within the frame-to-be compressed. P-frames are encoded using information both from within the frame-to-be compressed and from the previous I or P-frame. Compression is about 10 times better than for I-frames, but the performance costs are high. B-frames are encoded using information from within the frame, from the previous I or P-frame, and from the following I or P-frame. B-frames generally are compressed to about one sixtieth the size of I-frames, but performance suffers even further. B-frames are never used as a basis for the encoding of other frames. The time it takes to decode each of the three frame types is roughly the same.

Traditional video frame compression works great for talking heads. However, when the motion within a video becomes more dynamic the I-frame interval must be decreased in order to accommodate the higher motion. By decreasing the I-frame interval, the P and B-frames are based on more recently produced I-frames. Presently, adjusting the I-frame rate or interval is a time consuming trial and error, manually-performed process. The video compression in effect is less efficient, thereby making it more costly. Therefore, there exists a need for improving video compression by improving the ability to adjust I-frame rate.

SUMMARY OF THE INVENTION The present invention provides a computer processor implemented video compression method and computer program product for compressing a video signal. The method determines a video motion value from the video signal, determines frame interval according to the determined video motion value, and compresses at least a portion of the video signal according to the determined frame interval.

In accordance with further aspects of the invention, determining a video motion value includes taking a sample of a frame of the video signal, comparing the sample to one or more previously taken samples, and determining the video motion value according to the comparison. In accordance with other aspects of the invention, the steps of the process are repeated for frames of the video signal in accordance with a sampling pattern, such as every frame of the video signal.

In accordance with still further aspects of the invention, determining frame interval further includes comparing the determined video motion value to one or more previously determined video motion values. If the determined video motion value differs from the one or more previously determined video motion values by a threshold amount, the method determines frame interval according to the determined video motion value. In accordance with yet other aspects of the invention, compressing at least a portion of the video signal according to the determined frame interval further includes comparing the frame interval to one or more previously determined frame intervals.

If the determined frame interval differs from the one or more previously determined frame intervals by a threshold amount, the method compresses at least a portion of the video signal according to the determined frame interval.

In accordance with still other aspects of the invention, the frame interval is a predictive frame interval or a bi-directional predictive frame interval.

In accordance with further aspects of the invention, compressing at least a portion of the video signal uses at least one of the MPEG compression schemes. BRIEF DESCRIPTION OF THE DRAWINGS The foregoing aspects and many of the attendant advantages of this invention will become more readily appreciated as the same becomes better understood by reference to the following detailed description, when taken in conjunction with the accompanying drawings, wherein:

FIGURE 1 is a component diagram of the present invention; and

FIGURES 2-4 are flow diagrams of embodiment processes performed by the components illustrated in FIGURE 1.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

The invention provides automatically adapting intervals between I-frames during digital video compression, such as the Motion Pictures Experts Group (MPEG) compression schemes. As shown in FIGURE 1, a computer-based self-adapting compression processor 20 includes a motion sampler and determiner component 22 for receiving a framed video stream, an I-frame interval determiner component 24 coupled to the motion sampler and determiner component 22 and a video compressor component 26 coupled to the I-frame interval determiner component 24 for generating a compressed digital video.

FIGURE 2 illustrates a first embodiment of the process performed by the components of FIGURE 1. At block 40, the motion sampler and determiner component 22 receives a video stream from a video source. In one embodiment, the video stream is an analog video signal, such as NTSC or PAL. The video stream may be any other type of video signal, analog or digital, that includes frames of still images that require compression for storage or delivery. Next, at block 42, the motion sampler and determiner component 22 takes a sample of a frame of the received video stream. Then, at block 44, the motion sampler and determiner component 22 compares the sample to one or more previously taken samples and determines a value of change in video motion according to the comparison. The MPEG bitstream includes a motion vector and an error term. The error term is the same as the determined value of change in video motion. At block 46, the I-frame interval determiner component 24 determines an I-frame interval (frequency) according to the determined value of change in video motion. At block 48, the video compressor component 26 compresses the received video image according to the determined I-frame interval determination. The process returns to block 42 to take a sample of a successive frame, or of a frame at some interval in time or number of frames from the recently sampled frame.

FIGURE 3 illustrates an alternate embodiment of the process shown in FIGURE 2. The steps shown in blocks 54, 56 and 58 are the same as that described above in FIGURE 2 at blocks 40, 42 and 44. After block 58, at decision block 60, the motion sampler and determiner component 22 determines if the value of change in video motion differs from one or more previously determined values by more than a threshold amount. If the most recently determined value of change in video motion does not differ by more than the threshold amount, the process returns to block 56 to take a sample of a successive frame, or of a frame at some interval in time or number of frames from the recently sampled frame. If the most recently determined value of change in video motion does differ by more that the threshold amount, at block 62, the I-frame interval determiner component 24 determines an I-frame interval according to the determined value of change in video motion. At block 64, the video compressor component 26 compresses the received video image according to the determined I-frame interval. The process then returns to block 56 to take a sample of a successive frame, or a frame at some interval in time or number of frames from the recently sampled frame.

FIGURE 4 illustrates another embodiment of the process shown in FIGURE 2. The steps shown in blocks 70, 72, 74 and 76 are the same as that described above in FIGURE 2 at blocks 40, 42, 44 and 46. After block 76, at decision block 78, the I-frame interval determiner component 24 determines if the determined I-frame interval differs from one or more previously determined intervals by more than an interval threshold amount. If the most recently determined interval does not differ by more than the interval threshold amount, the process returns to block 72 to take a sample of a successive frame, or a frame at some interval in time or number of frames from the recently sampled frame. If the most recently determined interval does differ by more that the interval threshold amount, at block 80, the video compressor component 26 compresses the received video image according to the most recently determined I-frame interval determination. The process then returns to block 72 to take a sample of a successive frame, or a frame at some interval in time or number of frames from the recently sampled frame.

The steps described in FIGURES 2-4 may be performed in a multiple of different orders without departing from the scope of the present invention. While the preferred embodiment of the invention has been illustrated and described, many changes can be made without departing from the spirit and scope of the invention. Accordingly, the scope of the invention is not limited by the disclosure of the preferred embodiment. Instead, the invention should be determined entirely by reference to the claims that follow.

Claims

The embodiments of the invention in which an exclusive property or privilege is claimed are defined as follows:
1. A method for automatically adjusting frame interval between frames of digital video during compression of a received video signal comprising: a) determining a video motion value from the video signal; b) determining frame interval according to the determined video motion value; and c) automatically adjusting the frame interval according to the determined frame interval.
2. The method of Claim 1, wherein determining a video motion value comprises taking a sample of a frame of the video signal, comparing the sample to one or more previously taken frame samples, and determining the video motion value according to the comparison.
3. The method of Claim 2, further comprising: repeating a-c for other frames of the video signal in accordance with a predetermined sampling pattern.
4. The method of Claim 3, wherein the sampling pattern is every frame of the video signal.
5. The method of Claim 1, wherein determining frame interval further comprises comparing the determined video motion value to one or more previously determined video motion values, if the determined video motion value differs from the one or more previously determined video motion values by a threshold amount, determining frame interval according to the determined video motion value, and if the determined video motion value does not differ from the one or more previously determined video motion values by the threshold amount, returning to a.
6. The method of Claim 1, wherein compression is performed in accordance with a MPEG compression scheme.
7. A computer program product for performing the process of Claim 1.
8. A computer program product for performing the process of Claim 2.
9. A computer program product for performing the process of Claim 3.
10. A computer program product for performing the process of Claim 4.
11. A computer program product for performing the process of Claim 5.
12. A computer program product for performing the process of Claim 6.
PCT/US2000/027687 1999-10-07 2000-10-06 Self adapting frame intervals WO2001026379A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US15819099 true 1999-10-07 1999-10-07
US60/158,190 1999-10-07

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
AU7868600A AU7868600A (en) 1999-10-07 2000-10-06 Self adapting frame intervals

Publications (1)

Publication Number Publication Date
WO2001026379A1 true true WO2001026379A1 (en) 2001-04-12

Family

ID=22567031

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/027687 WO2001026379A1 (en) 1999-10-07 2000-10-06 Self adapting frame intervals

Country Status (1)

Country Link
WO (1) WO2001026379A1 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2864865A1 (en) * 2004-01-07 2005-07-08 Thomson Licensing Sa Video image sequence coding method for hybrid type video compression, involves coding entity of image based on rate of potential utilization of image entity calculated for forward and backward predictive coding of other two images
EP1566971A2 (en) * 2004-02-20 2005-08-24 Seiko Epson Corporation Video codec system with real-time complexity adaptation and region-of-interest coding
WO2005088981A1 (en) * 2004-03-11 2005-09-22 Canon Kabushiki Kaisha Encoding apparatus, encoding method, decoding apparatus, and decoding method
WO2005096633A1 (en) * 2004-03-31 2005-10-13 Koninklijke Philips Electronics N.V. Video processing method and corresponding encoding device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5479209A (en) * 1993-05-17 1995-12-26 Nec Corporation Preprocessor for moving picture encoding
US5825927A (en) * 1996-01-16 1998-10-20 Hitachi America, Ltd. Methods and apparatus for encoding video data in a manner that is well suited for decoding by regular or downconverting decoders
US5832121A (en) * 1994-09-27 1998-11-03 Sony Corporation Method and apparatus for video data compression
US5838872A (en) * 1995-03-20 1998-11-17 Matsushita Electric Industrial Co., Ltd. Image information recording apparatus and image information recording method
US5883672A (en) * 1994-09-29 1999-03-16 Sony Corporation Apparatus and method for adaptively encoding pictures in accordance with information quantity of respective pictures and inter-picture correlation

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5479209A (en) * 1993-05-17 1995-12-26 Nec Corporation Preprocessor for moving picture encoding
US5832121A (en) * 1994-09-27 1998-11-03 Sony Corporation Method and apparatus for video data compression
US5883672A (en) * 1994-09-29 1999-03-16 Sony Corporation Apparatus and method for adaptively encoding pictures in accordance with information quantity of respective pictures and inter-picture correlation
US5838872A (en) * 1995-03-20 1998-11-17 Matsushita Electric Industrial Co., Ltd. Image information recording apparatus and image information recording method
US5825927A (en) * 1996-01-16 1998-10-20 Hitachi America, Ltd. Methods and apparatus for encoding video data in a manner that is well suited for decoding by regular or downconverting decoders

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2864865A1 (en) * 2004-01-07 2005-07-08 Thomson Licensing Sa Video image sequence coding method for hybrid type video compression, involves coding entity of image based on rate of potential utilization of image entity calculated for forward and backward predictive coding of other two images
WO2005071972A1 (en) * 2004-01-07 2005-08-04 Thomson Licensing S.A. Method for coding an image sequence
US7983339B2 (en) 2004-01-07 2011-07-19 Thomson Licensing Method for coding an image sequence
EP1566971A2 (en) * 2004-02-20 2005-08-24 Seiko Epson Corporation Video codec system with real-time complexity adaptation and region-of-interest coding
EP1566971A3 (en) * 2004-02-20 2006-09-13 Seiko Epson Corporation Video codec system with real-time complexity adaptation and region-of-interest coding
WO2005088981A1 (en) * 2004-03-11 2005-09-22 Canon Kabushiki Kaisha Encoding apparatus, encoding method, decoding apparatus, and decoding method
US8064518B2 (en) 2004-03-11 2011-11-22 Canon Kabushiki Kaisha Encoding apparatus, encoding method, decoding apparatus, and decoding method
WO2005096633A1 (en) * 2004-03-31 2005-10-13 Koninklijke Philips Electronics N.V. Video processing method and corresponding encoding device

Similar Documents

Publication Publication Date Title
Tsekeridou et al. MPEG-2 error concealment based on block-matching principles
US6233278B1 (en) Apparatus and method for using side information to improve a coding system
US6067322A (en) Half pixel motion estimation in motion video signal encoding
US6438168B2 (en) Bandwidth scaling of a compressed video stream
US6118817A (en) Digital video signal encoder and encoding method having adjustable quantization
US6222881B1 (en) Using numbers of non-zero quantized transform signals and signal differences to determine when to encode video signals using inter-frame or intra-frame encoding
US5614952A (en) Digital video decoder for decoding digital high definition and/or digital standard definition television signals
US6959044B1 (en) Dynamic GOP system and method for digital video encoding
US6081209A (en) Search system for use in compression
US6301304B1 (en) Architecture and method for inverse quantization of discrete cosine transform coefficients in MPEG decoders
US7324595B2 (en) Method and/or apparatus for reducing the complexity of non-reference frame encoding using selective reconstruction
US6618442B1 (en) Method and apparatus for transcoding digital video signals
US5719986A (en) Video signal encoding method
US8358701B2 (en) Switching decode resolution during video decoding
US5809173A (en) Method and apparatus for improved video decompression using previous frame DCT coefficients
US6005626A (en) Digital video signal encoder and encoding method
US5835147A (en) Method for compression and decompression of a video signal
US7023924B1 (en) Method of pausing an MPEG coded video stream
US6167088A (en) Method and apparatus for performing adaptive encoding rate control of a video information stream including 3:2 pull-down video information
US6473558B1 (en) System and method for MPEG reverse play through dynamic assignment of anchor frames
US6301428B1 (en) Compressed video editor with transition buffer matcher
US6587509B1 (en) Reducing undesirable effects of an emphasis processing operation performed on a moving image by adding a noise signal to a decoded uncompressed signal
US6765963B2 (en) Video decoder architecture and method for using same
US20030185303A1 (en) Macroblock coding technique with biasing towards skip macroblock coding
US6404817B1 (en) MPEG video decoder having robust error detection and concealment

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CU CZ DE DK DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase in:

Ref country code: JP