CN1620821A - Image information coding device and method and image information decoding device and method - Google Patents

Image information coding device and method and image information decoding device and method Download PDF

Info

Publication number
CN1620821A
CN1620821A CNA038026279A CN03802627A CN1620821A CN 1620821 A CN1620821 A CN 1620821A CN A038026279 A CNA038026279 A CN A038026279A CN 03802627 A CN03802627 A CN 03802627A CN 1620821 A CN1620821 A CN 1620821A
Authority
CN
China
Prior art keywords
motion prediction
predictive coded
interframe
image
compensation deals
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA038026279A
Other languages
Chinese (zh)
Other versions
CN100574448C (en
Inventor
佐藤数史
铃木辉彦
矢崎阳一
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN1620821A publication Critical patent/CN1620821A/en
Application granted granted Critical
Publication of CN100574448C publication Critical patent/CN100574448C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136—Incoming video signal characteristics or properties
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/523—Motion estimation or motion compensation with sub-pixel accuracy
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/117—Filters, e.g. for pre-processing or post-processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51—Motion estimation or motion compensation
    • H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/80—Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

The present invention is directed to an image information encoding apparatus (10) used, in receiving compressed image information through network media, when processing of such compressed image information is performed on storage media. A picture sorting buffer (12) delivers information of picture type of frame Picture_type to a picture type discrimination unit (22). The picture type discrimination unit (22) transmits command to a motion prediction/compensation unit (21) on the basis of that information. The motion prediction/compensation unit (21) generates predictive picture by using filter coefficients having the number of taps lesser than that of P picture with respect to B picture for which operation quantity and the number of memory accesses are required to more degree as compared to, e.g., P picture on the basis of that command.

Description

Image information encoding device and image information encoding method, image information decoding device and picture information decoding method
Technical field
The present invention relates to image information encoding device and method thereof, image information decoding device and method thereof and program, via receiving such as network medias such as satellite broadcasting, cable TV and/or internets or to handling, by using in the image information of compressing such as orthogonal transform such as discrete transform or Karnen-Loeve conversion and such as MPEG (Motion Picture Experts Group), H.26x motion compensation (bit information) such as mediums such as CD, disk or flash memories.
The application requires the priority of the Japanese patent application submitted on January 23rd, 2002 2002-014888 number, and it all is incorporated herein by reference.
Background technology
In the last few years, in the message pick-up of the distribution of information (transmission) in broadcasting station etc. and general family, meeting such as Image Information Processing wherein is that the device of the mpeg system of digital information has obtained popularizing, in this case, by such as the orthogonal transform of discrete cosine transform etc. and use the motion compensation of the distinctive redundancy of image information to come image information is compressed, effective information sends and/or storage thereby carry out.
Especially, MPEG2 (ISO/IEC 13818-2) is defined as the image encoding system of general objects, and at present cover or comprise interlacing scan and line by line scan and the standard of standard-resolution image and high-definition image under be widely used in the application of professional application target and ordinary consumption application target.By using the MPEG2 compressibility, for example, under the situation of progressive scanning picture with 720 * 480 pixel standard resolutions, distribute 4 to 8Mbps encoding amount (bit rate), and under the situation of progressive scanning picture with 1920 * 1088 pixel high-resolutions, distribute 18 to 22Mbps encoding amount (bit rate), thereby can realize high compression rate and satisfied picture quality.
MPEG2 is primarily aimed at the high image quality coding that is applicable to broadcasting, is lower than MPEG1, the i.e. encoding amount of the coded system of high compression rate (bit rate) more but do not satisfy.But,, strong further in the future to the demand of this kind coded system along with popularizing of portable terminal device.Corresponding, the standard of execution MPEG4 coded system.About this image encoding system, its standard is confirmed to be international standard ISO/IEC 14496-2 in December, 1998.
In addition, in recent years, primary goal is used for video conference image encoding standard H.26L (ITU-T Q6/16 VCEG) develop.In H.26L, compare with traditional MPEG2 or the coded system of MPEG4, although need a large amount of operation amounts during coding/decoding, realized higher code efficiency.In addition, as the part of MPEG4 activity, wherein H.26L H.26L unsupported function also is defined as strengthening compressed video coding conjunctive model (Joint Model of Enhanced-Compression VideoCoding) as its basic standard with this at present.
In addition, in H.26L,, the motion prediction/compensation based on variable-block has been proposed as one of basic fundamental that realizes high coding efficiency.Under existing situation, 7 kinds of prediction/compensation block sizes have as shown in Figure 1 been determined.
And, in H.26L, stipulated high-precision motion prediction/compensation deals such as 1/4 pixel precision or 1/8 pixel precision.In the following description, with at first account for motion prediction/compensation deals.
Motion prediction/the compensation deals of 1/4 pixel precision of determining in H.26L are shown in Fig. 2.When generating the predicted picture of 1/4 pixel precision, at first use the FIR filter that has 6 taps (tap) in the horizontal and vertical directions respectively to generate the pixel value of 1/2 pixel precision according to being stored in pixel value in the frame memory.Here, as the coefficient of FIR filter, determine coefficient with following formula (1) expression.
{1，-5，20，20，-5，1}/32 ...(1)
In addition, generate the predicted picture of 1/4 pixel precision by linear interpolation according to the predicted picture of 1/2 pixel precision that is generated.
In addition, in H.26L,, stipulated the bank of filters shown in the following formula (2) in order to carry out the motion prediction/compensation of 1/8 pixel precision.
1∶1
1/8：{-3，12，-37，485，71，-21，6，-1}/512
2/8：{-3，12，-37，229，71，-21，6，-1}/256
3/8：{-6，24，-76，387，229，-60，18，-4}/512
4/8：{-3，12，-39，158，158，-39，12，-3}/256 ...(2)
5/8：{-4，18，-60，229，387，-76，24，-6}/512
6/8：{-1，6，-21，71，229，-37，12，-3}/256
7/8：{-1，6，-21，71，485，-37，12，-3}/512
Should be noted that in compressed image information, the precision of motion vector is by movement relation (MotionRelation) fields specify among the RTP (RTP).
As mentioned above, existing H.26L in, regulation is used pre-determined motion prediction/compensation deals as formula (1) or (2) determined filter.In addition, as at " AdaptiveInterpolation Filter for Motion Compensated Hybrid Video Coding " T.Wedi, described in the 49th～52 page of the Picture Coding Symposium 2001 (below be called document 1), also consider to use sef-adapting filter at present corresponding to input picture.
Specifically, in document 1, the adaptive optimization that is used for the motion prediction compensation deals as described below has been proposed.That is to say, at first,, use pre-determined filter to determine to make the motion vector d (k) of predicated error minimum in the first step.Then, in second step, determine filter coefficient H (k) at the motion vector d (k) that in the first step, determines, so that the predicated error minimum.By filter coefficient H (k) and the motion vector d (k) that determines in this kind mode, carry out motion compensation process.According to document 1, in the l-G simulation test of the cycle tests " Mobile2 andForeman " that uses the CIF size, compare with the situation of using pre-determined filter according to above-mentioned technology, can obtain the coding gain of 1.0 to the 1.5dB orders of magnitude.
Here, in H.26L, be similar to MPEG2, also comprise the regulation that relates to the B image.In H.26L, use the bi-directional predicted method of B image to be shown in Fig. 3.As shown in Figure 3, B 2Image and B 3Image uses I 1Image and P 4Image is as benchmark image, and B 5Image and B 6Image uses P 4Image and P 7Image is as benchmark image.
In addition, in compressed image information, the use of each image is defined as shown in Figure 4 by the PTYPE in the image head.As shown in Figure 4, when the value of coded number is 0 or 1, specifies and use the P image.When the value of coded number is 2, specifies and use the I image.When the value of coded number is 3 or 4, specifies and use the B image.In this case, when the value of coded number is 0, only uses the image in front that is right after to be used for prediction, and when the value of coded number is 1, use several images of front to be used for prediction.In addition, when the value of coded number is 3, uses image in front that is right after and the image in back that is right after to be used for prediction, and when the value of coded number is 4, use several images of front and back to be used for prediction.As mentioned above, be similar to the P image, in the B image, also can use multi-frame prediction.
In addition, in H.26L, use the B image to realize the scalability of time.That is to say, owing to do not exist the B image, can abrogate the B image and do not carry out its encoding process as the possibility of reference range.
In addition, in the B image, 5 kinds of predictive modes have been stipulated: direct predictive mode, forward prediction mode, back forecast pattern, bi-predictive mode and inner estimation mode.It should also be noted that, although directly predictive mode and bi-predictive mode all are bi-directional predicted, but there are differences between them, to kind using different motion vector informations, directly the motion vector information of predictive mode then is to read in the corresponding macro block from the subsequent prediction frame in the forward direction of bi-predictive mode and back.
The macro block (mb) type at the B image (MB_Type) of regulation is shown in Figure 5 in H.26L.Here, in Fig. 5, with forward direction (Forward) expression forward direction type in the corresponding type of prediction separately of the Code_number hurdle, the back represents that to (Backward) back is to type, two-way (Bi-directional) represents bi-directional type, the interior interior type of (Intra) presentation video (frame), the size of prediction piece is as shown in Figure 1 represented in the description such as " 16 * 16 " subsequently.In addition, " X " append to intra_pred_mode, Ref_frame, Blk_size, MVDFW, MVDBW separately the information in the hurdle define at corresponding type of prediction.For example, MVDFW and MVDBW represent forward motion vector information and reverse vector information respectively.In addition, at the information of field block size Blk_size in the two-way mode, the regulation as shown in Figure 6 Code_number and the relation between the block size.
But, in mode shown in Figure 3, in the B image, use bi-directional predictedly, can realize higher code efficiency thereby compare, but compare operation amount and the memory access that but needs flood tide with the I/P image with the I/P image.
Especially using under the situation of system H.26L, handle owing in prediction/compensation deals, carry out 6 taps of use formula (1) or (2) expression or the interpolation of 8 tap filters, therefore compare the problem that its operation amount of existence and memory accesses become magnanimity with the situation of using the MPEG2 system.
Summary of the invention
Consider that above-mentioned practical situation has proposed the present invention, its objective is provides a kind of image information encoding device and method, image information decoding device and method thereof and program, can reduce operation amount and memory accesses in motion prediction/compensation deals of carrying out at the B image.
Image information encoding device according to the present invention is a kind of image information encoding device, be used for by orthogonal transform and the motion prediction/compensation deals that wherein can select multiple different pixels precision comprising in-frame encoding picture at least, interframe forward predictive coded image, and the received image signal of interframe bidirectionally predictive coded picture is encoded, so that generation compressed image information, described image information encoding device comprises: motion prediction/compensating unit is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
Here, motion prediction/compensating unit is selected to compare a lot of interpolating method of operation amount and number of memory accesses minimizing as the interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
Also comprise image type discriminating parts according to image information encoding device of the present invention, be used to differentiate the image type of received image signal, wherein image type differentiates that parts will send to motion prediction/compensating unit with interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture according to the identification result of image type, so that control described order.
This image information encoding device is differentiated the image type of received image signal, so that reduce a lot of interpolating methods according to compare operation amount and number of memory accesses with interframe forward predictive coded image, carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, thereby reduce operation amount and memory accesses in motion prediction/compensation deals.
Image information encoding method according to the present invention is a kind of image information encoding method, be used for by orthogonal transform and the motion prediction/compensation deals that wherein can select multiple different pixels precision comprising in-frame encoding picture at least, interframe forward predictive coded image, and the received image signal of interframe bidirectionally predictive coded picture is encoded, so that generation compressed image information, described image information encoding method comprises: motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
Here, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
Also comprise image type discriminating step according to image information encoding method of the present invention, be used to differentiate the image type of received image signal, wherein, differentiate in the step at image type, carry out transmission with interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture according to the identification result of image type, so that be controlled at the processing in motion prediction/compensation process.
In this image information encoding method, differentiate the image type of received image signal, so that reduce a lot of interpolating methods according to compare operation amount and number of memory accesses with interframe forward predictive coded image, carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, thereby reduce operation amount and memory accesses in motion prediction/compensation deals.
Program according to the present invention is a kind of program that makes computer carry out following processing, promptly, by orthogonal transform and the motion prediction/compensation deals that wherein can select multiple different pixels precision to comprising in-frame encoding picture at least, interframe forward predictive coded image, and the received image signal of interframe bidirectionally predictive coded picture is encoded, so that generation compressed image information, described program comprises: motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
Here, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
Also comprise image type discriminating step according to program of the present invention, be used to differentiate the image type of received image signal, wherein, differentiate in the step at image type, carry out transmission with interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture according to the identification result of image type, so that be controlled at the processing in motion prediction/compensation process.
This program makes computer differentiate the image type of received image signal, so that reduce a lot of interpolating methods according to compare operation amount and number of memory accesses with interframe forward predictive coded image, carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, thereby reduce operation amount and memory accesses in motion prediction/compensation deals.
Image information decoding device according to the present invention is a kind of image information decoding device, be used for comprising in-frame encoding picture at least to what generate at image information encoding device by inverse orthogonal transformation and the motion prediction/compensation deals that wherein can select multiple different pixels precision, interframe forward predictive coded image, and the compressed image information of interframe bidirectionally predictive coded picture is decoded, described image information decoding device comprises: motion prediction/compensating unit is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
Here, motion prediction/compensating unit is selected to compare a lot of interpolating method of operation amount and number of memory accesses minimizing as the interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
Also comprise image type discriminating parts according to image information decoding device of the present invention, be used to differentiate the image type of compressed image information, wherein image type differentiates that parts are carried out according to the identification result of image type and the transmission of interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture, so that the processing in the controlled motion prediction/compensating unit.
This image information decoding device is differentiated the image type of the compressed image information that generates in image information encoding device, so that reduce a lot of interpolating methods according to compare operation amount and number of memory accesses with interframe forward predictive coded image, carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, thereby reduce operation amount and memory accesses in motion prediction/compensation deals.
Picture information decoding method according to the present invention is a kind of picture information decoding method, be used for by inverse orthogonal transformation and wherein can select the motion prediction/compensation deals of multiple different pixels precision that the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least decoded, described picture information decoding method comprises: motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
Here, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
Also comprise image type discriminating step according to picture information decoding method of the present invention, be used to differentiate the image type of compressed image information, wherein, differentiate in the step at image type, according to the identification result execution of image type and the transmission of interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture, so that the processing in the controlled motion prediction/compensation process.
In this picture information decoding method, the image type of the compressed image information that discriminating generates in image information encoding device, so that reduce a lot of interpolating methods according to compare operation amount and number of memory accesses with interframe forward predictive coded image, carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, thereby reduce operation amount and memory accesses in motion prediction/compensation deals.
Program according to the present invention is a kind of program that makes computer carry out following processing, promptly, by inverse orthogonal transformation with wherein can select the motion prediction/compensation deals of multiple different pixels precision that the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least decoded, described program comprises: motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
Here, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
Also comprise image type discriminating step according to program of the present invention, be used to differentiate the image type of compressed image information, wherein, differentiate in the step at image type, according to the identification result execution of image type and the transmission of interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture, so that the processing in the controlled motion prediction/compensation process.
This program makes computer differentiate the image type of the compressed image information that generates in image information encoding device, so that reduce a lot of interpolating methods according to compare operation amount and number of memory accesses with interframe forward predictive coded image, carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, thereby reduce operation amount and memory accesses in motion prediction/compensation deals.
By below in conjunction with the detailed description of accompanying drawing to embodiment, other purpose of the present invention and will become clearer by the obtainable real advantage of the present invention.
Description of drawings
Fig. 1 is the figure that is used for illustrating in the variable-block size of motion prediction/compensation block of H.26L determining.
Fig. 2 is the figure that is used for illustrating in the motion prediction/compensation deals of 1/4 pixel precision of H.26L determining.
Fig. 3 is the figure that is used for illustrating H.26L using the bi-directional predicted method of B image.
Fig. 4 is the figure that is used for illustrating at H.26L PTYPE.
Fig. 5 is the figure that is used for illustrating at the macro block (mb) type of H.26L determining at the B image.
Fig. 6 is the figure that is used for illustrating at the coded number (Code_number) of the automatic Blk_size of bi-predictive mode.
Fig. 7 is the block diagram that is used to illustrate according to the structured flowchart of the image information encoding device of first embodiment of the invention.
Fig. 8 is the block diagram that is used to illustrate according to the structured flowchart of the image information decoding device of first embodiment of the invention.
Fig. 9 is the block diagram that is used to illustrate according to the structured flowchart of the image information encoding device of second embodiment of the invention.
Figure 10 is the block diagram that is used to illustrate according to the structured flowchart of the image information decoding device of second embodiment of the invention.
Embodiment
Describe application specific embodiments of the present invention in detail below in conjunction with accompanying drawing.In these embodiments, the present invention is applied to suitable received image signal is transformed to the piece that for example meets system H.26L so that carry out based on the orthogonal transform of this piece it is quantized, thereby generate the image information encoding device of compressed image information, and the described compressed image information of suitable re-quantization to be carrying out inverse orthogonal transformation, thus the image information decoding device of this image information of decoding.
In the image information encoding device and image information decoding device that will describe below, carry out therein in the motion prediction/compensation deals of the interframe forward predictive coded image (hereinafter being called the P image) of interframe encode and interframe bidirectionally predictive coded picture (hereinafter being called the B image), the P image is used different interpolating methods with the B image, thereby can reduce necessary operation amount and memory accesses.
At first, the structured flowchart of using image information encoding device of the present invention is shown in Fig. 7.As shown in Figure 7, the image information encoding device 10 among this embodiment comprises A/D converting unit 11, image classification buffer 12, adder 13, orthogonal transform unit 14, quantifying unit 15, reversible encoding unit 16, storage buffer 17, inverse quantization unit 18, inverse orthogonal transformation unit 19, frame memory 20, motion prediction/compensating unit 21, image type discriminating unit 22 and ratio control unit 23.
In Fig. 7, A/D converting unit 11 is converted to digital signal with the picture signal of input.In addition, image classification buffer 12 is carried out frame classification according to GOP (image sets) structure of the compressed image information of exporting from this image information encoding device 10.Here, for the in-frame encoding picture (hereinafter being called the I image) of carrying out intraframe coding, image classification buffer 12 sends the image information of entire frame to orthogonal transform unit 14.14 pairs of image informations of orthogonal transform unit are carried out the orthogonal transform such as discrete cosine transform or Karhunen-Loeve conversion etc., conversion coefficient is sent to quantifying unit 15.
15 pairs of conversion coefficients that transmit from orthogonal transform unit 14 of quantifying unit are carried out quantification treatment.
The 16 pairs of quantized transform coefficients in reversible encoding unit are carried out the reversible encoding such as variable length code or arithmetic coding etc., send the conversion coefficient of encoding to storage buffer 17 and store.The conversion coefficient of coding is output as compressed image information.
The behavior of quantifying unit 15 is by 23 controls of ratio control unit.In addition, quantifying unit 15 sends quantized transform coefficients to inverse quantization unit 18.Inverse quantization unit 18 is carried out re-quantization to these conversion coefficients.
The conversion coefficient of 19 pairs of re-quantizations of inverse orthogonal transformation unit is carried out inverse orthogonal transformation and is handled, and generating the image information of decoding, and this information is sent to frame memory 20 stores.
On the other hand, for P image and the B image of carrying out interframe encode, image classification buffer 12 is sent to motion prediction/compensating unit 21 with image information.In addition, image classification buffer 12 sends the image type information Picture_type of frame to image type discriminating unit 22.Image type discriminating unit 22 sends order to motion prediction/compensating unit 21 according to this information.
At this moment, motion prediction/compensating unit 21 takes out related image information from frame memory 20, according to the order that sends from image type discriminating unit 22, that uses description hereinafter carries out motion prediction/compensation deals for the P image interpolating method different with the B image, to generate benchmark image information.
Motion prediction/compensating unit 21 sends this benchmark image information to adder 13.Adder 13 converts this benchmark image information between this benchmark image information and the described image information difference signal.In addition, meanwhile, motion prediction/compensating unit 21 sends motion vector information to reversible encoding unit 16.
16 pairs of these motion vector informations in reversible encoding unit are carried out such as the reversible encoding of variable length code or arithmetic coding etc. and are handled, to form the information of the head part of inserting compressed image information.Should be noted that, because other processing is similar to the processing in the situation of the compressed image information of carrying out intraframe coding, so omit its detailed description.
Then, the structured flowchart of using image information decoding device of the present invention is shown in Fig. 8.As shown in Figure 8, the image information decoding device 30 among this embodiment comprises storage buffer 31, reversible decoding unit 32, inverse quantization unit 33, inverse orthogonal transformation unit 34, adder 35, image classification buffer 36, D/A converting unit 37, motion prediction/compensating unit 38, frame memory 39 and image type discriminating unit 40.
In Fig. 8, the compressed image information that storage buffer 31 interim storages are imported sends reversible decoding unit 32 afterwards to.
Reversible decoding unit 32 is carried out processing such as length-changeable decoding or arithmetic decoding etc. according to the compressed image information formula that fixes really to compressed image information, sends quantized transform coefficients to inverse quantization unit 33.At corresponding frame is under the situation of P image or B image, and reversible decoding unit 32 is the motion vector information of decode stored in the head part of compressed image information also, sends this information to motion prediction/compensating unit 38.In addition, reversible decoding unit 32 sends image type information Picture_type to image type discriminating unit 40.Image type discriminating unit 40 sends order to motion prediction/compensating unit 38 according to this information.
The quantized transform coefficients that inverse quantization unit 33 re-quantizations transmit from reversible decoding unit 32 is to send conversion coefficient to inverse orthogonal transformation unit 34.Inverse orthogonal transformation unit 34 is carried out inverse orthogonal transformation such as inverse discrete cosine transform or contrary Karhunen-Loeve conversion etc. according to the compressed image information formula that fixes really to conversion coefficient.
Here, be under the situation of I image at corresponding image, inverse orthogonal transformation unit 34 sends the image information of inverse orthogonal transformation to image classification buffer 36.Image classification buffer 36 interim these image informations of storage send D/A converting unit 37 afterwards to.37 pairs of image informations of D/A converting unit carry out the D/A conversion process so that output.
On the other hand, at corresponding frame is under the situation of P image or B image, motion prediction/compensating unit 38 takes out related image information from frame memory 39, according to order that sends from image type discriminating unit 40 and reversible decoding moving vector information, that uses hereinafter description carries out motion prediction/compensation deals for the P image interpolating method different with the B image, to generate benchmark image information.Synthetic these benchmark image informations of adder 35 and from the output of inverse orthogonal transformation unit 34.Should be noted that,, therefore omit its detailed description because other processing is similar to the processing of intraframe coding.
As mentioned above, according to image information encoding device 10 of the present invention and image information decoding device 30 according to the order that sends from image type discriminating unit 22,40, in motion prediction/compensating unit 21,38, carry out motion prediction/compensation deals for the P image interpolating method different, thereby reduce necessary operation amount and memory accesses with the B image by using.
In view of this, will be described in motion prediction/compensation in motion prediction/compensating unit 21,38 below.Owing in motion prediction/compensating unit 21 and motion prediction/compensating unit 38, carry out similarly processing, the processing in motion prediction/compensating unit 21 will only be described below.
In motion prediction/compensating unit 21, store information about two filter coefficients that are used for P image and B image.Motion prediction/compensating unit 21 is carried out different motion prediction/compensation deals to the P image with the B image by first method or second method that describe below.
At first, in first method, to the motion prediction/compensation deals of P image and B image execution same pixel precision.In this case, compare, the B image is used filter with lesser amt tap with the P image.
Particularly, in that the two is all carried out under the situation of the motion prediction/compensation deals of 1/8 pixel precision at P image and B image, use the filter coefficient of 8 taps shown in the following formula (3) for the P image, and generate the predicted picture of 1/8 pixel precision for the B image by linear interpolation.
1∶1
1/8：{-3，12，-37，485，71，-21，6，-1}/512
2/8：{-3，12，-37，229，71，-21，6，-1}/256
3/8：{-6，24，-76，387，229，-60，18，-4}/512
4/8：{-3，12，-39，158，158，-39，12，-3}/256 ...(3)
5/8：{-4，18，-60，229，387，-76，24，-6}/512
6/8：{-1，6，-21，71，229，-37，12，-3}/256
7/8：{-1，6，-21，71，485，-37，12，-3}/512
In addition, in that the two is all carried out under the situation of the motion prediction/compensation deals of 1/4 pixel precision at P image and B image, for the filter coefficient of P image, generate the predicted picture of 1/4 pixel precision at 8 taps shown in each phase (phase) use following formula (4).On the other hand, for the B image, use the filter coefficient of 6 taps shown in the following formula (5) to generate the predicted picture of 1/2 pixel precision, and generate the predicted picture of 1/4 pixel precision by linear interpolation.
1/4：{-3，12，-37，229，71，-21，6，-1}/256
2/4：{-3，12，-39，158，158，-39，12，-3}/256 ...(4)
3/4：{-1，6，-21，71，229，-37，12，-3}/256
{1，-5，20，20，-5，1}/32 ...(5)
Should be noted that,, can generate the predicted picture of 1/4 pixel precision, to carry out motion prediction/compensation deals by linear interpolation for the B image.
In addition,, also can use the filter coefficient of 6 taps shown in the formula (5) to generate the predicted picture of 1/2 pixel precision, generate the predicted picture of 1/4 pixel precision afterwards by linear interpolation for the P image.For the B image, can generate the predicted picture of 1/4 pixel precision by linear interpolation, to carry out motion prediction/compensation deals.
Then, in second method, compare, the P image is carried out more high-precision motion prediction/compensation deals with the B image.
Particularly, for the P image, use the filter coefficient of 8 taps shown in the above-mentioned formula (3) to generate the predicted picture of 1/8 pixel precision, to carry out motion prediction/compensation deals.On the other hand,, use the filter coefficient of 6 taps shown in the above-mentioned formula (5) to generate the predicted picture of 1/2 pixel precision, generate the predicted picture of 1/4 pixel precision afterwards by linear interpolation, to carry out motion prediction/compensation deals for the B image.Should be noted that,, can generate the predicted picture of 1/4 pixel precision or the predicted picture of 1/2 pixel precision, to carry out motion prediction/compensation deals by linear interpolation for the B image.
In addition,, also can use the filter coefficient of 6 taps shown in the formula (5) to generate the predicted picture of 1/2 pixel precision, generate the predicted picture of 1/4 pixel precision afterwards by linear interpolation for the P image.For the B image, can generate the predicted picture of 1/2 pixel precision by linear interpolation, to carry out motion prediction/compensation deals.
Below, be shown in Fig. 9 according to another example of image information encoding device 50 of the present invention.Image information encoding device 50 shown in Figure 9 has the basic structure that is similar to image information encoding device shown in Figure 7 10.In this example, image information encoding device 50 is characterised in that and comprises motion prediction/compensating unit (fixedly filtering) 51 and motion prediction/compensating unit (adaptive-filtering) 52 wherein use which filter to switch selection by switch unit 54 bases from the order of image type discriminating unit 53.That is to say, the image information encoding device 10 of image information encoding device 50 and above-mentioned first embodiment is similar to comprise that single motion prediction/compensating unit 21 is as its assembly, also comprise as current 52 two parts of motion prediction/compensating unit (adaptive-filtering) that do not have filter coefficient at P image and B image of mentioning in the document 1 of prescribed motion prediction/compensating unit (fixedly filtering) 51 and description in front in H.26L as its assembly, thereby use in the filter any one according to P image or B image.
In addition, image information decoding device 70 shown in Figure 10 has and image information decoding device shown in Figure 8 30 essentially identical structures, and it is characterized in that comprising motion prediction/compensating unit (fixedly filtering) 71 and motion prediction/compensating unit (adaptive-filtering) 72, wherein use in these filters which by switch unit 74 according to switching from the order of image type discriminating unit 73.
Correspondingly and since identical reference number distribute to respectively with previous Fig. 7 and image information encoding device 10 shown in Figure 8 and image information decoding device 30 in similar parts, therefore omit its detailed description.
In image information encoding device shown in Figure 9 50, image classification buffer 12 sends the image type information Picture_type of frame to image type discriminating unit 53.Image type discriminating unit 53 sends order to switch unit 54 according to this information.
That is to say, be under the situation of B image in respective frame, and switch unit 54 switches to a one side among the figure according to mentioned order.Thus, use motion prediction/compensating unit (fixedly filtering) 51 to carry out the fixedly motion prediction/compensation deals of filtering.
On the other hand, be under the situation of P image in respective frame, switch unit 54 switches to b one side among the figure according to mentioned order.Thus, use motion prediction/compensating unit (adaptive-filtering) 52 to carry out the motion prediction/compensation deals of adaptive-filtering.Specifically, in the first step, use pre-determined filter to determine to make the motion vector d (k) of predicated error minimum.Then, in second step,, determine to make the filter coefficient H (k) of predicated error minimum at the motion vector d (k) that determines in the first step.Then, carry out motion compensation process according to filter coefficient H (k) that determines by this way and motion vector d (k).The information relevant with filter coefficient sends with the state in the embedded images compressed information.In this case, can in reversible encoding unit 16, carry out the variable length code processing or arithmetic coding handles the compressed information amount, thereby with in the described information embedded images compressed information.
Should be noted that, the pixel precision of the pixel precision of P image and B image can be mutually the same in the motion prediction/compensation deals of motion prediction/compensating unit (fixedly filtering) 51 or motion prediction/compensating unit (adaptive-filtering) 52, and compare with the B image, can carry out the motion prediction/compensation deals of higher pixel precision the P image.The transmission of pixel precision information is carried out with the state in Motion Resolution rate (MotionResolution) field that embeds RIP (RTP) layer in the compressed image information that will export.
In image information decoding device shown in Figure 10 70, reversible decoding unit 32 sends the image type information Picture_type of frame to image type discriminating unit 73.Image type discriminating unit 73 sends order to switch unit 74 according to this information.
That is to say, be under the situation of B image in respective frame, and switch unit 74 switches to c one side among the figure according to mentioned order.Thus, prediction mode information and motion vector information send motion prediction/compensating unit (fixedly filtering) 71 to.As a result, pass through fixedly filtering according to these information and carry out motion prediction/compensation deals.
On the other hand, be under the situation of P image in respective frame, switch unit 74 switches to d one side among the figure according to mentioned order.Thus, relevant with filter coefficient information sends motion prediction/compensating unit (adaptive-filtering) 72 to prediction mode information and motion vector information.As a result, carry out motion prediction/compensation deals according to these information by adaptive-filtering.
In this example, motion prediction/compensation deals are carried out by motion prediction/compensating unit (fixedly filtering) 71 or motion prediction/compensating unit (adaptive-filtering) 72 according to the pixel precision in the MotionResolution field that is embedded in RTP layer in the compressed image information.
As above described with reference to first and second embodiments, carry out motion prediction/compensation deals according to different interpolating methods at the P image respectively with the B image, thereby need the B image of a large amount of operation amounts and memory accesses can reduce its operation amount and memory accesses for comparing, meanwhile suppress deterioration of image as far as possible with the P image.
Should be noted that the present invention is not limited only to above-described execution mode, under the situation that does not break away from spirit of the present invention and scope, certainly it is carried out various variants and modifications.
For example, though in the superincumbent embodiment with the formal description of hardware configuration the present invention, but the present invention should not be so limited, can certainly by make CPU (CPU) respectively the processing in carries out image information coding device 10,50 and the image information decoding device 30,70 realize.
It should also be noted that, though describe the preferred implementation of the present invention shown in the accompanying drawing in the superincumbent explanation in detail, but will be understood by those skilled in the art that, under the situation that does not break away from spirit of the present invention defined in the appended claims and scope, can carry out various modification to it, replace structure or equivalent processes.
Industrial Applicability A
As mentioned above, according to image information encoding device of the present invention and image information encoding method, Differentiate the image type of received image signal, so that according to comparing with interframe forward predictive coded image Operation amount and number of memory accesses reduce a lot of interpolating methods, for the bi-directional predicted volume of interframe The code image is carried out motion prediction/compensation deals, thereby can reduce in motion prediction/compensation deals Operation amount and memory accesses.
In addition, use so that computer is differentiated the image class of received image signal according to program according to the present invention Type is so that according to comparing operation amount and number of memory accesses with interframe forward predictive coded image Reduce a lot of interpolating methods, carry out motion prediction/compensation for the interframe bidirectionally predictive coded picture Process, thereby operation amount and the memory access that can reduce in motion prediction/compensation deals are inferior Number.
According to image information decoding device of the present invention and picture information decoding method, differentiate at image The image type of the compressed image information that generates in the information coding device, so as according to the interframe forward direction Predictive-coded picture compares operation amount and number of memory accesses reduces a lot of interpolating methods, pin The interframe bidirectionally predictive coded picture is carried out motion prediction/compensation deals, thus the minimizing motion prediction/ Operation amount in the compensation deals and memory accesses.
In addition, another program according to the present invention is used so that computer is differentiated at image information coding dress The image type of the compressed image information that generates in putting, so as according to interframe forward predictive coded figure Operation amount compared by picture and number of memory accesses reduces a lot of interpolating methods, two-way for interframe Predictive-coded picture is carried out motion prediction/compensation deals, thereby reduces in motion prediction/compensation deals Operation amount and memory accesses.
Claims
(according to the modification of the 19th of treaty)
1. image information encoding device, be used for the received image signal that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture at least being encoded by orthogonal transform and motion prediction/compensation deals, so that the generation compressed image information, described image information encoding device comprises:
Motion prediction/compensating unit is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture;
Wherein, motion prediction/compensating unit is carried out motion prediction/compensation deals at interframe forward predictive coded image by using first filter, and has the second few filter of the tap of tapping ratio first filter or carry out motion prediction/compensation deals by linear interpolation by use at the interframe bidirectionally predictive coded picture.
2. image information encoding device according to claim 1,
Wherein, motion prediction/compensating unit is selected to compare a lot of interpolating method of operation amount and number of memory accesses minimizing as the interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
3. image information encoding device according to claim 1,
Wherein, motion prediction/compensating unit has the motion prediction/compensation deals of same pixel precision for interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
4. image information encoding device according to claim 1,
Wherein, motion prediction/compensating unit is selected the motion prediction/compensation deals of different pixels precision for interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
5. image information encoding device according to claim 1,
Wherein, motion prediction/compensating unit is used to carry out the motion prediction/compensation deals of 1/4 pixel precision, and handles at the interpolation that interframe forward predictive coded image uses 6 tap filter coefficients of following formula statement to carry out 1/2 pixel precision
{1，-5，20，20，-5，1}/32，
Handle with the interpolation of carrying out 1/4 pixel precision by linear interpolation according to the pixel that is generated.
6. image information encoding device according to claim 1,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision at the interframe bidirectionally predictive coded picture by linear interpolation.
7. image information encoding device according to claim 4,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision at interframe forward predictive coded image, and carries out the motion prediction/compensation deals of 1/2 pixel precision at the interframe bidirectionally predictive coded picture.
8. image information encoding device according to claim 4,
Wherein, the information relevant with the pixel precision of motion prediction/compensation deals is embedded in respectively in the MotionResolution field at RTP layer in the compressed image information of interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
9. image information encoding method, be used for the received image signal that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture at least being encoded by orthogonal transform and motion prediction/compensation deals, so that the generation compressed image information, described image information encoding method comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture;
Wherein, motion prediction/compensation process comprises: carry out motion prediction/compensation deals at interframe forward predictive coded image by using first filter, and have the second few filter of the tap of tapping ratio first filter or carry out motion prediction/compensation deals by linear interpolation by use at the interframe bidirectionally predictive coded picture.
10. program, be used to make computer to carry out following processing, promptly, by orthogonal transform and motion prediction/compensation deals the received image signal that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least encoded, so that the generation compressed image information, described program comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture;
Wherein, motion prediction/compensation process comprises: carry out motion prediction/compensation deals at interframe forward predictive coded image by using first filter, and have the second few filter of the tap of tapping ratio first filter or carry out motion prediction/compensation deals by linear interpolation by use at the interframe bidirectionally predictive coded picture.
11. image information decoding device, be used for by inverse orthogonal transformation and motion prediction/compensation deals the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture at least that generates at image information encoding device being decoded, described image information decoding device comprises:
Motion prediction/compensating unit is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture;
Wherein, motion prediction/compensating unit is carried out motion prediction/compensation deals at interframe forward predictive coded image by using first filter, and has the second few filter of the tap of tapping ratio first filter or carry out motion prediction/compensation deals by linear interpolation by use at the interframe bidirectionally predictive coded picture.
12. image information decoding device according to claim 11,
Wherein, motion prediction/compensating unit is selected to compare a lot of interpolating method of operation amount and number of memory accesses minimizing as the interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
13. image information decoding device according to claim 11,
Wherein, motion prediction/compensating unit has the motion prediction/compensation deals of mutually the same pixel precision for interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
14. image information decoding device according to claim 11,
Wherein, motion prediction/compensating unit is selected the motion prediction/compensation deals of different pixels precision for interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
15. image information decoding device according to claim 11,
Wherein, motion prediction/compensating unit is used to carry out the motion prediction/compensation deals of 1/4 pixel precision, and handles at the interpolation that interframe forward predictive coded image uses 6 tap filter coefficients of following formula statement to carry out 1/2 pixel precision
{1，-5，20，20，-5，1}/32，
Handle with the interpolation of carrying out 1/4 pixel precision by linear interpolation according to the pixel that is generated.
16. image information decoding device according to claim 11,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision at the interframe bidirectionally predictive coded picture by linear interpolation.
17. image information decoding device according to claim 14,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision at interframe forward predictive coded image, and carries out the motion prediction/compensation deals of 1/2 pixel precision at the interframe bidirectionally predictive coded picture.
18. image information decoding device according to claim 14,
Wherein, the information relevant with the pixel precision of motion prediction/compensation deals is embedded in respectively in the MotionResolution field at RTP layer in the compressed image information of interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
19. picture information decoding method, be used for by inverse orthogonal transformation and motion prediction/compensation deals the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture at least that generates at image information encoding device being decoded, described picture information decoding method comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture;
Wherein, motion prediction/compensation process comprises: carry out motion prediction/compensation deals at interframe forward predictive coded image by using first filter, and have the second few filter of the tap of tapping ratio first filter or carry out motion prediction/compensation deals by linear interpolation by use at the interframe bidirectionally predictive coded picture.
20. program, be used to make computer to carry out following processing, promptly, by inverse orthogonal transformation and motion prediction/compensation deals the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture at least that generates in image information encoding device is decoded, described program comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture;
Wherein, motion prediction/compensation process comprises: carry out motion prediction/compensation deals at interframe forward predictive coded image by using first filter, and have the second few filter of the tap of tapping ratio first filter or carry out motion prediction/compensation deals by linear interpolation by use at the interframe bidirectionally predictive coded picture.

Claims (86)

1. image information encoding device, be used for by orthogonal transform and wherein can select the motion prediction/compensation deals of multiple different pixels precision that the received image signal that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least encoded, so that the generation compressed image information, described image information encoding device comprises:
Motion prediction/compensating unit is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
2. image information encoding device according to claim 1,
Wherein, motion prediction/compensating unit is selected to compare a lot of interpolating method of operation amount and number of memory accesses minimizing as the interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
3. image information encoding device according to claim 1 also comprises image type discriminating parts, is used to differentiate the image type of received image signal;
Wherein, image type differentiates that parts will send to motion prediction/compensating unit with interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture according to the identification result of image type, so that control described order.
4. image information encoding device according to claim 3,
Wherein, motion prediction/compensating unit uses predetermined fixed filters to carry out motion prediction/compensation deals at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
5. image information encoding device according to claim 4,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
6. image information encoding device according to claim 5,
Wherein, motion prediction/compensating unit is used to carry out the motion prediction/compensation of 1/8 pixel precision, and uses 8 tap filter coefficients of following formula statement to carry out motion prediction/compensation deals at interframe forward predictive coded image:
1：1
1/8：{-3，12，-37，485，71，-21，6，-1}/512
2/8：{-3，12，-37，229，71，-21，6，-1}/256
3/8：{-6，24，-76，387，229，-60，18，-4}/512
4/8：{-3，12，-39，158，158，-39，12，-3}/256
5/8：{-4，18，-60，229，387，-76，24，-6}/512
6/8：{-1，6，-21，71，229，-37，12，-3}/256
7/8：{-1，6，-21，71，485，-37，12，-3}/512。
7. image information encoding device according to claim 6,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/8 pixel precision by linear interpolation at the interframe bidirectionally predictive coded picture.
8. image information encoding device according to claim 5,
Wherein, motion prediction/compensating unit is used to carry out the motion prediction/compensation of 1/4 pixel precision, and uses 8 tap filters of following formula statement to carry out motion prediction/compensation deals at interframe forward predictive coded image:
1：1
1/4：{-3，12，-37，229，71，-21，6，-1}/256
2/4：{-3，12，-39，158，158，-39，12，-3}/256
3/4：{-1，6，-21，71，229，-37，12，-3}/256。
9. image information encoding device according to claim 8,
Wherein, motion prediction/compensating unit uses 6 tap filter coefficients of following formula statement to carry out the motion prediction/compensation deals of 1/2 pixel precision at the interframe bidirectionally predictive coded picture,
{ 1 ,-5,20,20 ,-5, the motion prediction/compensation deals of 1/4 pixel precision are also carried out in 1}/32 by linear interpolation according to the pixel that is generated.
10. image information encoding device according to claim 8,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision by linear interpolation at the interframe bidirectionally predictive coded picture.
11. image information encoding device according to claim 5,
Wherein, motion prediction/compensating unit is used to carry out the motion prediction/compensation of 1/4 pixel precision, and uses 6 tap filter coefficients of following formula statement to carry out the motion prediction/compensation deals of 1/2 pixel precision at interframe forward predictive coded image,
{ 1 ,-5,20,20 ,-5,1}/32 are so that carry out the motion prediction/compensation deals of 1/4 pixel precision by linear interpolation according to the pixel that is generated.
12. image information encoding device according to claim 11,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision by linear interpolation at the interframe bidirectionally predictive coded picture.
13. image information encoding device according to claim 4,
Wherein, motion prediction/compensating unit makes pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than the pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
14. image information encoding device according to claim 13,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/8 pixel precision at interframe forward predictive coded image, and carries out the motion prediction/compensation deals of 1/4 pixel precision at the interframe bidirectionally predictive coded picture.
15. image information encoding device according to claim 14,
Wherein, motion prediction/compensating unit uses 8 tap filter coefficients of following formula statement to carry out motion prediction/compensation deals at interframe forward predictive coded image:
1：1
1/8：{-3，12，-37，485，71，-21，6，-1}/512
2/8：{-3，12，-37，229，71，-21，6，-1}/256
3/8：{-6，24，-76，387，229，-60，18，-4}/512
4/8：{-3，12，-39，158，158，-39，12，-3}/256
5/8：{-4，18，-60，229，387，-76，24，-6}/512
6/8：{-1，6，-21，71，229，-37，12，-3}/256
7/8：{-1，6，-21，71，485，-37，12，-3}/512。
16. image information encoding device according to claim 14,
Wherein, motion prediction/compensating unit uses 6 tap filter coefficients of following formula statement to carry out the motion prediction/compensation deals of 1/2 pixel precision at the interframe bidirectionally predictive coded picture,
{ 1 ,-5,20,20 ,-5, the motion prediction/compensation deals of 1/4 pixel precision are also carried out in 1}/32 by linear interpolation according to the pixel that is generated.
17. image information encoding device according to claim 14,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision by linear interpolation at the interframe bidirectionally predictive coded picture.
18. image information encoding device according to claim 13,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/8 pixel precision at interframe forward predictive coded image, and carries out the motion prediction/compensation deals of 1/2 pixel precision at the interframe bidirectionally predictive coded picture.
19. image information encoding device according to claim 18,
Wherein, motion prediction/compensating unit uses 8 tap filter coefficients of following formula statement to carry out motion prediction/compensation deals at interframe forward predictive coded image:
1：1
1/8：{-3，12，-37，485，71，-21，6，-1}/512
2/8：{-3，12，-37，229，71，-21，6，-1}/256
3/8：{-6，24，-76，387，229，-60，18，-4}/512
4/8：{-3，12，-39，158，158，-39，12，-3}/256
5/8：{-4，18，-60，229，387，-76，24，-6}/512
6/8：{-1，6，-21，71，229，-37，12，-3}/256
7/8：{-1，6，-21，71，485，-37，12，-3}/512。
20. image information encoding device according to claim 18,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/2 pixel precision by linear interpolation at the interframe bidirectionally predictive coded picture.
21. image information encoding device according to claim 13,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/4 pixel precision at interframe forward predictive coded image, and carries out the motion prediction/compensation deals of 1/2 pixel precision at the interframe bidirectionally predictive coded picture.
22. image information encoding device according to claim 21,
Wherein, motion prediction/compensating unit uses 6 tap filter coefficients of following formula statement to carry out the motion prediction/compensation deals of 1/2 pixel precision at the interframe bidirectionally predictive coded picture,
{ 1 ,-5,20,20 ,-5, the motion prediction/compensation deals of 1/4 pixel precision are also carried out in 1}/32 by linear interpolation according to the pixel that is generated.
23. image information encoding device according to claim 21,
Wherein, motion prediction/compensating unit is carried out the motion prediction/compensation deals of 1/2 pixel precision by linear interpolation at the interframe bidirectionally predictive coded picture.
24. image information encoding device according to claim 12,
Wherein, the information relevant with the pixel precision of motion prediction/compensation deals is embedded in respectively in the MotionResolution field at RTP layer in the compressed image information of interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
25. image information encoding device according to claim 3,
Wherein, motion prediction/compensating unit uses predetermined fixed filters to carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, and carries out motion prediction/compensation deals at use of interframe forward predictive coded image and the corresponding sef-adapting filter of input picture.
26. image information encoding device according to claim 25,
Wherein, motion prediction/compensating unit at first uses predetermined filter to determine to make the motion vector of predicated error minimum at interframe forward predictive coded image, determine to make the filter coefficient of predicated error minimum then at determined motion vector, and use described motion vector and filter coefficient to carry out motion prediction/compensation deals.
27. image information encoding device according to claim 26,
Wherein, be embedded in the compressed image information at the interframe forward predictive coded image information relevant with filter coefficient.
28. image information encoding device according to claim 27,
Wherein, relevant with filter coefficient information is embedded in the experience reversible encoding compressed image information afterwards.
29. image information encoding device according to claim 25,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
30. image information encoding device according to claim 25,
Wherein, motion prediction/compensating unit makes pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than the pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
31. image information encoding device according to claim 30,
Wherein, the information relevant with the pixel precision of motion prediction/compensation deals is embedded in respectively in the MotionResolution field at RTP layer in the compressed image information of interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
32. image information encoding method, be used for by orthogonal transform and wherein can select the motion prediction/compensation deals of multiple different pixels precision that the received image signal that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least encoded, so that the generation compressed image information, described image information encoding method comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
33. image information encoding method according to claim 32,
Wherein, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
34. image information encoding method according to claim 32 also comprises image type discriminating step, is used to differentiate the image type of received image signal;
Wherein, in image type is differentiated step, carry out transmission with interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture, so that be controlled at the processing in motion prediction/compensation process according to the identification result of image type.
35. image information encoding method according to claim 34,
Wherein, in motion prediction/compensation process, use predetermined fixed filters to carry out motion prediction/compensation deals at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
36. image information encoding method according to claim 35,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
37. image information encoding method according to claim 35,
Wherein, in motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
38. image information encoding method according to claim 34,
Wherein, in motion prediction/compensation process, use predetermined fixed filters to carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, and carry out motion prediction/compensation deals at use of interframe forward predictive coded image and the corresponding sef-adapting filter of input picture.
39. according to the described image information encoding method of claim 38,
Wherein, in motion prediction/compensation process, at first use predetermined filter to determine to make the motion vector of predicated error minimum at interframe forward predictive coded image, determine to make the filter coefficient of predicated error minimum then at determined motion vector, so that use described motion vector and filter coefficient to carry out motion prediction/compensation deals.
40. according to the described image information encoding method of claim 38,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
41. according to the described image information encoding method of claim 38,
Wherein, in motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
42. program, make computer carry out following processing, by orthogonal transform with wherein can select the motion prediction/compensation deals of multiple different pixels precision that the received image signal that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least encoded, so that the generation compressed image information, described program comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
43. according to the described program of claim 42,
Wherein, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
44. according to the described program of claim 42, also comprise image type discriminating step, be used to differentiate the image type of received image signal;
Wherein, in image type is differentiated step, carry out transmission with interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture, so that be controlled at the processing in motion prediction/compensation process according to the identification result of image type.
45. according to the described program of claim 44,
Wherein, use predetermined fixed filters to carry out motion prediction/compensation deals at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
46. according to the described program of claim 45,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
47. according to the described program of claim 45,
Wherein, in motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
48. according to the described program of claim 44,
Wherein, in motion prediction/compensation process, use predetermined fixed filters to carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, and carry out motion prediction/compensation deals at use of interframe forward predictive coded image and the corresponding sef-adapting filter of input picture.
49. according to the described program of claim 48,
Wherein, in motion prediction/compensation process, at first use predetermined filter to determine to make the motion vector of predicated error minimum at interframe forward predictive coded image, determine to make the filter coefficient of predicated error minimum then at determined motion vector, so that use described motion vector and filter coefficient to carry out motion prediction/compensation deals.
50. according to the described program of claim 48,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
51. according to the described program of claim 48,
Wherein, in motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
52. image information decoding device, be used for by inverse orthogonal transformation and wherein can select the motion prediction/compensation deals of multiple different pixels precision that the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture at least that generates at image information encoding device is decoded, described image information decoding device comprises:
Motion prediction/compensating unit is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
53. according to the described image information decoding device of claim 52,
Wherein, motion prediction/compensating unit is selected to compare a lot of interpolating method of operation amount and number of memory accesses minimizing as the interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
54. according to the described image information decoding device of claim 52, also comprise image type discriminating parts, be used to differentiate the image type of compressed image information;
Wherein, image type differentiates that parts will send to motion prediction/compensating unit with interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture according to the identification result of image type, so that control described order.
55. according to the described image information decoding device of claim 54,
Wherein, motion prediction/compensating unit uses predetermined fixed filters to carry out motion prediction/compensation deals at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
56. according to the described image information decoding device of claim 55,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
57. according to the described image information decoding device of claim 55,
Wherein, motion prediction/compensating unit makes pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than the pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
58. according to the described image information decoding device of claim 57,
Wherein, the information relevant with the pixel precision of motion prediction/compensation deals is embedded in respectively in the MotionResolution field at RTP layer in the compressed image information of interframe forward predictive coded image and interframe bidirectionally predictive coded picture; And
Wherein, motion prediction/compensating unit is according to the described information and executing motion prediction/compensation deals relevant with pixel precision.
59. according to the described image information decoding device of claim 54,
Wherein, motion prediction/compensating unit uses predetermined fixed filters to carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, and carries out motion prediction/compensation deals at use of interframe forward predictive coded image and the corresponding sef-adapting filter of input picture.
60. according to the described image information decoding device of claim 59,
Wherein, motion prediction/compensating unit at first uses predetermined filter to determine to make the motion vector of predicated error minimum at interframe forward predictive coded image, determine to make the filter coefficient of predicated error minimum then at determined motion vector, and use described motion vector and filter coefficient to carry out motion prediction/compensation deals.
61. according to the described image information decoding device of claim 60,
Wherein, be embedded in the compressed image information at the interframe forward predictive coded image information relevant with filter coefficient; And
Wherein, image type is differentiated the parts operation, so that be under the situation of interframe forward predictive coded image in respective frame, take out relevant with filter coefficient at least information from compressed image information, and this information is sent to motion prediction/compensating unit.
62. according to the described image information decoding device of claim 59,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
63. according to the described image information decoding device of claim 59,
Wherein, motion prediction/compensating unit makes pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than the pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
64. according to the described image information decoding device of claim 63,
Wherein, the information relevant with the pixel precision of motion prediction/compensation deals is embedded in respectively in the MotionResolution field at RTP layer in the compressed image information of interframe forward predictive coded image and interframe bidirectionally predictive coded picture; And
Wherein, motion prediction/compensating unit is according to the described information and executing motion prediction/compensation deals relevant with pixel precision.
65. picture information decoding method, be used for by inverse orthogonal transformation and wherein can select the motion prediction/compensation deals of multiple different pixels precision that the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least decoded, described picture information decoding method comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
66. according to the described picture information decoding method of claim 65,
Wherein, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
67. according to the described picture information decoding method of claim 65, also comprise image type discriminating step, be used to differentiate the image type of compressed image information;
Wherein, differentiate in the step, according to the identification result execution of image type and the transmission of interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture, so that the processing in the controlled motion prediction/compensation process at image type.
68. according to the described picture information decoding method of claim 67,
Wherein, at motion prediction/compensation process, use predetermined fixed filters to carry out motion prediction/compensation deals at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
69. according to the described picture information decoding method of claim 68,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
70. according to the described picture information decoding method of claim 68,
Wherein, at motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
71. according to the described picture information decoding method of claim 67,
Wherein, at motion prediction/compensation process, use predetermined fixed filters to carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, and carry out motion prediction/compensation deals at use of interframe forward predictive coded image and the corresponding sef-adapting filter of input picture.
72. according to the described picture information decoding method of claim 71,
Wherein, at motion prediction/compensation process, at first use predetermined filter to determine to make the motion vector of predicated error minimum at interframe forward predictive coded image, determine to make the filter coefficient of predicated error minimum then at determined motion vector, so that use described motion vector and filter coefficient to carry out motion prediction/compensation deals.
73. according to the described picture information decoding method of claim 72,
Wherein, be embedded in the compressed image information at the interframe forward predictive coded image information relevant with filter coefficient; And
Wherein, differentiating step at image type, is under the situation of interframe forward predictive coded image in respective frame, takes out relevant with filter coefficient at least information from compressed image information, so that carry out the transmission of this information, and this information that so obtains is used in motion prediction/compensation process.
74. according to the described picture information decoding method of claim 71,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
75. according to the described picture information decoding method of claim 71,
Wherein, at motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
76. program, make computer carry out following processing, by inverse orthogonal transformation with wherein can select the motion prediction/compensation deals of multiple different pixels precision that the compressed image information that comprises in-frame encoding picture, interframe forward predictive coded image and interframe bidirectionally predictive coded picture is at least decoded, described program comprises:
Motion prediction/compensation process is used for carrying out motion prediction/compensation deals according to different interpolating methods at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
77. according to the described program of claim 76,
Wherein, in motion prediction/compensation process, select to compare operation amount and number of memory accesses and reduce a lot of interpolating methods as interpolating method at the interframe bidirectionally predictive coded picture with interframe forward predictive coded image.
78. according to the described program of claim 76, also comprise image type discriminating step, be used to differentiate the image type of compressed image information;
Wherein, differentiate in the step, according to the identification result execution of image type and the transmission of interframe forward predictive coded image or the corresponding order of interframe bidirectionally predictive coded picture, so that the processing in the controlled motion prediction/compensation process at image type.
79. according to the described program of claim 78,
Wherein, at motion prediction/compensation process, use predetermined fixed filters to carry out motion prediction/compensation deals at interframe forward predictive coded image and interframe bidirectionally predictive coded picture.
80. according to the described program of claim 79,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
81. according to the described program of claim 79,
Wherein, at motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
82. according to the described program of claim 78,
Wherein, at motion prediction/compensation process, use predetermined fixed filters to carry out motion prediction/compensation deals at the interframe bidirectionally predictive coded picture, and carry out motion prediction/compensation deals at use of interframe forward predictive coded image and the corresponding sef-adapting filter of input picture.
83. 2 described programs according to Claim 8,
Wherein, at motion prediction/compensation process, at first use predetermined filter to determine to make the motion vector of predicated error minimum at interframe forward predictive coded image, determine to make the filter coefficient of predicated error minimum then at determined motion vector, so that use described motion vector and filter coefficient to carry out motion prediction/compensation deals.
84. 3 described programs according to Claim 8,
Wherein, be embedded in the compressed image information at the interframe forward predictive coded image information relevant with filter coefficient; And
Wherein, differentiating step at image type, is under the situation of interframe forward predictive coded image in respective frame, takes out relevant with filter coefficient at least information from compressed image information, so that carry out the transmission of this information, and this information that so obtains is used in motion prediction/compensation process.
85. 2 described programs according to Claim 8,
Wherein, the pixel precision of motion prediction/compensation deals is equal to each other in interframe forward predictive coded image and interframe bidirectionally predictive coded picture, and at the filter coefficient of interframe bidirectionally predictive coded picture use than the number of taps of lacking at interframe forward predictive coded image.
86. 2 described programs according to Claim 8,
Wherein, at motion prediction/compensation process, make pixel precision at the motion prediction/compensation deals of interframe forward predictive coded image be higher than pixel precision at the motion prediction/compensation deals of interframe bidirectionally predictive coded picture.
CNB038026279A 2002-01-23 2003-01-23 image information encoding device and method, image information decoding device and method Expired - Fee Related CN100574448C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2002014888A JP3861698B2 (en) 2002-01-23 2002-01-23 Image information encoding apparatus and method, image information decoding apparatus and method, and program
JP14888/2002 2002-01-23

Publications (2)

Publication Number Publication Date
CN1620821A true CN1620821A (en) 2005-05-25
CN100574448C CN100574448C (en) 2009-12-23

Family

ID=27651437

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB038026279A Expired - Fee Related CN100574448C (en) 2002-01-23 2003-01-23 image information encoding device and method, image information decoding device and method

Country Status (6)

Country Link
US (5) US7742648B2 (en)
EP (2) EP1469683B1 (en)
JP (1) JP3861698B2 (en)
KR (1) KR100950743B1 (en)
CN (1) CN100574448C (en)
WO (1) WO2003067896A1 (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009046601A1 (en) * 2007-10-09 2009-04-16 Hong Kong Applied Science And Technology Research Institute Co. Ltd. Method for motion compensation
CN101926177A (en) * 2008-03-07 2010-12-22 株式会社东芝 Dynamic image encoding/decoding device
CN101594537B (en) * 2009-06-04 2011-07-27 北京京北方信息技术有限公司 Massive image data compression method
US8090031B2 (en) 2007-10-05 2012-01-03 Hong Kong Applied Science and Technology Research Institute Company Limited Method for motion compensation
CN101282480B (en) * 2007-04-05 2012-04-25 香港科技大学 Advance macro-block entropy coding for advanced video standards
CN104601995A (en) * 2009-08-26 2015-05-06 索尼公司 Image processing device and method
CN109792524A (en) * 2016-10-05 2019-05-21 高通股份有限公司 Switch the system and method for interpolation filter

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100747958B1 (en) * 2001-09-18 2007-08-08 마쯔시다덴기산교 가부시키가이샤 Image encoding method and image decoding method
JP3861698B2 (en) 2002-01-23 2006-12-20 ソニー株式会社 Image information encoding apparatus and method, image information decoding apparatus and method, and program
JP4120301B2 (en) 2002-04-25 2008-07-16 ソニー株式会社 Image processing apparatus and method
JP4462823B2 (en) * 2002-11-20 2010-05-12 ソニー株式会社 Image signal processing apparatus and processing method, coefficient data generating apparatus and generating method used therefor, and program for executing each method
JP4284265B2 (en) * 2004-11-02 2009-06-24 株式会社東芝 Moving picture coding apparatus, moving picture coding method, moving picture decoding apparatus, and moving picture decoding method
CN100452877C (en) * 2004-11-12 2009-01-14 财团法人资讯工业策进会 Visual information decoding apparatus and method
KR100759870B1 (en) * 2006-03-24 2007-09-18 경희대학교 산학협력단 H.264 scalable encoding/decording method and apparatus for performing interlayer prediction using selected interpolator filter based on the cbp
ES2935961T3 (en) 2009-03-23 2023-03-13 Ntt Docomo Inc Image predictive decoding procedure
JP2011135184A (en) * 2009-12-22 2011-07-07 Sony Corp Image processing device and method, and program
US20120243611A1 (en) * 2009-12-22 2012-09-27 Sony Corporation Image processing apparatus and method as well as program
JP5581688B2 (en) * 2009-12-24 2014-09-03 ソニー株式会社 Image processing apparatus and method, and program
US20120300849A1 (en) * 2010-01-12 2012-11-29 Yukinobu Yasugi Encoder apparatus, decoder apparatus, and data structure
JP2011166327A (en) * 2010-02-05 2011-08-25 Sony Corp Image processing device and method
KR101682147B1 (en) * 2010-04-05 2016-12-05 삼성전자주식회사 Method and apparatus for interpolation based on transform and inverse transform
US9219921B2 (en) * 2010-04-12 2015-12-22 Qualcomm Incorporated Mixed tap filters
ES2820437T3 (en) * 2010-07-20 2021-04-21 Ntt Docomo Inc Predictive image coding method, predictive image decoding device, predictive image decoding method and predictive image decoding program
JP5767816B2 (en) * 2011-01-20 2015-08-19 ルネサスエレクトロニクス株式会社 Semiconductor integrated circuit mountable in recording apparatus and operation method thereof
WO2012120863A1 (en) * 2011-03-08 2012-09-13 パナソニック株式会社 Video coding method and video decoding method
CN107968945B (en) * 2011-09-14 2021-09-14 三星电子株式会社 Method for decoding video and method for encoding video
KR101665921B1 (en) 2011-11-08 2016-10-12 가부시끼가이샤 도시바 Image coding method, image decoding method, image coding apparatus, and image decoding apparatus
JP6331394B2 (en) 2011-11-24 2018-05-30 日本電気株式会社 Video encoding apparatus, video encoding method, and program
DE102014222942A1 (en) * 2014-11-11 2016-05-12 Robert Bosch Gmbh Stator of an electric machine

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH09322175A (en) * 1996-05-30 1997-12-12 Sony Corp Method and device for decoding time varying image
US6256348B1 (en) * 1996-08-30 2001-07-03 Texas Instruments Incorporated Reduced memory MPEG video decoder circuits and methods
ES2545066T3 (en) * 1997-06-09 2015-09-08 Hitachi, Ltd. Recording medium for image information
US6259479B1 (en) * 1997-09-17 2001-07-10 Sony Corporation Letterbox filter apparatus and method
US6393060B1 (en) 1997-12-31 2002-05-21 Lg Electronics Inc. Video coding and decoding method and its apparatus
JP3164056B2 (en) 1998-03-19 2001-05-08 日本ビクター株式会社 Moving image encoding / decoding device, moving image encoding / decoding method, and moving image code recording medium
JP2000078573A (en) * 1998-09-03 2000-03-14 Hitachi Ltd Hierarchical encoded data distribution device
WO2000035202A1 (en) * 1998-12-10 2000-06-15 Matsushita Electric Industrial Co., Ltd. Filter arithmetic device
US6968008B1 (en) 1999-07-27 2005-11-22 Sharp Laboratories Of America, Inc. Methods for motion estimation with adaptive motion accuracy
JP2001204026A (en) * 2000-01-21 2001-07-27 Sony Corp Image information converter and method
JP2002014888A (en) 2000-06-30 2002-01-18 Chizaiko:Kk Communication system and communication equipment and communication program storage medium
JP3861698B2 (en) 2002-01-23 2006-12-20 ソニー株式会社 Image information encoding apparatus and method, image information decoding apparatus and method, and program

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101282480B (en) * 2007-04-05 2012-04-25 香港科技大学 Advance macro-block entropy coding for advanced video standards
US8090031B2 (en) 2007-10-05 2012-01-03 Hong Kong Applied Science and Technology Research Institute Company Limited Method for motion compensation
WO2009046601A1 (en) * 2007-10-09 2009-04-16 Hong Kong Applied Science And Technology Research Institute Co. Ltd. Method for motion compensation
CN101926177A (en) * 2008-03-07 2010-12-22 株式会社东芝 Dynamic image encoding/decoding device
CN101594537B (en) * 2009-06-04 2011-07-27 北京京北方信息技术有限公司 Massive image data compression method
CN104601995A (en) * 2009-08-26 2015-05-06 索尼公司 Image processing device and method
CN104601995B (en) * 2009-08-26 2018-04-27 索尼公司 Image processing apparatus and method
CN109792524A (en) * 2016-10-05 2019-05-21 高通股份有限公司 Switch the system and method for interpolation filter

Also Published As

Publication number Publication date
KR20040077774A (en) 2004-09-06
US8155460B2 (en) 2012-04-10
US8150182B2 (en) 2012-04-03
WO2003067896A1 (en) 2003-08-14
US20120189219A1 (en) 2012-07-26
EP2560390A2 (en) 2013-02-20
US9078005B2 (en) 2015-07-07
JP3861698B2 (en) 2006-12-20
EP1469683A1 (en) 2004-10-20
KR100950743B1 (en) 2010-04-05
EP2560390A3 (en) 2015-03-25
EP1469683B1 (en) 2015-03-04
US7742648B2 (en) 2010-06-22
US20090129470A1 (en) 2009-05-21
CN100574448C (en) 2009-12-23
JP2003219426A (en) 2003-07-31
US20150229956A1 (en) 2015-08-13
US20050157936A1 (en) 2005-07-21
EP1469683A4 (en) 2010-02-24
US20110274172A1 (en) 2011-11-10

Similar Documents

Publication Publication Date Title
CN1620821A (en) Image information coding device and method and image information decoding device and method
CN100336401C (en) Moving image encoder, moving image decoder, moving image encoding method, moving image decoding method
CN1977541A (en) Motion prediction compensation method and motion prediction compensation device
CN1910933A (en) Image information encoding device and image information encoding method
CN1220391C (en) Image encoder, image decoder, image encoding method, and image decoding method
CN1208971C (en) Predictive coding method and decoding method for dynamic image
CN1285216C (en) Image encoding method, image decoding method, image encoder, image decode, program, computer data signal, and image transmission system
CN1829328A (en) Prediction image generating method and apparatus and image and video encoding/decoding method and apparatus using the same
CN101043621A (en) Self-adaptive interpolation process method and coding/decoding module
CN1225126C (en) Space predicting method and apparatus for video encoding
CN1615645A (en) Coding dynamic filters
CN1692653A (en) Moving picture encoding/decoding method and device
CN1820512A (en) Method, medium, and filter removing a blocking effect
CN1658673A (en) Video compression coding-decoding method
CN1960495A (en) Picture coding device, method, and program thereof
CN1625902A (en) Moving picture coding method and decoding method, and apparatus and program using the same
CN1926875A (en) Motion compensation method
CN1642285A (en) Image encoding method and apparatus and image encoding program
CN1640149A (en) Video data conversion device and video data conversion method
CN1898964A (en) Motion image coding apparatus, and control method and program of the apparatus
CN1893657A (en) Methods and systems for rate control in video encoder
CN1633811A (en) Image encoding method, image decoding method, image encoder, image decode, program, computer data signal, and image transmission system
CN1615656A (en) Picture level adaptive frame/field coding for digital video content
CN1324904C (en) Kinematic image coder and decoder
CN101032173A (en) Encoder, encoding method, program of encoding method and recording medium wherein program of encoding method is recorded

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20091223

Termination date: 20200123