JP5130245B2 - Imaging resolution prediction type moving picture encoding apparatus and decoding apparatus - Google Patents

Description

  The present invention relates to an imaging resolution prediction type moving image encoding apparatus and decoding apparatus, and more particularly to an encoding apparatus and decoding apparatus provided with a preprocessing device for high-efficiency compression encoding for high-definition video.

  A compression coding method for storage use in a hard disk recorder or VTR is highly likely to support a 4: 4: 4 color space such as RGB. In Patent Document 1 and Non-Patent Document 1, for 4: 4: 4 video input, prediction prediction between channels is performed prior to encoding, and only the residual signal is handled in the subsequent encoding process. This leads to improved coding performance.

JP 2006-310941 A "Image Encoding Device"

Haruhisa Kato et al., “A Study on Inter-channel Prediction in 4: 4: 4 Video Coding”, 2009 IEICE General Conference D-11-24

  However, according to the above-described background art, examination is performed on the premise that the form at the time of input is maintained without taking special considerations on imaging conditions such as resolution and color space. For this reason, the redundancy between channels can be reduced to some extent, but the resolution is premised on the input signal format, so the effect is limited.

  The object of the present invention is to solve the problems of the background art described above, accurately estimate the signal form at the time of shooting based on the input signal, and then determine the encoding resolution and decoding resolution for each channel based on the result. It is an object of the present invention to provide an imaging resolution prediction type moving image encoding apparatus and decoding apparatus that can determine and encode and decode with high accuracy.

  In order to achieve the above-described object, the present invention can adaptively set at least one of a coding resolution and a reference signal for inter-channel prediction, and encodes an image by intra-screen prediction and inter-channel prediction. The imaging resolution prediction type moving image encoding apparatus includes a preprocessing analysis unit that performs preprocessing analysis of an input image signal, and the preprocessing analysis unit includes an imaging resolution estimation unit, and is obtained in the imaging resolution estimation unit. It is characterized in that at least one of the encoding resolution and the inter-channel prediction reference signal is determined based on the resolution at the time of photographing for each channel.

  Further, update information encoding means for encoding the update information of the side information output from the preprocessing analysis unit is provided, and the side information includes a size ratio with respect to the resolution of the input video signal and a spatial phase difference between channels. Another characteristic is that it is at least one of the resolution conversion filter characteristics.

  The update information encoding means may encode the update information at least one of a size ratio with respect to the resolution of the input video applied in the neighborhood encoded frame, a spatial phase difference between channels, and a resolution conversion filter characteristic. There is another feature in that it is performed on the residual signal when is used as a predicted value.

  Further, in the video decoding apparatus capable of adaptively setting at least one of the output resolution and the inter-channel prediction reference signal, the video decoding apparatus includes side information decoding means for decoding side information included in received data, and the output Another feature is that at least one of the resolution and inter-channel prediction reference signals is determined based on the side information decoded by the side information decoding means.

  The side information decoding means decodes at least one of the size ratio with respect to the resolution of the input video, the spatial phase difference between channels, and the resolution conversion filter characteristics, and performs the decoded data on the decoding side. There is another feature in that the information for determining power resolution conversion is reflected in the final output format of the decoded image.

  Further, the side information decoding means acquires a residual signal by decoding received data, acquires a predicted value from the side information data applied in the neighborhood encoded frame, and decodes the side information by adding them. Has other features.

  According to the imaging resolution prediction type moving image encoding apparatus of the present invention, the input image signal is preprocessed and analyzed, and prior to the moving image encoding process, the resolution at the time of shooting corresponding to the input video is estimated with high accuracy, By determining the encoding resolution based on the result, it is possible to expect improvement in encoding performance.

  Also, according to the imaging resolution prediction type moving picture decoding apparatus of the present invention, the side information included in the received data is decoded, and the details of the post-processing method on the decoding side are determined based on the result. As a result, the output signal format of the decoding apparatus can be faithfully matched to the input signal of the encoding apparatus.

  Further, since the side information obtained by the preprocessing analysis is encoded and transmitted, the side information can be transmitted with a small code amount.

It is a block diagram which shows the structure of the encoding apparatus of 1st Embodiment of this invention. It is a block diagram which shows the structure of the specific example of the pre-processing analysis part of FIG. It is a block diagram which shows the structure of the decoding apparatus of 1st Embodiment of this invention. It is a block diagram which shows the structure of the encoding apparatus of 2nd Embodiment of this invention. It is a block diagram which shows the structure of the decoding apparatus of 2nd Embodiment of this invention. It is a block diagram which shows the structure of the encoding apparatus of 3rd Embodiment of this invention. It is a block diagram which shows the structure of the decoding apparatus of 3rd Embodiment of this invention. It is a block diagram which shows the structure of the encoding apparatus of 4th Embodiment of this invention. It is a block diagram which shows the structure of the decoding apparatus of 4th Embodiment of this invention. It is a flowchart which shows operation | movement of the side information encoding part of 1st, 3rd embodiment of this invention. It is a flowchart which shows operation | movement of the side information decoding part of 1st, 3rd embodiment of this invention. It is a flowchart which shows operation | movement of the side information encoding part of 2nd, 4th embodiment of this invention. It is a flowchart which shows operation | movement of the side information decoding part of 2nd, 4th embodiment of this invention.

  Compression encoding of a video signal having a 4: 4: 4 color space such as RGB is effective in realizing a compression rate with high correlation removal between channels (color components) such as R, G, and B. On the other hand, as a high-definition image capturing technique, there are many examples of introducing a so-called pixel shift process in which pixel sample points are adjacent to each other for each color space. The present invention relates to a compression encoding device for high-definition video, and an adaptive encoding device including a preprocessing analysis unit that analyzes an input video signal and identifies a signal form at the time of shooting in an upstream stage of encoding. And the decoding device.

  Hereinafter, the present invention will be described in detail with reference to the drawings. FIG. 1 is a block diagram showing a configuration of an embodiment of the present invention.

  The input image signal a to the moving image encoding device is temporarily stored in the frame memory 1 for preprocessing analysis. Here, the input image signal a is a video signal having a 4: 4: 4 color space such as R, G, and B, has a predetermined shooting resolution arbitrarily converted on the shooting side, and has a color ( Hereinafter, the sample points are shifted every time), in other words, an image having a spatial phase difference.

  The preprocessing analysis unit 2 serves to specify a signal form at the time of shooting. A specific example of the preprocessing analysis unit 2 will be described with reference to FIG. The preprocessing analysis unit 2 includes a frequency analysis unit 2b, a pixel shift estimation unit 2c, an imaging resolution estimation unit 2d, an inverse transform filter coefficient calculation unit 2e, and a reference signal selection unit 2f.

  The frequency analysis unit 2b performs frequency analysis on the input image signal b from the frame memory 1 by, for example, FFT. The pixel shift estimation unit 2c estimates the pixel shift between channels, that is, the inter-channel phase difference c based on the result of frequency analysis. The shooting resolution estimation unit 2d estimates the resolution at the time of shooting and outputs a resolution conversion ratio d. The inverse transform filter coefficient calculation unit 2e calculates and outputs an inverse transform filter coefficient e for returning to the resolution at the time of shooting. The inverse transform filter coefficient e is used to restore the video on the receiving side. The reference signal selection unit 2f selects or determines a signal that is a reference for correlation between channels such as R, G, and B, and is performed according to the norm of maximizing the correlation coefficient between the reference signal and the non-reference signal. Is desirable. Specifically, it is desirable to select the channel with the highest resolution as the reference signal. Further, when the imaging resolution estimated for each channel is different from each other, the selection of the reference signal for inter-channel prediction may be uniquely determined only from the imaging resolution for each channel. The reference signal selector 2f is provided for inter-channel prediction.

  The output of the preprocessing analyzer 2, that is, the phase difference c between channels, the resolution conversion ratio d (conversion ratio corresponding to the resolution at the time of shooting or the size ratio with respect to the resolution of the input video), the inverse conversion filter coefficient e and the reference signal are updated. It is sent to the information determination unit 3. The inter-channel phase difference c, the resolution conversion ratio d, and the inverse conversion filter coefficient e may be hereinafter referred to as “side information”.

  The update information determination unit 3 sets the side information sent from the preprocessing analysis unit 2 as update side information when it has changed from the previous data, and does not set it as update side information when it has not changed. The selection of the reference signal is uniquely determined based on the resolution. For example, the reference signal can be reproduced independently on the receiving side by using the signal having the maximum resolution as the reference signal. . For this reason, it is possible to omit the description of the reference signal selection result itself as side information.

  As shown in FIG. 1, the update side information output from the update information determination unit 3 is sent to the update information encoding unit 4 and directly encoded by the update information encoding unit 4. In this case, for example, when the code amount of the update information exceeds a certain threshold value, the video format at the time of input may be retained and the encoding process may not be applied.

  The above processing is repeated for each video frame. When it is known that there is no change in shooting conditions in the input video, the application of the above processing can be limited to the first video frame.

  FIG. 10 is a flowchart showing the processes of the preprocessing analysis unit 2, the update information determination unit 3, and the update information encoding unit 4.

  In step S1, it is determined whether or not the shooting conditions have changed. If there is no conversion, the process ends without performing preprocessing analysis. If there is a change, the process proceeds to step S2. Steps S2 to S5 are performed by the preprocessing analysis unit 2. In step S2, frequency analysis in the screen is performed. In step S3, the pixel shift between channels is estimated. In step S4, the imaging resolution is estimated. In step S5, the reference signal selection unit 2f determines the reference signal. . The processes in steps S6 and S7 are performed by the update information encoding unit 4. In step S6, it is determined whether or not the amount of code when the updated side information is encoded is smaller than a predetermined threshold value. If this determination is affirmative, the process proceeds to step S7 and the updated side information is encoded. Done. On the other hand, when the determination in step S6 is negative, the process ends without encoding.

  Next, the resolution conversion unit 6 in FIG. 1 converts the input image signal b to the same resolution as that at the time of shooting, based on the resolution conversion ratio from the update information determination unit 3. Thereafter, the encoding processing is performed in the processing order of intra-screen prediction → inter-channel prediction. Since this encoding process is well known, it will be briefly described. First, the switching units SW1 and SW2 are connected to the terminal a for the reference signal, and are connected to the terminal b for the non-reference signal. Note that “0” is input to the terminal a of SW2.

  The reference signal includes a subtractor 7, a DCT unit 8, a quantization unit 9, a variable length coding unit 10, a local decoding unit 12, an adder 13, a local decoded image unit 14, an adder 15, a local decoded image unit 16, and a resolution. Intra-screen prediction encoding is performed by the conversion unit 17, the motion detection unit 18, and the prediction image unit 19. On the other hand, the non-reference signal is predicted in the screen by the above circuit, and then inter-channel prediction is performed by the inter-channel prediction unit 20, the predicted image unit 21, and the subtracter 22, and the data amount is reduced. This inter-channel prediction process is preferably applied to the video signal immediately after the resolution conversion.

  The encoded image signal composed of the encoded reference signal and the non-reference signal is temporarily stored in the buffer memory 11 and multiplexed with the encoded update information or side information by the multiplexing unit 23 to generate encoded data. Is output as

  The intra-frame encoding process is not limited to intra-frame prediction encoding, and motion compensation prediction encoding may be applied.

  Next, the configuration of a decoding apparatus corresponding to the encoding apparatus will be described with reference to FIG.

  The image data separated from the received encoded data is temporarily stored in the buffer memory 31, and the side information is stored in the buffer memory 32. The side information stored in the buffer memory 32 is decoded by the update information decoding unit 33. Specifically, the decoded side information is a resolution conversion ratio (a conversion ratio corresponding to the resolution at the time of shooting or a size ratio with respect to the resolution of the input video), a spatial phase difference between channels, and an inverse conversion filter coefficient.

  The selection of the reference signal, that is, which of the R, G, and B signals is used as the reference signal is uniquely determined based on the encoding resolution for each channel (for example, the signal having the maximum resolution is used as the reference signal). Etc.) This reference signal is sent to the inter-channel prediction unit 38 and used for the decoding process of the inter-channel prediction.

  The operation of the update information decoding unit 33 is shown in the flowchart of FIG. In step S11, it is determined whether or not there is side information in the buffer memory 32. If there is no side information, the process ends as it is. On the other hand, when it exists, it progresses to step S12 and the update information decoding part 33 decodes side information. In step S13, the settings of the resolution conversion ratio, inverse transform filter coefficient, and interchannel phase difference are updated. In step S14, the reference signal is updated.

  The resolution conversion ratio decoded by the update information decoding unit 33 is sent to the resolution conversion unit 42 and used for image size correction. In addition, the spatial phase difference between channels and the inverse transform filter coefficient are sent to the resolution conversion unit 46 to return the R, G, B pixel shift to the original (when input to the encoding device) and to enlarge the image. Made.

  Since the decoding apparatus other than the above is a known decoding apparatus, the operation of the decoding apparatus can be simply described. The switching unit SW3 is connected to the terminal a at the time of the reference signal and to the terminal b at the time of the non-reference signal.

  The reference signal is decoded into the first decoded image 40 by the variable length decoding unit 34, the inverse quantizer 35, the inverse DCT unit 36, and the adder 37, and then the motion compensation unit 41, the resolution conversion unit 42, the prediction image The second decoded image 45 is obtained by the intra-screen decoding process by the unit 43 and the adder 44, and finally the resolution is converted by the resolution conversion unit 46 to be reconstructed into the same signal format as the input image signal.

  On the other hand, the non-reference signal includes the residual signal decoded by the variable length decoding unit 34, the inverse quantizer 35, and the inverse DCT unit 36, and the image predicted by the channel between the channel prediction unit 38 and the prediction image unit 39. The first decoded image 40 is added and decoded, and then the intra-screen decoding process is applied to each channel by the intra-screen decoding process performed by the motion compensation unit 41, the resolution conversion unit 42, the predicted image 43, and the adder 44. 2 decoded images 45 are obtained. Finally, the resolution is converted by the resolution converter 46 and reconfigured in the same signal format as the input image signal.

  The above processing is repeated for each video frame. Note that the intra-screen decoding process is not limited to intra-frame prediction decoding, and motion compensated prediction decoding may be applied.

  Next, an encoding apparatus according to a second embodiment of the present invention will be described with reference to FIG. 4, the same reference numerals as those in FIG. 1 denote the same or equivalent parts.

  The difference between this embodiment and the first embodiment is that the update side information output from the update information determination unit 3 is encoded using a value used in a nearby encoded screen as a predicted value. In other words, the updated side information is predictively encoded.

  Explaining the operation, the side information used in the neighboring encoded screen accumulated in the buffer memory 5 is locally decoded by the local decoding unit 26 and added to the predicted value 28 by the adder 27 to update the predicted value 28. . The subtracter 24 generates a residual signal by subtracting the predicted value 28 from the side information from the update information determination unit 3, and the residual signal is encoded by the encoding unit 25 and temporarily stored in the buffer memory 5. Is done. Then, it is sent to the multiplexing unit 23.

  FIG. 12 is a flowchart showing an operation for predictively encoding the updated side information. In step S21, it is determined whether or not the shooting conditions have changed. If there is no change, the process ends without performing preprocessing analysis. On the other hand, if there is a change, the process proceeds to step S22, and the preprocessing analysis unit 2 performs the same operations as steps S2 to S5 in FIG. 10 in steps S22 to S25. In step S26, a predicted value is calculated, and it is determined whether or not the code amount when the residual signal obtained by the subtractor 24 is encoded by the encoding unit 25 is smaller than a predetermined threshold value. . If this determination is negative, the process ends without encoding. If the determination is positive, the process proceeds to step S28, where the encoding unit 25 encodes and outputs the residual signal.

  The operation other than the predictive encoding of the updated side information, that is, the configuration and operation of the encoder that encodes the image information are the same as those in FIG.

  Next, the configuration of a decoding apparatus corresponding to the encoding apparatus will be described with reference to FIG. In FIG. 5, the same reference numerals as those in FIG. 3 denote the same or equivalent parts.

  This embodiment differs from the first embodiment in that a local decoding unit 47, an adder 48, an update information storage unit 49, and a predicted value storage unit 50 are provided in the subsequent stage of the buffer memory 32. Therefore, an operation having a configuration different from that of the first embodiment will be described below.

  In the buffer memory 32, a residual signal of side information extracted from the received encoded data is temporarily stored. The side information residual signal temporarily stored in the buffer memory 32 is locally decoded by the local decoding unit 47. The locally decoded residual signal is added to the predicted value, which is a value used in the neighboring encoded screen stored in the predicted value storage unit 50, by the adder 48, thereby corresponding to the resolution at the time of shooting. The conversion ratio (size ratio relative to the resolution of the input video), the spatial phase difference between channels, and the inverse transform filter coefficient are decoded and accumulated in the update information accumulation unit 49.

  FIG. 13 is a flowchart showing the operation of the side information decoding unit. In step S31, it is determined whether or not side information exists in the buffer memory 32. If there is no side information, the process ends. On the other hand, if it exists, the process proceeds to step S32 to decode the residual signal, the predicted value is calculated in step S33, the predicted value is added to the residual signal in step S34, and the resolution conversion ratio, inverse The setting of the filter coefficient and the inter-channel phase difference is updated. Next, in step S35, the reference signal is updated.

  The resolution conversion ratio decoded by the decoding unit is sent to the resolution conversion unit 42 and used for image size correction. In addition, the spatial phase difference between channels and the inverse transform filter coefficient are sent to the resolution conversion unit 46 to restore the R, G, and B pixel shifts and enlarge the image.

  The operations other than the decoding of the side information are the same as those in FIG.

  Next, a third embodiment of the present invention will be described with reference to FIG. In FIG. 6, the same reference numerals as those in FIG. 1 denote the same or equivalent components. In this embodiment, the same side information encoding apparatus as that of the first embodiment is applied to an encoding apparatus of a well-known inter-channel prediction → intra-screen prediction processing procedure.

  Therefore, description of the preprocessing analysis unit 2 and the side information encoding device (the flowchart is the same as that in FIG. 10) will be omitted, and only the image signal encoding device will be described briefly.

  The reference signal is sent to the terminal a of the switching unit SW1, and the predicted image 64 is subtracted by the subtractor 54. The residual signal output from the subtractor 54 includes a DCT unit 55, a quantization unit 56, a variable length coding unit 57, a local decoding unit 59, an adder 60, a local decoded image 61, a resolution conversion unit 62, and a motion detection unit. In step 63, the in-screen prediction process is performed. On the other hand, when the non-reference signal is encoded, the switching unit SW1 is connected to the terminal b. The non-reference signal is inter-channel predicted by subtracting the prediction image 52 obtained from the inter-channel prediction unit 51 and the local decoded image 61 by the subtractor 53. Next, intra prediction is performed by the circuit configuration used for the intra prediction processing of the reference signal.

  The encoded image signal composed of the reference signal and the non-reference signal encoded as described above is temporarily stored in the buffer memory 58 and multiplexed by the multiplexing unit 23 with the encoded update information or side information. Are output as encoded data.

  Next, the configuration of a decoding apparatus corresponding to the encoding apparatus will be described with reference to FIG. 7, the same reference numerals as those in FIG. 3 denote the same or equivalent parts.

  Since the side information decoding apparatus is the same as that of FIG. 3 of the first embodiment (the flowchart is the same as FIG. 11), the description is omitted, but the resolution conversion ratio of the decoded side information is given to Sent and used for image size correction. In addition, the spatial phase difference between channels and the inverse transform filter coefficient are sent to the resolution converter 82 to return the R, G, B pixel shift to the original (when input to the encoding device) and to enlarge the image. Made.

  Since a decoding apparatus for an image signal is well known, a brief description will be given. Image data separated from received encoded data is temporarily stored in a buffer memory 31, and a variable length decoding unit 71, an inverse quantization unit 72, an inverse DCT The unit 73, the motion compensation unit 74, the predicted image 75, the adder 76, and the resolution conversion unit 77 perform an intra-screen decoding process for each channel, and a residual signal for each channel is obtained as a decoded image 78. Next, the non-reference signal is subjected to inter-channel prediction decoding processing by the inter-channel prediction unit 79, the predicted image 80 and the adder 81. Finally, the resolution is converted by the resolution converter 82 and reconfigured to the same signal format as the input image signal.

  Next, a fourth embodiment of the present invention will be described with reference to FIG. 8, the same reference numerals as those in FIGS. 4 and 6 denote the same or equivalent components. In this embodiment, the same side information encoding apparatus as that of the second embodiment is applied to an encoding apparatus of a well-known inter-channel prediction → intra-screen prediction processing procedure.

  The encoding of the side information is the same as that of the encoding device (FIG. 4) of the second embodiment (the flowchart is the same as that of FIG. 12), and the encoding of the image information is the encoding device of the third embodiment ( Since this is the same as that of FIG. 6), the description of the operation of FIG. 8 is omitted.

  Next, FIG. 9 shows a configuration of a decoding apparatus corresponding to the encoding apparatus. 9, the same reference numerals as those in FIGS. 5 and 7 denote the same or equivalent components.

  The side information decoding device of this embodiment is the same as that of the decoding device (FIG. 5) of the second embodiment (the flowchart is the same as FIG. 13), and the image information decoding device is the decoding device of the third embodiment. It is the same as that of the device (FIG. 7). Therefore, the description of the operation of this embodiment is omitted.

  As described above, according to the first to fourth embodiments of the present invention, the pre-processing analysis unit estimates the resolution at the time of shooting for each channel. Therefore, prior to moving image encoding processing, the resolution at the time of shooting corresponding to the input video can be estimated with high accuracy, and the details of the encoding resolution and the post-processing method on the decoding side are determined based on the result. As a result, an improvement in encoding performance can be expected.

  2 ... Pre-processing analysis unit, 3 ... Update information determination unit, 4 ... Update information encoding unit, 6, 17 ... Resolution conversion unit, 20 ... Inter-channel prediction unit, 2b ... Frequency analysis unit, 2c: pixel shift estimation unit, 2d: imaging resolution estimation unit, 2e: inverse transform filter coefficient calculation unit, 2f: reference signal selection unit, 24: subtractor, 25 ... Coding section, 26 ... Local decoding section, 27 ... Adder, 28 ... Predicted value, 33 ... Update information decoding section, 38 ... Inter-channel prediction section, 42, 46... Resolution conversion unit, 51... Inter channel prediction unit, 62... Resolution conversion unit, 77 and 82... Resolution conversion unit, 79.

Claims (15)

In an imaging resolution prediction type moving image encoding device that can adaptively set at least one of a reference signal for encoding resolution and inter-channel prediction, and encodes an image by intra-screen prediction and inter-channel prediction,
A preprocessing analysis unit for performing preprocessing analysis of the input image signal;
The preprocessing analysis unit includes a pixel shift estimation unit, an imaging resolution estimation unit , an inverse transform filter coefficient calculation unit, and a reference signal selection unit ,
The pixel shift estimation unit estimates an inter-channel phase difference,
The shooting resolution estimation unit estimates the resolution at the time of shooting,
The inverse transform filter coefficient calculation unit calculates an inverse transform filter coefficient for returning to the resolution at the time of shooting ,
The reference signal selection unit determines at least one of the encoding resolution and the inter-channel prediction reference signal based on the resolution at the time of shooting for each channel obtained by the shooting resolution estimation unit. An imaging resolution prediction type moving image encoding device. The imaging resolution prediction type moving image encoding device according to claim 1,
The reference signal selection unit selects a reference signal for inter-channel prediction based on a norm of inter-channel correlation maximization, and is an imaging resolution prediction type moving image encoding device. The imaging resolution prediction type moving image encoding device according to claim 2,
The reference signal selection unit uniquely determines the selection of a reference signal for inter-channel prediction from only the imaging resolution for each channel when the imaging resolutions estimated for each channel are different from each other. Predictive video encoding device. The imaging resolution prediction type moving image encoding device according to claim 1,
The imaging shift prediction type moving image encoding apparatus, wherein the pixel shift estimation unit estimates a spatial phase difference. The imaging resolution prediction type moving image encoding device according to any one of claims 1 to 4,
The imaging resolution prediction type moving image encoding device, wherein the preprocessing analysis processing of the input image signal starts with frequency spectrum analysis for each channel. The imaging resolution prediction type moving image encoding device according to any one of claims 1 to 5,
The imaging resolution prediction type moving image encoding apparatus, wherein the inter-channel prediction processing is applied to a video signal immediately after resolution conversion. The imaging resolution prediction type moving image encoding device according to any one of claims 1 to 5,
The inter-channel prediction process is applied to a residual signal generated when either motion compensation prediction or intra-frame prediction is applied to a video signal immediately after resolution conversion. Predictive video encoding device. The imaging resolution prediction type moving image encoding device according to claim 1,
Update information encoding means for encoding the update information of the side information output from the preprocessing analysis unit,
The side information size ratio resolution of the input video signal, imaging resolution predictive video coding apparatus which comprises a spatial phase difference and the resolution conversion filter characteristics between channels. The imaging resolution prediction type moving image encoding device according to claim 8,
The update information encoding means predicts at least one of update information encoding among a size ratio with respect to the resolution of an input video applied in a neighboring encoded frame, a spatial phase difference between channels, and a resolution conversion filter characteristic. An imaging resolution prediction type moving image encoding apparatus, which is performed on a residual signal when a value is used. The imaging resolution prediction type moving image encoding device according to claim 8 or 9,
The update information encoding unit is configured to perform update information encoding only when the code amount of the update information falls below a predetermined threshold. In the imaging resolution prediction type moving picture decoding apparatus capable of adaptively setting at least one of the output resolution and the inter-channel prediction reference signal,
Comprising side information decoding means for decoding side information included in the received data;
The decoded side information includes a resolution conversion ratio, an inter-channel phase difference, and an inverse conversion filter coefficient,
Determining at least one of the output resolution and inter-channel prediction reference signal based on the decoded side information ;
The resolution conversion ratio is used for image size correction,
The inter-channel phase difference and the inverse transform filter coefficient are used for restoring the pixel shift of the color signal and enlarging the image, and a photographic resolution prediction type moving picture decoding apparatus. The imaging resolution prediction type moving picture decoding apparatus according to claim 11,
The side information decoding means decodes the encoding resolution for each channel;
An imaging resolution prediction type moving picture decoding apparatus characterized in that, when the encoding resolution for each channel is different from each other, selection of a reference signal for inter-channel prediction can be uniquely determined only from the resolution for each channel. The imaging resolution prediction type moving picture decoding device according to claim 11 or 12 ,
Means for obtaining a residual signal of inter-channel prediction by intra-screen decoding for received data;
An imaging resolution prediction type moving picture decoding apparatus comprising: means for acquiring a decoded picture for each channel by decoding processing of inter-channel prediction for the residual signal. The imaging resolution prediction type moving picture decoding device according to claim 11 or 12 ,
Means for obtaining a residual signal of intra-picture encoding by decoding processing of inter-channel prediction for received data;
An imaging resolution prediction type moving image decoding apparatus comprising: means for acquiring a decoded image for each channel by decoding processing applying either motion compensation prediction or intraframe prediction to the residual signal . The imaging resolution prediction type moving picture decoding device according to claim 11 or 12 ,
The side information decoding means acquires a residual signal by decoding received data, acquires a prediction value from side information data applied in a neighborhood encoded frame, and decodes side information by adding these. An imaging resolution prediction type moving picture decoding apparatus.

Images