WO2011138912A1 - Image encoding apparatus, image decoding apparatus, image encoding method, image decoding method and program - Google Patents

Image encoding apparatus, image decoding apparatus, image encoding method, image decoding method and program Download PDF

Info

Publication number
WO2011138912A1
WO2011138912A1 PCT/JP2011/060111 JP2011060111W WO2011138912A1 WO 2011138912 A1 WO2011138912 A1 WO 2011138912A1 JP 2011060111 W JP2011060111 W JP 2011060111W WO 2011138912 A1 WO2011138912 A1 WO 2011138912A1
Authority
WO
WIPO (PCT)
Prior art keywords
reference picture
compression
video
decompression
processing
Prior art date
Application number
PCT/JP2011/060111
Other languages
French (fr)
Japanese (ja)
Inventor
慶一 蝶野
純二 田治米
裕三 仙田
啓史 青木
健太 先崎
Original Assignee
日本電気株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日本電気株式会社 filed Critical 日本電気株式会社
Publication of WO2011138912A1 publication Critical patent/WO2011138912A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
    • H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
    • H04N19/426—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements using memory downsizing methods
    • H04N19/428—Recompression, e.g. by spatial or temporal decimation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/146—Data rate or code amount at the encoder output
    • H04N19/152—Data rate or code amount at the encoder output by measuring the fullness of the transmission buffer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Definitions

  • the present invention relates to a video encoding device, a video decoding device, a video encoding method, a video decoding method, and a program.
  • the video encoding apparatus related to the present invention generates encoded data, that is, a bit stream, by performing an encoding process based on a predetermined video encoding method on each frame of the input video.
  • ISO / IEC 14496-10 Advanced Video Coding (AVC) which is a typical example of a predetermined video encoding method, divides each frame into blocks of 16x16 pixel size called MB (Macro Block). Further, the MB is further divided into blocks of 4 ⁇ 4 pixel size (hereinafter referred to as 4 ⁇ 4 blocks), and the 4 ⁇ 4 block is set as the minimum structural unit of encoding.
  • FIG. 1 shows an example of the block division in the case where the spatial resolution of the frame is QCIF (Quarter Common Intermediate Format), 4: 2: 0 format.
  • QCIF Quadrater Common Intermediate Format
  • Intraframe prediction is a method of predicting an image using a reconstructed image of the current frame to be encoded.
  • Inter-frame prediction is a method for predicting an image using a reconstructed image of a frame encoded in the past from the current encoding target frame.
  • a conventional video encoding apparatus that predicts and encodes a reconstructed image of a coded image in this way, a reference picture that stores a frame (hereinafter referred to as a reference picture) that includes the reconstructed image that is referenced in the prediction.
  • a memory is provided (see FIG. 2).
  • an image frame encoded by applying intra-frame prediction to all MBs in a frame is called an I picture.
  • an image frame encoded by applying inter-frame prediction using a maximum of one reference picture for MB is called a P picture.
  • an image frame encoded by applying inter-frame prediction using two reference pictures simultaneously for the MB is called a B picture.
  • an I picture is set at a fixed period, and a section composed of a plurality of frames divided by the I picture is called a GOP (group of pictures).
  • an object of the present invention is to provide a video encoding device, a video decoding device, a video encoding method, a video decoding method, and a program that can eliminate degradation in the image quality of decoded video. There is.
  • the present invention that solves the above-described problems includes a video encoding unit that encodes an input video based on prediction, a reference picture compression unit that compresses a reference picture used for prediction by the video encoding unit, and a compressed reference picture
  • a reference picture storage means for storing the reference picture
  • a reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means, the reference picture compression means and the reference picture decompression means based on predetermined operating parameters
  • a video encoding apparatus comprising: a compression / decompression control unit that controls the video; a video bitstream of the video encoding unit; and a multiplexing unit that multiplexes the operation parameters of the compression / decompression control unit.
  • the present invention for solving the above-mentioned problems is a demultiplexing means for demultiplexing an input bitstream including operation parameters for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed, Video decoding means for decoding the demultiplexed video bitstream based on prediction, reference picture compression means for compressing a reference picture used for prediction by the video decoding means, and a reference for storing the compressed reference picture Picture storage means; reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means; and the reference picture compression means based on operating parameters included in the demultiplexed input bitstream; Video decompression control means for controlling the reference picture decompression means. It is a device.
  • the present invention that solves the above-described problems includes a video encoding unit that encodes an input video based on prediction, a reference picture compression unit that compresses a reference picture used for prediction by the video encoding unit, and a compressed reference picture
  • a reference picture storage means for storing the reference picture
  • a reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means, the reference picture compression means and the reference picture decompression means based on predetermined operating parameters
  • a video encoding unit having a compression / decompression control unit that controls the video bit stream of the video encoding unit and a multiplexing unit that multiplexes the operation parameters of the compression / decompression control unit;
  • Demultiplexing means for demultiplexing and separating the video bitstream and the operation parameter, and the multiplexing
  • Video decoding means for decoding the released video bitstream based on prediction
  • reference picture compression means for compressing a reference picture used for prediction by the video decoding means
  • the present invention that solves the above-described problems includes a process for encoding an input video based on prediction, a compression process for compressing a reference picture used for the prediction and generating a compressed reference picture, and a decompression for expanding the compressed reference picture A process, a compression / decompression control process for controlling the compression process and the decompression process based on a predetermined operation parameter, a multiplexing process for multiplexing the encoded video bitstream, and the operation parameter; Is a video encoding method.
  • the present invention for solving the above problems includes a demultiplexing process for demultiplexing an input bitstream when an operation parameter for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed is included.
  • a video decoding process for decoding the demultiplexed video bitstream based on prediction, a compression process for generating a compressed reference picture by compressing a reference picture used for prediction in the video decoding process, and the compressed reference picture
  • a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream.
  • the present invention that solves the above-described problems includes a process for encoding an input video based on prediction, a compression process for compressing a reference picture used for the prediction and generating a compressed reference picture, and a decompression for expanding the compressed reference picture
  • a process a compression / decompression control process for controlling the compression process and the decompression process based on a predetermined operation parameter, a multiplexing process for multiplexing the encoded video bitstream, and the operation parameter;
  • the present invention for solving the above problems includes a demultiplexing process for demultiplexing an input bitstream when an operation parameter for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed is included.
  • a video decoding process for decoding the demultiplexed video bitstream based on prediction, a compression process for generating a compressed reference picture by compressing a reference picture used for prediction in the video decoding process, and the compressed reference picture
  • a program for causing an information processing device to execute a decompression process for decompressing and a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream is there.
  • the present invention that solves the above problem multiplexes auxiliary information related to compression and decompression of the reference picture into a video bitstream obtained by encoding an input video based on prediction using a reference picture on the video encoding side.
  • the video decoding side demultiplexes the video bitstream, extracts the auxiliary information, and controls compression and expansion of the reference picture based on the auxiliary information.
  • FIG. 1 is a diagram showing an example of block division of a frame.
  • FIG. 2 is a diagram illustrating a related video encoding apparatus.
  • FIG. 3 is a diagram showing a related video decoding apparatus.
  • FIG. 4 is a diagram illustrating a video encoding apparatus according to the first embodiment.
  • FIG. 5 is a diagram showing an example of compression by DPCM.
  • FIG. 6 is a diagram showing an example of expansion by DPCM.
  • FIG. 7 is a video encoding flowchart according to the first embodiment.
  • FIG. 8 is a diagram illustrating a video decoding apparatus according to the second embodiment.
  • FIG. 9 is a diagram illustrating a video decoding flowchart according to the second embodiment.
  • FIG. 10 is a diagram showing the configuration of the information processing apparatus of the present invention.
  • the video encoding apparatus stores video encoding means for encoding an input video based on inter-frame prediction, reference picture compression means for compressing a reference picture for inter-frame prediction, and a compressed reference picture.
  • Reference picture storage means reference picture expansion means for expanding the compressed reference picture stored in the reference picture storage means, compression / decompression control means for controlling the reference picture compression means and reference picture expansion means, and video of the video encoding means
  • a multiplexing means for multiplexing the operating parameters of the bit stream and the compression / decompression control means is provided.
  • the video decoding apparatus includes a demultiplexing unit that demultiplexes an input bitstream, a video decoding unit that decodes the demultiplexed video bitstream based on interframe prediction, and a demultiplexing unit
  • a compression / decompression control unit that controls the reference picture compression unit and the reference picture expansion unit based on an operation parameter of the compression / decompression control unit, a reference picture compression unit that compresses a reference picture for inter-frame prediction, and a compressed reference picture
  • a reference picture expansion means for expanding the compressed reference picture stored in the reference picture storage means.
  • the operation parameters of the compression / decompression control means multiplexed into the bitstream by the video encoding apparatus are auxiliary information for applying the same reference picture compression and reference picture expansion to the reference picture in the video decoding apparatus. It becomes.
  • the video decoding apparatus includes means for demultiplexing the bitstream to extract the auxiliary information, and controlling the reference picture compression means and the reference picture expansion means based on the demultiplexed information. Thus, the pixel values of the reference picture can be completely matched.
  • the present invention since the pixel values of the reference picture are completely the same between the video encoding device and the video decoding device, the drift of the decoded video in the prior art is eliminated. Further, in the video encoding device, the memory bandwidth is reduced as in the video decoding device.
  • the video encoding device of the present invention stores the reference picture memory in the reference picture memory for each compression rate so that the memory arrangement of the reference picture memory can be determined in the video decoding device.
  • the video decoding apparatus includes means for extracting information related to the number of reference pictures to be stored in the reference picture memory for each compression rate and determining a memory arrangement based on the extracted information.
  • the memory arrangement of the reference picture memory can be completely matched between the video encoding device and the video decoding device. Therefore, the conventional problem that the memory arrangement is not determined on the video decoder side and a reference picture memory larger than necessary is prepared or a memory copy occurs due to alignment is solved.
  • FIG. 4 shows a video encoding apparatus according to the first embodiment.
  • a memory compressor 103 Compared with the conventional video encoding apparatus of FIG. 2, a memory compressor 103, a memory decompressor 104, a multiplexer 105, and a memory compression / decompression controller 106 are newly provided. Each operation will be described on the assumption that the memory compressor 103 and the memory decompressor 104 are DPCMs in which N pixels are used as a processing cycle and a prediction error is encoded with M bits.
  • the video encoder 101 encodes each frame of the input video and supplies the video bit stream to the multiplexer 105.
  • the video encoder 101 reads a reconstructed image of a reference picture used for prediction from the reference picture memory 102 via the memory expander 104 when intra-frame or inter-frame prediction is performed on the encoding target frame.
  • the video encoder 101 stores the reconstructed image as a reference picture in the reference picture memory 102 via the memory compressor 103 by a sliding window method or the like.
  • the memory compression / decompression controller 106 signals to the memory compressor 103, the memory expander 104, and the multiplexer 105 that the DPCM processing cycle is N pixels and the number of bits of the prediction error is M bits.
  • the memory compressor 103 applies an M-bit DPCM for each N pixel to the reconstructed image supplied from the video encoder 101 and stores it in the reference picture memory 102 as DPCM compressed data.
  • FIG. 5 shows how a horizontal line with a reference picture having an 8-bit pixel bit precision is subjected to DPCM compression with a processing period of 8 pixels and a prediction error of 5 bits and stored in the reference picture.
  • the memory decompressor 104 decompresses the DPCM compressed data stored in the reference picture memory 102 including the reconstructed image area of the reference picture requested from the video encoder 101.
  • a horizontal line with a reference picture with a pixel bit accuracy of 8 bits expands DPCM compressed data with a period of 8 pixels and a prediction error of 5 bits, and is supplied to the video encoder 101. As shown in FIG.
  • the compressed output signal y (n) is obtained by the number (1).
  • the pixel value x (0) at the left end of the block is encoded by PCM as a reference pixel for prediction, that is, the input pixel value is stored. Otherwise, the fixed-length index value epqridx (n) of the quantized representative value array for the quantized representative value epqr (n) is obtained. epqridx (n) is obtained using the numbers (2), (3), (4), (5).
  • ep (n) represents a prediction error
  • xp (n) represents a predicted pixel value
  • xr (n) represents a decoded pixel value.
  • the expansion of the output signal x (n) ′ is obtained by the equation (6).
  • DPCM compression using the number (7) and the number (8) is also possible by using the complement expression.
  • the compression and expansion operations based on the DPCM can be defined by the information regarding the DPCM processing cycle N and the number of bits M.
  • compression and expansion operations based on DPCM can be defined by adding information about the element values of 2 ⁇ M quantized representative value arrays. .
  • information on element values of 2 ⁇ M quantized representative value arrays may be added by the number of the quantized representative value arrays.
  • information including the DPCM processing period N, the number of bits M, and the element values of the quantized representative value array is referred to as DPCM auxiliary information.
  • the memory compression / decompression controller 106 supplies DPCM auxiliary information to the multiplexer 105 in order to apply the same reference picture compression and reference picture expansion as those of the video encoding apparatus to the reference picture in the video decoding apparatus.
  • the multiplexer 105 multiplexes the video bit stream and the DPCM auxiliary information and outputs the bit stream.
  • the DPCM auxiliary information is multiplexed with the sequence parameters as shown in Table 1 and Table 2 below for each GOP that becomes the random access period, according to the description of “Specification of syntax functions, categories, and descriptors” in Non-Patent Document 1. Can be considered.
  • mem_compression_flag is a fixed length syntax in which a flag indicating whether to apply DPCM compression to a reference picture is encoded with fixed 1 bit. 1 means apply, 0 means do not apply DPCM compression.
  • Dpcm_luma_interval_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the DPCM compression processing period N for the luminance signal is encoded based on an unsigned Exp-Golomb code.
  • dpcm_luma_interval_minus1 DPCM compression should not be applied to the reference picture of the luminance signal.
  • Dpcm_luma_bit_depth_minus1 is a variable-length syntax obtained by encoding a value obtained by subtracting 1 from the number M of DPCM compression bits for a luminance signal based on an unsigned Exp-Golomb code.
  • dpcm_luma_interval_minus1 When the decoded value of dpcm_luma_interval_minus1 is 0, dpcm_luma_bit_depth_minus1 must be a value obtained by adding 7 to bit_depth_luma_minus8.
  • dpcm_luma_qmatrix_present_flag is a fixed 1-bit encoded flag indicating whether or not there is a quantized representative value array having elements different from the specified quantized representative value array in DPCM compression used for luminance signals It has a fixed length syntax. 1 means it exists, 0 means it does not exist. When the decoded value of dpcm_luma_interval_minus1 is 1, dpcm_luma_qmatrix_present_flag must be 0.
  • Dpcm_luma_qmatrix_num_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the number of DPCM compressed quantized representative value arrays used for luminance signals is encoded based on an unsigned Exp-Golomb code.
  • Dpcm_chroma_interval_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the DPCM compression processing period N for the color difference signal is encoded based on an unsigned Exp-Golomb code.
  • dpcm_chroma_interval_minus1 DPCM compression should not be applied to the reference picture of the color difference signal.
  • Dpcm_chroma_bit_depth_minus1 is a variable-length syntax obtained by encoding a value obtained by subtracting 1 from the number M of DPCM compression bits for the color difference signal based on the unsigned Exp-Golomb code.
  • dpcm_chroma_interval_minus1 When the decoded value of dpcm_chroma_interval_minus1 is 0, dpcm_chroma_bit_depth_minus1 must be a value obtained by adding 7 to bit_depth_chroma_minus8.
  • dpcm_chroma_qmatrix_present_flag is a fixed 1-bit encoding flag indicating whether or not there is a quantized representative value array having elements different from the specified quantized representative value array in DPCM compression used for color difference signals. It has a fixed length syntax. 1 means it exists, 0 means it does not exist. When the decoded value of dpcm_chroma_interval_minus1 is 1, dpcm_chroma_qmatrix_present_flag must be 0.
  • Dpcm_chroma_qmatrix_num_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the number of DPCM compressed quantized representative value arrays used for color difference signals is encoded based on an unsigned Exp-Golomb code.
  • Scale is a fixed length syntax in which each element of the quantized representative value array is encoded with a fixed number of unsigned bits.
  • the number of bits is the number of sample bits of the corresponding component (luminance or color difference).
  • step S10001 the memory compression / decompression controller 106 applies DPCM auxiliary information to the memory compressor 103, the memory decompressor 104, and the reference picture compression and reference picture decompression, which are the same as those of the video encoding device, to the reference picture.
  • the multiplexer 105 is supplied to the multiplexer 105.
  • step S10002 the memory decompressor 104 stores the DPCM compressed data stored in the reference picture memory 102 including the reconstructed image area of the reference picture requested from the video encoder 101 based on the supplied DPCM auxiliary information. Is expanded and supplied to the video encoder 101.
  • step S10003 the video encoder 101 encodes each frame of the input video with a predetermined picture type (I picture, P picture, or B picture) and supplies the video bit stream to the multiplexer 105. To do.
  • a predetermined picture type I picture, P picture, or B picture
  • step S10004 the memory compressor 103 applies DPCM compression to the reconstructed image supplied from the video encoder 101 based on the supplied DPCM auxiliary information, and stores it in the reference picture memory 102.
  • step S10005 the multiplexer 105 multiplexes the video bitstream and the DPCM auxiliary information and outputs the bitstream.
  • step S10006 if the output bit stream is the last frame of video encoding, video encoding is terminated. If it is not the last frame, the process returns to S10001.
  • FIG. 8 shows a video decoding apparatus according to the second embodiment.
  • a demultiplexer 205 and a memory compression / decompression controller 206 are newly provided. Since the operations of the memory compressor 203 and the memory decompressor 204 are the same as those of the memory compressor 103 and the memory decompressor 104 described in the first embodiment, the demultiplexer 205 and the memory compression / decompression controller 206 are respectively used. The operation will be described.
  • the demultiplexer 205 demultiplexes the bitstream and extracts the video bitstream and DPCM auxiliary information.
  • the DPCM auxiliary information is supplied to the memory compression / decompression controller 206, and the video bitstream is supplied to the video decoder 201.
  • the memory compression / decompression controller 206 is configured to apply the same reference picture compression and reference picture decompression to the reference picture in the video decoding apparatus based on the supplied DPCM auxiliary information.
  • the operation of 203 and the memory expander 204 is set.
  • the video decoder 201 decodes the video bitstream and outputs the reconstructed image (decoded video) while reading the reconstructed image of the reference picture used for prediction from the reference picture memory 102 via the decompressor 204. Is decoded, a decoded image necessary as a reference picture is stored in the reference picture memory 202 via the compressor 203 by a sliding window method or the like for subsequent frame decoding.
  • step S20001 the demultiplexer 205 demultiplexes the bitstream and extracts the video bitstream and DPCM auxiliary information.
  • step S20002 the memory compression / decompression controller 206 applies the same reference picture compression and reference picture decompression to the reference picture also in the video decoding apparatus based on the supplied DPCM auxiliary information.
  • the operation of the memory compressor 203 and the memory decompressor 204 is set.
  • step S20003 the memory decompressor 204 stores the DPCM compressed data stored in the reference picture memory 202 including the reconstructed image area of the reference picture requested from the video decoder 201 based on the supplied DPCM auxiliary information.
  • the data is decompressed and supplied to the video decoder 201.
  • step S20004 the video decoder 201 decodes the input video bitstream.
  • a decoded image necessary as a reference picture is stored in the reference picture memory 202 via the compressor 203 by a sliding window method or the like.
  • step S20005 the memory compressor 203 applies DPCM compression to the decoded image supplied from the video decoder 201 based on the supplied DPCM auxiliary information, and stores it in the reference picture memory 202.
  • step S20006 if the decoded bit stream is the last frame of video decoding, video decoding is terminated. If it is not the last frame, the process returns to S20001.
  • the video encoding apparatus according to this embodiment will be described with reference to FIG. Compared with the conventional video encoding apparatus of FIG. 2, a memory compressor 103, a memory decompressor 104, a multiplexer 105, and a memory compression / decompression controller 106 are newly provided.
  • the memory compressor 103 and the memory decompressor 104 operate at a compression rate of a plurality of stages including non-compression.
  • the video encoder 101 encodes each frame of the input video and supplies the generated video bitstream to the multiplexer 105.
  • the video encoder 101 reads a reconstructed image of the reference picture used for prediction from the reference picture memory 102 via the memory expander 104.
  • the video encoder 101 stores the reconstructed image of each frame in the reference picture memory 102 via the memory compressor 103.
  • the memory compression / decompression controller 106 calculates the size of the reference picture memory 102 according to a reference picture management parameter given from the outside, and calculates the number of reference pictures stored in the reference picture memory 102 for each memory compression rate. .
  • the memory arrangement of the reference picture memory 102 is determined by the size of the reference picture memory 102 and the number of reference pictures stored for each memory compression rate.
  • the memory compression / decompression controller 106 determines a memory compression rate for each frame, and signals the determined memory compression rate to the memory compressor 103 and the memory expander 104.
  • the memory compression / decompression controller 106 multiplexes information on the size of the reference picture memory 102, the number of reference pictures stored for each memory compression rate, and the memory compression rate for each frame as a compression memory management parameter. Supply to 105.
  • the memory compressor 103 performs compression processing on the reconstructed image supplied from the video encoder 101 at the memory compression rate signaled from the memory compression / decompression controller 106, and compresses the compressed data according to the memory arrangement. Store in the memory 102.
  • the memory expander 104 supplies the reference picture area requested from the video encoder 101 by expanding the compressed data of the reference picture memory 102.
  • the multiplexer 105 multiplexes the video bitstream and the compression memory management parameter and outputs the video bitstream.
  • FIG. 8 shows a video decoding apparatus according to the fourth embodiment.
  • a demultiplexer 205 and a memory compression / decompression controller 206 are newly provided.
  • the memory compressor 203 and the memory decompressor 204 operate at a compression rate of a plurality of stages including non-compression.
  • the demultiplexer 205 demultiplexes the bitstream and extracts the video bitstream and the compressed memory management parameter.
  • the video bit stream is supplied to the video decoder 201.
  • the size of the reference picture memory 202, the number of reference pictures stored for each memory compression rate, and the memory compression rate for each frame included in the compression memory management parameter are supplied to the memory compression / decompression controller 206.
  • the memory compression / decompression controller 206 determines the memory arrangement of the reference picture memory 202 according to the size of the reference picture memory 202 supplied from the demultiplexer 205 and the number of reference pictures stored for each memory compression rate. . The determined memory arrangement is signaled to the memory compressor 203 and the memory decompressor 204.
  • the memory compression / decompression controller 206 signals the memory compression rate for each frame supplied from the demultiplexer 205 to the memory compressor 203 and holds it.
  • the memory compression rate corresponding to each reference picture referenced from the video encoder 101 is signaled to the memory decompressor 204 from the stored memory compression rates.
  • the video decoder 201 reads a reference picture reconstructed image used for inter-frame prediction from the reference picture memory 202 via the memory decompressor 204 and decodes the video bitstream to generate a reconstructed image (decoded video). Then, the reconstructed image is stored in the reference picture memory 202 via the memory compressor 203.
  • the memory compressor 203 performs compression processing on the reconstructed image supplied from the video decoder 201 at the compression rate signaled from the memory compression / decompression controller 206, and the compressed data is referred to the reference picture memory 202 according to the memory arrangement. To store.
  • the memory expander 204 supplies the reference picture area requested from the video decoder 201 by expanding the compressed data of the reference picture memory 202.
  • Tables 1 and 2 in the first embodiment show an embodiment in which information of a plurality of quantized representative value arrays is multiplexed into a bitstream for DPCM auxiliary information.
  • the present invention provides a minimum of DPCM processing by multiplexing the index information of the selected quantized representative value array into the DPCM compressed data by the memory compressor of each video encoding and decoding device. It is also possible to switch the quantized representative value array in units of N pixels that are periods.
  • DPCM auxiliary information is multiplexed into the sequence parameter for each GOP that becomes a random access cycle.
  • DPCM auxiliary information is multiplexed into picture parameters used for encoding / decoding for each frame as shown in Table 3 or Table 4 below, so that DPCM compression characteristics can be obtained in units of frames. It is also possible to switch.
  • the present invention relates to an input video as described in Non-Patent Document 2 (Reiko Noda, Ken Nakajo, “A moving picture coding efficiency improvement method by extending pixel bit length”, Information Science and Technology Forum 2006 J-009, 2006.)
  • Non-Patent Document 2 Reiko Noda, Ken Nakajo, “A moving picture coding efficiency improvement method by extending pixel bit length”, Information Science and Technology Forum 2006 J-009, 2006.
  • the present invention can also be applied to a purpose of reducing the reference picture memory that increases in accordance with the expanded bit depth.
  • the information processing system shown in FIG. 10 includes a processor A1001, a program memory A1002, and storage media A1003 and A1004.
  • the storage media A1003 and A1004 may be separate storage media, or may be storage areas composed of the same storage medium.
  • a magnetic storage medium such as a hard disk can be used as the storage medium.
  • the video encoding apparatus uses the reference picture compression auxiliary information as a bitstream so that the video decoding apparatus can apply the same reference picture compression and reference picture expansion as the video encoding apparatus to the reference picture.
  • the video decoding apparatus includes means for demultiplexing the bitstream to extract the auxiliary information, and controlling the reference picture compression means and the reference picture expansion means based on the information.
  • the pixel values of the reference picture can be completely matched.
  • the memory bandwidth is reduced as in the video decoding device.
  • the video encoding device of the present invention stores the reference picture memory in the reference picture memory for each compression rate so that the memory arrangement of the reference picture memory can be determined in the video decoding device. Multiplexed in an information bitstream related to the number of reference pictures to be performed.
  • the video decoding device of the present invention includes means for extracting information related to the number of multiplexed reference pictures to be stored in the reference picture memory for each compression ratio and determining the memory arrangement based on the extracted information. In both the video encoding device and the video decoding device, the memory arrangement of the reference picture memory can be completely matched. As a result, even if the compression rate of reference picture compression is changed in units of frames, problems such as memory copying for alignment purposes are avoided.
  • Video encoding means for encoding an input video based on prediction; Reference picture compression means for compressing a reference picture used for prediction by the video encoding means; Reference picture storage means for storing the compressed reference picture; Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means; Compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on predetermined operating parameters;
  • a video encoding apparatus comprising: a multiplexing unit that multiplexes the video bit stream of the video encoding unit and the operation parameter of the compression / decompression control unit.
  • the reference picture compression means and the reference picture expansion means are compression means and expansion means based on differential pulse code modulation,
  • the reference picture compression means and the reference picture decompression means operate at a compression rate of a plurality of stages,
  • the video encoding apparatus according to appendix 1 or appendix 2, wherein the compression rate is set according to an operation parameter of the compression / decompression control means.
  • Additional remark 4 The video coding apparatus of Additional remark 3 which manages the reference picture stored in the said reference picture storage means for every compression rate.
  • Demultiplexing means for demultiplexing an input bitstream including operation parameters for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed;
  • Video decoding means for decoding the demultiplexed video bitstream based on prediction;
  • Reference picture compression means for compressing a reference picture used for prediction by the video decoding means;
  • Reference picture storage means for storing the compressed reference picture;
  • Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means, and based on operation parameters included in the demultiplexed input bitstream, the reference picture compression means and the reference picture decompression means, And a compression / decompression control means for controlling the video.
  • the reference picture compression means and the reference picture decompression means are compression means and decompression means based on differential pulse code modulation,
  • the video decoding device according to appendix 6, wherein the operation parameters of the compression / decompression control means include at least a processing period of differential pulse coding modulation and a bit number of differential pulse coding modulation.
  • the reference picture compression means and the reference picture expansion means operate at a compression rate of a plurality of stages,
  • the video decoding device according to appendix 6 or appendix 7, wherein the compression rate is set according to an operation parameter of the compression / decompression control means.
  • the demultiplexing unit extracts at least information on the number of reference pictures to be held for each compression rate,
  • the video decoding device according to appendix 9, wherein the memory arrangement of the reference picture storage unit is determined based on information on the number of reference pictures to be held for each compression rate.
  • Video encoding means for encoding an input video based on prediction; Reference picture compression means for compressing a reference picture used for prediction by the video encoding means; Reference picture storage means for storing the compressed reference picture; Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means; Compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on predetermined operating parameters; A video encoding unit having a video bit stream of the video encoding unit and a multiplexing unit that multiplexes the operation parameter of the compression / decompression control unit; Demultiplexing means for demultiplexing the input bitstream and separating the video bitstream and the operation parameter; Video decoding means for decoding the demultiplexed video bitstream based on prediction; Reference picture compression means for compressing a reference picture used for prediction by the video decoding means; Reference picture storage means for storing the compressed reference picture; Video having reference picture decompression means for decompressing a
  • a compression process for compressing a reference picture used for the prediction and generating a compressed reference picture
  • Decompression processing for decompressing the compressed reference picture
  • a compression / decompression control process for controlling the compression process and the expansion process based on a predetermined operation parameter
  • a video encoding method comprising: a multiplexing process for multiplexing the encoded video bitstream and the operation parameter.
  • the compression processing and the decompression processing are compression processing and decompression processing based on differential pulse coding modulation,
  • the compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and the compression processing and the decompression processing are performed.
  • Demultiplexing processing for demultiplexing an input bitstream when including an operation parameter for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed;
  • a video decoding process for decoding the demultiplexed video bitstream based on prediction;
  • a compression process for compressing a reference picture used for prediction in the video decoding process and generating a compressed reference picture;
  • a video decoding method comprising: a decompression process for decompressing the compressed reference picture; and a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream.
  • the compression processing and the decompression processing are compression processing and decompression processing based on differential pulse code modulation,
  • the compression process and the decompression process are performed at a compression rate of a plurality of stages, and the compression process and the decompression process are performed. 19.
  • the demultiplexing process extracts at least information on the number of reference pictures to be held for each compression rate,
  • the video decoding method according to appendix 20 wherein a memory arrangement for storing a compressed reference picture is determined based on information on the number of compressed reference pictures to be held for each compression rate.
  • Processing for encoding input video based on prediction A compression process for compressing a reference picture used for the prediction and generating a compressed reference picture; Decompression processing for decompressing the compressed reference picture; A compression / decompression control process for controlling the compression process and the expansion process based on a predetermined operation parameter; A program for causing an information processing apparatus to execute a multiplexing process for multiplexing the encoded video bitstream and the operation parameter.
  • the compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and the compression processing and the decompression processing are performed.
  • the compression process and the decompression process are performed at a compression rate of a plurality of stages, and the compression process and the decompression process are performed.
  • auxiliary information related to compression and expansion of the reference picture is multiplexed with the video bitstream obtained by encoding the input video based on prediction using the reference picture,

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

An image encoding apparatus comprises: an image encoding means for encoding, based on a prediction, an input image; a reference picture compressing means for compressing a reference picture that is to be used in the prediction in the image encoding means; a reference picture storing means for storing the reference picture as compressed; a reference picture decompressing means for decompressing the reference picture as compressed and stored in the reference picture storing means; a compression/decompression control means for controlling, based on predetermined operation parameters, the reference picture compressing means and the reference picture decompressing means; and a multiplexing means for multiplexing the image bitstream of the image encoding means with the operation parameters of the compression/decompression control means.

Description

映像符号装置、映像復号装置、映像符号方法、映像復号方法及びプログラムVideo encoding device, video decoding device, video encoding method, video decoding method, and program
　本発明は、映像符号装置、映像復号装置、映像符号方法、映像復号方法及びプログラムに関する。 The present invention relates to a video encoding device, a video decoding device, a video encoding method, a video decoding method, and a program.
　本発明に関連する映像符号化装置は、入力映像の各フレームに、所定の映像符号化方式に準拠した符号化処理を行うことで符号化データすなわちビットストリームを生成する。所定の映像符号化方式の代表例である、非特許文献１のISO/IEC 14496-10 Advanced Video Coding （AVC）は、各フレームをMB（Macro Block）とよばれる16x16画素サイズのブロックに分割し、さらに前記MBを4x4画素サイズのブロック分割した（以後、4x4ブロックと呼ぶ）、前記4x4ブロックを符号化の最小構成単位とする。フレームの空間解像度がQCIF（Quarter Common Intermediate Format）、4:2:0フォーマットの場合での、前記ブロック分割の例を図１に示す。 The video encoding apparatus related to the present invention generates encoded data, that is, a bit stream, by performing an encoding process based on a predetermined video encoding method on each frame of the input video. ISO / IEC 14496-10 Advanced Video Coding (AVC), which is a typical example of a predetermined video encoding method, divides each frame into blocks of 16x16 pixel size called MB (Macro Block). Further, the MB is further divided into blocks of 4 × 4 pixel size (hereinafter referred to as 4 × 4 blocks), and the 4 × 4 block is set as the minimum structural unit of encoding. FIG. 1 shows an example of the block division in the case where the spatial resolution of the frame is QCIF (Quarter Common Intermediate Format), 4: 2: 0 format.
　分割されたブロックは、フレ－ム内予測あるいはフレ－ム間予測に基づいて符号化される。フレ－ム内予測は、現在符号化処理対象のフレ－ムの再構築画像を用いて画像を予測する方法である。フレ－ム間予測は、現在の符号化処理対象のフレームよりも過去に符号化されたフレ－ムの再構築画像を用いて画像を予測する方法である。このように符号化済み画像の再構築画像から予測し、符号化する従来の映像符号化装置は、予測で参照される再構築画像を含むフレーム（以後、参照ピクチャと呼ぶ）を格納する参照ピクチャメモリを備える（図２を参照）。 The divided blocks are encoded based on intra-frame prediction or inter-frame prediction. Intraframe prediction is a method of predicting an image using a reconstructed image of the current frame to be encoded. Inter-frame prediction is a method for predicting an image using a reconstructed image of a frame encoded in the past from the current encoding target frame. A conventional video encoding apparatus that predicts and encodes a reconstructed image of a coded image in this way, a reference picture that stores a frame (hereinafter referred to as a reference picture) that includes the reconstructed image that is referenced in the prediction. A memory is provided (see FIG. 2).
　なお、フレーム内の全てのMBにフレーム内予測を適用して符号化した画像フレームをIピクチャと呼ぶ。フレーム内予測に加えて、MBに最大で１枚の参照ピクチャを用いるフレーム間予測を適用して符号化した画像フレームをPピクチャと呼ぶ。更に、MBに同時に２枚の参照ピクチャを用いるフレーム間予測を適用して符号化した画像フレームをBピクチャと呼ぶ。一般に、Iピクチャは一定周期で設定され、このIピクチャで区切られる複数フレームからなる区間をGOP（グループオブピクチャ）と呼ぶ。 Note that an image frame encoded by applying intra-frame prediction to all MBs in a frame is called an I picture. In addition to intra-frame prediction, an image frame encoded by applying inter-frame prediction using a maximum of one reference picture for MB is called a P picture. Furthermore, an image frame encoded by applying inter-frame prediction using two reference pictures simultaneously for the MB is called a B picture. In general, an I picture is set at a fixed period, and a section composed of a plurality of frames divided by the I picture is called a GOP (group of pictures).
　ところで、従来の映像符号化装置の出力ビットストリームを復号して復号映像を得る、従来の映像復号装置において、特許文献１では、映像復号装置のメモリ帯域を削減するために、参照ピクチャに差分パルス符号化変調（Differential Pulse Code Modulation（DPCM））に基づいた非可逆圧縮を適用して参照ピクチャメモリに格納することが記載されている（図３を参照）。 By the way, in a conventional video decoding apparatus that decodes an output bit stream of a conventional video encoding apparatus to obtain a decoded video, in Patent Document 1, in order to reduce the memory bandwidth of the video decoding apparatus, a differential pulse is applied to a reference picture. It is described that irreversible compression based on coded modulation (Differential | Pulse | Code | Modulation (DPCM)) is applied and it stores in a reference picture memory (refer FIG. 3).
ＷＯ２００７／０９１５８８号公報WO2007 / 091588
　しかしながら、映像復号装置のみにて非可逆圧縮を参照ピクチャに適用すると、映像符号化装置と映像復号装置間で参照ピクチャの画素値が完全に一致することが保証されない。ゆえに、従来の映像符号化技術および復号技術においては、これに起因して発生する復号映像の画質劣化が課題となる。 However, when irreversible compression is applied to a reference picture only by the video decoding device, it is not guaranteed that the pixel values of the reference picture are completely the same between the video encoding device and the video decoding device. Therefore, in the conventional video encoding technique and decoding technique, degradation of the image quality of the decoded video caused by this becomes a problem.
　また、参照ピクチャごとに無作為に圧縮率を変えると、映像復号器側でメモリ配置が定まらず、必要以上に大きな参照ピクチャメモリを用意するか、整列のためにメモリのコピーが発生してしまうという問題がある。ゆえに、いかにメモリ配置を確定させるかも課題である。 In addition, if the compression rate is changed randomly for each reference picture, the memory arrangement is not determined on the video decoder side, and a reference picture memory larger than necessary is prepared, or a memory copy occurs for alignment. There is a problem. Therefore, how to determine the memory allocation is also a problem.
　そこで、本発明は上記課題に鑑みて発明されたものであって、その目的は、復号映像の画質劣化を解消する映像符号装置、映像復号装置、映像符号方法、映像復号方法及びプログラムを提供することにある。 Accordingly, the present invention has been invented in view of the above problems, and an object of the present invention is to provide a video encoding device, a video decoding device, a video encoding method, a video decoding method, and a program that can eliminate degradation in the image quality of decoded video. There is.
　上記課題を解決する本発明は、入力映像を予測に基づいて符号化する映像符号化手段と、前記映像符号化手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、所定の動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と、前記映像符号化手段の映像ビットストリームと、前記圧縮伸張制御手段の前記動作パラメータとを多重化する多重化手段とを有する映像符号化装置である。 The present invention that solves the above-described problems includes a video encoding unit that encodes an input video based on prediction, a reference picture compression unit that compresses a reference picture used for prediction by the video encoding unit, and a compressed reference picture A reference picture storage means for storing the reference picture, a reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means, the reference picture compression means and the reference picture decompression means based on predetermined operating parameters, A video encoding apparatus comprising: a compression / decompression control unit that controls the video; a video bitstream of the video encoding unit; and a multiplexing unit that multiplexes the operation parameters of the compression / decompression control unit.
　上記課題を解決する本発明は、予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含む入力ビットストリームの多重化を解除する多重化解除手段と、前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号手段と、前記映像復号手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、前記圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段とを有する映像復号装置である。 The present invention for solving the above-mentioned problems is a demultiplexing means for demultiplexing an input bitstream including operation parameters for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed, Video decoding means for decoding the demultiplexed video bitstream based on prediction, reference picture compression means for compressing a reference picture used for prediction by the video decoding means, and a reference for storing the compressed reference picture Picture storage means; reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means; and the reference picture compression means based on operating parameters included in the demultiplexed input bitstream; Video decompression control means for controlling the reference picture decompression means. It is a device.
　上記課題を解決する本発明は、入力映像を予測に基づいて符号化する映像符号化手段と、前記映像符号化手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、所定の動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と、前記映像符号化手段の映像ビットストリームと、前記圧縮伸張制御手段の前記動作パラメータとを多重化する多重化手段とを有する映像符号化部と、入力ビットストリームの多重化を解除し、映像ビットストリームと前記動作パラメータとを分離する多重化解除手段と、前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号手段と、前記映像復号手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、前記圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、前記動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段とを有する映像復号部とを有する映像符号／復号システムである。 The present invention that solves the above-described problems includes a video encoding unit that encodes an input video based on prediction, a reference picture compression unit that compresses a reference picture used for prediction by the video encoding unit, and a compressed reference picture A reference picture storage means for storing the reference picture, a reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means, the reference picture compression means and the reference picture decompression means based on predetermined operating parameters, A video encoding unit having a compression / decompression control unit that controls the video bit stream of the video encoding unit and a multiplexing unit that multiplexes the operation parameters of the compression / decompression control unit; Demultiplexing means for demultiplexing and separating the video bitstream and the operation parameter, and the multiplexing Video decoding means for decoding the released video bitstream based on prediction, reference picture compression means for compressing a reference picture used for prediction by the video decoding means, and reference picture storage means for storing the compressed reference picture A reference picture decompression unit that decompresses the compressed reference picture stored in the reference picture storage unit, and a compression / decompression control unit that controls the reference picture compression unit and the reference picture decompression unit based on the operation parameter; A video encoding / decoding system including a video decoding unit including
　上記課題を解決する本発明は、入力映像を予測に基づいて符号化する処理と、前記予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、前記圧縮参照ピクチャを伸張する伸張処理と、所定の動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と、前記符号化された映像ビットストリームと、前記動作パラメータとを多重化する多重化処理とを有する映像符号化方法である。 The present invention that solves the above-described problems includes a process for encoding an input video based on prediction, a compression process for compressing a reference picture used for the prediction and generating a compressed reference picture, and a decompression for expanding the compressed reference picture A process, a compression / decompression control process for controlling the compression process and the decompression process based on a predetermined operation parameter, a multiplexing process for multiplexing the encoded video bitstream, and the operation parameter; Is a video encoding method.
　上記課題を解決する本発明は、予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含むと入力ビットストリームの多重化を解除する多重化解除処理と、前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号処理と、前記映像復号処理で予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、前記圧縮参照ピクチャを伸張する伸張処理と、前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理とを有する映像復号方法である。 The present invention for solving the above problems includes a demultiplexing process for demultiplexing an input bitstream when an operation parameter for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed is included. A video decoding process for decoding the demultiplexed video bitstream based on prediction, a compression process for generating a compressed reference picture by compressing a reference picture used for prediction in the video decoding process, and the compressed reference picture And a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream.
　上記課題を解決する本発明は、入力映像を予測に基づいて符号化する処理と、前記予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、前記圧縮参照ピクチャを伸張する伸張処理と、所定の動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と、前記符号化された映像ビットストリームと、前記動作パラメータとを多重化する多重化処理とを情報処理装置に実行させるプログラムである。 The present invention that solves the above-described problems includes a process for encoding an input video based on prediction, a compression process for compressing a reference picture used for the prediction and generating a compressed reference picture, and a decompression for expanding the compressed reference picture A process, a compression / decompression control process for controlling the compression process and the decompression process based on a predetermined operation parameter, a multiplexing process for multiplexing the encoded video bitstream, and the operation parameter; Is a program that causes the information processing apparatus to execute the program.
　上記課題を解決する本発明は、予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含むと入力ビットストリームの多重化を解除する多重化解除処理と、前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号処理と、前記映像復号処理で予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、前記圧縮参照ピクチャを伸張する伸張処理と、前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理とを情報処理装置に実行させるプログラムである。 The present invention for solving the above problems includes a demultiplexing process for demultiplexing an input bitstream when an operation parameter for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed is included. A video decoding process for decoding the demultiplexed video bitstream based on prediction, a compression process for generating a compressed reference picture by compressing a reference picture used for prediction in the video decoding process, and the compressed reference picture A program for causing an information processing device to execute a decompression process for decompressing and a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream is there.
　上記課題を解決する本発明は、映像符号化側において、参照ピクチャを用いた予測に基づいて入力映像を符号化して得られた映像ビットストリームに、前記参照ピクチャの圧縮及び伸張に関する補助情報を多重化し、映像復号側において、前記映像ビットストリームの多重を解除して、前記補助情報を抽出し、前記補助情報に基づいて、前記参照ピクチャの圧縮及び伸張を制御する映像符号復号方法である。 The present invention that solves the above problem multiplexes auxiliary information related to compression and decompression of the reference picture into a video bitstream obtained by encoding an input video based on prediction using a reference picture on the video encoding side. In the video decoding method, the video decoding side demultiplexes the video bitstream, extracts the auxiliary information, and controls compression and expansion of the reference picture based on the auxiliary information.
　本発明によれば、復号映像の画質劣化を解消することができる。 According to the present invention, it is possible to eliminate the degradation of the image quality of the decoded video.
図１はフレームのブロック分割例を示した図である。FIG. 1 is a diagram showing an example of block division of a frame. 図２は関連する映像符号化装置を示した図である。FIG. 2 is a diagram illustrating a related video encoding apparatus. 図３は関連する映像復号装置を示した図である。FIG. 3 is a diagram showing a related video decoding apparatus. 図４は第１の実施の形態の映像符号化装置を示した図である。FIG. 4 is a diagram illustrating a video encoding apparatus according to the first embodiment. 図５はDPCMによる圧縮例を示した図である。FIG. 5 is a diagram showing an example of compression by DPCM. 図６はDPCMによる伸張例を示した図である。FIG. 6 is a diagram showing an example of expansion by DPCM. 図７は第１の実施の形態の映像符号化フローチャートである。FIG. 7 is a video encoding flowchart according to the first embodiment. 図８は第２の実施の形態の映像復号装置を示した図である。FIG. 8 is a diagram illustrating a video decoding apparatus according to the second embodiment. 図９は第２の実施の形態の映像復号フローチャートを示した図である。FIG. 9 is a diagram illustrating a video decoding flowchart according to the second embodiment. 図１０は本発明の情報処理装置の構成を示した図である。FIG. 10 is a diagram showing the configuration of the information processing apparatus of the present invention.
　本発明の概要を説明する。 The outline of the present invention will be described.
　本発明の映像符号化装置は、入力映像をフレーム間予測に基づいて符号化する映像符号化手段と、フレーム間予測の参照ピクチャを圧縮する参照ピクチャ圧縮手段と、圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、参照ピクチャ圧縮手段と参照ピクチャ伸張手段を制御する圧縮伸張制御手段と、映像符号化手段の映像ビットストリームと圧縮伸張制御手段の動作パラメータを多重化する多重化手段を備えたことを特徴とする。 The video encoding apparatus according to the present invention stores video encoding means for encoding an input video based on inter-frame prediction, reference picture compression means for compressing a reference picture for inter-frame prediction, and a compressed reference picture. Reference picture storage means, reference picture expansion means for expanding the compressed reference picture stored in the reference picture storage means, compression / decompression control means for controlling the reference picture compression means and reference picture expansion means, and video of the video encoding means A multiplexing means for multiplexing the operating parameters of the bit stream and the compression / decompression control means is provided.
　本発明の映像復号装置は、入力ビットストリームの多重化を解除する多重化解除手段と、多重化解除された映像ビットストリームをフレーム間予測に基づいて復号する映像復号手段と、多重化解除された圧縮伸張制御手段の動作パラメータに基づいて参照ピクチャ圧縮手段と参照ピクチャ伸張手段を制御する圧縮伸張制御手段と、フレーム間予測の参照ピクチャを圧縮する参照ピクチャ圧縮手段と、圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段を備えたことを特徴とする。 The video decoding apparatus according to the present invention includes a demultiplexing unit that demultiplexes an input bitstream, a video decoding unit that decodes the demultiplexed video bitstream based on interframe prediction, and a demultiplexing unit A compression / decompression control unit that controls the reference picture compression unit and the reference picture expansion unit based on an operation parameter of the compression / decompression control unit, a reference picture compression unit that compresses a reference picture for inter-frame prediction, and a compressed reference picture And a reference picture expansion means for expanding the compressed reference picture stored in the reference picture storage means.
　映像符号化装置によってビットストリームに多重化された圧縮伸張制御手段の動作パラメータは、映像復号装置において、映像符号化装置と同一の参照ピクチャ圧縮及び参照ピクチャ伸張を参照ピクチャに適用するための補助情報となる。映像復号装置が、ビットストリームを多重化解除して前記補助情報を抽出し、それに基づいて参照ピクチャ圧縮手段と参照ピクチャ伸張手段を制御する手段を備えることによって、映像符号化装置と映像復号装置間で参照ピクチャの画素値を完全に一致させることができる。 The operation parameters of the compression / decompression control means multiplexed into the bitstream by the video encoding apparatus are auxiliary information for applying the same reference picture compression and reference picture expansion to the reference picture in the video decoding apparatus. It becomes. The video decoding apparatus includes means for demultiplexing the bitstream to extract the auxiliary information, and controlling the reference picture compression means and the reference picture expansion means based on the demultiplexed information. Thus, the pixel values of the reference picture can be completely matched.
　本発明によれば、映像符号化装置と映像復号装置間で参照ピクチャの画素値が完全に一致するため、従来技術における復号映像のドリフトが解消される。さらに、映像符号化装置においても、映像復号装置と同様に、メモリ帯域が削減される。 According to the present invention, since the pixel values of the reference picture are completely the same between the video encoding device and the video decoding device, the drift of the decoded video in the prior art is eliminated. Further, in the video encoding device, the memory bandwidth is reduced as in the video decoding device.
　また、参照ピクチャ圧縮の圧縮率をフレーム単位で変える場合において、本発明の映像符号化装置は、映像復号装置において参照ピクチャメモリのメモリ配置が確定できるように、圧縮率ごとに参照ピクチャメモリに格納すべき参照ピクチャの枚数に関連する情報ビットストリームに多重化する手段を備える。 In addition, when changing the compression rate of reference picture compression in units of frames, the video encoding device of the present invention stores the reference picture memory in the reference picture memory for each compression rate so that the memory arrangement of the reference picture memory can be determined in the video decoding device. Means for multiplexing into an information bitstream related to the number of reference pictures to be provided.
　本発明の映像復号装置は、圧縮率ごとに参照ピクチャメモリに格納すべき参照ピクチャの枚数に関連する情報を抽出し、それに基づいてメモリ配置を決定する手段を備える。 The video decoding apparatus according to the present invention includes means for extracting information related to the number of reference pictures to be stored in the reference picture memory for each compression rate and determining a memory arrangement based on the extracted information.
　本発明によれば、参照ピクチャ圧縮の圧縮率をフレーム単位で変える場合においても、映像符号化装置と映像復号装置間で参照ピクチャメモリのメモリ配置を完全に一致させることができる。ゆえに、映像復号器側でメモリ配置が定まらず、必要以上に大きな参照ピクチャメモリを用意するか、整列のためにメモリのコピーが発生してしまうという従来の課題が解消される。 According to the present invention, even when the compression rate of the reference picture compression is changed in units of frames, the memory arrangement of the reference picture memory can be completely matched between the video encoding device and the video decoding device. Therefore, the conventional problem that the memory arrangement is not determined on the video decoder side and a reference picture memory larger than necessary is prepared or a memory copy occurs due to alignment is solved.
　以下に、具体的な実施の形態を説明する。
＜第１の実施の形態＞
　第１の実施の形態における映像符号化装置を図４に示す。 Specific embodiments will be described below.
<First Embodiment>
FIG. 4 shows a video encoding apparatus according to the first embodiment.
　図２の従来の映像符号化装置と比較すると、新たに、メモリ圧縮器103、メモリ伸張器104、多重化器105、メモリ圧縮伸張制御器106を備える。メモリ圧縮器103およびメモリ伸張器104が、N画素を処理周期とし、予測誤差をMビットで符号化するDPCMであることを仮定して、それぞれの動作を説明する。 Compared with the conventional video encoding apparatus of FIG. 2, a memory compressor 103, a memory decompressor 104, a multiplexer 105, and a memory compression / decompression controller 106 are newly provided. Each operation will be described on the assumption that the memory compressor 103 and the memory decompressor 104 are DPCMs in which N pixels are used as a processing cycle and a prediction error is encoded with M bits.
　映像符号化器101は、入力映像の各フレームを符号化し、その映像ビットストリームを多重化器105に供給する。映像符号化器101は、符号化対象フレームに対してフレーム内あるいはフレーム間予測する場合、メモリ伸張器104を介して参照ピクチャメモリ102から、予測に用いる参照ピクチャの再構築画像を読み取りこむ。映像符号化器101は、各フレームの符号化が完了する毎に、スライディングウィンドウ方式などによって、メモリ圧縮器103を介して参照ピクチャメモリ102に、参照ピクチャとしてその再構築画像を格納する。 The video encoder 101 encodes each frame of the input video and supplies the video bit stream to the multiplexer 105. The video encoder 101 reads a reconstructed image of a reference picture used for prediction from the reference picture memory 102 via the memory expander 104 when intra-frame or inter-frame prediction is performed on the encoding target frame. Each time the encoding of each frame is completed, the video encoder 101 stores the reconstructed image as a reference picture in the reference picture memory 102 via the memory compressor 103 by a sliding window method or the like.
　メモリ圧縮伸張制御器106は、DPCMの処理周期がN画素、予測誤差のビット数がMビットであることをメモリ圧縮器103、メモリ伸張器104、および、多重化器105にシグナリングする。 The memory compression / decompression controller 106 signals to the memory compressor 103, the memory expander 104, and the multiplexer 105 that the DPCM processing cycle is N pixels and the number of bits of the prediction error is M bits.
　メモリ圧縮器103は、映像符号化器101から供給される再構築画像に対して、各水平ラインをN画素毎にMビットのDPCMを適用し、DPCM圧縮データとして参照ピクチャメモリ102に格納する。例として、画素ビット精度が8ビットの参照ピクチャのある水平1ラインが、処理周期8画素、予測誤差5ビットにてDPCM圧縮されて、参照ピクチャに格納される様子を図５に示す。 The memory compressor 103 applies an M-bit DPCM for each N pixel to the reconstructed image supplied from the video encoder 101 and stores it in the reference picture memory 102 as DPCM compressed data. As an example, FIG. 5 shows how a horizontal line with a reference picture having an 8-bit pixel bit precision is subjected to DPCM compression with a processing period of 8 pixels and a prediction error of 5 bits and stored in the reference picture.
　メモリ伸張器104は、映像符号化器101から要求される参照ピクチャの再構築画像領域を含む、参照ピクチャメモリ102に格納されたDPCM圧縮データを伸張する。例として、画素ビット精度が8ビットの参照ピクチャのある水平1ラインが、周期8画素、予測誤差5ビットにてDPCM圧縮されたデータを伸張して、映像符号化器101に供給される様子を図６に示す。 The memory decompressor 104 decompresses the DPCM compressed data stored in the reference picture memory 102 including the reconstructed image area of the reference picture requested from the video encoder 101. As an example, a horizontal line with a reference picture with a pixel bit accuracy of 8 bits expands DPCM compressed data with a period of 8 pixels and a prediction error of 5 bits, and is supplied to the video encoder 101. As shown in FIG.
　ここで、DPCMによる圧縮と伸張の動作を具体的に示す例を説明する。 Here, an example that specifically shows the compression and decompression operations by DPCM will be described.
　処理周期分の入力画像の画素値をx(n), n=0,1, … , N-1とすれば、圧縮した出力信号y(n)は数(1)で求める。 If the pixel values of the input image for the processing period are x (n), n = 0, 1,…, N-1, the compressed output signal y (n) is obtained by the number (1).
Figure JPOXMLDOC01-appb-M000001
 　ブロック左端の画素値x(0)は予測の基準画素としてPCMで符号化、すなわち入力した画素値が保存される。それ以外は量子化代表値epqr(n)に対する量子化代表値配列の固定長インデックス値epqridx(n)となる。epqridx(n)は数(2), (3), (4), (5)を用いて求める。
Figure JPOXMLDOC01-appb-M000001
 The pixel value x (0) at the left end of the block is encoded by PCM as a reference pixel for prediction, that is, the input pixel value is stored. Otherwise, the fixed-length index value epqridx (n) of the quantized representative value array for the quantized representative value epqr (n) is obtained. epqridx (n) is obtained using the numbers (2), (3), (4), (5).
Figure JPOXMLDOC01-appb-M000002
Figure JPOXMLDOC01-appb-M000002
Figure JPOXMLDOC01-appb-M000003
Figure JPOXMLDOC01-appb-M000003
Figure JPOXMLDOC01-appb-M000004
Figure JPOXMLDOC01-appb-M000004
Figure JPOXMLDOC01-appb-M000005
 　ここで、ep(n)は予測誤差、xp(n)は予測画素値、xr(n)は復号画素値を表す。
　出力信号x(n)’の伸長に関しては、数(6)で求める。
Figure JPOXMLDOC01-appb-M000005
 Here, ep (n) represents a prediction error, xp (n) represents a predicted pixel value, and xr (n) represents a decoded pixel value.
The expansion of the output signal x (n) ′ is obtained by the equation (6).
Figure JPOXMLDOC01-appb-M000006
 　また、補数表現を利用することで、数(7)と数(8)を用いたDPCM圧縮も可能である。
Figure JPOXMLDOC01-appb-M000006
 Moreover, DPCM compression using the number (7) and the number (8) is also possible by using the complement expression.
Figure JPOXMLDOC01-appb-M000007
Figure JPOXMLDOC01-appb-M000007
Figure JPOXMLDOC01-appb-M000008
 　ここで、Lは参照ピクチャの画素ビット精度がBビットから一意に決定する値(L=2＾B)である。
Figure JPOXMLDOC01-appb-M000008
 Here, L is a value (L = 2 ^ B) in which the pixel bit precision of the reference picture is uniquely determined from B bits.
　上記から明らかなように、量子化代表値配列の要素値が固定値という条件下においては、DPCMの処理周期Nおよびビット数Mに関する情報によって、DPCMに基づいた圧縮と伸張の動作を規定できる。量子化代表値配列の要素値が可変値という条件においては、2＾M個の量子化代表値配列の要素値に関する情報をさらに追加することによって、DPCMに基づいた圧縮と伸張の動作を規定できる。量子化代表値配列を複数利用する場合においては、その個数分だけ、2＾M個の量子化代表値配列の要素値に関する情報をさらに追加すればよい。以後、DPCMの処理周期N、ビット数M、および、量子化代表値配列の要素値を含む情報をDPCM補助情報と呼ぶ。 As is clear from the above, under the condition that the element value of the quantized representative value array is a fixed value, the compression and expansion operations based on the DPCM can be defined by the information regarding the DPCM processing cycle N and the number of bits M. Under the condition that the element values of the quantized representative value array are variable values, compression and expansion operations based on DPCM can be defined by adding information about the element values of 2 ^ M quantized representative value arrays. . When a plurality of quantized representative value arrays are used, information on element values of 2 ^ M quantized representative value arrays may be added by the number of the quantized representative value arrays. Hereinafter, information including the DPCM processing period N, the number of bits M, and the element values of the quantized representative value array is referred to as DPCM auxiliary information.
　メモリ圧縮伸張制御器106は、映像復号装置において、映像符号化装置と同一の参照ピクチャ圧縮及び参照ピクチャ伸張を参照ピクチャに適用するために、DPCM補助情報を多重化器105に供給する。 The memory compression / decompression controller 106 supplies DPCM auxiliary information to the multiplexer 105 in order to apply the same reference picture compression and reference picture expansion as those of the video encoding apparatus to the reference picture in the video decoding apparatus.
　多重化器105は、映像ビットストリームとDPCM補助情報を多重化してビットストリームを出力する。DPCM補助情報は、非特許文献1の”Specification of syntax functions, categories, and descriptors”の記述に準ずると、ランダムアクセス周期となるGOP毎に、以下の表１、表２のようにシーケンスパラメータに多重化することが考えられる。 The multiplexer 105 multiplexes the video bit stream and the DPCM auxiliary information and outputs the bit stream. The DPCM auxiliary information is multiplexed with the sequence parameters as shown in Table 1 and Table 2 below for each GOP that becomes the random access period, according to the description of “Specification of syntax functions, categories, and descriptors” in Non-Patent Document 1. Can be considered.
Figure JPOXMLDOC01-appb-T000009
Figure JPOXMLDOC01-appb-T000009
Figure JPOXMLDOC01-appb-T000010
 　mem_compression_flagは、参照ピクチャに対してDPCM圧縮を適用するか否かを示すフラグを、固定1ビットで符号化した固定長シンタックスである。1は適用すること、0はDPCM圧縮を適用しないことを意味する。
Figure JPOXMLDOC01-appb-T000010
 mem_compression_flag is a fixed length syntax in which a flag indicating whether to apply DPCM compression to a reference picture is encoded with fixed 1 bit. 1 means apply, 0 means do not apply DPCM compression.
　dpcm_luma_interval_minus1は、輝度信号に対するDPCM圧縮の処理周期Nから１を減じた値を、符号なしExp-Golomb符号に基づいて符号化した可変長シンタックスである。dpcm_luma_interval_minus1の復号値が0の場合、輝度信号の参照ピクチャに対してDPCM圧縮を適用してはならない。 Dpcm_luma_interval_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the DPCM compression processing period N for the luminance signal is encoded based on an unsigned Exp-Golomb code. When the decoded value of dpcm_luma_interval_minus1 is 0, DPCM compression should not be applied to the reference picture of the luminance signal.
　dpcm_luma_bit_depth_minus1は、輝度信号に対するDPCM圧縮のビット数Mから１を減じた値を、符号なしExp-Golomb符号に基づいた符号化した可変長シンタックスである。dpcm_luma_interval_minus1の復号値が0の場合、dpcm_luma_bit_depth_minus1は、bit_depth_luma_minus8に7を加えた値とならなくてはならない。 Dpcm_luma_bit_depth_minus1 is a variable-length syntax obtained by encoding a value obtained by subtracting 1 from the number M of DPCM compression bits for a luminance signal based on an unsigned Exp-Golomb code. When the decoded value of dpcm_luma_interval_minus1 is 0, dpcm_luma_bit_depth_minus1 must be a value obtained by adding 7 to bit_depth_luma_minus8.
　dpcm_luma_qmatrix_present_flagは、輝度信号に対して用いるDPCM圧縮に、規定値の量子化代表値配列とは異なる要素を持つ量子化代表値配列が存在するか否かを示すフラグを、固定1ビットで符号化した固定長シンタックスである。1は存在すること、0は存在しないことを意味する。dpcm_luma_interval_minus1の復号値が1の場合、dpcm_luma_qmatrix_present_flagは0とならなくてはならない。 dpcm_luma_qmatrix_present_flag is a fixed 1-bit encoded flag indicating whether or not there is a quantized representative value array having elements different from the specified quantized representative value array in DPCM compression used for luminance signals It has a fixed length syntax. 1 means it exists, 0 means it does not exist. When the decoded value of dpcm_luma_interval_minus1 is 1, dpcm_luma_qmatrix_present_flag must be 0.
　dpcm_luma_qmatrix_num_minus1は、輝度信号に対して用いるDPCM圧縮の量子化代表値配列の個数から１を減じた値を、符号なしExp-Golomb符号に基づいて符号化した可変長シンタックスである。 Dpcm_luma_qmatrix_num_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the number of DPCM compressed quantized representative value arrays used for luminance signals is encoded based on an unsigned Exp-Golomb code.
　dpcm_chroma_interval_minus1は、色差信号に対するDPCM圧縮の処理周期Nから１を減じた値を、符号なしExp-Golomb符号に基づいて符号化した可変長シンタックスである。dpcm_chroma_interval_minus1の復号値が0の場合、色差信号の参照ピクチャに対してDPCM圧縮を適用してはならない。 Dpcm_chroma_interval_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the DPCM compression processing period N for the color difference signal is encoded based on an unsigned Exp-Golomb code. When the decoded value of dpcm_chroma_interval_minus1 is 0, DPCM compression should not be applied to the reference picture of the color difference signal.
　dpcm_chroma_bit_depth_minus1は、色差信号に対するDPCM圧縮のビット数Mから１を減じた値を、符号なしExp-Golomb符号に基づいた符号化した可変長シンタックスである。dpcm_chroma_interval_minus1の復号値が0の場合、dpcm_chroma_bit_depth_minus1は、bit_depth_chroma_minus8に7を加えた値とならなくてはならない。 Dpcm_chroma_bit_depth_minus1 is a variable-length syntax obtained by encoding a value obtained by subtracting 1 from the number M of DPCM compression bits for the color difference signal based on the unsigned Exp-Golomb code. When the decoded value of dpcm_chroma_interval_minus1 is 0, dpcm_chroma_bit_depth_minus1 must be a value obtained by adding 7 to bit_depth_chroma_minus8.
　dpcm_chroma_qmatrix_present_flagは、色差信号に対して用いるDPCM圧縮に、規定値の量子化代表値配列とは異なる要素を持つ量子化代表値配列が存在するか否かを示すフラグを、固定1ビットで符号化した固定長シンタックスである。1は存在すること、0は存在しないことを意味する。dpcm_chroma_interval_minus1の復号値が1の場合、dpcm_chroma_qmatrix_present_flagは0とならなくてはならない。 dpcm_chroma_qmatrix_present_flag is a fixed 1-bit encoding flag indicating whether or not there is a quantized representative value array having elements different from the specified quantized representative value array in DPCM compression used for color difference signals. It has a fixed length syntax. 1 means it exists, 0 means it does not exist. When the decoded value of dpcm_chroma_interval_minus1 is 1, dpcm_chroma_qmatrix_present_flag must be 0.
　dpcm_chroma_qmatrix_num_minus1は、色差信号に対して用いるDPCM圧縮の量子化代表値配列の個数から１を減じた値を、符号なしExp-Golomb符号に基づいて符号化した可変長シンタックスである。 Dpcm_chroma_qmatrix_num_minus1 is a variable length syntax in which a value obtained by subtracting 1 from the number of DPCM compressed quantized representative value arrays used for color difference signals is encoded based on an unsigned Exp-Golomb code.
　scaleは、量子化代表値配列の各要素を、符号なしの固定ビット数で符号化した固定長シンタックスである。ビット数は、対応する成分（輝度もしくは色差）のサンプルビット数である。 Scale is a fixed length syntax in which each element of the quantized representative value array is encoded with a fixed number of unsigned bits. The number of bits is the number of sample bits of the corresponding component (luminance or color difference).
　次に、図７を参照して、本実施形態の映像符号化のフローチャートを説明する。 Next, with reference to FIG. 7, a flowchart of video encoding according to this embodiment will be described.
　ステップS10001において、メモリ圧縮伸張制御器106は、映像符号化装置と同一の参照ピクチャ圧縮及び参照ピクチャ伸張を参照ピクチャに適用するために、DPCM補助情報をメモリ圧縮器103、メモリ伸張器104、および、多重化器105に多重化器105に供給する。 In step S10001, the memory compression / decompression controller 106 applies DPCM auxiliary information to the memory compressor 103, the memory decompressor 104, and the reference picture compression and reference picture decompression, which are the same as those of the video encoding device, to the reference picture. The multiplexer 105 is supplied to the multiplexer 105.
　ステップS10002において、メモリ伸張器104は、供給されたDPCM補助情報に基づいて、映像符号化器101から要求される参照ピクチャの再構築画像領域を含む、参照ピクチャメモリ102に格納されたDPCM圧縮データを伸張して、映像符号化器101に供給する。 In step S10002, the memory decompressor 104 stores the DPCM compressed data stored in the reference picture memory 102 including the reconstructed image area of the reference picture requested from the video encoder 101 based on the supplied DPCM auxiliary information. Is expanded and supplied to the video encoder 101.
　ステップS10003において、映像符号化器101は、入力映像の各フレームを所定のピクチャタイプ（Iピクチャ、Pピクチャ、Bピクチャのいずれか）にて符号化し、その映像ビットストリームを多重化器105に供給する。 In step S10003, the video encoder 101 encodes each frame of the input video with a predetermined picture type (I picture, P picture, or B picture) and supplies the video bit stream to the multiplexer 105. To do.
　ステップS10004において、メモリ圧縮器103は、供給されたDPCM補助情報に基づいて、映像符号化器101から供給される再構築画像に対してDPCM圧縮を適用して、参照ピクチャメモリ102に格納する。 In step S10004, the memory compressor 103 applies DPCM compression to the reconstructed image supplied from the video encoder 101 based on the supplied DPCM auxiliary information, and stores it in the reference picture memory 102.
　ステップS10005において、多重化器105は、映像ビットストリームとDPCM補助情報を多重化してビットストリームを出力する。 In step S10005, the multiplexer 105 multiplexes the video bitstream and the DPCM auxiliary information and outputs the bitstream.
　ステップS10006において、出力したビットストリームが映像符号化の最後のフレームのである場合、映像符号化を終了する。最後のフレームでない場合には、S10001に戻る。 In step S10006, if the output bit stream is the last frame of video encoding, video encoding is terminated. If it is not the last frame, the process returns to S10001.
　以上で、本実施の形態の映像符号化装置の構成および動作の説明を終了する。
＜第２の実施の形態＞
　第２の実施の形態の映像復号装置を図８に示す。図３の従来の映像符号化装置と比較すると、新たに、多重化解除器205、メモリ圧縮伸張制御器206を備える。メモリ圧縮器203およびメモリ伸張器204の動作は、第１実施形態で述べたメモリ圧縮器103およびメモリ伸張器104と同じであるため、多重化解除器205、メモリ圧縮伸張制御器206をそれぞれの動作を説明する。 Above, description of a structure and operation | movement of the video coding apparatus of this Embodiment is complete | finished.
<Second Embodiment>
FIG. 8 shows a video decoding apparatus according to the second embodiment. Compared with the conventional video encoding apparatus of FIG. 3, a demultiplexer 205 and a memory compression / decompression controller 206 are newly provided. Since the operations of the memory compressor 203 and the memory decompressor 204 are the same as those of the memory compressor 103 and the memory decompressor 104 described in the first embodiment, the demultiplexer 205 and the memory compression / decompression controller 206 are respectively used. The operation will be described.
　多重化解除器205は、ビットストリームの多重化を解除して、映像ビットストリームとDPCM補助情報を抽出する。DPCM補助情報はメモリ圧縮伸張制御器206に、映像ビットストリームは映像復号器201にそれぞれ供給される。 The demultiplexer 205 demultiplexes the bitstream and extracts the video bitstream and DPCM auxiliary information. The DPCM auxiliary information is supplied to the memory compression / decompression controller 206, and the video bitstream is supplied to the video decoder 201.
　メモリ圧縮伸張制御器206は、供給されるDPCM補助情報に基づいて、映像復号装置においても、映像符号化装置と同一の参照ピクチャ圧縮及び参照ピクチャ伸張を参照ピクチャに適用するように、メモリ圧縮器203およびメモリ伸張器204の動作を設定する。 The memory compression / decompression controller 206 is configured to apply the same reference picture compression and reference picture decompression to the reference picture in the video decoding apparatus based on the supplied DPCM auxiliary information. The operation of 203 and the memory expander 204 is set.
　映像復号器201は、伸張器204を介して参照ピクチャメモリ102から予測に用いる参照ピクチャの再構築画像を読み取りながら、映像ビットストリームを復号して再構築画像（復号映像）を出力する、各フレームを復号した後に、以後のフレームの復号のために、スライディングウィンドウ方式などによって、圧縮器203を介して参照ピクチャメモリ202に、参照ピクチャとして必要な復号画像を格納する。 The video decoder 201 decodes the video bitstream and outputs the reconstructed image (decoded video) while reading the reconstructed image of the reference picture used for prediction from the reference picture memory 102 via the decompressor 204. Is decoded, a decoded image necessary as a reference picture is stored in the reference picture memory 202 via the compressor 203 by a sliding window method or the like for subsequent frame decoding.
　以上で、新たに追加された多重化解除器205、メモリ圧縮伸張制御器206の動作説明を終了する。 This completes the description of the operations of the newly added demultiplexer 205 and memory compression / decompression controller 206.
　次に、図９を参照して、本実施の形態の映像復号のフローチャートを説明する。 Next, a video decoding flowchart according to this embodiment will be described with reference to FIG.
　まず、ステップS20001において、多重化解除器205は、ビットストリームの多重化を解除して、映像ビットストリームとDPCM補助情報を抽出する。 First, in step S20001, the demultiplexer 205 demultiplexes the bitstream and extracts the video bitstream and DPCM auxiliary information.
　ステップS20002において、メモリ圧縮伸張制御器206は、供給されるDPCM補助情報に基づいて、映像復号装置においても、映像符号化装置と同一の参照ピクチャ圧縮及び参照ピクチャ伸張を参照ピクチャに適用するように、メモリ圧縮器203およびメモリ伸張器204の動作を設定する。 In step S20002, the memory compression / decompression controller 206 applies the same reference picture compression and reference picture decompression to the reference picture also in the video decoding apparatus based on the supplied DPCM auxiliary information. The operation of the memory compressor 203 and the memory decompressor 204 is set.
　ステップS20003において、メモリ伸張器204は、供給されたDPCM補助情報に基づいて、映像復号器201から要求される参照ピクチャの再構築画像領域を含む、参照ピクチャメモリ202に格納されたDPCM圧縮データを伸張して、映像復号器201に供給する。 In step S20003, the memory decompressor 204 stores the DPCM compressed data stored in the reference picture memory 202 including the reconstructed image area of the reference picture requested from the video decoder 201 based on the supplied DPCM auxiliary information. The data is decompressed and supplied to the video decoder 201.
　ステップS20004において、映像復号器201は、入力映像ビットストリームを復号する。以後のフレームの復号のために、スライディングウィンドウ方式などによって、圧縮器203を介して参照ピクチャメモリ202に、参照ピクチャとして必要な復号画像を格納する。 In step S20004, the video decoder 201 decodes the input video bitstream. In order to decode subsequent frames, a decoded image necessary as a reference picture is stored in the reference picture memory 202 via the compressor 203 by a sliding window method or the like.
　ステップS20005において、メモリ圧縮器203は、供給されたDPCM補助情報に基づいて、映像復号器201から供給される復号画像に対してDPCM圧縮を適用して、参照ピクチャメモリ202に格納する。 In step S20005, the memory compressor 203 applies DPCM compression to the decoded image supplied from the video decoder 201 based on the supplied DPCM auxiliary information, and stores it in the reference picture memory 202.
　ステップS20006において、復号したビットストリームが映像復号の最後のフレームのである場合、映像復号を終了する。最後のフレームでない場合には、S20001に戻る。 In step S20006, if the decoded bit stream is the last frame of video decoding, video decoding is terminated. If it is not the last frame, the process returns to S20001.
　以上で、本実施の形態の映像復号装置の構成および動作の説明を終了する。
＜第３の実施の形態＞
　図４を用いて、本実施形態の映像符号化装置を説明する。図２の従来の映像符号化装置と比較すると、新たに、メモリ圧縮器103、メモリ伸張器104、多重化器105、メモリ圧縮伸張制御器106を備える。メモリ圧縮器103およびメモリ伸張器104は、非圧縮を含めた複数の段階の圧縮率で動作する。 Above, description of the structure and operation | movement of the video decoding apparatus of this Embodiment is complete | finished.
<Third Embodiment>
The video encoding apparatus according to this embodiment will be described with reference to FIG. Compared with the conventional video encoding apparatus of FIG. 2, a memory compressor 103, a memory decompressor 104, a multiplexer 105, and a memory compression / decompression controller 106 are newly provided. The memory compressor 103 and the memory decompressor 104 operate at a compression rate of a plurality of stages including non-compression.
　映像符号器101は、入力映像の各フレームを符号化し、生成した映像ビットストリームを多重化器105に供給する。映像符号器101は、予測に参照ピクチャが必要な場合、メモリ伸張器104を介して参照ピクチャメモリ102から、予測に用いる参照ピクチャの再構築画像を読み出す。映像符号器101は、各フレームの再構築画像を、メモリ圧縮器103を介して参照ピクチャメモリ102に格納する。 The video encoder 101 encodes each frame of the input video and supplies the generated video bitstream to the multiplexer 105. When a reference picture is required for prediction, the video encoder 101 reads a reconstructed image of the reference picture used for prediction from the reference picture memory 102 via the memory expander 104. The video encoder 101 stores the reconstructed image of each frame in the reference picture memory 102 via the memory compressor 103.
　メモリ圧縮伸張制御器106は、外部から与えられた参照ピクチャ管理パラメータに従って、参照ピクチャメモリ102のサイズを算出し、メモリ圧縮率ごとに、参照ピクチャメモリ102に格納される参照ピクチャの枚数を算出する。参照ピクチャメモリ102のメモリ配置は、前記参照ピクチャメモリ102のサイズと前記メモリ圧縮率ごとに格納される参照ピクチャの枚数とによって、確定する。 The memory compression / decompression controller 106 calculates the size of the reference picture memory 102 according to a reference picture management parameter given from the outside, and calculates the number of reference pictures stored in the reference picture memory 102 for each memory compression rate. . The memory arrangement of the reference picture memory 102 is determined by the size of the reference picture memory 102 and the number of reference pictures stored for each memory compression rate.
　また、メモリ圧縮伸張制御器106は、フレームごとにメモリ圧縮率を決定し、決定したメモリ圧縮率をメモリ圧縮器103とメモリ伸張器104とにシグナリングする。 The memory compression / decompression controller 106 determines a memory compression rate for each frame, and signals the determined memory compression rate to the memory compressor 103 and the memory expander 104.
　さらに、メモリ圧縮伸張制御器106は、参照ピクチャメモリ102のサイズ、メモリ圧縮率ごとに格納される参照ピクチャの枚数、および、フレームごとのメモリ圧縮率に関する情報を、圧縮メモリ管理パラメータとして多重化器105に供給する。 Further, the memory compression / decompression controller 106 multiplexes information on the size of the reference picture memory 102, the number of reference pictures stored for each memory compression rate, and the memory compression rate for each frame as a compression memory management parameter. Supply to 105.
　メモリ圧縮器103は、映像符号化器101から供給される再構築画像に対して、メモリ圧縮伸張制御器106からシグナリングされるメモリ圧縮率で圧縮処理を行い、圧縮データをメモリ配置に従って、参照ピクチャメモリ102に格納する。 The memory compressor 103 performs compression processing on the reconstructed image supplied from the video encoder 101 at the memory compression rate signaled from the memory compression / decompression controller 106, and compresses the compressed data according to the memory arrangement. Store in the memory 102.
　メモリ伸張器104は、映像符号化器101から要求される参照ピクチャの領域を、参照ピクチャメモリ102の圧縮データを伸長して供給する。 The memory expander 104 supplies the reference picture area requested from the video encoder 101 by expanding the compressed data of the reference picture memory 102.
　多重化器105は、映像ビットストリームと圧縮メモリ管理パラメータを多重化して映像ビットストリームを出力する。 The multiplexer 105 multiplexes the video bitstream and the compression memory management parameter and outputs the video bitstream.
　以上で、本実施の形態の説明を終了する。
＜第４の実施の形態＞
　第４の実施の形態の映像復号装置を図８に示す。図３の従来の映像符号化装置と比較すると、新たに、多重化解除器205、メモリ圧縮伸張制御器206を備える。メモリ圧縮器203およびメモリ伸張器204は、非圧縮を含めた複数の段階の圧縮率で動作する。 Above, description of this Embodiment is complete | finished.
<Fourth embodiment>
FIG. 8 shows a video decoding apparatus according to the fourth embodiment. Compared with the conventional video encoding apparatus of FIG. 3, a demultiplexer 205 and a memory compression / decompression controller 206 are newly provided. The memory compressor 203 and the memory decompressor 204 operate at a compression rate of a plurality of stages including non-compression.
　多重化解除器205は、ビットストリームの多重化を解除して、映像ビットストリームと圧縮メモリ管理パラメータを抽出する。映像ビットストリームは映像復号器201に供給される。圧縮メモリ管理パラメータに含まれる、参照ピクチャメモリ202のサイズ、メモリ圧縮率ごとに格納される参照ピクチャの枚数、および、フレームごとのメモリ圧縮率はメモリ圧縮伸張制御器206に供給される。 The demultiplexer 205 demultiplexes the bitstream and extracts the video bitstream and the compressed memory management parameter. The video bit stream is supplied to the video decoder 201. The size of the reference picture memory 202, the number of reference pictures stored for each memory compression rate, and the memory compression rate for each frame included in the compression memory management parameter are supplied to the memory compression / decompression controller 206.
　メモリ圧縮伸張制御器206は、多重化解除器205から供給される参照ピクチャメモリ202のサイズ、および、メモリ圧縮率ごとに格納される参照ピクチャの枚数によって、参照ピクチャメモリ202のメモリ配置を決定する。決定したメモリ配置をメモリ圧縮器203とメモリ伸張器204にシグナリングする。 The memory compression / decompression controller 206 determines the memory arrangement of the reference picture memory 202 according to the size of the reference picture memory 202 supplied from the demultiplexer 205 and the number of reference pictures stored for each memory compression rate. . The determined memory arrangement is signaled to the memory compressor 203 and the memory decompressor 204.
　また、メモリ圧縮伸張制御器206は、多重化解除器205から供給されるフレームごとのメモリ圧縮率をメモリ圧縮器203にシグナリングするとともに保持しておく。保持しておいたメモリ圧縮率の中から、映像符号器101から参照される各参照ピクチャに対応するメモリ圧縮率をメモリ伸張器204にシグナリングする。 Also, the memory compression / decompression controller 206 signals the memory compression rate for each frame supplied from the demultiplexer 205 to the memory compressor 203 and holds it. The memory compression rate corresponding to each reference picture referenced from the video encoder 101 is signaled to the memory decompressor 204 from the stored memory compression rates.
　映像復号器201は、メモリ伸張器204を介して参照ピクチャメモリ202からフレーム間予測に用いる参照ピクチャの再構築画像を読み取りながら、映像ビットストリームを復号して再構築画像（復号映像）を生成し、メモリ圧縮器203を介して、再構築画像を参照ピクチャメモリ202に格納する。 The video decoder 201 reads a reference picture reconstructed image used for inter-frame prediction from the reference picture memory 202 via the memory decompressor 204 and decodes the video bitstream to generate a reconstructed image (decoded video). Then, the reconstructed image is stored in the reference picture memory 202 via the memory compressor 203.
　メモリ圧縮器203は、映像復号器201から供給される再構築画像に対して、メモリ圧縮伸張制御器206からシグナリングされる圧縮率で圧縮処理を行い、圧縮データをメモリ配置に従って、参照ピクチャメモリ202に格納する。 The memory compressor 203 performs compression processing on the reconstructed image supplied from the video decoder 201 at the compression rate signaled from the memory compression / decompression controller 206, and the compressed data is referred to the reference picture memory 202 according to the memory arrangement. To store.
　メモリ伸張器204は、映像復号器201から要求される参照ピクチャの領域を、参照ピクチャメモリ202の圧縮データを伸長して供給する。 The memory expander 204 supplies the reference picture area requested from the video decoder 201 by expanding the compressed data of the reference picture memory 202.
　以上で、本実施の形態の説明を終了する。
＜他の実施の形態＞
　第１の実施の形態における表１及び表２にて、DPCM補助情報について、複数の量子化代表値配列の情報をビットストリームに多重化する実施形態を示した。そのような実施形態において、本発明は、映像符号化及び復号装置それぞれのメモリ圧縮器は選択した量子化代表値配列のインデックス情報をDPCM圧縮データに多重化することによって、最小で、DPCMの処理周期であるN画素単位にて量子化代表値配列を切り替えることも可能である。 Above, description of this Embodiment is complete | finished.
<Other embodiments>
Tables 1 and 2 in the first embodiment show an embodiment in which information of a plurality of quantized representative value arrays is multiplexed into a bitstream for DPCM auxiliary information. In such an embodiment, the present invention provides a minimum of DPCM processing by multiplexing the index information of the selected quantized representative value array into the DPCM compressed data by the memory compressor of each video encoding and decoding device. It is also possible to switch the quantized representative value array in units of N pixels that are periods.
　また、第１の実施の形態にて、ランダムアクセス周期となるGOP毎に、DPCM補助情報をシーケンスパラメータに多重化する実施形態を示した。しかしながら、本発明によれば、例えば、フレーム毎の符号化・復号に用いるピクチャパラメータにDPCM補助情報を以下の表３又は表４のように多重化することで、フレーム単位でDPCM圧縮の特性を切り替えることも可能である。 Further, in the first embodiment, the embodiment in which the DPCM auxiliary information is multiplexed into the sequence parameter for each GOP that becomes a random access cycle is shown. However, according to the present invention, for example, DPCM auxiliary information is multiplexed into picture parameters used for encoding / decoding for each frame as shown in Table 3 or Table 4 below, so that DPCM compression characteristics can be obtained in units of frames. It is also possible to switch.
Figure JPOXMLDOC01-appb-T000011
Figure JPOXMLDOC01-appb-T000011
Figure JPOXMLDOC01-appb-T000012
 　また、本発明は、非特許文献２（野田玲子、中條健、"画素ビット長拡張による動画像符号化効率改善方式", 情報科学技術フォーラム2006 J-009, 2006.）のように入力映像のビット深度を伸張して映像符号化をする場合に、伸張したビット深度に応じて増加する参照ピクチャメモリを削減する用途にも応用可能である。
Figure JPOXMLDOC01-appb-T000012
 In addition, the present invention relates to an input video as described in Non-Patent Document 2 (Reiko Noda, Ken Nakajo, “A moving picture coding efficiency improvement method by extending pixel bit length”, Information Science and Technology Forum 2006 J-009, 2006.) When video encoding is performed by extending the bit depth, the present invention can also be applied to a purpose of reducing the reference picture memory that increases in accordance with the expanded bit depth.
　さらには上述した発明の実施形態においては、上述した説明からも明らかなように、ハードウェアで構成することも可能であるが、コンピュータプログラムにより実現することも可能である。 Furthermore, in the embodiment of the invention described above, as is apparent from the above description, it can be configured by hardware, but can also be realized by a computer program.
　図１０に示す情報処理システムは、プロセッサA1001，プログラムメモリA1002，記憶媒体A1003およびA1004からなる。記憶媒体A1003およびA1004は、別個の記憶媒体であってもよいし、同一の記憶媒体からなる記憶領域であってもよい。記憶媒体としては、ハードディスク等の磁気記憶媒体を用いることができる。 The information processing system shown in FIG. 10 includes a processor A1001, a program memory A1002, and storage media A1003 and A1004. The storage media A1003 and A1004 may be separate storage media, or may be storage areas composed of the same storage medium. A magnetic storage medium such as a hard disk can be used as the storage medium.
　上記の如く、本発明の映像符号化装置は、映像復号装置において、映像符号化装置と同一の参照ピクチャ圧縮及び参照ピクチャ伸張を参照ピクチャに適用できるように、参照ピクチャ圧縮の補助情報をビットストリームに多重化する。映像復号装置が、ビットストリームを多重化解除して前記補助情報を抽出し、それに基づいた参照ピクチャ圧縮手段と参照ピクチャ伸張手段を制御する手段を備えることによって、映像符号化装置と映像復号装置間で参照ピクチャの画素値を完全に一致させることができる。その結果、従来技術における復号映像の画質劣化が解消される。さらに、映像符号化装置においても、映像復号装置と同様に、メモリ帯域が削減される。 As described above, the video encoding apparatus according to the present invention uses the reference picture compression auxiliary information as a bitstream so that the video decoding apparatus can apply the same reference picture compression and reference picture expansion as the video encoding apparatus to the reference picture. To multiplex. The video decoding apparatus includes means for demultiplexing the bitstream to extract the auxiliary information, and controlling the reference picture compression means and the reference picture expansion means based on the information. Thus, the pixel values of the reference picture can be completely matched. As a result, the image quality degradation of the decoded video in the prior art is solved. Further, in the video encoding device, the memory bandwidth is reduced as in the video decoding device.
　また、参照ピクチャ圧縮の圧縮率をフレーム単位で変える場合において、本発明の映像符号化装置は、映像復号装置において参照ピクチャメモリのメモリ配置が確定できるように、圧縮率ごとに参照ピクチャメモリに格納すべき参照ピクチャの枚数に関連する情報ビットストリームに多重化する。本発明の映像復号装置は、多重化された、圧縮率ごとに参照ピクチャメモリに格納すべき参照ピクチャの枚数に関連する情報を抽出し、それに基づいてメモリ配置を決定する手段を備えることによって、映像符号化装置と映像復号装置の両方において、参照ピクチャメモリのメモリ配置を完全に一致させることができる。その結果、参照ピクチャ圧縮の圧縮率をフレーム単位で変えても、整列目的のメモリコピーなどの課題が回避される。 In addition, when changing the compression rate of reference picture compression in units of frames, the video encoding device of the present invention stores the reference picture memory in the reference picture memory for each compression rate so that the memory arrangement of the reference picture memory can be determined in the video decoding device. Multiplexed in an information bitstream related to the number of reference pictures to be performed. The video decoding device of the present invention includes means for extracting information related to the number of multiplexed reference pictures to be stored in the reference picture memory for each compression ratio and determining the memory arrangement based on the extracted information. In both the video encoding device and the video decoding device, the memory arrangement of the reference picture memory can be completely matched. As a result, even if the compression rate of reference picture compression is changed in units of frames, problems such as memory copying for alignment purposes are avoided.
　上記の実施形態の一部又は全部は、以下の付記のようにも記載されうるが、以下には限られない。 Some or all of the above embodiments can be described as in the following supplementary notes, but are not limited thereto.
　（付記１）　入力映像を予測に基づいて符号化する映像符号化手段と、
　前記映像符号化手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
　圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、
　所定の動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と、
　前記映像符号化手段の映像ビットストリームと、前記圧縮伸張制御手段の前記動作パラメータとを多重化する多重化手段と
を有する映像符号化装置。 (Supplementary note 1) Video encoding means for encoding an input video based on prediction;
Reference picture compression means for compressing a reference picture used for prediction by the video encoding means;
Reference picture storage means for storing the compressed reference picture;
Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means;
Compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on predetermined operating parameters;
A video encoding apparatus comprising: a multiplexing unit that multiplexes the video bit stream of the video encoding unit and the operation parameter of the compression / decompression control unit.
　（付記２）　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段とは差分パルス符号化変調に基づいた圧縮手段および伸張手段であって、
　前記圧縮伸張制御手段の動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
付記１に記載の映像符号化装置。 (Supplementary Note 2) The reference picture compression means and the reference picture expansion means are compression means and expansion means based on differential pulse code modulation,
The video encoding device according to appendix 1, wherein the operation parameters of the compression / decompression control means include at least a processing period of differential pulse code modulation and a bit number of differential pulse code modulation.
　（付記３）　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段は複数の段階の圧縮率で動作し、
　前記圧縮伸張制御手段の動作パラメータにより前記圧縮率を設定する
付記１又は付記２に記載の映像符号化装置。 (Supplementary note 3) The reference picture compression means and the reference picture decompression means operate at a compression rate of a plurality of stages,
The video encoding apparatus according to appendix 1 or appendix 2, wherein the compression rate is set according to an operation parameter of the compression / decompression control means.
　（付記４）　前記参照ピクチャ格納手段に格納される参照ピクチャを圧縮率ごとに管理する
付記３に記載の映像符号化装置。 (Additional remark 4) The video coding apparatus of Additional remark 3 which manages the reference picture stored in the said reference picture storage means for every compression rate.
　（付記５）　外部から指定される参照ピクチャ管理パラメータから、圧縮率ごとに保持すべき参照ピクチャの枚数を算出し、
　前記多重化手段によって、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を多重化する
付記４に記載の映像符号化装置。 (Supplementary Note 5) Calculate the number of reference pictures to be held for each compression rate from the reference picture management parameter specified from the outside,
The video encoding apparatus according to appendix 4, wherein the multiplexing means multiplexes at least information relating to the number of reference pictures to be held for each compression rate.
　（付記６）　予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含む入力ビットストリームの多重化を解除する多重化解除手段と、
　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号手段と、
　前記映像復号手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
　前記圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と
　前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と
を有する映像復号装置。 (Supplementary note 6) Demultiplexing means for demultiplexing an input bitstream including operation parameters for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed;
Video decoding means for decoding the demultiplexed video bitstream based on prediction;
Reference picture compression means for compressing a reference picture used for prediction by the video decoding means;
Reference picture storage means for storing the compressed reference picture;
Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means, and based on operation parameters included in the demultiplexed input bitstream, the reference picture compression means and the reference picture decompression means, And a compression / decompression control means for controlling the video.
　（付記７）　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段とは差分パルス符号化変調に基づいた圧縮手段および伸張手段であって、
　前記圧縮伸張制御手段の動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
付記６に記載の映像復号装置。 (Supplementary Note 7) The reference picture compression means and the reference picture decompression means are compression means and decompression means based on differential pulse code modulation,
The video decoding device according to appendix 6, wherein the operation parameters of the compression / decompression control means include at least a processing period of differential pulse coding modulation and a bit number of differential pulse coding modulation.
　（付記８）　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段とは複数の段階の圧縮率で動作し、
前記圧縮伸張制御手段の動作パラメータにより前記圧縮率を設定する
付記６又は付記７に記載の映像復号装置。 (Supplementary Note 8) The reference picture compression means and the reference picture expansion means operate at a compression rate of a plurality of stages,
The video decoding device according to appendix 6 or appendix 7, wherein the compression rate is set according to an operation parameter of the compression / decompression control means.
　（付記９）　前記参照ピクチャ格納手段に格納される参照ピクチャを圧縮率ごとに管理する
付記８に記載の映像復号装置。 (Supplementary note 9) The video decoding device according to supplementary note 8, wherein the reference picture stored in the reference picture storage unit is managed for each compression rate.
　（付記１０）　前記多重化解除手段は、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を取り出し、
　前記圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報に基づいて、前記参照ピクチャ格納手段のメモリ配置を決定する
付記９に記載の映像復号装置。 (Supplementary Note 10) The demultiplexing unit extracts at least information on the number of reference pictures to be held for each compression rate,
The video decoding device according to appendix 9, wherein the memory arrangement of the reference picture storage unit is determined based on information on the number of reference pictures to be held for each compression rate.
　（付記１１）　入力映像を予測に基づいて符号化する映像符号化手段と、
　前記映像符号化手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
　圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、
　所定の動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と、
　前記映像符号化手段の映像ビットストリームと、前記圧縮伸張制御手段の前記動作パラメータとを多重化する多重化手段と
を有する映像符号化部と、
　入力ビットストリームの多重化を解除し、映像ビットストリームと前記動作パラメータとを分離する多重化解除手段と、
　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号手段と、
　前記映像復号手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
　前記圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と
　前記動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と
を有する映像復号部と
を有する映像符号／復号システム。 (Supplementary Note 11) Video encoding means for encoding an input video based on prediction;
Reference picture compression means for compressing a reference picture used for prediction by the video encoding means;
Reference picture storage means for storing the compressed reference picture;
Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means;
Compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on predetermined operating parameters;
A video encoding unit having a video bit stream of the video encoding unit and a multiplexing unit that multiplexes the operation parameter of the compression / decompression control unit;
Demultiplexing means for demultiplexing the input bitstream and separating the video bitstream and the operation parameter;
Video decoding means for decoding the demultiplexed video bitstream based on prediction;
Reference picture compression means for compressing a reference picture used for prediction by the video decoding means;
Reference picture storage means for storing the compressed reference picture;
Video having reference picture decompression means for decompressing a compressed reference picture stored in the reference picture storage means, and compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on the operation parameter A video encoding / decoding system including a decoding unit.
　（付記１２）　入力映像を予測に基づいて符号化する処理と、
　前記予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
　前記圧縮参照ピクチャを伸張する伸張処理と、
　所定の動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と、
　前記符号化された映像ビットストリームと、前記動作パラメータとを多重化する多重化処理と
を有する映像符号化方法。 (Additional remark 12) The process which encodes input video based on prediction,
A compression process for compressing a reference picture used for the prediction and generating a compressed reference picture;
Decompression processing for decompressing the compressed reference picture;
A compression / decompression control process for controlling the compression process and the expansion process based on a predetermined operation parameter;
A video encoding method comprising: a multiplexing process for multiplexing the encoded video bitstream and the operation parameter.
　（付記１３）　前記圧縮処理と前記伸張処理とは、差分パルス符号化変調に基づいた圧縮処理および伸張処理であって、
　前記動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
付記１２に記載の映像符号化方法。 (Supplementary note 13) The compression processing and the decompression processing are compression processing and decompression processing based on differential pulse coding modulation,
The video encoding method according to appendix 12, wherein the operation parameter includes at least a processing period of differential pulse code modulation and a bit number of differential pulse code modulation.
　（付記１４）　前記圧縮処理と前記伸張処理は、複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
　前記動作パラメータにより前記圧縮率を設定する
付記１２又は付記１３に記載の映像符号化装置。 (Supplementary Note 14) The compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and the compression processing and the decompression processing are performed.
14. The video encoding device according to appendix 12 or appendix 13, wherein the compression rate is set according to the operation parameter.
　（付記１５）　前記圧縮参照ピクチャを圧縮率ごとに管理する
付記１４に記載の映像符号化方法。 (Supplementary note 15) The video encoding method according to supplementary note 14, wherein the compressed reference picture is managed for each compression rate.
　（付記１６）　外部から指定される参照ピクチャ管理パラメータから、圧縮率ごとに保持すべき参照ピクチャの枚数を算出し、
　前記多重化処理は、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を多重化する
付記１５に記載の映像符号化方法。 (Supplementary Note 16) From the reference picture management parameter specified from the outside, the number of reference pictures to be held for each compression rate is calculated,
The video encoding method according to supplementary note 15, wherein the multiplexing process multiplexes at least information related to the number of reference pictures to be held for each compression rate.
　（付記１７）　予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含むと入力ビットストリームの多重化を解除する多重化解除処理と、
　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号処理と、
　前記映像復号処理で予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
　前記圧縮参照ピクチャを伸張する伸張処理と
　前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と
を有する映像復号方法。 (Supplementary Note 17) Demultiplexing processing for demultiplexing an input bitstream when including an operation parameter for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed;
A video decoding process for decoding the demultiplexed video bitstream based on prediction;
A compression process for compressing a reference picture used for prediction in the video decoding process and generating a compressed reference picture;
A video decoding method comprising: a decompression process for decompressing the compressed reference picture; and a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream.
　（付記１８）　前記圧縮処理と前記伸張処理とは差分パルス符号化変調に基づいた圧縮処理と伸張処理であって、
　前記動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
付記１７に記載の映像復号方法。 (Supplementary note 18) The compression processing and the decompression processing are compression processing and decompression processing based on differential pulse code modulation,
The video decoding method according to appendix 17, wherein the operation parameters include at least a processing period of differential pulse code modulation and a bit number of differential pulse code modulation.
　（付記１９）　前記圧縮処理と前記伸張処理とは複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
　前記動作パラメータにより前記圧縮率を設定する
付記１７又は付記１８に記載の映像復号方法。 (Supplementary Note 19) The compression process and the decompression process are performed at a compression rate of a plurality of stages, and the compression process and the decompression process are performed.
19. The video decoding method according to appendix 17 or appendix 18, wherein the compression rate is set according to the operation parameter.
　（付記２０）　前記圧縮参照ピクチャは圧縮率ごとに管理される
付記２０に記載の映像復号方法。 (Supplementary note 20) The video decoding method according to supplementary note 20, wherein the compressed reference picture is managed for each compression rate.
　（付記２１）　前記多重化解除処理は、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を取り出し、
　前記圧縮率ごとに保持すべき圧縮参照ピクチャの枚数に関する情報に基づいて、圧縮参照ピクチャを格納するメモリ配置を決定する
付記２０に記載の映像復号方法。 (Supplementary Note 21) The demultiplexing process extracts at least information on the number of reference pictures to be held for each compression rate,
The video decoding method according to appendix 20, wherein a memory arrangement for storing a compressed reference picture is determined based on information on the number of compressed reference pictures to be held for each compression rate.
　（付記２２）　入力映像を予測に基づいて符号化する処理と、
　前記予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
　前記圧縮参照ピクチャを伸張する伸張処理と、
　所定の動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と、
　前記符号化された映像ビットストリームと、前記動作パラメータとを多重化する多重化処理と
を情報処理装置に実行させるプログラム。 (Supplementary Note 22) Processing for encoding input video based on prediction;
A compression process for compressing a reference picture used for the prediction and generating a compressed reference picture;
Decompression processing for decompressing the compressed reference picture;
A compression / decompression control process for controlling the compression process and the expansion process based on a predetermined operation parameter;
A program for causing an information processing apparatus to execute a multiplexing process for multiplexing the encoded video bitstream and the operation parameter.
　（付記２３）　前記圧縮処理と前記伸張処理は、複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
　前記動作パラメータにより前記圧縮率を設定する
付記２２に記載のプログラム。 (Supplementary Note 23) The compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and the compression processing and the decompression processing are performed.
The program according to appendix 22, wherein the compression rate is set according to the operation parameter.
　（付記２４）　予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含むと入力ビットストリームの多重化を解除する多重化解除処理と、
　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号処理と、
　前記映像復号処理で予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
　前記圧縮参照ピクチャを伸張する伸張処理と
　前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と
を情報処理装置に実行させるプログラム。 (Supplementary Note 24) Demultiplexing processing for demultiplexing an input bitstream when including an operation parameter for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed;
A video decoding process for decoding the demultiplexed video bitstream based on prediction;
A compression process for compressing a reference picture used for prediction in the video decoding process and generating a compressed reference picture;
The information processing apparatus executes a decompression process for decompressing the compressed reference picture and a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream. Program to make.
　（付記２５）　前記圧縮処理と前記伸張処理とは複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
　前記動作パラメータにより前記圧縮率を設定する
付記２４に記載のプログラム。 (Supplementary Note 25) The compression process and the decompression process are performed at a compression rate of a plurality of stages, and the compression process and the decompression process are performed.
The program according to appendix 24, wherein the compression rate is set by the operation parameter.
　（付記２６）　映像符号化側において、参照ピクチャを用いた予測に基づいて入力映像を符号化して得られた映像ビットストリームに、前記参照ピクチャの圧縮及び伸張に関する補助情報を多重化し、
　映像復号側において、前記映像ビットストリームの多重を解除して、前記補助情報を抽出し、前記補助情報に基づいて、前記参照ピクチャの圧縮及び伸張を制御する
映像符号復号方法。 (Supplementary note 26) On the video encoding side, auxiliary information related to compression and expansion of the reference picture is multiplexed with the video bitstream obtained by encoding the input video based on prediction using the reference picture,
A video code decoding method for demultiplexing the video bitstream, extracting the auxiliary information, and controlling compression and expansion of the reference picture based on the auxiliary information on a video decoding side.
　以上好ましい実施の形態をあげて本発明を説明したが、本発明は必ずしも上記実施の形態に限定されるものではなく、その技術的思想の範囲内において様々に変形し実施することが出来る。 Although the present invention has been described with reference to the preferred embodiments, the present invention is not necessarily limited to the above-described embodiments, and various modifications can be made within the scope of the technical idea.
　本出願は、２０１０年５月６日に出願された日本出願特願２０１０－１０６４１５号を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2010-106415 filed on May 6, 2010, the entire disclosure of which is incorporated herein.
１０３　　メモリ圧縮器
１０４　　メモリ伸張器
１０５　　多重化器
１０６　　メモリ圧縮伸張制御器
２０３　　メモリ圧縮器
２０４　　メモリ伸張器
２０５　　多重化解除器
２０６　　メモリ圧縮伸張制御器 DESCRIPTION OF SYMBOLS 103 Memory compressor 104 Memory decompressor 105 Multiplexer 106 Memory compression / decompression controller 203 Memory compressor 204 Memory decompressor 205 Demultiplexer 206 Memory compression / decompression controller

Claims (26)

  1. 　入力映像を予測に基づいて符号化する映像符号化手段と、
    　前記映像符号化手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
    　圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
    　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、
    　所定の動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と、
    　前記映像符号化手段の映像ビットストリームと、前記圧縮伸張制御手段の前記動作パラメータとを多重化する多重化手段と
    を有する映像符号化装置。     Video encoding means for encoding the input video based on the prediction;
    Reference picture compression means for compressing a reference picture used for prediction by the video encoding means;
    Reference picture storage means for storing the compressed reference picture;
    Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means;
    Compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on predetermined operating parameters;
    A video encoding apparatus comprising: a multiplexing unit that multiplexes the video bit stream of the video encoding unit and the operation parameter of the compression / decompression control unit.
  2. 　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段とは差分パルス符号化変調に基づいた圧縮手段および伸張手段であって、
    　前記圧縮伸張制御手段の動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
    請求項１に記載の映像符号化装置。     The reference picture compression means and the reference picture decompression means are compression means and decompression means based on differential pulse code modulation,
    The video encoding apparatus according to claim 1, wherein the operation parameters of the compression / decompression control means include at least a processing period of differential pulse code modulation and a bit number of differential pulse code modulation.
  3. 　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段は複数の段階の圧縮率で動作し、
    　前記圧縮伸張制御手段の動作パラメータにより前記圧縮率を設定する
    請求項１又は請求項２に記載の映像符号化装置。     The reference picture compression means and the reference picture decompression means operate at a compression rate of a plurality of stages,
    The video encoding apparatus according to claim 1, wherein the compression rate is set according to an operation parameter of the compression / decompression control unit.
  4. 　前記参照ピクチャ格納手段に格納される参照ピクチャを圧縮率ごとに管理する
    請求項３に記載の映像符号化装置。     4. The video encoding apparatus according to claim 3, wherein reference pictures stored in the reference picture storage unit are managed for each compression rate.
  5. 　外部から指定される参照ピクチャ管理パラメータから、圧縮率ごとに保持すべき参照ピクチャの枚数を算出し、
    　前記多重化手段によって、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を多重化する
    請求項４に記載の映像符号化装置。     From the reference picture management parameter specified from the outside, calculate the number of reference pictures to be held for each compression rate,
    5. The video encoding apparatus according to claim 4, wherein at least information on the number of reference pictures to be held for each compression rate is multiplexed by the multiplexing means.
  6. 　予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含む入力ビットストリームの多重化を解除する多重化解除手段と、
    　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号手段と、
    　前記映像復号手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
    　前記圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
    　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と
    　前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と
    を有する映像復号装置。     Demultiplexing means for demultiplexing an input bitstream including operation parameters for compression processing of a reference picture used for prediction and decompression processing of a compressed reference picture in which the reference picture is compressed;
    Video decoding means for decoding the demultiplexed video bitstream based on prediction;
    Reference picture compression means for compressing a reference picture used for prediction by the video decoding means;
    Reference picture storage means for storing the compressed reference picture;
    Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means, and based on operation parameters included in the demultiplexed input bitstream, the reference picture compression means and the reference picture decompression means, And a compression / decompression control means for controlling the video.
  7. 　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段とは差分パルス符号化変調に基づいた圧縮手段および伸張手段であって、
    　前記圧縮伸張制御手段の動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
    請求項６に記載の映像復号装置。     The reference picture compression means and the reference picture decompression means are compression means and decompression means based on differential pulse code modulation,
    7. The video decoding apparatus according to claim 6, wherein the operation parameters of the compression / decompression control means include at least a processing period of differential pulse coding modulation and a bit number of differential pulse coding modulation.
  8. 　前記参照ピクチャ圧縮手段と参照ピクチャ伸張手段とは複数の段階の圧縮率で動作し、
    前記圧縮伸張制御手段の動作パラメータにより前記圧縮率を設定する
    請求項６又は請求項７に記載の映像復号装置。     The reference picture compression means and the reference picture decompression means operate at a compression rate of a plurality of stages,
    The video decoding apparatus according to claim 6 or 7, wherein the compression rate is set according to an operation parameter of the compression / decompression control means.
  9. 　前記参照ピクチャ格納手段に格納される参照ピクチャを圧縮率ごとに管理する
    請求項８に記載の映像復号装置。     9. The video decoding apparatus according to claim 8, wherein reference pictures stored in the reference picture storage unit are managed for each compression rate.
  10. 　前記多重化解除手段は、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を取り出し、
    　前記圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報に基づいて、前記参照ピクチャ格納手段のメモリ配置を決定する
    請求項９に記載の映像復号装置。     The demultiplexing means extracts at least information on the number of reference pictures to be held for each compression rate,
    The video decoding device according to claim 9, wherein a memory arrangement of the reference picture storage unit is determined based on information on the number of reference pictures to be held for each compression rate.
  11. 　入力映像を予測に基づいて符号化する映像符号化手段と、
    　前記映像符号化手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
    　圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
    　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と、
    　所定の動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と、
    　前記映像符号化手段の映像ビットストリームと、前記圧縮伸張制御手段の前記動作パラメータとを多重化する多重化手段と
    を有する映像符号化部と、
    　入力ビットストリームの多重化を解除し、映像ビットストリームと前記動作パラメータとを分離する多重化解除手段と、
    　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号手段と、
    　前記映像復号手段で予測に用いる参照ピクチャを圧縮する参照ピクチャ圧縮手段と、
    　前記圧縮された参照ピクチャを格納する参照ピクチャ格納手段と、
    　前記参照ピクチャ格納手段に格納された圧縮参照ピクチャを伸張する参照ピクチャ伸張手段と
    　前記動作パラメータに基づいて、前記参照ピクチャ圧縮手段と前記参照ピクチャ伸張手段とを制御する圧縮伸張制御手段と
    を有する映像復号部と
    を有する映像符号／復号システム。     Video encoding means for encoding the input video based on the prediction;
    Reference picture compression means for compressing a reference picture used for prediction by the video encoding means;
    Reference picture storage means for storing the compressed reference picture;
    Reference picture decompression means for decompressing the compressed reference picture stored in the reference picture storage means;
    Compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on predetermined operating parameters;
    A video encoding unit including a video bit stream of the video encoding unit and a multiplexing unit that multiplexes the operation parameter of the compression / decompression control unit;
    Demultiplexing means for demultiplexing the input bitstream and separating the video bitstream and the operation parameter;
    Video decoding means for decoding the demultiplexed video bitstream based on prediction;
    Reference picture compression means for compressing a reference picture used for prediction by the video decoding means;
    Reference picture storage means for storing the compressed reference picture;
    Video having reference picture decompression means for decompressing a compressed reference picture stored in the reference picture storage means, and compression / decompression control means for controlling the reference picture compression means and the reference picture decompression means based on the operation parameter A video encoding / decoding system including a decoding unit.
  12. 　入力映像を予測に基づいて符号化する処理と、
    　前記予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
    　前記圧縮参照ピクチャを伸張する伸張処理と、
    　所定の動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と、
    　前記符号化された映像ビットストリームと、前記動作パラメータとを多重化する多重化処理と
    を有する映像符号化方法。     Encoding the input video based on the prediction;
    A compression process for compressing a reference picture used for the prediction and generating a compressed reference picture;
    Decompression processing for decompressing the compressed reference picture;
    A compression / decompression control process for controlling the compression process and the expansion process based on a predetermined operation parameter;
    A video encoding method comprising: a multiplexing process for multiplexing the encoded video bitstream and the operation parameter.
  13. 　前記圧縮処理と前記伸張処理とは、差分パルス符号化変調に基づいた圧縮処理および伸張処理であって、
    　前記動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
    請求項１２に記載の映像符号化方法。     The compression processing and the expansion processing are compression processing and expansion processing based on differential pulse coding modulation,
    The video encoding method according to claim 12, wherein the operation parameters include at least a processing period of differential pulse code modulation and a bit number of differential pulse code modulation.
  14. 　前記圧縮処理と前記伸張処理は、複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
    　前記動作パラメータにより前記圧縮率を設定する
    請求項１２又は請求項１３に記載の映像符号化装置。     The compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and compression processing and decompression processing are performed.
    The video encoding device according to claim 12 or 13, wherein the compression rate is set according to the operation parameter.
  15. 　前記圧縮参照ピクチャを圧縮率ごとに管理する
    請求項１４に記載の映像符号化方法。     The video encoding method according to claim 14, wherein the compressed reference picture is managed for each compression rate.
  16. 　外部から指定される参照ピクチャ管理パラメータから、圧縮率ごとに保持すべき参照ピクチャの枚数を算出し、
    　前記多重化処理は、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を多重化する
    請求項１５に記載の映像符号化方法。     From the reference picture management parameter specified from the outside, calculate the number of reference pictures to be held for each compression rate,
    16. The video encoding method according to claim 15, wherein the multiplexing process multiplexes at least information relating to the number of reference pictures to be held for each compression rate.
  17. 　予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含むと入力ビットストリームの多重化を解除する多重化解除処理と、
    　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号処理と、
    　前記映像復号処理で予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
    　前記圧縮参照ピクチャを伸張する伸張処理と
    　前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と
    を有する映像復号方法。     A demultiplexing process for demultiplexing the input bitstream when the operation parameters of the compression process of the reference picture used for prediction and the decompression process of the compressed reference picture in which the reference picture is compressed are included;
    A video decoding process for decoding the demultiplexed video bitstream based on prediction;
    A compression process for compressing a reference picture used for prediction in the video decoding process and generating a compressed reference picture;
    A video decoding method comprising: a decompression process for decompressing the compressed reference picture; and a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream.
  18. 　前記圧縮処理と前記伸張処理とは差分パルス符号化変調に基づいた圧縮処理と伸張処理であって、
    　前記動作パラメータは、少なくとも、差分パルス符号化変調の処理周期および差分パルス符号化変調のビット数を含む
    請求項１７に記載の映像復号方法。     The compression processing and the expansion processing are compression processing and expansion processing based on differential pulse coding modulation,
    The video decoding method according to claim 17, wherein the operation parameters include at least a processing period of differential pulse code modulation and a bit number of differential pulse code modulation.
  19. 　前記圧縮処理と前記伸張処理とは複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
    　前記動作パラメータにより前記圧縮率を設定する
    請求項１７又は請求項１８に記載の映像復号方法。     The compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and compression processing and decompression processing are performed.
    The video decoding method according to claim 17 or 18, wherein the compression rate is set according to the operation parameter.
  20. 　前記圧縮参照ピクチャは圧縮率ごとに管理される
    請求項２０に記載の映像復号方法。     The video decoding method according to claim 20, wherein the compressed reference picture is managed for each compression rate.
  21. 　前記多重化解除処理は、少なくとも、圧縮率ごとに保持すべき参照ピクチャの枚数に関する情報を取り出し、
    　前記圧縮率ごとに保持すべき圧縮参照ピクチャの枚数に関する情報に基づいて、圧縮参照ピクチャを格納するメモリ配置を決定する
    請求項２０に記載の映像復号方法。     The demultiplexing process extracts at least information on the number of reference pictures to be held for each compression rate,
    The video decoding method according to claim 20, wherein a memory arrangement for storing a compressed reference picture is determined based on information on the number of compressed reference pictures to be held for each compression rate.
  22. 　入力映像を予測に基づいて符号化する処理と、
    　前記予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
    　前記圧縮参照ピクチャを伸張する伸張処理と、
    　所定の動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と、
    　前記符号化された映像ビットストリームと、前記動作パラメータとを多重化する多重化処理と
    を情報処理装置に実行させるプログラム。     Encoding the input video based on the prediction;
    A compression process for compressing a reference picture used for the prediction and generating a compressed reference picture;
    Decompression processing for decompressing the compressed reference picture;
    A compression / decompression control process for controlling the compression process and the expansion process based on a predetermined operation parameter;
    A program for causing an information processing apparatus to execute a multiplexing process for multiplexing the encoded video bitstream and the operation parameter.
  23. 　前記圧縮処理と前記伸張処理は、複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
    　前記動作パラメータにより前記圧縮率を設定する
    請求項２２に記載のプログラム。     The compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and compression processing and decompression processing are performed.
    The program according to claim 22, wherein the compression rate is set according to the operation parameter.
  24. 　予測に用いる参照ピクチャの圧縮処理、参照ピクチャが圧縮された圧縮参照ピクチャの伸張処理の動作パラメータを含むと入力ビットストリームの多重化を解除する多重化解除処理と、
    　前記多重化解除された映像ビットストリームを予測に基づいて復号する映像復号処理と、
    　前記映像復号処理で予測に用いる参照ピクチャを圧縮し、圧縮参照ピクチャを生成する圧縮処理と、
    　前記圧縮参照ピクチャを伸張する伸張処理と
    　前記多重化解除された入力ビットストリームに含まれる動作パラメータに基づいて、前記圧縮処理と前記伸張処理とを制御する圧縮伸張制御処理と
    を情報処理装置に実行させるプログラム。     A demultiplexing process for demultiplexing the input bitstream when the operation parameters of the compression process of the reference picture used for prediction and the decompression process of the compressed reference picture in which the reference picture is compressed are included;
    A video decoding process for decoding the demultiplexed video bitstream based on prediction;
    A compression process for compressing a reference picture used for prediction in the video decoding process and generating a compressed reference picture;
    The information processing apparatus executes a decompression process for decompressing the compressed reference picture and a compression / decompression control process for controlling the compression process and the decompression process based on an operation parameter included in the demultiplexed input bitstream. Program to make.
  25. 　前記圧縮処理と前記伸張処理とは複数の段階の圧縮率で、圧縮処理と伸張処理を行い、
    　前記動作パラメータにより前記圧縮率を設定する
    請求項２４に記載のプログラム。     The compression processing and the decompression processing are performed at a compression rate of a plurality of stages, and compression processing and decompression processing are performed.
    The program according to claim 24, wherein the compression rate is set according to the operation parameter.
  26. 　映像符号化側において、参照ピクチャを用いた予測に基づいて入力映像を符号化して得られた映像ビットストリームに、前記参照ピクチャの圧縮及び伸張に関する補助情報を多重化し、
    　映像復号側において、前記映像ビットストリームの多重を解除して、前記補助情報を抽出し、前記補助情報に基づいて、前記参照ピクチャの圧縮及び伸張を制御する
    映像符号復号方法。     On the video encoding side, auxiliary information related to compression and expansion of the reference picture is multiplexed with the video bitstream obtained by encoding the input video based on prediction using the reference picture,
    A video code decoding method for demultiplexing the video bitstream, extracting the auxiliary information, and controlling compression and expansion of the reference picture based on the auxiliary information on a video decoding side.
PCT/JP2011/060111 2010-05-06 2011-04-26 Image encoding apparatus, image decoding apparatus, image encoding method, image decoding method and program WO2011138912A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010106415 2010-05-06
JP2010-106415 2010-05-06

Publications (1)

Publication Number Publication Date
WO2011138912A1 true WO2011138912A1 (en) 2011-11-10

Family

ID=44903764

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/060111 WO2011138912A1 (en) 2010-05-06 2011-04-26 Image encoding apparatus, image decoding apparatus, image encoding method, image decoding method and program

Country Status (1)

Country Link
WO (1) WO2011138912A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015146474A (en) * 2014-01-31 2015-08-13 株式会社アクセル Encoding device and decoding device
JP2015146473A (en) * 2014-01-31 2015-08-13 株式会社アクセル Encoding device and decoding device
JP2017527194A (en) * 2014-08-08 2017-09-14 クアルコム，インコーポレイテッド Method for video coding with spatial prediction mode for multi-mode video coding

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003348592A (en) * 2002-05-23 2003-12-05 Matsushita Electric Ind Co Ltd Image data storage device, encoding device, decoding device, and compression and expansion system
WO2007091588A1 (en) * 2006-02-09 2007-08-16 Nec Corporation Dynamic image decoding device, decoded image recording device, their method, and program
WO2007148619A1 (en) * 2006-06-21 2007-12-27 Nec Corporation Dynamic image decoding device, decoded image recording device, and their method and program
JP2009130931A (en) * 2007-11-19 2009-06-11 Samsung Electronics Co Ltd Method and apparatus for efficiently encoding and/or decoding moving image using image resolution adjustment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003348592A (en) * 2002-05-23 2003-12-05 Matsushita Electric Ind Co Ltd Image data storage device, encoding device, decoding device, and compression and expansion system
WO2007091588A1 (en) * 2006-02-09 2007-08-16 Nec Corporation Dynamic image decoding device, decoded image recording device, their method, and program
WO2007148619A1 (en) * 2006-06-21 2007-12-27 Nec Corporation Dynamic image decoding device, decoded image recording device, and their method and program
JP2009130931A (en) * 2007-11-19 2009-06-11 Samsung Electronics Co Ltd Method and apparatus for efficiently encoding and/or decoding moving image using image resolution adjustment

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015146474A (en) * 2014-01-31 2015-08-13 株式会社アクセル Encoding device and decoding device
JP2015146473A (en) * 2014-01-31 2015-08-13 株式会社アクセル Encoding device and decoding device
JP2017527194A (en) * 2014-08-08 2017-09-14 クアルコム，インコーポレイテッド Method for video coding with spatial prediction mode for multi-mode video coding

Similar Documents

Publication Publication Date Title
JP6183502B2 (en) Video decoding apparatus, video decoding method, and program
WO2012017945A1 (en) Video encoding device, video decoding device, video encoding method, video decoding method, and program
US8487791B2 (en) Parallel entropy coding and decoding methods and devices
CA2788754C (en) Parallel entropy coding and decoding methods and devices
US9942550B2 (en) Image encoding device, image encoding method and program, image decoding device, and image decoding method and program
WO2007010901A1 (en) Dynamic image encoding device, dynamic image decoding device, and code string format
TWI739042B (en) A method for encoding video
JP6792685B2 (en) How and equipment to encode video frames
KR101147744B1 (en) Method and Apparatus of video transcoding and PVR of using the same
JPWO2009051010A1 (en) Image encoding device, image decoding device, image encoding method, and image decoding method
JP5835585B2 (en) Video decoding apparatus, video encoding apparatus, video decoding method, video encoding method, and program
WO2011138912A1 (en) Image encoding apparatus, image decoding apparatus, image encoding method, image decoding method and program
CN102783148A (en) Method and arrangement for video coding
KR102257754B1 (en) Video encoding and decoding method and apparatus using the same
CN113422960A (en) Image transmission method and device
WO2014002422A1 (en) Image encoding apparatus, image encoding method and program, image decoding apparatus, and image decoding method and program
JP2015146474A (en) Encoding device and decoding device
JP2005333662A (en) Coding instrument, decoding instrument, recoding instrument and coding method, decoding method, and recoding method
JP2006319638A (en) Content coding device, content coding program, content editing device and content editing program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11777431

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11777431

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP