WO2007132647A1 - 動画像復号化装置 - Google Patents
動画像復号化装置 Download PDFInfo
- Publication number
- WO2007132647A1 WO2007132647A1 PCT/JP2007/058826 JP2007058826W WO2007132647A1 WO 2007132647 A1 WO2007132647 A1 WO 2007132647A1 JP 2007058826 W JP2007058826 W JP 2007058826W WO 2007132647 A1 WO2007132647 A1 WO 2007132647A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- picture
- decoding
- reference picture
- decoded
- pictures
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/577—Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
- H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/172—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a picture, frame or field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/43—Hardware specially adapted for motion estimation or compensation
- H04N19/433—Hardware specially adapted for motion estimation or compensation characterised by techniques for memory access
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/58—Motion compensation with long-term prediction, i.e. the reference frame for a current frame not being the temporally closest one
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/85—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
- H04N19/89—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
- H04N19/895—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
Definitions
- the present invention relates to a moving picture decoding apparatus for decoding pictures constituting a moving picture.
- inter-picture prediction is used as a method of using temporal redundancy.
- inter-picture prediction when a certain picture (referred to as one picture) is encoded, a picture that is in front of or behind the one picture in the order of display time is used as a reference picture.
- the amount of motion of the reference picture is detected, and the amount of information is compressed by removing the redundancy in the spatial direction for the difference value between the picture subjected to motion compensation and the current picture. I do.
- a slice is a unit composed of a plurality of macroblock forces smaller than a picture.
- a picture is also composed of one or more slicing forces.
- a slice including only a block that performs intra-picture prediction using only the current picture without a reference picture is called an I slice.
- a slice including a block that performs inter-picture prediction with reference to one picture that has already been decoded and a block that performs intra-picture prediction is called a P slice.
- a slice including a block that performs inter-picture prediction and a block that performs intra-picture prediction by simultaneously referring to two or less pictures that have already been decoded is called a B slice.
- a picture can be composed of a plurality of types of slicers.
- a picture including only an I slice is an I picture
- a picture including only an I slice and a P slice is a P picture
- an I slice and a P slice and B A picture containing a slice is called a B picture.
- the reference picture referenced in the block belonging to the P picture may be either forward or backward in display time as long as it is a decoded picture.
- the two or less pictures referenced in the block belonging to the B picture may be either forward or backward in display time as long as they have been decoded.
- the reference picture does not depend on the picture type, and may be any of an I picture, a P picture, and a B picture.
- FIG. 40 is a schematic diagram showing a prediction relationship of each picture in the above moving image encoding method.
- the vertical line in the figure shows one picture, and the picture type (1, P, B) is shown in the lower right of each picture.
- the arrow in the figure indicates that the picture power at the beginning of the arrow indicates that the picture at the end of the arrow is used as a reference picture, and that inter-picture prediction decoding is performed.
- LO forward reference
- L1 backward reference
- the forward reference only gives priority to the forward picture in display time, and does not necessarily have to be the forward picture in display time. Also, for backward reference, only the backward picture is given priority in display time, and it is not always necessary to be the backward picture in display time! /.
- the 9th B picture B9 from the first picture II in the figure is the latter in terms of display time as a forward reference, the 10th P picture P10 as the reference time, and the former in terms of display time as a backward reference Use the seventh picture P7 as a reference picture.
- FIG. 41 is a schematic diagram showing the relationship between the decoding order and the display order of each picture in the above-described video encoding method.
- the upper number is assigned to each picture in decoding order, and the lower number is assigned to each picture in display order.
- the arrows in the middle of the figure indicate the correspondence between the decoding order and display order of each picture.
- the display order is encoded as an attribute of each picture.
- P picture P10 in the figure is displayed after B picture B11 or P picture 13 to be decoded later.
- the encoding mode in the decoding of a B picture, can be selected in which the encoding target block itself does not have a motion vector.
- direct mode There are two types of direct mode: temporal direct mode and spatial direct mode.
- the motion vector of another encoded picture is used as a reference motion vector, and scaling processing is performed based on the display temporal positional relationship between pictures.
- the motion vector used in is predicted and generated! /, (For example, see Patent Document 1).
- FIG. 42 is a schematic diagram showing a motion vector prediction generation method in the temporal direct mode.
- a vertical bar indicates a picture
- a symbol assigned to the upper right of the picture indicates P is a P picture
- B indicates a B picture
- the number attached to a picture type indicates the decoding order of each picture.
- Each picture Pl, B3, B4, B5, P2 has Tl, ⁇ 2, ⁇ 3, ⁇ 4, ⁇ 5 as display time information, respectively.
- Tl time information
- ⁇ 2, ⁇ 3, ⁇ 4, ⁇ 5 display time information
- the motion vector MV1 of the block (anchor block) BL1 at the same coordinate position as the block BLO in the picture ⁇ 2 that is already decoded (anchor picture) located near the display time of the picture ⁇ 5 is used.
- the motion vector MV1 is a motion vector used when the block BL1 is decoded and refers to the picture P1.
- the motion vector used for decoding block BL0 is motion vector MV-F for picture P1 and motion vector MV-B for picture P2.
- the process of obtaining MVf and MVb from MV1 in this way is called the scaling process.
- block MBLO motion compensation is performed from pictures P1 and P2, which are reference pictures.
- the decoding target block itself does not have a motion vector as in the temporal direct mode, and the decoding target block of the decoding target block located spatially around the decoding target block.
- the motion vector that is held is referred to, and decoding is performed using the motion vector (see, for example, Patent Document 2).
- Fig. 43 is a schematic diagram showing a motion vector prediction generation method according to the spatial direct mode.
- the case where the block BLO of picture B5 in the figure is decoded in the spatial direct mode will be described.
- the display time from the decoding target picture The motion vector that refers to the already decoded picture closest to is determined as a motion vector candidate for the encoding target block.
- the median value is selected as the motion vector of the block to be decoded. If there are two, the average value of them is obtained and used as the motion vector of the encoding target block.
- the motion vectors MVA1 and MVCl are obtained with reference to the picture P2, and the motion vector MVB1 is obtained with reference to the picture P1.
- the decryption pair Elephant picture power Picture that is already decoded picture nearest to display time
- the average value of the motion vectors MVA1 and MVC1 with reference to P2 is obtained, and the decoding target block
- MV-F is the first motion vector. The same applies when obtaining the second motion vector MV-B, and the motion vector MVB2 referring to the decoded picture P3 that is closest in display time is defined as MV-B.
- Patent Document 1 Japanese Patent Laid-Open No. 11 75191
- Patent Document 2 International Publication No. 2004Z008775 Pamphlet
- any two decoded pictures included in the picture memory are selected. Can be referred to.
- the number of pictures that can be stored is limited to a certain number, and the old picture (the picture with the most forward display order)
- the video decoding device is designed so that it is deleted sequentially.
- a reference picture that can be used when a certain picture is decoded is not always usable when a subsequent picture is decoded. For this reason, in the temporal direct mode, the motion vector of the block (anchor block) at the same position as the decoding target block in the decoded target picture (anchor picture) that is close to the decoding target picture in display time.
- the forward reference picture of the anchor block is deleted from the picture memory and cannot be referenced! obtain.
- FIG. 44 is a schematic diagram showing a case where the forward reference picture power of the anchor block cannot be used as a forward reference picture in the decoding target picture.
- the decoding order is the pictures Pl, P2, B3, B4, and B5, and the display j is the pictures Pl, B3, B4, B5, and B2.
- (a) is a diagram showing the reference relationship of a picture when decoding picture P2, which will later become an anchor picture. When picture P2 is decoded, only picture P1 exists, so picture P1 can be used as a reference picture.
- (b) is a diagram showing a picture reference relationship when picture B5 is decoded.
- the display order in front is deleted preferentially. This is because the display order in the front is less likely to be referred to by another picture that is decoded later.
- the forward reference picture of an anchor block that is referenced by the decoding target block according to the temporal direct mode is included in the decoding target block in the form of a picture list (RPL: Reference Picture List). It comes to manage with.
- Referenceable pictures are included in the picture list.
- the forward reference picture of the anchor block is physically stored in the picture memory when decoding the decoding target block. Even if it is stored in, it may not be referenced because it does not exist in the list.
- a reference attribute indicating whether a picture can be used as a reference picture can be assigned and deleted by control from the stream.
- a picture with a reference attribute can be referenced as a reference picture S, and a picture with a reference attribute removed (unreferenced) cannot be referenced.
- the forward reference picture of the anchor block is physically stored in the picture memory at the time of decoding the decoding target block, the forward reference picture power reference attribute is removed by controlling the stream force. I can't refer to it! Due to the problems described above, when decoding the decoding target block according to the temporal direct mode, the forward reference picture of the anchor block may not be used and decoding may not be performed.
- the present invention has been made in view of the above circumstances, and the temporal direct mode. As described above, it is an object to reliably decode even if a mode for decoding a decoding target block is selected using a reference picture of another decoded picture.
- a moving picture decoding apparatus is a moving picture decoding apparatus that decodes a plurality of pictures constituting a moving picture, and each picture includes And a mode extracting means for extracting the coding mode of the processing target block, and a coding mode extracted by the mode extracting means when decoding the processing target block in one picture
- the decoded picture of the decoded picture A reference determination unit that determines whether or not the reference picture that the reference picture has is usable, and when the reference determination unit determines that the reference picture is usable, the reference picture is used.
- the decoding process When the decoding process is executed according to the first encoding mode and the reference determination unit determines that the reference picture is not usable, the decoding process is performed according to the first encoding mode using the reference picture. And a decoding processing means for executing the decoding process in a mode different from that of the decoding process.
- the first code key mode is a temporal direct mode defined in the H.264 standard, for example.
- the moving picture decoding apparatus as in the temporal direct mode, decoding in a mode in which a decoding target block is decoded using a reference picture of another decoded picture. Can be reliably continued.
- FIG. 1 is a diagram showing an example of the configuration of a video decoding device 100 according to the present invention.
- FIG. 2 is a diagram showing an example of the data structure of the video decoding device 100 of the present invention.
- FIG. 3 is a diagram showing an example of a decoding procedure in the moving picture decoding apparatus according to the first embodiment of the present invention.
- FIG. 4 is a diagram showing an example of a procedure of substitution processing in the video decoding device 100 according to the first embodiment of the present invention.
- FIG. 5 is a diagram showing a stream structure for explaining a case where no forward reference picture exists in the picture memory in the temporal direct mode.
- FIG. 6 is a diagram illustrating an example of a picture management information table and a forward reference picture list of the stream in FIG. 5.
- FIG. 6 is a diagram illustrating an example of a picture management information table and a forward reference picture list of the stream in FIG. 5.
- FIG. 7 is a diagram showing an example of a case where no forward reference picture exists in the picture memory in the temporal direct mode.
- FIG. 8 is a diagram showing an example of a conversion procedure to a forward reference picture number.
- FIG. 9 is a diagram showing an example of a procedure for creating a conversion table into forward reference picture numbers.
- FIG. 10 is a diagram showing an example of a forward reference picture reference table of the stream of FIG.
- FIG. 11 is a diagram illustrating a stream configuration for explaining a case where a forward reference picture does not exist in a forward reference picture list in the temporal direct mode.
- FIG. 12 is a diagram illustrating an example of a picture management information table and a forward reference picture list of the stream in FIG. 11.
- FIG. 13 is a diagram illustrating an example of a case where the forward reference picture does not exist in the forward reference picture list in the temporal direct mode.
- FIG. 14 is a diagram showing an example of a forward reference picture reference table of the stream of FIG. 11.
- FIG. 15 is a diagram illustrating an example of a case where a forward reference picture is substituted with a forward reference picture number 0 in the video decoding device 100 according to the first embodiment of the present invention.
- FIG. 16 is a diagram illustrating an example of a case where a forward reference picture is substituted with a picture having a similar display time in the moving picture decoding apparatus 100 according to the second embodiment of the present invention.
- FIG. 17 One of the motion vectors is referred to by the moving image decoding apparatus 100 according to the third embodiment of the present invention. It is a figure which shows an example when the other vector is 0.
- FIG. 18 is a diagram illustrating an example of a case where the motion vector is set to 0 in the video decoding device according to the fourth embodiment of the present invention.
- FIG. 19 is a diagram showing an example of a case where a motion vector is substituted only in the backward reference direction in the video decoding device 100 according to the fifth embodiment of the present invention.
- FIG. 20 is a diagram illustrating an example of a case where a motion vector is substituted only in the backward reference direction in the video decoding device 100 according to the seventh embodiment of the present invention.
- FIG. 21 is a diagram illustrating an example in which all pixel copy is performed as a substitute process of the moving image decoding apparatus 100 according to the eighth embodiment of the present invention.
- FIG. 22 is a diagram showing an example of a procedure of substitution processing in the video decoding device 100 according to the ninth embodiment of the present invention.
- FIG. 23 is a diagram showing a stream structure for explaining a case where the forward reference picture does not exist in the forward reference picture list in the temporal direct mode.
- FIG. 24 is a diagram illustrating an example of a case where the forward reference picture does not exist in the forward reference picture list in the temporal direct mode.
- ⁇ 25 This is a diagram showing a stream structure for explaining the case where the forward reference picture is a non-reference picture.
- FIG. 26 is a diagram illustrating an example of a substitute process performed by the video decoding device 100 according to the ninth embodiment when the forward reference picture is a non-reference picture.
- FIG. 27 is a diagram illustrating a stream configuration for explaining a case where the forward reference picture is an unused picture in the temporal out-of-time mode.
- FIG. 28 is a diagram illustrating an example of a substitute process of the moving picture decoding apparatus 100 according to the ninth embodiment when the forward reference picture is an unused picture in the temporal out-of-time mode.
- FIG. 29 is a diagram showing an example of a decoding procedure by the moving picture decoding apparatus 100 according to the tenth embodiment of the present invention.
- FIG. 30 is a diagram showing an example of a decoding procedure by the moving picture decoding apparatus 100 according to Embodiment 11 of the present invention.
- FIG. 32 is a diagram illustrating an example of decoding by implicit weighted prediction in temporal direct mode.
- FIG. 33 is a diagram illustrating an example of a weighted prediction decoding procedure performed by the video decoding device 100 according to the twelfth embodiment of the present invention.
- FIG. 34 is a diagram illustrating an example of a decoding result of weighted prediction by the video decoding device 100 according to the thirteenth embodiment of the present invention.
- FIG. 35 is a diagram illustrating an example of a weighted prediction decoding procedure performed by the video decoding device 100 according to the thirteenth embodiment of the present invention.
- FIG. 36 is a diagram illustrating an example of a decoding prediction procedure for weighted prediction by the video decoding device 100 according to the thirteenth embodiment of the present invention.
- FIG. 37 is a diagram illustrating an example of explicit weighted prediction in the substitute process in the video decoding device 100 according to the thirteenth embodiment of the present invention.
- ⁇ 38] A diagram showing a configuration of the mobile phone according to the fourteenth embodiment of the present invention.
- FIG. 39 is a diagram showing a configuration of a mobile phone according to the fifteenth embodiment of the present invention.
- FIG. 40 is a diagram illustrating an example of a relationship between reference images of the H.264 standard.
- FIG. 41 is a diagram showing an example of the relationship between the decoding order and display order of the H.264 standard.
- FIG. 42 is a diagram illustrating an example of decoding in the temporal direct mode.
- FIG. 43 is a diagram showing an example of decoding keys in the spatial direct mode.
- Fig. 44 is a diagram illustrating an example where decoding in the temporal direct mode is impossible. Explanation of symbols
- FIG. 1 is a block diagram showing a configuration of a moving picture decoding apparatus 100 compliant with the H.264 standard according to the first embodiment.
- the moving picture decoding apparatus 100 includes a code stream analysis unit 101, a prediction residual decoding unit 102, a picture memory 103, a reference picture 'motion vector storage unit 104, and a reference picture' motion.
- a vector prediction unit 105, a motion compensation unit 106, an addition operation unit 107, a switch unit 108, a direct mode enable / disable determination unit 109, a substitute processing unit 110, and an in-screen prediction unit 111 are provided.
- the code string analysis unit 101 extracts various data such as code key mode information and motion vector information used at the time of code key input from the input code key stream (stream).
- the prediction residual decoding unit 102 performs decoding of the input prediction residual code data and generates prediction residual image data.
- the picture memory 103 stores the generated decoded data.
- the reference picture 'motion vector storage unit 104 stores the reference picture and motion vector extracted by the code string analysis unit 101 in the form of a motion vector information table 104a.
- the reference picture motion vector predictor 105 calculates a reference picture motion vector used for motion compensation based on the information on the code mode and the motion vector extracted by the code stream analyzer 101. To do.
- the motion compensation unit 106 generates motion compensated image data based on the reference image and the motion vector calculated by the reference image / motion vector predicting unit 105.
- the addition operation unit 107 adds the prediction residual image data input from the prediction residual decoding unit 102 and the motion compensated image data input from the motion compensation decoding unit 106 to generate decoded image data. To do.
- the switch unit 108 switches the decoded image data depending on whether motion compensation is used or not used for each code mode.
- the direct mode feasibility determining unit 109 determines whether or not the decoding capability in the direct mode is possible. If the determination is impossible, the substitute processing unit 110 is notified.
- the substitution processing unit 110 performs processing necessary for continuing the video decoding key when receiving a notification from the direct mode propriety determining unit 109 that decoding in the direct mode is impossible. This is notified to the picture 'motion vector prediction unit 105, the motion compensation unit 106, or the picture memory 103.
- the intra prediction unit 111 When the decoding target block of the input code sequence is encoded in the intra prediction (intra) mode, the intra prediction unit 111 performs intra prediction and performs decoding of the decoded image data. Is generated.
- the substitute processing unit 110 has only one power that is configured to notify all of the reference picture 'motion vector prediction unit 105, motion compensation unit 106, and picture memory 103.
- a configuration capable of notification is also possible.
- the picture memory at the center in the figure corresponds to the picture memory 103, and has a luminance component and a color difference component as decoded image data.
- the picture memory 103 can have a plurality of pictures, decoded image data is stored here, and image data necessary for reference is referred to here.
- the motion vector information table in the lower part of the figure corresponds to the motion vector information table 104a in the reference picture 'motion vector storage unit 104, and the reference picture information and reference motion vector information necessary for the direct mode for each block. Etc. Examples of such information include the block address, block type information, and field information of the block, the picture memory number of the reference picture, display time information, decoding information, and a reference motion vector.
- the motion vector information table 104a can also have a plurality of pictures.
- the picture management information table in the figure has information necessary for decoding, and at the same time, has a role of linking the picture memory 103 and the motion vector information table 104a.
- Examples of information held in the picture management information table include picture memory number, frame number, picture memory address, motion vector information address, display time information, reference attribute information, There are display attribute information, usage attribute information, display attribute information, field information, and decoding information. If the picture memory number is determined, the corresponding picture management information, picture memory, and motion vector information are uniquely determined.
- the code string analysis unit 101 acquires the block type (code key mode) for the input code string power (step S201).
- the subsequent processing flow differs depending on the block type at that time.
- step S202 When the block type is intra prediction (step S202: NO), the prediction residual decoding unit 102 or the intra prediction unit 111 generates decoded image data as shown in FIG. Store (step S212).
- the reference picture 'motion vector prediction unit 105 The reference picture number and motion vector information are acquired from 101 (step S204).
- the reference picture number is a number assigned to a picture that can be referred to by the decoding target picture, and is determined for each coding target picture.
- the reference picture 'motion vector prediction unit 105 has the power of the motion vector information acquired from the code stream analysis unit 101, such as information on blocks around the target block. Since the information may be compressed, it is converted into a motion vector so that a reference image can be actually obtained.
- the motion compensation unit 106 converts the reference picture number into a picture memory number in which a reference image is actually stored (step S205). Further, a reference image is acquired from the picture memory 103 using the picture memory number and the motion vector (step S206). Next, the motion compensation unit 106 obtains a predicted image to be used for decoding (step S207).
- the predicted image is not exactly the same as the reference image. For example, in a mode in which two images can be referenced, such as a B picture, the two reference images need to be averaged as a predicted image.
- the addition operation unit 107 adds the predicted image and the predicted residual image, thereby obtaining a decoded image.
- Data generation is complete (step S208).
- the decoded key image data is stored in the picture memory 103.
- the reference picture 'motion' is not included because the code string does not include the reference picture number or motion vector information.
- the vector prediction unit 105 calculates a reference picture number and a motion vector based on the temporal direct mode algorithm (step S210). The temporal direct mode algorithm will be described later.
- step S205 After calculating the reference picture number and the motion vector, the same processing as when the block type is inter-screen prediction and not in the direct mode is executed (steps S205 to S208). Even when the block type is inter-screen prediction (step S 203: YES) and the spatial direct mode (step S 209: NO), the temporal direct mode is used except that the reference picture number and motion vector calculation method are different. (Step S211).
- the algorithm for the temporal direct mode is the same as that of the prior art, so it will not be described here.
- the reference picture 'motion vector prediction unit 105 determines that the index of the backward reference picture list (backward reference picture number) is 0 for the decoding target picture as an anchor picture (step S301).
- the backward reference picture number starts from 0, and is assigned to a picture that can be referred to the decoding target picture.
- the backward reference picture number is temporally related to the decoding target picture. Is given preferentially to the picture that is behind and the picture that is close in time to the decoding target picture (the smaller the number, the higher the priority), so the anchor picture is assigned to the decoding target picture. On the other hand, it is often behind the display time and closest to the picture.
- the forward reference picture information and the motion vector of the block (anchor block) on the same coordinates of the anchor picture are referred to from the reference picture / motion vector storage unit 104.
- the forward reference picture information and the motion vector of the decoded picture are stored. Is stored at the time of decoding, and therefore, it is possible to acquire such information.
- the forward reference picture information acquired from the reference picture motion vector storage unit 104 is not the forward reference picture number itself.
- the forward reference picture number at the time of anchor picture decoding is different for the picture to be decoded, and is used for identifying the picture as it is. Can not.
- parameters that do not change for each decoding target picture such as a picture notifier number, a display order number, and a frame number can be used. Any other information that can be identified by the picture may be used.
- the reference picture 'motion vector prediction unit 105 notifies the identification information of the forward reference picture of the anchor block to the direct mode availability determination unit 109.
- the direct mode availability determination unit 109 checks whether or not there is a picture having the same identification information from the forward reference picture list of the decoding target picture (step S303). If the corresponding picture exists (step S303: YES), the reference picture 'motion vector prediction unit 105 is notified because decoding in the temporal direct mode is possible. If the corresponding picture does not exist (step S303: NO), since it is impossible to continue decoding in the temporal direct mode as it is, a substitute process is performed. The substitution process will be described later.
- the reference picture 'motion vector predicting unit 105 detects the front of the picture having the same identification information from the forward reference picture list of the decoding target picture.
- a reference picture number is calculated and determined as a forward reference picture of the decoding target picture (step S304).
- the reference picture 'motion vector prediction unit 105 determines the anchor picture as the backward reference picture of the picture to be decoded (step S305).
- the back reference picture number is always 0.
- reference picture 'motion vector prediction section 105 obtains a motion vector of the decoding target block.
- a motion vector is calculated by performing scaling processing on the motion vector of the anchor block with the display order number of the forward reference picture and the display order number of the backward reference picture (step S306).
- Scaling is a conventional technique The explanation is omitted because it is similar to the technique.
- FIG. 5 is a schematic diagram showing the decoding sequence, the display time relationship, the reference relationship between pictures, and the state of the picture memory 103 of each picture in the code string (stream).
- Fig. 5 shows the pictures arranged in decoding order
- the lower part shows the pictures arranged in display order
- the dashed arrow in the middle shows the correspondence between the decoding order and display order of each picture.
- the display order is signed as an attribute of each picture.
- the size of the picture memory 103 is the power specified by the stream.
- the capacity of the picture memory 103 is assumed to exist for three pictures excluding the picture to be decoded.
- the picture memory numbers are 0, 1, and 2 from the top in the figure.
- the picture memory 103 is empty at the start of decoding of the picture P1, but if the picture P1 is encoded as having a reference attribute, it is stored in the picture memory 103 after decoding (picture memory number 0).
- picture P2 and picture B3 are decoded as having the reference attribute
- 103 is stored in the picture memory before picture B4 decoding (picture memory number). 0, 1, 2).
- picture memory 103 already has three pictures occupied in the picture memory 103. There is no free space.
- the H.264 standard stipulates that a picture with a low priority is deleted from the picture memory at this time.
- the priority is basically determined by whether or not the picture has a reference attribute and whether or not the display number is forward force. In this case, the picture P1 with the frontmost display number is deleted from the picture memory.
- FIG. 6 (a) shows a picture management information table at the time of picture B5 decoding. For example, a decoding number and a display number are managed for the picture memory number.
- FIG. 7 is a schematic diagram showing the relationship with the reference picture at the time of decoding picture B5.
- decoding picture B5 forward reference picture numbers are assigned to pictures existing as reference pictures in the picture memory 103 in the order of picture B4, picture B3, and picture P2. This is because priority is given to the display order of the decoding target picture that is near the front and is given to the picture that is close to the display order of the decoding target picture after that.
- Back reference picture numbers are assigned in the order of picture P2, picture B4, and picture B3, based on the same criteria.
- FIG. 6 (b) shows a forward reference picture list of picture B5. Since the forward reference picture number is determined as described above, the forward reference picture list of FIG. 6B is obtained by copying the information in the picture management information table of FIG. 6A in the order of the forward reference picture number.
- the picture memory 103 and the reference picture list have a one-to-one correspondence. However, in general, since the maximum number of reference picture lists can be limited, there are pictures that can be referred to in the picture list. In some cases, the reference picture number is not assigned. In general, a plurality of reference picture numbers can be assigned to the same picture memory.
- the anchor picture is determined as the picture P2 having the backward reference picture number 0.
- the motion vector information table stores display time Tl, picture memory number 0 (decoding), decoding number 1, etc. as reference picture information for identifying the reference picture Has been.
- Reference picture information power Figure 8 shows an example of the conversion procedure to forward reference picture numbers.
- the process shown in the figure is a process for searching by referring to all the contents of the forward reference picture list to see if there is a match with the reference picture. This search needs to be performed on all blocks in the time direct mode. ⁇ ⁇ In the H.264 standard, the size of the forward reference list is 32 at the maximum. This is an inefficient process.
- the forward reference list is common to all blocks in the slice, so reference once per slice Picture information power If a conversion table to forward reference picture numbers is created, the processing in each block only needs to refer to the table, so it is efficient.
- FIG. 9 shows an example of a procedure for creating a conversion table into forward reference picture numbers.
- the conversion table actually created differs depending on what information is used to identify the reference picture.
- Figure 10 shows an example of the conversion table for the reference picture information power when decoding picture B5 to the forward reference picture number.
- (a) is a conversion table when the reference picture is identified by the display time.
- (B) in the figure is a conversion table when the reference picture is identified by the decoding number.
- (C) in the figure is a conversion table when the reference picture is identified by the picture memory number.
- the display time of the reference picture of the anchor block is T1
- the forward reference picture number is assigned. It turns out.
- the decoding number of the reference picture of the anchor block is 1, but referring to (b) in the figure, the forward reference picture number is not assigned. Becomes clear.
- the picture memory number of the reference picture of the anchor block is 0.
- the decoding number of the anchor picture is 2 and the picture with the picture memory number 0 is the decoding number 4.
- the reference picture of the anchor picture cannot be decoded after the anchor picture, so the picture memory has no anchor picture. It turns out that there is no reference picture left.
- FIG. 11 is a schematic diagram showing the decoding order, the display time relationship, the reference relationship between pictures, and the picture memory state of each picture in the code string (stream). Difference from the stream in Figure 5 That is, the size of the picture memory 103 exists for the number of pictures. For this reason, at the time of decoding the picture B5, all of the previously decoded pictures Pl, picture P2, picture B3, and picture B4 are stored in the picture memory (picture memory numbers 0, 1,. 2, 3) o
- FIG. 12 (a) shows a picture management information table at the time of picture B5 decoding. The explanation is omitted because it is the same as Fig. 6 (a).
- FIG. 13 is a schematic diagram showing the relationship with the reference picture at the time of picture B5 decoding.
- the difference from Fig. 7 is that the maximum number of forward reference picture lists and backward reference picture lists is limited to one, not just the size of picture memory.
- the maximum number of reference picture lists can be defined by the stream.
- the backward reference picture number has a high priority and is assigned only to picture P2.
- Figure 12 (b) shows the forward reference picture list for picture B5. The explanation is omitted because it is the same as Fig. 6 (b).
- FIG. 14 shows an example of the conversion table of the reference picture information power when decoding picture B5 to the forward reference picture number.
- (a) is a conversion table when the reference picture is identified by the display time.
- (B) in the figure is a conversion table when the reference picture is identified by the decoding number.
- (C) in the figure is a conversion table when the reference picture is identified by the picture memory number.
- the method for creating the conversion table is the same as in FIG.
- Reference picture information power The procedure for conversion to a forward reference picture number is also the same as in the case of FIG. 8 when the reference picture is identified by the display time and when the decoding number is used. To do.
- the picture memory number of the reference picture of the anchor block is 0.
- the forward reference picture number is not assigned. Unlike the case of Fig. 10, it is not necessary to refer to the decryption number. As described above, since no forward reference picture is found, some substitute processing is required to continue decoding decoding.
- the video decoding device 100 performs the substitute processing (steps S307 to S310) in the temporal direct mode.
- the size of the forward reference picture list is defined by the number of reference pictures included in the picture list, but is also defined by the maximum number specified in the stream. However, since the size of the reference picture list does not become so, there is always a picture with a forward reference picture number of 0. Therefore, if the picture with the forward reference picture number 0 is determined as the forward reference picture of the decoding target block, the temporal direct mode can always be continued. Further, the substitute processing method according to the present method has an advantage that it is easy to implement.
- Reference picture information power of anchor block The forward reference picture number conversion process is as shown in FIG. 8 or FIG.
- step S4301 in FIG. 8 if the forward reference picture number of the decoding target block is initialized to 0, substitution processing can be performed in normal processing and temporal direct mode. Also, for example, in step S4401 of FIG. 9, if all the conversion tables from the forward reference picture of the anchor block to the forward reference picture number are initialized with 0, the substitution process can be similarly performed in the temporal direct mode. Become.
- the substitute processing unit 110 obtains the reference motion vector in step S310. Continue using the direct mode in time.
- the motion vector determination method in the first embodiment is particularly effective when the display time information of the original reference picture P1 and the picture B3 used this time are not significantly different.
- FIG. 15 is a schematic diagram of substitution processing in the temporal direct mode in the first embodiment.
- substitution processing section 110 substitutes picture B4 of forward reference picture number 0 for the forward reference picture of the decoding target block, and continues decoding in the temporal direct mode.
- the video decoding device 100 can continue the decoding processing in the temporal direct mode even if the reference picture of the block to be decoded cannot be referred to and the situation falls. be able to.
- the second embodiment is different from the first embodiment in the method for determining the forward reference picture.
- Embodiment 1 The substitution process shown in Embodiment 1 is easy to implement. If the display time of the reference picture of the anchor block and the picture with the forward reference picture number power ⁇ are separated, the difference between the images of the two As a result, there is a possibility that the reference image data will be significantly different.
- the display order is as close as possible to the original reference picture, and there is a high possibility of improvement if a picture is selected as the reference picture.
- step S308 the display time information of the picture referred to by the anchor block is compared with the display time information of the picture included in the forward reference picture list, and the picture is the closest to the forward reference picture. Determine as.
- FIG. 16 is a schematic diagram at the time of substitution processing in the temporal direct mode in the second embodiment.
- the picture referred to by the anchor block is picture P1, and its display order information is T1.
- the forward reference picture list contains picture B4, picture B3, and picture P2.
- the picture with the display order information closest to Tl is picture B3. If the temporal direct mode is continued using the picture B3 as the forward reference picture, the substitute processing unit 110 can output an image close to the image specified in the code string and can continue decoding.
- the backward reference picture can be determined as an anchor picture (step 309) in the same manner as in the decoding process (steps S301 to S306) in the normal temporal direct mode.
- the third embodiment is different from the first and second embodiments in the motion vector determination method.
- the substitute processing unit 110 uses the force that used the reference motion vector as it is in step S310.
- the forward reference vector MV-F the backward reference vector
- the tilt shift becomes larger than the original reference motion vector MV1.
- an image at a position higher than the original position is acquired from the forward reference image, and an image at a position lower than the original position is acquired from the backward reference image. is there.
- the forward reference vector MV — F when there is a difference in display time information between the original reference picture P1 and the picture B3 used this time, the forward reference vector MV — F, the backward Both the reference vector MV-B causes a deviation in inclination compared to the original reference motion vector MV1.
- the corresponding decoding target block may be an image having no continuity in terms of time and space.
- the substitute processing unit 110 sets the motion vector to 0 for a reference picture whose display time is close to that of the decoding target picture in Step S310.
- FIG. 17 is a schematic diagram of substitution processing in the temporal direct mode in the third embodiment.
- the anchor picture is the 0th backward reference picture for the decoding target block
- the display time is close to the decoding target picture (picture B5)
- the picture (picture P2) is set, so the backward reference motion vector is set to 0. It becomes possible to do.
- the display time (T2) is not close to the display time (T4) of the picture to be decoded.
- the reference vector may be used as it is for the forward reference motion vector.
- a scaled value based on the temporal direct mode algorithm may be used.
- Figure 17 shows the case where the former method is used.
- the fourth embodiment is different from the third embodiment in the motion vector determination method.
- the substitute processing unit 110 does not make the motion vector 0 because the forward reference picture is not close in display time to the picture to be encoded.
- the forward reference picture is determined to be a picture whose forward reference picture number is 0, a reference picture whose display time is close to that of the decoding target picture is usually set.
- substitution processing unit 110 also sets the forward reference motion vector to 0 in step S310.
- FIG. 18 is a schematic diagram of substitution processing in the temporal direct mode in the third embodiment. Since the backward reference picture is picture P2 and the forward reference picture is picture B4, and the decoding target picture P5 is close in display time, the forward reference motion vector and backward reference motion vector are set to zero. In this case, the decoding target picture B5 becomes an intermediate value between pictures P2 and B4 that are neighboring pictures in display time, and temporal continuity can be expected.
- the fifth embodiment is different from the first to fourth embodiments in the motion vector determination method.
- Embodiments 1 to 4 since the inclination of the original reference motion vector and the motion vector actually used for reference in the encoding target block are different, it naturally changes smoothly (scales). Even for moving images, the decoding result may not be smooth.
- the substitute processing unit 110 applies the concept of temporal direct mode scaling to the motion vector used in the substitute process in step S310.
- FIG. 19 is a schematic diagram of substitution processing in the temporal direct mode in the fifth embodiment.
- the forward reference vector MVf ′ and the backward reference vector MVb ′ which are the reference motion vectors of the original coding target block, can be obtained by the equation shown in (Equation 2).
- the motion vector is also scaled according to this display time difference.
- the forward reference picture referenced by the anchor block and the forward reference picture reference number referenced by the decoding target block are just the decoding target picture and anchor picture display number. Is also required.
- the prediction error is added even during the substitution process.
- the prediction error may be added as in the normal process, or the prediction error may not be converted in consideration of the substitution process.
- the sixth embodiment is different from the first to fifth embodiments in the substitute processing method.
- the substitute processing unit 110 performs the substitute process in the temporal direct mode.
- Steps S307 to S310 Force Instead, in the sixth embodiment, the substitution processing unit 110 performs substitution processing in the spatial direct mode (step S311).
- Spatial direct mode does not require reference pictures and motion vectors in the stream, as does temporal direct mode.
- the forward reference picture of the anchor block does not exist, so even if the temporal direct mode is not possible, the spatial direct mode is executed as a substitute process. Can S311).
- the prediction error may be added as in the normal process, or the prediction error may not be converted in consideration of the substitution process.
- the seventh embodiment is different from the first to sixth embodiments in the substitute processing method.
- the substitute processing unit 110 performs substitute processing.
- the substitute processing unit 110 performs the substitute process by a method other than the direct mode (step S312).
- FIG. 20 is a schematic diagram of a substitute process for performing motion compensation only by backward reference in the seventh embodiment.
- the decoding target block of decoding target picture B5 is decoded in backward decoding only (picture P2) decoding mode.
- the reference motion vector can be determined by the same method as in the case of the substitution process in the temporal direct mode shown in the first to fifth embodiments.
- FIG. 18 shows back reference in a method (Embodiment 4) for setting the motion vector to 0 as an example.
- prediction error is added even during the substitution process.
- the prediction error may be added as in the normal process, or the prediction error may not be converted in consideration of the substitution process.
- the eighth embodiment is different from the first to seventh embodiments in the substitute processing method.
- the decoding target block of the decoding target picture is substituted.
- the approach was to apply the processing and continue decoding (steps S307 to S312).
- the fact that such a substitute process is required for a specific block may require a similar substitute process for neighboring blocks.
- the substitution process limited to a specific block may result in a decoding result that is far from the expected decoding result.
- the substitute processing unit 110 performs substitute processing in units of pictures or slices instead of steps S307 to S312 (step S313).
- the substitute processing method is that the decoding of the stream for the corresponding picture is stopped, and for each block belonging to the corresponding picture or for all the blocks belonging to the corresponding slice, the substitute processing shown in the first to seventh embodiments. Should be executed.
- the substitute processing unit 110 may copy the image data of the most recently decoded picture, or may copy the image data of the most recently displayed picture! Any method can be used, such as a cocoon method.
- FIG. 21 shows an example of copying the image data of the most recently decoded picture.
- the decoding order is pictures Pl, P2, B3, B4, and B5, and the picture that is decoded immediately before picture B5 is picture B4.
- substitution processing occurs in picture B5
- the pixel data of picture B4 is copied to picture B5, and a decoding result with high continuity between pictures can be obtained.
- the ninth embodiment is different from the first to eighth embodiments in the conditions under which the substitute processing unit 110 performs the substitute process.
- FIG. 22 is a flowchart showing the operation of the substitute processing unit 110 in the ninth embodiment. Steps S 2001 to S 2006 in the figure are the same as steps S 301 to S306 shown in FIG. 3 in the first embodiment. Because there is, it is not detailed here. Hereinafter, the substitution process (steps S2007 to S2014) will be described.
- step S2003 Even if it is determined in step S2003 that substitution processing is necessary (step S2003: NO), the image data of the reference picture itself is not necessarily lost from the picture memory 103.
- the reference picture physically exists in the picture memory 103, it is originally defined in the H.264 standard so that it cannot be decoded with reference to the reference picture.
- the substitute processing unit 110 checks whether or not the forward reference picture of the anchor block exists in the picture memory 103 so that it can be referred to. For example, regardless of the original rules, the forward reference picture of the decoding target picture is determined to be the substitute picture as a substitute process, and thereafter the same processing as in the normal temporal direct mode is performed (step S2007 and steps S2010 to S2013). .
- step S 2007 and step S 2010 will be described with reference to the schematic diagrams of FIGS.
- FIG. 23 is a schematic diagram showing the decoding order of each picture in the stream, the relationship between display times, the reference relationship between pictures, and the state of the picture memory 103.
- the picture memory 103 contains the picture Pl, the picture P2, and the picture All of B3 and picture B4 are included.
- FIG. 24 is a schematic diagram in the case where the decoding target picture is the picture B5 in the above stream, and the picture B5 is decoded in the temporal direct mode. If the maximum number of forward picture lists is specified as 2 in the stream, only pictures B4 and B3 can exist in the forward reference picture list when decoding picture B5. Picture B5 Anchor One block of forward reference picture is picture PI, but it is not included in the forward reference picture list, so it is necessary to perform substitution processing.
- picture P1 As shown in FIG. 23, at the time of decoding picture B5, picture P1 remains in a state in which it can be referred to, so that it is possible to perform a substitute process as a reference picture.
- the picture memory 103 may be controlled by a stream.
- a picture memory control command can be embedded in a stream, and a reference attribute is set when another picture is decoded later for a picture to which a reference attribute is assigned. Can be removed (not referenced).
- the reference attribute Before the reference attribute is changed, even if the picture can be referred to by other picture powers, once the reference attribute is changed to non-reference, it cannot be used as a reference picture in pictures decoded thereafter. If the picture attribute becomes non-referenced, whether or not to delete the picture from the picture memory 103 is determined by the display attribute of the picture.
- the decoding order and the display order can be arbitrarily set. Therefore, even when a picture to be decoded later needs to be displayed first, even a picture that is not used as a reference picture is used. Therefore, it is necessary to leave it in the picture memory 103 for display (the display attribute is hidden).
- the reference attribute is assigned to the reference picture when the decoding target block is decoded even though the reference picture of the decoding target block exists in the picture memory 103.
- the substitute processing unit 110 does not rely on the original rule even if the forward reference picture of the anchor block existing in the picture memory 103 is non-referenced, and does not depend on the original rule.
- the forward reference picture is determined as that picture, and thereafter, the same processing as in the normal temporal direct mode can be performed (step S200). 8 and steps S2010 to S2013).
- step S 2008 and step S 2010 will be described with reference to the schematic diagrams of FIGS.
- FIG. 25 is a schematic diagram showing the decoding order of each picture of the stream, the relationship between display times, the reference relationship between pictures, and the state of the picture memory.
- the picture memory 103 includes the picture P2, the picture B3, and the picture B4 as referenceable and the picture P1 as a non-reference.
- Fig. 26 is a schematic diagram when the encoding target picture is the picture B5 in the stream and the picture B5 is decoded in the temporal direct mode.
- picture P1 Since picture P1 is unreferenced, it is not included in the forward reference picture list of picture B5. Since the forward reference picture of the anchor block of picture B5 is not included in the forward reference picture list, which is picture P1, substitution processing must be performed.
- the picture attribute is dereferenced, if the picture has already been displayed (the display attribute has been displayed), it is not necessary to leave the picture memory 103 already. At this time, the picture memory is released (use attribute is not used).
- this picture is the forward reference picture of the anchor picture.
- the reference picture is still present in the picture memory 103, but decoding cannot be performed with reference to the reference picture.
- the substitute processing unit 110 does not comply with the original regulations even if the use attribute of the reference picture existing in the picture memory 103 is changed to unused.
- the forward reference picture of the decoding target picture is determined to be the picture, and thereafter, the same processing as in the normal temporal direct mode can be performed (step S2009 and steps S2010 to S2013).
- step S 2009 and step S 2010 will be described with reference to the schematic diagrams of FIGS.
- FIG. 27 is a schematic diagram showing the decoding order of each picture in the stream, the relationship between display times, the reference relationship between pictures, and the state of the picture buffer.
- the picture memory 103 at the time of decoding picture B5 includes picture P2, picture B3, and picture B4 as referenceable, and picture P1 also remains in the unused area. That's it.
- FIG. 28 is a schematic diagram in the case where the encoding target picture is picture B5 in the above stream, and the picture B5 is decoded in the temporal direct mode.
- picture P1 Since picture P1 is unused, it is not included in the forward reference picture list of picture B5. Since the forward reference picture of the anchor block of picture B5 is not included in the forward reference picture list that is picture P1, substitution processing must be performed. As shown in FIG. 27, at the time of decoding of picture B5, picture P1 remains in the unused area in the picture memory, so that it is possible to perform substitution processing as a reference picture.
- the substitute processing can be performed as described in the first to eighth embodiments (step S2011 or step S2014). (Embodiment 10)
- the tenth embodiment differs from the ninth embodiment in the substitute processing method.
- step S2010 a picture that is not assigned to a reference picture number is determined as a reference picture.
- the H.264 standard assumes that the reference picture is always included in the reference picture list.
- the forward reference picture number used as a reference picture is always obtained.
- FIG. 29 is a flowchart showing an example of the operation of the moving picture decoding apparatus 100.
- the process branches depending on whether a picture not included in the reference picture list is determined as the reference picture (step S2707).
- step S2707: NO If the forward reference picture is included in the forward reference picture list (step S2707: NO), the picture buffer number is referenced from the reference picture number (step S2702) but is not included in the reference picture list Since (Step S2707: YES) does not have a reference picture number, the subsequent motion compensation can be made common to the normal motion compensation processing by skipping the above processing (Step S2702).
- the eleventh embodiment differs from the tenth embodiment in the substitute processing method.
- FIG. 30 is a flowchart showing an example of the operation of the moving picture decoding apparatus 100.
- the subsequent processing is made common to normal motion compensation processing.
- Embodiments 10 and 11 are examples of a method for performing motion compensation with a reference picture having no reference picture number. If the above problem is solved, motion compensation is performed with another method. You may go.
- the embodiment 12 differs from the embodiments 1 to 11 in that the substitution process is performed in consideration of the weighted prediction defined in the H.264 standard.
- Weighted prediction is a mechanism for predicting the brightness (luminance) of an image, and is characterized by being effective for images whose brightness changes in steps (especially fade-in and fade-out). .
- Explicit weighted prediction is a mode in which a weighting factor for the reference image is embedded in the stream, and implicit weighted prediction is a weighting factor for the reference image, similar to the scaling process in the temporal direct mode. Is determined by the ratio of the display time to the reference image.
- the pixel value is obtained as an average value of both reference images.
- a specific coefficient is applied to both reference images.
- the pixel value is obtained.
- FIG. 31 is a schematic diagram illustrating explicit weighted prediction.
- the decoding target picture is picture B5, and in the temporal direct mode, the reference picture is determined to be picture P1 having a forward reference picture number of 2 and picture P2 having a backward reference picture number of 0. To do.
- a weighting factor for each reference picture number is embedded in the stream. At this time, the default weighting factor is also included, so that the specified strength can be used. This default weighting factor is assigned to the reference picture number.
- the forward reference weighting factors WO and DO are defined according to the H.264 standard. Are assigned default weighting factors (Wd, Dd).
- the weighting factors W10 and D10 specified by the stream are assigned to the backward reference weighting factors Wl and D1.
- the pixel value (luminance) Y of the decoding target block is obtained by the equation shown in (Equation 4), where YO is the luminance of the forward reference image and Y1 is the luminance of the backward reference image.
- FIG. 32 is a schematic diagram for explaining implicit weighted prediction.
- the decoding target picture is picture B5, and in the temporal direct mode, the reference picture is determined to be picture P1 having a forward reference picture number 2 and picture P2 having a backward reference picture number 0. To do.
- the weighting factor is determined by scaling the display time with the reference picture.
- weighted prediction in the H.264 standard depends on the reference picture number. (10-3. Operation)
- Figure 33 shows the processing flow when decoding without assigning a reference picture to motion compensation using weighted prediction.
- step S3112 If the reference picture determined in the substitute process is not included in the forward reference picture list (step S3112: YES), the process of determining the coefficients necessary for weighted prediction for the above reasons (step S3102, step S3102) S3108, step S3103, step S3109, and step S3110) cannot be performed! /.
- motion compensation is performed without a weighted prediction coefficient, motion compensation is performed using an average value of forward reference and backward reference in step S3106.
- Embodiment 13 differs from Embodiment 12 in the substitution processing method using weighted prediction.
- FIG. 34 is a schematic diagram for explaining the effect when weighted prediction cannot be applied during substitution processing.
- Block A Since the reference picture may be changed for each block, out of adjacent blocks A and B, block A can be decoded as a normal process.
- Block B cannot be decoded as a normal process. There is a possibility that a case where decryption is performed by substitution processing will occur.
- weighted prediction can be applied to block A, luminance is assumed to be YA as shown in A in the figure. Since weighted prediction cannot be applied to block B, as shown in (B) in the figure, the expected brightness is YB, but the brightness by the substitution process is YB.
- FIG. 35 shows an example of the operation of the moving picture decoding apparatus 100 in consideration of this point.
- Embodiment 12 The difference from Embodiment 12 is that the reference picture assigned by the substitute process is a forward reference picture. The point is that weighted prediction is applied even when power is not included in the list. However, as described above, explicit weighted prediction is based on the premise that a reference picture number is assigned, so that processing similar to normal processing is not possible during substitution processing.
- processing is continued by applying the values included as the initial values (Wd, Dd) of the explicit weight prediction coefficients in the stream to the reference picture assigned by the substitute processing.
- FIG. 36 shows another example of the operation of the moving picture decoding apparatus 100.
- Embodiment 12 The difference from Embodiment 12 is that when a reference picture assigned by substitution processing is added to the forward reference picture list, an explicit weighted prediction coefficient is used as a weight prediction coefficient of the added forward reference picture number. The difference is that processing continues after the initial values (Wd, Dd) are applied.
- the weighted prediction is applied even in the substitute process, but is applicable.
- the decoding target picture is picture B5, and the stream specifies that the maximum number of forward reference picture lists of picture B5 is 2, the temporal direct mode and the explicit weight prediction mode are applied. It shall be.
- the weighted prediction coefficient is a normal coefficient (W10, D10) with reference to the weighted prediction coefficient table.
- the weighted prediction coefficient has an initial value of Since the measurement coefficients (Wd, Dd) exist, they can be applied.
- Embodiment 14 is an example in which the moving picture decoding apparatus 100 of the present invention is mounted on a mobile phone.
- FIG. 38 shows a configuration of the mobile phone according to the fourteenth embodiment.
- the cellular phone of the fourteenth embodiment includes a main control unit 4111 adapted to control the respective units of the main body unit including the display unit 4122 and the operation keys 4124.
- Power supply circuit unit 4110, operation input control unit 4104, moving image encoding unit 4112, still image encoding unit 4132, camera control unit 4103, display control unit 4102, moving image decoding unit 410 9, still image decoding unit Reference numeral 4131, a demultiplexing unit 4108, a recording / reproducing unit 4107, a modulation / demodulation circuit unit 4106, and an audio processing unit 4105 are connected to the main control unit 4111 via a synchronization node 4113.
- the moving picture decoding unit 4109 has the same configuration as that of the moving picture decoding apparatus 100 that performs the operations described in the first to thirteenth embodiments, and a bit stream of image data is used in each embodiment.
- the generated moving image data is generated by decoding with the decoding method shown in (5), and the generated image is supplied to the display unit 4222 via the display control unit 4102.
- the moving image decoding unit 4109 also notifies the substitution processing unit 4133 when a substitute process is required during the moving image decoding.
- the substitute processing unit 4133 notifies the moving image decoding 4109 again after the substitute processing.
- Each part of the main body may be realized as an integrated circuit.
- the video decoding unit 4109 and the substitute processing unit 4133 may be realized as an integrated circuit! ⁇ (Integrated circuit may be realized as an integrated circuit including other configurations! / ⁇ (integrated circuit B)), and other configurations may be used.
- the fifteenth embodiment is different in substitution processing method from the fourteenth embodiment. .
- the substitution process is applied only to the moving picture decoding unit 4109.
- a mobile phone or the like has a configuration in which the moving image decoded by the moving image decoding unit 4109 is displayed on the display unit 4222, the substitution process is not necessarily performed only on the moving image decoding unit 4109. It is only necessary to obtain the same effect for the display unit 4222 which is not necessary to be performed.
- the same effect can be obtained by continuing to output the contents of the previously displayed picture as it is as a substitute process when it becomes impossible to continue decoding.
- This can be realized by notifying the display processing unit 4102 from the substitute processing unit 4133 to continue displaying the previously displayed picture.
- FIG. 39 shows the configuration of the mobile phone of the fifteenth embodiment.
- Embodiment 14 The difference from Embodiment 14 is that notification can be sent from the substitute processing unit 4233 to the display control unit 4202.
- Each part of the main body may be realized as an integrated circuit.
- the video decoding unit 4109 and the substitute processing unit 4133 may be realized as an integrated circuit (integrated circuit A), or may be realized as an integrated circuit including other configurations.
- integrated circuit B integrated circuit
- the notification of the substitute processing unit 4133 and the display control unit 4102 is performed between the integrated circuits.
- the integrated circuit A is provided with a terminal for notifying the necessity of substitution processing, and the display control unit 4102 changes the operation based on the notification of the terminal power.
- substitute processing As a substitute processing method, other substitute processing may be used as long as the same effect can be obtained without continuing to output the contents of the previously displayed picture as it is.
- the substitute process may be performed only for both the display control unit 4102 and the moving image decoding unit 4109, which are performed only for the display control unit 4102. (Modification)
- step S312 the substitute processing unit 110 copies the image data of the block at the same position as the decoding target block in the previous decoded picture in the decoding order, and performs the substitute process.
- step S312 for example, the substitute processing unit 110 copies the image data of the block at the same position as the decoding target block in the previous decoded picture in the decoding order, and performs the substitute process.
- Embodiments 1 to 15 are specifically recorded in a recording medium such as a flexible disk, optical disk, IC card, ROM cassette, etc.
- the recording medium 100 can be realized by reading the recording medium.
- the program describing the contents of the operation processing can be realized by the moving image decoding apparatus 100 downloading and executing the network power such as the Internet without being recorded on the recording medium.
- Embodiments 1 to 15 the power described on the assumption that each picture is decoded as a frame structure can be implemented by a similar process even in a field structure. Even if the frame structure and field structure are adaptively combined, the same processing can be performed.
- Embodiments 1 to 15 can also be applied to other video coding schemes having the same restrictions as those described based on the H.264 standard.
- Embodiments 14 to 15 have been described by taking a mobile phone as an example, but the present invention is not limited to this.
- the moving image decoding apparatus 100 can be applied to all devices that handle moving images, such as DVD devices, set-top boxes, digital televisions, automobiles, and security systems. Industrial applicability
- the moving picture decoding apparatus is a moving picture decoding apparatus corresponding to the mode in which the decoding target block is decoded using the reference picture of another decoded picture. Widely applicable.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Claims
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008515474A JP5155157B2 (ja) | 2006-05-12 | 2007-04-24 | 動画像復号化装置 |
US12/300,243 US8270492B2 (en) | 2006-05-12 | 2007-04-24 | Moving picture decoding device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006-133298 | 2006-05-12 | ||
JP2006133298 | 2006-05-12 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2007132647A1 true WO2007132647A1 (ja) | 2007-11-22 |
Family
ID=38693746
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2007/058826 WO2007132647A1 (ja) | 2006-05-12 | 2007-04-24 | 動画像復号化装置 |
Country Status (3)
Country | Link |
---|---|
US (1) | US8270492B2 (ja) |
JP (1) | JP5155157B2 (ja) |
WO (1) | WO2007132647A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012014458A1 (ja) * | 2010-07-27 | 2012-02-02 | パナソニック株式会社 | 画像符号化方法および画像復号方法 |
JP2014239420A (ja) * | 2013-05-09 | 2014-12-18 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | 画像復号方法及び画像復号装置 |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
MXPA05013727A (es) * | 2003-06-25 | 2006-07-06 | Thomson Licensing | Metodo y aparato para el calculo de prediccion ponderada con el uso de diferencial de cuadro desplazado. |
KR20100128392A (ko) * | 2009-05-28 | 2010-12-08 | 삼성전자주식회사 | 영상 디스플레이 방법, 영상 매칭 방법 및 이를 이용한 디스플레이 장치 |
US8995526B2 (en) * | 2009-07-09 | 2015-03-31 | Qualcomm Incorporated | Different weights for uni-directional prediction and bi-directional prediction in video coding |
US8711930B2 (en) * | 2009-07-09 | 2014-04-29 | Qualcomm Incorporated | Non-zero rounding and prediction mode selection techniques in video encoding |
US9161057B2 (en) | 2009-07-09 | 2015-10-13 | Qualcomm Incorporated | Non-zero rounding and prediction mode selection techniques in video encoding |
US8594200B2 (en) * | 2009-11-11 | 2013-11-26 | Mediatek Inc. | Method of storing motion vector information and video decoding apparatus |
CA2784517A1 (en) | 2009-12-17 | 2011-06-23 | Telefonaktiebolaget L M Ericsson (Publ) | Method and arrangement for video coding |
JP5387520B2 (ja) * | 2010-06-25 | 2014-01-15 | ソニー株式会社 | 情報処理装置と情報処理方法 |
JP2012161020A (ja) * | 2011-02-02 | 2012-08-23 | Fujitsu Ltd | 画像処理装置および画像処理方法 |
US9106927B2 (en) | 2011-09-23 | 2015-08-11 | Qualcomm Incorporated | Video coding with subsets of a reference picture set |
US9264717B2 (en) | 2011-10-31 | 2016-02-16 | Qualcomm Incorporated | Random access with advanced decoded picture buffer (DPB) management in video coding |
KR101606661B1 (ko) | 2011-11-18 | 2016-03-25 | 모토로라 모빌리티 엘엘씨 | 고효율 비디오 코딩(hevc)을 위한 병치된 화상을 시그널링하기 위한 명시적 방법 |
US9392235B2 (en) | 2011-11-18 | 2016-07-12 | Google Technology Holdings LLC | Explicit way for signaling a collocated reference picture for video coding |
CN103959774B (zh) | 2011-11-18 | 2017-11-24 | 谷歌技术控股有限责任公司 | 用于高效视频编码的运动信息的有效存储 |
CN104137547B (zh) | 2011-11-21 | 2018-02-23 | 谷歌技术控股有限责任公司 | 用于时间预测的共位图片的隐式确定以及组合隐式和显式确定 |
US9300959B2 (en) | 2011-12-26 | 2016-03-29 | Google Technology Holdings LLC | Implicit determination of collocated picture for temporal prediction |
WO2013109092A1 (ko) * | 2012-01-18 | 2013-07-25 | 한국전자통신연구원 | 영상 부호화 및 복호화 방법 및 장치 |
JP6012014B2 (ja) * | 2012-03-30 | 2016-10-25 | サン パテント トラスト | 画像符号化方法および画像復号方法 |
WO2013154674A1 (en) | 2012-04-11 | 2013-10-17 | Motorola Mobility Llc | Evaluation of signaling of collocated reference picture for temporal prediction |
JP6144754B2 (ja) | 2012-04-11 | 2017-06-07 | モトローラ モビリティ エルエルシーMotorola Mobility Llc | 時間的予測のための時間的動きベクトル予測(mvp)フラグのシグナリング |
US9319681B2 (en) | 2012-07-18 | 2016-04-19 | Google Technology Holdings LLC | Signaling of temporal motion vector predictor (MVP) enable flag |
CN105850134B (zh) * | 2013-12-27 | 2020-02-14 | 索尼公司 | 图像处理装置及方法 |
US10148965B2 (en) * | 2015-03-04 | 2018-12-04 | Panasonic Intellectual Property Management Co., Ltd. | Moving image coding apparatus and moving image coding method |
CN114793279A (zh) * | 2016-02-03 | 2022-07-26 | Oppo广东移动通信有限公司 | 运动图像解码装置、编码装置、以及预测图像生成装置 |
US20190158860A1 (en) * | 2016-05-13 | 2019-05-23 | Sharp Kabushiki Kaisha | Video decoding device |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003333602A (ja) * | 2002-05-03 | 2003-11-21 | Lg Electronics Inc | 動画コーディング方法 |
WO2004008775A1 (ja) * | 2002-07-15 | 2004-01-22 | Hitachi, Ltd. | 動画像符号化方法及び復号化方法 |
JP2004088722A (ja) * | 2002-03-04 | 2004-03-18 | Matsushita Electric Ind Co Ltd | 動画像符号化方法および動画像復号化方法 |
JP2004129191A (ja) * | 2002-10-04 | 2004-04-22 | Lg Electronics Inc | Bピクチャのダイレクトモード動きベクトル演算方法 |
JP2004208258A (ja) * | 2002-04-19 | 2004-07-22 | Matsushita Electric Ind Co Ltd | 動きベクトル計算方法 |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6091767A (en) * | 1997-02-03 | 2000-07-18 | Westerman; Larry Alan | System for improving efficiency of video encoders |
US5974184A (en) | 1997-03-07 | 1999-10-26 | General Instrument Corporation | Intra-macroblock DC and AC coefficient prediction for interlaced digital video |
US5991447A (en) | 1997-03-07 | 1999-11-23 | General Instrument Corporation | Prediction and coding of bi-directionally predicted video object planes for interlaced digital video |
JP3209210B2 (ja) * | 1999-02-10 | 2001-09-17 | 日本電気株式会社 | 動画像圧縮方法、動画像圧縮装置及び動画像圧縮プログラムを記憶した記憶媒体 |
WO2003026315A1 (en) * | 2001-09-14 | 2003-03-27 | Ntt Docomo, Inc. | Coding method, decoding method, coding apparatus, decoding apparatus, image processing system, coding program, and decoding program |
BR0206305A (pt) | 2001-11-06 | 2004-07-13 | Matsushita Electric Ind Co Ltd | Método de codificação de imagem em movimento e método de decodificação de imagem em movimento |
EP1489848A4 (en) * | 2002-03-14 | 2006-05-03 | Matsushita Electric Ind Co Ltd | MOTION VECTOR DETECTION METHOD |
EP1418762A1 (en) * | 2002-05-22 | 2004-05-12 | Matsushita Electric Industrial Co., Ltd. | Moving image encoding method, moving image decoding method, and data recording medium |
AU2002950210A0 (en) * | 2002-07-11 | 2002-09-12 | Mediaware Solutions Pty Ltd | Mosaic construction from a video sequence |
JP3977716B2 (ja) * | 2002-09-20 | 2007-09-19 | 株式会社東芝 | 動画像符号化/復号化方法及び装置 |
KR100990829B1 (ko) | 2002-11-01 | 2010-10-29 | 파나소닉 주식회사 | 동화상 부호화 방법 및 동화상 복호화 방법 |
JP3878591B2 (ja) | 2002-11-01 | 2007-02-07 | 松下電器産業株式会社 | 動画像符号化方法および動画像復号化方法 |
US7609763B2 (en) * | 2003-07-18 | 2009-10-27 | Microsoft Corporation | Advanced bi-directional predictive coding of video frames |
WO2005022923A2 (en) * | 2003-08-26 | 2005-03-10 | Thomson Licensing S.A. | Method and apparatus for minimizing number of reference pictures used for inter-coding |
TWI268715B (en) * | 2004-08-16 | 2006-12-11 | Nippon Telegraph & Telephone | Picture encoding method, picture decoding method, picture encoding apparatus, and picture decoding apparatus |
US7933335B2 (en) * | 2004-11-30 | 2011-04-26 | Panasonic Corporation | Moving picture conversion apparatus |
JP4050754B2 (ja) * | 2005-03-23 | 2008-02-20 | 株式会社東芝 | ビデオエンコーダ及び動画像信号の符号化方法 |
US7822116B2 (en) * | 2005-04-14 | 2010-10-26 | Broadcom Corporation | Method and system for rate estimation in a video encoder |
EP1713283A2 (en) * | 2005-04-15 | 2006-10-18 | Sony Corporation | Video decoder with random access technique |
-
2007
- 2007-04-24 WO PCT/JP2007/058826 patent/WO2007132647A1/ja active Search and Examination
- 2007-04-24 US US12/300,243 patent/US8270492B2/en not_active Expired - Fee Related
- 2007-04-24 JP JP2008515474A patent/JP5155157B2/ja not_active Expired - Fee Related
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004088722A (ja) * | 2002-03-04 | 2004-03-18 | Matsushita Electric Ind Co Ltd | 動画像符号化方法および動画像復号化方法 |
JP2004208258A (ja) * | 2002-04-19 | 2004-07-22 | Matsushita Electric Ind Co Ltd | 動きベクトル計算方法 |
JP2003333602A (ja) * | 2002-05-03 | 2003-11-21 | Lg Electronics Inc | 動画コーディング方法 |
WO2004008775A1 (ja) * | 2002-07-15 | 2004-01-22 | Hitachi, Ltd. | 動画像符号化方法及び復号化方法 |
JP2004129191A (ja) * | 2002-10-04 | 2004-04-22 | Lg Electronics Inc | Bピクチャのダイレクトモード動きベクトル演算方法 |
Non-Patent Citations (2)
Title |
---|
"Information technology -Coding of audio-visual objects- Part 10: Advanced Video Coding", INTERNATIONAL STANDARD ISO/IEC, vol. 14496-10, no. SECOND EDITION, PART 10, 1 October 2004 (2004-10-01), pages 82 - 100, XP003001303 * |
XIANGYANG JI ET AL.: "New bi-prediction techniques for B pictures coding", 2004 IEEE INTERNATIONAL CONFERENCE ON MULTIMEDIA AND EXPO. ICME'04, vol. 1, 27 June 2004 (2004-06-27), pages 101 - 104, XP010770754 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012014458A1 (ja) * | 2010-07-27 | 2012-02-02 | パナソニック株式会社 | 画像符号化方法および画像復号方法 |
JP2014239420A (ja) * | 2013-05-09 | 2014-12-18 | パナソニック インテレクチュアル プロパティ コーポレーション オブアメリカPanasonic Intellectual Property Corporation of America | 画像復号方法及び画像復号装置 |
Also Published As
Publication number | Publication date |
---|---|
JP5155157B2 (ja) | 2013-02-27 |
US8270492B2 (en) | 2012-09-18 |
US20090168886A1 (en) | 2009-07-02 |
JPWO2007132647A1 (ja) | 2009-09-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5155157B2 (ja) | 動画像復号化装置 | |
US11979598B2 (en) | Video encoding method, video encoding apparatus, video decoding method, video decoding apparatus, and video encoding/decoding apparatus | |
US11115677B2 (en) | Image coding method, image decoding method, image coding apparatus, and image decoding apparatus | |
US11509928B2 (en) | Derivation method and apparatuses with candidate motion vectors | |
US10034001B2 (en) | Image coding method, image coding apparatus, image decoding method, image decoding apparatus, and image coding and decoding apparatus | |
AU2017265185B2 (en) | Image predictive encoding device, image predictive encoding method, image predictive encoding program, image predictive decoding device, image predictive decoding method, and image predictive decoding program | |
US8311106B2 (en) | Method of encoding and decoding motion picture frames | |
US20150063446A1 (en) | Moving picture encoding method, moving picture decoding method, moving picture encoding apparatus, and moving picture decoding apparatus | |
US20130107965A1 (en) | Image coding method, image decoding method, image coding apparatus, and image decoding apparatus | |
US9609320B2 (en) | Image decoding method and image decoding apparatus | |
EP1879388B1 (en) | Video information recording device, video information recording method, video information recording program, and recording medium containing the video information recording program | |
JPH08154247A (ja) | 圧縮画像データ処理装置及び方法 | |
US9369705B2 (en) | Moving picture coding method and moving picture decoding method | |
JP4708821B2 (ja) | 動画像符号化装置及びその制御方法、コンピュータプログラム及び記憶媒体 | |
JP2003189313A (ja) | 画面間予測符号化方法および画面間予測復号化方法 | |
AU2002344460B2 (en) | Moving picture coding method and moving picture decoding method | |
JP2003339049A (ja) | 画像復号装置及び画像復号方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
DPE2 | Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101) | ||
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07742261 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008515474 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12300243 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 07742261 Country of ref document: EP Kind code of ref document: A1 |
|
DPE2 | Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101) |