KR102142014B1 - Video encoding method, video decoding method, video encoding apparatus, video decoding apparatus, and video encoding-decoding apparatus - Google Patents

Abstract

The moving picture encoding method includes processing for converting a video signal in the spatial domain into coefficients in the frequency domain, and processing for quantizing the coefficients in the frequency domain, for every second processing unit included in one or more in the first processing unit. And an arithmetic encoding step (S704) of arithmetic encoding the luminance CBF flag indicating whether a quantization coefficient is included in the second processing unit in which the transform and quantization step has been performed, and in the arithmetic encoding step, According to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size (S701), a probability table used for arithmetic coding is determined (S702, S703).

Description

VIDEO ENCODING METHOD, VIDEO DECODING METHOD, VIDEO ENCODING APPARATUS, VIDEO DECODING APPARATUS, AND VIDEO ENCODING-DECODING APPARATUS}

In the present invention, in order to encode an image for each block, a video encoding method and a video encoding apparatus for encoding a flag indicating whether a transform coefficient of a block to be encoded exists or not, a video encoding device for decoding a flag indicating whether or not coded transform coefficients exist A decoding method, a video decoding device, and a video encoding and decoding device.

The number of applications for video-on-demand type services, including video conferencing over the Internet, digital video broadcasting, and streaming of video content, is constantly increasing, and these applications are used to transmit video information. Depend on it. When video data is transmitted or recorded, a considerable amount of data is transmitted through a conventional transmission path of a limited bandwidth, or stored in a conventional storage medium having a limited data capacity. In order to transmit and store video information on conventional transmission channels and storage media, it is necessary to compress or reduce the amount of digital data.

Here, a plurality of video encoding standards have been developed for compression of video data. These video encoding standards are, for example, the ITU-T standard indicated by H.26x and the ISO/IEC standard indicated by MPEG-x. The latest and most advanced video encoding standard is currently a standard indicated by H.264/MPEG-4 AVC (see Non-Patent Document 1).

The encoding approaches that form the basis of most of these standards are based on predictive encoding including the main steps shown in (a) to (d) below. (a) In order to compress each image frame at a block level, the image frame is divided into blocks of pixels. (b) First, individual blocks are predicted from the encoded image data, thereby specifying temporal and spatial redundancy. (c) Specified redundancy is removed by reducing predictive data from image data. (d) The remaining data (residual block) is compressed by Fourier transform, quantization, and entropy coding.

ITU-T Recommendation H.264 「Advanced video coding for generic audiovisual services」, March 2010 JCT-VC “WD3: Working Draft 3 of High-Efficiency Video Coding”, JC TVC-E603, March 2011.

In recent years, improvement in encoding efficiency has been further demanded in accordance with high definition of moving images.

Here, an object of the present invention is to provide a video encoding method with high encoding efficiency, a video encoding device, a video decoding method, a video decoding device, and a video encoding and decoding device.

A moving picture encoding method according to an aspect of the present invention is a method of encoding a moving picture signal for each first processing unit. Specifically, the video encoding method includes processing for converting the video signal in the spatial domain into coefficients in the frequency domain, and coefficients in the frequency domain in every second processing unit included in one or more of the first processing units. And a transform/quantization step including a quantization process, and an arithmetic coding step of performing arithmetic coding on a luminance CBF flag indicating whether a quantization coefficient is included in the second processing unit in which the transform/quantization step has been performed. In the arithmetic encoding step, a probability table used for arithmetic encoding is determined according to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size.

In addition, the present invention can be realized not only as the above-described encoding method or decoding method, but also as a program for executing each step included in such encoding method or decoding method in a computer. It goes without saying that such a program can be transmitted through a non-transitory recording medium such as a CD-ROM (Compact Disc Read Only Memory) or a transmission medium such as the Internet.

According to the present invention, the luminance CBF flag can be efficiently arithmetic encoded and arithmetic decoded.

1 is a block diagram showing a functional configuration of a decoding apparatus including a luminance CBF flag decoder according to Embodiment 1 of the present invention.
2 is a flowchart showing an example of the operation flow of the luminance CBF decoding unit 101 of the present invention.
3 is a schematic diagram for explaining details of the luminance CBF decoding unit 101 according to the first embodiment of the present invention.
4 is a block diagram showing an example of a configuration of a video decoding apparatus according to Embodiment 1 of the present invention.
5A is a Table1000 used for arithmetic decoding according to the present embodiment, and is a table corresponding to Table0000 in FIG. 28A.
Fig. 5B is Table1001 used for arithmetic decoding of this embodiment, and is a table corresponding to Table0001 in Fig. 28B.
5C is a Table1002 used for arithmetic decoding of the present embodiment, and is a table corresponding to Table0002 in FIG. 28C.
Fig. 5D is Table1003 used for arithmetic decoding of this embodiment, and is a table corresponding to Table0003 in Fig. 28D.
6 is a diagram for explaining a method of obtaining a number ctxldxlnc for deriving the probability for the luminance CBF flag of Embodiment 1 of the present invention.
7 is a flowchart showing an example of an operation flow of the luminance CBF flag encoder according to Embodiment 2 of the present invention.
8 is a block diagram showing an example of a configuration of an image encoding device according to Embodiment 2 of the present invention.
9 is an overall configuration diagram of a content supply system that realizes a content delivery service.
10 is an overall configuration diagram of a digital broadcasting system.
11 is a block diagram showing a configuration example of a television.
12 is a block diagram showing a configuration example of an information reproducing/recording unit that reads and writes information on a recording medium that is an optical disc.
13 is a diagram showing an example of the structure of a recording medium that is an optical disc.
14A is a diagram showing an example of a mobile phone.
14B is a block diagram showing a configuration example of a mobile phone.
15 is a diagram showing the configuration of multiplexed data.
16 is a diagram schematically showing how each stream is multiplexed in multiplexed data.
17 is a diagram showing in more detail how a video stream is stored in a PES packet sequence.
18 is a diagram showing the structure of a TS packet and a source packet in multiplexed data.
19 is a diagram showing the data structure of PMT.
20 is a diagram showing an internal configuration of multiplexed data information.
21 is a diagram showing the internal configuration of stream attribute information.
22 is a diagram illustrating a step of identifying image data.
23 is a block diagram showing a configuration example of an integrated circuit that realizes the video encoding method and the video decoding method of each embodiment.
24 is a diagram showing a configuration for switching the driving frequency.
25 is a diagram showing steps of identifying image data and switching driving frequencies.
26 is a diagram showing an example of a look-up table in which a standard of video data and a driving frequency are correlated.
27A is a diagram showing an example of a configuration for sharing a module of a signal processing unit.
27B is a diagram showing another example of a configuration for sharing a module of the signal processing unit.
28A is a diagram showing a correspondence between a slice type SliceType and a number of ctxldx corresponding to a probability value required for arithmetic encoding and arithmetic decoding.
28B is a table for defining a combination of ctxldx numbers 0 to 11 shown in FIG. 28A and information (m, n) necessary for determining the initial probability.
28C is a table showing the allocation of the offset value ctxldxOffset defining that the leading ctxldx is changed by the slice type.
28D is a table showing how to assign ctxldx to the number binldx indicating the turn from the beginning of the binary signal sequence.
29A is a diagram showing a method of acquiring a signal ctxldxlnc for deriving a ctxldx number for a flag including a luminance CBF flag in HEVC.
29B is a diagram illustrating a method for determining ctxldxlnc of a luminance CBF flag.
30 is a diagram showing a flow of arithmetic decoding processing of conventional context adaptation.
31 is a diagram showing a flow of arithmetic decoding processing for conventional bypass processing.
32 is a flowchart for explaining in detail the normalization process (RenormD) shown in step SC08 of FIG. 30.

(Knowledge that became the basis of the present invention)

In the step (d) described above, in the current video encoding standard and the video encoding standard under consideration, the amount of information is further reduced by encoding a flag indicating whether there is information in the residual block after Fourier transform and quantization. Specifically, a flag for identifying the presence or absence of a coefficient in the residual block after quantization is variable-length coded.

In addition, in a standard candidate called HEVC, which is currently undergoing standardization work (see non-patent document 2), this identification flag is called CBF, and the above identification flag for the luminance signal is called luminance CBF flag cbf_luma. It is known that variable length encoding is based on arithmetic encoding (CABAC) based on arithmetic encoding, which will be described later. In HEVC, encoding is performed using parameters defined by the methods shown in FIGS.

28A to 28D are information groups showing definition of information for encoding a luminance CBF flag in HEVC. First, Table0000 shown in FIG. 28A shows the correspondence between the slice type (I/P/B) called the slice type SliceType and the number of ctxldx corresponding to a probability value required for arithmetic encoding and arithmetic decoding. This indicates that, for example, in the case of an I slice, ctxldx numbers used for encoding and decoding of the luminance CBF flag are four types of 0 to 3. Similarly, there are 4 to 4 types in the case of P slices and 4 to 8 types in case of B slices.

Next, in Table0001 shown in FIG. 28B, it is a table for defining a combination of the ctxldx numbers 0 to 11 indicated by Table0000 and information (m, n) necessary to determine the initial probability. For the method of deriving the initial probability using (m, n), the method described in Non-Patent Document 1 or Non-Patent Document 2 is used.

Next, Table0002 shown in FIG. 28C is a table showing the allocation of the offset value ctxldxOffset defining that the leading ctxldx is changed (for example, 0, 4, 8) according to the slice type described above.

Next, in Table0003 shown in FIG. 28D, ctxldx is allocated for each binary signal sequence (bin) when arithmetic encoding and arithmetic decoding are performed, so how to obtain ctxldx for the number binldx indicating the order from the beginning of this binary signal sequence Table indicating whether to allocate. That is, the first bit of the first binary signal sequence is binldx=0, and is defined as 1 and 2 thereafter. In addition, since the luminance CBF flag is a flag indicating “0” or “1”, only binldx=0 is defined. And in the method defined in Section 9.3.3.1.1.1, ctxldx number indicates that any one of 0, 1, 2, and 3 is used, and offsets of 0, 4, and 8 are given according to the slice type. Note that na in the table is a symbol indicating that it does not exist.

In addition, the contents of Section 9.3.3.1.1.1 will be described in detail with reference to FIGS. 29A and 29B. B01 shown in FIG. 29A is an excerpt from Non-Patent Document 2 of a part showing a method for obtaining a signal ctxldxlnc for deriving a ctxldx number for a flag including a luminance CBF flag in HEVC.

First, in 9.3.3.1.1, it is shown that a flag including a luminance CBF flag is arithmetic coded using the result of an adjacent block. Next, in the section of 9.3.3.1.1.1, details are described about a block result located on a block containing a flag to be encoded and a result of the block result located on the left. As for the luminance CBF flag, ctxldxlnc is determined as follows by the luminance CBF flag in the left block and the luminance CBF flag in the upper block, as indicated by Table 9-50 shown in Fig. 29B.

First, when the luminance CBF flag of the left block is 0 (or does not exist) and the luminance CBF flag of the upper block is 0 (or does not exist), the number of ctxldxlnc of the luminance CBF flag to be encoded is set to 0 (case One). When the luminance CBF flag of the left block is 1 and the luminance CBF flag of the upper block is 0 (or does not exist), the number of ctxldxlnc of the luminance CBF flag to be coded is set to 1 (case 2). In addition, when the luminance CBF flag of the left block is 0 (or does not exist) and the luminance CBF flag of the upper block is 1, the number of ctxldxlnc of the luminance CBF flag to be coded is 2 (case 3). In addition, when the luminance CBF flag of the left block is 1 and the luminance CBF flag of the upper block is 1, the number of ctxldxlnc of the luminance CBF flag to be coded is set to 3 (case 4).

As described above, ctxldxlnc for deriving probability values for use in arithmetic encoding and arithmetic decoding of the luminance CBF flag to be encoded is switched according to the value of the surrounding luminance CBF flag.

Next, variable length encoding such as the above-described identification flag (CBF) will be described. In H.264, as one of the variable length coding methods, there is context adaptive arithmetic coding (CABAC). This CABAC will be described below with reference to FIGS. 30 to 32.

30 is a diagram showing the flow of the arithmetic decoding process of the conventional context adaptation described above. In addition, this figure is excerpted from the nonpatent literature 1, and is as described in the nonpatent literature 1, unless otherwise specified.

In the arithmetic decoding process, first, a context (ctxldx) determined based on the signal type is input.

Next, the derived value qCodlRangeldx is calculated from the parameter codlRange indicating the state in the arithmetic decoding apparatus at the present time, and a pStateldx value that is a state value corresponding to ctxldx is obtained. Then, by referring to the table (rangeTableLPS) with the two values, codlRangeLPS is obtained. In addition, this codlRangeLPS is a parameter indicating the state in the arithmetic decoding device when LPS (indicating the lower one of symbols 0 or 1 occurrence probability) with respect to the first parameter codlRange indicating the state in the arithmetic decoding device. Indicates the value to be. In addition, a value obtained by subtracting the above-described codlRangeLPS from the current codlRange is put in the codlRange (step SC01).

Next, the calculated codlRange is compared with the second parameter codlOffset indicating the state in the arithmetic decoding apparatus (step SC02). And when codlOffset is equal to or greater than codlRange (YES in SC02), it is determined that a symbol of LPS has occurred, and in the decoded output value binVal, valMPS (the higher one of the probability of occurrence of MPS<symbol 0 or 1) Set a value (0 if valMPM=1, 1 if valMPM=0) and a value different from the specific value (0 or 1) of Pointing Symbol>.

In addition, a value obtained by subtracting codlRange is set to the second parameter codlOffset indicating the state in the arithmetic decoding apparatus. In addition, since LPS is generated in the first parameter codlRange indicating the state in the arithmetic decoding apparatus, the value of codlRangeLPS calculated in step SC01 is set (step SC03).

In addition, when the pStateldx value corresponding to the ctxldx described above is 0 (YES in step SC05), since the probability of the LPS exceeds the probability of the MPS, the valMPM is replaced (0 when valMPM=1, When valMPM=0, 1) (step SC06). On the other hand, when the pStateldx value is 0 (NO in step SC05), the pStateldx value is updated based on the conversion table transldxLPS when LPS occurs (step SC07).

When the codlOffset is small (NO in SC02), it is determined that a symbol of MPS has occurred, sets valMPS in the binVal which is the decoded output value, and updates the pStateldx value based on the conversion table transldxMPS when MPS occurs (step SC04) ).

Finally, normalization processing (RenormD) is performed (step SC08) to end the arithmetic decoding processing.

As described above, in the context adaptive arithmetic decoding process, a plurality of symbol occurrence probability, which is a probability of occurrence of a binary symbol, is maintained in correspondence with a context index, and switched according to conditions (for example, referring to values of adjacent blocks). You need to keep order.

Fig. 31 is a diagram showing the flow of the arithmetic decoding process for the conventional bypass processing described above. In addition, this figure is taken from the nonpatent literature 1, and it is as described in the nonpatent literature 1, unless there is a specific explanation.

First, the second parameter codlOffset indicating the state in the arithmetic decoding apparatus at the present time point is shifted left (twice), and 1 bit is read from the bit stream, and if the read bit is 1, it is +1, again if it is 0 (2) Times) is set (SD01).

Next, when codlOffset is equal to or greater than the first parameter codlRange indicating the state in the arithmetic decoding apparatus (YES in SD02), “1” is set to binVal, which is a decoded output value, and codlOffset is subtracted from codlRange. Set (step SD03). On the other hand, when codlOffset is smaller than the first parameter codlRange indicating the state in the arithmetic decoding apparatus (NO in SD02), “0” is set to binVal as the decoded output value (step SD04).

32 is a flowchart for explaining in detail the normalization process (RenormD) shown in step SC08 of FIG. 30. This drawing is taken from non-patent document 1, and is as described in non-patent document 1, unless otherwise specified.

When the first parameter codlRange indicating the state in the arithmetic decoding apparatus in arithmetic decoding processing is smaller than Ox100 (hexadecimal: 256 (decimal)) (YES in step SE01), the codlRange is shifted left (2 times) ), left shift (twice) the second parameter codlOffset indicating the state in the arithmetic decoding apparatus, read one bit from the bit stream, and if the read bit is 1, again +1, if it is 0, it is the same (twice). The value is set (SE02). This process ends at the stage where the codlRange is 256 or more (NO in step SE01) finally.

Arithmetic decoding is performed by performing the above process.

However, conventionally, for arithmetic coding and arithmetic decoding of the luminance CBF flag, it is necessary to change the probability value according to the result of blocks adjacent to the upper and left sides. For this reason, for arithmetic encoding or arithmetic decoding, it is necessary to record the results of the luminance CBF flags of blocks adjacent to the left and upper sides. For this reason, there is a problem in that, when the resolution of the input video is large, it is necessary to prepare a large amount of memory for storing the result of the luminance CBF flag.

In order to solve the above problems, a moving picture encoding method according to an embodiment of the present invention is a method of encoding a moving picture signal for each first processing unit. Specifically, the video encoding method includes processing for converting the video signal in the spatial domain into coefficients in the frequency domain for each second processing unit included in one or more in the first processing unit, and the coefficients in the frequency domain And a transform/quantization step including a process of quantizing, and an arithmetic coding step of performing arithmetic coding on a luminance CBF flag indicating whether a quantization coefficient is included in the second processing unit in which the transform/quantization step has been performed. . Then, in the arithmetic encoding step, a probability table used for arithmetic encoding is determined according to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size. .

According to the above configuration, since the probability value for arithmetic encoding the luminance CBF flag can be determined without depending on the value of the luminance CBF flag of the neighboring block, even if the memory capacity for holding the luminance CBF flag is significantly reduced, high encoding efficiency is maintained. Can.

In addition, in the arithmetic encoding step, a probability table used for arithmetic encoding is determined according to the type of the slice to which the first processing unit belongs.

As an example, the first processing unit may be an encoding block. Further, the second processing unit may be a conversion block.

In addition, the moving picture encoding method is a coding process that conforms to the first standard and a coding process that conforms to the second standard, and is an encoding process that conforms to the first standard, wherein the conversion and quantization steps and the arithmetic are performed. An encoding step may be performed, and an identifier indicating the standard of the encoding process may be encoded.

A moving picture decoding method according to an embodiment of the present invention is a method of decoding an encoded moving picture signal for each first processing unit. Specifically, the video decoding method includes an arithmetic decoding step of arithmetic decoding a luminance CBF flag indicating whether a quantization coefficient is included in a second processing unit included in one or more of the first processing units, and the arithmetic And restoring a moving picture signal using the quantization coefficient of the second processing unit when the luminance CBF flag decoded in the decoding step indicates that the second processing unit includes a quantization coefficient. . Then, in the arithmetic decoding step, a probability table used for arithmetic decoding is determined according to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size. .

Further, in the arithmetic decoding step, a probability table used for arithmetic decoding is determined according to the type of the slice to which the first processing unit belongs.

As an example, the first processing unit may be an encoding block. Further, the second processing unit may be a conversion block.

Further, the video decoding method switches between decoding processing conforming to the first standard and decoding processing conforming to the second standard according to an identifier indicating a first standard or a second standard included in an encoded signal. In the case where the identifier indicates the first standard, the arithmetic decoding step and the restoring step may be performed as decoding processing conforming to the first standard.

The video encoding apparatus according to one embodiment of the present invention encodes a video signal for each first processing unit. Specifically, the video encoding apparatus includes processing for converting the video signal in the spatial domain into coefficients in the frequency domain for each second processing unit included in one or more of the first processing units, and the coefficients in the frequency domain And a transform/quantizer including quantization processing, and an arithmetic encoding unit for arithmetic encoding a luminance CBF flag indicating whether a quantization coefficient is included in the second processing unit processed by the transform/quantization unit. The arithmetic coding unit determines a probability table used for arithmetic coding according to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size.

The moving picture decoding apparatus according to one embodiment of the present invention decodes the encoded moving picture signal for each first processing unit. Specifically, the moving picture decoding apparatus includes an arithmetic decoding unit for arithmetic decoding the luminance CBF flag indicating whether a quantization coefficient is included in the second processing unit included in one or more of the first processing units, and the arithmetic When the luminance CBF flag processed by the decoding unit indicates that a quantization coefficient is included in the second processing unit, a restoration unit for restoring a video signal using the quantization coefficient of the second processing unit is provided. The arithmetic decoding unit determines a probability table used for arithmetic decoding according to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size.

The moving picture encoding/decoding device according to one embodiment of the present invention includes the moving picture encoding device described above and the moving picture decoding device described above.

Moreover, these general or specific aspects may be realized by a system, a method, an integrated circuit, a computer program or a recording medium, or may be realized by any combination of a system, a method, an integrated circuit, a computer program and a recording medium.

EMBODIMENT OF THE INVENTION Hereinafter, embodiment of this invention is described in detail using drawing. In addition, the embodiment demonstrated below shows all the specific preferable example of this invention. In other words, the numerical values, shapes, materials, components, arrangement and connection forms, steps, sequence of steps, etc. shown in the following embodiments are examples of the present invention and do not limit the present invention. The present invention is limited by the scope of the claims. Therefore, among the components in the following embodiments, components not described in the independent claims showing the highest concept of the present invention are not necessary to achieve the problems of the present invention, but more preferable embodiments will be described. It is written for.

(Embodiment 1)

The moving picture decoding apparatus according to the first embodiment decodes the encoded moving picture signal for each first processing unit. For this reason, the moving picture decoding apparatus decodes the arithmetic decoding unit for arithmetic decoding the luminance CBF flag indicating whether a quantization coefficient is included in the second processing unit included in one or more of the first processing unit, and the arithmetic decoding unit When the luminance CBF flag indicates that the quantization coefficient is included in the second processing unit, a restoration unit for restoring a video signal using the quantization coefficient of the second processing unit is provided.

The arithmetic decoding unit determines a probability table used for arithmetic decoding of the luminance CBF flag according to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size. The arithmetic decoding unit may further determine a probability table used for arithmetic decoding according to the type of the slice (I slice/P slice/B slice) to which the first processing unit belongs. In addition, the phrase "determining the probability table" can be replaced with, for example, "switching the context."

The moving image input to the moving image decoding apparatus is composed of a plurality of pictures. Further, the picture is divided into a plurality of slices. The slices are encoded and decoded for each processing unit described later. The processing unit includes a coding unit (CU), a prediction unit (PU), and a transformation unit (TU). A CU is a block made up of 128 x 128 pixels, and is a unit equivalent to a conventional macro block. PU is a basic unit of inter prediction. The TU is a basic unit of orthogonal transformation, and the size of the TU is equal to or smaller than the CU. Hereinafter, the coding unit is referred to as an encoding block and a transformation unit is referred to as a transformation block.

The first processing unit in the present embodiment is, for example, an encoding block (CU). In addition, the second processing unit in the present embodiment is, for example, a conversion block (TU). Then, one luminance CBF flag exists in each transform block, and indicates whether a quantization coefficient is present in the transform block. In addition, "whether or not a quantization coefficient exists in a transform block" can be replaced with whether or not a quantization coefficient to be encoded exists. It is also possible to switch to whether or not a non-zero coefficient (coefficient whose value is non-zero) exists in the transform block.

1 is a block diagram showing a functional configuration of a decoding apparatus including a luminance CBF flag decoder according to Embodiment 1 of the present invention.

As shown in Fig. 1, the decoding apparatus 100 according to the present embodiment includes a luminance CBF decoding unit 101, a control unit 102, a switch 103, a residual coefficient decoding unit 104, and A residual signal restoration unit 105 and an addition unit 106 are provided. The decoding apparatus 100 restores the luminance CBF flag from the decoding position information (POS) and the acquired bit stream (BS), and outputs the decoded image signal (OUT) from the predicted image signal (PRED).

The operation of the luminance CBF decoding unit 101 of this embodiment will be described in detail with reference to FIG. 2. 2 is a flowchart showing an example of the operation flow of the luminance CBF decoding unit 101 of the present invention.

First, the luminance CBF decoding unit 101 acquires the target bit stream BS. In addition, the control unit 102 obtains information (POS) indicating where the luminance CBF flag to be decoded is the size of the coding block and the transform coefficient, and outputs it to the luminance CBF decoding unit 101. .

Next, from the information obtained from the control unit 102, the luminance CBF decoding unit 101, (i) the transform block indicated by the luminance CBF flag to be decoded is the same as the size of the encoding block, or (ii) the transform block It is determined whether the size is the same as the maximum size of the conversion block (S201). In addition, the information specifying the maximum size of the transform block is included in, for example, a bit stream.

When at least one of (i) and (ii) above is satisfied (YES in S201), a number ctxldxlnc for specifying probability information used for arithmetic decoding is set to 1 (S203). On the other hand, if none of the above (i) and (ii) is satisfied (NO in S201), the number ctxldxlnc for specifying probability information used for arithmetic decoding is set to 0 (S202). In addition, the value set by ctxldxlnc is not limited to the examples of steps S202 and S203. That is, different values may be set in steps S202 and S203. However, it is necessary to set common values on the encoding side and the decoding side.

Next, a probability value corresponding to ctxldx obtained by adding the number ctxldxlnc for specifying the probability information obtained in steps S202 and S203 and an offset value defined for each slice in advance (see FIGS. 5A to 5D below) is acquired, and the target Arithmetic decoding processing of the luminance CBF flag to be performed is performed (S204). Thereby, the luminance CBF flag is acquired.

Next, the luminance CBF flag obtained in step S204 is output to the control unit 102, and is used for control of the switch 103. When the luminance CBF flag indicates "no coefficient" (for example, 0), the switch 103 is connected to the terminal B. That is, since there is no transform coefficient in the transform block, there is no residual signal added to the predicted image signal PRED, and the predicted image signal PRED is output as the decoded image signal OUT.

On the other hand, when the luminance CBF flag indicates "coefficient existence" (for example 1), the switch 103 is connected to the terminal A. In this case, the residual coefficient signal included in the bit stream BS is decoded by the residual coefficient decoding unit 104, the residual signal obtained by inverse quantization and inverse transform by the residual signal restoration unit 105, and the predicted image signal PRED Is added by the addition unit 106 and output as a decoded image signal OUT. Accordingly, the decoded image signal OUT can be correctly output from the bit stream BS using the luminance CBF flag.

That is, the luminance CBF decoding unit 101 and the control unit 102 shown in Fig. 1 correspond to, for example, the arithmetic decoding unit according to the present embodiment. Note that the switch 103 shown in Fig. 1, the residual coefficient decoding unit 104, and the residual signal restoration unit 105 correspond to the restoration unit according to this embodiment. However, it is not limited to the above correspondence relationship.

FIG. 3 is a schematic diagram for explaining the conditions shown in step S201 in FIG. 2. Blocks 301 to 306 indicated by bold frames indicate coding blocks. In addition, a block in which the blocks 301 and 302 are further divided is a transform block.

It is prescribed that the size of the transform block is equal to or smaller than the size of the coding block. In addition, in this description, the sizes of the blocks 301 and 302 are the maximum size of the encoded block (64 pixels x 64 pixels), and the maximum size of the transform block is one layer smaller than the blocks 301 and 302 (32 pixels × 32 pixels) will be described. In addition, the maximum size of the conversion size is changed according to information described in the header information of the slice, for example.

In addition, the present invention is characterized in that the probability table is switched under a certain condition (step S201) regardless of the size of the transform block, and does not depend on the result of the surrounding block. The effect of the invention (reducing the amount of memory) can be realized.

Here, first, the case where the block 301 is used as an encoding block will be described.

First, when the small block of the first layer (32 pixels x 32 pixels) obtained by dividing the block 301 into four blocks is a transform block, the luminance CBF flag 311 corresponding to the small block of the first layer is decoded. When the luminance CBF flag 311 indicates no coefficient, the transform coefficient is not included in the small block of the first layer. For this reason, luminance CBF flags 312 and 313 corresponding to blocks smaller than this are not decoded. Also, when the luminance CBF flag 311 is decoded, the small block of the first layer becomes the maximum size of the transform block (YES in S201 in FIG. 2), and thus represents a probability table used for arithmetic decoding of the luminance CBF flag. As the number, ctxldxlnc=1 is used (S203 in FIG. 2).

On the other hand, when the small block of the second layer (16 pixels x 16 pixels) obtained by dividing the small block of the first layer into a transform block is a transform block, the luminance CBF flag 312 corresponding to the small block of the second layer is decoded. do. In addition, when the small block of the third layer (8 pixels × 8 pixels) obtained by dividing the small block of the second layer again into a transform block, the luminance CBF flag 313 corresponding to the small block of the third layer is Decrypted. In this case, ctxldxlnc=0 is used as a number indicating a probability table used for arithmetic decoding of the luminance CBF flag (S202 in FIG. 2).

Further, when the luminance CBF flag (not shown) corresponding to the small block of the first layer of the block 302 is decoded, ctxldxlnc=1 is used as a number indicating the probability table, and a small block of the second layer or less When the luminance CBF flag (not shown) corresponding to is decoded, ctxldxlnc=0 is used as a number indicating the probability table. Further, for blocks 303 to 306, it is determined whether the size of the transform block matches the size of the coding block or the maximum size of the transform block, and the number ctxldxlnc indicating the probability table according to the determination result Is determined.

As shown above, by comparing the size of the transform block and the size of the coding block, the number of probability tables can be changed from 4 to 2 in the prior art by switching two types of ctxldxinc to “0” or “1”. (Per slice). Further, since it is not necessary to refer to the luminance CBF flag of the surrounding block in order to determine the ctxldxinc of the luminance CBF flag to be decoded, the luminance CBF flag is correctly decoded without having to secure a large amount of memory including a line buffer. can do.

In addition, depending on whether or not the size of the transform block is the maximum, the deterioration of encoding efficiency due to the reduction in the type of the probability table can be suppressed by switching the probability table of the luminance CBF flag in two steps. This is because the presence or absence of the transform coefficient is often dependent on the block size of the transform block, and more specifically, the smaller the size of the transform block, the higher the probability that all of the coefficients become zero.

Further, the arithmetic decoding unit (decoding device 100) according to the first embodiment of the present invention is provided in a moving picture decoding device for decoding compressed coded encoded image data. 4 is a block diagram showing an example of a configuration of a video decoding apparatus 400 according to Embodiment 1 of the present invention.

The moving picture decoding apparatus 400 decodes the coded coded image data. For example, in the video decoding apparatus 400, encoded image data is input as a decoding target signal for each block. The moving picture decoding apparatus 400 restores image data by performing variable length decoding, inverse quantization, and inverse transformation on the input decoding target signal.

As shown in Fig. 4, the video decoding apparatus 400 includes an entropy decoding unit 410, an inverse quantization and inverse conversion unit 420, an adder 425, a deblocking filter 430, and a memory 440. ), an intra prediction unit 450, a motion compensation unit 460, and an intra/inter switch 470.

The entropy decoding unit 410 restores the quantized coefficients by variable-length decoding an input signal (input stream). Here, the input signal (input stream) is a signal to be decoded, and corresponds to data for each block of encoded image data. In addition, the entropy decoding unit 410 acquires motion data from the input signal, and outputs the obtained motion data to the motion compensation unit 460.

The inverse quantization/inverse transform unit 420 restores the transform coefficients by inverse quantizing the quantized coefficients restored by the entropy decoding unit 410. Then, the inverse quantization/inverse transform unit 420 restores the prediction error by inverse transforming the reconstructed transform coefficients.

The adder 425 generates a decoded image by adding the prediction error restored by the inverse quantization and inverse transform unit 420 and the prediction signal obtained from the intra/inter switch 470.

The deblocking filter 430 performs deblocking filter processing on the decoded image generated by the adder 425. The decoded image subjected to the deblocking filter process is output as a decoded signal.

The memory 440 is a memory for storing a reference image used for motion compensation. Specifically, the memory 440 stores a decoded image in which the deblocking filter process has been performed by the deblocking filter 430.

The intra prediction unit 450 generates a prediction signal (intra prediction signal) by performing intra prediction. Specifically, the intra prediction unit 450 generates an intra prediction signal by performing intra prediction with reference to an image around a decoding target block (input signal) in the decoded image generated by the adder 425.

The motion compensation unit 460 generates a prediction signal (inter prediction signal) by performing motion compensation based on the motion data output from the entropy decoding unit 410.

The intra/inter switch 470 selects one of the intra prediction signal and the inter prediction signal, and outputs the selected signal to the adder 425 as a prediction signal.

With the above configuration, the moving picture decoding apparatus 400 according to Embodiment 2 of the present invention decodes the coded coded image data.

In the moving picture decoding apparatus 400, the decoding unit of the luminance CBF flag according to Embodiment 1 of the present invention is included in the entropy decoding unit 410, the inverse quantization and inverse conversion unit 420, and the adder 425. . More specifically, for example, the luminance CBF decoding unit 101, the control unit 102, the switch 103, and the residual coefficient decoding unit 104 of FIG. 1 are included in the entropy decoding unit 410 of FIG. 1, the residual signal restoration unit 105 of FIG. 1 is included in the inverse quantization and inverse conversion unit 420 of FIG. 4, and the adder 106 of FIG. 1 is included in the adder 425 of FIG. 4. However, it is not limited to the above-mentioned correspondence.

As described above, according to the moving picture decoding apparatus and the moving picture decoding method according to Embodiment 1 of the present invention, arithmetic decoding of the luminance CBF flag is performed by arithmetically decoding the luminance CBF flag to be decoded without depending on the value of the luminance CBF of the neighboring block. A bit stream that reduces the need for memory for decoding can be properly restored.

5A, 5B, 5C, and 5D show examples of Table1000 to 1003 used for arithmetic decoding of the present embodiment. In addition, Tables 1000 to 10003 are tables corresponding to FIGS. 28A to 28D. 5A to 5D, in this embodiment, two probability tables per slice are switched. In addition, the result of the luminance CBF flag of the surrounding block is not used to switch the probability table. This will be described again with reference to FIG. 6.

6 is a sentence for explaining a method of obtaining the number ctxldxlnc for calculating the probability for the luminance CBF flag in the present embodiment. As shown here, the conversion of the two numbers depends on the block size (transformDepth, MaxTrafoSize) of the transform block, and not on the result of the neighboring block.

(Embodiment 2)

The outline of the arithmetic coding method of this embodiment will be described. In addition, the detailed description of the commonality with the first embodiment will be omitted, and the explanation will be mainly focused on the differences.

The arithmetic coding method of this embodiment does not use the result of the luminance CBF flag in the neighboring blocks as in the conventional method for encoding the luminance CBF flag, but two probability tables (per slice) according to the block size of the transform block. It is characterized by switching. Accordingly, it is realized to significantly reduce the memory size required for encoding.

The above is an explanation of the outline of the arithmetic coding method of the present embodiment. When not specifically described, it shows that the same method as the conventional arithmetic coding method may be employed.

The video encoding apparatus according to Embodiment 2 encodes a video signal for each first processing unit. Specifically, the video encoding apparatus includes processing for converting a video signal (eg, a residual signal) in the spatial domain into a coefficient in the frequency domain for every second processing unit included in one or more in the first processing unit, An arithmetic coding unit for performing arithmetic coding on a luminance CBF flag indicating whether a quantization coefficient is included in a transform/quantization unit including processing for quantizing frequency-domain coefficients and a second processing unit in which the processing of the conversion and quantization unit is performed. To be equipped.

The arithmetic encoding unit determines a probability table used for arithmetic encoding of the luminance CBF flag according to whether the sizes of the first and second processing units are the same and whether the second processing unit is a predetermined maximum size ( Switch context). The arithmetic coding unit may further determine a probability table used for arithmetic coding according to the type of the slice to which the first processing unit belongs.

Next, the processing flow of the luminance CBF flag encoding unit for performing the luminance CBF flag encoding method of the present embodiment will be described. 7 is a flowchart showing an example of the operation flow of the luminance CBF flag encoder according to Embodiment 2 of the present invention.

The luminance CBF flag encoding unit, from the information obtained from the control unit, (i) whether the size of the transformation block indicated by the luminance CBF flag to be encoded is the same as the size of the encoding block, or (ii) the size of the transformation block is the maximum size of the transformation block. It is determined whether or not (S701). In addition, the information specifying the maximum size of the transform block is included in, for example, a bit stream.

When at least one of (i) and (ii) above is satisfied (YES in S701), a number ctxldxlnc for specifying probability information used for arithmetic encoding is set to 1 (S703). On the other hand, if neither of the above (i) and (ii) is satisfied (NO in S701), the number ctxldxlnc for specifying probability information used for arithmetic encoding is set to 0 (S702).

Next, a probability value corresponding to ctxldx obtained by adding the number ctxldxlnc for specifying the probability information obtained in steps S702 and S703 and an offset value (refer to FIGS. 5A to 5D) specified for each slice in advance is acquired, and the target is obtained. Arithmetic coding processing of the luminance CBF flag is performed (S704). Accordingly, the luminance CBF flag is encoded.

By encoding in this way, it is possible to realize an apparatus for encoding a luminance CBF flag with a small amount of memory required.

Moreover, the luminance CBF flag encoding unit according to Embodiment 2 of the present invention is provided in an image encoding apparatus for compression encoding image data. 8 is a block diagram showing an example of a configuration of an image encoding apparatus 200 according to Embodiment 2 of the present invention.

The image encoding apparatus 200 compressively encodes image data. For example, in the image encoding apparatus 200, image data is input as an input signal for each block. The image encoding apparatus 200 generates an encoded signal by performing transform, quantization, and variable length encoding on the input signal.

As shown in FIG. 10, the image encoding apparatus 200 includes a subtracter 205, a transform-quantization unit 210, an entropy encoding unit 220, an inverse quantization-inverse transformation unit 230, and an adder ( 235), the deblocking filter 240, the memory 250, the intra prediction unit 260, the motion detection unit 270, the motion compensation unit 280, and the intra/inter switch 290 To be equipped.

The subtractor 205 calculates the difference between the input signal and the prediction signal, that is, the prediction error.

The transform/quantization unit 210 generates transform coefficients in the frequency domain by transforming prediction errors in the spatial domain. For example, the transform/quantizer 210 generates a transform coefficient by performing a DCT (Discrete Cosine Transform) transform on a prediction error. In addition, the transform/quantizer 210 quantizes the transform coefficients to generate quantized coefficients.

In addition, the conversion/quantization unit 210 generates a luminance CBF flag indicating whether a coefficient (quantization coefficient) exists in the conversion block. Specifically, the transform/quantizer 210 sets “1” in the luminance CBF flag when a coefficient is present in the transform block, and “0” in the luminance CBF flag when no coefficient is present in the transform block. Sets.

The entropy encoding unit 220 generates a coded signal by variable-length encoding the quantization coefficients. In addition, the entropy encoding unit 220 encodes motion data (eg, motion vectors) detected by the motion detection unit 270 and outputs the motion data by including it in the encoded signal.

The inverse quantization/inverse transform unit 230 restores the transform coefficients by inversely quantizing the quantized coefficients. In addition, the inverse quantization/inverse transform unit 230 restores a prediction error by inverse transforming the reconstructed transform coefficients. In addition, the reconstructed prediction error does not match the prediction error generated by the subtractor 205 because information is lost by quantization. That is, the reconstructed prediction error includes quantization error.

The adder 235 generates a local decoded image by adding the reconstructed prediction error and prediction signal.

The deblocking filter 240 performs deblocking filter processing on the generated local decoded image.

The memory 250 is a memory for storing a reference image used for motion compensation. Specifically, the memory 250 stores a local decoded image subjected to deblocking filter processing.

The intra prediction unit 260 generates a prediction signal (intra prediction signal) by performing intra prediction. Specifically, the intra prediction unit 260 refers to the surrounding image of the block to be coded (input signal) in the local decoded image generated by the adder 235, and performs intra prediction to generate an intra prediction signal. .

The motion detection unit 270 detects motion data (for example, a motion vector) between an input signal and a reference image stored in the memory 250.

The motion compensation unit 280 generates a prediction signal (inter prediction signal) by performing motion compensation based on the detected motion data.

The intra/inter switch 290 selects one of an intra prediction signal and an inter prediction signal, and outputs the selected signal to the subtractor 205 and adder 235 as a prediction signal.

With the above structure, the image coding device 200 according to the second embodiment of the present invention compression-codes image data.

In addition, in the video encoding apparatus 200, the CBF flag encoding unit according to Embodiment 2 of the present invention is included in, for example, the entropy encoding unit 220. That is, the CBF flag encoding unit included in the entropy encoding unit 220 performs arithmetic encoding on the luminance CBF flag generated by the transform/quantization unit 210. However, it is not limited to the above-mentioned correspondence.

(Embodiment 3)

By recording a program for realizing the configuration of the moving picture coding method (image coding method) or the moving picture decoding method (image decoding method) shown in each of the above embodiments in a storage medium, the processing shown in each embodiment is an independent computer system. In this, it becomes possible to carry out simply. The storage medium may be any one that can record programs such as a magnetic disk, optical disk, optical magnetic disk, IC card, and semiconductor memory.

Here, an application example of a video encoding method (image encoding method) or a video decoding method (image decoding method) shown in each of the above embodiments and a system using the same will be described. The system is characterized by having an image encoding/decoding device comprising an image encoding device using an image encoding method and an image decoding device using an image decoding method. Other configurations in the system can be changed as appropriate.

9 is a diagram showing the overall configuration of a content supply system ex100 that realizes a content delivery service. The area for providing communication services is divided into desired sizes, and base stations ex106, ex107, ex108, ex109, and ex110, which are fixed radio stations, are installed in each cell.

This content supply system ex100 is a computer ex111, a PDA (Personal Digital Assistant) via the internet service provider ex102 and the telephone network ex104, and the base station ex106 to the internet ex101 via ex110. Each device such as (ex112), camera ex113, mobile phone ex114, game machine ex115 is connected.

However, the content supply system ex100 is not limited to the configuration as shown in Fig. 9 and may be connected by combining several elements. Further, each device may be directly connected to the telephone network ex104 without going through ex110 from the base station ex106 which is a fixed radio station. Further, the devices may be directly connected to each other through short-range wireless or the like.

The camera ex113 is a device capable of shooting moving images such as a digital video camera, and the camera ex116 is a device capable of shooting still images and moving pictures such as a digital camera. In addition, the mobile phone ex114 is a GSM (registered trademark) (GLobal System for Mobile Communications) method, a Code Division Multiple Access (CDMA) method, a Wideband-Code Division Multiple Access (W-CDMA) method, or a Long Term (LTE). Evolution method, HSPA (High Speed Packet Access) mobile phone, or PHS (Personal Handyphone System).

In the content supply system ex100, the camera ex113 or the like is connected to the streaming server ex103 via the base station ex109 and the telephone network ex104, thereby enabling live transmission and the like. In the live transmission, the content (for example, music live video, etc.) photographed by the user using the camera ex113 is subjected to encoding processing as described in each of the above embodiments (i.e., in one aspect of the present invention) Functions as an associated image encoding device) and the streaming server ex103. Meanwhile, the streaming server ex103 streams the content data transmitted to the client having a request. Examples of the client include a computer ex111, a PDA ex112, a camera ex113, a mobile phone ex114, and a game machine ex115 capable of decoding the encoded data. In each device that has received the transmitted data, the received data is decoded and reproduced (that is, functions as an image decoding device according to an aspect of the present invention).

Incidentally, the encoding processing of the photographed data may be performed by the camera ex113, or may be performed by the streaming server ex103 which performs the data transmission processing, or may be shared with each other. Similarly, the decoding processing of the transmitted data may be performed by the client, by the streaming server ex103, or by sharing with each other. Further, the present invention is not limited to the camera ex113, and still image and/or moving image data captured by the camera ex116 may be transmitted to the streaming server ex103 via the computer ex111. The encoding processing in this case may be performed by either the camera ex116, the computer ex111, or the streaming server ex103, or may be performed by sharing with each other.

In addition, these encoding/decoding processes are generally processed in the computer ex111 and the LSI ex500 owned by each device. The LSI ex500 may be composed of one chip or a plurality of chips. Further, the software for encoding and decoding moving pictures may be put in any recording medium (CD-ROM, flexible disk, hard disk, etc.) readable by a computer ex111 or the like, and encoding and decoding processing may be performed using the software. . In addition, when the mobile phone exT14 is equipped with a camera, the moving image data acquired with the camera may be transmitted. The video data at this time is data encoded by the LSI ex500 of the mobile phone ex114.

Further, the streaming server ex103 may be a plurality of servers or a plurality of computers, which may distribute data, process it, record it, or transmit it.

As described above, in the content supply system ex100, the encoded data can be received and reproduced by the client. In this way, in the content supply system ex100, the information transmitted by the user can be received and decoded in real time by the client, reproduced, and reproduced, and even a user without special rights or facilities can realize personal broadcasting.

In addition, the present invention is not limited to the example of the content supply system ex100, and as shown in FIG. 10, the digital broadcasting system ex200 also includes at least a video encoding device (image encoding device) or a video decoding device (at least one of the above embodiments). Image decoding device). Specifically, in the broadcasting station ex201, multiplexed data in which music data or the like is multiplexed to video data is transmitted to a communication or satellite ex202 via radio waves. This video data is data encoded by the video encoding method described in each of the above embodiments (i.e., data encoded by the image encoding device according to one aspect of the present invention). The broadcast satellite ex202 that has received this transmits a broadcast radio wave, and the home antenna ex204 capable of receiving satellite broadcasts receives the radio wave. The received multiplexed data is decoded and reproduced by a device such as a television (receiver) ex300 or a set top box (STB) ex217 (that is, functions as an image decoding device according to an aspect of the present invention).

In addition, a reader/recorder that reads and decodes multiplexed data recorded on a recording medium ex215, such as a DVD or BD, or encodes a video signal on the recording medium ex215 and, in some cases, multiplexes with a music signal to write. In (ex218), it is possible to mount the moving picture decoding apparatus or moving picture encoding apparatus shown in each of the above embodiments. In this case, the reproduced video signal is displayed on the monitor ex219, and the video signal can be reproduced in another device or system by the recording medium ex215 on which the multiplexed data is recorded. In addition, a moving picture decoding apparatus may be mounted in a set-top box ex217 connected to a cable ex203 for cable television or an antenna ex204 for satellite/terrestrial broadcast, and this may be displayed on a television monitor ex219. At this time, the video decoding device may be put in the TV, not in the set-top box.

Fig. 11 is a diagram showing a television (receiver) ex300 using the moving picture decoding method and the moving picture encoding method described in each of the above embodiments. The television ex300 includes a tuner ex301 that acquires or outputs multiplexed data in which audio data is multiplexed to video data through an antenna ex204 or a cable ex203 that receives the broadcast, and the received multiplexed data. A demodulation/demodulation unit ex302 for demodulating or modulating with multiplexed data transmitted to the outside, and separating the demodulated multiplexed data into image data and audio data, or image data or audio data encoded by the signal processing unit ex306 A multiplex/separator ex303 for multiplexing is provided.

In addition, the television ex300 includes an audio signal processing unit ex304 and an image signal processing unit ex305 for decoding each of the audio data and the video data, or encoding each information (the image encoding device according to one aspect of the present invention, or A signal processing unit ex306 having a function as an image decoding device) and an output unit ex309 having a display unit ex308 such as a speaker ex307 for outputting a decoded audio signal and a display for displaying the decoded video signal. Have In addition, the television ex300 has an interface unit ex317 having an operation input unit ex312 or the like that accepts input of a user operation. In addition, the television ex300 has a control unit ex310 that collectively controls each unit, and a power supply circuit unit ex311 that supplies power to each unit. The interface unit ex317 includes, in addition to the operation input unit ex312, a slot unit for enabling mounting of a recording medium ex216, such as a bridge ex313 and an SD card connected to an external device such as a reader/recorder ex218. ex314), a driver ex315 for connecting to an external recording medium such as a hard disk, a modem ex316 for connecting to a telephone network, and the like. In addition, the recording medium ex216 enables recording of information electrically by a nonvolatile/volatile semiconductor memory element to be stored. Each part of the television ex300 is connected to each other via a synchronous bus.

First, a configuration in which the television ex300 decodes and reproduces multiplexed data acquired from the outside by the antenna ex204 or the like will be described. The television ex300 multiplexes/demultiplexes the multiplexed data demodulated by the modulation/demodulation unit ex302 under the control of the control unit ex310 having a CPU or the like by receiving user manipulation from the remote controller ex220 or the like. (ex303). In addition, the television ex300 decodes the separated audio data in the audio signal processing unit ex304, and decodes the separated video data in the video signal processing unit ex305 using the decoding method described in each of the above embodiments. The decoded audio signal and video signal are output from the output unit ex309 toward the outside, respectively. When outputting, it is sufficient to accumulate these signals once in the buffers ex318, ex319, etc. so that the audio signal and the video signal are reproduced in synchronization. Further, the television ex300 may read multiplexed data from recording media ex215, ex216, such as magnetic/optical disks, SD cards, etc., not from broadcast or the like. Next, a description will be given of a configuration in which the television ex300 encodes an audio signal or a video signal, and transmits it externally or writes it to a recording medium. The television ex300 receives a user's operation from the remote controller ex220 or the like, and encodes the audio signal in the audio signal processing unit ex304 under the control of the control unit ex310, and displays the video in the video signal processing unit ex305. Signals are encoded using the encoding methods described in the above embodiments. The encoded audio signal and video signal are multiplexed by the multiplex/separator ex303 and output to the outside. When multiplexing, these signals may be accumulated once in the buffers ex320, ex321, etc. so that the audio signal and the video signal are synchronized. Further, a plurality of buffers ex318, ex319, ex320, and ex321 may be provided as shown, or a configuration in which one or more buffers are shared. In addition to the illustration, data may be stored in the buffer as a buffer to avoid overflow and underflow of the system, for example, between the modulation/demodulation unit ex302 and the multiple/separation unit ex303.

In addition, the television ex300 is provided with a configuration for receiving audio data and video data from a broadcast or recording media, etc., and receiving AV input from a microphone or camera, and encoding processing can be performed on the data obtained from them. do. In addition, the television ex300 is described as a configuration capable of the above encoding processing, multiplexing, and external output, but it is impossible to perform these processes, and the receiving, decoding processing and only external output may be possible.

When the multiplexed data is read or written from the recording medium by the reader/recorder ex218, the decoding process or encoding process may be performed by either the television ex300 or the reader/recorder ex218, and the television (ex300) and the leader/recorder ex218 may share each other.

As an example, the structure of the information reproducing/recording unit ex400 in the case of reading or writing data from an optical disc is shown in FIG. The information reproduction/recording unit ex400 includes elements (ex401, ex402, ex403, ex404, ex405, ex406, ex407) described below. The optical head ex401 irradiates a laser spot on the recording surface of the recording medium ex215, which is an optical disc, to write information, and detects reflected light from the recording surface of the recording medium ex215 to read the information. The modulation recording unit ex402 electrically drives the semiconductor laser embedded in the optical head ex401 to modulate the laser light according to the recording data. The reproduction demodulation unit ex403 amplifies the reproduction signal electrically detecting the reflected light from the recording surface by the photodetector built in the optical head ex401, separates and demodulates the signal components recorded on the recording medium ex215, Play the necessary information. The buffer ex4 04 temporarily holds information for recording on the recording medium ex215 and information reproduced from the recording medium ex215. The disc motor ex405 rotates the recording medium ex215. The servo control unit ex406 moves the optical head ex401 to a predetermined information track while controlling the rotational drive of the disc motor ex405, and performs laser spot tracking processing. The system control unit ex407 controls the entire information reproduction/recording unit ex400. In the above reading and writing processing, the system control unit ex407 uses various information held in the buffer ex404, and also creates and adds new information as necessary, and modulates the recording unit ex402 and reproduces it. It is realized by performing recording and reproduction of information through the optical head ex401 while cooperatively operating the demodulation unit ex403 and the servo control unit ex406. The system control unit ex407 is composed of, for example, a microprocessor, and executes these processes by executing a program of reading and writing.

In the above, the optical head ex401 has been described as irradiating a laser spot, but a configuration in which a higher-density recording is performed using near-field light may be used.

Fig. 13 is a schematic diagram of a recording medium ex215 that is an optical disc. On the recording surface of the recording medium ex215, guide grooves (groups) are formed in a spiral shape, and in the information track ex230, address information indicating the absolute position on the disc according to the change in the shape of the group is recorded in advance. This address information includes information for specifying the position of the recording block ex231, which is a unit for recording data, and reads the address block by reading the address track ex230 in the apparatus for recording or reproducing. It can be specified. In addition, the recording medium ex215 includes a data recording area ex233, an inner peripheral area ex232, and an outer peripheral area ex234. The area used to record the user data is the data recording area ex233, and the inner circumferential area ex232 and the outer circumferential area ex234 that are disposed on the inner circumference or the outer circumference than the data recording area ex233 are other than the recording of the user data. Used for specific applications. The information reproducing/recording unit ex400 reads and writes the encoded audio data, video data, or multiplexed data multiplexed on these data recording areas ex233 of the recording medium ex215.

In the above, an optical disc such as a DVD or BD on one layer has been described as an example. However, the present invention is not limited to these, and may have a multi-layer structure and an optical disc that can be recorded in addition to the surface. Further, the optical disk may be a structure in which information is recorded using light of various different wavelengths in the same place as the disk, a layer of different information is recorded from various angles, or multidimensional recording/reproduction is performed.

In addition, in the digital broadcasting system ex200, data is received from a satellite ex202 or the like by a car ex210 having an antenna ex205, and a moving image is displayed on a display device such as a car navigation ex211 of the car ex210. It is also possible to play. In addition, the configuration of the car navigation ex211, for example, among the configurations shown in FIG. 11, a configuration in which a GPS receiver is added can be considered, and the same can be considered for a computer ex111, a mobile phone ex114, or the like.

Fig. 14A is a diagram showing a mobile phone ex114 using the moving picture decoding method and the moving picture encoding method described in the above embodiment. The mobile phone ex114 includes an antenna ex350 for transmitting and receiving radio waves between the base station ex110, a camera unit ex365 capable of taking a video, and a still image, and an image captured by the camera unit ex365, and an antenna A display unit ex358, such as a liquid crystal display, that displays the decoded data, such as an image received by (ex350), is provided. The mobile phone ex114 includes a main body having an operation key ex366, a voice output unit ex357 as a speaker for outputting audio, a voice input unit ex356 as a microphone for inputting audio, photographed images, still images Memory section (ex367) for storing coded or decoded data such as images, recorded voices, or received images, still images, and mail, or slot section (ex364), which is an interface to recording media that similarly stores data It is provided.

In addition, a configuration example of the mobile phone ex114 will be described with reference to Fig. 14B. The mobile phone ex114 includes a power supply circuit unit ex361, an operation input control unit ex362, and a video for the main control unit ex360 that collectively controls each part of the main body unit having the display unit ex358 and the operation key unit ex366. Signal processing unit (ex355), camera interface unit (ex363), LCD (Liquid Crystal Display) control unit (ex359), modulation / demodulation unit (ex352), multiple / separation unit (ex353), audio signal processing unit (ex354), slot unit ( ex364), and the memory units ex367 are connected to each other through the bus ex370.

The power supply circuit unit ex361 activates the cellular phone ex114 in an operable state by supplying electric power to each unit from the battery pack when the call termination and the power key are turned on by a user's operation.

The mobile phone ex114 digitalizes the voice signal received by the voice input unit ex356 in the voice call mode in the voice signal processing unit ex354 under the control of the main control unit ex360 having a CPU, ROM, RAM, or the like. It is converted to a voice signal, and is subjected to spectrum spreading processing by the modulation/demodulation unit ex352, digital analog conversion processing and frequency conversion processing are performed by the transmission/reception unit ex351, and then transmitted through the antenna ex350. In addition, the mobile phone ex114 amplifies received data received through the antenna ex350 in the voice call mode, performs frequency conversion processing and analog digital conversion processing, and performs spectrum despreading by the modulation/demodulation unit ex352. After processing, the audio signal processing unit ex354 converts the analog audio signal, and outputs it from the audio output unit ex357.

In addition, when the electronic mail is transmitted in the data communication mode, text data of the electronic mail input by an operation such as the operation key unit ex366 of the main body is sent to the main control unit ex360 through the operation input control unit ex362 . The main control unit ex360 performs spectrum spreading processing on the modulation/demodulation unit ex352 by the text data, performs digital analog conversion processing and frequency conversion processing by the transmission/reception unit ex351, and then transmits the frequency data through the antenna ex350. ex110). In the case of receiving an e-mail, processing substantially opposite to that of the received data is performed and output to the display unit ex358.

When transmitting a video, still image, or video and audio in data communication mode, the video signal processing unit ex355 uses the video encoding method shown in each of the above embodiments to receive the video signal supplied from the camera unit ex365. Compressed encoding (that is, functioning as an image encoding apparatus according to an aspect of the present invention), and the encoded image data is transmitted to a multiplex/separator ex353. In addition, the audio signal processing unit ex354 encodes the audio signal received by the audio input unit ex356 during imaging of an image, a still image, or the like with the camera unit ex365, and multiplex/separate the encoded audio data (ex353) Sent to

The multiplex/separation unit ex353 multiplexes the encoded image data supplied from the video signal processing unit ex355 and the encoded audio data supplied from the audio signal processing unit ex354 in a predetermined manner, and multiplexed data obtained as a result. Spectrum spreading processing is performed by the modulation/demodulation unit (modulation/demodulation circuit unit) ex352, digital analog conversion processing and frequency conversion processing are performed by the transmission/reception unit ex351, and then transmitted through the antenna ex350.

When receiving data of a video file linked to a home page or the like in the data communication mode, or when receiving an e-mail with video and/or audio attached, in order to decode the multiplexed data received through the antenna ex350, multiplexing The /separation unit ex353 divides the multiplexed data into a bit stream of video data and a bit stream of audio data, and supplies the video data encoded through the sync bus ex370 to the video signal processing unit ex355, The encoded audio data is supplied to the audio signal processing unit ex354. The video signal processing unit ex355 decodes the video signal by decoding by the video decoding method corresponding to the video encoding method shown in each of the above embodiments (i.e., functions as an image decoding device according to one embodiment of the present invention) , An image and a still image included in a moving image file linked to a home page are displayed from the display unit ex358 through the LCD control unit ex359. In addition, the audio signal processing unit ex354 decodes the audio signal, and audio is output from the audio output unit ex357.

In addition, the terminal such as the mobile phone ex114, like the television ex300, has three types of mounting types, in addition to a transmitting/receiving terminal having both an encoder and a decoder, and a transmitting terminal only for the encoder and a receiving terminal only for the decoder. Can think. In addition, in the digital broadcasting system ex200, it has been described as receiving and transmitting multiplexed data in which music data and the like are multiplexed to image data. In addition to audio data, text data related to images may be multiplexed data, and multiplexed data may be used. No, it may be the video data itself.

In this way, it is possible to use the moving picture coding method or the moving picture decoding method shown in each of the above embodiments in any one of the above-described devices and systems, and by doing so, the effects described in the above-described respective embodiments can be obtained.

In addition, the present invention is not limited to the above-described embodiment, and various modifications or modifications can be made without departing from the scope of the present invention.

(Embodiment 4)

Video data is generated by appropriately switching the video encoding method or apparatus shown in each of the above embodiments and the video encoding method or apparatus conforming to different standards such as MPEG-2, MPEG4-AVC, VC-1, etc. as necessary. It is also possible.

Here, when a plurality of video data conforming to different standards are generated, it is necessary to select a decoding method corresponding to each standard when decoding. However, since it is not possible to discriminate which standard the video data to be decoded conforms to, a problem arises in that an appropriate decoding method cannot be selected.

In order to solve this problem, the multiplexed data obtained by multiplexing audio data or the like to video data is configured to include identification information indicating which standard the video data conforms to. The specific configuration of the multiplexed data including the video data generated by the video encoding method or apparatus shown in each of the above embodiments will be described below. The multiplexed data is a digital stream in MPEG-2 transport stream format.

15 is a diagram showing a configuration of multiplexed data. As shown in Fig. 15, multiplexed data is obtained by multiplexing one or more of a video stream, an audio stream, a presentation graphics stream (PG), and an interactive graphics stream. The video stream represents the main and sub-pictures of the movie, the audio stream (IG) represents the main audio portion of the movie and the sub-audio mixing with the main voice, and the presentation graphics stream represents the subtitle of the movie. Here, the main image refers to a normal image displayed on the screen, and the sub-image refers to an image displayed on a small screen in the main image. In addition, the interactive graphics stream represents a dialog screen created by arranging GUI parts on the screen. The video stream is encoded by the video encoding method or apparatus shown in each of the above-mentioned embodiments, and the conventional video encoding method or apparatus conforming to standards such as MPEG-2, MPEG4-AVC and VC-1. The audio stream is encoded by Dolby AC-3, Dolby Digital Plus, MLP, DTS, DTS-HD, or linear PCM.

Each stream included in the multiplexed data is identified by PID. For example, Ox1011 is used for video streams used for movie images, Ox1100 to Ox111F for audio streams, Ox1200 to Ox121F for presentation graphics, and Ox1400 to Ox141F for interactive graphics streams. Ox1B00 to Ox1B1F are assigned to the stream, and Ox1A00 to Ox1A1F are assigned to audio streams used for the sub-audio that is mixed with the main voice.

16 is a diagram schematically showing how multiplexed data is multiplexed. First, a video stream ex235 composed of a plurality of video frames and an audio stream ex238 composed of a plurality of audio frames are converted into PES packet sequences ex236 and ex239, respectively, and TS packets ex237 and ex240 ). Similarly, the data of the presentation graphics stream ex241 and the interactive graphics ex244 are converted into PES packet sequences ex242 and ex245, respectively, and then converted into TS packets ex243 and ex246, respectively. The multiplexed data ex247 is configured by multiplexing these TS packets into one stream.

Fig. 17 shows how the video stream is stored in the PES packet sequence in more detail. The first row in Fig. 17 shows a video frame sequence of a video stream. The second row represents the PES packet sequence. As shown by arrows yy1, yy2, yy3, and yy4 in FIG. 17, I, B, and P pictures, which are a plurality of Video Presentation Units in a video stream, are divided for each picture and stored in the payload of the PES packet. . Each PES packet has a PES header, and the PES header stores PTS (Presentation Time-Stamp) as a picture display time or DTS (Decoding Time-Stamp) as a picture decoding time.

Fig. 18 shows the format of a TS packet finally written into the multiplexed data. The TS packet is a 188Byte fixed length packet composed of a 4Byte TS header having information such as PID for identifying a stream and a 184Byte TS payload storing data, and the PES packet is divided and stored in the TS payload. . In the case of BD-ROM, 4 bytes of TP_Extra_Header are assigned to TS packets, and a source packet of 192 bytes is constituted and written into multiplexed data. Information such as ATS (Arrival_Time_Stamp) is described in TP_Extra_Header. ATS indicates the start time of transmission of the TS packet to the PID filter of the decoder. Source packets are arranged in the multiplexed data as shown in the lower part of FIG. 18, and the number incremented from the top of the multiplexed data is called SPN (source packet number).

In addition, TS packets included in the multiplexed data include PAT (Program Association Table), PMT (Program Map Table), and PCR (Program Clock Reference) in addition to each stream such as video, audio, and subtitles. PAT indicates what PID of the PMT used in the multiplexed data, and the PID of the PAT itself is registered as 0. The PMT has PIDs of each stream, such as video, audio, and subtitles included in the multiplexed data, and attribute information of streams corresponding to each PID, and also has various descriptors for multiplexed data. The descriptor includes copy control information indicating whether permission of copying of multiplexed data is permitted or not. In order to synchronize the ATS (Arrrval Time Clock), the time axis of the ATS, and the System Time Clock (STC), the time axis of the PTS and DTS, the PCR packet has STC time information corresponding to the ATS transmitted to the decoder. .

19 is a view for explaining in detail the data structure of the PMT. At the head of the PMT, a PMT header indicating the length of the data contained in the PMT and the like is arranged. After that, a plurality of descriptors for the multiplexed data are arranged. The copy control information and the like are described as descriptors. After the descriptor, a plurality of stream information relating to each stream included in the multiplexed data is arranged. The stream information is composed of a stream descriptor for describing a stream type, a PID of a stream, and attribute information (frame rate, aspect ratio, etc.) for identifying a compressed codec of the stream. There are as many stream descriptors as there are streams present in the multiplexed data.

When recording on a recording medium or the like, the multiplexed data is recorded together with the multiplexed data information file.

As shown in FIG. 20, the multiplexed data information file is management information of multiplexed data, and corresponds to multiplexed data one-to-one, and is composed of multiplexed data information, stream attribute information, and an entry map.

As shown in FIG. 20, the multiplexed data information is composed of a system rate, a reproduction start time, and a reproduction end time. The system rate represents the maximum transmission rate of the multiplexed data to the PID filter of the system target decoder described later. The interval of ATS included in the multiplexed data is set to be equal to or less than the system rate. The reproduction start time is the PTS of the first video frame of the multiplexed data, and the reproduction end time is set by adding the reproduction interval for one frame to the PTS of the video frame at the end of the multiplexed data.

As shown in Fig. 21, as for the stream attribute information, attribute information for each stream included in the multiplexed data is registered for each PID. The attribute information has different information for each video stream, audio stream, presentation graphics stream, and interactive graphics stream. The video stream attribute information includes information such as what compression codec the video stream is compressed to, what resolution of each picture data constituting the video stream is, what is the aspect ratio, and what is the frame rate. The audio stream attribute information has information such as what compression codec the audio stream is compressed to, what number of channels are included in the audio stream, which language it corresponds to, and how much the sampling frequency is. These pieces of information are used for initialization of the decoder before the player plays it or the like.

In the present embodiment, among the multiplexed data, a stream type included in the PMT is used. When multiplexed data is recorded on a recording medium, video stream attribute information included in the multiplexed data information is used. Specifically, in the video encoding method or device shown in each of the above embodiments, the stream type or video stream attribute information included in the PMT is generated by the video encoding method or device shown in each of the above embodiments. And a step or means for setting unique information indicating that the video data is generated. With this configuration, it is possible to identify video data generated by the video encoding method or apparatus shown in each of the above embodiments and video data conforming to other standards.

Fig. 22 shows steps of the video decoding method according to the present embodiment. In step exS100, the stream type included in the PMT or the video stream attribute information included in the multiplexed data information is acquired from the multiplexed data. Next, in step exS101, it is judged whether or not the stream type or video stream attribute information indicates that it is multiplexed data generated by the video encoding method or apparatus shown in each of the above embodiments. When it is determined that the stream type or the video stream attribute information is generated by the video encoding method or apparatus shown in each of the above embodiments, in step exS102, the video decoding method shown in each of the above embodiments is used. Decrypt. When the stream type or the video stream attribute information indicates that it conforms to the standards of the conventional MPEG-2, MPEG4-AVC, VC-1, etc., in step exS103, the video decoding according to the conventional standard is decoded. Decoding is performed by a method.

In this way, by setting a new eigenvalue in the stream type or video stream attribute information, it is possible to determine whether decoding is possible in the video decoding method or apparatus shown in each of the above embodiments when decoding. Therefore, even when multiplexed data conforming to other standards is input, since an appropriate decoding method or apparatus can be selected, decoding can be performed without causing an error. Moreover, it is also possible to use the moving picture encoding method or device shown in this embodiment, or the moving picture decoding method or device for any one of the above-mentioned devices and systems.

(Embodiment 5)

The moving picture encoding method and device, and the moving picture decoding method and device shown in each of the above embodiments are typically realized by an integrated circuit, LSI. As an example, the configuration of the LSI ex500 chipped in FIG. 23 is shown. The LSI ex500 includes elements described below (ex501, ex502, ex503, ex504, ex505, ex506, ex507, ex508, ex509), and each element is connected via a bus ex510. When the power is turned on, the power supply circuit unit ex505 starts up in an operable state by supplying power to each part.

For example, in the case of performing encoding processing, the LSI ex500 is controlled by the control unit ex501 having the CPU ex502, the memory controller ex503, the stream controller ex504, the driving frequency control unit ex512, and the like. Then, the AV signal is input from the microphone ex117, the camera ex113, or the like by the AV I/O ex509. The input AV signal is once accumulated in an external memory ex511 such as SDRAM. Under the control of the control unit ex501, the accumulated data is appropriately divided into a plurality of circuits according to the throughput or processing speed, and sent to the signal processing unit ex507, and the signal processing unit ex507 encodes the audio signal and/or the video signal. Encoding is performed. Here, the encoding processing of the video signal is the encoding processing described in each of the above embodiments. The signal processing unit ex507 also performs processing such as multiplexing the encoded audio data and the encoded video data in some cases, and outputs it from the stream I/O ex506 to the outside. The output multiplexed data may be transmitted to the base station ex107, or may be written to the recording medium ex215. In addition, it is sufficient to accumulate data in the buffer ex508 once to synchronize when multiplexing.

In addition, although the memory ex511 was described as an external configuration of the LSI ex500, the configuration included in the LSI ex500 may be sufficient. The buffer ex508 is also not limited to one, and a plurality of buffers may be provided. In addition, the LSI ex500 may be one chip or multiple chips.

In addition, in the above, it is assumed that the control unit ex501 has a CPU ex502, a memory controller ex503, a stream controller ex504, a driving frequency control unit ex512, and the like. It is not limited to the structure. For example, a configuration in which the signal processing unit ex507 further includes a CPU may be used. By providing a CPU inside the signal processing unit ex507, it becomes possible to further improve the processing speed. Further, as another example, the CPU ex502 may be configured to include a signal processing unit ex507 or, for example, an audio signal processing unit that is part of the signal processing unit ex507. In this case, the control unit ex501 is configured to include a signal processing unit ex507 or a CPU ex502 having a part thereof.

In addition, although it was set as LSI here, it is also called IC, system LSI, super LSI, and ultra LSI depending on the difference in integration.

In addition, the method of integrated circuitization is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. After LSI manufacturing, a programmable field programmable gate array (FPGA) or a reconfigurable processor capable of reconfiguring the connection and setting of circuit cells inside the LSI may be used.

In addition, if the technology of integrated circuitization, which is replaced by LSI by the advancement of semiconductor technology or by a separate technology derived from it, has appeared, of course, the functional block may be integrated using the technology. There may be the possibility of adaptation of biotechnology and the like.

(Embodiment 6)

When decoding the video data generated by the video encoding method or apparatus shown in each of the above embodiments, compared with the case of decoding video data conforming to the standards of conventional MPEG-2, MPEG4-AVC, VC-1, etc. It can be considered that the throughput increases. For this reason, in the LSI ex500, it is necessary to set the driving frequency higher than the driving frequency of the CPU ex502 when decoding the video data conforming to the conventional standard. However, when the driving frequency is increased, there is a problem that power consumption increases.

In order to solve this problem, a moving picture decoding apparatus such as a television ex300 or an LSI ex500 is configured to identify which standard the video data conforms to and switch the driving frequency according to the standard. 24 shows the configuration ex800 in the present embodiment. The driving frequency conversion unit ex803 sets the driving frequency high when the video data is generated by the video encoding method or apparatus shown in each of the above embodiments. Then, the decoding processing unit ex801 that executes the moving picture decoding method shown in each of the above embodiments is instructed to decode the video data. On the other hand, when the video data is video data conforming to a conventional standard, the driving frequency is set to be lower than when the video data is generated by the video encoding method or apparatus shown in each of the above embodiments. . Then, the decoding processing unit ex802 conforming to the conventional standard is instructed to decode the video data.

More specifically, the driving frequency switching unit ex803 is composed of the CPU ex502 of FIG. 23 and the driving frequency control unit ex512. The decoding processing unit ex801 for executing the moving picture decoding method shown in each of the above-described embodiments, and the decoding processing unit ex802 conforming to the conventional standards correspond to the signal processing unit ex507 in FIG. 23. The CPU ex502 identifies which standard the video data conforms to. Then, based on the signal from the CPU ex502, the drive frequency control unit ex512 sets the drive frequency. In addition, based on the signal from the CPU ex502, the signal processing unit ex507 decodes the video data. Here, it is conceivable to use the identification information described in Embodiment 4, for example, for identification of video data. The identification information is not limited to that described in the fourth embodiment, and may be information that can identify which standard the video data conforms to. For example, if it is possible to identify which standard the video data conforms to based on an external signal that identifies whether the video data is used for a television or a disk, etc., it may be identified based on the external signal. do. In addition, it is conceivable to select the drive frequency in the CPU ex502 based on, for example, a lookup table in which the standard of the video data as shown in Fig. 26 and the drive frequency are correlated. It is possible to select the driving frequency by storing the lookup table in the buffer ex508 or the internal memory of the LSI, and the CPU ex502 refers to this lookup table.

25 shows the steps of implementing the method of the present embodiment. First, in step exS200, the signal processing unit ex507 acquires identification information from the multiplexed data. Next, in step exS201, it is discriminated in the CPU ex502 whether or not the video data is generated by the encoding method or apparatus shown in each of the above embodiments based on the identification information. When the video data is generated by the encoding method or apparatus shown in each of the above embodiments, in step exS202, a signal for setting the driving frequency high is generated by the CPU ex502 by the driving frequency control unit ex512. Send to And in the drive frequency control unit ex512, it is set to a high drive frequency. On the other hand, in the case of indicating that the video data conforms to the standards of the conventional MPEG-2, MPEG4-AVC, VC-1, etc., in step exS203, the signal for setting the driving frequency low is the CPU ex502. It is sent to the driving frequency control unit ex512. Then, in the driving frequency control unit ex512, the video data is set to a lower driving frequency compared to the case where the video data is generated by the encoding method or apparatus shown in each of the above embodiments.

In addition, it is possible to further increase the power saving effect by changing the voltage applied to the device including the LSI ex500 or the LSI ex500 in conjunction with the switching of the driving frequency. For example, when the driving frequency is set low, it is considered that the voltage applied to the device including the LSI (ex500) or the LSI (ex500) is set lower than the case where the driving frequency is set accordingly. Can.

In addition, the driving frequency setting method is limited to setting the driving frequency high when the throughput at the time of decoding is large, and setting the driving frequency low when the throughput at the time of decoding is small, and is limited to the above-described setting method. Does not work. For example, when the throughput for decoding video data conforming to the MPEG4-AVC standard is greater than the processing capacity for decoding video data generated by the video encoding method or apparatus shown in each of the above embodiments, setting the driving frequency It is conceivable to do the opposite of the case described above.

In addition, the setting method of a drive frequency is not limited to the structure which makes a drive frequency low. For example, when the identification information indicates that the video data is generated by the video encoding method or apparatus shown in each of the above embodiments, the voltage applied to the device including the LSI (ex500) or LSI (ex500) is increased. In the case of setting and indicating that the video data conforms to the standards of the conventional MPEG-2, MPEG4-AVC, VC-1, etc., the voltage applied to the device including the LSI (ex500) or LSI (ex500) is set low. You can also think. Further, as another example, when the identification information indicates that the video data is generated by the video encoding method or apparatus shown in each of the above embodiments, the driving of the CPU ex502 is not stopped, and the conventional MPEG-2 is not used. In the case of indicating that it is video data conforming to standards such as MPEG4-AVC, VC-1, etc., it is conceivable to temporarily stop the operation of the CPU ex502 because there is room for processing. Even when the identification information indicates that the video data is generated by the video encoding method or apparatus shown in each of the above embodiments, it is also conceivable that the CPU ex502 is temporarily stopped when there is room for processing. In this case, it is conceivable to set the stop time shorter than that in the case of indicating that it is video data conforming to the standards of conventional MPEG-2, MPEG4-AVC, VC-1, and the like.

In this way, it is possible to achieve power saving by switching the driving frequency in accordance with the standard to which the video data conforms. In addition, when driving a device including an LSI (ex500) or LSI (ex500) using a battery, it is possible to increase the life of the battery in accordance with power saving.

(Embodiment 7)

A plurality of video data conforming to different standards may be input to the above-described devices and systems such as TVs and mobile phones. As described above, in order to be able to decode even when a plurality of video data conforming to different standards are input, it is necessary that the signal processing unit ex507 of the LSI ex500 corresponds to the plurality of standards. However, when the signal processing units ex507 corresponding to the respective standards are individually used, there is a problem that the circuit size of the LSI ex500 increases and the cost increases.

In order to solve this problem, a part of the decoding processing unit for executing the moving picture decoding method shown in each of the above-mentioned embodiments and a decoding processing unit conforming to conventional MPEG-2, MPEG4-AVC, and VC-1 standards are partially shared. It is configured. This configuration example is shown in ex900 in Fig. 27A. For example, the video decoding method shown in each of the above-described embodiments and the video decoding method conforming to the MPEG4-AVC standard are partially processed in processing such as entropy encoding, inverse quantization, deblocking filter, and motion compensation. It becomes common. For the common processing contents, the decoding processing unit ex902 corresponding to the MPEG4-AVC standard is shared, and for the other processing contents specific to one embodiment of the present invention that does not support the MPEG4-AVC standard, the dedicated decoding processing unit A configuration using (ex901) can be considered. Particularly, since one aspect of the present invention has characteristics for inverse quantization, for example, for the inverse quantization, a dedicated decoding processing unit ex901 is used, and other entropy decoding, deblocking filters, and motion compensation are being performed. It is conceivable to share the decoding processing unit for any one or all of the processing. Regarding the sharing of the decoding processing unit, for the common processing content, the decoding processing unit for executing the video decoding method shown in each of the above embodiments is shared, and for the processing content specific to the MPEG4-AVC standard, a dedicated decoding processing unit It may be configured to use.

In addition, another example in which the processing is partially shared is shown in ex1000 in Fig. 27B. In this example, the dedicated decoding processing unit ex1001 corresponding to the processing contents specific to one aspect of the present invention, the dedicated decoding processing unit ex1002 corresponding to the processing contents specific to other conventional standards, and one aspect of the present invention It is configured to use a common decoding processing unit ex1003 corresponding to the processing content common to the related video decoding method and other conventional standard video decoding methods. Here, the dedicated decoding processing units ex1001 and ex1002 are not necessarily specialized in the processing contents peculiar to one aspect of the present invention or other conventional standards, and may be capable of executing other general-purpose processing. Moreover, it is also possible to mount the structure of this embodiment in LSI ex500.

Thus, by sharing the decoding processing unit with respect to the processing contents common to the moving picture decoding method and the conventional standard moving picture decoding method according to one aspect of the present invention, the circuit size of the LSI is reduced and the cost is reduced. It is possible.

<Industrial availability>

The moving picture encoding method and the moving picture decoding method according to an aspect of the present invention can be used, for example, a television set, a digital video recorder, car navigation system, a mobile phone, a digital camera, or a digital video camera.

100: decoding device 101: luminance CBF decoding unit
102: control unit 103: switch
104: residual coefficient decoding unit 105: residual signal recovery unit
106: adder 200: image coding device
205: subtractor 210: conversion, quantization
220: entropy encoding unit 230, 420: inverse quantization, inverse transformation unit
235, 425: adder 240, 430: deblocking filter
250, 440: memory 260, 450: intra prediction unit
270: motion detection unit 280, 460: motion compensation unit
290, 470: Intra/inter changeover switch
301, 302, 303, 304, 305, 306: block
311, 312, 313, 314, 315: luminance CBF flag
400: moving picture decoding device 410: entropy decoding unit

Claims (15)

A decoding method for decoding a coded image signal for each first unit including one or more second units,
An acquiring step of acquiring, from the coded image signal, a luminance CBF flag indicating whether a quantization coefficient is included in a second unit of the one or more second units;
A determining step of determining whether the size of the first unit and the size of the second unit are the same, and whether the size of the second unit is a predetermined maximum size;
(i) when the size of the first unit and the size of the second unit are the same, or when the size of the second unit is a predetermined maximum size, a first probability table is selected, and (ii) the first If the size of the unit and the size of the second unit are not the same, and the size of the second unit is not a predetermined maximum size, the second probability table is selected regardless of the size of the second unit. A selection step of selecting a first probability table or a second probability table;
An arithmetic decoding step of performing arithmetic decoding of the luminance CBF flag using one selected from the first probability table and the second probability table; And
And a reconstruction step of reconstructing an image signal for each of the first units using the quantization coefficients of the second unit when the luminance CBF flag indicates that the quantization coefficients are included in the second unit. Way. A decoding device for decoding an encoded image signal for each first unit including one or more second units,
Processor; And
It has a non-transitory memory in which executable instructions are stored, which, when executed by the processor, cause the processor to:
An acquiring step of acquiring, from the coded image signal, a luminance CBF flag indicating whether a quantization coefficient is included in a second unit of the one or more second units;
A determining step of determining whether the size of the first unit and the size of the second unit are the same, and whether the size of the second unit is a predetermined maximum size;
(i) when the size of the first unit and the size of the second unit are the same, or when the size of the second unit is a predetermined maximum size, a first probability table is selected, and (ii) the first If the size of the unit and the size of the second unit are not the same, and the size of the second unit is not a predetermined maximum size, the second probability table is selected regardless of the size of the second unit. A selection step of selecting a first probability table or a second probability table;
An arithmetic decoding step of performing arithmetic decoding of the luminance CBF flag using one selected from the first probability table and the second probability table; And
When the luminance CBF flag indicates that the quantization coefficient is included in the second unit, performing a reconstruction step of reconstructing an image signal for each of the first units using the quantization coefficient of the second unit, Decryption device. An encoding method for encoding an image signal for each first unit including one or more second units,
A transform quantization step of converting the image signal of the first unit into a coefficient and quantizing the coefficient for every second unit of the one or more second units;
A determining step of determining whether the size of the first unit and the size of the second unit are the same, and whether the size of the second unit is a predetermined maximum size;
(i) when the size of the first unit and the size of the second unit are the same, or when the size of the second unit is a predetermined maximum size, a first probability table is selected, and (ii) the first If the size of the unit and the size of the second unit are not the same, and the size of the second unit is not a predetermined maximum size, the second probability table is selected regardless of the size of the second unit. A selection step of selecting a first probability table or a second probability table; And
And an arithmetic encoding step of performing arithmetic encoding of a luminance CBF flag indicating whether a quantization coefficient is included in the second unit, using one selected from the first probability table and the second probability table. . An encoding apparatus for encoding an image signal for each first unit including one or more second units,
Processor; And
It has a non-transitory memory in which executable instructions are stored, which, when executed by the processor, cause the processor to:
A transform quantization step of converting the image signal of the first unit into a coefficient and quantizing the coefficient for every second unit of the one or more second units;
A determining step of determining whether the size of the first unit and the size of the second unit are the same, and whether the size of the second unit is a predetermined maximum size;
(i) when the size of the first unit and the size of the second unit are the same, or when the size of the second unit is a predetermined maximum size, a first probability table is selected, and (ii) the first If the size of the unit and the size of the second unit are not the same, and the size of the second unit is not a predetermined maximum size, the second probability table is selected regardless of the size of the second unit. A selection step of selecting a first probability table or a second probability table; And
Encoding to perform an arithmetic encoding step of performing arithmetic encoding of a luminance CBF flag indicating whether a quantization coefficient is included in the second unit, using one selected from the first probability table and the second probability table Device. As an encoding/decoding device,
One or more processors; And
A non-transitory storage medium connected to the one or more processors, an encoding instruction for executing an encoding process for encoding an image signal for each first unit including one or more second units, and a third including one or more fourth units A non-transitory storage medium comprising a decoding instruction for executing decoding processing for decoding the encoded image signal for each unit;
The one or more processors execute the encoding process, and the encoding process is:
A transform quantization step of converting the image signal of the first unit into a coefficient and quantizing the coefficient for every second unit of the one or more second units;
A first determining step of determining whether the size of the first unit and the size of the second unit are the same, and whether the size of the second unit is a predetermined maximum size;
(i) when the size of the first unit and the size of the second unit are the same, or when the size of the second unit is a predetermined maximum size, a first probability table is selected, and (ii) the first If the size of the unit and the size of the second unit are not the same, and the size of the second unit is not a predetermined maximum size, the second probability table is selected regardless of the size of the second unit. A first selection step of selecting a first probability table or a second probability table; And
An arithmetic encoding step of performing arithmetic encoding of a luminance CBF flag indicating whether a quantization coefficient is included in the second unit, using one selected from the first probability table and the second probability table;
The one or more processors also execute the decoding process, the decoding process being:
An acquisition step of obtaining a luminance CBF flag indicating whether a quantization coefficient is included in a fourth unit of the one or more fourth units from the encoded image signal;
A second determination step of determining whether the size of the third unit and the size of the fourth unit are the same, and whether the size of the fourth unit is a predetermined maximum size;
(i) when the size of the third unit and the size of the fourth unit are the same, or when the size of the fourth unit is a predetermined maximum size, a third probability table is selected, and (ii) the third If the size of the unit and the size of the fourth unit are not the same, and the size of the fourth unit is not a predetermined maximum size, the fourth probability table is selected regardless of the size of the fourth unit. A second selection step of selecting a 3 probability table or a 4 probability table;
An arithmetic decoding step of performing arithmetic decoding of the luminance CBF flag using one selected from the third probability table and the fourth probability table; And
And a reconstruction step of reconstructing an image signal for every third unit by using the quantization coefficient of the fourth unit when the luminance CBF flag indicates that the quantization coefficient is included in the fourth unit. Decryption device. The method according to claim 5,
Each of the first unit and the third unit is a coding unit, and the coding process or the decoding process is performed based on the coding unit;
Each of the second unit and the fourth unit is a transformation unit, and an image signal is converted into the coefficients based on the transformation unit for each first unit. As an encoding/decoding device,
An encoding device that encodes an image signal for each first unit including one or more second units; And
A decoding device for decoding the image signal encoded for each of the first units including the one or more second units;
The encoding device:
A transform quantization unit that converts an image signal into coefficients for every second unit among the one or more second units, and quantizes the coefficients for each first unit;
An arithmetic coding unit to determine whether the size of the first unit and the size of the second unit are the same, and whether the size of the second unit is a predetermined maximum size; And
(i) when the size of the first unit and the size of the second unit are the same, or when the size of the second unit is a predetermined maximum size, a first probability table is selected, and (ii) the first If the size of the unit and the size of the second unit are not the same, and the size of the second unit is not a predetermined maximum size, the second probability table is selected regardless of the size of the second unit. A switch for selecting a first probability table or a second probability table;
The arithmetic encoding unit performs arithmetic encoding of a luminance CBF flag indicating whether a quantization coefficient is included in the second unit, using one selected from the first probability table and the second probability table;
The decoding device is:
A luminance CBF decoder for obtaining a luminance CBF flag indicating whether the quantization coefficient is included in a second unit of the one or more second units from the encoded image signal;
An arithmetic decoding unit that determines whether the size of the first unit and the size of the second unit are the same, and whether the size of the second unit is a predetermined maximum size; And
(i) when the size of the first unit and the size of the second unit are the same, or when the size of the second unit is a predetermined maximum size, a first probability table is selected, and (ii) the first If the size of the unit and the size of the second unit are not the same, and the size of the second unit is not a predetermined maximum size, the second probability table is selected regardless of the size of the second unit. A switch for selecting a first probability table or a second probability table;
The arithmetic decoding unit performs arithmetic decoding of the luminance CBF flag using one selected from the first probability table and the second probability table;
The decoding apparatus, when the luminance CBF flag indicates that the quantization coefficient is included in the second unit, a reconstruction unit configured to reconstruct an image signal for each first unit using the quantization coefficient of the second unit. An encoding/decoding device further provided. The method according to claim 7,
The first unit is a coding unit, and encoding or decoding is performed based on the coding unit;
The second unit is a transform unit, and an image signal is transformed into the coefficients based on the transform unit for each first unit. delete delete delete delete delete delete delete

Images