JPH11285001A - Moving image encoding device and moving image decoding device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To eliminate deterioration in the quality of an image by keeping both a frame rate and picture quality excellent by integrating the shape encoding output obtained by encoding the shapes of an area of an entire image (background) and an area of a partial image (person) and the moving image encoding output obtained by encoding only the pixel values in both the areas. SOLUTION: An area selection part 101 selects the entire image in 1st encoding mode and the partial image in 2nd encoding mode and according to the selection, a moving image encoding part 104 encodes source image data in the 1st or 2nd encoding mode. The shape data on the area selected by the area selection part 101 are encoded by a shape encoding part 102, decoded, and inputted to a moving image encoding part 104. An encoding control part 105 controls the area selection part 101 and a switch 106 according to the encoding mode. In the 1st encoding mode, the entire image is selected and the switch 106 is turned off. In the 2nd encoding mode, on the other hand, the partial image is selected and the switch 106 is turned on to perform shape encoding.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention belongs to the field of digital image processing, and more particularly to moving picture coding for efficiently coding image data and moving picture decoding for coded data created by this moving picture coding apparatus. The present invention relates to a decoding device.

[0002]

2. Description of the Related Art Conventionally, H.26
A moving picture coding method represented by 1 has been used. 7A and 7B show a conventional example, in which FIG. 7A is a block diagram of a conventional video encoding device, and FIG. 7B is a block diagram of a conventional video decoding device.

[0003] A moving picture coding apparatus shown in FIG.
01, an encoding unit 702, an adder 703, a frame memory 704, and a motion compensation prediction unit 705. Also,
The video decoding device in FIG. 7B includes a decoding unit 706, an adder 7
07, a frame memory 708, and a motion compensation prediction unit 709.

[0004] Next, the operation of the conventional moving picture coding apparatus and the conventional moving picture decoding apparatus will be described with reference to FIG. The original image data is divided into a plurality of blocks, and each of the divided blocks is input to a differentiator 701. The difference unit 701 calculates difference data between the image data of each block and the predicted image data from the motion compensation prediction unit 705. The prediction image data is obtained by motion compensation prediction from the decoded image data that has been encoded and recorded in the frame memory 704. At this time, the motion between the decoded image data and the original image data is detected for each block, and the detected motion data is encoded by the encoding unit 702. However, the motion data is not shown. The encoding unit 702 also encodes the difference data calculated by the differentiator 701, outputs encoded data, and decodes the difference data. The decoded difference data is added to the predicted image data by the adder 703 and stored in the frame memory 704. The stored decoded image data is used for motion compensation prediction of the next frame.

[0005] A decoding unit 706 decodes the encoded data to obtain difference data and motion data. However, the motion data is not shown. The decoded difference data is added to the predicted image data by the adder 707 and stored in the frame memory 708. The motion compensation prediction unit 709 generates predicted image data based on the decoded image data stored in the frame memory 708 and the motion data. Encoding and decoding of a moving image are performed as described above.

[0006]

Since the conventional videophone / conference is used indoors, the background of the speaker is generally stationary. However, when a videophone is used outdoors, the background pattern changes significantly with time as compared to a normal speaker. Or, even in indoor use, when the camera is moved or when a person moves behind the speaker, the background picture changes and motion information is generated.

In such a case, according to the prior art, if the frame rate (the number of frames) is maintained, the total number of coded bits becomes large because the amount of codes generated from the background portion is large, and the transmission capacity becomes large. There is a problem that exceeds. On the other hand, in order to reduce the number of coded bits while maintaining the image quality of each frame, the frame rate must be reduced, which is a problem.

To solve this problem, Japanese Patent Application Laid-Open No. 9-9233
As described in (1), a method has been proposed in which an input image from a camera is controlled to update only a partial area in the input image. However, according to this method, since the shape of the region is limited to a rectangle, the image becomes discontinuous around the region, and there is a problem that the quality of the decoded image is significantly deteriorated.

It is an object of the present invention to solve these problems and to provide an encoding apparatus and a decoding apparatus which maintain both the frame rate and the picture quality of a speaker in good condition and do not degrade the picture quality. .

[0010]

According to the first aspect of the present invention, a first encoding mode for encoding an image in a first area, and a second encoding mode which is a partial area in the first area. A second encoding mode for encoding an image in the first and second regions, comprising: a region selector for selecting the first and second regions; and a first and second region. A shape encoding unit that encodes the shape of the moving image encoding unit that encodes only the pixel values inside the selected region based on the output from the shape encoding unit, and the shape encoding unit. The above problem is solved by providing a coded data integration unit that integrates the output from the video encoding unit.

According to a second aspect of the present invention, a first encoding mode for encoding an image in a first area representing the entire image, and a second area which is a partial area in the first area A second encoding mode for encoding an image in a moving image encoding apparatus, comprising: an area selecting unit that selects the second area; and a shape code that encodes a shape of the second area. A moving image encoding unit that encodes only pixel values inside the second region based on pixel values of the entire image or an output from the shape encoding unit, the shape encoding unit, The above problem is solved by providing a coded data integration unit that integrates the output from the video encoding unit.

According to a third aspect of the present invention, a first encoding mode for encoding an image in a first area and an image encoding in a second area which is a partial area in the first area. A video encoding device comprising: a second encoding mode for converting the first and second regions;
Encode a block outside the selected area as an invalid block based on the output from the area selection unit,
The above problem is solved by providing a moving image encoding unit that encodes information indicating a valid block.

According to a fourth aspect of the present invention, a first encoding mode for encoding an image in a first area representing the entire image, and a second area which is a partial area in the first area And a second encoding mode for encoding an image in the moving image encoding apparatus, wherein the region selecting unit that selects the second region, the selected based on the output from the region selecting unit The above problem is solved by providing a moving image encoding unit that encodes a block outside the set area as an invalid block and encodes information indicating an invalid / effective block.

According to a fifth aspect of the present invention, in the moving image encoding unit, image data of a partial area in an image in the second encoding mode is converted into an image in the first encoding mode. The above problem is solved by adding information indicating whether or not to superimpose to the encoded data.

According to claim 6 of the present invention, a first decoding mode for decoding an image in a first area and a second decoding mode for decoding an image in a second area which is a partial area in the first area. A shape decoding unit that decodes data obtained by coding the shapes of the first and second regions included in the input coded data, the shape decoding unit including:
A moving image decoding unit that decodes only the pixel values inside the first region in the decoding mode, and decodes only the pixel values inside the second region in the second decoding mode; The above problem is solved by providing a superimposing unit for superimposing the respective image data.

According to the seventh aspect of the present invention, a first decoding mode for decoding an image of a first area representing the entire image, and an image of a second area, which is a partial area within the first area, is decoded. A second decoding mode for decoding, comprising: a shape decoding unit configured to decode data obtained by encoding a shape of the second region included in input encoded data; Decoding the pixel values of the entire image by the decoding mode of
A moving image decoding unit that decodes only the pixel value inside the second region in the second decoding mode, and a superimposing unit that superimposes each image data decoded by the moving image decoding unit. Solution to the Problems

According to an eighth aspect of the present invention, a first decoding mode for decoding an image in a first area and a second decoding mode for decoding an image in a second area which is a partial area in the first area. And a decoding mode, wherein the information of the invalid / valid block included in the input coded data as information indicating whether or not inside the first and second areas, A video decoding unit that decodes only pixel values inside a first area in the first decoding mode based on the information, and decodes only pixel values inside a second area in the second decoding mode; And a superimposing unit that superimposes the respective image data decoded by the moving image decoding unit,
Solution to the Problems

According to the ninth aspect of the present invention, a first decoding mode for decoding an image of a first area showing the entire image, and an image of a second area which is a partial area in the first area is decoded. A second decoding mode for decoding, wherein the information on the invalid / effective block included in the input coded data is information indicating whether or not the information is inside the second area. A moving image decoding unit that decodes pixel values of the entire image in the first decoding mode based on the information, and decodes only pixel values in a second region in the second decoding mode; The above problem is solved by providing a superimposing unit that superimposes each image data decoded by the image decoding unit.

According to a tenth aspect of the present invention, in the superimposing unit, image data of a partial area in an image in the second encoding mode is included in the first encoded data included in the encoded data. The image decoded in the second decoding mode is superimposed with the image decoded in the first decoding mode or other images based on information indicating whether or not to superimpose the image in the encoding mode. By doing
Solution to the Problems

[0020]

DESCRIPTION OF THE PREFERRED EMBODIMENTS In the present invention, two encoding modes, a first encoding mode and a second encoding mode, are provided. In the first encoding mode, the entire image is encoded. In the second encoding mode, the entire image is encoded. Only a partial area in the image (such as a speaker area or a face part of a person image) is encoded. This makes it possible to reduce the frame rate of the background portion of a speaker or a person, and to suppress the amount of codes generated from the background even when the background pattern changes greatly.

FIG. 1 is a block diagram showing an encoding apparatus according to the first embodiment. 1 includes an area selecting unit 101, a shape encoding unit 102, and an encoded data integration unit 1.
03, a moving image encoding unit 104, an encoding control unit 105, and a switch 106. Hereinafter, the first according to FIG.
The operation of the encoding apparatus according to the embodiment will be described in detail.

The area selecting section 101 is a section for extracting a speaker area from original image data in the second encoding mode. As a method of extracting a face portion in an image, for example,
There is a method described in the document "Technique for Improving Image Quality in Video Coding" (Sharp Technical Report, No. 6, December 1994, pp. 25-30). In the first encoding mode, the area selecting unit 101 outputs the entire image as a selected area.

The original image data is encoded by the moving image encoding unit 104 in the first encoding mode or the second encoding mode. In the first encoding mode, the entire image is encoded.
As the encoding method, for example, H.
For example, a moving image coding method such as 261 is used. In the second encoding mode, only a partial area in the image is encoded according to the result of the area selection unit. This encoding method is basically the same as the first encoding mode, but the encoding target is limited to only the selected area. For example, when a method of dividing an image into blocks in the first encoding mode and performing encoding is used, the image is also divided into blocks in the second encoding mode, and only the block including the selected region is encoded. .

The shape encoding unit 102 includes a region selecting unit 101
The shape data of the area selected in is encoded. Here, the shape data is, for example, binary image data in which the pixel value inside the area is 1 and the pixel value outside is 0. As an encoding method of the shape data, for example, an international standard method such as MH, MR, MMR, and JBIG for encoding a binary image is used. The shape data encoded and decoded by the shape encoding unit 102 is input to the moving image encoding unit 104.

The coding control unit 105 controls the area selection unit 101 and the switch 106 according to the coding mode.
That is, in the case of the first encoding mode, the region selecting unit 10
In step 1, the entire image is selected, and the switch 102 is opened so that shape coding is not performed. In the case of the second encoding mode, the area selecting unit 101 selects a partial area in the image, closes the switch 102, and performs shape encoding.

As described above, the encoded moving image data and shape data are integrated by the encoded data integration unit and output. Next, the decoding device according to the first embodiment will be described.

FIG. 2 is a block diagram showing a decoding apparatus according to the first embodiment. 2 includes an encoded data separating unit 201, a shape decoding unit 202, a superimposing unit 203, a video decoding unit 204, a decoding control unit 205, a frame memory 2
06, the first switch 207, the second switch 208,
It comprises a third switch 209 and a fourth switch 210. Hereinafter, the operation of the decoding apparatus according to the first embodiment will be described in detail with reference to FIG.

The encoded data separating section 201 separates the inputted encoded data into encoded data of moving image data and encoded data of shape data. The encoded data of the shape data is decoded by the shape data decoding unit 202 and restored as a binary image.

The moving image decoding unit 204 decodes the entire image in the first encoding mode, and decodes one image in the image based on the decoded shape data in the second encoding mode. Only the area of the part is decoded. For example, when a method of dividing an image into blocks in the first encoding mode and decoding the image is used, in the second encoding mode, only the block including the inside of the area indicated by the shape data is decoded.

The decoding control unit 205 includes a first switch 207, a second switch 208, and a third switch 207 according to the encoding mode.
209 and the fourth switch 210 are controlled.
That is, in the case of the first encoding mode, the first switch 207 is opened so as not to decode the shape data, the second switch 208 is closed and the decoded image data is stored in the frame memory 206, The third switch 209 and the fourth switch 210 are connected to the lower side, and the decoded image data is output as it is. In the case of the second encoding mode, the first switch 207 is closed to decode the shape data, and the second switch 208 is opened so that the data in the frame memory 206 is not updated. The fourth switch 210 is connected to the upper side to input the decoded image data to the superimposing unit.

The superimposing section 203 superimposes the decoded image data input via the third switch 209 on the image data in the frame memory 206 while referring to the shape data. That is, if the shape data is the value 1 indicating the inside of the area, the decoded image data from the third switch 209 is output. If the shape data is the value 0 indicating the outside of the area, the image data of the frame memory 206 is output. I do. Thereby, in the case of the second encoding mode, the frame memory 20
6, the decoded image data of the entire image stored in
Image data is created by superimposing decoded image data of a partial area in the image decoded in the encoding mode.

In the superimposing section 203, instead of superimposing the image data by the above method, a weighted average of the data of the frame memory 206 and the data of the moving picture decoding section 204 can be obtained. At this time, the weight of the weighted average in each pixel is created from the shape data as follows.

Here, two methods will be described. The first method is a method in which weights are sequentially determined from the periphery of the area indicated by the shape data as shown in FIG. First, the weight outside the area is determined to be 0, and then the weights corresponding to the peripheral pixels of the area are determined.
0.2. Further, peripheral pixels of a portion where the weight is not determined inside the region are obtained, and the weight corresponding to these is set to 0.5. This procedure is repeated until the weights of the peripheral pixels of the undetermined portion become 1. Finally, the weight is set to 1.0 for a region whose weight has not been determined. In this way in the center of the area
Weight data having a value of 1.0, 0.2 in the peripheral portion, and 0.0 outside the region is created.

In the second method, the weight value is set to 0 outside the region,
This is a method of internally setting 1 and applying a low-pass filter to this binary image to blur the boundary. Various weight data can be created depending on the size of the filter, the coefficient value, and the number of times the filter is applied.

As described above, by setting the weight of the weighted average to 0 outside the region, 0 to 1 around the boundary, and 1 to the inside of the region, the weight of the region boundary generated by superimposition using binary shape data is set. Noise can be suppressed.

In this way, a part of the image (speaker region) is encoded in both the first encoding mode and the second encoding mode, and the other region (background) is encoded with the first code. Since the encoding is performed only in the encoding mode, the frame rate of the decoded image data can be set higher in the speaker region than in the background.

Next, a second embodiment of the present invention will be described. This embodiment allows a user to display a component image on a unique background image. Here, the part image is obtained by cutting out a partial area in the image such as a speaker or an object, and is assumed to be encoded in the second encoding mode. A flag is added to the encoded data to determine whether to superimpose the component image on the decoded image data in the first encoding mode as in the first embodiment, or on the original background image data prepared by the user. Indicated by For example, if the value of the flag is 1, it is superimposed on the decoded image data in the first encoding mode, and if it is 0, it is superimposed on the original background image prepared by the decoding device.

First, the coding device will be described. FIG.
Shows a block diagram of an encoding device according to the second embodiment. This is because the encoding device shown in FIG.
07, and the portions other than the encoding control unit 305 and the encoded data integrating unit 303 perform the same operations as those described in the first embodiment.

The flag generator 307 in FIG. 3 generates a flag having a value of 0 or 1. The generated flag is integrated with other encoded data in the encoded data integration unit 303.
The flag may be generated in all frames encoded in the second encoding mode, or may be generated only in a frame switched from the first encoding mode to the second encoding mode. In the former case, the background image can be switched in frame units, and in the latter case, the background image can be switched only when the encoding mode is switched. Alternatively, it may be generated only at the start of image sequence encoding and added to the header of encoded data. At this time, the background image can be switched for each image sequence.

Next, the decoding device will be described. FIG.
Shows a block diagram of a decoding device according to the second embodiment. This is because the background image memory 41
1 and a fifth switch 412 are added. Portions other than the encoded data separation unit 401 and the decoding control unit 405 perform the same operations as those described in the first embodiment.

The coded data separation unit 401 in FIG. 4 separates coded data of moving image data, coded data of shape data, and a flag from coded data. The flag is input to the decoding control unit 405.

The background image memory 411 stores background image data prepared by the user. The background image data may be image data previously sent from the encoding device in the first encoding mode, or may be image data originally captured by a digital camera, a scanner, or the like.

The decoding control unit 405 controls the first switch 407, the second switch 408, the third switch 409, and the fourth switch 410 as in the first embodiment, and responds to the value of the flag. Controls the fifth switch 412. That is, when the flag value is 1, the fifth switch 412 is closed toward the frame memory 406, and when the flag value is 0, the fifth switch 412 is closed toward the background image memory 411.

In the above description, a frame memory for recording image data is used in the background image memory 411, but a memory for recording one pixel data may be used instead of using such a frame memory. That is, when the value of the flag is 0, the background image is the one painted with the data recorded in the one-pixel data.

Next, a third embodiment of the present invention will be described. This embodiment is different from the first embodiment in that
The present invention is more simply implemented without coding the shape of the selected area.

The encoding apparatus according to the third embodiment can be realized by FIG. 8 from which the shape encoding section 102 and the switch 106 are removed in FIG. Hereinafter, the operation will be described with reference to FIG.

The moving picture coding unit 802 uses a method of dividing a picture into blocks and performing predictive coding using motion compensation prediction for each block, as described in "Prior Art". The difference from the operation of the first embodiment is that, at the time of encoding in the second encoding mode, a part other than the area selected by the area selecting unit 801 is encoded as an invalid block. Here, the invalid block is the encoding unit 702 in FIG.
Denotes a block that does not include difference data and motion data to be encoded. On the other hand, an effective block is a normal block including difference data or motion data. Both are distinguished by, for example, 1-bit data added for each block.

FIG. 5 shows an example of a selection area and an invalid / effective block. The outside of the selected area is always an invalid block, but the selected area includes an invalid block and a valid block. This is because even if the block is in the selected area, there is no change from the previous encoded image, and if there is no need to encode the difference data, the block becomes an invalid block.

The decoding apparatus according to the third embodiment differs from the decoding apparatus of FIG.
9 in which the signal line and the first switch 207 are removed. The operation will be described below with reference to FIG.

The difference between the first embodiment and the first embodiment is that the shape decoding unit 902 uses invalid / invalid data included in the encoded data.
The point is that shape data is created from 1-bit data indicating an effective block. That is, the shape data in the invalid block is all 0, and the shape data in the valid block is all 1. When the shape data is created in this manner, the region boundary is expressed only with a block-size accuracy, and the noise at the time of superposition is conspicuous. Therefore, as described in the first embodiment, the superimposing unit 903 converts the shape data to 0 at the region boundary.
Is changed to have a value of 1 and the decoded image data is created by weighted averaging.

As described above, even when the shape of the selected region is not encoded and the encoding device is simply configured, a good decoded image can be obtained by the decoding device. Note that a similar technique can be applied to the second embodiment. That is, the encoding device is configured as shown in FIG. 10 in which the switch 306 and the shape encoding unit 302 are omitted from FIG. 3, and the decoding device is changed from FIG. 4 to the encoded data separation unit 401 and the shape decoding unit 402. Signal line and first switch 407
Can be realized by configuring as shown in FIG.

At this time, since the decoded image data in the second encoding mode may be superimposed on a background image prepared by the user, the operation of the moving image encoding unit 1002 in FIG. 10 is as follows. . That is, the flag generator 1004
Is 0, all the blocks inside the selected area are regarded as valid blocks. For example, in FIG. 5, an invalid block inside the selected area is encoded as a valid block. Other functions of the encoding device are the same as those of the second embodiment. By doing so, a good decoded image is selected even when the value of the flag is 0 in the decoding device shown in FIG. 11 and the image data from the background image memory 1107 is used in the superimposing unit 1110. The difference between the operation of the decoding device and the first embodiment is that the shape creation unit 1102
Is that the shape data is created from 1-bit data indicating an invalid / effective block included in the encoded data.

In the first embodiment or the second embodiment, the present invention can be configured such that only a partial area in an image is encoded even in the first encoding mode. . Thus, for example, when a component image of only the speaker region is encoded, it is possible to perform encoding using different frame rates for the mouth region and the other regions in the speaker region. This can be realized by the encoding device shown in FIG. 12 in which the switch 106 of FIG. 1 is always closed and the decoding device shown in FIG. 13 in which the switch 207 of FIG. 2 is always closed.

In the encoding device shown in FIG.
Even in the coding mode, the region selecting unit 1201 selects a part of the region in the image, and the moving image coding unit 1204
Only the region selected in is encoded, and the shape encoding unit 1202 encodes the shape of the region.

In the decoding apparatus, even in the first encoding mode, the shape decoding unit 1302 decodes the shape of the region, and the moving image decoding unit 1304 decodes a part of the image according to the shape. In the superimposing unit 1303, a partial region of the component image decoded in the second encoding mode is superimposed on the component image decoded in the first encoding mode.

Also in the second embodiment, the same modification as described above can be used to encode only a partial area in an image even in the first encoding mode. The encoding device in this case can be realized by the encoding device shown in FIG. 14 in which the switch 306 in FIG. 3 is always closed.

The decoding apparatus keeps the switch 407 closed as shown in FIG. 4, deletes the fourth switch 410 and the background image memory 411 in FIG. 4, and superimposes the control signal from the decoding control unit 405 to the switch 412. It can be realized by the decoding device shown in FIG.

In the encoding device shown in FIG.
Even in the coding mode, the region selecting unit 1401 selects a partial region in the image, and
Only the area selected in 04 is encoded, and the shape encoding unit 1402 encodes the shape of the area. The flag generated by the flag generator 1406 has a different meaning in the decoding device from that of the second embodiment, as described below.

In the decoding device shown in FIG.
503 performs the following operations. That is, if the value of the flag is 1
In the case of, the decoded image data of the second encoding mode is superimposed on the image data of the frame memory 1506 as in FIG. 3. Output the data as it is. The decoding control unit 1505 controls the superimposition unit 1503 so that superimposition is performed when the value of the flag is 1, and superimposition is not performed when the value of the flag is 0.

In any of the embodiments, the decoded image to be output is obtained by decoding a partial area of the image (part image). Actually, this image is superimposed on some background image and displayed, but is not shown here.

In the coding apparatus of the present invention described above, the conventional method shown in FIG. 7A is used in the moving picture coding section 104, and the motion compensation prediction is performed in the first direction in all directions. When the decoding is performed from the decoded image data in the encoding mode, the encoding control unit 105 controls the input of the moving image encoding unit 104 to the frame memory. That is, in the case of the first encoding mode, the decoded image data is recorded in the frame memory, and in the case of the second encoding mode, the decoded image data is not recorded in the frame memory. As a result, the necessary frame memory can be reduced to one.

In the decoding device corresponding to this, the frame memory 206 can be used also as the frame memory of the moving picture decoding unit 204. That is, in the case of the first encoding mode, the decoded image data is recorded in the frame memory 206 and is used for the subsequent motion compensation prediction. Further, in the case of the second encoding mode, the decoded image data is not used for the motion compensation prediction, and thus need not be recorded in the frame memory.

[0063]

According to the moving picture coding apparatus and the moving picture decoding apparatus of the present invention, (1) the whole picture is coded in the first coding mode, and a part of the picture is coded in the second coding mode. By doing so, it is possible to make the frame rate of the background smaller than the frame rate of a part of the image, and without deteriorating the frame rate of the part of the image or the image quality of the entire image even when the background motion is large. , Can be encoded.

(2) Switching between a case where an image encoded in the second encoding mode is superimposed on an image encoded in the first encoding mode and a case where the image is superimposed on an image uniquely prepared by the decoding device. This makes it possible to use a user-specific image as the background image.

(3) When encoding in the second encoding mode, if the encoding device and the decoding device are configured without encoding the shape data indicating a partial area of the image, the shape data To reduce the amount of code required for
The present invention can be easily implemented by reducing the number of operations and memories required for decoding.

(4) Even when encoding is performed in the first encoding mode, when encoding shape data indicating a partial area of an image, a partial area of the component image and an area other than the partial image are encoded. Can be encoded using different frame rates,
Part images can be efficiently encoded.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an encoding device according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a decoding device according to the first embodiment of the present invention.

FIG. 3 is a block diagram illustrating an encoding device according to a second embodiment of the present invention.

FIG. 4 is a block diagram illustrating a decoding device according to a second embodiment of the present invention.

FIG. 5 is a diagram illustrating the shape of a selection area, invalid blocks, and valid blocks.

FIG. 6 is a diagram illustrating an example of a method of creating weight data.

FIG. 7 is a diagram showing a conventional video encoding device and video decoding device.

FIG. 8 is a block diagram illustrating an encoding device according to a third embodiment of the present invention.

FIG. 9 is a block diagram illustrating a decoding device according to a third embodiment of the present invention.

FIG. 10 is a block diagram illustrating an encoding device according to a third embodiment of the present invention.

FIG. 11 is a block diagram illustrating a decoding device according to a third embodiment of the present invention.

FIG. 12 is a block diagram illustrating a modification of the encoding device according to the first embodiment of the present invention.

FIG. 13 is a block diagram illustrating a modification of the decoding device according to the first embodiment of the present invention.

FIG. 14 is a block diagram showing a modification of the encoding device according to the second embodiment of the present invention.

FIG. 15 is a block diagram showing a modification of the decoding device according to the second embodiment of the present invention.

[Explanation of symbols]

 Reference Signs List 101 area selection unit 102 shape encoding unit 103 encoded data integration unit 104 moving image encoding unit 105 encoding control unit 106 switch 201 encoded data separation unit 202 shape decoding unit 203 superposition unit 204 moving image decoding unit 205 decoding control unit 206 frame memory 207 first switch 208 second switch 209 third switch 210 fourth switch

Claims (10)

[Claims] 1. A first encoding mode for encoding an image in a first area, and a second encoding mode which is a partial area in the first area.
A second encoding mode for encoding an image in an area, wherein: an area selection unit that selects the first and second areas; and the first and second areas. A shape encoding unit that encodes the shape of, a moving image encoding unit that encodes only pixel values inside a selected area based on an output from the shape encoding unit, and the shape encoding unit. A moving image encoding apparatus comprising: an encoded data integrating unit that integrates an output from the moving image encoding unit. 2. A first encoding mode for encoding an image in a first area representing the entire image, and a second encoding mode for encoding an image in a second area that is a partial area in the first area. A region selecting unit that selects the second region; a shape coding unit that codes the shape of the second region; and pixels of the entire image. A moving image encoding unit that encodes only the pixel value in the second area based on the value or the output from the shape encoding unit; and an output from the shape encoding unit and the moving image encoding unit. And a coded data integration unit for integrating the video data. 3. A first encoding mode for encoding an image in a first area, and a second encoding mode, which is a partial area in the first area.
A second encoding mode that encodes an image in an area of a moving image encoding apparatus, wherein: an area selecting unit that selects the first and second areas; and an output from the area selecting unit. Coding the block outside the selected area as an invalid block based on the
A moving image encoding apparatus comprising: a moving image encoding unit that encodes information indicating a valid block. 4. A first encoding mode for encoding an image in a first area representing the entire image, and a second encoding mode for encoding an image in a second area that is a partial area in the first area. A region selecting unit that selects the second region, and invalidating blocks outside the selected region based on an output from the region selecting unit. Encoded as invalid
A moving image encoding apparatus comprising: a moving image encoding unit that encodes information indicating a valid block. 5. The video encoding unit according to claim 2, wherein:
Wherein information indicating whether or not image data of a partial area in the image according to the first encoding mode is superimposed on the image according to the first encoding mode is added to the encoded data. An image encoding apparatus according to any one of claims 1 to 4. 6. A moving image comprising a first decoding mode for decoding an image in a first area, and a second decoding mode for decoding an image in a second area that is a partial area in the first area. A decoding device, comprising: a shape decoding unit that decodes data obtained by encoding the shapes of the first and second regions included in input encoded data; A moving image decoding unit that decodes only the pixel values of the second region and decodes only the pixel values inside the second region in the second decoding mode; and superimposing each image data decoded by the moving image decoding unit. And a moving image decoding apparatus. 7. A first decoding mode for decoding an image of a first area representing the entire image, and a second decoding mode for decoding an image of a second area which is a partial area in the first area. A shape decoding unit that decodes data obtained by encoding the shape of the second area included in the input encoded data; and a pixel of the entire image according to the first decoding mode. A moving image decoding unit that decodes a value and decodes only a pixel value inside a second area in the second decoding mode; and a superimposing unit that superimposes each image data decoded by the moving image decoding unit. A moving picture decoding device, comprising: 8. A moving image comprising a first decoding mode for decoding an image in a first area, and a second decoding mode for decoding an image in a second area which is a partial area in the first area. A decoding device, wherein information of an invalid / effective block included in input coded data is information indicating whether or not the block is inside the first and second areas, and based on the information, A moving image decoding unit that decodes only the pixel values inside the first area in the first decoding mode, and decodes only the pixel values inside the second area in the second decoding mode; And a superimposing unit that superimposes each piece of image data. 9. A first decoding mode for decoding an image of a first area showing the entire image, and a second decoding mode for decoding an image of a second area which is a partial area in the first area. In the video decoding device comprising, the information of the invalid / valid block included in the input encoded data as information indicating whether or not inside the second area, based on the information, A moving image decoding unit that decodes pixel values of the entire image in a first decoding mode, and decodes only pixel values in a second region in the second decoding mode; And a superimposing unit for superimposing the image data. 10. The superimposing unit superimposes image data of a partial area in an image in the second encoding mode with an image in the first encoding mode included in input encoded data. Based on the information indicating whether to
The image decoded by the second decoding mode is converted to the first image.
The moving picture decoding apparatus according to any one of claims 6 to 9, wherein the moving picture decoding apparatus superimposes an image decoded in the decoding mode of (1) or another image.