JP2007158703A - Moving picture generating apparatus, moving picture generating method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology of efficiently generating a moving picture where an object is gradually made blurry. <P>SOLUTION: A moving picture generating apparatus and generating the moving picture, resulting from changing still pictures includes a data acquisition section for acquiring data for denoting how to change the degree of blur processing applied to a blur region that is at least a part region of the still pictures, in a plurality of consecutive frame images in the moving picture; a first moving picture configuration image generating section for generating a first frame image, including the blur region from at least one of the still pictures on the basis of the acquired data; a DCT section for applying discrete cosine transform (DCT) to each partial region included in the first frame image, to calculate the DCT coefficient by each partial region; a DCT factor conversion section for converting the DCT coefficients in the partial regions included in the blur region in the first frame image, depending on the degree of blurring to be applied to the blurring region denoted by the data acquired by the data acquisition section; and a second moving picture configuration image generating section for generating a second frame image, reproduced before or after the first frame image, by using the converted DCT factors of the blurring region. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a moving image generating apparatus, a moving image generating method, and a program. In particular, the present invention relates to a moving image generation device and a moving image generation method for generating a moving image from a still image, and a program for the moving image generation device.

In a system that generates and records moving image data from multiple still image data provided by customers, it generates moving image data in which still images are switched by adding difference data indicating still image switching to the still image data. The system which performs is known (for example, refer patent document 1). With this technology, a user can easily browse a photographic image using a home video playback device such as a DVD player or a computer terminal such as a personal computer.
JP 2003-259303 A

  However, Patent Document 1 does not disclose a specific technique for efficiently generating a moving image indicating image switching. For example, in Patent Document 1, moving image data indicating transition of a still image, such as movement, enlargement / reduction, rotation, change in color tone, fade-in / fade-out of a still image, and mosaic display for a still image, is disclosed in Patent Document 1. A specific technique for efficiently generating is not disclosed.

  Then, an object of this invention is to provide the moving image production | generation apparatus, moving image production | generation method, and program which can solve said subject. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  According to the first aspect of the present invention, there is provided a moving image generating apparatus that generates a moving image in which a still image changes, and in a plurality of continuous moving image constituent images included in the moving image, a blur that is at least a partial region of the still image A transition data acquisition unit that acquires transition data indicating how to change the blurring level of the area, and a plurality of blur levels that gradually change based on the transition data acquired by the transition data acquisition unit A moving image generating unit that generates a compressed moving image including the moving image forming image, and the moving image generating unit generates a first moving image forming image including a blurred region from at least one still image; The DCT is applied to each partial area included in the first moving picture constituent image generated by the first moving picture constituent image generation unit to perform DC for each partial area. The DCT conversion unit that calculates the coefficient and the blur data indicated by the transition data acquired by the transition data acquisition unit indicate the DCT coefficient of the partial region included in the blur region in the first video component image generated by the first video component image generation unit. A DCT coefficient value conversion unit that converts in accordance with the blurring degree of the region, and a second moving image constituent image that is reproduced before or after the first moving image constituent image by using the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit And a second moving image constituent image generation unit.

  The DCT coefficient value conversion unit includes the DCT coefficient of the partial region included in the blur region in the second moving image constituent image generated by the second moving image constituent image generation unit in the blur region indicated by the transition data acquired by the transition data acquiring unit. Further converted according to the degree of blurring, the second moving image constituent image generation unit uses the DCT coefficient of the blur region converted by the DCT coefficient value converting unit to reproduce the third moving image reproduced before or after the second moving image constituent image. A composition image may be further generated.

  The DCT coefficient value conversion unit calculates the DCT coefficient of the blur region of the second moving image constituent image by reducing a high frequency component equal to or higher than the first level of the DCT coefficient of the blur region of the first moving image constituent image, The DCT coefficient of the blur area of the third moving image constituent image is calculated by reducing a high frequency component equal to or higher than the second level smaller than the first level of the DCT coefficient of the blur area of the second moving image constituent image, and the second moving picture is calculated. The component image generation unit may generate a first moving image component image, a second moving image component image, and a third moving image component image in which the blurring degree of the blur region gradually increases or decreases.

  The moving image generation unit includes a plurality of first partial blur regions included in the plurality of first partial blur regions obtained by dividing the blur region by using the DCT coefficients of the partial regions included in the blur region of the second moving image component image generated by the second moving image component image generation unit A DCT coefficient averaging unit that averages in the partial area, and the DCT coefficient averaged by the DCT coefficient averaging unit as DCT coefficients of a plurality of partial areas included in the first partial blur area, You may further have the 3rd moving image structure image generation part which produces | generates the 4th moving image structure image reproduced | regenerated later.

  The DCT coefficient averaging unit includes the DCT coefficient of the partial region included in the blur region of the fourth moving image constituent image generated by the third moving image component image generating unit in the second partial blur region that is larger than the first partial blur region. The third moving image constituent image generation unit further averages the DCT coefficients averaged by the DCT coefficient averaging unit as the DCT coefficients of the plurality of partial regions included in the second partial blur region. A fifth moving image constituent image that is played back before or after the constituent image may be generated.

  A plurality of moving picture configurations in which an object extracting unit that extracts a region of a predetermined object in a still image as a blurred region is further provided, and the moving image generating unit gradually changes the degree of blurring of the object region extracted by the object extracting unit A compressed moving image including an image may be generated.

  Based on the transition data acquired by the transition data acquisition unit, a partial region having the same image content as each of a plurality of predetermined partial regions included in an image region other than the blur region of one moving image constituent image Based on the same partial area specifying unit that specifies whether or not it exists in the moving image constituent image and the transition data acquired by the transition data acquiring unit, the same partial area specifying unit has determined that there is a partial area having the same image content A motion vector calculating unit that calculates a motion vector indicating a position difference between the partial region and a partial region included in another moving image constituent image having the same image content as the partial region; The moving image composition image generation unit uses the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit and the motion vector calculated by the motion vector calculation unit. May generate a second video configuration images containing the partial region revealed.

  The moving image generation unit generates an MPEG-encoded moving image in which a plurality of still images change, and the first moving image configuration image generation unit is a first moving image configuration image including a blur change region from at least one still image. The picture is generated, and the DCT conversion unit performs DCT conversion for each macroblock included in the I picture generated by the first moving image configuration image generation unit to calculate a DCT coefficient for each macroblock, and the DCT coefficient value conversion unit The DCT coefficients of the macroblocks included in the blur region in the I picture generated by the first moving image constituent image generation unit are converted according to the blur degree of the blur region indicated by the transition data acquired by the transition data acquisition unit, and the same The partial area specifying unit is configured to generate a plurality of P pictures or B pixels based on the transition data acquired by the transition data acquisition unit. A partial area having the same image content as each of a plurality of predetermined macroblocks included in the image area other than the blur area of the imager is reproduced before the I picture, P picture, or B picture reproduced before the P picture. Alternatively, the motion vector calculation unit specifies whether or not each of the I picture or P picture to be reproduced later exists, and the motion vector calculation unit uses the same partial area specification unit based on the transition data acquired by the transition data acquisition unit. A motion vector indicating a difference in position between the macro block determined to be present and the partial area included in the I picture or P picture having the same image content as the macro block, The component image generation unit calculates the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit and the motion vector calculation unit. It may generate a P-picture or B-picture which is the second moving arrangement image including the macroblock represented by the motion vectors.

  According to the second aspect of the present invention, there is provided a moving image generation method for generating a moving image in which a still image changes, and in a plurality of continuous moving image constituent images included in the moving image, a blur that is at least a partial region of the still image Based on the transition data acquisition stage that obtains transition data indicating how to change the blurring degree of the area and the transition data acquired in the transition data acquisition stage, the blurring degree of the blurring area gradually changes A moving image generation stage for generating a compressed moving image including a plurality of moving image composition images, and the moving image generation stage generates a first moving image composition image generation step including a blur area from at least one still image. And DCT for each partial area included in the first moving image constituent image generated in the first moving image constituent image generation stage. DCT conversion stage for calculating DCT coefficients for each partial area by performing conversion, and DCT coefficients of the partial areas included in the blurring area in the first moving image constituent image generated in the first moving picture constituent image generation step, as transition data Using the DCT coefficient value conversion stage for converting according to the blurring degree of the blur area indicated by the transition data acquired in the acquisition stage, and the DCT coefficient of the blur area converted in the DCT coefficient value conversion stage, the first moving image constituent image A second moving image composing image generating step of generating a second moving image composing image to be reproduced before or after

  According to the third aspect of the present invention, there is provided a program for a moving image generating apparatus that generates a moving image in which a still image changes. The transition data acquisition unit that acquires transition data that indicates how to change the blur level of at least some of the blur areas, and the blur level of the blur area is based on the transition data acquired by the transition data acquisition unit First, the moving image generation unit functions as a moving image generation unit that generates a compressed moving image including a plurality of gradually changing moving image component images, and the moving image generation unit generates a first moving image component image including a blur region from at least one still image. D for each partial area included in the first moving image composition image generated by the one moving image composition image generation unit and the first moving image composition image generation unit Transition data acquisition of DCT coefficients of a partial area included in a blurred area in the first moving image constituent image generated by the first moving image constituent image generated by the first moving picture constituent image generating unit and a DCT converting unit that performs T conversion to calculate a DCT coefficient for each partial region The DCT coefficient value conversion unit that converts according to the blurring degree of the blur region indicated by the transition data acquired by the unit, the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit, before or after the first moving image constituent image It is made to function as a 2nd moving image structure image generation part which produces | generates the 2nd moving image structure image reproduced | regenerated.

  Note that the above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  According to the present invention, it is possible to provide a moving image generating apparatus that efficiently generates a moving image in which an object is blurred.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are inventions. It is not always essential to the solution.

  FIG. 1 shows an example of a usage environment of a moving image generating apparatus 100 according to an embodiment. The moving image generating apparatus 100 generates an MPEG encoded moving image such as a slide show by applying effects such as reduction, rotation, mirror display conversion, color conversion, and mosaic processing to an object included in a still image. Specifically, the moving image generating apparatus 100 receives still images 120, 121, 122, 123,... Taken by the user 190 using the imaging device 110. Then, the moving image generating apparatus 100 has a higher matching degree than a predetermined matching degree with an object included in a larger number of images or a pre-registered person's face among the objects included in the received still image. The matching object is extracted as an object to be effected. Note that the moving image generating apparatus 100 may cause the user 190 to select an object to be moved in the moving image from among the objects included in the still image.

  Then, the moving image generating apparatus 100 performs processing including DCT conversion on the still image including the extracted object, thereby generating I pictures (for example, I pictures 141, 151, 161, 171, 181) constituting the moving image. Generate. Then, the moving image generating apparatus 100 operates the DCT coefficient calculated at the time of generating each I picture in accordance with the effect pattern instructed by the user 190, thereby causing the object to have an effect applied to the P picture or B picture. (For example, B pictures 142, 152, 162, 172, 182) are generated. For example, the moving image generating apparatus 100 generates a moving image 140 in which an object is reduced by thinning out DCT coefficients. For example, the moving image generating apparatus 100 generates a moving image 150 in which an object is enlarged by thinning out DCT coefficients. In addition, the moving image generating apparatus 100 generates a moving image 160 in which an object rotates by rearranging and code conversion of DCT coefficients in a block and rearranging blocks. In addition, the moving image generation apparatus 100 generates a moving image 170 in which an object is mirror-display converted by code conversion of DCT coefficients. In addition, the moving image generating apparatus 100 generates a moving image 180 in which the color of the object changes by increasing or decreasing the magnitude of the DCT coefficient value for the color difference signals Cr and Cb. In addition, the moving image generating apparatus 100 generates a moving image 190 in which mosaic processing is performed on an object by cutting high frequency components of DCT coefficients or averaging DC components of DCT coefficients of adjacent macroblocks.

  As described above, the moving image generating apparatus 100 generates the DCT coefficient of the P picture or the B picture by operating the DCT coefficient when the I picture is generated. Therefore, the moving image generating apparatus 100 can generate a moving image that has been MPEG encoded at a higher speed than the case where MPEG encoding is performed after generating pixel data of the entire image area of a P picture or B picture.

  Note that the moving image generation apparatus 100 may acquire and register an effect pattern designed by a designer who creates a moving image, a user 190 who operates the moving image generation apparatus 100, or the like. In addition, the moving image generating apparatus 100 may acquire and register an effect pattern via a recording medium or a communication line that can be accessed by the moving image generating apparatus 100. Note that the moving image generating apparatus 100 may record the generated moving image on a recording medium such as the DVD 130 and provide it to the user 190, or may provide the generated moving image to the user 190 through a communication line such as the Internet. In addition, the moving image generating apparatus 100 may receive a still image from the imaging device 110 through a communication line such as the Internet, or may receive a still image recorded on a recording medium such as a semiconductor memory by the imaging device 110 from the recording medium. Also good. Note that the moving image generation apparatus 100 may be a captured image, or image data created using image processing software or the like other than the captured image. Note that the video generation device 100 may be a digital photoshop 170, a convenience store, a public facility, a kiosk terminal provided in a simple building such as a station and park shop, or the like, or provided in a private house. It may be a terminal such as a personal computer.

  FIG. 2 shows an example of a block configuration of the moving image generating apparatus 100. An object of the moving image generating apparatus 100 according to the present embodiment is to efficiently generate a moving image in which a still image changes by manipulating a DCT coefficient in the still image. The moving image generation apparatus 100 includes an instruction input unit 200, an output unit 205, an image storage unit 210, a transition data acquisition unit 212, a moving image generation unit 214, and an object extraction unit 260. The moving image generation unit 214 includes a DCT coefficient code conversion unit 220, a DCT coefficient arrangement conversion unit 222, a DCT coefficient value conversion unit 224, a DCT coefficient color difference conversion unit 226, a DCT coefficient averaging unit 228, an inverse DCT conversion unit 230, and an inverse DCT conversion. A pixel selection unit 232, an identical partial region specification unit 240, a motion vector calculation unit 250, a first moving image configuration image generation unit 281, a second moving image configuration image generation unit 282, a third moving image configuration image generation unit 283, a DCT conversion unit 290, A DCT coefficient quantization unit 292 and an encoding unit 294 are included.

  The transition data acquisition unit 212 acquires transition data indicating how to reduce a reduced area, which is at least a partial area of a still image, in a plurality of continuous moving image constituent images included in a moving image. Then, the first moving image configuration image generation unit 281 generates a first moving image configuration image including a reduced area from at least one still image. Then, the DCT conversion unit 290 performs DCT conversion for each partial region included in the first moving image configuration image generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each partial region.

  Then, the inverse DCT conversion pixel selection unit 232 selects a pixel having the number of pixels corresponding to the reduction ratio of the reduction area indicated by the transition data acquired by the transition data acquisition unit 212 from pixels having a lower frequency. Then, the inverse DCT conversion unit 230 calculates the DCT coefficient for each partial region calculated by the DCT conversion unit 290 for each partial region included in the reduced region in the first moving image configuration image generated by the first moving image configuration image generation unit 281. Of these, the DCT coefficient having the number of pixels corresponding to the reduction ratio of the reduction area indicated by the transition data acquired by the transition data acquisition unit 212 is subjected to inverse DCT transform, and the first moving image configuration image generation unit 281 generates Pixel data of the reduced area in the second moving image constituent image reproduced next to the one moving image constituent image is calculated. Specifically, the inverse DCT transform unit 230 has selected the inverse DCT transform pixel selection unit 232 for each partial region included in the reduced region in the first movie composition image generated by the first movie composition image generation unit 281. Inverse DCT transform is applied to the DCT coefficient of the pixel. Then, the second moving image configuration image generation unit 282 generates a second moving image configuration image using the pixel data of the reduced area in the second moving image configuration image calculated by the inverse DCT conversion unit 230.

  For example, when the transition data acquisition unit 212 acquires transition data indicating that the reduction area is reduced at a reduction ratio of 1 / N between the first moving picture constituent image and the second moving picture constituent image, the inverse DCT conversion pixel is acquired. The selection unit 232 selects a pixel having a pixel number that is 1 / N of the number of pixels of the DCT coefficient constituting the partial region, from pixels having a lower frequency. Then, the inverse DCT converter 230 generates pixel data of a reduced image having a 1 / N pixel width by inverse DCT transformation. As described above, the moving image generation unit 214 generates a compressed moving image including a plurality of moving image constituent images in which the reduction area is gradually reduced based on the transition data acquired by the transition data acquisition unit 212. Therefore, the moving image generating apparatus 100 can generate a moving image in which the object is reduced from the operation of the DCT coefficient.

  The DCT conversion unit 290 performs DCT conversion for each partial region included in the second moving image constituent image generated by the second moving image constituent image generation unit 282, and further calculates a DCT coefficient for each partial region. Then, the inverse DCT conversion unit 230 calculates the DCT coefficient for each partial region calculated by the DCT conversion unit 290 for each partial region included in the reduced region in the second moving image configuration image generated by the second moving image configuration image generation unit 282. Of these, the DCT coefficient having the number of pixels corresponding to the reduction ratio of the reduction area indicated by the transition data acquired by the transition data acquisition unit 212 is subjected to inverse DCT transform, and the second moving image configuration image generation unit 282 generates The pixel data of the reduced area in the third moving image constituent image reproduced next to the two moving image constituent images is further calculated. Then, the second moving image composition image generation unit 282 generates a third moving image composition image using the pixel data of the reduced area in the third moving image composition image calculated by the inverse DCT conversion unit 230. In this way, the moving image generating apparatus 100 can easily generate a moving image in which the reduced area is gradually reduced by operating the DCT coefficient.

  The same partial area specifying unit 240 is the same as each of a plurality of predetermined partial areas included in an image area other than the reduced area of one moving image constituent image based on the transition data acquired by the transition data acquiring unit 212. It is specified whether or not the partial area of the image content exists in another moving image constituent image. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the partial region determined by the same partial region specifying unit 240 that there is a partial region having the same image content, the partial region, A motion vector indicating a difference in position from a partial area included in another moving image constituent image having the same image content is calculated. The second moving image constituent image generation unit 282 is expressed by the pixel data of the reduced area in the second moving image constituent image calculated by the inverse DCT conversion unit 230 and the motion vector calculated by the motion vector calculation unit 250 minutes. A second moving image constituent image including the partial area is generated.

  When the moving image generation unit 214 generates an MPEG-encoded moving image in which a plurality of still images change, the first moving image configuration image generation unit 281 is a first moving image configuration image including a reduced area from at least one still image. An I picture is generated. Then, the DCT conversion unit 290 performs DCT conversion for each macroblock included in the I picture generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient of the macroblock. Then, the inverse DCT conversion unit 230 calculates, for each macroblock included in the reduced area in the I picture generated by the first moving image configuration image generation unit 281, out of the DCT coefficients for each macroblock calculated by the DCT conversion unit 290. Next, the DCT coefficient having the number of pixels corresponding to the reduction ratio of the reduction area indicated by the transition data acquired by the transition data acquisition unit 212 is subjected to inverse DCT transform and next to the I picture generated by the first moving image constituent image generation unit 281. The pixel data of the reduced area in the P picture or B picture to be reproduced is calculated.

  In addition, the same partial area specifying unit 240, based on the transition data acquired by the transition data acquiring unit 212, for each of a plurality of P pictures or B pictures, a plurality of predetermined plural areas included in an image area other than the reduced area Whether a partial area of the same image content as each macroblock exists in an I picture or P picture played before a P picture, or an I picture or P picture played before or after a B picture Identify. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the macro block determined by the same partial region specification unit 240 that there is a partial region having the same image content, the macro block, A motion vector indicating a difference in position from a partial region included in an I picture or P picture having the same image content is calculated. Then, the second moving image constituent image generation unit 282 is represented by the pixel data of the reduced area in the I picture or B picture calculated by the inverse DCT conversion unit 230 and the motion vector calculated by the motion vector calculation unit 250 minutes. An I picture or B picture, which is a second moving image constituent image including the partial area, is generated. For this reason, the moving image generating apparatus 100 can easily specify a partial area in which the amount of data can be compressed by expressing it with a motion vector from the transition data.

  In addition, the moving image generation apparatus 100 generates a moving image with an effect of rotating the rotation region of the image. In this case, the transition data acquisition unit 212 acquires transition data indicating how to rotate a rotation area, which is at least a partial area of a still image, in a plurality of continuous moving image constituent images included in the moving image. For example, the moving image generating apparatus 100 acquires transition data indicating the rotation amount and rotation direction of the rotation area.

  The first moving image forming image generation unit 281 generates a first moving image forming image including a rotation area from at least one still image. Then, the DCT conversion unit 290 performs DCT conversion for each partial region included in the first moving image configuration image generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each partial region. Then, the DCT coefficient arrangement conversion unit 222 performs the transition acquired by the transition data acquisition unit 212 in each of a plurality of partial regions included in the rotation region in the first moving image configuration image generated by the first moving image configuration image generation unit 281. A plurality of DCT coefficients in the partial area are rearranged or code-converted according to the rotation direction and rotation amount indicated by the data. Then, the second moving image configuration image generation unit 282 uses the transition acquired by the transition data acquisition unit 212 for each of the partial areas included in the rotation region in the first moving image configuration image generated by the first moving image configuration image generation unit 281. By rearranging according to the rotation direction and rotation amount indicated by the data, a second moving image constituent image to be reproduced next to the first moving image constituent image generated by the first moving image constituent image generating unit 281 is generated.

  As described above, the moving image generation unit 214 generates a compressed moving image including a plurality of moving image constituent images in which the rotation area is gradually rotated based on the transition data acquired by the transition data acquisition unit 212. Therefore, the moving image generating apparatus 100 can easily generate a moving image on which an effect of rotating the rotation area sequentially is performed by operating the DCT coefficient and replacing the arrangement of the partial areas. Note that the transition data acquisition unit 212 may acquire transition data indicating the rotation direction and the rotation amount based on the speed of each partial area included in the rotation area. The transition data acquisition unit 212 may acquire transition data indicating the rotation direction and the rotation amount of the rotation region based on the coordinates of the rotation center and the rotating angular velocity.

  The DCT conversion unit 290 performs DCT conversion for each partial region included in the second moving image constituent image generated by the second moving image constituent image generation unit 282, and further calculates a DCT coefficient for each partial region. Then, the DCT coefficient arrangement conversion unit 222 performs the transition acquired by the transition data acquisition unit 212 in each of a plurality of partial regions included in the rotation region in the second moving image configuration image generated by the second moving image configuration image generation unit 282. A plurality of DCT coefficients in the partial area are rearranged or code-converted according to the rotation direction and rotation amount indicated by the data. Then, the second moving image configuration image generation unit 282 determines each of the partial areas included in the rotation area in the second moving image configuration image according to the rotation direction and the rotation amount indicated by the transition data acquired by the transition data acquisition unit 212. By rearranging, a third moving image constituent image to be reproduced next to the second moving image constituent image is generated. As described above, the moving image generating apparatus 100 can easily generate a moving image on which an effect of rotating the rotation region sequentially is performed by operating the DCT coefficient and replacing the arrangement of the partial regions.

  The same partial area specifying unit 240 is the same as each of a plurality of predetermined partial areas included in an image area other than the rotation area of one moving image constituent image based on the transition data acquired by the transition data acquiring unit 212. It is specified whether or not the partial area of the image content exists in another moving image constituent image. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the partial region determined by the same partial region specifying unit 240 that there is a partial region having the same image content, the partial region, A motion vector indicating a difference in position from a partial area included in another moving image constituent image having the same image content is calculated. Then, the second moving image constituent image generation unit 282 is expressed by a partial region obtained by rearranging the partial regions included in the rotation region in the second moving image constituent image, and the motion vector calculated by the motion vector calculation unit 250 minutes region. A second moving image constituent image including the partial area to be generated is generated. As described above, the moving image generating apparatus 100 can efficiently specify a partial region in which the same image content is included in another moving image constituent image from among the partial regions not including the rotation region.

  When the moving image generation unit 214 generates an MPEG-encoded moving image in which a plurality of still images change, the first moving image constituent image generation unit 281 includes a first moving image including a rotation area from at least one still image. An I picture that is a constituent image is generated. Then, the DCT conversion unit 290 performs DCT conversion for each macroblock included in the I picture generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each macroblock. Then, the DCT coefficient arrangement conversion unit 222 performs the transition acquired by the transition data acquisition unit 212 in each of the plurality of macroblocks included in the rotation area in the first video configuration image generated by the first video configuration image generation unit 281. A plurality of DCT coefficients in the macroblock are rearranged or code-converted according to the rotation direction and rotation amount indicated by the data.

  Further, the same partial area specifying unit 240, based on the transition data acquired by the transition data acquiring unit 212, includes a plurality of predetermined macroblocks included in an image area other than a rotation area of a plurality of P pictures or B pictures. It is specified whether or not the same partial area of the image content exists in the I picture or P picture reproduced before the P picture, or in the I picture or P picture reproduced before or after the B picture. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the macro block determined by the same partial region specification unit 240 that there is a partial region having the same image content, the macro block, A motion vector indicating a difference in position from a partial region included in an I picture or P picture having the same image content is calculated. Then, the second moving image constituent image generation unit 282 is expressed by the motion vector calculated by the macro block obtained by rearranging the macro blocks included in the rotation region in the second moving image constituent image and the motion vector calculation unit 250 minutes region. A second moving image constituent image including the macroblock is generated.

  In addition, the moving image generating apparatus 100 generates a moving image that has been subjected to mirror display conversion of the image. In this case, the transition data acquisition unit 212 shows transition data indicating how to convert the mirror display conversion area, which is at least a partial area of the still image, to the mirror display conversion in a plurality of continuous moving image constituent images included in the moving image. To get. For example, the transition data acquisition unit 212 acquires transition data indicating the position and direction of the mirror axis to be subjected to mirror display conversion.

  Then, the first moving image configuration image generation unit 281 generates a first moving image configuration image including a mirror display conversion area from at least one still image. Then, the DCT conversion unit 290 performs DCT conversion for each partial region included in the first moving image configuration image generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each partial region. The DCT coefficient code conversion unit 220 is acquired by the transition data acquisition unit 212 in each of a plurality of partial regions included in the mirror display conversion region in the first moving image configuration image generated by the first moving image configuration image generation unit 281. The plurality of DCT coefficients in the partial area are code-converted according to the direction of the mirror axis of the mirror display conversion indicated by the transition data. Then, in the second moving image configuration image generation unit 282, the transition data acquisition unit 212 acquires each of the partial areas included in the mirror display conversion area in the first moving image configuration image generated by the first moving image configuration image generation unit 281. By rearranging according to the direction of the mirror axis of the mirror display conversion indicated by the transition data, the second moving image constituent image to be reproduced next to the first moving image constituent image generated by the first moving image constituent image generating unit 281 is generated. To do.

  As described above, the moving image generation unit 214 converts the compressed moving image including a plurality of moving image constituent images in which the mirror display conversion area is mirror-converted based on the transition data acquired by the transition data acquisition unit 212 to DCT coefficient conversion. Generate by. For this reason, the moving image generating apparatus 100 can efficiently generate a moving image that has been subjected to mirror display conversion.

  In addition, the DCT conversion unit 290 performs DCT conversion for each partial region included in the second moving image constituent image generated by the second moving image constituent image generation unit 282, and further calculates a DCT coefficient for each partial region. The DCT coefficient code conversion unit 220 is acquired by the transition data acquisition unit 212 in each of a plurality of partial regions included in the mirror display conversion region in the second moving image configuration image generated by the second moving image configuration image generation unit 282. The plurality of DCT coefficients in the partial area are code-converted according to the mirror axis direction of the mirror display conversion indicated by the transition data. Then, the second moving image configuration image generation unit 282 displays the direction of the mirror axis of the mirror display conversion indicated by the transition data acquired by the transition data acquisition unit 212 for each of the partial regions included in the rotation area in the second moving image configuration image. By rearranging according to the above, a third moving image constituent image to be reproduced next to the second moving image constituent image is generated. In this way, the moving image generating apparatus 100 can efficiently generate a moving image on which an effect that the mirror display conversion is repeated is performed by repeating the code conversion of the DCT coefficient.

  Further, the same partial area specifying unit 240, based on the transition data acquired by the transition data acquiring unit 212, includes a plurality of predetermined partial areas included in an image area other than the mirror display conversion area of one moving image constituent image. It is specified whether or not a partial area having the same image content as each of the other moving image constituent images exists. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the partial region determined by the same partial region specifying unit 240 that there is a partial region having the same image content, the partial region, A motion vector indicating a difference in position from a partial area included in another moving image constituent image having the same image content is calculated. Then, the second moving image constituent image generation unit 282 includes a partial region obtained by rearranging the partial regions included in the mirror display conversion region in the first moving image constituent image, and the motion vector calculated by the motion vector calculation unit 250 minutes region. A second moving image composing image including the partial area expressed by is generated. Thus, the moving image generating apparatus 100 can efficiently specify a partial region in which the same image content is included in another moving image constituent image from a region that is not subjected to mirror display conversion.

  When the moving image generating unit 214 generates an MPEG-encoded moving image in which a plurality of still images change, the first moving image forming image generating unit 281 includes a first moving image forming image including a mirror display conversion area from at least one still image. I picture is generated. Then, the DCT conversion unit 290 performs DCT conversion for each macroblock included in the I picture generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each macroblock. Then, the DCT coefficient arrangement conversion unit 222 is acquired by the transition data acquisition unit 212 in each of the plurality of macroblocks included in the mirror display conversion region in the first moving image configuration image generated by the first moving image configuration image generation unit 281. The plurality of DCT coefficients in the macroblock are code-converted according to the mirror axis direction of the mirror display conversion indicated by the transition data.

  Based on the transition data acquired by the transition data acquisition unit 212, the same partial region specifying unit 240 and each of a plurality of predetermined macroblocks included in an image region other than a mirror region of a plurality of P pictures or B pictures It is specified whether or not a partial area having the same image content exists in an I picture or P picture reproduced before a P picture, or an I picture or P picture reproduced before or after the B picture. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the macro block determined by the same partial region specification unit 240 that there is a partial region having the same image content, the macro block, A motion vector indicating a difference in position from a partial region included in an I picture or P picture having the same image content is calculated. Then, the second moving image constituent image generation unit 282 includes the macro block obtained by rearranging the macro blocks included in the mirror display conversion region in the first moving image constituent image, and the motion vector calculated by the motion vector calculation unit 250 minutes region. A second moving image constituent image including the macro block expressed by the above is generated.

  In addition, the moving image generating apparatus 100 generates a moving image to which an effect that changes the color of the object is applied. In this case, the transition data acquisition unit 212 displays transition data indicating how to change the color of the color change area, which is at least a partial area of the still image, in a plurality of continuous moving image constituent images included in the moving image. get. For example, the transition data acquisition unit 212 acquires transition data indicating the color to be emphasized in the color change region.

  The first moving image forming image generation unit 281 generates a first moving image forming image including a color change area from at least one still image. Then, the DCT conversion unit 290 performs DCT conversion for each partial region included in the first moving image configuration image generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each partial region. Then, the DCT coefficient color difference conversion unit 226 converts the DCT coefficient indicating the color difference information of the partial area included in the color change area in the first moving image configuration image generated by the first moving image configuration image generation unit 281 into the transition data acquisition unit 212. Is converted according to the color change amount of the color change area indicated by the transition data acquired. Then, the second moving image configuration image generation unit 282 generates a second moving image configuration image to be reproduced next to the first moving image configuration image, using the DCT coefficient of the color change region converted by the DCT coefficient color difference conversion unit 226. .

  As described above, the moving image generation unit 214 converts the compressed moving image including a plurality of moving image constituent images in which the color of the color change region gradually changes based on the transition data acquired by the transition data acquisition unit 212 into color difference information. Generated by manipulating the indicated DCT coefficient values. For this reason, the moving image generating apparatus 100 can efficiently generate a moving image whose color changes.

  Also, the DCT coefficient color difference conversion unit 226 converts the DCT coefficient indicating the color difference information of the partial area included in the color change area in the second moving image configuration image generated by the second moving image configuration image generation unit 282 into the transition data acquisition unit 212. Is further converted according to the color change amount of the color change region indicated by the acquired transition data. The second moving image configuration image generation unit 282 further generates a third moving image configuration image to be reproduced next to the second moving image configuration image, using the DCT coefficient of the color change region converted by the DCT coefficient color difference conversion unit 226. As described above, the moving image generating apparatus 100 can efficiently generate a moving image on which an effect in which a specific color is gradually enhanced is performed by manipulating the DCT coefficient value indicating the color difference information.

  Also, the DCT coefficient color difference conversion unit 226 converts the DCT coefficient of the color change area of the second moving image constituent image to be smaller than the DCT coefficient of the color change area of the first moving image constituent image, and the color change area of the second moving image constituent image. The DCT coefficient of the color change area of the third moving image constituent image is converted from the DCT coefficient. Then, the second moving image component image generation unit 282 generates a first moving image component image, a second moving image component image, and a third moving image component image in which the color change area gradually approaches a single color. For this reason, the moving image generation unit 214 can easily generate a moving image with an effect that the color gradually disappears by manipulating the DCT coefficient value of the color difference signal.

  Further, the object extraction unit 260 extracts a predetermined object area in the still image as a color change area. Then, the moving image generating unit 214 generates a compressed moving image including a plurality of moving image constituent images in which the color of the object region extracted by the object extracting unit 260 gradually changes. For example, the DCT coefficient color difference conversion unit 226 converts the DCT coefficient indicating the color difference information of the partial area included in the object area extracted by the object extraction unit 260 according to the color change amount of the color change area indicated by the transition data. .

  In addition, the same partial area specifying unit 240, based on the transition data acquired by the transition data acquiring unit 212, each of a plurality of predetermined partial areas included in an image area other than the color change area of one moving image constituent image. It is specified whether or not a partial area having the same image content exists in another moving image constituent image. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the partial region determined by the same partial region specifying unit 240 that there is a partial region having the same image content, the partial region, A motion vector indicating a difference in position from a partial area included in another moving image constituent image having the same image content is calculated. Then, the second moving image configuration image generation unit 282 includes the second moving image including the partial region expressed by the DCT coefficient of the color change region converted by the DCT coefficient color difference conversion unit 226 and the motion vector calculated by the motion vector calculation unit 250. Generate a composition image.

  When the moving image generation unit 214 generates an MPEG-encoded moving image in which a plurality of still images change, the first moving image configuration image generation unit 281 uses a first moving image configuration image including a color change area from at least one still image. A certain I picture is generated. Then, the DCT conversion unit 290 performs DCT conversion for each macroblock included in the I picture generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each macroblock. Then, the DCT coefficient color difference conversion unit 226 has acquired the DCT coefficient indicating the color difference information of the macroblock included in the color change area in the I picture generated by the first moving image configuration image generation unit 281 by the transition data acquisition unit 212. Conversion is performed according to the amount of color change in the color change area indicated by the transition data.

  Further, the same partial area specifying unit 240, based on the transition data acquired by the transition data acquiring unit 212, a plurality of predetermined macroblocks included in image areas other than the color change areas of a plurality of P pictures or B pictures. It is specified whether or not a partial area having the same image content as each of the I picture or P picture reproduced before the P picture exists in the I picture or P picture reproduced before or after the B picture. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the macro block determined by the same partial region specification unit 240 that there is a partial region having the same image content, the macro block, A motion vector indicating a difference in position from a partial region included in an I picture or P picture having the same image content is calculated. Then, the second moving image configuration image generation unit 282 includes the second moving image including the macroblock represented by the DCT coefficient of the color change region converted by the DCT coefficient color difference conversion unit 226 and the motion vector calculated by the motion vector calculation unit 250. A P picture or B picture, which is a constituent image, is generated.

  In addition, the moving image generating apparatus 100 generates a moving image that has been subjected to the effect of the object blurring process. In this case, the transition data acquisition unit 212 displays transition data indicating how to change the blurring degree of the blurring area that is at least a part of the still image in a plurality of continuous moving picture constituent images included in the moving picture. get.

  And the 1st moving image structure image generation part 281 produces | generates the 1st moving image structure image containing a blurring area | region from at least 1 still image. Then, the DCT conversion unit 290 performs DCT conversion for each partial region included in the first moving image configuration image generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each partial region. Then, the DCT coefficient value conversion unit 224 uses the transition data obtained by the transition data obtaining unit 212 to obtain the DCT coefficients of the partial regions included in the blurred region in the first moving image composition image generated by the first moving image composition image generation unit 281. Is converted according to the degree of blur of the blur area indicated by. Then, the second moving image configuration image generation unit 282 generates a second moving image configuration image to be reproduced before or after the first moving image configuration image, using the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit 224. .

  As described above, the moving image generation unit 214 converts a compressed moving image including a plurality of moving image constituent images in which the blurring degree of the blur region gradually changes based on the transition data acquired by the transition data acquisition unit 212 to the DCT coefficient. Generate by operation.

  In addition, the DCT coefficient value conversion unit 224 uses the transition data obtained by the transition data obtaining unit 212 to obtain the DCT coefficients of the partial regions included in the blurred region in the second moving image composition image generated by the second moving image composition image generation unit 282. Further conversion is performed according to the blurring degree of the blurring area indicated by. The second moving image component image generation unit 282 further generates a third moving image component image to be reproduced before or after the second moving image component image, using the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit 224. As described above, the moving image generation unit 214 can easily generate a moving image in which the blurring degree sequentially changes by operating the DCT coefficient.

  Further, the DCT coefficient value conversion unit 224 calculates the DCT coefficient of the blur area of the second moving image constituent image by reducing the high frequency component equal to or higher than the first level of the DCT coefficient of the blur area of the first moving image constituent image. Then, the DCT coefficient of the blur area of the third moving image constituent image is calculated by reducing a high frequency component equal to or higher than the second level smaller than the first level of the DCT coefficient of the blur area of the second moving image constituent image. Then, the second moving image component image generation unit 282 generates a first moving image component image, a second moving image component image, and a third moving image component image in which the blurring degree of the blur region gradually increases or decreases. As described above, the moving image generation unit 214 can easily generate a moving image to be subjected to the blurring process or a moving image to which the blurring process is canceled from the image subjected to the blurring process by operating the DCT coefficient.

  The DCT coefficient averaging unit 228 also uses a plurality of first partial blurrings obtained by dividing the DCT coefficients of the partial regions included in the blurring region of the second moving image constituent image generated by the second moving image constituent image generating unit 282 into the blurring regions. Averaging is performed on a plurality of partial areas included in the area. Then, the third moving image constituent image generation unit 283 uses the DCT coefficient averaged by the DCT coefficient averaging unit 228 as the DCT coefficients of the plurality of partial regions included in the first partial blur region, before the second moving image constituent image or A fourth moving image constituent image to be reproduced later is generated. For this reason, the moving image generation unit 214 can easily generate the effect of blurring the blur area in a mosaic manner by averaging the DCT coefficients of a plurality of partial areas.

  The DCT coefficient averaging unit 228 converts the DCT coefficient of the partial region included in the blur region of the fourth moving image constituent image generated by the third moving image component image generating unit 283 into a second partial blur region larger than the first partial blur region. Further averaging is performed on a plurality of included partial areas. Then, the third moving image constituent image generation unit 283 uses the DCT coefficient averaged by the DCT coefficient averaging unit 228 as the DCT coefficients of the plurality of partial regions included in the second partial blur region, before the fourth moving image constituent image or A fifth moving image constituent image to be reproduced later is generated. For this reason, the moving image generating unit 214 can easily generate a moving image in which the mosaic-processed region expands over a plurality of partial regions by operating the DCT coefficient.

  The object extraction unit 260 extracts a predetermined object area in the still image as a blur area. Then, the moving image generating unit 214 generates a compressed moving image including a plurality of moving image constituent images in which the degree of blurring of the object region extracted by the object extracting unit 260 gradually changes. For example, the DCT coefficient averaging unit 228 converts the DCT coefficient of the partial area included in the object area extracted by the object extracting unit 260 according to the degree of blurring indicated by the transition data.

  Based on the transition data acquired by the transition data acquisition unit 212, the same partial area specifying unit 240 is the same as each of a plurality of predetermined partial areas included in an image area other than the blur area of one moving image constituent image. It is specified whether or not the partial area of the image content exists in another moving image constituent image. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the partial region determined by the same partial region specifying unit 240 that there is a partial region having the same image content, the partial region, A motion vector indicating a difference in position from a partial area included in another moving image constituent image having the same image content is calculated. Then, the second moving image configuration image generation unit 282 includes the second moving image configuration including the partial region expressed by the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit 224 and the motion vector calculated by the motion vector calculation unit 250. Generate an image.

  When the moving image generation unit 214 generates an MPEG-encoded moving image in which a plurality of still images change, the first moving image configuration image generation unit 281 uses a first moving image configuration image including a blur change region from at least one still image. A certain I picture is generated. Then, the DCT conversion unit 290 performs DCT conversion for each macroblock included in the I picture generated by the first moving image configuration image generation unit 281 and calculates a DCT coefficient for each macroblock. The DCT coefficient value conversion unit 224 then blurs the DCT coefficient of the macroblock included in the blur region in the I picture generated by the first moving image constituent image generation unit 281 indicated by the transition data acquired by the transition data acquisition unit 212. Convert according to the degree of blur of the area.

  Further, the same partial area specifying unit 240, based on the transition data acquired by the transition data acquiring unit 212, includes a plurality of predetermined macroblocks included in image areas other than the blur areas of a plurality of P pictures or B pictures. Specify whether or not the same partial area of the image content exists in each of the I picture or P picture reproduced before or after the P picture, or the I picture or P picture reproduced before or after the B picture. .

  Based on the transition data acquired by the transition data acquisition unit 212, the motion vector calculation unit 250 is identical to the macroblock that is determined by the same partial region specification unit 240 to have a partial region having the same image content. A motion vector indicating a difference in position from the partial area included in the I picture or P picture that is the image content is calculated. Then, the second moving image configuration image generation unit 282 includes the second moving image configuration including the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit 224 and the macroblock expressed by the motion vector calculated by the motion vector calculation unit 250. A P picture or B picture as an image is generated.

  As described above, the moving image generating apparatus 100 according to the present embodiment can generate a moving image in which various effects are applied to a still image by operating a DCT coefficient. For this reason, the moving image generating apparatus 100 can generate a moving image that has been MPEG encoded at a higher speed than the case where the MPEG encoding is performed after generating the pixel data on which the effect is applied to the still image. Note that the still image in the present embodiment may be an image constituting an animation or a partial image in one image constituting the animation, such as an image of an object included in the animation. Then, the moving image generating apparatus 100 may generate an animation from the plurality of still images. Even in this case, it goes without saying that the moving image generating apparatus 100 can generate the animation at a higher speed than the case where the MPEG encoding is performed after generating the pixel data of the image constituting the animation.

  FIG. 3 shows an example of an operation in which the moving image generation unit 214 reduces an object. The first moving image constituent image generation unit 281 generates an I picture 391 in MPEG encoding from a still image. Then, the object extraction unit 260 extracts the object 390 included in the still image as a reduced area. Hereinafter, taking the macroblock 350 included in the object 390 of the I picture 391 as an example, the moving image generation unit 214 in the case where the object 390 is sequentially reduced to 1/2, 1/4, and 1/8 according to the transition data. An example of the process will be described.

  The macro block 350 includes four blocks 351, 352, 353, and 354 each composed of 8 × 8 pixels. The DCT conversion unit 290 calculates 8 × 8 DCT coefficients for each of the blocks 351, 352, 353, and 354. In this figure, the arrangement of 8 × 8 DCT coefficients in each block is such that the DCT coefficient of the higher frequency component in the X direction is located further to the right, and the DCT coefficient of the higher frequency component in the Y direction is further downward. Shall be located. For example, the DC components of the DCT coefficients of the blocks 351, 352, 353, and 354 are the DCT coefficients 321, 322, 323, and 324 located at the upper left, respectively.

  The case where the moving image generation unit 214 generates the B picture 392 by reducing the size of the object 390 by 1/2 in the X direction and the Y direction will be described. The inverse DCT transform pixel selection unit 232 includes blocks 351, 352, Among the eight DCT coefficients indicating different frequency components in the X direction and the Y direction included in the blocks 353 and 354, the DCT coefficient of the lower frequency component in each direction is a number of 1/2 (4 Only one). In the example of this figure, the DCT coefficients in the frames 301, 302, 303, and 304 include frequency components for four pixels in order of decreasing frequency in the X and Y directions. The DCT coefficients in these frames 301, 302, 303, and 304 are selected by the inverse DCT transform pixel selection unit 232, and the DCT coefficients in the selected frames 301, 302, 303, and 304 are converted into the inverse DCT transform unit 230. Are subjected to inverse DCT transform, thereby generating pixel data 362 of an image obtained by reducing the image of the block 350 to ½.

  Similarly, when the moving image generation unit 214 generates the B picture 393 by reducing the size of the object 390 to 1/4 in the X direction and the Y direction, the inverse DCT transform pixel selection unit 232 uses the DCT coefficients for two pixels. The two DCT coefficients in each of the frames 311, 312, 313, and 314 including the selected DCT coefficients in the frames 311, 312, 313, and 314 are respectively inverse DCT transformed by the inverse DCT transform unit 230. As a result, the pixel data 364 of the image in which the macroblock 350 is reduced to ¼ is generated. When the moving image generation unit 214 generates the B picture 394 by reducing the size of the object 390 to 1/8 in the X direction and the Y direction, the inverse DCT conversion pixel selection unit 232 performs DCT indicating a DC component. The coefficients 321, 322, 323, and 324 are selected to generate pixel data 366 of an image in which the macroblock 350 is reduced to 1/8 from the selected DCT coefficients.

  In addition, when generating pixel data of an image reduced to ¼ in the B picture 393, the image including the pixel data 362 generated in the B picture 392 may be generated by reducing it to ½. . In this case, the pixel data may be generated from the DCT coefficient of the I picture 391 by a method similar to the method of generating pixel data in which the object 390 is reduced to ½ in the B picture 392. That is, among the DCT coefficients of the pixel data 362 in the B picture 392, the DCT coefficients included in the frames 331, 332, 333, and 334 including the DCT coefficients of the four low frequency components in the X direction and the Y direction, respectively, are inverse DCT. The 1/4 pixel data 365 may be generated by conversion.

  In the above description, the case of generating a moving image reduced at a reduction rate of 1/2 has been described. However, the moving image generation unit 214 uses the same method to reduce the reduction rate with 1/8 as the minimum unit from an I picture. A moving image that is being reduced can be generated by manipulating the DCT coefficients. In addition, the moving image generation unit 214 can generate a moving image that is reduced at a reduction rate of 1/8 as a minimum unit between consecutive pictures by operating a DCT coefficient. As described above, the moving image generating apparatus 100 can generate a moving image in which the object is reduced by operating the DCT coefficient calculated when generating the I picture.

  FIG. 4 shows an example of an operation in which the moving image generation unit 214 enlarges the object. Also in this figure, the first moving image constituent image generation unit 281 generates an I picture 491 from a still image, as described with reference to FIG. In the example of this figure, the second moving image composition image generation unit 282 generates B pictures 492 and 493 in which the object 390 extracted as the enlargement area by the object extraction unit 260 is enlarged two times and four times, respectively.

  The second moving image constituent image generation unit 282 generates images 381 and 382 obtained by enlarging the object 390 twice and four times, and specifies the positions of the contour lines in the B pictures 492 and 493 of the image 381 and the image 382. And the 2nd moving image structure image generation part 282 specifies the macroblock (for example, macroblock 441 and 451) which cross | intersects the outline. Then, the second moving image configuration image generation unit 282 enlarges the image of the macroblock (for example, the macroblock 421 and the macroblock 431) in the I picture 491 at the same position as the macroblock that intersects the contour line, and the object 390. 381 and the image 382 are combined to generate an image of a macroblock that intersects the contour line.

  In addition, when generating the B picture 492, the second moving image configuration image generation unit 282 calculates the ratio of the area occupied by the object 390 included in the macroblock 441 to the macroblock 441 from the position of the contour line of the image 381. To do. Then, when the calculated ratio is smaller than a predetermined reference ratio (for example, 50%), the second moving image constituent image generation unit 282 converts the image content of the macroblock 441 to the difference image data from the image of the macroblock 421. And 0 motion vectors. As described above, the second moving image constituent image generation unit 282 can expect a higher compression ratio by specifying the positions of the contour lines of the images 381 and 382 in the macroblock based on the enlargement ratio of the object 390. As for the macroblock, a moving image can be efficiently generated by taking a difference image signal from the image content of the macroblock at an appropriate position.

  FIG. 5 shows an example of an operation in which the moving image generation unit 214 rotates the object. The object extraction unit 260 extracts the object 390 as a rotation area. The first moving image constituent image generation unit 281 generates an I picture 591 in MPEG encoding from a still image. Hereinafter, the conversion process performed by the DCT coefficient arrangement conversion unit 222 on the DCT coefficients of the macroblock 550 included in the object 390 of the I picture 591, and the second moving image configuration image generation unit 282 includes the macroblocks 1 to 1 in the object 390. The process of rearranging the blocks included in 12 will be described as an example. In this example, an example is shown in which the transition data acquisition unit 212 acquires transition data that sequentially rotates the object 390 by 90 degrees clockwise. In the example of this figure, it is assumed that the center of rotation 580 is located at the boundary between the macroblocks 6 and 7.

  The DCT coefficient arrangement 511a is an example of a DCT coefficient obtained by performing DCT conversion on the block 511 of each macroblock 1. The DCT coefficient arrangement 511a is shown in the same arrangement as the DCT coefficient arrangement described with reference to FIG. Specifically, c00 is a DC component of the DCT coefficient, and c01, c02... Are 0th-order components in the Y direction, and primary, secondary,. Show. When generating the B picture 592, the DCT coefficient arrangement conversion unit 222 performs the (n, m) order DCT coefficient in the (X, Y) direction and the (X, Y) direction with respect to the arrangement 511 a (m , N) Swap the position with the next DCT coefficient. For example, the DCT coefficient arrangement conversion unit 222 swaps the position of the DCT coefficient value c10 and the position of the value c01. Then, the DCT coefficient arrangement conversion unit 222 obtains an arrangement 511b indicating the DCT coefficients of the image rotated in the block by reversing the sign of the DCT coefficients at odd-order positions in the X direction after the replacement. .

  Then, the second moving image configuration image generation unit 282 rearranges the positions so that the blocks in the macroblocks 1 to 12 rotate 90 ° with respect to the center point 580. Specifically, the second moving image composing image generation unit 282 positions each macro block at a position moved by 90 ° with respect to the center point 580. Further, the second moving image configuration image generation unit 282 rotates the position of each block included in each macroblock by 90 ° clockwise with respect to the center of the macroblock. As described above, the moving image generation unit 214 generates the B picture 592 by rearranging or transcoding DCT coefficients in the block and rearranging the position of the block.

  The operation of the moving image generation unit 214 when generating the B pictures 593 and 594 is an operation of rotating the object 390 from the B pictures 592 and 593 by 90 ° in the clockwise direction, and generates the B picture 592 from the I picture 591. Since the operation is the same as that in this case, the description thereof is omitted. In the example of this figure, an example of the operation of the moving image generation unit 214 when the object is rotated clockwise by 90 ° units has been described. Needless to say, the rotation of the object can be expressed by replacement or code conversion and rearrangement of the block positions. In addition, the unit of the rotation angle is not limited to 90 °, and may be rotation in units of multiples of 90 ° such as 180 ° and 270 °. Needless to say, even with such rotation, the rotation of the object can be expressed by rearranging or transforming the DCT coefficients in the block and rearranging the positions of the blocks.

  As described above, the moving image generating apparatus 100 can calculate the DCT coefficient of the image obtained by rotating the object by rearranging or transcoding the DCT coefficients in the block and rearranging the block positions. For this reason, the moving image generating apparatus 100 can generate a moving image in which the object rotates at a higher speed than when the pixel data obtained by rotating the object is generated and then the DCT conversion is performed.

  FIG. 6 illustrates an example of an operation in which the moving image generation unit 214 performs mirror display conversion of an object. In the example of this figure, the moving image generating unit 214 generates a moving image obtained by performing mirror display conversion on the mirror axis 680 parallel to the Y axis, on the object 390 extracted by the object extracting unit 260. In this case, the mirror display conversion for the object 390 is mirror display conversion in the X-axis (horizontal) direction. The arrangement of the macroblocks 1 to 12, the arrangement of the blocks included in the macroblocks 1 to 12, and the arrangement 511a of the DCT coefficients are the same as the respective arrangements described with reference to FIG. To do.

  The processing for the arrangement 511a of the DCT coefficient arrangement conversion unit 222 when generating the B picture 692 will be described as an example. The DCT coefficient arrangement conversion unit 222 performs the odd-order DCT coefficient ( For example, by reversing the sign of c01, c03, c05, c07, c11, c13...), The arrangement 611b indicating the DCT coefficients mirror-transformed in the block is obtained. Then, the second moving image configuration image generation unit 282 rearranges the positions of the blocks so that the positions of the blocks included in the macroblocks 1 to 12 are positioned at the target positions with respect to the mirror axis 680. As described above, the moving image generation unit 214 can calculate the DCT coefficient by code conversion of the DCT coefficient in the block and rearrangement of the position of the block.

  In the example of this figure, the case where the horizontal mirror display conversion is performed on the mirror axis 680 parallel to the Y axis has been described for the object, but the vertical mirror display conversion for the mirror axis parallel to the X direction is also described. The DCT coefficient can be calculated by code conversion of the DCT coefficient and rearrangement of the block positions. Specifically, the vertical mirror display conversion is performed by converting the sign of the odd-order component with respect to the Y direction of the DCT coefficient of each block and rearranging the arrangement so that each block is located at a symmetrical position with respect to the mirror axis. The DCT coefficient at can be calculated. In addition, the moving image generation unit 214 may perform mirror display conversion in both the X direction and the Y direction. For example, the mirror display conversion may be a mirror display conversion related to a target position with respect to a specific point. Even in this case, the code conversion of the DCT coefficient in the block is performed on the odd-order components in the X direction and the Y direction, and the mirror display conversion is performed on the object by rearranging the position of the block with respect to the symmetry point. The DCT coefficient of the image can be calculated.

  As described above, the moving image generating apparatus 100 calculates the DCT coefficient when the object is subjected to mirror display conversion by reversing the sign of the DCT coefficient in the block and rearranging the block. For this reason, the moving image generating apparatus 100 can generate a moving image in which the object is mirror-changed at a higher speed than when pixel data obtained by mirror-converting an object is generated and then subjected to DCT conversion.

  FIG. 7 shows an example of an operation in which the moving image generation unit 214 changes the color of the object. In the example of this figure, the moving image generation unit 214 generates a moving image in which the color of the object 390 extracted by the object extraction unit 260 becomes lighter with time. Hereinafter, conversion of DCT coefficients for the color difference signals Cr and Cb of the macroblock 1 included in the object 390 will be described as an example. Note that the arrangement of DCT coefficients in this figure is the same as the arrangement of DCT coefficients described in relation to FIG. 5, and the DCT coefficient at the left side indicates a lower-order DCT coefficient in the X direction. The upper position DCT coefficient indicates a lower order DCT coefficient in the Y direction.

  The DCT coefficient color difference conversion unit 226 converts the DCT coefficient of each picture from the B picture 792 to the B picture 799 so that the color difference signals Cr and Cb indicated by the DCT coefficient go to 0. For example, the DCT coefficient color difference conversion unit 226 calculates the amount of change in the DCT coefficient in each picture so that the DCT coefficients for the macroblocks included in the object 390 in the B picture 799 are all zero. For example, assuming that the number of pictures ranging from the I picture 591 to the B picture 799 is N, the change amount Δf00 per picture of the DC component of the DCT coefficient of the color difference signal Cr for the macroblock 1 per picture Δf00 = −f00 / N Is calculated. Similarly, for the DC component g00 of the DCT coefficient for the color difference signal Cb, a change amount Δg00 per picture of the DC component is calculated. Are sequentially changed by Δf00 and Δg00 for the DC component of the DCT coefficient at the position of the macroblock 1 of the pictures 792, 793... Displayed at the timing between the I picture 591 and the B picture 799. Similarly, the DCT coefficient color difference conversion unit 226 calculates the change amount of the DCT coefficient between consecutive pictures for the AC components of the DCT coefficients for the color difference signals Cr and Cb, and sequentially changes the calculated change amount. Let

  In the example of this figure, the case where the effect of fading the color from the object has been described, but various color changes can be expressed by arbitrarily changing the DCT coefficients for the color difference signals Cr and Cb. Needless to say, you can. For example, contrary to the example of this figure, the size of the DCT coefficients of the color difference signals Cr and Cb may be increased to generate a moving image in which colors appear from an uncolored object. In addition, the DCT coefficient color difference conversion unit 226 sequentially increases the magnitude of the DCT coefficient for the color difference signal Cb, thereby enhancing the blue intensity or the blue spatial color change for the object. It is also possible to generate a movie with the effect of going on.

  In the example of this figure, the DCT coefficient conversion for the color difference signals Cr and Cb has been described. However, the DCT coefficient for the luminance signal may be changed simultaneously with the conversion of the DCT coefficient for the color difference signals Cr and Cb. . For example, the moving image generation unit 214 further increases the size of the DC component of the DCT coefficient for the luminance signal and decreases the size of the AC component, so that the color of the object turns to one white color. You can also create a moving video.

  As described above, the moving image generation unit 214 can apply an effect of decreasing the color to the object by decreasing the size of the DCT coefficient for the color difference signals Cr and Cb. For this reason, the moving image generating apparatus 100 can generate a moving image at a higher speed than the case where the pixel data in which the color of the object is changed is generated for each picture and then the DCT conversion is performed.

  FIG. 8 shows an example of an operation in which the moving image generation unit 214 performs blurring processing on an object. In the example of this figure, the moving image generating unit 214 generates a moving image that performs mosaic processing on the object 390 extracted by the object extracting unit 260. Hereinafter, a case where DCT coefficients for the luminance signals of the macroblocks 1, 2, 5, and 6 included in the object 390 are converted will be described as an example. In this figure, an image 891 indicates an image in a range indicated by macroblocks 1, 2, 5, and 6 in the I picture 591. Note that the arrangement of DCT coefficients in this figure is the same as the arrangement of DCT coefficients described in relation to FIG. The upper position DCT coefficient indicates a lower order DCT coefficient in the Y direction.

  The DCT coefficient value conversion unit 224 decreases the size of the DCT coefficient in order from the high frequency component for the DCT coefficient calculated for the I picture 591. For example, in the block 511 included in the image 892 in the B picture, DCT coefficients (for example, c06, c07, c16, c17, etc.) indicating frequency components higher in the X direction than the frequency component indicated by c05 are set to 0, and c50 DCT coefficients (for example, c60, c70, c61, c71, etc.) indicating frequency components higher in the Y direction than the frequency component indicated by 0 are set to zero. Further, the DCT coefficient value conversion unit 224, in the block 511 in the image 893 in the B picture, shows a DCT coefficient (for example, c04, c15, c14, c15, etc.) indicating a higher frequency component in the X direction than the frequency at which c03 was obtained. And DCT coefficients (for example, c40, c50, c41, c51, etc.) indicating frequency components higher in the Y direction than the frequency at which c30 is obtained are set to 0. In the block 511 included in the image 894 in the B picture, DCT coefficients other than the DC component c00 are set to 0. As described above, the DCT coefficient value conversion unit 224 can advance the averaging of the pixel data in the block by gradually cutting the high-frequency component of the DCT coefficient. As a result, the luminance distribution in the block gradually becomes uniform, so that the intensity of the mosaic with each block as a boundary gradually increases.

  Then, the DCT coefficient averaging unit 228 calculates the DC component of the DCT coefficient of each block included in each macroblock of the image 895 in the B picture, and the average value of the DC component of the DCT coefficient of the block included in each macroblock. To do. As a result, since the macroblock 1 has a uniform luminance distribution, a mosaic pattern image having the macroblock as a boundary in the image 895 in the B picture is obtained. Further, the DCT coefficient averaging unit 228 averages the DC components of the DCT coefficients of the blocks included in the macro blocks 1, 2, 5, and 6 in the image 896 in the B picture, and the DC components of the DCT coefficients of the respective macro blocks. Value. As a result, in the B picture 896, an object 390 that has been subjected to mosaic processing with the outlines of the macroblocks 1, 2, 5, and 6 as boundaries is obtained.

  In the above description, mosaic processing is performed by cutting high-frequency components of DCT coefficients for luminance signals or averaging the DCT coefficients of luminance signals in a block or a plurality of macroblocks in a macroblock. explained. In addition, the DCT coefficient value conversion unit 224 performs mosaic processing by cutting high-frequency components of the DCT coefficients for the color difference signals Cr or Cb or by averaging the DCT coefficients for the color difference signals Cr or Cb in a plurality of macro blocks. You may give it. In addition, in the example of this figure, an example in which mosaic processing is performed on an object has been described. However, mosaicing has been performed by arranging pictures so that pictures that have undergone mosaic processing by DCT coefficient conversion are reproduced in reverse order. Needless to say, it is possible to generate a moving image in which the mosaic is solved from the state object.

  As described above, the moving image generation unit 214 cuts the high frequency component of the DCT coefficient for the luminance signal or the color difference signal Cr or Cb, or for a plurality of macroblocks or a plurality of blocks in the macroblock for the luminance signal. By averaging the DCT coefficients, the object can be mosaicked. For this reason, the moving image generating apparatus 100 can generate a moving image that has been subjected to mosaic processing at a higher speed than when generating pixel data obtained by applying mosaic processing to an object and then calculating DCT coefficients by DCT conversion. it can.

  FIG. 9 shows an example of an operation in which the moving image generation unit 214 calculates a motion vector. In the example of this figure, the moving image generating apparatus 100 generates a moving image in which a sun object moves with a still image 900 as a background. The transition data acquisition unit 212 acquires, as transition data, differences in object coordinates (vectors ΔTV 901, 902, 903, and 904) between pictures that are continuously played back, for example. The transition data also includes the initial position of the object. Then, the first moving image constituent image generation unit 281 generates the I picture 931 by superimposing the object image on the initial position of the still image 900.

  Hereinafter, an operation in which the motion vector calculation unit 250 calculates a motion vector will be described by taking as an example a case where the P picture 934 is generated. The same partial area specifying unit 240 calculates an object movement vector V914 indicating a difference in the position of the object from the P picture 934 by sequentially adding each vector ΔTV indicated by the transition data from the I picture 931. To do. In the example of this figure, the object movement vector TV 914 can be expressed by ΔTV 901 + ΔTV 902 + ΔTV 903. The transition data acquisition unit 212 may acquire time-dependent data on the speed of the object, or may calculate an object movement vector in which the object has moved by temporal integration from the I picture 931.

  Further, from the position of the object in the P picture 934, the outline information of the object, and the position of the macro block, the same partial area specifying unit 240 may specify the macro blocks 971, 972, 973, and 974 including the outline of the object. it can. Then, in the area 980 near the boundary between the object and the background in the P picture 934, the same partial area specifying unit 240 uses macroblocks 961, 962, and 963 in which the entire area is included in the object by the object movement vector TV 914, respectively. It is determined that the image content is the same as the partial areas 951, 952, and 953 in the I picture shown.

  In addition, the entire area of the macroblocks 971, 972, 973, and 974 including the outline of the object that exist around the outside of the object (for example, the macroblock 981) is included in the background. The image content of the macroblock whose background is entirely included in the background is the image content of the I picture 931 within the macroblock range (unless an object is included within the macroblock range of the I picture 931). Background image). Therefore, the motion vector calculation unit 250 calculates a motion vector of 0 as a motion vector of a macroblock whose entire region is included in the background. Then, the second moving image constituent image generation unit 282 represents the macroblock by a 0 motion vector and a 0 difference image signal.

  In addition, the second moving image configuration image generation unit 282 generates a macroblock (for example, a macroblock 972) including the outline of the object by synthesizing the background image and the image of the object. For example, the second moving image configuration image generation unit 282 includes an image of the object in the region 991 including the object in the macroblock 972 (for example, the image of the region 941 in the I picture 931) and the range indicated by the macroblock 972 in the I picture 931. The image of the macro block 972 is generated by combining the image of the region 942 other than the object region 991 in the image content.

  In addition, the second moving image configuration image generation unit 282 may represent the image content of the macro block 972 using a difference image and a motion vector. For example, the second moving image configuration image generation unit 282 calculates the area of the object region 991, and the ratio of the area of the region 991 to the area of the macroblock is larger than a predetermined reference ratio (for example, 0.5). In this case, a difference image signal with respect to the partial region 954 of the I picture 931 may be generated, and the image content of the macro block 972 may be expressed by an object movement vector between the generated difference image signal and the macro block. When the ratio of the area of the region 391 to the area of the macroblock is equal to or less than a predetermined reference ratio (for example, 0.5), the second moving image configuration image generation unit 282 is located at the position of the macroblock 972. A difference image signal from the partial area 955 of the I picture 931 is generated, and the image content of the macro block 972 is expressed by the generated difference image signal and a motion vector of 0. As described above, the moving image generating apparatus 100 can easily specify a partial region having similar image contents based on the transition data without performing block matching.

  As described above, the same partial region specifying unit 240 can easily specify macroblocks having the same image content by adding the movement vectors of the objects indicated by the transition data. For this reason, the moving image generating apparatus 100 can generate a moving image at a higher speed than in the case where MPEG encoding is performed after generating pixel data of each picture. In particular, since the moving image generating apparatus 100 can realize a process corresponding to block matching for calculating a motion vector by adding the movement vector of an object, the motion generation apparatus 100 can perform motion compared to a case where a motion vector is calculated by block matching. The vector can be calculated more quickly. Note that the transition data acquisition unit 212 preferably acquires transition data in which the difference between the position of the object in the I picture and the position of the object in the B picture or P picture is a value with 1/2 pixel as the minimum unit. Since the image content of the macroblock included in the object that moves 1/2 pixel in the minimum unit can be expressed by the same motion vector as the object movement vector and the difference image signal of 0, the moving image has a higher compression rate. The video can be compressed at a high speed, and a moving image can be generated at a higher speed.

  In the description of this figure, the method of calculating the motion vector is described by taking the movement of the object as an example. However, the transition data acquisition unit 212 uses the transition data indicating the movement of a part of the area included in the I picture. Needless to say, it may be acquired. Even in such a case, a moving image can be generated at a high speed from the movement of the region based on the transition data by the same method as described with reference to FIG. In addition, the transition data acquisition unit 212 may acquire transition data indicating the movement of the reduction area, the rotation area, the mirror display conversion area, the blur area, and the color change area described with reference to FIGS. In this case, the DCT coefficient of the macroblock included in the moving area indicated by the transition data can be calculated by the operation of the DCT coefficient described with reference to FIGS. In addition, as described in relation to this figure, the motion vector calculation unit 250 uses the motion vector of 0 from the image regions other than the moving region indicated by the transition data acquired by the transition data acquisition unit 212. It is possible to specify a macro block that can express the content.

  FIG. 10 illustrates an example of a hardware configuration of the moving image generating apparatus 100 according to the present embodiment. The moving image generating apparatus 100 includes a CPU peripheral portion including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and communication connected to the host controller 1582 by an input / output controller 1584. An input / output unit having an interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584. .

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505. The communication interface 1530 is connected to the network communication device 1598 to transmit / receive programs or data. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the moving image generating apparatus 100 is started, a program depending on the hardware of the moving image generating apparatus 100, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program executed by the CPU 1505 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is installed in the hard disk drive 1540 from the recording medium, read into the RAM 1520, and executed by the CPU 1505.

  The program executed by the CPU 1505 includes the moving image generating apparatus 100, the instruction input unit 200, the output unit 205, the image storage unit 210, the transition data acquiring unit 212, the moving image generating unit 214, and the object described with reference to FIGS. It functions as the extraction unit 260. The program also includes the moving picture generation unit 214, the DCT coefficient code conversion unit 220, the DCT coefficient arrangement conversion unit 222, the DCT coefficient value conversion unit 224, the DCT coefficient color difference conversion unit 226, the DCT coefficient averaging unit 228, and the inverse DCT conversion. Unit 230, inverse DCT transform pixel selection unit 232, same partial region specification unit 240, motion vector calculation unit 250, first moving image configuration image generation unit 281, second moving image configuration image generation unit 282, and third moving image configuration image generation unit 283 , DCT conversion section 290, DCT coefficient quantization section 292, and encoding section 294.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the moving image generation device 100 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

It is a figure which shows an example of the utilization environment of the moving image production | generation apparatus 100 which concerns on one Embodiment. 2 is a diagram illustrating an example of a block configuration of a moving image generating apparatus 100. FIG. It is a figure which shows an example of the operation | movement which the moving image production | generation part 214 reduces an object. It is a figure which shows an example of the operation | movement which the moving image production | generation part 214 expands an object. It is a figure which shows an example of the operation | movement which the moving image production | generation part 214 rotates an object. It is a figure which shows an example of the operation | movement which the moving image production | generation part 214 carries out mirror display conversion of the object. It is a figure which shows an example of the operation | movement which the moving image production | generation part 214 changes the color of an object. It is a figure which shows an example of the operation | movement which the moving image production | generation part 214 performs a blurring process with respect to an object. It is a figure which shows an example of the operation | movement which the moving image production | generation part 214 calculates a motion vector. An example of the hardware configuration of the moving image generating apparatus 100 is shown.

Explanation of symbols

100 movie generating device 110 imaging device 130 DVD
170 Digital Photoshop 190 User 200 Instruction Input Unit 205 Output Unit 210 Image Storage Unit 212 Transition Data Acquisition Unit 214 Movie Generation Unit 220 DCT Coefficient Code Conversion Unit 222 DCT Coefficient Arrangement Conversion Unit 224 DCT Coefficient Value Conversion Unit 226 DCT Coefficient Color Difference Conversion Unit 228 DCT coefficient averaging unit 230 Inverse DCT conversion unit 232 Inverse DCT conversion pixel selection unit 240 Same partial region specifying unit 250 Motion vector calculation unit 260 Object extraction unit 281 First moving image configuration image generation unit 282 Second moving image configuration image generation unit 283 Third moving image constituent image generation unit 290 DCT conversion unit 292 DCT coefficient quantization unit 294 encoding unit

Claims (10)

A moving image generating device that generates a moving image in which a still image changes,
A transition data acquisition unit that acquires transition data indicating how to change a blurring degree of a blur region that is at least a part of a still image in a plurality of continuous video composition images included in the video;
Based on the transition data acquired by the transition data acquisition unit, a moving image generating unit that generates a compressed moving image including a plurality of moving image constituent images in which the blurring degree of the blur region gradually changes,
The moving image generation unit
A first moving image component image generating unit that generates a first moving image component image including a blur region from at least one still image;
A DCT conversion unit that performs DCT conversion on each partial region included in the first moving image constituent image generated by the first moving image constituent image generation unit and calculates a DCT coefficient for each partial region;
The DCT coefficient of the partial area included in the blur area in the first moving image constituent image generated by the first moving picture constituent image generation unit is determined according to the blurring degree of the blur region indicated by the transition data acquired by the transition data acquiring unit. A DCT coefficient value conversion unit for conversion;
A second moving image composing image generating unit that generates a second moving image composing image to be reproduced before or after the first moving image composing image, using the DCT coefficient of the blur region converted by the DCT coefficient value converting unit; apparatus. In the DCT coefficient value conversion unit, the transition data acquired by the transition data acquisition unit indicates the DCT coefficient of the partial region included in the blurred region in the second moving image configuration image generated by the second moving image configuration image generation unit. Further conversion according to the degree of blur in the blur area,
The second moving image composing image generation unit further generates a third moving image composing image to be reproduced before or after the second moving image composing image, using the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit. Item 4. The moving image generating device according to Item 1. The DCT coefficient value conversion unit calculates the DCT coefficient of the blur region of the second moving image constituent image by reducing a high frequency component equal to or higher than the first level of the DCT coefficient of the blur region of the first moving image constituent image, Calculating a DCT coefficient of the blur region of the third moving image constituent image by reducing a high frequency component equal to or higher than a second level smaller than the first level of the DCT coefficient of the blur region of the second moving image constituent image;
The said 2nd moving image structure image generation part produces | generates the 1st moving image structure image, the 2nd moving image structure image, and the 3rd moving image structure image from which the blurring degree of a blurring area becomes large gradually or becomes small. Video generator. The moving image generation unit
The DCT coefficients of the partial regions included in the blurred region of the second moving image constituent image generated by the second moving image constituent image generation unit are averaged over a plurality of partial regions included in the plurality of first partial blurred regions obtained by dividing the blurred region. A DCT coefficient averaging unit for converting to
A DCT coefficient averaged by the DCT coefficient averaging unit is used as a DCT coefficient of a plurality of partial areas included in the first partial blurring area to generate a fourth moving picture constituent image that is reproduced before or after the second moving picture constituent image. The moving image generating apparatus according to claim 1, further comprising a third moving image constituent image generating unit. The DCT coefficient averaging unit sets a DCT coefficient of a partial region included in a blur region of the fourth moving image constituent image generated by the third moving image component image generating unit to be larger than the first partial blur region. Further averaged over multiple subregions contained in
The third moving image composing image generating unit reproduces the DCT coefficients averaged by the DCT coefficient averaging unit as DCT coefficients of a plurality of partial regions included in the second partial blurring region before or after the fourth moving image composing image. The moving image generating apparatus according to claim 4, wherein the moving image generating image is generated. An object extraction unit that extracts an area of a predetermined object in the still image as a blur area;
The moving image generation apparatus according to claim 1, wherein the moving image generation unit generates a compressed moving image including a plurality of moving image constituent images in which the degree of blurring of the object region extracted by the object extraction unit gradually changes. Based on the transition data acquired by the transition data acquisition unit, a partial region having the same image content as each of a plurality of predetermined partial regions included in an image region other than the blur region of one moving image constituent image, The same partial region specifying unit for specifying whether or not it exists in another moving image constituent image;
Based on the transition data acquired by the transition data acquisition unit, the partial area determined by the same partial area specifying unit to have a partial area having the same image content, and another moving image having the same image content as the partial area A motion vector calculation unit that calculates a motion vector indicating a difference in position between the partial areas included in the constituent images;
Further comprising
The second moving image composing image generating unit includes a second moving image composing image including a DCT coefficient of the blur region converted by the DCT coefficient value converting unit and a partial region expressed by a motion vector calculated by the motion vector calculating unit. The moving image generating device according to claim 1 to generate. The moving image generating unit generates an MPEG encoded moving image in which a plurality of still images change,
The first moving image composing image generating unit generates an I picture that is a first moving image composing image including a blur change region from at least one still image,
The DCT conversion unit performs DCT conversion for each macroblock included in the I picture generated by the first moving image configuration image generation unit to calculate a DCT coefficient for each macroblock,
The DCT coefficient value conversion unit includes a DCT coefficient of a macroblock included in a blur region in an I picture generated by the first moving image configuration image generation unit, in a blur region indicated by the transition data acquired by the transition data acquisition unit. Convert according to the degree of blur,
The same partial area specifying unit, based on the transition data acquired by the transition data acquisition unit, each of a plurality of predetermined macroblocks included in an image area other than the blur area of a plurality of P pictures or B pictures Specify whether or not there is a partial area of the same image content as the I picture or P picture reproduced before the P picture, or the I picture or P picture reproduced before or after the B picture,
The motion vector calculation unit, based on the transition data acquired by the transition data acquisition unit, the macroblock that the same partial region specification unit has determined that there is a partial region of the same image content, and the same macroblock Calculating a motion vector indicating a difference in position from a partial region included in an I picture or P picture as image content;
The second moving image composing image generating unit is a second moving image composing image including a DCT coefficient of the blur region converted by the DCT coefficient value converting unit and a macro block expressed by a motion vector calculated by the motion vector calculating unit. The moving image generating apparatus according to claim 7, wherein a certain P picture or B picture is generated. A video generation method for generating a video in which a still image changes,
A transition data acquisition stage for acquiring transition data indicating how to change the blurring degree of a blur region that is at least a partial region of a still image in a plurality of continuous video composition images included in a video;
A moving image generating step for generating a compressed moving image including a plurality of moving image constituent images in which the blurring degree of the blur region gradually changes based on the transition data acquired in the transition data acquiring step;
The video generation stage includes
A first moving image composing image generating step of generating a first moving image composing image including a blur region from at least one still image;
A DCT conversion step of performing DCT conversion for each partial region included in the first moving image constituent image generated in the first moving image constituent image generation step to calculate a DCT coefficient for each partial region;
The DCT coefficient of the partial area included in the blurring area in the first moving image constituent image generated in the first moving picture constituent image generation step is set to the blurring degree of the blurring region indicated by the transition data acquired in the transition data acquisition step. DCT coefficient value conversion stage to convert in response,
A moving image having a second moving image constituent image generating step of generating a second moving image constituent image to be reproduced before or after the first moving image constituent image by using the DCT coefficient of the blurred region converted in the DCT coefficient value converting step; Generation method. A program for a moving image generating device that generates a moving image in which a still image changes, wherein the moving image generating device includes:
A transition data acquisition unit that acquires transition data indicating how to change a blurring degree of a blur region that is at least a partial region of a still image in a plurality of continuous video constituent images included in a video;
Based on the transition data acquired by the transition data acquisition unit, function as a moving image generation unit that generates a compressed moving image including a plurality of moving image constituent images in which the blurring degree of the blur region gradually changes,
The moving image generation unit
A first moving image component image generating unit that generates a first moving image component image including a blur region from at least one still image;
A DCT conversion unit that performs DCT conversion for each partial region included in the first moving image constituent image generated by the first moving image constituent image generation unit and calculates a DCT coefficient for each partial region;
The DCT coefficient of the partial area included in the blur area in the first moving image constituent image generated by the first moving picture constituent image generation unit is determined according to the blurring degree of the blur region indicated by the transition data acquired by the transition data acquiring unit. DCT coefficient value conversion unit for conversion,
A program that functions as a second moving image constituent image generation unit that generates a second moving image constituent image that is reproduced before or after the first moving image constituent image by using the DCT coefficient of the blur region converted by the DCT coefficient value conversion unit.