JP2007095010A - Moving picture generating device, moving picture generation method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To effectively generate a moving picture presenting the changes in still images. <P>SOLUTION: The moving picture generating device for generating a moving picture, which a plurality of still images change, comprises an acquisition part for acquiring transition data, presenting how the boundary line of the first still image and second still image are moved in the moving picture; a DCT conversion part for conducting DCT conversion on the first and second still images, and calculating a DCT coefficient of a partial region; a boundary part region specifying part for specifying whether the plurality of the partial regions included in one moving picture constructed image intersects with the boundary line of the first and second still images, on the basis of the transition data acquired by the acquisition part; a partial region image generation part for generating the DCT coefficient of the partial region determined as being that the region intersects with the boundary line from the DCT coefficient of the partial regions in the first and second still images existing in a periphery of the boundary line; and a moving picture constructed image generation part for generating the moving image constructed image, containing the DCT coefficient of the partial region generated by the partial region image generation part. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a moving image generating apparatus, a moving image generating method, and a program. In particular, the present invention relates to a moving image generation device and a moving image generation method for generating a moving image from a still image, and a program for the moving image generation device.

In a system that generates and records moving image data from multiple still image data provided by customers, it generates moving image data in which still images are switched by adding difference data indicating still image switching to the still image data. The system which performs is known (for example, refer patent document 1). With this technology, a user can easily browse a photographic image using a home video playback device such as a DVD player or a computer terminal such as a personal computer.
JP 2003-259303 A

  However, Patent Document 1 does not disclose a specific technique for efficiently generating a moving image indicating image switching. For example, in Patent Document 1, moving image data indicating transition of a still image, such as movement, enlargement / reduction, rotation, change in color tone, fade-in / fade-out of a still image, and mosaic display for a still image, is disclosed in Patent Document 1. A specific technique for efficiently generating is not disclosed.

  Then, an object of this invention is to provide the moving image production | generation apparatus, moving image production | generation method, and program which can solve said subject. This object is achieved by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention.

  According to the first aspect of the present invention, there is provided a moving image generating apparatus that generates a moving image in which a plurality of still images change, and how to move a boundary line between the first still image and the second still image in the moving image. Based on the transition data acquired by the transition data acquisition unit that acquires the transition data shown, and the transition data acquisition unit, a plurality of video composition images are generated from the still image, and a video including the generated plurality of video configuration images is generated A moving image generating unit that performs DCT conversion on the first still image and the second still image, and calculates DCT coefficients of a plurality of partial regions included in the first still image and the second still image. A plurality of predetermined partial areas included in one moving image constituent image based on the transition data acquired by the DCT conversion unit and the transition data acquisition unit. A boundary partial region specifying unit that specifies whether or not the boundary between the first still image and the second still image intersects, and a DCT coefficient of the partial region that the boundary partial region specifying unit determines to cross the boundary DCT coefficients calculated by the DCT transform unit for the partial region in the first still image existing in the vicinity of the line, and DCT coefficients calculated by the DCT transform unit for the partial region in the second still image present in the vicinity of the boundary line A partial region image generation unit that generates a moving image composition image including a DCT coefficient of the partial region generated by the partial region image generation unit.

  The moving image generation unit, based on the transition data acquired by the transition data acquisition unit, a partial region that the boundary partial region specifying unit determines not to cross the boundary line, and a still image or the same image content as the partial region It further has a motion vector calculation unit that calculates a motion vector indicating a difference in position from a partial region included in another moving image configuration image, and the moving image configuration image generation unit is a motion vector calculated by the motion vector calculation unit. You may produce | generate the moving image structure image containing the DCT coefficient of the partial area | region expressed and the partial area | region which the partial area image generation part produced | generated.

  The partial region image generation unit determines the DCT coefficient of the partial region that the boundary partial region specifying unit has determined to cross the boundary line, the DCT coefficient of the partial region of the first still image existing in the vicinity of the boundary line, and the vicinity of the boundary line. May be generated by averaging the DCT coefficients of the partial regions in the second still image existing for each frequency component.

  The partial region image generation unit calculates the DCT coefficient of the partial region determined by the boundary partial region specifying unit to intersect the boundary line, the DCT coefficient of the partial region in the first still image existing in the vicinity of the boundary line, and the boundary line The DCT coefficients of the partial regions in the second still image existing in the vicinity may be generated by weighting and averaging based on the transition data acquired by the transition data acquisition unit.

  The partial region image generation unit calculates the DCT coefficient of the partial region that is determined that the boundary partial region specifying unit intersects the boundary line in each of the plurality of moving image constituent images, based on the transition data acquired by the transition data acquisition unit A plurality of moving images in which a DCT coefficient of a partial region in the first still image existing in the vicinity of the boundary line and a DCT coefficient of the partial region in the second still image existing in the vicinity of the boundary line Each of the constituent images may be generated by averaging with different weights.

  The moving image generation unit calculates a boundary partial region area calculation that calculates the area of the first still image included in the partial region that the boundary partial region specifying unit determines to cross the boundary line based on the transition data acquired by the transition data acquisition unit And the partial region image generation unit weights the DCT coefficients of the partial regions in the first still image more heavily when the area of the first still image calculated by the boundary partial region area calculation unit is larger. Thus, the DCT coefficient of the partial region determined that the boundary partial region specifying unit intersects the boundary line may be calculated.

  The transition data acquisition unit acquires transition data indicating the movement of the first still image with respect to the second still image, and the boundary partial area specifying unit converts the transition data indicating the movement of the first still image acquired by the transition data acquisition unit. Based on this, it is determined whether or not a plurality of predetermined partial areas included in one moving image constituent image intersect the boundary line between the first still image and the second still image, and the partial area image generation unit The DCT coefficient of the partial area determined by the boundary partial area specifying unit to intersect the boundary line is the DCT coefficient of the partial area in the first still image existing in the vicinity of the boundary line and the second DCT coefficient existing in the vicinity of the boundary line. You may generate from the DCT coefficient of the partial area | region in a still image.

  The moving image generating unit generates an MPEG encoded moving image in which a plurality of still images change, and the boundary partial area specifying unit is included in advance in one moving image constituent image based on the transition data acquired by the transition data acquiring unit. It is determined whether or not a plurality of defined macroblocks intersect the boundary line between the first still image and the second still image, and the partial region image generation unit detects that the boundary partial region identification unit intersects the boundary line The determined DCT coefficient of the macroblock is obtained by calculating the frequency of the DCT coefficient of the macroblock in the first still picture existing in the vicinity of the boundary line and the DCT coefficient of the macroblock in the second still picture existing in the vicinity of the boundary line. You may produce | generate by averaging for every component.

  The motion vector calculation unit, based on the transition data acquired by the transition data acquisition unit, the macro block determined that the boundary partial region specifying unit does not cross the boundary line, and a still image having the same image content as the macro block Alternatively, a motion vector indicating a difference in position from a partial region included in another moving image configuration image is calculated, and the moving image configuration image generation unit is a macroblock expressed by the motion vector calculated by the motion vector calculation unit, and You may generate the moving image structure image containing the DCT coefficient of the macroblock which the partial area image generation part produced | generated.

  Based on the transition data acquired by the transition data acquisition unit, the moving image configuration image generation unit generates an I picture generation unit from the still image as an I picture, and the transition data and I picture acquired by the transition data acquisition unit And a P picture generation unit that generates a moving picture constituent image as a P picture based on the I picture generated by the generation unit, and the motion vector calculation unit generates a boundary portion based on the transition data acquired by the transition data acquisition unit. Indicates a difference in position between a macroblock that the area specifying unit has determined not to cross the boundary and a partial area included in the I picture generated by the I picture generation unit that has the same image content as the macroblock. The motion vector is calculated, and the P picture generation unit The video configuration images comprising macroblocks represented by calculated motion vectors may be generated as a P-picture.

  The moving image composition image generation unit generates the moving image composition image as a B picture based on the transition data acquired by the transition data acquisition unit and the I picture generated by the I picture generation unit or the P picture generated by the P picture generation unit. The motion vector calculation unit further includes a B picture generation unit, and the motion vector calculation unit is the same as the macroblock determined based on the transition data acquired by the transition data acquisition unit, that the boundary partial region specifying unit does not cross the boundary line A motion vector indicating a difference in position between a partial area included in an I picture generated by the I picture generating unit or a P picture generated by the P picture generating unit, Including a macro block represented by the motion vector calculated by the motion vector calculation unit. The video configuration images may be generated as a B-picture.

  According to the second aspect of the present invention, there is provided a moving image generation method for generating a moving image in which a plurality of still images change, and how to move a boundary line between a first still image and a second still image in the moving image. Based on the transition data acquisition stage for acquiring the transition data shown, and the transition data acquired in the transition data acquisition stage, a plurality of video composition images are generated from the still images, and a video including the generated plurality of video composition images is generated. A moving image generation stage for generating, wherein the moving image generation stage performs DCT conversion on the first still image and the second still image, and calculates DCT coefficients of a plurality of partial regions included in the first still image and the second still image. Based on the DCT conversion stage to be calculated and the transition data acquired by the transition data acquisition unit, it is determined in advance that is included in one moving image constituent image. A boundary partial region specifying stage for specifying whether or not a plurality of partial areas cross the boundary line between the first still image and the second still image, and a portion determined to cross the boundary line at the boundary partial region specifying stage The DCT coefficient of the area is converted by the DCT coefficient calculated by the DCT conversion unit for the partial area in the first still image existing in the vicinity of the boundary line and the DCT conversion for the partial area in the second still image existing in the vicinity of the boundary line. A partial area image generation stage generated from the DCT coefficients calculated by the section, and a moving picture constituent image generation stage for generating a moving picture constituent image including the DCT coefficients of the partial areas generated in the partial area image generation stage.

According to a third aspect of the present invention, there is provided a program for a moving image generating apparatus that generates a moving image in which a plurality of still images change. The moving image generating apparatus is configured to display a boundary line between a first still image and a second still image as a moving image. A transition data acquisition unit that acquires transition data indicating how to move the image, and based on the transition data acquired by the transition data acquisition unit, a plurality of video composition images are generated from the still image, and the generated plurality of videos The moving image generation unit functions as a moving image generation unit that generates a moving image including a constituent image, and the moving image generation unit performs DCT conversion on the first still image and the second still image, and includes a plurality of images included in the first still image and the second still image. Based on the transition data acquired by the DCT conversion unit and the transition data acquisition unit for calculating the DCT coefficient of the partial region, the image is included in one moving image constituent image. It is determined that a boundary partial area specifying unit that specifies whether or not a plurality of predetermined partial areas intersects the boundary line between the first still image and the second still image, and the boundary partial area specifying unit intersects the boundary line The DCT coefficients of the partial areas thus obtained are calculated by the DCT conversion unit for the partial areas in the first still image existing in the vicinity of the boundary line and the partial areas in the second still image existing in the vicinity of the boundary line. It functions as a partial region image generation unit generated from the DCT coefficients calculated by the DCT conversion unit, and a moving image configuration image generation unit that generates a moving image configuration image including the DCT coefficients of the partial regions generated by the partial region image generation unit.

  Note that the above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  ADVANTAGE OF THE INVENTION According to this invention, the moving image production | generation apparatus which produces | generates the moving image expressing the transition of a still image efficiently can be provided.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the claimed invention, and all combinations of features described in the embodiments are inventions. It is not always essential to the solution.

  FIG. 1 shows an example of a usage environment of a moving image generating apparatus 100 according to an embodiment. The moving image generating apparatus 100 receives still images 120, 121, 122, 123,... Taken by the user 190 using the imaging device 110, and generates MPEG encoded moving image data 130 such as a slide show. At this time, the moving image generating apparatus 100 processes the still image according to the transition data in which the transition of the still image is defined, such as the motion of the still image, so that one frame to be reproduced between the still image and the still image. A plurality of MPEG-encoded moving picture composition images are generated. In the example of FIG. 1, the moving image generating apparatus 100 generates a moving image that starts from a state in which the still image 121 is displayed and the still image 122 gradually appears from one end of the still image 121.

  For example, the moving image generating apparatus 100 acquires transition data indicating a transition from the still image 121 to the still image 122 by moving the still images 121 and 122. Then, the moving image generating apparatus 100 calculates the moving speed of the still images 121 and 122 from the transition data, and for example, the macroblock in the partial region 143 of the moving image constituent image 133 is converted into the partial region 141 of the still image 121. It specifies that it is the same as the image content of the macroblock. Then, the moving image generating apparatus 100 represents the image content of the macroblock in the region 143 as a motion vector for the macroblock in the region 141. In this case, the moving image generating apparatus 100 calculates a movement vector that the still image 121 has moved as a motion vector. In this way, the moving image generation apparatus 100 generates MPEG encoded moving image data from the transition data without performing complicated processing such as generating all pixel data of each frame image included in the moving image and performing block matching. Can be generated directly.

  Also, the moving image generating apparatus 100 determines the position of the boundary between the still images 121 and 122 in the moving image composition image 133 (for example, the position of the boundary 161 in the moving image composition image 133) from the transition data based on the moving speed of the still images 121 and 122. It can be judged directly. In this case, the moving image generating apparatus 100 generates pixel data in a macro block including a boundary inside by combining the image contents of the images 121 and 122. Then, the moving image generating apparatus 100 calculates DCT coefficients of the macroblock including the boundary by performing DCT conversion on the pixel data in the macroblock obtained by combining. In addition, the moving image generating apparatus 100 adds the DCT coefficients obtained from the macroblocks near the boundary of the still image 121 and the macroblocks near the boundary of the still image 122 to add the image contents of the still images 121 and 122 near the boundary. May be directly calculated.

  The moving image generating apparatus 100 may acquire an instruction from a designer who creates a moving image, a user 190, or the like as transition data, or from moving image generating template data indicating an effect to be added to a still image such as movement of an object. It may be acquired as transition data. The moving image generating apparatus 100 may provide the moving image generated on the user 190 by recording on an optical recording medium such as the DVD 150, or the moving image generated on the user 190 through a communication line such as the Internet. Further, the moving image generating apparatus 100 may receive a still image from the imaging device 110 through a communication line such as the Internet, or may receive a still image recorded on a recording medium such as a semiconductor memory by the imaging device 110. Note that the moving image generation apparatus 100 may be a captured image, or image data created using image processing software or the like other than the captured image. The moving image generating apparatus 100 may be a moving image generating terminal provided in the digital photoshop 170, or a terminal such as a personal computer provided in a private house.

  As described above, according to the moving image generating apparatus 100 of the present embodiment, it is possible to directly determine the data of a macro block having the same image content as the macro block of a still image or another moving image constituent image from the transition data. it can. For this reason, the moving image generating apparatus 100 does not need to generate all the pixel data of the image of each frame included in the moving image. Therefore, the moving image generating apparatus 100 can generate a moving image at a higher speed than the case where MPEG encoding is performed after generating pixel data of each frame included in the moving image. For example, the moving image generating apparatus 100 can significantly reduce the amount of processing corresponding to block matching in MPEG encoding.

  FIG. 2 shows an example of a block configuration in the second embodiment of the moving image generating apparatus 100. The moving image generating apparatus 100 according to the present exemplary embodiment generates a moving image in which a plurality of still images change. The moving image generating apparatus 100 includes an instruction input unit 200, an image output unit 205, an image storage unit 210, a transition data acquisition unit 212, and a moving image generation unit 214. The moving image generation unit 214 includes an object movement vector calculation unit 220, an area movement vector calculation unit 225, an object position specification unit 230, an identical partial region specification unit 240, a motion vector calculation unit 250, a similar partial region specification unit 260, and a partial region image generation. Unit 270, moving image composition image generation unit 280, DCT conversion unit 290, DCT coefficient quantization unit 292, and encoding unit 294. The similar partial region specifying unit 260 includes a boundary partial region area calculating unit 262 and a similar partial region selecting unit 264. Further, the same partial area specifying unit 240 includes a boundary partial area specifying unit 245. The moving image composition image generation unit 280 includes an I picture generation unit 282, a P picture generation unit 284, and a B picture generation unit 286.

  The image storage unit 210 stores a plurality of still images. The transition data acquisition unit 212 acquires transition data indicating how a plurality of still images stored in the image storage unit 210 are changed. Specifically, the transition data acquisition unit 212 acquires an instruction indicating whether the still image input from the user 190 is transferred to the instruction input unit 200. Then, the moving image generation unit 214 generates a plurality of moving image configuration images from the still images stored in the image storage unit 210 based on the transition data acquired by the transition data acquisition unit 212, and generates the generated plurality of moving image configurations. Generate a video that contains an image. Specifically, the moving image generation unit 214 may generate an MPEG encoded moving image in which a plurality of still images stored in the image storage unit 210 change.

  Specifically, the transition data acquisition unit 212 acquires transition data indicating the movement of at least a part of the moving area of the still image stored in the image storage unit 210. The area movement vector calculation unit 225 stores the position of the movement area in one moving image constituent image and the image storage unit 210 based on the transition data indicating the movement of the movement area acquired by the transition data acquisition unit 212. An area movement vector indicating a position difference between the position of the movement area in the still image or the other moving image constituent image is calculated. Then, based on the region movement vector calculated by the region movement vector calculation unit 225, the same partial region identification unit 240 adds all of the predetermined partial regions included in one moving image constituent image to the movement region. It is specified whether or not a partial area having the same image content as each of the partial areas including the range exists in the still image or other moving image constituent image stored in the image storage unit 210.

  Then, the motion vector calculation unit 250 uses the region movement vector calculated by the region movement vector calculation unit 225 as a partial region determined by the same partial region specification unit 240 that there is a partial region having the same image content, the partial region, It is calculated as a motion vector indicating the difference in position between partial images included in still images or other moving image constituent images stored in the image storage unit 210 having the same image content. Then, the moving image configuration image generation unit 280 generates a moving image configuration image including a partial region expressed by the motion vector calculated by the motion vector calculation unit 250. As described above, the moving image composition image generation unit 280 can easily specify a partial region having the same image content as that of another moving image composition image based on the transition data.

  As described above, the same partial region specifying unit 240 is the same image as each of a plurality of predetermined partial regions included in one moving image constituent image based on the transition data acquired by the transition data acquiring unit 212. It is specified whether or not the partial area of the content exists in a still image or another moving image constituent image stored in the image storage unit 210. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the partial region determined by the same partial region specification unit 240 to have a partial region having the same image content, the partial region, A motion vector indicating a position difference between a still image stored in the image storage unit 210 and a partial area included in another moving image constituent image, which is the same image content, is calculated.

  The operation of the same partial region specifying unit 240 will be specifically described. The boundary partial region specifying unit 245 is determined in advance based on the region movement vector calculated by the region movement vector calculating unit 225 and included in one moving image constituent image. In addition, it is specified whether or not the plurality of partial areas intersect the boundary line of the moving area. Then, the same partial region specifying unit 240 determines that the partial region that the boundary partial region specifying unit 245 determines not to intersect the boundary line is a partial region in which a partial image having the same image content exists. In addition, the same partial area specifying unit 240 determines the partial area that the boundary partial area specifying unit 245 determines to intersect the boundary line as the partial area that has been determined that there is no partial image having the same image content. As described above, the boundary partial region specifying unit 245 moves a plurality of predetermined partial regions included in one moving image constituent image based on the transition data indicating the movement of the moving region acquired by the transition data acquiring unit 212. Specify whether to cross the border of the region.

  Then, the partial region image generation unit 270 specifies the position of the moving region in the moving image composition image based on the transition data indicating the movement of the moving region acquired by the transition data acquisition unit 212, and based on the specified position of the moving region. Thus, the image of the moving area that should be included in the partial area that the boundary partial area specifying unit 245 determines to cross the boundary line, and the still image or other moving image stored in the image storage unit 210 within the range of the partial area The image contents of the partial area determined by the boundary partial area specifying unit 245 to intersect the boundary line are generated by combining the image of the area that does not include the moving area in the constituent images. As described above, the partial region image generation unit 270 determines the image of the partial region that the boundary partial region specification unit 245 determines to cross the boundary line based on the transition data indicating the movement of the movement region acquired by the transition data acquisition unit 212. The contents are generated by combining a part of a plurality of partial areas included in the still image or other moving image constituent image stored in the image storage unit 210 and the image of the moving area.

  In addition, the transition data acquisition unit 212 acquires transition data indicating the movement of an object that moves with a still image or another moving image constituent image stored in the image storage unit 210 as a background. Then, based on the transition data indicating the movement of the object acquired by the transition data acquisition unit 212, the object movement vector calculation unit 220 and the position of the object in one moving image constituent image and the still image stored in the image storage unit 210 are stored. An object movement vector indicating a difference in position from the position of the object in the image or other moving image constituent image is calculated. Then, the object position specifying unit 230 specifies the position of the object in the moving image composition image based on the object movement vector calculated by the object movement vector calculation unit 220 and the position of the object in another moving image composition image. Note that the object position specifying unit 230 may specify the position of the object in each of the plurality of video composition images.

  Specifically, the transition data acquisition unit 212 acquires transition data indicating the amount of movement and the temporal change in the movement direction of an object moving with the still image or moving image constituent image stored in the image storage unit 210 as a background. . Then, the object movement vector calculation unit 220 integrates one moving image composition image and the other by temporally integrating the movement amount and the temporal change of the movement direction of the object included in the transition data acquired by the transition data acquisition unit 212. An object movement vector indicating the difference in the position of the object from the moving image composing image is calculated. Specifically, the object position specifying unit 230 specifies the position of the object in the moving image composition image by temporally integrating the movement amount and the temporal change of the moving direction of the object acquired by the transition data acquisition unit 212. . More specifically, the transition data acquisition unit 212 acquires transition data indicating the amount of movement of the object in the x direction and the y direction between the moving image constituent images to be played back continuously, and calculates an object movement vector. The unit 220 calculates an object movement vector by cumulatively adding the movement amounts in the x direction and y direction of the object acquired by the transition data acquisition unit 212. In this way, the object position specifying unit 230 specifies the position of the object in the moving image composition image based on the transition data indicating the movement of the object acquired by the transition data acquiring unit 212.

  Then, the boundary partial area specifying unit 245 determines that the plurality of predetermined partial areas included in one moving image constituent image are the object and the image based on the position of the object in the moving image constituent image specified by the object position specifying unit 230. Whether the storage unit 210 crosses the boundary line with the background still image or another moving image constituent image stored is specified. As described above, the boundary partial area specifying unit 245 determines that the plurality of predetermined partial areas included in one moving image constituent image are the object based on the transition data indicating the movement of the object acquired by the transition data acquiring unit 212. Specifies whether or not to cross the boundary between the background and the background.

  Then, the same partial area specifying unit 240 determines that the partial area that the boundary partial area specifying unit 245 determines not to intersect the boundary line between the object and the background is a partial area in which a partial image having the same image content exists. To do. In addition, the same partial area specifying unit 240 determines the partial area that the boundary partial area specifying unit 245 determines to intersect the boundary line as the partial area that has been determined that there is no partial image having the same image content. Then, the same partial area specifying unit 240, based on the position of the object specified by the object position specifying unit 230 based on the object movement vector, out of a plurality of predetermined partial areas included in one moving image constituent image Then, it is specified whether or not a partial area having the same image content as each of the partial areas including the entire range of the object exists in the still image or other moving image constituent image stored in the image storage unit 210. Then, the motion vector calculation unit 250 uses the partial area determined by the same partial area specifying unit 240 to determine that there is a partial area having the same image content from the object movement vector calculated by the object movement vector calculation unit 220, the partial area, It is calculated as a motion vector indicating the difference in position between partial images included in still images or other moving image constituent images stored in the image storage unit 210 having the same image content.

  In addition, the same partial area specifying unit 240 is based on the position of the object calculated by the object position specifying unit 230 based on the object movement vector, and is selected from a plurality of predetermined partial areas included in one moving image constituent image. Whether a partial area having the same image content as each of the partial areas including the entire range in the background to which the object moves exists in the still image or other moving image constituent image stored in the image storage unit 210. Further specify. Then, the motion vector calculation unit 250 sets the motion vector of the partial region in which the partial region having the same image content is included in the background to the same partial region specifying unit 240.

  The partial area image generation unit 270 then compares the position of the object in the moving image composition image specified by the object position specifying unit 230 and the position of the partial area determined by the boundary partial area specifying unit 245 to intersect the boundary line. By combining the image included in the partial area of the object specified from the above and the background image of the area not including the object among the background images within the range of the partial area, the boundary partial area specifying unit The image content of the partial area determined that 245 intersects the boundary line is generated. In this way, the partial region image generation unit 270 converts the image contents of the partial region that the boundary partial region specification unit 245 determines to intersect the boundary line into transition data indicating the movement of the object acquired by the transition data acquisition unit 212. Based on this, an object and a part of a plurality of partial areas included in a still image or other moving image constituent image stored in the image storage unit 210 are generated.

  In this way, the partial region image generation unit 270 determines the partial region determined by the same partial region specifying unit 240 that there is no partial image having the same image content, based on the transition data acquired by the transition data acquisition unit 212. The image content is generated from a still image or another moving image constituent image stored in the image storage unit 210. Further, the partial area image generation unit 270 determines the image contents of the partial areas determined by the same partial area specification unit 240 based on the transition data acquired by the transition data acquisition unit 212 that there are no partial images having the same image content. , A part of a plurality of partial areas included in a still image or another moving image constituent image stored in the image storage unit 210 is generated in combination.

  The similar partial area specifying unit 260 determines the image content of the partial area that the boundary partial area specifying unit 245 determines to cross the boundary line based on the position of the object in each of the plurality of moving image constituent images specified by the object position specifying unit 230. Other moving image constituent images having partial areas similar to are specified. In this case, the partial area image generation unit 270 includes a motion vector indicating a difference in position between the position of the partial area in one moving image constituent image and the position of the partial area specified by the similar partial area specifying unit 260, and a similar part. The image content of the partial area determined by the boundary partial area specifying unit 245 to intersect the boundary line is represented by the difference image between the partial area specified by the area specifying unit 260 and the partial area in the one moving image constituent image.

  Specifically, the boundary partial area area calculation unit 262 applies the partial area determined by the boundary partial area specification unit 245 to intersect the boundary line based on the position of the object in the moving image composition image specified by the object position specification unit 230. The area of the included object and the area of the background are calculated. The similar partial region selection unit 264 identifies the object position specifying unit 230 when the area of the object calculated by the boundary partial region area calculation unit 262 is larger than the background area calculated by the boundary partial region area calculation unit 262. Based on the position of the object in each of the plurality of moving image constituent images, a partial region similar to the partial region determined by the boundary partial region specifying unit 245 to intersect the boundary line from other moving image constituent images including the image of the object select.

  Further, when the area of the object calculated by the boundary partial area calculation unit 262 is equal to or less than the background area calculated by the boundary partial region area calculation unit 262, each of the plurality of moving image constituent images specified by the object position specifying unit 230 Based on the position of the object in, a partial area including the image that is the background of the partial area determined by the boundary partial area specifying unit 245 to intersect the boundary line is selected from other moving image composition images including the object image. . Then, the partial region image generation unit 270 includes a motion vector indicating a position difference between the position of the partial region in one moving image constituent image and the position of the partial region selected by the similar partial region selection unit 264, and the similar partial region The image content of the partial area determined by the boundary partial area specifying unit 245 to intersect the boundary line is expressed by a difference image between the partial area selected by the selection unit 264 and the partial area in the one moving image constituent image.

  Then, the moving image configuration image generation unit 280 generates a moving image configuration image including the partial area expressed by the motion vector calculated by the motion vector calculation unit 250 and the partial area generated by the partial area image generation unit 270. In addition, the moving image configuration image generation unit 280 generates a moving image configuration image including the partial area expressed by the motion vector calculated by the motion vector calculation unit 250 and the image contents of the partial area generated by the partial area image generation unit 270. . For this reason, the moving image generating apparatus 100 can quickly generate a moving image constituent image without searching by block matching by specifying a macroblock that can be expressed only by a motion vector from the transition data.

  When the moving image generation unit 214 generates an MPEG encoded moving image, the same partial area specifying unit 240 is included in one moving image constituent image based on the transition data acquired by the transition data acquisition unit 212. It is specified whether or not a partial region having the same image content as each of a plurality of predetermined macroblocks exists in a still image or another moving image constituent image stored in the image storage unit 210. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the macro block determined by the same partial region specification unit 240 that there is a partial region having the same image content, the macro block, A motion vector indicating a position difference between a still image stored in the image storage unit 210 and a partial area included in another moving image constituent image, which is the same image content, is calculated. Further, the partial area image generation unit 270 determines the image content of the macroblock that the same partial area specification unit 240 determines that there is no partial image with the same image content based on the transition data acquired by the transition data acquisition unit 212. , A part of a plurality of partial areas included in a still image or another moving image constituent image stored in the image storage unit 210 is generated in combination. Then, the moving image configuration image generation unit 280 generates a moving image configuration image including the macroblocks represented by the motion vectors calculated by the motion vector calculation unit 250 and the macroblocks generated by the partial area image generation unit 270.

  Also, the I picture generation unit 282 generates a moving image constituent image as an I picture from the still image stored in the image storage unit 210 based on the transition data acquired by the transition data acquisition unit 212. Then, the P picture generation unit 284 generates a moving picture composition image as a P picture based on the transition data acquired by the transition data acquisition unit 212 and the I picture generated by the I picture generation unit 282. Then, based on the transition data acquired by the transition data acquisition unit 212, the same partial region specifying unit 240 has a partial region having the same image content as each of a plurality of predetermined macroblocks included in one moving image constituent image. Is present in the I picture generated by the I picture generating unit 282.

  Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the macro block determined by the same partial region specification unit 240 that there is a partial region having the same image content, the macro block, A motion vector indicating a difference in position with a partial region included in the I picture generated by the I picture generation unit 282 having the same image content is calculated. Then, the P picture generation unit 284 generates, as a P picture, a moving picture constituent image that includes the macro block expressed by the motion vector calculated by the motion vector calculation unit 250 and the macro block generated by the partial area image generation unit 270. In addition, the B picture generation unit 286 generates a moving image constituent image based on the transition data acquired by the transition data acquisition unit 212 and the I picture generated by the I picture generation unit 282 or the P picture generated by the P picture generation unit 284. Generated as a B picture.

  Specifically, the same partial area specifying unit 240 has the same image content as each of a plurality of predetermined macroblocks included in one moving image constituent image based on the transition data acquired by the transition data acquiring unit 212. Is specified in the I picture generated by the I picture generating unit 282 or the P picture generated by the P picture generating unit 284. Then, the motion vector calculation unit 250, based on the transition data acquired by the transition data acquisition unit 212, the macro block determined by the same partial region specification unit 240 that there is a partial region having the same image content, the macro block, A motion vector indicating a difference in position between the I picture generated by the I picture generating unit 282 or the partial area included in the P picture generated by the P picture generating unit 284 is calculated. The B picture generation unit 286 generates a moving picture composition image including a macro block expressed by the motion vector calculated by the motion vector calculation unit 250 and a macro block generated by the partial area image generation unit 270 as a B picture.

  When the transition data acquisition unit 212 acquires transition data indicating the movement of an object that moves with a still image or another moving image constituent image stored in the image storage unit 210 as a background, the object movement vector calculation unit 220 Based on the transition data indicating the movement of the object acquired by the transition data acquiring unit 212, the position of the object in the moving picture composition image to be generated as the P picture, and the position of the object in the I picture generated by the I picture generating unit 282 An object movement vector indicating the difference in position between is calculated.

  Then, based on the object movement vector calculated by the object movement vector calculation unit 220, the same partial area specifying unit 240 applies the entire range to the object among the plurality of macroblocks included in the moving picture constituent image to be generated as the P picture. Is specified in the I picture generated by the I picture generating unit 282. Then, the motion vector calculation unit 250 uses the object movement vector calculated by the object movement vector calculation unit 220 as a macroblock determined by the same partial region specification unit 240 as having a partial region having the same image content, the macroblock, It is calculated as a motion vector indicating the difference in position with the partial area included in the I picture generated by the I picture generating unit 282 having the same image content. Then, the P picture generation unit 284 generates, as a P picture, a moving picture constituent image that includes the macro block expressed by the motion vector calculated by the motion vector calculation unit 250 and the macro block generated by the partial area image generation unit 270.

  In addition, the object movement vector calculation unit 220 has the object position in the moving image composition image to be generated as the B picture based on the transition data indicating the movement of the object acquired by the transition data acquisition unit 212, and the I picture generation unit 282 An object movement vector indicating a difference in position between the generated I picture or P picture generated by the P picture generating unit 284 and the position of the object is calculated. Then, the same partial area specifying unit 240, based on the object movement vector calculated by the object movement vector calculation unit 220, includes the entire range of objects among the plurality of macroblocks included in the moving picture constituent image to be generated as the B picture. Is specified in the I picture generated by the I picture generating unit 282 or the P picture generated by the P picture generating unit 284. Then, the motion vector calculation unit 250 uses the object movement vector calculated by the object movement vector calculation unit 220 as a macroblock determined by the same partial region specification unit 240 as having a partial region having the same image content, the macroblock, It is calculated as a motion vector indicating the difference in position between the I picture generated by the I picture generating unit 282 or the partial area included in the P picture generated by the P picture generating unit 284 that has the same image content. Then, the B picture generation unit 286 generates a moving picture constituent image including the macro block expressed by the motion vector calculated by the motion vector calculation unit 250 and the macro block generated by the partial area image generation unit 270 as a B picture.

  The DCT conversion unit 290 performs DCT conversion on the moving image configuration image generated by the moving image configuration image generation unit 280 as an I picture, P picture, or B picture, and calculates a DCT coefficient. The DCT coefficient quantization unit 292 generates a moving image constituent image in which the data amount is compressed by performing quantization on the DCT coefficient calculated by the DCT conversion unit 290. The encoding unit 294 generates a moving image including a moving image constituent image in which the data amount is compressed by performing encoding on the moving image constituent image generated by the DCT coefficient quantization unit 292. Specifically, the encoding unit 294 may perform run length encoding and Huffman encoding on a moving image constituent image. The image output unit 205 outputs a moving image including the moving image constituent image generated by the encoding unit 294 to the outside of the moving image generating apparatus 100. For example, the image output unit 205 outputs to a recording medium such as a DVD.

  As described above, according to the moving image generating apparatus 100 in the present embodiment, a motion vector can be directly calculated from transition data indicating movement of an object or the like. In addition, the moving image generating apparatus 100 can directly calculate a DCT coefficient or obtain a difference image signal from the transition data for the macro block in the contour portion of the object. For this reason, it is possible to generate a moving image at a higher speed as compared with a case where MPEG encoding is performed after processing a still image to generate pixel data of a moving image constituent image. Note that the still image in the present embodiment may be an image constituting an animation or a partial image in one image constituting the animation, such as an image of an object included in the animation. Then, the moving image generating apparatus 100 may generate an animation from the plurality of still images. Even in this case, it goes without saying that the moving image generating apparatus 100 can generate the animation at a higher speed than the case where the MPEG encoding is performed after generating the pixel data of the image constituting the animation.

  FIG. 3 shows an example of moving image data generated by the moving image generating unit 214. In the example of this figure, the moving image generating apparatus 100 generates moving image data indicating movement of an object indicating the sun with the still image 300 as a background. The transition data acquisition unit 212 acquires, as transition data, the difference in coordinates of the object indicating the sun (vector ΔTV 301, 302, 303, 304) between moving image constituent images that are continuously played back. The transition data also includes the initial position of the object, and the moving image generation unit 214 generates the moving image composition image 331 by superimposing the object image on the initial position of the object indicated by the transition data of the still image 300. At this time, the moving image generating apparatus 100 generates the moving image composing image 331 as an I picture.

  Then, when generating the moving image composition image 334 (P picture), the object movement vector calculation unit 220 sequentially adds each vector ΔTV indicated by the transition data from the moving image composition image 331 (I picture). Then, an object movement vector V314 indicating a difference in the position of the object from the moving image constituent image is calculated. In the example of this figure, the object movement vector TV314 can be expressed as ΔTV301 + ΔTV302 + ΔTV303. In addition, the transition data acquisition unit 212 may acquire time-dependent data on the speed of the object, or may calculate an object movement vector in which the object has moved by temporal integration from the I picture. In either case, the method for calculating the object movement vector is a temporal integration of the position change of the object.

  In addition, the macroblocks 371, 372, 373, and 374 including the contour of the object can be identified from the position of the object, the contour information of the object, and the position of the macroblock in the moving image constituent image 334 (P picture). In the area 380 in the vicinity of the boundary between the object and the background in the moving image composition image 334 (P picture), the macroblocks 361, 362, and 363 in which the entire area is included in the object are respectively opposite to the object movement vector TV314. The image content is the same as that of the partial areas 351, 352, and 353 in the shifted I picture.

  In addition, the macroblocks 371, 372, 373, and 374 including the contour of the object can be identified from the position of the object, the contour information of the object, and the position of the macroblock in the moving image constituent image 334 (P picture). The entire area of the macroblocks 371, 372, 373, and 374 including the outline of the object that exist outside the object (for example, the macroblock 381) is included in the background. The image content of the macroblock whose entire area is included in the background is the image content (background image) of the I picture in the range of the macroblock unless an object is included in the range of the macroblock in the I picture. ). Therefore, the image content of the macroblock whose entire area is included in the background can be expressed with 0 as the motion vector and 0 as the difference image signal.

  In addition, a macroblock including the outline of the object (for example, macroblock 372) is generated by synthesizing the background image and the object image. For example, the object region among the image of the object in the region 391 including the object in the macroblock 372 (for example, the portion of the image 341 in the moving image constituent image 331) and the image content in the range indicated by the macroblock 372 in the I picture. By synthesizing the image of the area 342 other than the area 391, an image of the macroblock 372 can be generated.

  In addition, the moving image generation unit 214 may express the image content of the macroblock 372 using a difference image and a motion vector. For example, when the area of the object region 391 is calculated and the area of the region 391 with respect to the area of the macroblock is larger than a predetermined reference area, the difference image from the partial region 354 of the moving image constituent image 331 (I picture) A signal may be generated, and the image content of the macroblock 372 may be expressed by an object movement vector between the generated difference image signal and the macroblock. If the area of the region 391 with respect to the area of the macroblock is equal to or smaller than a predetermined reference area, a difference image signal from the partial region 355 of the moving image constituent image 331 (I picture) at the position of the macroblock 372 is generated. Then, the generated difference image signal and the motion vector are set to 0, and the image content of the macroblock 372 can be expressed. As described above, the moving image generating apparatus 100 can easily specify a similar partial region based on the transition data without performing block matching.

  As described above, the moving image generating apparatus 100 can easily specify images having the same image content by adding the movement information of the object indicated by the transition data. For this reason, it is possible to generate an MPEG-compressed moving image more quickly than when generating pixel data of a moving image constituent image once. In particular, processing corresponding to block matching or the like for calculating a motion vector can be realized by adding object movement information, so that a motion vector can be calculated at a higher speed. Note that the movement of the object indicated by the transition data is such that the difference between the position of the object in the reference moving image constituent image (for example, I picture) and the position of the object in another moving image constituent image (B picture, P picture) is 1. It is desirable to have a value with a minimum unit of / 2 pixels. In this case, in the macroblock, the motion vector in the MPEG encoding is the same as the object movement vector and the difference data can be expressed as 0. Therefore, the moving image is compressed at a higher compression rate, and the moving image is compressed. Can be generated at a higher speed.

  In the description of this figure, the movement of the object has been described as an example. However, the transition data may be a movement of a partial area included in the still image (I picture). Even in this case, the moving image can be quickly generated from the movement of the region based on the transition data by the same method as described with reference to FIG.

  FIG. 4 shows another example of transition of still images. In the example of this figure, the moving image generation unit 214 generates a moving image indicating the switching of images. Specifically, the transition data acquisition unit 212 acquires transition data indicating movement of a still image. In the example of FIG. 4, the transition data acquisition unit 212 acquires transition data in which the still image 401 moves from the right end at the same speed as the still image 400 while the still image 400 moves toward the left end of the display area. . Specifically, the transition data acquisition unit 212 acquires transition data that defines the moving speed V440 of the display boundary line between the still image 400 and the still image 401. Moreover, in the example of this figure, the moving image production | generation part 214 produces | generates the still images 400 and 401 as the moving image structure images 410 and 420 (I picture), respectively.

  The boundary in the moving image composition image 410 (I picture) is integrated by temporally integrating the speed of the boundary line from the timing at which the moving image composition image 410 (I picture) is reproduced to the respective timing at which each moving image composition image is reproduced. A movement vector TV423 of the boundary line from the position of the line (in the example of this figure, the right end of the display area) is calculated. In this case, the image contents of the macroblock 423a refer to the moving image constituent image 410 and the boundary movement vectors TV423 and 0 as in the relation between the object movement vector and the motion vector in the movement of the object described in FIG. It can be expressed by the difference image signal. Similarly, the macro block 423b can be expressed by a difference image signal of 0 with reference to the motion vector TV 423 of the boundary line with reference to the moving image constituent image 420 (I picture).

  Further, in another example showing the switching of images in this figure, the moving image generating unit 214 sets the area for displaying the image content of the still image 401 from the lower right in the moving image for switching the display of the still image 401 from the still image 400. Generate a video that expands toward the top left. Specifically, the moving image generating unit 214 generates a moving image composing image 450 as an I picture from the still image 400 and generates a moving image composing image 460 that is the next I picture of the I picture from the still image 401. Specifically, the transition data acquisition unit 212 acquires transition data indicating the moving speeds Vx490 and Vy490 of the display boundary lines in the X direction and the Y direction, respectively. In the moving image in this example, among the macro blocks of the moving image constituent images 451, 452, and 453, all the macro blocks that do not include the display boundary line are included in the moving image constituent images of the preceding and following I pictures. Therefore, if all the moving image constituent images are generated as B pictures, it is possible to directly determine from the transition data that the motion vector component can be expressed by 0 in macroblocks other than the macroblock including the display boundary. it can.

  In any of the image switching examples described above, the image contents of the macroblock including the display boundary line are set to the images of the still images 400 and 401 in the same manner as the description of the method for synthesizing the macroblock including the boundary in FIG. It can be easily synthesized from the contents, the position of the boundary line, and the position of the macroblock. Further, even when the image content of the macroblock is expressed by the difference from the I picture, the selection of the difference from the still images 400 and 410 and the selection of the area for calculating the difference are made from the transition data. It can be calculated directly.

  As described above, since the motion vector and the difference image signal can be obtained directly from the movement vector of the boundary line, compared with the case where the pixel data of the moving image constituent image is once generated and then MPEG encoding is performed. As a result, the generation time of the video can be greatly reduced. In FIGS. 3 and 4, for the sake of simplicity, the case where an I picture in a moving image is generated from one still image and an object or from one still image has been described. Needless to say, an image obtained by synthesizing may be generated as an I picture. In addition, the transition data acquisition unit 212 may acquire transition data indicating that an image obtained by combining a plurality of still images is generated as a moving image constituent image.

  FIG. 5 shows an example of a block configuration of the moving image generating apparatus 100 in the second embodiment. The moving image generating apparatus 100 according to the present embodiment aims to speed up the generation of an image in a macroblock at a boundary portion of an image in the moving image generation described with reference to FIGS. Specifically, the moving image generating apparatus 100 according to the present embodiment adds the DCT coefficient of the macroblock including the boundary portion of the still image in the moving image constituent image to the DCT coefficient of the macroblock including the image content of the boundary portion in the still image. It is characterized by generating directly. Therefore, by incorporating the function of the moving image generating apparatus 100 described in the present embodiment into the function of the moving image generating apparatus 100 in the first embodiment, the moving image generation speed can be further improved.

  The moving image generating apparatus 100 of the present embodiment includes an instruction input unit 600, an image output unit 605, an image storage unit 610, a transition data acquisition unit 612, and a moving image generation unit 614. The moving image generating unit 614 includes a boundary partial region specifying unit 645, a motion vector calculating unit 650, a boundary partial region area calculating unit 662, a partial region image generating unit 670, a moving image constituent image generating unit 680, a DCT converting unit 690, and a DCT coefficient quantization. Part 692 and encoding part 694. The moving picture composition image generation unit 680 includes an I picture generation unit 682, a P picture generation unit 684, and a B picture generation unit 686.

  The image storage unit 610 stores a plurality of still images. Then, the transition data acquisition unit 612 acquires transition data indicating how to move the boundary line between the first still image and the second still image stored in the image storage unit 610 in the moving image. Then, the moving image generation unit 614 generates a plurality of moving image configuration images from the still images stored in the image storage unit 610 based on the transition data acquired by the transition data acquisition unit 612, and generates the generated plurality of moving image configurations. Generate a video that contains an image.

  Specifically, the DCT conversion unit 690 performs DCT conversion on the first still image and the second still image stored in the image storage unit 610, and performs a plurality of operations included in the first still image and the second still image. The DCT coefficient of the partial area is calculated. Then, the boundary partial area specifying unit 645 stores, based on the transition data acquired by the transition data acquisition unit 612, a plurality of predetermined partial areas included in one moving image constituent image stored in the image storage unit 610. It is determined whether or not the boundary line between the first still image and the second still image intersects. The boundary partial area specifying unit 645 is based on, for example, the movement of the first still image and the second still image indicated by the transition data, similarly to the operation of the boundary partial area specifying unit 245 described in the first embodiment. It is possible to specify whether or not the partial area intersects the boundary line between the first still image and the second still image.

  Then, the partial region image generation unit 670 converts the DCT coefficient of the partial region that the boundary partial region specification unit 645 has determined to intersect the boundary line into the DCT conversion unit for the partial region in the first still image existing in the vicinity of the boundary line. The DCT coefficient calculated by 690 and the DCT coefficient calculated by the DCT conversion unit 690 for the partial region in the second still image existing in the vicinity of the boundary line are generated. Then, the moving image configuration image generation unit 680 generates a moving image configuration image including the DCT coefficients of the partial areas generated by the partial area image generation unit 670.

  Specifically, the partial region image generation unit 670 uses the DCT coefficient of the partial region that the boundary partial region specification unit 645 determines to intersect the boundary line as the DCT coefficient of the partial region of the first still image existing in the vicinity of the boundary line. The coefficient and the DCT coefficient of the partial region in the second still image existing in the vicinity of the boundary line are generated by averaging for each frequency component. In addition, the partial region image generation unit 670 uses the DCT coefficient of the partial region that the boundary partial region specification unit 645 determines to intersect the boundary line as the DCT coefficient of the partial region in the first still image existing near the boundary line. The DCT coefficients of the partial regions in the second still image existing in the vicinity of the boundary line may be generated by weighting and averaging based on the transition data acquired by the transition data acquisition unit 612. The transition data acquisition unit 212 may acquire transition data indicating whether the background or the object is more weighted at the boundary, and may use this as data for weighted averaging.

  The partial area image generation unit 670 acquires the transition data acquisition unit 612 when calculating the DCT coefficient of the partial area that the boundary partial area specification unit 645 determines to intersect the boundary line in each of the plurality of moving image constituent images. Based on the transition data obtained, the DCT coefficients of the partial areas in the first still image existing near the boundary line and the DCT coefficients of the partial areas in the second still image existing near the boundary line are You may produce | generate by averaging with a different weight about each of several continuous moving image structure image. Thereby, the moving image generating apparatus 100 can easily add a visual effect to the moving image viewer, for example, gradually increasing the composition ratio of the object with respect to the background as the object moves.

  Further, the boundary partial region area calculation unit 662 is based on the transition data acquired by the transition data acquisition unit 612, and the area of the first still image included in the partial region that the boundary partial region specification unit 645 determines to intersect the boundary line Is calculated. Then, when the area of the first still image calculated by the boundary partial region area calculation unit 662 is larger, the partial region image generation unit 670 weights the DCT coefficient of the partial region in the first still image more greatly, The DCT coefficient of the partial area that the boundary partial area specifying unit 645 determines to intersect the boundary line is calculated. For example, the partial region image generation unit 670 increases the DCT coefficient of the partial region in the first still image when the ratio of the area of the first still image calculated by the boundary partial region area calculation unit 662 to the partial region is larger. The DCT coefficient of the partial region that the boundary partial region specifying unit 645 determines to intersect the boundary line is calculated with a large weight.

  Note that the transition data acquisition unit 612 may acquire transition data indicating the movement of the first still image stored in the image storage unit 610 with respect to the second still image stored in the image storage unit 610. Then, the boundary partial area specifying unit 645 includes a plurality of predetermined partial areas included in one moving image constituent image based on the transition data indicating the movement of the first still image acquired by the transition data acquiring unit 612. It is specified whether or not the boundary line between the first still image and the second still image stored in the image storage unit 610 intersects. Then, the partial region image generation unit 670 uses the DCT coefficient of the partial region that the boundary partial region specifying unit 645 determines to intersect the boundary line as the DCT coefficient of the partial region in the first still image existing in the vicinity of the boundary line. And the DCT coefficient of the partial area in the second still image existing in the vicinity of the boundary line. Specifically, the partial area image generation unit 670 includes the DCT coefficient of the partial area in the first still image existing in the vicinity of the boundary line and the DCT coefficient of the partial area in the second still image existing in the vicinity of the boundary line. Are averaged for each frequency component.

  In addition, the motion vector calculation unit 650, based on the transition data acquired by the transition data acquisition unit 612, the partial area that the boundary partial area specifying unit 645 determines not to cross the boundary line, and the same image content as the partial area That is, a motion vector indicating a position difference from a partial region included in a still image or another moving image constituent image stored in the image storage unit 610 is calculated. For example, the motion vector calculation unit 650 calculates a motion vector based on transition data indicating the movement of the first still image with respect to the second still image acquired by the transition data acquisition unit 612. Note that the details of the specific operation of the motion vector calculation unit 650 are the same as those of the motion vector calculation unit 250 of the moving image generation device 100 in the first embodiment, and thus description thereof is omitted. Then, the moving image configuration image generation unit 680 generates a moving image configuration image including the partial area expressed by the motion vector calculated by the motion vector calculation unit 650 and the DCT coefficient of the partial area generated by the partial area image generation unit 670. .

  Note that the moving image generation unit 614 may generate an MPEG encoded moving image in which a plurality of still images stored in the image storage unit 610 change. Specifically, the boundary partial area specifying unit 645 is configured so that a plurality of predetermined macroblocks included in one moving image constituent image are stored in the image storage unit 610 based on the transition data acquired by the transition data acquisition unit 612. It is specified whether or not the boundary line between the stored first still image and second still image intersects. Then, the partial region image generation unit 670 uses the DCT coefficient of the macroblock that the boundary partial region specification unit 645 determines to intersect the boundary line as the DCT coefficient of the macroblock in the first still image existing in the vicinity of the boundary line. The DCT coefficients of the macroblocks in the second still image existing in the vicinity of the boundary line are averaged for each frequency component.

  In addition, the motion vector calculation unit 650, based on the transition data acquired by the transition data acquisition unit 612, the macro block that the boundary partial region specifying unit 645 determines not to cross the boundary line, and the same image content as the macro block That is, a motion vector indicating a position difference from a partial region included in a still image or another moving image constituent image stored in the image storage unit 610 is calculated. Then, the moving image configuration image generation unit 680 generates a moving image configuration image including the DCT coefficients of the macroblocks represented by the motion vectors calculated by the motion vector calculation unit 650 and the macroblocks generated by the partial region image generation unit 670. .

  Specifically, the I picture generation unit 682, the moving image composition image generation unit 680, and the moving image composition image from the still image stored in the image storage unit 610 based on the transition data acquired by the transition data acquisition unit 612. Are generated as an I picture. Also, the P picture generation unit 684 generates a moving picture composition image as a P picture based on the transition data acquired by the transition data acquisition unit 612 and the I picture generated by the I picture generation unit 682. Then, the motion vector calculation unit 650, based on the transition data acquired by the transition data acquisition unit 612, the macro block that the boundary partial area specifying unit 645 determines not to cross the boundary line, and the same image content as the macro block That is, the motion vector indicating the difference in position with the partial area included in the I picture generated by the I picture generating unit 682 is calculated. Then, the P picture generation unit 684 generates a moving picture constituent image including a macro block represented by the motion vector calculated by the motion vector calculation unit 650 as a P picture.

  Also, the B picture generation unit 686 generates a moving image constituent image based on the transition data acquired by the transition data acquisition unit 612 and the I picture generated by the I picture generation unit 682 or the P picture generated by the P picture generation unit 684. Generated as a B picture. Then, the motion vector calculation unit 650, based on the transition data acquired by the transition data acquisition unit 612, the macro block that the boundary partial area specifying unit 645 determines not to cross the boundary line, and the same image content as the macro block The motion vector indicating the difference in position between the I picture generated by the I picture generating unit 682 or the partial area included in the P picture generated by the P picture generating unit 684 is calculated. Then, the B picture generation unit 686 generates a moving image constituent image including a macro block represented by the motion vector calculated by the motion vector calculation unit 650 as a B picture.

  The DCT coefficient quantization unit 292 compresses the data amount by performing quantization on the DCT coefficients included in the moving image composition image generated as the I picture, P picture, or B picture by the moving image composition image generation unit 280. Generate a moving image composition image. The encoding unit 294 generates a moving image including a moving image constituent image in which the data amount is compressed by performing encoding on the moving image constituent image generated by the DCT coefficient quantization unit 292. The image output unit 205 outputs a moving image including the moving image constituent image generated by the encoding unit 294 to the outside of the moving image generating apparatus 100. For example, the image output unit 205 outputs to a recording medium such as a DVD.

  As described above, according to the moving image generating apparatus 100 in the present embodiment, since DCT conversion is not performed to generate a P or B picture, it is more than when generating pixel data and performing DCT conversion. It can be generated at high speed.

  FIG. 6 shows an example of processing for calculating DCT coefficients of a macroblock including a boundary line. An example of the processing in this figure is the same as the transition data described in FIG. 3 except for the method of calculating the image data of the macroblock including the boundary line, and thus the description is omitted except for the differences.

  The DCT conversion unit 690 calculates a DCT coefficient by performing DCT conversion on each macroblock included in the moving image constituent image 331 (I picture). Specifically, the DCT conversion unit 690 calculates a luminance signal of a macroblock 354 having 16 pixels in the vertical and horizontal directions in the moving image composition image including the object, and calculates a DCT coefficient for each of four blocks having 8 pixels in the vertical and horizontal directions. In addition, the DCT conversion unit 690 calculates, in the macroblock 354, the DCT coefficients of the blocks of 8 pixels in the vertical and horizontal directions for each of the Cr and Cb color difference signals. Similarly, with respect to the macro block 355 serving as the background of the object, DCT coefficients are calculated for each of the luminance signal and Cr and Cb color difference signals.

  Then, the DCT coefficients calculated for each of the macroblocks 354 and 355 are weighted and averaged for each frequency component to calculate the DCT coefficients of the luminance signal and the color difference signals Cr and Cb of the macroblock. Needless to say, the averaging of the DCT coefficient in each block of the luminance signal is the averaging of the DCT coefficient with the block at the same position. Needless to say, the DCT coefficient of the Cr signal of the macro block 354 and the DCT coefficient of the Cr signal of the macro block 355 are averaged, and the DCT coefficient of the Cb signal of the block 354 and the DCT coefficient of the Cb signal of the block 355 are averaged. To do. In the example of this figure, the DC component I701 of one block in the luminance signal of the macroblock 354, the DC component I702 of one block in the luminance signal of the macroblock 355, and the weighting coefficients α and β respectively are used. An example of calculating the DC component (α × I 701 + β × I 702) of one block in the luminance signal of the block 372 is illustrated.

  Through the processing described above, the DCT coefficient of the image content of the macro block including the boundary portion can be directly calculated by averaging the DCT coefficients calculated in advance. Therefore, the DCT coefficient of the image content of the macroblock including the boundary can be generated at a higher speed than when the DCT conversion is performed from the pixel data. Since the image obtained by averaging the DCT coefficients is an image obtained by superimposing the background and the object, for example, in the image in which the object moves in the background image, the boundary portion between the object and the background is accurately expressed. It does not become an image. However, since the background and the image of the object remain as an afterimage around the moving object, the moving object looks blurry to the viewer of the moving image. For this reason, even if the background and the object are superimposed on the macro block image including the outline of the object, the viewer can browse without feeling uncomfortable.

  Note that when such DCT coefficient averaging processing is performed, the difference in position in the x and y directions between the object in the I picture and the object in the P or B picture matches the size of the macroblock (16 pixels). It is desirable. If the difference matches, the part of the object and the background part included in the macroblock including the boundary in the P or B picture will be included in any macroblock in the I picture. The image content of the macro block can be generated more accurately. On the other hand, even when the difference does not match, the image of the macroblock having the largest area that matches the object included in the macroblock including the boundary line and the area corresponding to the background included in the macroblock including the boundary line DCT coefficients may be averaged for the macroblock with the largest. In this way, by averaging the DCT coefficients of the macroblocks existing in the vicinity of the boundary line between the object and the background, the DCT coefficients representing the macroblock image content that intersects the boundary line can be approximately calculated. Further, visual effects can be included in the boundary portion of the object by weighting with the weighting coefficients α and β in averaging of the DCT coefficients. For example, by increasing the object weight (α) in a moving image constituent image reproduced at a later timing in a plurality of moving image constituent images, the degree of enhancement of the object at the boundary can be changed.

  FIG. 7 shows an example of a hardware configuration of the moving image generating apparatus 100 according to the first and second embodiments. The moving image generating apparatus 100 includes a CPU peripheral portion including a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 connected to each other by a host controller 1582, and communication connected to the host controller 1582 by an input / output controller 1584. An input / output unit having an interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560, and a legacy input / output unit having a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584. .

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 and controls each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 and the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505. The communication interface 1530 is connected to the network communication device 1598 to transmit / receive programs or data. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program executed when the moving image generating apparatus 100 is started, a program depending on the hardware of the moving image generating apparatus 100, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via a flexible disk drive 1550 and, for example, a parallel port, a serial port, a keyboard port, a mouse port, and the like.

  A program executed by the CPU 1505 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is installed in the hard disk drive 1540 from the recording medium, read into the RAM 1520, and executed by the CPU 1505.

  The program executed by the CPU 1505 includes the instruction input unit 200, the image output unit 205, the image storage unit 210, the transition data acquisition unit 212, which are described with reference to FIGS. 1 to 4. It functions as the moving image generation unit 214. The program also includes the moving image generation unit 214, the object movement vector calculation unit 220, the region movement vector calculation unit 225, the object position specification unit 230, the same partial region specification unit 240, the motion vector calculation unit 250, and the similar partial region specification unit. 260, the partial area image generation unit 270, the moving image configuration image generation unit 280, the DCT conversion unit 290, the DCT coefficient quantization unit 292, and the encoding unit 294. In addition, the program causes the similar partial region specifying unit 260 to function as the boundary partial region area calculating unit 262 and the similar partial region selecting unit 264, and causes the same partial region specifying unit 240 to function as the boundary partial region specifying unit 245. In addition, the program causes the moving picture composition image generation unit 280 to function as an I picture generation unit 282, a P picture generation unit 284, and a B picture generation unit 286. In addition, the program executed by the CPU 1505 includes the instruction input unit 600, the image output unit 605, and the image storage that have been described with reference to FIGS. 1, 5, and 6 for the moving image generating apparatus 100 according to the second embodiment. Unit 610, transition data acquisition unit 612, and moving image generation unit 614. The program also includes a moving image generating unit 614, a boundary partial region specifying unit 645, a motion vector calculating unit 650, a boundary partial region area calculating unit 662, a partial region image generating unit 670, a moving image constituent image generating unit 680, and a DCT converting unit. 690, function as a DCT coefficient quantization unit 692 and an encoding unit 694. In addition, the program causes the moving picture composition image generation unit 680 to function as an I picture generation unit 682, a P picture generation unit 684, and a B picture generation unit 686.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Further, a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet may be used as a recording medium, and the program may be provided to the moving image generation device 100 via the network.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. Various modifications or improvements can be added to the above embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

2 is a diagram illustrating an example of a usage environment of a moving image generating apparatus 100. FIG. It is a figure which shows an example of the block configuration in the 1st Example of the moving image generation device. It is a figure which shows an example of the moving image data which the moving image generation part 214 produces | generates. It is a figure which shows another example of the moving image data which the moving image generation part 214 produces | generates. It is a figure which shows an example of the block configuration in the 2nd Example of the moving image generation device. It is a figure which shows an example of the process which calculates the DCT coefficient of the macroblock containing a boundary line. 2 is a diagram illustrating an example of a hardware configuration of a moving image generating apparatus 100. FIG.

Explanation of symbols

100 moving image generating device 110 imaging device 130 moving image data 150 DVD
170 Digital Photoshop 190 User 200 Instruction Input Unit 205 Image Output Unit 210 Image Storage Unit 212 Transition Data Acquisition Unit 214 Movie Generation Unit 220 Object Movement Vector Calculation Unit 225 Region Movement Vector Calculation Unit 230 Object Position Specification Unit 240 Same Partial Region Specification Unit 245 Boundary partial region specifying unit 250 Motion vector calculating unit 260 Similar partial region specifying unit 262 Boundary partial region area calculating unit 264 Similar partial region selecting unit 270 Partial region image generating unit 280 Moving picture composition image generating unit 282 I picture generating unit 284 P picture Generation unit 286 B picture generation unit 290 DCT conversion unit 292 DCT coefficient quantization unit 294 encoding unit 600 instruction input unit 605 image output unit 610 image storage unit 612 transition data acquisition unit 614 video generation unit 64 Boundary partial region specifying unit 650 Motion vector calculating unit 662 Boundary partial region area calculating unit 670 Partial region image generating unit 680 Movie constituent image generating unit 682 I picture generating unit 684 P picture generating unit 686 B picture generating unit 690 DCT converting unit 692 DCT Coefficient quantization unit 694 Coding unit

Claims (13)

A moving image generating apparatus that generates a moving image in which a plurality of still images change,
A transition data acquisition unit that acquires transition data indicating how to move the boundary line between the first still image and the second still image in the moving image;
A moving image generating unit that generates a plurality of moving image constituent images from a still image based on the transition data acquired by the transition data acquiring unit, and generates a moving image including the generated moving image constituent images;
The moving image generation unit
A DCT conversion unit that performs DCT conversion on the first still image and the second still image, and calculates DCT coefficients of a plurality of partial areas included in the first still image and the second still image;
Whether or not a plurality of predetermined partial areas included in one moving image constituent image intersect the boundary line between the first still image and the second still image based on the transition data acquired by the transition data acquisition unit A boundary part region specifying part for specifying
The DCT coefficient of the partial area determined by the boundary partial area specifying unit to intersect the boundary line, the DCT coefficient calculated by the DCT conversion unit for the partial area in the first still image existing in the vicinity of the boundary line, and the boundary line A partial region image generation unit that generates a partial region in the second still image existing in the vicinity of the DCT coefficient calculated by the DCT conversion unit;
A moving image generating apparatus that includes a moving image forming image generating unit that generates a moving image forming image including the DCT coefficients of the partial areas generated by the partial area image generating unit. The moving image generation unit
Based on the transition data acquired by the transition data acquisition unit, the partial region determined by the boundary partial region specifying unit not to intersect the boundary line, and a still image or other moving image having the same image content as the partial region A motion vector calculating unit that calculates a motion vector indicating a difference in position between the partial areas included in the constituent images;
The moving image composing image generation unit generates a moving image composing image including a partial region expressed by a motion vector calculated by the motion vector calculating unit and a DCT coefficient of the partial region generated by the partial region image generating unit. The moving image generating apparatus according to 1. The partial region image generation unit calculates the DCT coefficient of the partial region determined by the boundary partial region specifying unit to intersect the boundary line, the DCT coefficient of the partial region of the first still image existing in the vicinity of the boundary line, and the boundary line The moving image generating apparatus according to claim 2, wherein the moving image generating apparatus generates the DCT coefficients of the partial areas in the second still image existing in the vicinity of the image by averaging each frequency component. The partial region image generation unit uses the DCT coefficient of the partial region determined by the boundary partial region specifying unit to intersect the boundary line, the DCT coefficient of the partial region in the first still image existing in the vicinity of the boundary line, and the boundary The moving image according to claim 3, wherein the moving image is generated by weighting and averaging DCT coefficients of a partial region in the second still image existing in the vicinity of the line based on the transition data acquired by the transition data acquisition unit. Generator. The partial region image generation unit calculates the DCT coefficient of the partial region that is determined that the boundary partial region specifying unit intersects the boundary line in each of the plurality of moving image constituent images, and the transition acquired by the transition data acquisition unit Based on the data, the DCT coefficient of the partial area in the first still image existing in the vicinity of the boundary line and the DCT coefficient of the partial area in the second still image existing in the vicinity of the boundary line are consecutive in the moving image. The moving image generating apparatus according to claim 4, wherein the moving image generating device generates each of the plurality of moving image composing images by averaging with different weights. The moving image generation unit
A boundary partial area area calculating unit that calculates an area of a first still image included in the partial area determined by the boundary partial area specifying unit to intersect with the boundary line based on the transition data acquired by the transition data acquiring unit; Have
When the area of the first still image calculated by the boundary partial region area calculation unit is larger, the partial region image generation unit weights the DCT coefficient of the partial region in the first still image more heavily, and The moving image generating apparatus according to claim 4, wherein the DCT coefficient of the partial region that is determined that the partial region specifying unit intersects the boundary line is calculated. The transition data acquisition unit acquires transition data indicating movement of the first still image relative to the second still image;
The boundary partial region specifying unit includes a plurality of predetermined partial regions included in one moving image constituent image based on transition data indicating movement of the first still image acquired by the transition data acquiring unit. Specify whether to cross the boundary between the still image and the second still image,
The partial region image generation unit uses the DCT coefficient of the partial region determined by the boundary partial region specifying unit to intersect the boundary line, the DCT coefficient of the partial region in the first still image existing in the vicinity of the boundary line, and the boundary The moving image generating device according to claim 4, wherein the moving image generating device generates the moving image from DCT coefficients of a partial region in the second still image existing in the vicinity of the line. The moving image generating unit generates an MPEG encoded moving image in which a plurality of still images change,
Based on the transition data acquired by the transition data acquisition unit, the boundary partial area specifying unit includes a plurality of predetermined macroblocks included in one moving image constituent image, a first still image, a second still image, Whether or not to cross the boundary of
The partial area image generation unit determines the DCT coefficient of the macroblock that the boundary partial area specifying unit has determined to intersect the boundary line, the DCT coefficient of the macroblock in the first still image existing in the vicinity of the boundary line, and the boundary 4. The moving image generating apparatus according to claim 3, wherein the moving image generating apparatus generates the moving image by averaging the DCT coefficients of the macroblocks in the second still image existing in the vicinity of the line for each frequency component. The motion vector calculation unit is based on the transition data acquired by the transition data acquisition unit, the macro block determined that the boundary partial region specifying unit does not cross the boundary line, and the same image content as the macro block , Calculating a motion vector indicating a difference in position between a still image or a partial area included in another moving image constituent image,
The moving image composing image generation unit generates a moving image composing image including a macroblock expressed by a motion vector calculated by the motion vector calculation unit and a DCT coefficient of the macroblock generated by the partial area image generation unit. 8. The moving image generating device according to 8. The moving picture composition image generation section, based on the transition data acquired by the transition data acquisition section, an I picture generation section that generates a moving picture composition image as an I picture from a still image;
A P picture generation unit that generates a moving picture constituent image as a P picture based on the transition data acquired by the transition data acquisition unit and the I picture generated by the I picture generation unit;
The motion vector calculation unit is based on the transition data acquired by the transition data acquisition unit, the macro block determined that the boundary partial region specifying unit does not cross the boundary line, and the same image content as the macro block Calculating a motion vector indicating a difference in position between the partial area included in the I picture generated by the I picture generating unit;
The moving picture generating apparatus according to claim 9, wherein the P picture generating unit generates a moving picture constituent image including a macroblock represented by the motion vector calculated by the motion vector calculating unit as a P picture. The moving image composition image generation unit
A B picture generation unit that generates a moving picture composition image as a B picture based on the transition data acquired by the transition data acquisition unit and the I picture generated by the I picture generation unit or the P picture generated by the P picture generation unit Further including
The motion vector calculation unit is based on the transition data acquired by the transition data acquisition unit, the macro block determined that the boundary partial region specifying unit does not cross the boundary line, and the same image content as the macro block Calculating a motion vector indicating a difference in position between the I picture generated by the I picture generating unit or the partial area included in the P picture generated by the P picture generating unit;
The moving picture generating apparatus according to claim 10, wherein the B picture generating unit generates a moving picture constituent image including a macroblock represented by the motion vector calculated by the motion vector calculating unit as a B picture. A video generation method for generating a video in which a plurality of still images change,
A transition data acquisition stage for acquiring transition data indicating how to move the boundary line between the first still image and the second still image in the moving image;
Based on the transition data acquired in the transition data acquisition step, a plurality of moving image composition images are generated from a still image, and a moving image generation step that generates a moving image including the generated plurality of moving image composition images,
The video generation stage includes
A DCT conversion stage for performing DCT conversion on the first still image and the second still image and calculating DCT coefficients of a plurality of partial areas included in the first still image and the second still image;
Based on the transition data acquired in the transition data acquisition step, whether or not a plurality of predetermined partial areas included in one moving image constituent image intersect the boundary line between the first still image and the second still image A boundary sub-region identification step for identifying whether or not,
DCT coefficients of the partial areas determined to intersect the boundary line in the boundary partial area specifying stage, DCT coefficients calculated in the DCT conversion stage for the partial areas in the first still image existing in the vicinity of the boundary line, A partial region image generation step for generating a partial region in the second still image existing in the vicinity of the boundary line from the DCT coefficient calculated in the DCT conversion step;
A moving image generating image generating step of generating a moving image forming image including a DCT coefficient of the partial region generated in the partial area image generating step; A program for a moving image generating device for generating a moving image in which a plurality of still images change, wherein the moving image generating device is
A transition data acquisition unit for acquiring transition data indicating how to move the boundary line between the first still image and the second still image in the moving image;
Based on the transition data acquired by the transition data acquisition unit, generate a plurality of moving image constituent images from a still image, and function as a moving image generation unit that generates a moving image including a plurality of generated moving image constituent images,
The moving image generation unit
A DCT conversion unit that performs DCT conversion on the first still image and the second still image, and calculates DCT coefficients of a plurality of partial regions included in the first still image and the second still image;
Whether or not a plurality of predetermined partial areas included in one moving image constituent image intersect the boundary line between the first still image and the second still image based on the transition data acquired by the transition data acquisition unit Boundary part region specifying part for specifying
The DCT coefficient of the partial area determined by the boundary partial area specifying unit to intersect the boundary line, the DCT coefficient calculated by the DCT conversion unit for the partial area in the first still image existing in the vicinity of the boundary line, and the boundary line A partial region image generation unit that generates a partial region in the second still image existing in the vicinity of the DCT coefficient calculated by the DCT conversion unit;
A program that functions as a moving image constituent image generation unit that generates a moving image constituent image including a DCT coefficient of a partial region generated by the partial region image generation unit.

Images