JP6424620B2 - Image generation apparatus, image generation method and program - Google Patents

Description

  The present invention relates to an image generation apparatus, an image generation method, and a program.

  2. Description of the Related Art Conventionally, a technique for detecting a frame image considered to be important from a captured moving image and acquiring it as a still image is widely known. In such a technique, there is a technique of acquiring a frame image of an important scene from a captured moving image as a still image (see Patent Document 1).

JP, 2005-191770, A

  However, for example, when an effect is added to a moving image, when a still image is obtained from a portion to which the effect is added, a still image representing the content of the moving image desired by the user is Because of the difference, it may be difficult for the user to properly understand the entire content of the moving image.

  The present invention has been made in view of such a situation, and it is an object of the present invention to allow a user to easily understand the content of a moving image.

In order to achieve the above object, an image generation device according to an aspect of the present invention is
An image acquisition unit 52 for acquiring a plurality of images;
A moving image generation processing unit 54 that generates a new moving image from the plurality of images acquired by the image acquisition unit 52;
A moving image generation processing unit 54 / thumbnail image generation processing unit 55 for acquiring a specific image from the plurality of images acquired by the image acquisition unit 52;
The new moving image generated by the moving image generation processing unit 54 and the specific image acquired by the moving image generation processing unit 54 / thumbnail image generation processing unit 55 are associated with each other in the generated image storage unit 73. A moving image generation processing unit 54 / thumbnail image generation processing unit 55 to be stored;
It is characterized by having.

  According to the present invention, it is possible for a user to easily understand the content of a moving image.

It is a block diagram showing the composition of the hardware of the imaging device concerning one embodiment of the present invention. It is a schematic diagram for demonstrating the moving image produced | generated by this embodiment. It is a schematic diagram for demonstrating the thumbnail image produced | generated by this embodiment. FIG. 5 is a functional block diagram showing a functional configuration for executing an image generation process among the functional configurations of the imaging device of FIG. 1. It is a flowchart explaining the flow of the image generation process which the imaging device of FIG. 1 which has the functional structure of FIG. 2 performs. 5 is a flowchart illustrating a flow of image selection condition setting processing in the image generation processing. It is a flow chart explaining a flow of collage image generation processing among image generation processing. 5 is a flowchart illustrating a flow of moving image generation processing in the image generation processing. 5 is a flowchart illustrating a flow of thumbnail image generation processing in the image generation processing.

  Hereinafter, embodiments of the present invention will be described using the drawings.

FIG. 1 is a block diagram showing a hardware configuration of an imaging apparatus according to an embodiment of the present invention.
The imaging device 1 is configured as, for example, a digital camera.

  The imaging device 1 includes a central processing unit (CPU) 11, a read only memory (ROM) 12, a random access memory (RAM) 13, a bus 14, an input / output interface 15, an imaging unit 16, and an input unit 17. , An output unit 18, a storage unit 19, a communication unit 20, and a drive 21.

  The CPU 11 executes various processes in accordance with a program stored in the ROM 12 or a program loaded from the storage unit 19 into the RAM 13.

  Data and the like necessary for the CPU 11 to execute various processes are also stored in the RAM 13 as appropriate.

  The CPU 11, the ROM 12 and the RAM 13 are connected to one another via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a communication unit 20, and a drive 21 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured of a lens that collects light, such as a focus lens or a zoom lens, in order to capture an object.
The focus lens is a lens that forms an object image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length in a certain range.
The optical lens unit is also provided with peripheral circuits for adjusting setting parameters such as focus, exposure, white balance, etc., as necessary.

The image sensor includes a photoelectric conversion element, an AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a complementary metal oxide semiconductor (CMOS) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) an object image, accumulates an image signal for a certain period of time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on this analog image signal. A digital signal is generated by various signal processing, and is output as an output signal of the imaging unit 16.
Hereinafter, such an output signal of the imaging unit 16 is referred to as “captured image data”. Data of the captured image is appropriately supplied to the CPU 11 and an image processing unit (not shown).

The input unit 17 includes various buttons and the like, and inputs various information in accordance with a user's instruction operation.
The output unit 18 is configured by a display, a speaker, and the like, and outputs an image and sound.
The storage unit 19 is configured by a hard disk, a dynamic random access memory (DRAM), or the like, and stores data of various images.
The communication unit 20 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is appropriately attached to the drive 21. The program read from the removable media 31 by the drive 21 is installed in the storage unit 19 as needed. The removable media 31 can also store various data such as image data stored in the storage unit 19 in the same manner as the storage unit 19.

The imaging device 1 configured as described above has a function capable of generating a moving image from an image (hereinafter referred to as “processing target image”) selected by evaluating a plurality of image groups.
Further, in the imaging device 1, a reduced image (hereinafter referred to as "thumbnail image") corresponding to a moving image and representing the content of the moving image is generated from the plurality of processing target images.
Further, in the imaging device 1, an image characteristically representing the content of the moving image (hereinafter referred to as "collage image") is generated from the plurality of processing target images, and the generated collage image is configured as a moving image. To generate a moving image.

FIG. 2 is a schematic view for explaining a moving image generated in the present embodiment.
As the moving image generated in the present embodiment, as shown in FIG. 2, a plurality of images are evaluated to select images to be processed (A, B, C, D, E, F).
Then, a moving image in which the selected image to be processed (A, B, C, D, E, F) is a frame image is generated. At that time, the collage image generated from the selected processing target image (A, B, C, D, E, F) is also included in the moving image as a frame image. The generated collage image is used as a thumbnail image as an image representing the content of the moving image, or used as a frame image so as to be an index representing the content of the moving image at the beginning / end of the moving image or a part of the scene Do.
Also, separately from the collage image, a collage image for a thumbnail image is generated and stored in the thumbnail area of the moving image. In this embodiment, unlike the collage image, the collage image for the thumbnail image is synthesized with the selected processing target image with the template image so that the contents of the moving image can be understood even if the image size is small as the thumbnail image. The image is a single image.
Further, the selected processing target images may be displayed in the descending order of evaluation so that the contents of the moving image can be understood even if the image size is small.

Here, the generated thumbnail image will be described.
FIG. 3 is a schematic view for explaining thumbnail images generated in the present embodiment.
In the thumbnail image of the present embodiment, as shown in FIG. 3A, the processing target image to be used is changed according to the image size of the thumbnail image to be generated. This is to prevent the area in which the processing target image constituting the thumbnail image is displayed becoming narrow due to the restriction of the display area and the like, and the content of the processing target image can not be grasped. For example, in the case of the thumbnail image size [small], two processing target images are used, and in the case of the thumbnail image size [large], six processing target images are used. The number of processing target images to be used is determined according to the image size of. That is, when the display size of the image varies depending on the software to be displayed, the screen, etc., a template image in which the number of images to be arranged is determined is prepared in advance so that the user can easily view If it is two pieces arrangement, a large size will arrange up to eight pieces etc.).

Further, as shown in FIG. 3B, the thumbnail image of the present embodiment determines the arrangement location and the size in the thumbnail image based on the evaluation result of each image. For example, in the case of image A, image B, image C, image D, image E, and image F in descending order of evaluation of the processing target image, the size of the display area is the largest and the image A Adjust and arrange the size of each image in order of evaluation.
Further, in the present embodiment, a template image in which the arrangement location and size of the image generated in advance correspond to the evaluation result is used in generating the thumbnail image.

  By generating a moving image and a collage image from the common processing target image in this manner, the collage image represents the contents of the moving image as a list, and the user visually recognizes the scene composed of the thumbnail image and the collage image. By doing this, the content of the moving image can be understood more appropriately. In addition, since the processing target image to be used is a still image, for example, a scene switching portion or a portion to which an effect is added as compared with a case where a still image is extracted from a moving image and an image representing the moving image is configured. Since there is no risk of extracting the image, it is possible to generate an image that can make the user understand the content of the moving image more appropriately.

  FIG. 4 is a functional block diagram showing a functional configuration for executing an image generation process among the functional configurations of such an imaging device 1.

“Image generation processing” refers to a moving image, a thumbnail image of a moving image, a collage image, a generated collage image, and a processing target, with the processing target image as a frame image, using in common the processing target image selected from a plurality of images This is a series of processes for generating a moving image with an image as a frame image.
The “image generation process” includes “image selection condition setting process”, “collage image generation process”, “moving image generation process”, and “thumbnail image generation process”.
The “image selection condition setting process” refers to a series of processes for setting the selection condition of the processing target image.
The “collage image generation process” refers to a series of processes for generating a collage image from the selected processing target image.
The “moving image generation process” refers to a series of processes for generating a moving image from the selected processing target image and the generated collage image.
The “thumbnail image generation process” refers to a series of processes for generating a thumbnail image from the selected processing target image.

  When executing the image generation processing, as shown in FIG. 4, in the CPU 11, the image selection condition setting processing unit 51, the image acquisition unit 52, the collage image generation processing unit 53, and the moving image generation processing unit 54. , And the thumbnail image generation processing unit 55 function.

  Further, in one area of the storage unit 19, a processing target image storage unit 71, a template image storage unit 72, and a generated image storage unit 73 are set.

  The processing target image storage unit 71 stores a still image or a moving image as data of the processing target image.

  The template image storage unit 72 stores data of a template image used to generate a collage image or a thumbnail image.

  The generated image storage unit 73 stores data of a moving image to which a generated collage image and a thumbnail image are added.

The image selection condition setting processing unit 51 executes an image selection condition setting process.
In detail, the image selection condition setting processing unit 51 sets “image to be used” and “image not to be used”, and gives a score to the image based on the photographing information. Then, the image selection condition setting processing unit 51 selects an image by excluding the image whose score is lower than the threshold and the image set as “the image which is not desired to be used” by the image selection condition setting processing unit 51 from selection targets. Set the conditions.

  The image acquisition unit 52 specifies the date range to be used from the processing target image storage unit 71, and reads out the corresponding processing target image.

The collage image generation processing unit 53 executes a collage image generation process.
Specifically, the collage image generation processing unit 53 selects a template image corresponding to the number of combined images selected by the user from the template image storage unit 72.
In addition, the collage image generation processing unit 53 selects only the “combination number” in the order of “higher number of images from the“ desired image to be used ”, and combines the selected processing target image with the template image, as shown in FIG. Generate one collage image.

The moving image generation processing unit 54 performs moving image generation processing.
In detail, the moving image generation processing unit 54 selects a plurality of images including the processing target image set as the “desired image to be used” and the collage image in descending order of the score within the range that falls within the target reproduction time.
In addition, the moving image generation processing unit 54 sorts the selected images in order of shooting date and time, and combines a plurality of sorted images to generate one new moving image.

The thumbnail image generation processing unit 55 executes thumbnail image generation processing.
Specifically, the thumbnail image generation processing unit 55 selects, from the template image storage unit 72, template images having different numbers of combined images according to the size of the thumbnail image to be generated. In addition, the thumbnail image generation processing unit 55 selects "the number of images to be used" in the descending order of "score number", combines the selected images, and selects one collage image for thumbnail images. Generate In addition, the thumbnail image generation processing unit 55 stores the generated collage image for the thumbnail image in the thumbnail area of the corresponding moving image stored in the generated image storage unit 73.

FIG. 5 is a flowchart for explaining the flow of the image generation process performed by the imaging device 1 of FIG. 1 having the functional configuration of FIG. 4.
The image generation processing is started by an operation of the image generation processing start on the input unit 17 by the user.

In step S1, the image selection condition setting processing unit 51 executes an image selection condition setting process. As a result of executing the image selection condition setting process, the condition for image selection is set.
The flow of the image selection condition setting process will be described later.

  In step S2, the image acquisition unit 52 designates the date range to be used from the processing target image storage unit 71, and reads out the corresponding processing target image.

In step S3, the collage image generation processing unit 53 executes a collage image generation process. As a result of executing the collage image generation process, a collage image is generated from the selected processing target image.
The flow of the collage image generation process will be described later.

In step S4, the moving image generation processing unit 54 performs moving image generation processing. As a result of executing the moving image generation process, a moving image is generated from the selected processing target image and the generated collage image.
The flow of the moving image generation process will be described later.

In step S5, the thumbnail image generation processing unit 55 executes a thumbnail image generation process. As a result of executing the thumbnail image generation process, a thumbnail image is generated from the selected processing target image.
The flow of the thumbnail image generation process will be described later.

In step S6, the CPU 11 determines whether to end the image generation processing.
If the image generation process is not completed, it is determined as NO in step S6, and the process returns to step S1.
When the image generation process is ended, it is determined as YES in step S6, and the image generation process is ended.

  FIG. 6 is a flowchart for explaining the flow of the image selection condition setting process in the image generation process.

  In step S21, the image selection condition setting processing unit 51 sets each image as either “image which it is desired to use” or “image which it is not desired to use”.

  In step S22, the image selection condition setting processing unit 51 gives points to the image based on shooting information such as the in-focus state and brightness of the subject, the number of detected faces in the image, and the number of times of image reproduction.

  In step S23, the image selection condition setting processing unit 51 calculates the reproduction time for moving image generation for each image based on the assigned points.

  In step S24, the image selection condition setting processing unit 51 sorts the images in order of shooting date and time.

  In step S25, the image selection condition setting processing unit 51 excludes the set "non-use desired image" from the selection targets.

In step S26, the image selection condition setting processing unit 51 excludes the image whose score is lower than the threshold from the selection target.
Thereafter, the image selection condition setting process ends.

  FIG. 7 is a flowchart for explaining the flow of the collage image generation process in the image generation process.

  In step S41, the collage image generation processing unit 53 selects the number of combined images to be used for collage image generation based on the number of combined images selection operation to the input unit 17 by the user.

  In step S42, the collage image generation processing unit 53 selects a template image corresponding to the number of combined images from the template image storage unit 72.

In step S43, the collage image generation processing unit 53 determines whether "the number of images desired to be used" is equal to or more than "the number of images to be used"("the number of images desired to be used"」" the number of images to be combined ").
If the "number of images desired to be used" is equal to or more than the "combination number", it is determined as YES in step S43, and the process proceeds to step S44.
If the “number of images desired to be used” is not the “combined number” or more, it is determined as NO in step S43, and the process proceeds to step S6 of the image generation process.

  In step S44, the collage image generation processing unit 53 selects "the number of combined images" in descending order of score from "the image desired to be used".

  In step S45, the collage image generation processing unit 53 synthesizes the images selected by the “combination number” and generates one collage image.

  In step S46, the collage image generation processing unit 53 controls the output unit 18 to display the generated collage image.

  In step S47, the collage image generation processing unit 53 stores the generated collage image in the generated image storage unit 73.

In step S48, the collage image generation processing unit 53 determines whether to end the collage image generation processing.
If the collage image generation process is not completed, it is determined as NO in step S48, and the process returns to step S41.
When the collage image generation process is ended, YES is determined in step S48, and the collage image generation process is ended.

  FIG. 8 is a flow chart for explaining the flow of moving image generation processing in the image generation processing.

  In step S61, the moving image generation processing unit 54 sets the target reproduction time based on the setting operation of the target reproduction time on the input unit 17 by the user.

In step S62, the moving image generation processing unit 54 determines whether or not the generated collage image is to be used for moving image generation.
When the generated collage image is used for moving image generation, YES is determined in step S62, and the process proceeds to step S63.
When the generated collage image is not used for moving image generation, it is determined as NO in step S62, and the process proceeds to step S66.

In step S63, the moving image generation processing unit 54 causes the image selection condition setting processing unit 51 to set the collage image to be used as the “image desired to be used”.

  In step S64, the moving image generation processing unit 54 causes the image selection condition setting processing unit 51 to select an average point of evaluation results of a plurality of images used for collage image generation and a median value of the evaluation results. A score corresponding to the middle point is given.

  In step S65, the moving image generation processing unit 54 sets a reproduction time of the collage image.

In step S66, the moving image generation processing unit 54 determines whether the total reproduction time of the "desired image to be used" is equal to or more than the target reproduction time (total reproduction time of "image desired to be used" 目標 target reproduction time). Determine
If the total reproduction time of the “desired image to be used” is not the target reproduction time or more, it is determined as NO in step S66, and the process proceeds to step S6 of the image generation process.
If the total reproduction time of the "desired image to be used" is equal to or more than the target reproduction time, YES is determined in step S66, and the process proceeds to step S67.

  In step S67, the moving picture generation processing unit 54 selects the images set as the “desired image to be used” in descending order of score within the range that falls within the target reproduction time.

  In step S68, the moving image generation processing unit 54 sorts the selected plurality of images in order of shooting date and time.

  In step S69, the moving image generation processing unit 54 connects a plurality of selected images to generate one new moving image.

In step S70, the moving image generation processing unit 54 determines whether or not to store the generated moving image.
When storing the generated moving image, YES is determined in step S70, and the process proceeds to step S71.
If the generated moving image is not stored, it is determined as NO in step S70, and the process proceeds to step S72.

  In step S71, the moving image generation processing unit 54 stores the generated moving image in the generated image storage unit 73.

In step S72, the moving image generation processing unit 54 determines whether to end the moving image generation process.
If the moving image generation process is not completed, it is determined as NO in step S72, and the process returns to step S61.
When the moving image generation process ends, it is determined YES in step S72, and the moving image generation process ends.

  FIG. 9 is a flow chart for explaining the flow of thumbnail image generation processing in the image generation processing.

  In step S81, in accordance with the image size selection operation to be generated on the input unit 17, the thumbnail image generation processing unit 55 selects the size of the thumbnail image to be generated.

  In step S 82, the thumbnail image generation processing unit 55 selects from the template image storage unit 72 the number of template images of the combined number corresponding to the size of the selected thumbnail image.

In step S83, the thumbnail image generation processing unit 55 determines whether or not the "number of images desired to be used" is equal to or more than the "combination number"("the number of images desired to be used" 使用 "combination number").
If the "number of images desired to be used" is equal to or more than the "combination number", it is determined as YES in step S83, and the process proceeds to step S84.
If the “number of images desired to be used” is not the “combined number” or more, it is determined as NO in step S83, and the process proceeds to step S6 of the image generation process.

  In step S84, the thumbnail image generation processing unit 55 selects "the number of combined images" in descending order of score from "the image desired to be used".

  In step S85, the thumbnail image generation processing unit 55 combines the selected images to generate a collage image for one thumbnail image.

  In step S86, the thumbnail image generation processing unit 55 controls the output unit 18 to display the generated collage image for thumbnail images.

In step S87, the thumbnail image generation processing unit 55 determines whether or not the generated collage image for the thumbnail image is to be stored in the thumbnail area of the moving image.
In the case of storing in the thumbnail area, YES is determined in step S87, and the process proceeds to step S88.

  In step S88, the thumbnail image generation processing unit 55 stores the collage image for the thumbnail image in the thumbnail area of the corresponding moving image stored in the generated image storage unit 73.

  On the other hand, when the thumbnail image is not stored, NO is determined in step S87, and the process proceeds to step S89.

In step S89, the thumbnail image generation processing unit 55 determines whether to end the thumbnail image generation processing.
If the thumbnail image generation process is not completed, it is determined as NO in step S89, and the process returns to step S81.
When the thumbnail image generation process is ended, YES is determined in step S89, and the thumbnail image generation process is ended.

The imaging device 1 configured as described above includes an image acquisition unit 52, a moving image generation processing unit 54, and a thumbnail image generation processing unit 55.
The image acquisition unit 52 acquires a plurality of images.
The moving image generation processing unit 54 generates a new moving image from the plurality of images acquired by the image acquisition unit 52.
The moving image generation processing unit 54 / thumbnail image generation processing unit 55 acquires a specific image from the plurality of images acquired by the image acquisition unit 52.
Also, the moving image generation processing unit 54 / thumbnail image generation processing unit 55 stores the new moving image generated by the moving image generation processing unit 54 in association with the acquired specific image in the generated image storage unit 73. Let Specifically, the moving image generation processing unit 54 / thumbnail image generation processing unit 55 stores a specific image so as to be included in the moving image, or stores it as a thumbnail image in the thumbnail area, associates it, It is stored in the image storage unit 73.
As a result, in the imaging device 1, it is possible to generate a moving image in which the user can more appropriately understand the content of the entire image.

The image acquisition unit 52 selects a number of images smaller than the total number of the plurality of acquired images from the plurality of acquired images.
The moving image generation processing unit 54 generates a new moving image from the plurality of images selected by the image acquisition unit 52.
The moving image generation processing unit 54 / thumbnail image generation processing unit 55 acquires a specific image from the plurality of images selected by the image acquisition unit 52.
As a result, in the imaging device 1, it is possible to generate a moving image in which the user can more appropriately understand the content of the entire image.

The imaging device 1 further includes an image selection condition setting processing unit 51 that evaluates the plurality of images acquired by the image acquisition unit 52 based on usage information of each of the plurality of images.
The image acquisition unit 52 selects, based on the evaluation result of the image selection condition setting processing unit 51, a plurality of relatively high evaluation images from the plurality of images evaluated by the image selection condition setting processing unit 51.
Thereby, in the imaging device 1, an image desired by the user can be selected.

The image selection condition setting processing unit 51 evaluates the plurality of images acquired by the image acquisition unit 52 based on the number of times of reproduction regarding the plurality of images and the favorite information as the usage information.
Thereby, in the imaging device 1, an image desired by the user can be selected.

The imaging device 1 further includes a collage image generation processing unit 53 that combines a plurality of images acquired by the image acquisition unit 52 into one image and generates a new image.
The moving image generation processing unit 54 acquires a new image generated by the collage image generation processing unit 53 as a specific image.
As a result, in the imaging device 1, it is possible to generate a moving image in which the user can more appropriately understand the content of the entire image during moving image reproduction.

The collage image generation processing unit 53 combines a plurality of images selected by the image acquisition unit 52 into one image to generate a new image.
As a result, in the imaging device 1, it is possible to generate an image that allows the user to more appropriately understand the content of the entire image.

The collage image generation processing unit 53 acquires information on the size of the generated image.
The collage image generation processing unit 53 determines the number of images to be combined in one image according to the information on the size of the image acquired by the information acquisition unit.
The collage image generation processing unit 53 generates a new image with the number of images determined by the determination unit.
The image acquisition unit 52 selects the number of images determined by the determination unit from the plurality of images acquired by the image acquisition unit 52.
Thereby, in the imaging device 1, it is possible to generate an image that allows the user to more appropriately understand the content of the entire image in one image.

The image acquisition unit 52 selects a plurality of images from the plurality of images acquired by the image acquisition unit 52 and the new image generated by the collage image generation processing unit 53.
The moving image generation processing unit 54 generates a new moving image from the plurality of images selected by the image acquisition unit 52.
As a result, in the imaging device 1, it is possible to generate a moving image in which the user can more appropriately understand the content of the entire image.

The thumbnail image generation processing unit 55 associates the acquired specific image with the output unit 18 so as to be displayed as a thumbnail image of a new moving image generated by the moving image generation processing unit 54 and causes the generated image storage unit 73 to be associated. Remember.
As a result, in the imaging device 1, it is possible to generate a thumbnail image attached to a moving image that allows the user to more appropriately understand the content of the entire image.

The thumbnail image generation processing unit 55 acquires information on the display size of the thumbnail image displayed on the output unit 18.
In addition, the thumbnail image generation processing unit 55 stores the information on the display size acquired by the thumbnail image generation processing unit 55 and the specific image in the generated image storage unit 73 as a new moving image thumbnail image in association with each other. Let
As a result, in the imaging device 1, it is possible to generate a thumbnail image that allows the user to more appropriately understand the content of the entire image.

  The present invention is not limited to the above-described embodiment, and modifications, improvements, and the like in the range in which the object of the present invention can be achieved are included in the present invention.

  Although the present invention is described to target moving images to which effects are added as problems to be solved, it is also possible to target moving images to which effects are not added.

  In the above embodiment, a collage image may be used as a thumbnail image. Further, even if a collage image is not generated, one image to be processed may be arbitrarily selected from a set of original images and resized for thumbnails.

  Further, in the above-described embodiment, one image is stored in the collage area for one moving image, but a thumbnail image with high visibility is displayed according to the display size of the thumbnail image of the display unit. As described above, a plurality of thumbnail images of different image sizes may be stored in the thumbnail area in one moving image.

  Further, in the above-described embodiment, the user selects the image size of the collage image for thumbnails to be generated, but even if thumbnail images of a plurality of sizes are automatically generated at one time good.

Moreover, in the above-mentioned embodiment, although the imaging device 1 to which this invention is applied was demonstrated as an example of the digital camera, it is not specifically limited to this.
For example, the present invention can be applied to electronic devices in general having an image generation processing function. Specifically, for example, the present invention is applicable to a laptop personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be performed by hardware or software.
In other words, the functional configuration of FIG. 4 is merely an example and is not particularly limited. That is, it is sufficient if the imaging apparatus 1 has a function capable of executing the above-described series of processes as a whole, and what functional block is used to realize this function is not particularly limited to the example of FIG.
Further, one functional block may be configured by hardware alone, may be configured by software alone, or may be configured by a combination of them.

When the series of processes are executed by software, a program that configures the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only configured by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body to provide the program to the user, but also the user in a state incorporated in advance in the apparatus main body The recording medium etc. provided to The removable medium 31 is made of, for example, a magnetic disk (including a floppy disk), an optical disk, or a magneto-optical disk. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), a Blu-ray (registered trademark) Disc (Blu-ray Disc), or the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. The recording medium provided to the user in a state of being incorporated in the apparatus main body is, for example, the ROM 12 of FIG. 1 in which the program is recorded, the hard disk included in the storage unit 19 of FIG.

  In the present specification, in the step of describing the program to be recorded on the recording medium, the processing performed chronologically along the order is, of course, parallel or individually not necessarily necessarily chronologically processing. It also includes the processing to be performed.

  While some embodiments of the present invention have been described above, these embodiments are merely illustrative and do not limit the technical scope of the present invention. The present invention can take other various embodiments, and furthermore, various changes such as omissions and substitutions can be made without departing from the scope of the present invention. These embodiments and modifications thereof are included in the scope and the gist of the invention described in the present specification, etc., and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the claims at the beginning of the application of the present application is appended below.
[Supplementary Note 1]
Image acquisition means for acquiring a plurality of images;
A moving image generation unit that generates a new moving image from the plurality of images acquired by the image acquisition unit;
Specific image acquisition means for acquiring a specific image from the plurality of images acquired by the image acquisition means;
Storage control means for storing the new moving image generated by the moving image generation means and the specific image acquired by the specific image acquisition means in the storage means in association with each other;
An image generating apparatus comprising:
[Supplementary Note 2]
An image selection unit configured to select a number of images smaller than the total number of the plurality of images from the plurality of images acquired by the image acquisition unit;
And further
The moving image generation unit generates the new moving image from the plurality of images selected by the image selection unit,
The specific image acquisition unit acquires the specific image from the plurality of images selected by the image selection unit.
The image generation device according to claim 1, characterized in that:
[Supplementary Note 3]
An evaluation unit that evaluates the plurality of images acquired by the image acquisition unit based on usage information of each of the plurality of images;
And further
The image selection means selects a plurality of images having a relatively high evaluation from the plurality of images evaluated by the evaluation means based on the evaluation result by the evaluation means.
The image generation apparatus according to any one of Additional Notes 1 or 2, characterized in that
[Supplementary Note 4]
The evaluation unit evaluates the plurality of images acquired by the image acquisition unit based on the number of times of reproduction regarding the plurality of images and favorite information as the use information.
The image generation device according to appendix 3, characterized in that
[Supplementary Note 5]
An image generation unit that combines the plurality of images acquired by the image acquisition unit into one image to generate a new image;
And further
The specific image acquisition unit acquires the new image generated by the image generation unit as a specific image.
The image generation device according to any one of appendices 1 to 4, characterized in that:
[Supplementary Note 6]
The image generation unit combines the plurality of images selected by the image selection unit into one image to generate a new image.
The image generation device according to Supplementary Note 5, characterized in that
[Supplementary Note 7]
An information acquisition unit that acquires information on the size of the image generated by the image generation unit;
A determination unit configured to determine the number of images to be combined in the one image according to the information on the size of the image acquired by the information acquisition unit;
And further
The image generation unit generates the new image with the number of images determined by the determination unit,
The image selection unit selects the number of images determined by the determination unit from the plurality of images acquired by the image acquisition unit.
The image generation apparatus according to claim 6, characterized in that
[Supplementary Note 8]
The image selection unit selects a plurality of images from the plurality of images acquired by the image acquisition unit and a new image generated by the image generation unit.
The moving image generation unit generates a new moving image from the plurality of images selected by the image selection unit.
The image generation device according to any one of appendices 1 to 7, characterized in that
[Supplementary Note 9]
The storage control unit associates the specific image acquired by the specific image acquisition unit with the display unit so as to display the specific image as a thumbnail image of the new moving image generated by the moving image generation unit. Remember in the means,
The image generation apparatus according to any one of appendices 1 to 8, characterized in that
[Supplementary Note 10]
A display information acquisition unit that acquires information on the display size of the thumbnail image displayed on the display unit;
And further
The storage control unit associates the information on the display size acquired by the display information acquisition unit with the specific image and stores the information as a thumbnail image of the new moving image in the storage unit.
The image generation device according to any one of appendices 1 to 9, characterized in that
[Supplementary Note 11]
An image generation method to be executed by an image generation apparatus comprising storage means, comprising:
An image acquisition step of acquiring a plurality of images;
A moving image generation step of generating a new moving image from the plurality of images acquired by the image acquisition step;
A specific image acquisition step of acquiring a specific image from the plurality of images acquired by the image acquisition step;
A storage control step of storing the new moving image generated in the moving image generation step and the specific image acquired in the specific image acquisition step in association with each other in the storage means;
A method of generating an image, comprising:
[Supplementary Note 12]
A computer for controlling an image generation device comprising storage means,
Image acquisition means for acquiring multiple images,
Moving image generation means for generating a new moving image from a plurality of images acquired by the image acquisition means,
Specific image acquisition means for acquiring a specific image from a plurality of images acquired by the image acquisition means,
Storage control means for storing the new moving image generated by the moving image generation means and the specific image acquired by the specific image acquisition means in the storage means in association with each other;
A program characterized by acting as

  DESCRIPTION OF REFERENCE NUMERALS 1 imaging device 11 CPU 12 ROM 13 13 RAM 14 bus 15 input / output interface 16 imaging unit 17 17 Input unit 18 Output unit 19 Storage unit 20 Communication unit 21 Drive 31 Removable media 51 Image selection condition setting processing unit 52 · · · Image acquisition unit, 53 · · · collage image generation processing unit, 54 · · · moving image generation processing unit, 55 · · · thumbnail image generation processing unit, 71 · · · · · · · processing target image storage unit, 72 · · · Template image storage unit, 73 ... generated image storage unit

Claims (13)

Image acquisition means for acquiring a plurality of images;
A moving image generation unit that generates a new moving image from the plurality of images acquired by the image acquisition unit;
Specific image acquisition means for acquiring a specific image from the plurality of images acquired by the image acquisition means;
Storage control means for storing the new moving image generated by the moving image generation means and the specific image acquired by the specific image acquisition means in the storage means in association with each other;
An image generating apparatus comprising: An image generation unit that combines the plurality of images acquired by the image acquisition unit into one image to generate a new image;
And further
The specific image acquisition unit acquires the new image generated by the image generation unit as a specific image.
The image generating apparatus according to claim 1, characterized in that. An image selection unit configured to select a number of images smaller than the total number of the plurality of images from the plurality of images acquired by the image acquisition unit;
And further
The moving image generation unit generates the new moving image from the plurality of images selected by the image selection unit,
The specific image acquisition unit acquires the specific image from the plurality of images selected by the image selection unit.
The image generation apparatus according to claim 2 , characterized in that: An evaluation unit that evaluates the plurality of images acquired by the image acquisition unit based on usage information of each of the plurality of images;
And further
The image selection means selects a plurality of images having a relatively high evaluation from the plurality of images evaluated by the evaluation means based on the evaluation result by the evaluation means.
The image generation apparatus according to claim 3 , characterized in that: The evaluation unit evaluates the plurality of images acquired by the image acquisition unit based on the number of times of reproduction regarding the plurality of images and favorite information as the use information.
The image generation apparatus according to claim 4 , characterized in that: The image generation unit combines the plurality of images selected by the image selection unit into one image to generate a new image.
The image generation apparatus according to any one of claims 3 to 5 , characterized in that: The image generation unit is configured to display one of the plurality of images selected by the image selection unit with an image size relatively high in the evaluation result and a larger image size than an image relatively low in the evaluation result. Compose in the image and generate a new image,
The image generation device according to claim 4 or 5, characterized in that: An information acquisition unit that acquires information on the size of the image generated by the image generation unit;
A determination unit configured to determine the number of images to be combined in the one image according to the information on the size of the image acquired by the information acquisition unit;
And further
The image generation unit generates the new image with the number of images determined by the determination unit,
The image selection unit selects the number of images determined by the determination unit from the plurality of images acquired by the image acquisition unit.
The image generation apparatus according to claim 6, wherein The image selection unit selects a plurality of images from the plurality of images acquired by the image acquisition unit and a new image generated by the image generation unit.
The moving image generation unit generates a new moving image from the plurality of images selected by the image selection unit.
The image generation apparatus according to any one of claims 3 to 8 , characterized in that: The storage control unit associates the specific image acquired by the specific image acquisition unit with the display unit so as to display the specific image as a thumbnail image of the new moving image generated by the moving image generation unit. Remember in the means,
The image generation apparatus according to any one of claims 1 to 9 , characterized in that: Display information acquisition means for acquiring information on the display size of the thumbnail image displayed on the display means;
And further
The storage control unit associates the information on the display size acquired by the display information acquisition unit with the specific image and stores the information as a thumbnail image of the new moving image in the storage unit.
The image generation apparatus according to any one of claims 1 to 10 , wherein An image generation method to be executed by an image generation apparatus comprising storage means, comprising:
An image acquisition step of acquiring a plurality of images;
A moving image generation step of generating a new moving image from the plurality of images acquired by the image acquisition step;
A specific image acquisition step of acquiring a specific image from the plurality of images acquired by the image acquisition step;
A storage control step of storing the new moving image generated in the moving image generation step and the specific image acquired in the specific image acquisition step in association with each other in the storage means;
A method of generating an image, comprising: A computer for controlling an image generation device comprising storage means,
Image acquisition means for acquiring multiple images,
Moving image generation means for generating a new moving image from a plurality of images acquired by the image acquisition means,
Specific image acquisition means for acquiring a specific image from a plurality of images acquired by the image acquisition means,
Storage control means for storing the new moving image generated by the moving image generation means and the specific image acquired by the specific image acquisition means in the storage means in association with each other;
A program characterized by acting as

Images