JP2016181823A - Image processing apparatus, image processing method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a user load when selecting an image to generate a composite image from a plurality of images.SOLUTION: An imaging apparatus 1 includes: an image acquisition unit 51, an image evaluation unit 53, an image selection unit 55 and an image generation unit 56. The image acquisition unit 51 acquires a plurality of images. The image evaluation unit 53 respectively evaluates the plurality of images acquired from the image acquisition unit 51, on the basis of information caused by at least one operation among operations related to specific imaging, editing and reproduction of each image. Based on the evaluation result by the image evaluation unit 53, the image selection unit 55 selects a predetermined number of specific images from the plurality of images. The image generation unit 56 generates a new image from the predetermined number of specific images selected by the image selection unit 55.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for generating an image.

  Conventionally, a method of arbitrarily selecting a plurality of images from a plurality of images and synthesizing the plurality of images has been performed (see Patent Document 1).

JP 2000-043363 A

  However, in the technique described in Patent Document 1 described above, since it is necessary to arbitrarily select individual images, the burden on the user may increase depending on the amount of images to be selected.

  The present invention has been made in view of such a situation, and an object thereof is to reduce a burden on a user who selects an image when generating a composite image from a plurality of images.

In order to achieve the above object, an image generation apparatus according to an aspect of the present invention includes:
Acquisition means for acquiring a plurality of images;
An evaluation unit that evaluates the plurality of images acquired by the acquisition unit based on information resulting from at least one of operations related to specific shooting, editing, and reproduction for each image;
Selection means for selecting a predetermined number of specific images from the plurality of images based on the evaluation result by the evaluation means;
Generating means for generating a new image from the predetermined number of specific images selected by the selecting means;
It is provided with.

  According to the present invention, it is possible to reduce a burden on a user who selects an image when generating a composite image from a plurality of images.

It is a block diagram which shows the hardware constitutions of the imaging device which concerns on one Embodiment of the image processing apparatus of this invention. It is a schematic diagram for demonstrating the production | generation of a digest moving image. It is a functional block diagram which shows the functional structure for performing an image generation process among the functional structures of the imaging device of FIG. 4 is a flowchart illustrating a flow of image generation processing executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG. 3.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a hardware configuration of an imaging apparatus according to an embodiment of the image processing apparatus of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an imaging unit 16, and an input unit 17. An output unit 18, a storage unit 19, a communication unit 20, and a drive 21.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 19 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, an input unit 17, an output unit 18, a storage unit 19, a communication unit 20, and a drive 21 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured by a lens that collects light, for example, a focus lens or a zoom lens, in order to photograph a subject.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16.
Hereinafter, the output signal of the imaging unit 16 is referred to as “captured image data”. Data of the captured image is appropriately supplied to the CPU 11 or an image processing unit (not shown).

The input unit 17 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 18 includes a display, a speaker, and the like, and outputs images and sounds.
The storage unit 19 is composed of a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 20 controls communication performed with other devices (not shown) via a network including the Internet.

  A removable medium 31 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 21. The program read from the removable medium 31 by the drive 21 is installed in the storage unit 19 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 19 in the same manner as the storage unit 19.

  In the imaging apparatus 1 configured as described above, in the present embodiment, a plurality of images are evaluated, and one moving image (hereinafter referred to as a “digest moving image”) that is a new image from the images selected based on the evaluation. .)).

FIG. 2 is a schematic diagram for explaining the generation of a digest video.
In this embodiment, as shown in FIG. 2, one digest video is generated from a still image or a video.
For example, in the case of a still image, an image is selected from the evaluated / sorted images based on the evaluation result, and a digest moving image having the selected image as a frame image is generated.
In the case of a moving image, a moving image is selected from the evaluated and sorted moving images based on the evaluation result, and a digest moving image is generated from the frame image of the selected moving image. In this case, a plurality of frame images can be selected from the selected moving image.
In addition, a digest video can be generated from a single video. In this case, the frame images constituting the video are evaluated and sorted, and the frame image is selected based on the evaluation result. Generate a digest video.
In addition, a digest moving image can be generated from a still image and a moving image, and the user can select the type of image used for the generation.
Hereinafter, a still image or a frame image used as a frame image constituting a digest video is simply referred to as an image.

Here, the evaluation performed when the digest video is generated will be described.
The evaluation method used in the present embodiment determines the evaluation by summing up the points corresponding to operations such as photographing, editing, and reproduction for an image. In the present embodiment, operations such as photographing, editing, and reproduction for images are stored as operation-related information during operation and used for evaluation.
In this embodiment, the evaluation items are related to an image editing operation, related to a specific image capturing operation during image capturing, based on an operation for capturing a still image during moving image capturing, or based on an operation related to playback.
As image editing operations (editing history), for example, in the items of lighting (+1), white balance (+1), brightness editing (+1), trimming (+2), protect (+2) An evaluation is made.
As the specific imaging operation (imaging operation history) at the time of imaging, for example, in the items of the shutter long press operation (+3) and the focus operation (+2), an evaluation of a score shown in () is made.
In the item of the operation (still image saving history) for shooting as a still image at the time of moving image shooting, for example, an evaluation of (+2) is given.
As operations related to playback (playback history), when the evaluation target is a still image, playback immediately after shooting (+1), playback in multi playback (+1), and enlarged playback (+1), and when the evaluation target is a moving image In the items of normal playback (+1), enlarged playback (+3), pause & frame advance (+2), fast forward (-1), and fast reverse (+1) for each frame for which the target operation has been performed ( ) Is evaluated as a score shown in ().

Further, in this embodiment, the group classification is performed based on the evaluation items described above and the closeness of the shooting date / time and the shooting location of the image.
When configured to select an image with a high evaluation, when an image having a specific evaluation item is biased and receives a high evaluation, a large number of images having a specific evaluation item are selected. If grouping is performed for each evaluation item, a predetermined number of images are selected in the group, so that selection bias in the evaluation item can be reduced. In addition, when selection with an evaluation item is desired, for example, selection may be made only from a specific group, or selection may be weighted so as to increase the number of sheets selected from a specific group.
Further, if the group classification is performed based on the shooting date and time or the proximity of the shooting location, it is possible to eliminate the image bias in similar scenes.

  In addition, regarding the selection of images, a predetermined number of images can be selected from each group, an image can be selected from a specific group, or the number of images selected for each group can be weighted. For selecting an image within a group, for example, an image evaluation result such as selecting a highly evaluated image is used. Conversely, it may be configured not to select an image with a low evaluation or a negative evaluation.

FIG. 3 is a functional block diagram illustrating a functional configuration for executing the image generation process among the functional configurations of the imaging apparatus 1 as described above.
The image generation process evaluates an image, evaluates a plurality of images obtained by classifying the evaluated images into groups, selects a highly evaluated image for each group, and generates a digest movie from the selected image. This is a series of processing.

  As shown in FIG. 3, the image generation unit 51, the image evaluation unit 53, the image classification unit 54, the image selection unit 55, and the image generation unit 56 function in the image generation processing in the CPU 11.

  An image storage unit 71 and an image information storage unit 72 are set in one area of the storage unit 19.

The image storage unit 71 stores image data acquired from shooting or an external network.
In the acquired image, information on the shooting date and the shooting location is stored as supplementary information.

The image information storage unit 72 stores information resulting from an operation on an image acquired by shooting or the like. In this embodiment, information resulting from an operation is information related to image editing of an image, information related to a specific imaging operation at the time of imaging, information about whether or not a still image was captured at the time of moving image shooting, or information related to playback. .
The image editing operation (editing history) information includes, for example, whether or not lighting, white balance, brightness editing, trimming, and protection operations are performed.
The information on the specific imaging operation (imaging operation history) at the time of imaging is, for example, information on presence / absence of a shutter long press operation and a focus operation.
The information on the operation (still image saving history) for shooting as a still image during moving image shooting is information on the presence or absence of the operation.
For information on operations related to playback (playback history), for example, if the evaluation target is a still image, playback immediately after shooting, playback in multiple playback, and enlarged playback, and if the evaluation target is a video, the target This is information on the presence / absence of normal playback, enlarged playback, pause & frame advance, fast forward, and fast reverse for each frame that has been operated.
The imaging apparatus 1 monitors an operation on an image, and stores an image and an operation in association with each other in image information when the operation is performed.

The image acquisition unit 51 selects the type of image used to generate a digest video specified by the user. Specifically, the user selects the type of image specified from only a still image, only a moving image, or a still image and a moving image.
Further, the image acquisition unit 51 acquires an image stored in the image storage unit 71 based on the type of the selected image.

The image setting unit 52 determines (sets) the number of images to be used by a user operation on the input unit 17. In the present embodiment, in order to generate a digest movie, the number of images used is set in consideration of the playback time per movie in the movie. It is also possible to configure so that the playback time for one sheet is set according to the selection order. If the generated image is not a moving image but an image (for example, a collage image), the number of used images is set as it is.
Further, the image setting unit 52 sets weights in the group of the selected number of sheets by the user's operation on the input unit 17. The selected number of sheets in the group is set by weighting the selected number of sheets in the group. In the present embodiment, whether or not to weight the selected number is set for evaluation items that are not used for group separation. For example, grouping is performed by date, and weighting is set such that an image having an image editing history is preferentially selected from the evaluation items.

  The image evaluation unit 53 evaluates the image acquired by the image acquisition unit 51. Specifically, the image evaluation unit 53 refers to the information resulting from the operation stored in the image information storage unit 72, assigns a score to each scoring item for each image, and uses the total score, Evaluate. An image with a high score is rated high, an image with a low score is rated low, and an image with a negative score is an unused image.

  The image sorting unit 54 sorts images into groups for each evaluation item. Specifically, the image classification unit 54 refers to, for example, the additional information of the image and the information resulting from the operation stored in the image information storage unit 72, and the closeness of the shooting date and the shooting location and the evaluation items. Perform a grouping that combines.

  The image selection unit 55 selects an image from each group. Specifically, the image selection unit 55 sets, for example, one image or a group of images that have a high score and high evaluation in each group for a predetermined number of images (for example, considering the playback time of the digest movie). Selected). The image selection unit 55 can also be configured to select images with different numbers of images according to the type of group.

  The image generation unit 56 generates a digest video from the image selected by the image selection unit 55. Specifically, the image generation unit 56 generates frame images so that each selected image has a predetermined playback time, rearranges them in the playback order, and combines them to generate one digest video. .

FIG. 4 is a flowchart for explaining the flow of image generation processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.
The image generation process is started by an operation for starting the image generation process on the input unit 17 by the user.

  In step S <b> 11, the image acquisition unit 51 acquires an image stored in the image storage unit 71.

  In step S <b> 12, the image acquisition unit 51 selects the type of image used for generating a digest video specified by the user. Specifically, the user selects the type of image specified from only a still image, only a moving image, or a still image and a moving image.

  In step S13, the image acquisition unit 51 acquires an image of the selected image type from the acquired image based on the selected image type.

  In step S <b> 14, the image setting unit 52 determines (sets) the number of images to be used by a user operation on the input unit 17. In the present embodiment, in order to generate a digest movie, the number of images used is set in consideration of the playback time per movie in the movie.

In step S <b> 15, the image evaluation unit 53 evaluates the image acquired by the image acquisition unit 51. Specifically, the image evaluation unit 53 refers to the information resulting from the operation stored in the image information storage unit 72, assigns a score for each allocation item for each image, and evaluates based on the total score. I do. An image with a high score is rated high, an image with a low score is rated low, and an image with a negative score is an unused image.
Specifically, the evaluation is performed with the total score in the image under the following evaluation items and points.
As image editing operations (editing history), for example, in the items of lighting (+1), white balance (+1), brightness editing (+1), trimming (+2), protect (+2) An evaluation is made.
As the specific imaging operation (imaging operation history) at the time of imaging, for example, in the items of the shutter long press operation (+2) and the focus operation (+2), an evaluation of a score shown in () is made.
For the item of operation (still image saving history) taken as a still image at the time of moving image shooting, for example, an evaluation with a score of (+2) is made.
As operations related to playback (playback history), when the evaluation target is a still image, playback immediately after shooting (+1), playback in multi playback (+1), and enlarged playback (+1), and when the evaluation target is a moving image In the items of normal playback (+1), enlarged playback (+3), pause & frame advance (+2), fast forward (-1), and fast reverse (+1) for each frame for which the target operation has been performed ( ) Is evaluated as a score shown in ().

  In step S16, the image sorting unit 54 sorts the images into groups for each evaluation item. Specifically, the image classification unit 54 refers to the additional information of the image and the information resulting from the operation stored in the image information storage unit 72, and determines each of the evaluation date and the proximity of the shooting date and the shooting location. Grouping is performed depending on whether or not an image is edited, whether or not a specific imaging operation is performed at the time of imaging, and whether or not the image is a still image at the time of moving image shooting. For example, images that are close to the shooting date and are undergoing image editing are classified as one group.

In step S <b> 17, the image setting unit 52 determines whether or not to perform a weighting process for the selected number. Specifically, the image setting unit 52 determines to perform the weighting process of the selected number of sheets when the weighting in the group of the selected number of sheets is set by the user's operation on the input unit 17.
When the weighting process for the selected number is not performed, YES is determined in step S17, and the process proceeds to step S18.

  In step S18, the image setting unit 52 sets the selected number for each group. That is, the image setting unit 52 sets the selection number for each group by weighting the selection number in the group based on the user's operation on the input unit 17. At this time, the image setting unit 52 sets whether or not to weight the selected number of sheets with evaluation items that are not used for group separation. Specifically, for example, the image setting unit 52 performs group sorting by date, and performs setting so that an image having an image editing history is preferentially selected from among the evaluation items.

  On the other hand, when the weighting process of the selected number is not performed, NO is determined in step S17, and the process proceeds to step S19.

  In step S19, the image selection unit 55 selects an image from each group. Specifically, for example, the image selection unit 55 selects an image having a high score and high evaluation in each group. In addition, when the number of selections for each group is set, the image selection unit 55 selects images with different numbers of images according to the type of group.

In step S <b> 20, the image generation unit 56 generates a digest video from the image selected by the image selection unit 55. Specifically, the image generation unit 56 generates frame images so that each selected image has a predetermined playback time, rearranges them in the playback order, and combines them to generate one digest video. . As a result, as shown in FIG. 2, a digest movie is generated from a movie or a still image.
Thereafter, the image generation process ends.

The imaging device 1 configured as described above includes an image acquisition unit 51, an image evaluation unit 53, an image selection unit 55, and an image generation unit 56.
The image acquisition unit 51 acquires a plurality of images.
The image evaluation unit 53 evaluates the plurality of images acquired from the image acquisition unit 51 based on information resulting from at least one operation among operations related to specific shooting, editing, and reproduction for each image.
The image selection unit 55 selects a predetermined number of specific images from a plurality of images based on the evaluation result by the image evaluation unit 53.
The image generation unit 56 generates a new image from a predetermined number of specific images selected by the image selection unit 55.
Thereby, in the imaging device 1, since the selection of the image reflecting the user's interest / disapproval can be performed by selecting the image based on the evaluation based on the information resulting from the operation, the user's interest is further increased. It is possible to generate a new image composed of a high image. Further, since it is not necessary for the user to search for and select an image of high interest, it is possible to reduce the time and effort for selecting the image.

Operations related to image editing include operations for changing lighting, white balance, brightness, trimming, or protection.
Thereby, in the imaging device 1, an image can be evaluated by an operation of changing lighting, white balance, brightness, trimming, or protection, and the user does not have to search for and select an image of high interest. Therefore, it is possible to reduce the trouble of image selection.

The operation related to specific imaging at the time of imaging includes a zoom operation, a shutter long press operation, a focus operation, or a still image shooting operation during moving image shooting.
Thereby, in the imaging device 1, an image can be evaluated by a zoom operation, a shutter long press operation, a focus operation, or a still image shooting operation during moving image shooting, and it is necessary for the user to find and select an image of high interest. This eliminates the need for image selection.

The operation related to reproduction includes a reproduction operation immediately after shooting when reproducing a still image, a reproduction operation selected and reproduced during multi-reproduction, or an enlarged reproduction operation.
Thereby, in the imaging device 1, when reproducing a still image, the image can be evaluated by a reproduction operation immediately after shooting, a reproduction operation selected and reproduced at the time of multi-reproduction, or an enlarged reproduction operation, and the user is highly interested. Since it is not necessary to search for and select an image by itself, it is possible to reduce time and effort for image selection.

The operation related to reproduction includes an operation of enlargement reproduction, pause, frame advance or fast reverse when reproducing a moving image.
Thereby, in the imaging device 1, when a moving image is reproduced, the image can be evaluated by an operation of enlargement reproduction, pause, frame advance, or fast reverse, and it is necessary for the user to find and select an image of high interest. Therefore, it is possible to reduce the time and labor for image selection.

The imaging device 1 further includes an image sorting unit 54.
The image sorting unit 54 sorts a plurality of images into a plurality of groups based on information resulting from the operation.
The image selection unit 55 selects a predetermined number of specific images from each of the plurality of groups sorted by the image sorting unit 54.
Thereby, in the imaging device 1, in order to classify an image into a plurality of groups based on information resulting from an operation, an image group can be configured for each type of user's interest. There is no need to unconsciously select many images, and it is possible to select various images that the user is highly interested in.

The image classification unit 54 acquires related information for each of the plurality of images acquired by the image acquisition unit 51.
The image sorting unit 54 sorts the plurality of images into a plurality of groups based on the related information acquired by the image sorting unit 54 and the evaluation result by the image evaluation unit 53.
Thereby, in the imaging device 1, for example, by further sorting into groups based on related information such as date and place, images of similar scenes are not selected. You can choose.

The imaging apparatus 1 further includes an image setting unit 52 that determines the number of images used for image generation in the image generation unit 56.
The image selection unit 55 selects a specific image from a plurality of images based on the number of images determined by the image setting unit 52.
Thereby, in the imaging device 1, the number of images can be determined, and a new image composed of an arbitrary number can be generated.

The image setting unit 52 weights the number of images selected from each of the plurality of groups based on either the evaluation result of the image evaluation unit 53 of each image or the accompanying information of the image.
Thereby, in the imaging device 1, since the weighting of the number of images is set for each group based on either the evaluation result of each image or the supplementary information of the image, it depends on the evaluation result or the supplementary information of the image and the group. It is possible to generate a new image in consideration of uneven weight.

The image acquisition unit 51 acquires a plurality of images from one moving image.
The image generation unit 56 generates a digest video in which scenes constituting one video are aggregated from the images acquired by the image acquisition unit 51.
Thereby, in the imaging device 1, a moving image that attracts the user's interest can be generated.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

In the above-described embodiment, an example in which a new image (digest movie in the present embodiment) is generated from a plurality of images (still images and moving images) has been described. For example, a new image such as a collage image may be generated by evaluating each frame in one moving image. In this case, it is not necessary to view all the moving images in order to generate the collage image in a form that summarizes the original moving images. This is particularly effective for long moving images. In addition, when the generated collage image is used as a thumbnail of a moving image, the contents of the entire moving image are reflected, and the visibility and discriminability of the moving image can be improved.
In addition, when an operation is performed during shooting of a moving image and a still image is saved, a collage image composed of the still image may be generated. Also in this case, the generated collage image can be used as a thumbnail.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having an image generation processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 3 is merely an example, and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in this. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 19 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
Acquisition means for acquiring a plurality of images;
An evaluation unit that evaluates the plurality of images acquired by the acquisition unit based on information resulting from at least one of operations related to specific shooting, editing, and reproduction for each image;
Selection means for selecting a predetermined number of specific images from the plurality of images based on the evaluation result by the evaluation means;
Generating means for generating a new image from the predetermined number of specific images selected by the selecting means;
An image generation apparatus comprising:
[Appendix 2]
The operation related to the editing of the image includes an operation of changing lighting, white balance, brightness, trimming or protection,
The image generating apparatus according to Supplementary Note 1, wherein
[Appendix 3]
The operation related to specific imaging at the time of imaging includes a zoom operation, a shutter long press operation, a focus operation, or a still image shooting operation during moving image shooting,
The image generating apparatus according to appendix 1 or 2, characterized in that:
[Appendix 4]
The operation related to the reproduction includes a reproduction operation immediately after shooting when reproducing a still image, a reproduction operation selected and reproduced during multi-reproduction, or an enlarged reproduction operation.
The image generation apparatus according to any one of supplementary notes 1 to 3, wherein:
[Appendix 5]
The operation related to the reproduction includes an operation of enlargement reproduction, pause, frame advance or fast reverse when reproducing a moving image,
The image generation apparatus according to any one of supplementary notes 1 to 4, wherein
[Appendix 6]
Based on information resulting from the operation, the image processing apparatus further includes a sorting unit that sorts the plurality of images into a plurality of groups.
The selecting means selects a predetermined number of specific images from each of a plurality of groups sorted by the sorting means;
The image generating device according to any one of appendices 1 to 5, characterized in that:
[Appendix 7]
Further comprising information acquisition means for acquiring related information for each of the plurality of images acquired by the acquisition means;
The classification unit classifies the plurality of images into a plurality of groups based on the related information acquired by the information acquisition unit and the evaluation result by the evaluation unit.
The image generating apparatus according to appendix 6, wherein:
[Appendix 8]
An image number determining means for determining the number of images used for image generation in the generating means;
The selection unit selects a specific image from the plurality of images based on the number of images determined by the number-of-images determination unit;
The image generating apparatus according to Supplementary Note 1, wherein
[Appendix 9]
The selection means further comprises weighting means for weighting the number of images selected from each of the plurality of groups based on either the evaluation result of the evaluation means of each image or the supplementary information of the image.
The image generation apparatus according to any one of supplementary notes 1 to 4, wherein
[Appendix 10]
The acquisition unit acquires a plurality of images from one moving image,
The generation unit generates a digest video in which scenes constituting the first video are aggregated from the image acquired by the acquisition unit.
The image generation apparatus according to any one of supplementary notes 1 to 4, wherein
[Appendix 11]
An acquisition step of acquiring a plurality of images;
An evaluation step for evaluating each of the plurality of images acquired from the acquisition step based on information resulting from at least one operation among operations related to specific shooting, editing, and reproduction for each image;
A selection step of selecting a predetermined number of specific images from the plurality of images based on the evaluation result of the evaluation step;
A generation step of generating a new image from the predetermined number of specific images selected in the selection step;
An image generation method comprising:
[Appendix 12]
Computer
An acquisition means for acquiring a plurality of images;
An evaluation unit that evaluates each of the plurality of images acquired by the acquisition unit based on information resulting from at least one of operations related to specific shooting, editing, and reproduction for each image;
Selection means for selecting a predetermined number of specific images from the plurality of images based on the evaluation result by the evaluation means;
Generating means for generating a new image from the predetermined number of specific images selected by the selecting means;
A program characterized by functioning as

DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input-output interface, 16 ... Imaging part, 17 ... Input unit 18 ... Output unit 19 ... Storage unit 20 ... Communication unit 21 ... Drive 31 ... Removable media 51 ... Image acquisition unit 52 ... Image Setting unit 53... Image evaluating unit 54... Image sorting unit 55... Image selecting unit 56. Part

Claims (12)

Acquisition means for acquiring a plurality of images;
An evaluation unit that evaluates the plurality of images acquired by the acquisition unit based on information resulting from at least one of operations related to specific shooting, editing, and reproduction for each image;
Selection means for selecting a predetermined number of specific images from the plurality of images based on the evaluation result by the evaluation means;
Generating means for generating a new image from the predetermined number of specific images selected by the selecting means;
An image generation apparatus comprising: The operation related to the editing of the image includes an operation of changing lighting, white balance, brightness, trimming or protection,
The image generating apparatus according to claim 1. The operation related to specific imaging at the time of imaging includes a zoom operation, a shutter long press operation, a focus operation, or a still image shooting operation during moving image shooting,
The image generation apparatus according to claim 1, wherein the image generation apparatus is an image generation apparatus. The operation related to the reproduction includes a reproduction operation immediately after shooting when reproducing a still image, a reproduction operation selected and reproduced during multi-reproduction, or an enlarged reproduction operation.
The image generation apparatus according to claim 1, wherein the image generation apparatus is an image generation apparatus. The operation related to the reproduction includes an operation of enlargement reproduction, pause, frame advance or fast reverse when reproducing a moving image,
The image generation apparatus according to claim 1, wherein the image generation apparatus is an image generation apparatus. Based on information resulting from the operation, the image processing apparatus further includes a sorting unit that sorts the plurality of images into a plurality of groups.
The selecting means selects a predetermined number of specific images from each of a plurality of groups sorted by the sorting means;
The image generation apparatus according to claim 1, wherein the image generation apparatus is an image generation apparatus. Further comprising information acquisition means for acquiring related information for each of the plurality of images acquired by the acquisition means;
The classification unit classifies the plurality of images into a plurality of groups based on the related information acquired by the information acquisition unit and the evaluation result by the evaluation unit.
The image generation apparatus according to claim 6. An image number determining means for determining the number of images used for image generation in the generating means;
The selection unit selects a specific image from the plurality of images based on the number of images determined by the number-of-images determination unit;
The image generating apparatus according to claim 1. The selection means further comprises weighting means for weighting the number of images selected from each of the plurality of groups based on either the evaluation result of the evaluation means of each image or the supplementary information of the image.
The image generation apparatus according to claim 1, wherein the image generation apparatus is an image generation apparatus. The acquisition unit acquires a plurality of images from one moving image,
The generation unit generates a digest video in which scenes constituting the first video are aggregated from the image acquired by the acquisition unit.
The image generation apparatus according to claim 1, wherein the image generation apparatus is an image generation apparatus. An acquisition step of acquiring a plurality of images;
An evaluation step for evaluating each of the plurality of images acquired from the acquisition step based on information resulting from at least one operation among operations related to specific shooting, editing, and reproduction for each image;
A selection step of selecting a predetermined number of specific images from the plurality of images based on the evaluation result of the evaluation step;
A generation step of generating a new image from the predetermined number of specific images selected in the selection step;
An image generation method comprising: Computer
An acquisition means for acquiring a plurality of images;
An evaluation unit that evaluates each of the plurality of images acquired by the acquisition unit based on information resulting from at least one of operations related to specific shooting, editing, and reproduction for each image;
Selection means for selecting a predetermined number of specific images from the plurality of images based on the evaluation result by the evaluation means;
Generating means for generating a new image from the predetermined number of specific images selected by the selecting means;
A program characterized by functioning as

Images