JP2015029178A - Imaging device, imaging method and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate an image with an extended imaging area which includes a plurality of excellent subject images.SOLUTION: A CPU 11 sequentially acquires a plurality of images with changing their imaging areas as partial images. A face region evaluation processing part 54 detects subject images from each of the plurality of acquired partial images having different imaging areas. The face region evaluation processing part 54 evaluates each of the detected subject images. An image synthesis processing part 56 selects an image, having a subject image with a higher evaluation result, as an image for synthesis, within a plurality of partial images containing the same subject image. The image synthesis processing part 56 generates an image with an extended imaging area by synthesizing a plurality of acquired partial images containing different subject images and a selected partial image for synthesis within the plurality of partial images containing the same subject image.

Description

  The present invention relates to an imaging apparatus, an imaging method, and a program.

  A technique for generating a panoramic image with a wide angle of view that cannot be obtained by a single shooting by combining a plurality of images while shooting and changing the imaging range is known as Patent Document 1 It has become.

JP-A-11-282100

  However, when a group photo is taken a plurality of times while changing the imaging range and a panoramic image is generated while changing the imaging range, if there is no smile, blinking, etc., all the subject images There is a problem that it is difficult to generate an image with a good shooting state.

  The present invention has been made in view of such a situation, and an object of the present invention is to generate an image with an extended shooting range including a plurality of good subject images.

In order to achieve the above object, an imaging device of one embodiment of the present invention includes:
Image acquisition means for sequentially acquiring a plurality of images taken while changing the imaging range as partial images;
Detection means for detecting a subject image from each of a plurality of partial images having different shooting ranges acquired by the image acquisition means;
Subject image evaluation means for evaluating each subject image detected by the detection means;
A plurality of partial images including the same subject image by the subject image evaluation unit, a subject image selection unit that selects a partial image including the subject image that has obtained higher evaluation as a synthesis target;
A plurality of partial images including different subject images acquired by the image acquisition unit and a partial image selected as the combination target by the subject image selection unit among a plurality of partial images including the same subject image are combined. Image generating means for generating a single image with an expanded shooting range,
It is characterized by providing.

  According to the present invention, it is possible to generate an image with an extended shooting range including a plurality of good subject images.

It is a block diagram which shows the structure of the hardware of the imaging device which concerns on one Embodiment of this invention. It is a functional block diagram which shows the functional structure for performing an imaging process among the functional structures of the imaging device of FIG. It is a schematic diagram for demonstrating adjustment of a zoom ratio. It is a schematic diagram for demonstrating a non-good face area | region display. 3 is a flowchart for explaining a flow of panoramic photographing processing executed by the imaging apparatus of FIG. 1 having the functional configuration of FIG. 2. It is a figure for demonstrating a photography flag. It is a flowchart explaining the detailed flow of a zoom ratio adjustment process among panoramic imaging processes. It is a flowchart explaining the detailed flow of a non-good face area | region display process among panoramic imaging processes. It is a flowchart explaining the detailed flow of a face area evaluation process among panoramic imaging processes. It is a flowchart explaining the detailed flow of an image compositing process among panoramic imaging processes. It is a flowchart explaining the detailed flow of the modification of an unfavorable face area | region display process among panoramic imaging processes. It is a schematic diagram for demonstrating the non-good face area | region display in a modification. It is a flowchart explaining the flow of the panorama imaging | photography process in other embodiment which the imaging device of FIG. 1 which has the functional structure of FIG. 2 performs. It is a flowchart explaining the detailed flow of a face area | region evaluation process among the panorama imaging processes of other embodiment. It is a flowchart explaining the detailed flow of an image compositing process among the panorama imaging processes of other embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a hardware configuration of an imaging apparatus 1 according to an embodiment of the present invention.
The imaging device 1 is configured as a digital camera, for example.

  The imaging apparatus 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an imaging unit 16, and an acceleration sensor 17. An input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22.

  The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  The RAM 13 appropriately stores data necessary for the CPU 11 to execute various processes.

  The CPU 11, ROM 12, and RAM 13 are connected to each other via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, an acceleration sensor 17, an input unit 18, an output unit 19, a storage unit 20, a communication unit 21, and a drive 22 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit includes a lens that collects light, such as a focus lens and a zoom lens, in order to capture a subject image.
The focus lens is a lens that forms a subject image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length within a certain range.
The optical lens unit is also provided with a peripheral circuit for adjusting setting parameters such as focus, exposure, and white balance as necessary.

The image sensor includes a photoelectric conversion element, AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a CMOS (Complementary Metal Oxide Semiconductor) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) the subject image, accumulates the image signal for a predetermined time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on the analog image signal. Through various signal processing, a digital signal is generated and output as an output signal of the imaging unit 16.
Hereinafter, the output signal of the imaging unit 16 is referred to as “captured image data”. Data of the captured image is appropriately supplied to the CPU 11, the image processing unit, and the like.
Also, among the captured images, the captured image displayed in real time on the display screen during live view display is referred to as “live view image”, and the captured image displayed for confirmation after the imaging operation by the user is referred to as “review image”. Call.

  The acceleration sensor 17 is configured to be able to detect the speed and acceleration of the imaging device 1. The movement of the imaging device 1 can be detected from the change in position of the imaging device 1 based on the speed and acceleration detected by the acceleration sensor 17.

The input unit 18 includes various buttons and the like, and inputs various types of information according to user instruction operations.
The output unit 19 includes a display, a speaker, and the like, and outputs images and sounds.
The storage unit 20 is configured by a hard disk, a DRAM (Dynamic Random Access Memory), or the like, and stores various image data.
The communication unit 21 controls communication with other devices (not shown) via a network including the Internet.

  A removable medium 31 composed of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately attached to the drive 22. The program read from the removable medium 31 by the drive 22 is installed in the storage unit 20 as necessary. The removable medium 31 can also store various data such as image data stored in the storage unit 20 in the same manner as the storage unit 20.

In such an imaging apparatus 1, for example, when it is desired to take a group photo in which a plurality of subject images become main subject images, one image is obtained in a state where each subject image is photographed under favorable photographing conditions. It has a function that can generate a picked-up image.
Note that “good shooting conditions” in the subject image correspond to good conditions of the subject image itself for the purpose of use of the image (for example, a smiling state, no blinking state, no red-eye state, etc.) and subject image. Including the conditions of the external environment (for example, a state where the focus is not blurred, a state where there is no shade, backlight, etc.)
Further, in the present embodiment, the imaging apparatus 1 is configured to perform panoramic shooting, taking a group photograph as an example, and generate one panoramic image from a plurality of captured images.
In this case, the imaging apparatus 1 determines the state of the person's face that is the subject image as the shooting condition as a favorable shooting condition. Specifically, as favorable imaging conditions, for example, a state where the face is smiling and a state where the eyes are not closed. That is, a state where the face is not smiling or a state where the eyes are closed is determined as an unfavorable shooting condition.

FIG. 2 is a functional block diagram illustrating a functional configuration for executing the panoramic photographing process among the functional configurations of the imaging apparatus 1 as described above.
In the panorama shooting process, an area to be shot (hereinafter, referred to as “shooting scheduled area”) having an angle of view to be a panoramic image is sequentially shot while moving the imaging apparatus 1, and finally acquired plural images are obtained. This refers to a series of processes from combining captured images to generating a panoramic image that is a single combined image. In the panorama shooting process, if the subject image in the captured image is not in a favorable shooting condition, the image is shot again, and the captured image shot again is overwritten and combined to generate a panoramic image. In the present embodiment, the panoramic image having the target imaging range as the scheduled imaging area is configured such that a plurality of captured images obtained by partially imaging the scheduled imaging area become partial images.

  When executing the panorama shooting process, the CPU 11 performs a zoom ratio adjustment processing unit 51, a face region detection processing unit 52, a movement detection unit 53, a face region evaluation processing unit 54, and an unfavorable face region display processing unit. 55 and the image composition processing unit 56 function.

  An area of the storage unit 20 is provided with an image storage unit 71 that stores image data and information about the image.

The zoom ratio adjustment processing unit 51 performs zoom ratio adjustment processing.
The “zoom ratio adjustment process” is a series of processes until the zoom ratio is adjusted so that shooting is performed with a size that allows the evaluation value to be calculated in the evaluation target.
Specifically, in the zoom ratio adjustment process, the zoom ratio is adjusted to such an extent that the state of the face that is the subject image as the evaluation target can be evaluated in the planned shooting area.

  The face area detection processing unit 52 executes zoom ratio adjustment processing. Specifically, the face area detection processing unit 52 detects the face area of the image stored in the image storage unit 71 in the zoom ratio adjustment process. A well-known face detection technique is used to detect a face area in an image.

Here, the zoom ratio adjustment executed in the zoom ratio adjustment process will be described.
FIG. 3 is a schematic diagram for explaining the adjustment of the zoom ratio.
In the zoom ratio adjustment process, first, as shown in FIG. 3A, an image obtained by photographing the scheduled photographing region R1 is acquired. Then, all the faces F to be evaluated are detected, and the size of the face region R2 of each face F is acquired.
Further, based on the acquired sizes of all the face regions R2, it is possible to calculate a zoom ratio that is a size necessary for calculating evaluation values in all the face regions R2, that is, evaluation values in all the face regions R2. A zoom ratio to be a size is calculated, and adjustment is performed with the calculated zoom ratio. In the example of FIG. 3A, the evaluation value of each face F can be calculated from the size of each face region R2 when imaging is performed with the size of the photographing region R3 shown in FIG.
As a result, as shown in FIG. 3C, the user moves the imaging apparatus 1 so as to follow a predetermined route in the planned shooting area R1 with a zoom ratio that is the size of the shooting area R3, and sequentially performs shooting. . In the imaging apparatus 1, a plurality of captured images including the scheduled shooting area R1 are acquired along with the movement, and the acquired captured images are combined to form a single panoramic image with the scheduled shooting area R1 as an angle of view. Generate.

  Returning to FIG. 2, the movement detection unit 53 detects whether the imaging apparatus 1 has moved from the value output from the acceleration sensor 17.

The face area evaluation processing unit 54 executes face area evaluation processing.
The “face area evaluation process” is a series of processes for evaluating the face area of the acquired image. An unfavorable face area is determined by the evaluation performed in the face area evaluation process.
In the present embodiment, when the evaluation value is less than the predetermined value, the evaluation value and the position of the unfavorable face area are stored as an unfavorable face area.
Note that the face area evaluation value calculation performed in the face area evaluation processing unit 54 uses a known face area determination technique.

The non-good face area display processing unit 55 executes non-good face area display processing. The “non-favorable face area display process” is a display of an index indicating an unfavorable face area in a live view image when an image including an unfavorable face area evaluated in the face area evaluation process is acquired (hereinafter, “ This is a series of processes until “unfavorable face area display”. When there is an unfavorable face area in the live view image, the unfavorable face area display processing unit 55 surrounds the unfavorable face area, and displays the color frames color-coded according to the cause of unfavorableness. In addition, when there is an unsatisfactory face area outside the live view image, the unfavorable face area display processing unit 55 displays an arrow indicating which direction the image is in relation to the currently displayed live view image. Display icons as indicators.
The “unfavorable face area” is an area including a face whose facial expression is not suitable for the photographer's intention, such as a face that does not blink or smile. In other words, when the intention of the photographer is not positive, it includes a case where it is determined that the face area is open or the face area is not good.

Here, the non-good face area display executed in the non-good face area display process will be described.
FIG. 4 is a schematic diagram for explaining the non-good face area display. In the example of FIG. 4, imaging is sequentially performed with the zoom ratio adjusted by the zoom ratio adjustment processing so as to include the scheduled imaging area R1 illustrated in FIG.
In the non-good face area display, images are taken sequentially, and as shown in FIG. 4 (a), an image including an unsatisfactory face that is not a smile is taken, and then the image is taken. Then, as shown in FIG. 4B, when shooting is performed below the unfavorable face region R2 that is not a smile, the live view image is currently displayed as shown in FIG. 4C. The direction of the unfavorable face region R2 viewed from the position with the live view image being displayed is displayed together with the live view image as an index (upward arrow icon d1).
By performing such display, the user can know that there is a place where it is necessary to perform re-shooting with the direction.

The image composition processing unit 56 executes image composition processing.
“Image composition processing” is a series of processing that combines multiple images and recombines them when there is an area that does not satisfy the evaluation, resulting in an image with the angle of view of the planned shooting area. is there.
A known technique such as panorama synthesis is used as a technique for synthesizing images captured at a series of multiple angles of view in the image synthesis process.
In addition, the image composition processing unit 56 sequentially synthesizes an image with an angle of view of the planned image area in the acquired image, and if the image includes an unsatisfactory face area, the image captured again is overwritten on the face area. A panoramic image that finally becomes the angle of view of the scheduled shooting area is generated by combining the images. That is, the image composition processing unit 56 selects an image including a subject image with higher evaluation as an image to be synthesized, and synthesizes one synthesized panorama image with the synthesized image already synthesized. Generate.

Next, a flow of panorama shooting processing executed by the imaging apparatus 1 will be described.
FIG. 5 is a flowchart for explaining the flow of panorama shooting processing executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.

  The panorama shooting process is started by an operation for starting the panorama shooting process on the input unit 18 by the user. In the panorama shooting process, after the zoom ratio is adjusted, the image pickup unit 16 picks up images as the image pickup apparatus 1 moves, and a plurality of picked-up images are stored in the image storage unit 71.

  In step S1, the zoom ratio adjustment processing unit 51 executes a zoom ratio adjustment process. As a result, the zoom ratio in the case of capturing an image with the field of view to be captured is adjusted.

In step S2, the movement detection unit 53 determines whether or not the imaging device 1 has moved.
When the imaging device 1 is not moving, it is determined as NO in Step S2 and waits until the imaging device 1 moves.
On the other hand, when the imaging device 1 is moving, YES is determined in step S2, and the process proceeds to step S3.

In step S3, the unfavorable face area display processing unit 55 performs an unfavorable face area display process.
Thereby, in the live view image, an unfavorable face area display indicating an unfavorable face area is performed. The user can know the presence / absence of re-photographing and in which direction there is an unfavorable face area by displaying the unfavorable face area.

In step S4, the CPU 11 determines whether or not there is a face area stored in the live view image.
If there is a face area whose evaluation value stored in the live view image is less than the predetermined value, YES is determined in step S4, and the process proceeds to step S5.

  In step S5, the CPU 11 sets the photographing flag to “1”. Thereafter, the process proceeds to step S8. The processing after step S8 will be described later.

Here, the shooting flag will be described.
FIG. 6 is a diagram for explaining the shooting flag.
In the panoramic imaging process of the present embodiment, the presence / absence of an unfavorable face region is recognized using a shooting flag.

As shown in FIG. 6, when “value: 0” is set, the shooting flag is “no stored face area (evaluation value is less than a predetermined value)” and the evaluation value is less than the predetermined value. It recognizes that there is no certain face area, that is, an unfavorable face area.
Further, when “value: 1” is set, a face area whose value is not less than the predetermined value, that is, a face area that is not good is determined as “there is a stored face area (the evaluation value is less than the predetermined value)”. Recognize that there is.

  On the other hand, when there is no face area whose evaluation value stored in the live view image is less than the predetermined value as in the first shooting range, NO is determined in step S4, and the process proceeds to step S6. move on.

In step S6, the movement detection unit 53 determines whether or not the imaging apparatus 1 has moved a predetermined distance.
If the imaging device 1 has not moved by the predetermined distance, NO is determined in step S6, and the process returns to step S2.
On the other hand, when the imaging device 1 has moved by the predetermined distance, it is determined as YES in Step S6, and the process proceeds to Step S7.

  In step S7, the CPU 11 sets the photographing flag to “0”.

  In step S8, the CPU 11 acquires image data. That is, the CPU 11 acquires image data that is automatically and sequentially imaged by the imaging unit 16 as the imaging device 1 moves, and that is stored in the image storage unit 71.

In step S9, the face area evaluation processing unit 54 executes a face area evaluation process.
Thereby, the face area of the acquired image is evaluated and it is determined whether or not the face area is not good.

In step S10, the image composition processing unit 56 executes image composition processing.
As a result, the acquired plurality of captured images are combined, and an image having an angle of view of the planned shooting area is combined. In addition, when there is an unsatisfactory face area at the time of composition, an image acquired by re-photographing is overwritten, and an image having the field of view to be photographed is synthesized.

In step S <b> 11, the CPU 11 determines whether shooting has ended.
If shooting has not ended, NO is determined in step S11, and the process returns to step S2.
On the other hand, when shooting is completed, YES is determined in step S11, and the panorama shooting process ends.

  FIG. 7 is a flowchart for explaining the detailed flow of the zoom ratio adjustment process in the panorama shooting process.

In step S31, the zoom ratio adjustment processing unit 51 acquires an image. In this step, the zoom ratio adjustment processing unit 51 obtains an image obtained by photographing a planned photographing area that is an angle of view of a panoramic image to be generated.
Specifically, the zoom ratio adjustment processing unit 51 captures a captured image having an angle of view including all persons in the group photo as illustrated in FIG. 3A and acquires an image used for calculating the zoom ratio.

In step S32, the zoom ratio adjustment processing unit 51 determines whether there is a face area in the acquired image.
If there is no face area in the acquired image, NO is determined in step S32, and the zoom ratio adjustment process ends.
On the other hand, if there is a face area in the acquired image, YES is determined in step S32, and the process proceeds to step S33.

In step S33, the face area detection processing unit 52 detects a face area from the acquired image.
Specifically, as shown in FIG. 3A, the zoom ratio adjustment processing unit 51 detects a face region R2 included in an image obtained by photographing a planned photographing region.

In step S34, the zoom ratio adjustment processing unit 51 acquires the size of the detected face area (hereinafter referred to as “detected face area”) with respect to the acquired image.
Specifically, the zoom ratio adjustment processing unit 51 acquires the size of each face area R2 using the face area R2 shown in FIG. 3A as a detected face area.

  In step S35, the zoom ratio adjustment processing unit 51 calculates a zoom ratio necessary for calculating the evaluation value from the average of the detected sizes. By setting the average of the detected sizes, a size within a predetermined range in the vicinity of the average is an evaluation target for calculating an evaluation value, and a face region having a size greatly deviating from the average can be removed.

In step S36, the zoom ratio adjustment processing unit 51 sets the calculated zoom ratio to adjust the zoom ratio.
Specifically, the zoom ratio adjustment processing unit 51 performs adjustment with a zoom ratio that becomes a photographing region R3 as shown in FIG. As a result, in the subsequent processing, as shown in FIG. 3C, shooting is sequentially performed so as to include the scheduled shooting area R1 with the zoom ratio of the shooting area R3.
Thereafter, the zoom ratio adjustment process ends.

  FIG. 8 is a flowchart for explaining the detailed flow of the non-good face area display process in the panorama shooting process.

In step S51, the unfavorable face area display processing unit 55 determines whether there is a face area whose evaluation value stored in the live view image is less than a predetermined value.
If there is no face area whose evaluation value stored in the live view image is less than the predetermined value, NO is determined in step S51, and the process proceeds to step S53. The processing after step S53 will be described later.
On the other hand, if there is a face area whose evaluation value stored in the live view image is less than the predetermined value, YES is determined in step S51, and the process proceeds to step S52.

In step S52, the unfavorable face area display processing unit 55 controls the output unit 19 to display the face area in a color frame. That is, since the face area is in the live view image, the non-good face area display processing unit 55 controls the output unit 19 to display the corresponding part in the displayed live view image with a frame. For example, the color frame is displayed in different colors depending on the unfavorable cause, such as “red” when not smiling, or “green” when blinking.
The user is prompted to perform a predetermined operation such as re-photographing by looking at such an unfavorable face area display.

In the present embodiment, as shown in the examples of FIGS. 4A to 4C, it can be expressed by changing the line type instead of color coding. In FIGS. 4A to 4C, the face area currently being detected in the live view image is displayed as a solid line, and when it is not a smile, it is expressed by a broken line type. If it is not a smile, it can be expressed by, for example, a one-dot chain line type.
In addition, the second blinking person from the lower left of FIG. 4B has not been photographed yet, so no color frame display is performed.

In step S53, the unfavorable face area display processing unit 55 determines whether or not there is a face area whose evaluation value stored outside the live view image is less than a predetermined value.
If there is no face area whose evaluation value stored outside the live view image is less than the predetermined value, NO is determined in step S53, and the non-good face area display process ends.
On the other hand, if there is a face area whose evaluation value stored outside the live view image is less than the predetermined value, YES is determined in step S53, and the process proceeds to step S54.

  In step S54, the non-favorable face area display processing unit 55 controls the output unit 19 to display an arrow indicating the direction of the face area. That is, the non-good face area display processing unit 55 controls the output unit 19 to display an arrow indicating in which direction the live view image is displayed because the face area is outside the live view image. To do. The arrow is displayed in a different color depending on the cause, such as “red” when not smiling and “green” when blinking.

Specifically, as shown in FIG. 4C, when there is a face area whose evaluation value stored outside the live view image is less than a predetermined value, an arrow icon d1 is displayed. Further, the type of hatching of the arrow icon d1 may be changed according to the cause that is not good. Viewing the display, the user is prompted to perform a predetermined operation such as re-photographing.
Thereafter, the non-favorable face area display process ends.
If there are multiple unsatisfactory display areas, a plurality of arrow icons may be displayed, or only one arrow icon in the nearest direction is displayed and moved to the position indicated by the arrow icon. Then, a single arrow icon in the direction closest to the position may be displayed.

  As described above, in the imaging apparatus 1, only when the evaluation value of the subject image is less than the predetermined value, the position and the evaluation value are stored, and when the subject image is present in the live view image, the color frame is displayed. If the subject image is outside the live view image, an arrow indicating the direction is displayed. The imaging device 1 can display a subject image having an evaluation value less than a predetermined value in an identifiable manner according to the inside or outside of the live view image by displaying a color frame display or an arrow.

  FIG. 9 is a flowchart for explaining the detailed flow of the face area evaluation process in the panorama shooting process.

In step S71, the face area evaluation processing unit 54 determines whether or not there is a face area in the acquired image.
If there is no face area in the acquired image, NO is determined in step S71, and the face area evaluation process ends.
On the other hand, if there is a face area in the acquired image, YES is determined in step S71, and the process proceeds to step S72.

In step S72, the face area evaluation processing unit 54 determines whether or not the shooting flag is “1”.
If the shooting flag is not “1”, that is, “0”, it is determined as NO in Step S72, and the process proceeds to Step S76. The processing after step S76 will be described later.
On the other hand, when the shooting flag is “1”, it is determined as YES in Step S72, and the process proceeds to Step S73.

  In step S73, the face area evaluation processing unit 54 calculates an evaluation value of the face area at the stored position. Depending on the evaluation value, it is possible to determine whether it is not a smile, a blinking eye, or the like.

In step S74, the face area evaluation processing unit 54 determines whether or not the evaluation value is less than a predetermined value.
If the evaluation value is less than the predetermined value, YES is determined in step S74, and the process proceeds to step S80.
On the other hand, if the evaluation value is not less than the predetermined value, that is, not less than the predetermined value, NO is determined in step S74, and the process proceeds to step S75.

  In step S75, the face area evaluation processing unit 54 updates the evaluation value of the face area and sets an update flag indicating that the evaluation value has been updated.

  On the other hand, in step S76, the face area evaluation processing unit 54 detects a face area. That is, as shown in the example of FIG. 4A, the face area evaluation processing unit 54 detects the face area R2 from the acquired image.

  In step S77, the face area evaluation processing unit 54 calculates an evaluation value of the detected face area. The face area evaluation processing unit 54 calculates the evaluation value of the face area R2 shown in the example of FIG. If the calculated evaluation value is less than a predetermined value, the face area is not good (for example, a face area that is not blinking or a smile), and if the calculated evaluation value is greater than or equal to the predetermined value, it is good. Face area (for example, a smiling face area).

In step S78, the face area evaluation processing unit 54 determines whether or not the evaluation value is less than a predetermined value.
If the evaluation value is not less than the predetermined value, that is, is equal to or greater than the predetermined value, NO is determined in step S78, and the process proceeds to step S80.
On the other hand, if the evaluation value is less than the predetermined value, YES is determined in step S78, and the process proceeds to step S79.

  In step S <b> 79, the face area evaluation processing unit 54 stores the position of the face area and the evaluation value in the image storage unit 71.

In step S80, the face area evaluation processing unit 54 determines whether there is any other face area.
If there is another face area, NO is determined in step S80, and the process returns to step S72.
On the other hand, if there is no other face area, it is determined YES in step S80, and the face area evaluation process ends.

  FIG. 10 is a flowchart for explaining the detailed flow of the image composition process in the panorama shooting process.

In step S101, the image composition processing unit 56 determines whether there is an uncombined area in the acquired image.
If there is no uncombined area in the acquired image, NO is determined in step S101, and the process proceeds to step S103. The processing after step S103 will be described later.
On the other hand, if there is an unsynthesized area in the acquired image, YES is determined in step S101, and the process proceeds to step S102.

  In step S <b> 102, the image composition processing unit 56 performs composition processing so that overlapping portions are identified and connected.

In step S103, the image composition processing unit 56 determines whether or not the shooting flag is “1”.
If the shooting flag is “0” instead of “1”, that is, if there is no face area whose stored evaluation value is less than the predetermined value, it is determined NO in step S103, and the image composition processing ends.
On the other hand, if the shooting flag is “1”, that is, if there is a face area whose stored evaluation value is less than the predetermined value, YES is determined in step S103, and the process proceeds to step S104. .

In step S104, the image composition processing unit 56 determines whether there is a face area for which an update flag is set.
If there is no face area for which an update flag is set, NO is determined in step S104, and the image composition process ends.
On the other hand, if there is a face area for which an update flag is set, YES is determined in step S104, and the process proceeds to step S105.

  In step S105, the image composition processing unit 56 extracts the face area of the current captured image.

  In step S106, the image composition processing unit 56 overwrites and composes the extracted face area on the corresponding face area of the synthesized image. As a result, finally, the image composition processing unit 56 generates one panoramic image in which the detected face area is in a good state from a plurality of captured images.

  In step S107, the image composition processing unit 56 clears the memory of the face area that has been overwritten and synthesized.

In step S108, the image composition processing unit 56 determines whether there is any other face area.
If there is another face area, NO is determined in step S108, and the process returns to step S104.
On the other hand, if there is no other face area, it is determined as YES in step S108, and the image composition process is ended.

<Modification>
In the above-described embodiment, a live view image is displayed, and a subject image whose evaluation is less than a predetermined value is displayed with respect to the displayed image. On the other hand, in this modification, an image being combined is displayed as a review image even during shooting, and subject images less than a predetermined value are identified and displayed. When this modification is executed by the imaging apparatus 1, only the unfavorable face area display process in the panorama shooting process is different from the above-described embodiment. That is, only non-good face area display processing different from the above-described embodiment will be described.

  FIG. 11 is a flowchart for explaining a detailed flow of a modified example of the non-good face area display process in the panorama shooting process.

  In step S121, the unfavorable face area display processing unit 55 displays a composite image. In other words, the non-favorable face area display processing unit 55 displays a combined image that is sequentially synthesized using the scheduled shooting area as a display screen of the output unit 19.

In step S122, the unfavorable face area display processing unit 55 determines whether there is a face area whose stored evaluation value is less than a predetermined value.
If there is no face area whose stored evaluation value is less than the predetermined value, NO is determined in step S122, and the non-good face area display process ends.
On the other hand, if there is a face area whose stored evaluation value is less than the predetermined value, YES is determined in step S122, and the process proceeds to step S123.

In step S123, the unfavorable face area display processing unit 55 displays the face area in a color frame. By performing the non-good face area display in this way, the user can easily grasp the positional relationship of the bad face areas.
Thereafter, the non-favorable face area display process ends.

FIG. 12 is a schematic diagram for explaining the non-good face area display in the modified example.
Specifically, as shown in FIG. 12A, the scheduled shooting area R1 is displayed in advance as a review image, and the acquired images are sequentially embedded and displayed in the scheduled shooting area R1. When the face area R2 is detected in the acquired image, a frame for displaying the detection is displayed as shown in FIG. When the detected face area R2 is evaluated and the evaluation is less than the predetermined value, a frame icon d1 indicating an unfavorable face area is displayed as shown in FIG. Display area. During shooting, the user can grasp a list of unfavorable face areas, that is, whether there is an area that needs to be re-photographed, and where the unfavorable face area is located in the planned shooting area R1. A predetermined operation such as shooting is prompted.

<Other embodiments>
In the above-described embodiment, when the evaluation value is greater than or equal to the predetermined value, the image is used as a composition image. In contrast, in the present embodiment, even if the evaluation value is greater than or equal to the predetermined value, the evaluation value is compared when it is acquired again, and the one with the higher evaluation value is used as the image for synthesis. To be configured.

  FIG. 13 is a flowchart for explaining the flow of panorama shooting processing in another embodiment executed by the imaging apparatus 1 of FIG. 1 having the functional configuration of FIG.

  In step S201, the zoom ratio adjustment processing unit 51 performs a zoom ratio adjustment process. Note that the zoom ratio adjustment process of the present embodiment is the same as the zoom ratio adjustment process of the above-described embodiment, and a description thereof will be omitted.

In step S202, the movement detection unit 53 determines whether or not the imaging apparatus 1 has moved a predetermined distance or more.
When the imaging device 1 has not moved more than the predetermined distance, it is determined as NO in Step S202 and waits until the imaging device 1 moves more than the predetermined distance.
On the other hand, when the imaging device 1 has moved a predetermined distance or more, YES is determined in step S202, and the process proceeds to step S203.

  In step S203, the CPU 11 acquires image data. That is, the CPU 11 acquires a captured image stored in the image storage unit 71.

  In step S204, the face area evaluation processing unit 54 performs a face area evaluation process. The face area evaluation process of this embodiment will be described later.

  In step S205, the image composition processing unit 56 executes image composition processing. The image composition process of this embodiment will be described later.

In step S <b> 206, the CPU 11 determines whether shooting has ended.
If shooting has not been completed, NO is determined in step S206, and the process returns to step S202.
On the other hand, when shooting is completed, YES is determined in step S206, and the panorama shooting process ends.

  FIG. 14 is a flowchart for explaining the detailed flow of the face area evaluation process in the panorama shooting process according to another embodiment.

In step S221, the face area evaluation processing unit 54 determines whether or not there is a face area in the live view image.
If there is no face area in the live view image, it is determined as NO in step S221, and the face area evaluation process ends.
On the other hand, if there is a face area in the live view image, YES is determined in step S221, and the process proceeds to step S222.

In step S222, a face area is detected.
In step S223, the face area evaluation processing unit 54 acquires the position of the detected face area.

  In step S224, the face area evaluation processing unit 54 calculates an evaluation value of the detected face area.

In step S225, the face area evaluation processing unit 54 determines whether there is a face area at substantially the same position.
If there is no face region at substantially the same position, NO is determined in step S225, and the process proceeds to step S229.

In step S229, the face area evaluation processing unit 54 stores the current position and the evaluation value in the image storage unit 71. Thereafter, the process proceeds to step S230. The processing after step S230 will be described later.
On the other hand, if there are face regions at substantially the same position, YES is determined in step S225, and the process proceeds to step S226.

  In step S226, the face area evaluation processing unit 54 compares the stored evaluation value with the current evaluation value.

In step S227, the face area evaluation processing unit 54 determines whether or not the current evaluation value is higher than the stored evaluation value.
If the current evaluation value is lower than the stored evaluation value, NO is determined in step S227, and the process proceeds to step S229.
In contrast, if the current evaluation value is higher than the stored evaluation value, YES is determined in step S227, and the process proceeds to step S228.

  In step S228, the face area evaluation processing unit 54 updates the evaluation value with the current calculated value and sets an update flag.

In step S230, the face area evaluation processing unit 54 determines whether there is any other face area.
If there is another face area, NO is determined in step S230, and the process proceeds to step S222.
On the other hand, if there is no other face area, it is determined YES in step S230, and the face area evaluation process ends.

  FIG. 15 is a flowchart for explaining the detailed flow of the image composition process in the panorama shooting process according to another embodiment.

In step S251, the image composition processing unit 56 determines whether there is an uncombined area in the acquired image.
If there is no uncombined area in the acquired image, NO is determined in step S251, and the process proceeds to step S253. The processing after step S253 will be described later.
On the other hand, if there is an unsynthesized area in the acquired image, YES is determined in step S251, and the process proceeds to step S252.

  In step S252, the image composition processing unit 56 performs composition processing so that overlapping portions are discriminated and connected.

In step S253, the image composition processing unit 56 determines whether there is a face area for which an update flag is set.
If there is no face area for which an update flag is set, NO is determined in step S253, and the image composition process ends.
On the other hand, if there is a face area for which an update flag is set, YES is determined in step S253, and the process proceeds to step S254.

  In step S254, the image composition processing unit 56 extracts the face area of the current captured image.

  In step S255, the image composition processing unit 56 performs overwriting composition of the extracted face area on the corresponding face area of the synthesized image.

  In step S <b> 256, the image composition processing unit 56 clears the update flag for the overwritten face area.

In step S257, the image composition processing unit 56 determines whether there is any other face area.
If there is another face area, NO is determined in step S257, and the process proceeds to step S253.
On the other hand, if there is no other face area, it is determined as YES in step S257, and the image composition process is ended.

The imaging apparatus 1 configured as described above includes a CPU 11, a face area evaluation processing unit 54, and an image composition processing unit 56.
The CPU 11 sequentially acquires a plurality of images partially captured while changing the imaging range as partial images.
The face area evaluation processing unit 54 detects a subject image from each of a plurality of partial images with different shooting ranges acquired by the CPU 11.
The face area evaluation processing unit 54 evaluates each detected subject image.
For the plurality of partial images including the same subject image, the image composition processing unit 56 selects a partial image including the subject image with higher evaluation as an image to be combined.
The image composition processing unit 56 synthesizes a plurality of partial images including different subject images and a partial image selected as a compositing target among a plurality of partial images including the same subject image. One extended image is generated.
Thereby, in the imaging device 1, even when a panoramic image is generated by combining and acquiring a plurality of images while moving the imaging device, the blinking, the smile, etc. An image composed of a good subject image can be generated. In addition, in the case where it is considered that it is better to re-acquire an already acquired subject image, the possibility of obtaining a better image can be expanded by moving the imaging device to the subject image again. .
Therefore, the imaging apparatus 1 can generate an image in which the shooting state of all the subject images is good.

In addition, when the acquired partial image includes a subject image whose evaluation is less than a predetermined value, the imaging device 1 includes an output unit 19 that outputs a notification to that effect.
Thereby, in the imaging device 1, when the acquired partial image includes an unsatisfactory face such as blinking or not smiling, it is notified to the user, and therefore it is determined whether or not to re-shoot. Can do.

The image composition processing unit 56 selects a subject image when the same subject image is reacquired according to the notification output from the output unit 19.
Thereby, in the imaging device 1, when the same subject image is not reacquired, the subject image is not selected, so that the processing load can be reduced.

The non-good face area display processing unit 55 controls the output unit 19 to display the acquired image. Further, the non-good face area display processing unit 55 causes the output unit 19 to display the subject image so that the subject image can be identified when the subject image whose evaluation is less than a predetermined value is included in the displayed image. Control.
As a result, the imaging apparatus 1 can easily identify an unsatisfactory face that is blinking or not smiling, so it is possible to easily determine where to re-shoot.

Further, the non-favorable face area display processing unit 55 displays the position of the subject image when the subject image whose evaluation is less than a predetermined value is not included in the displayed image. To control.
As a result, in the imaging apparatus 1, even if the imaging apparatus 1 is moved while moving and the camera passes through an unsatisfactory face and comes off the display unit, it is easy to determine where to re-shoot. Can be determined.

Further, the unfavorable face area display processing unit 55 controls the output unit 19 to display a display indicating the position of the subject image so as to indicate the direction of the subject image with respect to the current angle of view.
Thereby, in the imaging device 1, the processing load can be reduced and it can be easily determined where to re-shoot.

In addition, the non-favorable face area display processing unit 55 performs composite display of a plurality of partial images whenever necessary, and displays a display indicating the position of the subject image on the composite display screen. The output unit 19 is controlled so that
Thereby, in the imaging device 1, since it is displayed as a list, it is possible for the user to easily determine where to re-shoot.

In addition, the imaging apparatus 1 includes a zoom ratio adjustment processing unit 51.
The zoom ratio adjustment processing unit 51 adjusts the acquisition size of the partial image to a size that can be evaluated.
Thereby, in the imaging device 1, an evaluation value can be reliably calculated.

In addition, the zoom ratio adjustment processing unit 51 performs adjustment to a size that can be evaluated with a zoom ratio for obtaining the size of the subject image necessary for the evaluation.
Thereby, in the imaging device 1, size adjustment can be performed automatically.

  In addition, this invention is not limited to the above-mentioned embodiment, The deformation | transformation in the range which can achieve the objective of this invention, improvement, etc. are included in this invention.

  In the above-described embodiment, in the image composition process, when there is a better face area, the composition is performed by overwriting, but the present invention is not limited to this. In the case of re-photographing, there is a high probability that the face area is better. For this reason, for example, it is possible to configure so as to preferentially synthesize what was photographed later, including simplification of processing.

In the above-described embodiment, it is assumed that the evaluation value will eventually become a predetermined value or more due to re-shooting. Therefore, if the number of shots does not exceed the predetermined value, the non-good face area display does not disappear. Therefore, when the evaluation value does not become a predetermined value or more for a predetermined number of times, or when a predetermined time or more has elapsed since the start of photographing or the like, the non-good face area display may be turned off.
Specifically, the unfavorable face area display processing unit 55 acquires a subject image whose evaluation is less than a predetermined number of times or when a predetermined time or more has passed since the start of photographing, a display indicating the position of the subject image The output unit 19 can be configured to stop the operation.

Further, in the above-described embodiment, the configuration is such that an unsatisfactory face area is notified by display, but the present invention is not limited to this. For example, you may comprise so that it alert | reports by sounds, such as a buzzer, and lights, such as a lamp | ramp. At this time, it may be configured to acquire a good captured image by performing re-photographing at the notification timing. Thereby, it is possible to prompt the user to retake with light processing.
Specifically, when the output unit 19 detects a subject image with an evaluation less than a predetermined value, the imaging apparatus 1 performs a notification output that prompts reacquisition of the subject image. Further, when the same subject image is reacquired in response to the notification output from the output unit 19, the face area evaluation processing unit 54 is configured to give a high evaluation to the image including the reacquired subject image. it can.

Further, in the above-described embodiment, the image having a higher evaluation value calculated is used as an image to be combined, but is not limited thereto. For example, when the evaluation value is equal to or greater than a predetermined value, an image to be combined may be configured without performing subsequent evaluation. By configuring in this way, processing that is not necessarily performed can be omitted.
Specifically, the face area evaluation processing unit 54 may be configured not to evaluate the subject image when the subject image that has already been evaluated to be equal to or higher than the predetermined value is detected again. it can.

In the above-described embodiment, the zoom ratio is set to a zoom ratio that is suitable from the average of the detected sizes, but is not limited to this. For example, as an unfavorable face area, for example, a facial expression can be detected to evaluate a smile Alternatively, the zoom ratio may be changed in accordance with an item to be evaluated such that eyes can be detected to detect blinking. With such a configuration, a more appropriate zoom ratio is obtained, so that zooming up more than necessary can be prevented.
Specifically, the zoom ratio adjustment processing unit 51 can be configured to adjust the zoom ratio according to the content to be evaluated.

  In the above-described embodiment, the zoom ratio adjustment process automatically adjusts the zoom ratio to perform shooting, but the present invention is not limited to this. You may comprise so that the guide display which may become the zoom which can calculate an evaluation value at the time of imaging | photography, or the distance to a to-be-photographed image. The guide display can be performed, for example, by displaying a frame or the like when the subject image is detected, and by changing the display of the frame when the evaluation value can be calculated. With such a guide display, the user can adjust the size by approaching the subject image or adjusting the zoom, and can reliably calculate the evaluation value.

  Further, in the above-described embodiment, as an unsatisfactory face, in the case of a group photo, a smile, a blinking eye, etc. are given as examples, but the present invention is not limited to this. For example, red eyes, blurring, backlighting, etc. may be used. In addition, an unsatisfactory face can be arbitrarily set according to the user's acquisition purpose of the captured image, and may be negative such as poor reflection. A positive face may be an unfavorable face.

  In the above-described embodiment, since the detection technique of the face area is used, the display process or the image synthesis process of the unsatisfactory area is performed on the basis of whether the face condition is good or bad. However, the present invention is not limited to this. If it is possible to evaluate whether the subject image is good or bad, it is possible to perform display processing of an unfavorable region, image synthesis processing, or the like based on the evaluation.

In the above-described embodiment, the imaging apparatus 1 to which the present invention is applied has been described using a digital camera as an example, but is not particularly limited thereto.
For example, the present invention can be applied to general electronic devices having an imaging processing function. Specifically, for example, the present invention can be applied to a notebook personal computer, a printer, a television receiver, a video camera, a portable navigation device, a mobile phone, a smartphone, a portable game machine, and the like.

The series of processes described above can be executed by hardware or can be executed by software.
In other words, the functional configuration of FIG. 2 is merely an example and is not particularly limited. That is, it is sufficient that the imaging apparatus 1 has a function capable of executing the above-described series of processing as a whole, and what functional blocks are used to realize this function is not particularly limited to the example of FIG.
In addition, one functional block may be constituted by hardware alone, software alone, or a combination thereof.

When a series of processing is executed by software, a program constituting the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  The recording medium including such a program is not only constituted by the removable medium 31 of FIG. 1 distributed separately from the apparatus main body in order to provide the program to the user, but also in a state of being incorporated in the apparatus main body in advance. It is comprised with the recording medium etc. which are provided in. The removable medium 31 is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, a magneto-optical disk, or the like. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disc), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. In addition, the recording medium provided to the user in a state of being preliminarily incorporated in the apparatus main body includes, for example, the ROM 12 in FIG. 1 in which a program is recorded, the hard disk included in the storage unit 20 in FIG.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in time series along the order, but is not necessarily performed in time series, either in parallel or individually. The process to be executed is also included.

  As mentioned above, although several embodiment of this invention was described, these embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and various modifications such as omission and replacement can be made without departing from the gist of the present invention. These embodiments and modifications thereof are included in the scope and gist of the invention described in this specification and the like, and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the scope of claims at the beginning of the filing of the present application will be appended.
[Appendix 1]
Image acquisition means for sequentially acquiring a plurality of images taken while changing the imaging range as partial images;
Detection means for detecting a subject image from each of a plurality of partial images having different shooting ranges acquired by the image acquisition means;
Subject image evaluation means for evaluating each subject image detected by the detection means;
A plurality of partial images including the same subject image by the subject image evaluation unit, a subject image selection unit that selects a partial image including the subject image that has obtained higher evaluation as a synthesis target;
A plurality of partial images including different subject images acquired by the image acquisition unit and a partial image selected as the combination target by the subject image selection unit among a plurality of partial images including the same subject image are combined. Image generating means for generating a single image with an expanded shooting range,
An imaging apparatus comprising:
[Appendix 2]
In the case where a subject image whose evaluation is less than a predetermined value is included in the acquired partial image, an informing means for informing the fact is provided.
The imaging apparatus according to Supplementary Note 1, wherein
[Appendix 3]
The subject image selection means selects the subject image when the same subject image is reacquired in response to the notification by the notification means;
The imaging apparatus according to Supplementary Note 2, wherein
[Appendix 4]
The notification means is a first display control means for controlling the display means so as to display the subject image in an identifiable manner when the subject image whose evaluation is less than a predetermined value is included in the displayed image. Comprising
The imaging apparatus according to appendix 2 or 3, characterized by the above.
[Appendix 5]
The informing means controls the display means to display the position of the subject image when the subject image whose evaluation is less than a predetermined value is not included in the displayed image. With means,
The imaging apparatus according to any one of appendices 2 to 4, characterized in that:
[Appendix 6]
The second display control unit controls the display unit to display a display indicating the position of the subject image so as to indicate a direction of the subject image with respect to a current angle of view.
The imaging apparatus according to appendix 5, which is characterized in that.
[Appendix 7]
The second display control means combines and displays a plurality of partial images whenever necessary, and displays a display indicating the position of the subject image and a display indicating the position of the subject image on the composite display screen. Control the display means to
The imaging apparatus according to appendix 5 or 6, characterized by the above.
[Appendix 8]
The second display control means obtains a subject image whose evaluation is less than a predetermined number of times, or stops displaying the position of the subject image when a predetermined time or more has elapsed since the start of photographing. Control the display means,
The imaging apparatus according to any one of appendices 5 to 7, characterized in that:
[Appendix 9]
When the same subject image is reacquired in response to the notification by the notification unit, the subject image evaluation unit sets the image including the reacquired subject image as a high evaluation.
The imaging apparatus according to Supplementary Note 2, wherein
[Appendix 10]
The subject image evaluation means does not evaluate the subject image when a subject image that has already been evaluated to be equal to or higher than a predetermined value is detected again.
The imaging apparatus according to any one of appendices 1 to 9, characterized in that:
[Appendix 11]
An adjustment unit that adjusts the acquisition size of the partial image to a size that can be evaluated;
The imaging apparatus according to any one of appendices 1 to 10, characterized in that:
[Appendix 12]
The adjusting means performs adjustment to a size that can be evaluated at a zoom ratio for obtaining the size of a subject image necessary for evaluation.
The imaging apparatus according to appendix 11, wherein:
[Appendix 13]
The adjusting means adjusts the zoom ratio according to the content to be evaluated.
The imaging apparatus according to attachment 12, wherein the imaging apparatus is characterized in that
[Appendix 14]
An image acquisition step of sequentially acquiring a plurality of images taken while changing the imaging range as partial images;
A detection step of detecting a subject image from each of a plurality of partial images having different shooting ranges acquired by the image acquisition step;
A subject image evaluation step for evaluating each subject image detected by the detection step;
A plurality of partial images including the same subject image by the subject image evaluation step, a subject image selection step of selecting a partial image including the subject image having a higher evaluation as a synthesis target;
A plurality of partial images including different subject images acquired by the image acquisition step and a partial image selected as the combination target by the subject image selection step among the plurality of partial images including the same subject image are combined. An image generation step for generating a single image with an expanded shooting range;
An imaging method comprising:
[Appendix 15]
A computer that controls the imaging device;
Image acquisition means for sequentially acquiring a plurality of images taken while changing the imaging range as partial images;
Detecting means for detecting a subject image from each of a plurality of partial images having different shooting ranges acquired by the image acquiring means;
Subject image evaluation means for evaluating each subject image detected by the detection means;
Subject image selection means for selecting, as a synthesis target, a partial image including a subject image that has obtained higher evaluation for a plurality of partial images including the same subject image by the subject image evaluation means,
A plurality of partial images including different subject images acquired by the image acquisition unit and a partial image selected as the combination target by the subject image selection unit among a plurality of partial images including the same subject image are combined. Image generating means for generating a single image with an expanded shooting range,
A program characterized by functioning as

  DESCRIPTION OF SYMBOLS 1 ... Imaging device, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... Bus, 15 ... Input-output interface, 16 ... Imaging part, 17 ... Acceleration sensor 18 ... Input unit 19 ... Output unit 20 ... Recording unit 21 ... Communication unit 22 ... Drive 31 ... Removable media 51 ... Zoom ratio Adjustment processing unit 52... Face area detection processing unit 53... Movement detection unit 54... Face area evaluation processing unit 55. Processing unit, 71 ... Image storage unit

Claims (15)

Image acquisition means for sequentially acquiring a plurality of images taken while changing the imaging range as partial images;
Detection means for detecting a subject image from each of a plurality of partial images having different shooting ranges acquired by the image acquisition means;
Subject image evaluation means for evaluating each subject image detected by the detection means;
A plurality of partial images including the same subject image by the subject image evaluation unit, a subject image selection unit that selects a partial image including the subject image that has obtained higher evaluation as a synthesis target;
A plurality of partial images including different subject images acquired by the image acquisition unit and a partial image selected as the combination target by the subject image selection unit among a plurality of partial images including the same subject image are combined. Image generating means for generating a single image with an expanded shooting range,
An imaging apparatus comprising: In the case where a subject image whose evaluation is less than a predetermined value is included in the acquired partial image, an informing means for informing the fact is provided.
The imaging apparatus according to claim 1. The subject image selection means selects the subject image when the same subject image is reacquired in response to the notification by the notification means;
The imaging apparatus according to claim 2. The notification means is a first display control means for controlling the display means so as to display the subject image in an identifiable manner when the subject image whose evaluation is less than a predetermined value is included in the displayed image. Comprising
The imaging apparatus according to claim 2 or 3, wherein The informing means controls the display means to display the position of the subject image when the subject image whose evaluation is less than a predetermined value is not included in the displayed image. With means,
The imaging apparatus according to any one of claims 2 to 4, wherein the imaging apparatus is characterized in that The second display control unit controls the display unit to display a display indicating the position of the subject image so as to indicate a direction of the subject image with respect to a current angle of view.
The imaging apparatus according to claim 5. The second display control means combines and displays a plurality of partial images whenever necessary, and displays a display indicating the position of the subject image and a display indicating the position of the subject image on the composite display screen. Control the display means to
The imaging apparatus according to claim 5 or 6. The second display control means obtains a subject image whose evaluation is less than a predetermined number of times, or stops displaying the position of the subject image when a predetermined time or more has elapsed since the start of photographing. Control the display means,
The image pickup apparatus according to claim 5, wherein the image pickup apparatus is an image pickup apparatus. When the same subject image is reacquired in response to the notification by the notification unit, the subject image evaluation unit sets the image including the reacquired subject image as a high evaluation.
The imaging apparatus according to claim 2. The subject image evaluation means does not evaluate the subject image when a subject image that has already been evaluated to be equal to or higher than a predetermined value is detected again.
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. An adjustment unit that adjusts the acquisition size of the partial image to a size that can be evaluated;
The image pickup apparatus according to claim 1, wherein the image pickup apparatus is an image pickup apparatus. The adjusting means performs adjustment to a size that can be evaluated at a zoom ratio for obtaining the size of a subject image necessary for evaluation.
The imaging apparatus according to claim 11. The adjusting means adjusts the zoom ratio according to the content to be evaluated.
The imaging apparatus according to claim 12. An image acquisition step of sequentially acquiring a plurality of images taken while changing the imaging range as partial images;
A detection step of detecting a subject image from each of a plurality of partial images having different shooting ranges acquired by the image acquisition step;
A subject image evaluation step for evaluating each subject image detected by the detection step;
A plurality of partial images including the same subject image by the subject image evaluation step, a subject image selection step of selecting a partial image including the subject image having a higher evaluation as a synthesis target;
A plurality of partial images including different subject images acquired by the image acquisition step and a partial image selected as the combination target by the subject image selection step among the plurality of partial images including the same subject image are combined. An image generation step for generating a single image with an expanded shooting range;
An imaging method comprising: A computer that controls the imaging device;
Image acquisition means for sequentially acquiring a plurality of images taken while changing the imaging range as partial images;
Detecting means for detecting a subject image from each of a plurality of partial images having different shooting ranges acquired by the image acquiring means;
Subject image evaluation means for evaluating each subject image detected by the detection means;
Subject image selection means for selecting, as a synthesis target, a partial image including a subject image that has obtained higher evaluation for a plurality of partial images including the same subject image by the subject image evaluation means,
A plurality of partial images including different subject images acquired by the image acquisition unit and a partial image selected as the combination target by the subject image selection unit among a plurality of partial images including the same subject image are combined. Image generating means for generating a single image with an expanded shooting range,
A program characterized by functioning as

Images