JP5293427B2 - Imaging apparatus and imaging control program - Google Patents

Description

  The present invention relates to a photographing apparatus having a function of generating an image obtained by combining a plurality of photographed images having different photographing ranges, and a photographing control program used in the photographing apparatus.

  2. Description of the Related Art Conventionally, there has been proposed a photographing apparatus having a function capable of photographing an image in which a subject is placed at a desired position in an image. This photographing apparatus designates a region where a subject is to be located in a photographed image in advance when performing self-photographing. Thereafter, when self-photographing is performed, the photographing is executed on the condition that the subject has arrived in the region within the angle of view. Therefore, an image having a desired composition in which a subject is arranged at a position intended by a photographer in the image can be taken (see Patent Document 1).

JP 2007-6413 A

  By the way, so-called panoramic composition in which a plurality of photographed images with different photographing ranges are combined is a well-known technique, and an image having an angle of view larger than the maximum angle of view of the photographing apparatus can be obtained by using this panorama composition. Can do. However, in the above-described prior art, it is only possible to shoot an image having a desired composition in which the subject is placed at a desired position within an angle of view that can be taken by the photographing apparatus, and the desired composition in the panorama composite image. An image consisting of cannot be obtained.

  The present invention has been made in view of such a conventional problem, and provides a photographing apparatus and a photographing control program capable of realizing a composition desired by a user in an image obtained by combining a plurality of photographed images having different photographing ranges. The purpose is to provide.

  In order to solve the above-described problem, the imaging apparatus according to the present invention sets the position of the main subject image in a specified composite image obtained by combining a plurality of images according to an imaging unit that captures an image. First recognition means for recognizing the main subject image on the image photographed by the photographing means, and a position set by the first setting means on the prescribed composite image. A second setting unit that sets a shooting range for each image shot by the shooting unit so that a main subject recognized by the recognition unit is located; and a shooting range of an image shot by the shooting unit. An acquisition means for autonomously or otherwise acquiring an image shot by the shooting means when the shooting range set by the second setting means is reached, and a copy acquired by the acquisition means. Characterized in that it comprises a synthesizing means for generating a composite image of said defined by synthesizing the images.

  Further, in the shooting control program according to the invention, the position of the main subject image in the prescribed synthesized image obtained by synthesizing a plurality of images in accordance with the operation of the computer included in the imaging apparatus having the imaging means for taking an image is determined. A first setting means for setting, a recognition means for recognizing the main subject image on the image photographed by the photographing means, and a position set by the first setting means on the prescribed composite image A second setting means for setting a photographing range for each image photographed by the photographing means so that a main subject recognized by the recognizing means is located, and a photographing range of an image photographed by the photographing means Acquisition means for autonomously or otherwise acquiring an image photographed by the photographing means when the photographing range set by the second setting means has been reached. Characterized in that to function as a combining means for generating a composite image of said defined by synthesizing a plurality of images acquired by means.

  According to the present invention, it is possible to generate a composite image in which a plurality of photographed images having different photographing ranges are combined and a desired subject is arranged at a user's desired part. Therefore, a user-desired composition can be realized in an image obtained by combining a plurality of photographed images having different photographing ranges.

It is a block diagram of the electronic camera which concerns on one embodiment of this invention. It is a figure which shows the example of the memorize | stored panorama composition pattern. It is a flowchart which shows the process sequence in the 1st Embodiment of this invention. It is explanatory drawing which shows the position setting procedure of the face image in the embodiment. It is a figure which shows the corresponding relationship of the selected panorama composition pattern and a flag table. (A) is explanatory drawing which shows the relationship between the image which completed the imaging | photography in a panoramic composition pattern, and another image, (B) is a figure which shows the state of the flag table at the time of imaging completion. It is an external view of the digital camera in the modification of the 1st Embodiment of this invention. It is a flowchart which shows the process sequence in the modification. It is a display transition diagram in the modification. It is a flowchart which shows the process sequence in the 2nd Embodiment of this invention.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
(First embodiment)
FIG. 1 is a block diagram showing a schematic configuration of a digital camera 1 common to each embodiment of the present invention. The digital camera 1 includes an optical lens 2 disposed on the front surface of the main body, an image sensor 3 such as a CCD imaged by the optical lens 2, a TG 4 for driving the image sensor 3, and an output from the image sensor 3. A unit circuit 5 including a CDS that holds the captured image signal, a gain adjustment amplifier (AGC) that amplifies the image signal, and an A / D converter (AD) that converts the amplified image signal into a digital signal. Yes. Then, an image of the subject is formed on the image sensor 3 via the optical lens 2, and the image sensor 3 outputs a signal. The signal output from the image pickup device 3 is sampled, amplified, and digitized by the unit circuit 5, sent to the CPU 6, converted into luminance within the CPU 6, and luminance integration and histogram processing are performed.

  The optical lens 2 is held by a lens driving circuit 7 having an AF motor or the like. The lens driving circuit 7 is driven by the control of the CPU 6 to move in the optical axis direction and form an image on the image sensor 3. Adjust the focus of the subject image. Further, during the AE control, the image sensor 3 is driven by the TG 4 based on the shutter pulse sent from the CPU 6 and the charge accumulation time is controlled. Thereby, an electronic shutter is realized.

  The CPU 6 controls each unit and has various signal processing and image processing functions. The CPU 6 generates a video signal from an imaging signal converted into a digital signal through the unit circuit 5, and the imaging device 3. The subject image picked up by the above is displayed as a through image on the liquid crystal display unit 8 including a TFT liquid crystal monitor or the like. Further, at the time of image pickup, the image pickup signal is compressed to generate a JPEG format image file, which is stored in an image storage medium 9 such as a flash memory, and at the time of reproduction, the compressed image file is expanded and displayed on the liquid crystal display unit 8. Display.

  In the present embodiment, the liquid crystal display unit 8 is disposed on the back surface facing the front surface of the main body on which the optical lens 2 is disposed. Further, the CPU 6 includes a clock unit 10 that measures the current date and time, and the image storage medium 9 is detachable.

  Further, an operation key unit 11 including a cross cursor key, a shutter button, a menu key, a ROM 12, a GPS (Global Positioning System) module 13, a gyro unit 14, a RAM 15, and a notification unit 16 are connected to the CPU 6. The ROM 12 stores operation programs and the like necessary for control of each unit and various data processing by the CPU 6.

  It should be noted that the shutter button is divided into the first step and the second step and is pressed in two steps, “two-step full press”, and the first and second steps are pressed in one step without being pressed at once. This is a stepped operation type button.

  The GPS module 13 receives the L / B C / A code from the geodetic satellite, demodulates and decodes it, and determines the latitude / longitude of the current position. Information on the latitude / longitude determined by the GPS module 13 ( (Absolute position information) is taken into the CPU 6. The gyro unit 14 includes a two-axis gyro sensor that detects an angular velocity or an angular acceleration when the user moves the digital camera 1 in the horizontal direction or the vertical direction with the hand held by the user, and the detection output of the two-axis gyro sensor. Is output to the CPU 6. Therefore, the CPU 6 can calculate the movement amount of the digital camera 1 based on the change in the absolute position information from the GPS module 13 and the angular velocity or angular acceleration from the gyro unit 14.

  The RAM 15 temporarily stores various data and is used for work of the CPU 6. The notification unit 16 includes a light emitting unit and a sound report unit, and performs notification using light and / or sound.

  The ROM 12 stores a plurality (N pieces) of panoramic composition patterns (1), (2), (3),... (N) shown in FIG. These panoramic composition patterns are obtained by combining a single captured image captured at a time with the digital camera 1 as a partial image and combining these partial images with different numbers of matrix patterns. That is, the panorama composition pattern (1) is composed of 3 rows and 3 columns, the panorama composition pattern (2) is composed of 3 rows and 2 columns, and the panorama composition pattern (3) is composed of 1 row and 6 columns. Therefore, the panorama composition is performed in various compositions by the user selecting an arbitrary pattern from the plurality of different panorama composition patterns (1), (2), (3),. Can do.

  Further, in any of the partial images constituting each pattern, a face mark FM used for matching the position of the subject's face in the composition pattern is written at the default setting position. In this example, the panorama composition pattern (1) is the “partial image 5”, the panorama composition pattern (2) is the “partial image 3”, and the panorama composition pattern (1) is the “partial image 5”. Has been written. The face mark FM can be moved into another partial image by processing to be described later, and can also be moved to an arbitrary position in the center, left and right, and up and down in the partial image.

  Next, the operation of the digital camera 1 according to the above configuration will be described. FIG. 3 is a flowchart showing the processing procedure of the panoramic shooting mode in the present embodiment. When the panorama shooting mode is set by the operation of the operation key unit 11 by the user, the CPU 6 executes the processing shown in this flowchart according to the program.

  That is, the CPU 6 displays a list of N panoramic composition patterns (1), (2), (3),... (N) stored in the ROM 12 on the liquid crystal display unit 8 (step S101). Next, the CPU 6 determines whether or not a selection operation has been performed on any of the panorama composition patterns (1), (2), (3),... (N) displayed in a list (step S102). When one of the panorama composition patterns is selected by the user's operation on the operation key unit 11, the CPU 6 sets the selected panorama composition pattern, stores it in the RAM 15, and displays it on the liquid crystal display unit 8. (Step S103).

  Therefore, if the panorama composition pattern (1) is selected by the user, the panorama composition pattern (1) is displayed on the liquid crystal display unit 8 as shown in FIG. The face mark FM is positioned at the center in the “partial image 5” which is the default setting position.

  Next, the CPU 6 moves the face mark FM into another partial image area in response to an operation on the operation key unit 11 by the user (step S104). Therefore, the user can move the face mark FM located in the “partial image 5” at the default setting position into an arbitrary partial image region. Therefore, the face mark FM located in the “partial image 5” in the default setting can be moved to the “partial image 4” as shown in FIG. 4B.

  Here, the face mark FM is an area for matching the face of the subject as will be described later, and is an area where the face of the subject should be located in the composite image in the panorama composition pattern. Therefore, by the processing in step S104, the user can determine the composition in which the face of the subject is arranged on the desired partial image in the plurality of partial images constituting the panoramic composition pattern.

  If the movement determination operation of the face mark FM is performed by the operation of the operation key unit 11 by the user (step S105; YES), the CPU 6 continues the image region in which the face mark FM is determined according to the operation. (Step S106). That is, in the default setting, the face mark FM is located at the center in the partial image as shown in FIG. 4C. However, the user operates the operation key unit 11 as shown in FIG. As described above, the face mark FM can be moved to an arbitrary position such as the lower right in the partial image. Then, after the face mark FM is moved to an arbitrary position in the partial image, if the user performs a position determination operation by the operation of the operation key unit 11 by the user, the determination in step S107 becomes YES. Accordingly, the process proceeds from step S107 to step S108, the face mark position in the partial image area is set, and the position information of the face mark FM in the partial image area is stored in the RAM 15.

  Next, a flag table corresponding to the selected panoramic composition pattern is created and stored in the RAM 15 (step S109). That is, in this example, as shown in FIG. 5A, the panorama composition pattern (1) is selected, but this panorama composition pattern (1) is composed of 3 rows and 3 columns. Therefore, as shown in FIG. 5B, the CPU 6 creates a flag table FT having 3 rows and 3 columns corresponding to the panorama composition pattern (1) and stores it in the RAM 15. At this time, all the flags F in the flag table FT consisting of 3 rows and 3 columns are reset (“0”), and the face mark flag FF indicating that the face mark FM is a partial image area is also reset. ("0").

  Thereafter, the CPU 6 executes a face mark display process (step S110). In the face mark display process in step S110, the display area of the liquid crystal display unit 8 is regarded as a partial image area (partial image 4) where the face mark FM exists, and the position stored in the step S108 of the liquid crystal display unit 8 is stored. A face mark is displayed at the position indicated by the information. Therefore, when the face mark FM is determined at the lower right of the partial image 4 area as in this example, the face mark is displayed at the lower right of the liquid crystal display unit 8 in the process of step S110.

  Subsequently, the capturing of the subject image captured by the image sensor 3 is started, and the live view image is displayed on the liquid crystal display unit 8 (step S111). At this time, since the face mark is displayed at the position on the liquid crystal display unit 8 by the processing in step S110, the face mark and the live view image are superimposed and displayed. Therefore, the user can easily match the face of the subject person in the live view image with the face mark by adjusting the orientation of the digital camera 1 while viewing the liquid crystal display unit 8.

  On the other hand, the CPU 6 detects the position of the face of the human subject in the live view image (step S112). In the face position detection process in step S112, a known face detection method may be used. For example, a technique for detecting a human face area from one frame, such as a technique described in Japanese Patent Application Laid-Open No. 2003-274271 or a technique described in Japanese Patent Application Laid-Open No. 2000-30033, can be appropriately employed. Further, a dedicated circuit may be provided for the face detection process, or the face detection program may be executed by the CPU 6.

  Next, it is determined whether or not the face mark displayed on the liquid crystal display unit 8 matches the face position detected in the live view image (step S113). More specifically, the liquid crystal display unit 8 is equally divided into a plurality of regions, and the RAM 15 stores in which region the face mark belongs. Then, it is determined whether the face detected in the live view image exists in the equally divided region, and it is determined whether the region to which the determined face belongs and the region to which the face mark belongs are matched. .

  During this time, the user adjusts the orientation of the digital camera 1 so that the face mark displayed on the liquid crystal display unit 8 and the position of the face of the human subject in the live view image coincide. When the two positions coincide with each other, the CPU 6 controls the notifying unit 16 to notify that both coincide with each other by light or / and sound (step S114). Therefore, the user can recognize that the position of the face of the person subject in the live view image has become a desired position in the desired partial image by this notification.

  As described above, in the digital camera 1 according to the present embodiment, the optical lens 2 is disposed on the front surface of the main body, and the liquid crystal display unit 8 is disposed on the rear surface. Therefore, when the photographer performs self-photographing without using a self-timer, the liquid crystal display unit 8 cannot be visually recognized if the digital lens 1 is held in his / her hand and the optical lens 2 is directed toward the self. Therefore, the photographer cannot confirm whether or not the face mark and the face of the subject person (its own face) match on the liquid crystal display unit 8. However, since it is notified by light or sound that the two coincide with each other in the process in step S114, the photographer can view the live view image even when the photographer performs self-photographing without using the self-timer. It can be recognized that the position of its own face in the inside becomes a desired position in the desired partial image.

  Then, when the user who recognizes this presses the shutter button “two steps fully” on the operation key unit 11, the determination in step S115 becomes YES. Accordingly, the process proceeds from step S115 to step S116 to execute the partial image photographing process, and the image data from the image sensor 3 is acquired and stored in the RAM 15. As a result, as shown in FIG. 6A, in the panoramic composition pattern (1) of 3 rows and 3 columns, photographing of “partial image 4” having the face F of the person subject is completed.

  Further, a flag corresponding to the captured partial image is set (step S117). That is, at present, since the image of “partial image 4” having the face mark FM is taken in the panorama composition pattern (1) shown in FIG. 5A, the flag table FT shown in FIG. , The flag F4 corresponding to “partial image 4” is set to set the flag F4 = 1, and the face mark flag FF is also set to set the flag FF = 1.

  As described above, since the user has finished shooting the “partial image 4” where the face mark FM exists, the partial image to be shot next is the upper side of the “partial image 4” as shown in FIG. Are “partial image 1”, “partial image 7” connected to the lower side, and “partial image 5” continuous to the right side. Therefore, the user moves the digital camera 1 so that the optical lens 2 faces upward when the user wants to photograph “partial image 1” next time, and optical when the user wants to photograph “partial image 7”. The digital camera 1 is moved so that the lens 2 faces downward, and when the “partial image 5” is to be taken, the digital camera 1 is moved so that the optical lens 2 faces right.

  Then, as disclosed in Japanese Patent Application Laid-Open No. 2006-217478, the CPU 6 performs digital processing based on the change in the absolute position information from the GPS module 13 and the angular velocity or angular acceleration information from the gyro 14. Obtained by calculating the movement amount of the camera 1 (step S118). Further, the CPU 6 captures the partial image captured in step S116 and the next image based on the acquired movement amount information and the angle-of-view information and the pixel number information obtained from the image sensor 3 and the lens driving circuit 7. The overlap of the partial image to be processed, that is, the next partial image adjacent on the four sides with the captured partial image is calculated (step S119).

That is, in order to efficiently create a panoramic image, it is necessary that an overlapping portion between adjacent partial images does not become too large. For this reason, in step S119, first, the overlap between the partial image photographed in step S116, which is an adjacent partial image, and the partial image to be photographed next is calculated. Then, in the next step S120, it is determined whether or not the following two conditions are satisfied.
Condition 1: The overlap is in an appropriate range.
Condition 2: The partial image to be photographed this time based on the movement amount information is a partial image area in which the flag F = 0 and the flag is not set.
When determining whether or not the condition 1 is satisfied, for example, the overlap between the partial image captured in step S116 which is an adjacent partial image and the partial image to be captured next is, for example, 5% or more and less than 15%. In some cases, “the overlap is in an appropriate range”.

  As a result of this determination, when the conditions 1 and 2 are satisfied, that is, the partial image that is overlapped is in an appropriate range and is to be photographed this time based on the movement amount information is a partial image area in which the flag F = 0 and the flag is not set. If there is, the CPU 6 controls the notification unit 16 to notify this by light or / and sound (step S121). Therefore, the user who is taking the next partial image while adjusting the orientation of the digital camera 1 recognizes that the next partial image adjacent to the previously taken partial image can be taken by this notification. Can do.

  When the user completes two shutter buttons based on this recognition, the determination in step S122 is YES. Therefore, the CPU 6 proceeds from step S122 to step S123, executes the partial image photographing process, acquires the image data from the image sensor 3, and stores it in the RAM 15. Further, a flag corresponding to the captured partial image is set (step S124).

  Subsequently, it is determined whether or not the shutter button is pressed at once (step S125), and the loop of steps S118 to S125 is repeated until the shutter button is pressed at once. Therefore, in the present example in which the 3 × 3 panoramic composition pattern (1) is selected, the loop of steps S118 to S125 is repeated eight times, so that the flag table FT is updated as shown in FIG. All the flags are set (= 1).

  When the user presses the shutter button all at once, the process proceeds from step S125 to step S126, and the CPU 6 generates a panorama composite image in the RAM 15. That is, with reference to the “partial image 4” in which the face of the subject person photographed in step S116 is present, the overlapping part between the adjacent partial images is deleted from the other “partial image” photographed in step S123. A panorama composite image is generated by sequentially joining.

  Next, the CPU 6 determines whether or not all the flags in the flag table FT are set (= 1) (step S127). At this time, if the appropriate number of partial images corresponding to the panorama composition pattern selected in advance by the user is not captured, and the composite image of the selected panorama composition pattern is not properly generated in step S126, the flag table FT Are not set, and the determination in step S127 is NO.

  Therefore, the CPU 6 proceeds from step S127 to step S128, deletes the composite image generated in the RAM 15, and operates the notification unit 16 to notify that the composite image has been deleted. Thereafter, the process returns to step S112 to re-execute the processing described above. Therefore, the user can know from the notification in step S128 that the current panorama shooting has failed and the panorama composite image has not been recorded.

  On the other hand, when a proper number of partial images corresponding to the panorama composition pattern selected in advance by the user are photographed and a composite image of the selected panorama composition pattern is properly generated in step S126, FIG. As also indicated, all the flags in the flag table FT are set, and the determination in step S127 is YES. Therefore, the CPU 6 proceeds from step S127 to step S129, and stores the panorama composite image generated by the RAM 15 in the image storage medium 9.

  In the composite image stored in the image storage medium 9, a plurality of (N) panoramic composition patterns (1), (2), (3),... Shown in FIG. A panoramic composition pattern arbitrarily selected from (N). Therefore, for example, when the user selects a panoramic composition pattern (3) composed of one row and six columns, it is obtained in a normal photographed image that is long in the horizontal direction and has a human subject at the end thereof. A composition that cannot be achieved, that is, a composition unique to a panoramic image can be realized.

  In addition, the composite image stored in the image storage medium 9 is an image obtained by combining a plurality of photographed images with different photographing ranges, and the face of the person subject (the photographer himself / herself) at a user's desired part. Is included). Therefore, according to the present embodiment, it is possible to realize a user-desired composition in an image obtained by combining a plurality of photographed images having different photographing ranges.

  In the present embodiment, after the composite image is generated in step S126, the determination in step S127 is performed. If this determination is NO, the generated composite image is deleted. However, the determination in step S127 may be performed before the composite image is generated, and the composite image may be generated when the determination in step S127 is YES. In this way, if the determination in step S127 is NO, it is only necessary to perform notification without deleting the composite image in step S128, and the processing can be simplified.

  In this embodiment, the main subject to be recognized is the face of a human subject. However, the main subject to be recognized is not limited to this, and may be another subject, and the main subject to be recognized is variably set. You may be able to do it.

(Modification of the first embodiment)
FIG. 7 is a diagram showing an external configuration of the digital camera 1 according to a modification of the first embodiment of the present invention. The digital camera 1 includes a main body 20 and a flap 21 pivotally attached to a side portion of the main body 20. As illustrated, the flap 21 can be rotated between an unfolded state extending to the side of the main body 20 and a retracted state (not shown) folded on the back surface of the main body 20. The optical lens 2 is disposed on the front surface of the main body 20, and the liquid crystal display unit 8 is disposed on the surface portion of the flap 21.
The circuit configuration is the same as that of the first embodiment shown in FIG.

  Next, the operation of the digital camera 1 according to the above configuration will be described. FIG. 8 is a flowchart showing a processing procedure of the panorama shooting mode in the present modification. In this flowchart, the processes in steps S201 to S208 are the same as the processes in steps S101 to S108 in the flowchart shown in FIG.

  In step S209 following step S208, the CPU 6 executes a face mark display process. In the face mark display process in step S209, the display area of the liquid crystal display unit 8 is regarded as a partial image area (partial image 4) where the face mark FM exists, and the position stored in the step S208 of the liquid crystal display unit 8 is stored. A face mark is displayed at the position indicated by the information. Therefore, when the face mark FM is determined at the lower right of the partial image 4 area as in this example, the face mark is displayed at the lower right of the liquid crystal display unit 8 in the process of step S209.

  Subsequently, the capturing of the subject image captured by the image sensor 3 is started, and the live view image is displayed on the liquid crystal display unit 8 (step S210). At this time, since the face mark is displayed at the position on the liquid crystal display unit 8 by the processing in step S209, the face mark and the live view image are displayed in a superimposed manner. In addition, as shown in FIG. 7, when the user holds the digital camera 1 with the flap 21 in the unfolded state and the optical lens 2 facing the user, the user visually recognizes the liquid crystal display unit 8 while photographing himself / herself. It becomes possible to do. Therefore, the user can easily match his / her face in the live view image with the face mark by adjusting the orientation of the digital camera 1 while visually checking the liquid crystal display unit 8.

  On the other hand, the CPU 6 detects the position of the face of the human subject in the live view image (step S211). In the face position detection process in step S211, a known face detection method may be used as described above. Next, it is determined whether or not the face mark displayed on the liquid crystal display unit 8 matches the face position detected in the live view image (step S212). During this time, the user adjusts the orientation of the digital camera 1 so that the face mark displayed on the liquid crystal display unit 8 and the position of his / her face in the live view image coincide. When the positions of the two match, the CPU 6 controls the notification unit 16 to notify that the two match using light or / and sound (step S213).

  When the user responds to this notification and presses the shutter button “two steps fully” on the operation key unit 11, the determination in step S214 is YES. Accordingly, the process proceeds from step S214 to step S215 to execute the partial image photographing process, and the image data from the image sensor 3 is acquired and stored in the RAM 15. As a result, as shown in FIG. 6A, in the panoramic composition pattern (1) of 3 rows and 3 columns, photographing of “partial image 4” having the face F of the person subject is completed.

  Next, identification display of the captured partial image is started (step S216). In the process of step S216, as shown in FIG. 9A, a matrix-like pattern frame 80 corresponding to the panorama composition pattern selected in step S203 is displayed on the full screen on the liquid crystal display unit 8. Of course, the live view image displayed at this time is deleted. In the pattern frame 80, the rectangular area corresponding to the partial image captured in step S215 is displayed in a different color from the other areas.

  Accordingly, if the panorama composition pattern (1) is selected as in this example, a pattern frame 80 consisting of 3 rows and 3 columns is displayed as shown in FIG. 9A, and the image is captured in step S215. The rectangular area 84 in the second row and first column corresponding to the “partial image 4” is displayed in color.

  As shown in the figure, when the rectangular area 84 is an area corresponding to a partial image where a face image exists, a face mark FM is also displayed.

  By visually recognizing this display, the user can know that the photographing of “partial image 4” in which the face mark FM exists has been completed. As a result, as shown in FIG. 6A, the partial image to be photographed next is “partial image 1” connected to the upper side of “partial image 4”, “partial image 7” connected to the lower side, “ It can be recognized that it is one of the partial images 5 ”. Therefore, for example, when the user intends to take “partial image 1” next time, the user moves the digital camera 1 so that the optical lens 2 faces upward.

Then, as described above, it is obtained by calculating the movement amount of the digital camera 1 (step S217), and the overlap between the captured partial image and the next partial image adjacent on the four sides is calculated (step S219). Then, in the next step S220, it is determined whether or not the following two conditions are satisfied.
Condition 1: The overlap is in an appropriate range.
Condition 2: The partial image to be captured this time based on the movement amount information is an uncaptured partial image.

  As a result of this determination, if the conditions 1 and 2 are satisfied, that is, if the overlap is in an appropriate range and the partial image to be captured this time based on the movement amount information is an uncaptured partial image, the CPU 6 The notification unit 16 is controlled to notify this by light or / and sound (step S220). Therefore, the user who is taking the next partial image while adjusting the orientation of the digital camera 1 recognizes that the next partial image adjacent to the previously taken partial image can be taken by this notification. Can do.

  When the user completes the two shutter buttons based on this recognition, the determination in step S221 is YES. Therefore, the CPU 6 proceeds from step S221 to step S222, executes partial image shooting processing, acquires image data from the image sensor 3, and stores it in the RAM 15. Further, the identification display of the captured partial image is updated (step S223). That is, when the partial image captured this time is “partial image 1” adjacent to the upper side of the “partial image 4”, as shown in FIG. 9B, 1 corresponding to “partial image 1”. The display state of the liquid crystal display unit 8 is updated by color-displaying the rectangular region 81 in the first row.

  Therefore, each time a partial image constituting a panoramic composition pattern selected in advance by the user is photographed, the corresponding rectangular regions 84, 81,... Of the pattern frame 80 are sequentially colored and displayed. Thus, the user can recognize which partial images constituting the pre-selected panoramic composition pattern have been captured, and can reliably capture an appropriate number of partial images.

  In the present embodiment, the pattern frame 80 is displayed on the entire screen on the liquid crystal display unit 8. However, the liquid crystal display unit 8 is divided into screens, and the live view image is continuously displayed on one side, and the other side is displayed. The pattern frame 80 may be displayed. With such a display form, the captured partial image can be confirmed while the captured image is visually recognized in the live view image.

  In this way, when the entire area in the pattern frame 80 displayed on the liquid crystal display unit 8 is displayed in color, and shooting of an appropriate number of partial images is completed, the user presses the shutter button all at once. Then, the determination in step S224 is YES, and the CPU 6 proceeds to step S226 and generates a panorama composite image in the RAM 15. That is, with reference to “partial image 4” in which the face of the subject person photographed in step S215 is present, the overlapping portion between the adjacent partial images is deleted from the other “partial image” photographed in step S222. A panorama composite image is generated by sequentially joining. Further, the CPU 6 proceeds from step S225 to step S226, and stores the panorama composite image generated by the RAM 15 in the image storage medium 9.

  The composite image stored in the image storage medium 9 is an image obtained by combining a plurality of photographed images having different photographing ranges, and the face of the person subject (the photographer's own image) is placed on a desired part of the user. (Including face). Therefore, according to the present embodiment, it is possible to realize a user-desired composition in an image obtained by combining a plurality of photographed images having different photographing ranges.

  In addition, in the present embodiment, since an appropriate number of partial images can be reliably shot as described above, the composition desired by the user can be further improved in an image obtained by combining a plurality of shot images having different shooting ranges. It can be realized reliably.

(Second Embodiment)
FIG. 10 is a flowchart showing a processing procedure in the panorama shooting mode according to the second embodiment of the present invention. When the panorama shooting mode is set by the operation of the operation key unit 11 by the user, the CPU 6 executes the processing shown in this flowchart according to the program. In this flowchart, the processes in steps S301 to S309 are the same as the processes in steps S101 to S109 in the flowchart shown in FIG. Therefore, when the panorama composition pattern (1) is selected by the user, as shown in FIG. 5B, the CPU 6 creates a flag table FT consisting of 3 rows and 3 columns corresponding to the panorama composition pattern (1). Created and stored in RAM 15.

  Subsequently, the capturing of the subject image captured by the image sensor 3 is started, and the live view image is displayed on the liquid crystal display unit 8 (step S310). Further, the CPU 6 detects the position of the face of the human subject in the live view image (step S311). Also in the face position detection process in step S311, a known face detection method may be used as described above.

  Next, it is determined whether or not the face mark position in the partial image region set in step S308 matches the face position detected in the live view image (step S312). During this time, the user adjusts the orientation of the digital camera 1 so that the position of the face of the human subject in the live view image matches the position of the set face mark. When the two positions coincide with each other, the CPU 6 proceeds from step S312 to step S313 to automatically execute a partial image photographing process, acquires image data from the image pickup device 3, and stores it in the RAM 15. As a result, as shown in FIG. 6A, in the panoramic composition pattern (1) of 3 rows and 3 columns, photographing of “partial image 4” having the face F of the person subject is completed.

  Further, a flag corresponding to the captured partial image is set (step S317). That is, at present, since the image of “partial image 4” having the face mark FM is taken in the panorama composition pattern (1) shown in FIG. 5A, the flag table FT shown in FIG. , The flag F4 corresponding to “partial image 4” is set to set the flag F4 = 1, and the face mark flag FF is also set to set the flag FF = 1.

  As described above, since the CPU 6 has finished capturing the “partial image 4” where the face mark FM exists, the partial image to be photographed next is “partial image 4” as shown in FIG. One of “partial image 1” connected to the upper side, “partial image 7” connected to the lower side, and “partial image 5” connected to the right side. Therefore, the user moves the digital camera 1 so that the optical lens 2 is directed upward, downward, or rightward. Then, the CPU 6 calculates and acquires the movement amount of the digital camera 1 in the same manner as described above (step S315), and calculates the overlap between the partial image captured in step S313 and the partial image to be captured next (step S315). Step S316). Further, in the next step S317, it is determined whether or not the conditions 1 and 2 are satisfied.

  As a result of the determination, when the conditions 1 and 2 described in the first embodiment are satisfied, that is, the partial image that is overlapped is in an appropriate range and is to be photographed this time based on the movement amount information is flag F = 0. If it is a partial image area where a flag has not been set, the CPU 6 proceeds from step S317 to step S318. Then, the partial image photographing process is automatically executed, and the image data from the image sensor 3 is acquired and stored in the RAM 15. Further, a flag corresponding to the captured partial image is set (step S319).

  Subsequently, it is determined whether or not all the flags in the flag table FT are set (= 1) (step S320). At this time, if shooting of an appropriate number of partial images corresponding to the panorama composition pattern selected in advance by the user has not been completed, all the flags in the flag table FT have not been set, and the determination in step S327 is performed. No. Accordingly, the process returns to step S315, and the loop of steps S315 to S320 is repeated until all the flags in the flag table FT are set.

  Accordingly, in this example in which the 3 × 3 panoramic composition pattern (1) is selected, the loop of steps S315 to S320 is repeated eight times. As a result, each partial image constituting the selected panoramic composition pattern is automatically photographed sequentially. When the nine partial images constituting the 3 × 3 panoramic composition pattern (1) are automatically captured, all the flags in the flag table FT are set (= 1 as shown in FIG. 6B). ). Then, the CPU 6 proceeds from step S320 to step S321, and generates a panoramic composite image in the RAM 15 as described above. Further, the panorama composite image generated by the RAM 15 is stored in the image storage medium 9 (step S322).

  Therefore, according to the present embodiment, an image having the face of a subject person and a plurality of parts constituting the panorama composition pattern according to the panorama composition pattern selected in advance without the user operating the shutter button. Images are automatically captured and combined. Therefore, according to the present embodiment, it is possible to easily and quickly realize a user-desired composition in an image obtained by combining a plurality of photographed images having different photographing ranges.

  In the present embodiment, the process of displaying the face mark on the liquid crystal display unit 8 is omitted without performing the process of step S110 executed in the first embodiment, but the same process may be performed. Good. Accordingly, the user can adjust the orientation of the digital camera 1 while visually recognizing the liquid crystal display unit 8, and can easily match the face of the subject person in the live view image with the face mark. As a result, the partial image capturing process in step S313 is performed quickly, and the time required to record the composite image can be shortened in combination with the automatic capturing of each partial image.

1 Digital Camera 2 Optical Lens 3 Image Sensor 4 TG
5 Unit circuit 6 Image processing circuit / CPU
8 Liquid crystal display unit 9 Image storage medium 11 Operation key unit 12 ROM
13 GPS module 14 Gyro section 15 RAM
16 Notification unit 20 Main body 21 Flap 22 Control unit 80 Pattern frame FF Face mark flag FM Face mark FT flag table

Claims (10)

Photographing means for photographing an image;
A first setting means for setting a position of a main subject image in a prescribed composite image obtained by combining a plurality of images according to an operation;
Recognizing means for recognizing the main subject image on the image photographed by the photographing means;
A photographing range for each image photographed by the photographing unit is set so that the main subject recognized by the recognizing unit is positioned at the position set by the first setting unit on the prescribed composite image. A second setting means;
When the photographing range of the image photographed by the photographing means becomes the photographing range set by the second setting means, the image photographed by the photographing means is acquired autonomously or otherwise. Acquisition means;
Synthesizing means for generating the prescribed synthesized image by synthesizing a plurality of images obtained by the obtaining means;
An imaging apparatus comprising: The first setting means includes
Selecting means for selecting an image for setting the position of the main subject from a plurality of images constituting the prescribed composite image;
Position setting means for setting the main subject at an arbitrary position in the image selected by the selection means;
The imaging apparatus according to claim 1, further comprising: When the shooting range of the shot image shot by the shooting means becomes the shooting range set by the second setting means, the first notification means for notifying that effect,
The imaging device according to claim 1, wherein the acquisition unit acquires an image captured by the imaging unit in response to an operation after the notification by the first notification unit. The acquisition means includes
When the shooting range of the shot image shot by the shooting unit is the shooting range set by the second setting unit, the image shot by the shooting unit is autonomously acquired. The imaging apparatus according to claim 1. A third setting means for setting a photographing range of the prescribed composite image;
The imaging apparatus according to claim 1, further comprising: The third setting means includes
Comprising storage means for storing a plurality of composite patterns of the composite image;
6. The photographing apparatus according to claim 5, wherein an arbitrary composite pattern is selected from a plurality of types of composite patterns stored in the storage means according to an operation, and a photographing range of the composite image is set. 2. The apparatus according to claim 1, further comprising: a second notifying unit for notifying that the shooting range of the synthesized image generated by the synthesizing unit does not include the shooting range of the specified synthesized image. 6. The photographing apparatus according to any one of 6.   7. The photographing apparatus according to claim 1, further comprising a display unit that displays a correspondence relationship between the image acquired by the acquisition unit and an image constituting the prescribed composite image. Determining means for determining whether or not all the images corresponding to the images constituting the prescribed composite image have been acquired by the acquiring means;
7. The composite image according to claim 1, wherein the composition unit generates the composite image when it is determined by the determination unit that an image corresponding to an image constituting the prescribed composite image has been acquired. The imaging device described. A computer included in an imaging apparatus including an imaging unit that captures an image,
A first setting means for setting a position of a main subject image in a prescribed composite image obtained by combining a plurality of images according to an operation;
Recognizing means for recognizing the main subject image on the image photographed by the photographing means;
A photographing range for each image photographed by the photographing unit is set so that the main subject recognized by the recognizing unit is positioned at the position set by the first setting unit on the prescribed composite image. A second setting means;
When the photographing range of the image photographed by the photographing means becomes the photographing range set by the second setting means, the image photographed by the photographing means is acquired autonomously or otherwise. Acquisition means;
Synthesizing means for generating the prescribed synthesized image by synthesizing a plurality of images obtained by the obtaining means;
A shooting control program characterized by causing the function to function.

Images