JP2011097194A - Imaging apparatus, method of controlling the same, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To assist photographing by guiding the operation of a photographer to correct a position of a subject to a position coinciding with photographing composition. <P>SOLUTION: An imaging apparatus includes a selection unit for selecting photographing composition information for indicating a composition in photographing of the subject, namely an object to be photographed, a recognition unit for acquiring subject recognition information for indicating a recognition result of the subject, a comparison unit for comparing the selected photographing composition information with the subject recognition information, a determination unit for determining whether the photographing composition information coincides with the subject recognition information based on a comparison result, a presentation unit for presenting the comparison result, and a determined result; and a guidance unit for guiding the operation of the photographer so that the subject recognition information coincides with the photographing composition information based on the presented information. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an imaging apparatus, an imaging apparatus control method, and a program.

  In recent years, with the increase in capacity and price of storage devices such as memory cards and hard disks of digital cameras, the trend of taking a large number of images has been spurred. For this reason, there has been a problem that it takes time to select only the necessary captured images after taking a picture.

  Furthermore, when creating an album with a certain theme, such as a wedding ceremony, children's athletic meet, travel, etc., after taking a picture, the photographed images are classified by time series or scene, and the optimum is selected from each. It was necessary to sort out images, and complicated work was required.

  On the other hand, as a method for reducing such effort, the type of the subject to be noticed is determined, and the position of the subject to be noticed at the time of photographing is displayed based on information on the composition to be photographed (photographing composition information) according to the type of the subject. There is a method (see Patent Document 1) of displaying guidance.

JP 2007-020104 A

  However, there is still a problem that the photographer still has to perform correction of the position of the subject while judging whether or not the position of the subject is in an appropriate state as the photographing composition of the photo used for the album.

  In view of the above-described problems, the present invention provides shooting assistance by guiding the photographer's operation to correct the position of the subject to a position that matches the shooting composition that is information related to the composition at the time of shooting the subject. An object of the present invention is to provide an imaging technique capable of performing shooting while performing.

An imaging apparatus according to the present invention that achieves the above-described object,
Selecting means for selecting shooting composition information indicating a composition when shooting a subject to be shot from an information storage means for storing the shooting composition information;
Recognition means for recognizing the subject and acquiring subject recognition information indicating a recognition result of the subject;
Comparison means for comparing the photographing composition information selected by the selection means with the subject recognition information acquired by the recognition means;
Judging means for judging whether or not the photographing composition information and the subject recognition information match based on a result of the comparison by the comparing means;
Presenting means for presenting the result of the comparison by the comparing means and the result of the judgment by the judging means;
Guidance means for guiding a photographer's operation to match the subject recognition information and the photographing composition information based on the result of the comparison presented by the presenting means and the result of the determination. It is characterized by.

  According to the present invention, it is possible to perform shooting assistance by guiding the photographer's operation to correct the position of the subject to a position that matches the shooting composition. With this shooting assistance, it is possible to prevent shooting omission and excessive shooting of the subject. Also, when creating an album after shooting, it is possible to reduce the labor of sorting.

1 is a block diagram showing a system configuration of a digital camera. The block diagram which shows the functional structure of a digital camera. The flowchart which shows a main process. The flowchart which shows a still image album creation flow. Float showing the still image shooting flow in the method of manually selecting the shooting composition. 6 is a flowchart showing a flow for guiding a photographer's operation in order for a subject to match a shooting composition. The figure which shows the display content of the display apparatus in the system which selects a photography composition manually. The figure which shows the transition of the display content at the time of guide | inducing a photographer's operation in order to match | combine a subject with a photography composition in the system which selects a photography composition manually. The flowchart which shows the moving image imaging | photography flow in the system which selects an imaging | photography composition manually. The flowchart which shows the still image shooting flow in the system which selects a photography composition automatically. The figure which shows the display content of the display apparatus in the system which selects an imaging | photography composition automatically, and the transition of the display content at the time of guide | inducing in order that a to-be-photographed object may match an imaging | photography composition.

(First embodiment)
A system configuration of an imaging apparatus (hereinafter referred to as “digital camera 100”) will be described with reference to FIG. The digital camera 100 includes a CPU (Central Processing Unit) 101, a primary storage unit 102, a communication control unit 103, an input unit 104, a display unit 105, an imaging unit 106, and a secondary storage unit 107. Yes. The CPU 101 and each device are connected by a bus 108.

  The CPU 101 reads a system program stored in the secondary storage unit 107, develops it in a work area formed in the primary storage unit 102, and controls each device according to the system program. Further, the CPU 101 reads out various processing programs stored in the secondary storage unit 107 and develops them in a work area, and executes various processes according to the developed programs. The primary storage unit 102 forms a work area for temporarily storing various programs executed by the CPU 101 and data related to these programs.

  The communication control unit 103 is connected to an external electronic device (not shown) such as a personal computer via a communication cable or the like, and controls transmission / reception of image data and the like. The connection with an external electronic device is not necessarily a wired connection with a communication cable or the like, and may be performed with a wireless connection such as infrared rays.

  The input unit 104 includes a power key, a shutter key, a key for moving the cursor position on the display screen of the display unit 105, and a determination key for specifying and setting the content selected at that time ( Not shown). In addition, the input unit 104 includes a mode switch for switching the operation mode of the digital camera 100 such as a normal shooting mode, an album creation mode, an end mode, and a playback mode (not shown). The input unit 104 outputs an operation signal corresponding to each key operation and switch operation by the photographer to the CPU 101. The display unit 105 includes a monitor (display screen) such as an LCD (Liquid Crystal Display). Then, in accordance with the instruction of the display signal input from the CPU 101, the display unit 105 displays a shooting composition template, which is an image to be shot, and the shot image, etc. on the display screen.

  The functional configuration of the digital camera 100 will be described with reference to FIG. The shooting composition information holding unit 201 functioning as an information storage unit stores shooting composition information, shooting conditions, and the like of an album created as a template in advance. A subject recognition unit 202 that functions as a recognition unit performs image processing on image data being shot to recognize a subject to be shot. The subject comparison unit 203 that functions as a comparison unit compares the shooting composition information with subject recognition information that is a recognition result of the subject, and calculates a similarity. A match determination unit 204 functioning as a determination unit determines whether the subject recognition information and the shooting composition information match based on the similarity obtained by the comparison unit. The result presenting unit 205 that functions as a presenting unit presents the photographing composition information, the similarity between the photographing composition and the subject, whether or not the selected photographing composition is matched, and the like on the display unit 105 as comparison results. In addition, the result presenting unit 205 has a function as guiding means for guiding the photographer to operate the image processing apparatus so that the photographing composition matches the subject based on the presented comparison result. An image photographing unit 206 that functions as a photographing unit photographs a subject with the imaging unit 106. An image recording unit 207 that functions as a recording unit records an image captured by the image capturing unit 206 in the secondary storage unit 107 or the like. An album creating unit 208 functioning as an album creating unit creates an album from images stored in the secondary storage unit 107 or the like.

  With reference to FIG. 3, the flow showing the main process of photographing will be described. First, the current operation mode (shooting mode) is analyzed (step S301). When the current operation mode is the normal shooting mode (step S302; YES), normal shooting processing is executed (step S303). The normal shooting mode is a shooting mode in which shooting is performed by processing predetermined as a standard in the digital camera 100. On the other hand, when it is not the normal shooting mode (step S302; NO), the process proceeds to step S304. If it is determined in step S304 that the current operation mode is the album shooting mode (step S304; YES), a still image album creation flow is executed in step S305 (see FIG. 4). The still picture album creation flow in FIG. 4 will be described later. As a result of analyzing the current operation mode (step S301), a case is considered in which the mode switching is not instructed by operating a mode switching switch (not shown) of the input unit 104, etc., and the album photographing mode remains (step S302; NO, And step S304; YES). In that case, a still image album creation flow is executed (step S305).

  On the contrary, when the mode switching is instructed and the album shooting mode is not maintained, the normal shooting (step S302; YES) or the end mode determination (step S302; NO and step S304; NO) is performed. (Step S306). That is, if it is determined in step S304 that the current operation mode is not the album shooting mode (step S304; NO), it is determined whether or not the operation mode is an end mode (step S306). If it is determined that the current operation mode is not the end mode (step S306; NO), processing according to the current operation mode is executed (step S307).

  For example, when the current operation mode is the playback mode, an image list recorded in the secondary storage unit 107 is displayed on the screen of the display unit 105, and a captured image selected from the image list is reproduced and displayed. The If it is determined in step S306 that the current operation mode is the end mode (step S306; YES), the process ends.

  Next, a still image album creation flow will be described with reference to FIG. The communication control unit 103 receives (downloads) the shooting composition information of an album prepared in advance as a template in a personal computer (not shown) via a communication cable or the like, and transfers it to the work area of the primary storage unit 102 ( Step S401). When the transfer process ends, the still image shooting flow shown in FIG. 5 is executed (step S402). The still image shooting flow will be described later. When the still image shooting flow is completed, the shot still image is pasted to the corresponding position of the album to create a still image album (step S403), the created still image album is transferred to the terminal (step S404), and processing is performed. Exit.

  With reference to FIG. 5, a still image shooting flow in a method of manually selecting a shooting composition will be described. First, the CPU 101 extracts the shooting composition information of the album from the shooting composition information holding unit 201 and displays it on the screen of the display unit 105. The shooting composition information of the album is presented on the screen of the display unit 105 as shown in FIG. 7 to be described later, for example, and the photographer selects one arbitrary shooting composition from the presented shooting composition information (step S501). ). Here, a case where the photographer selects the photographing composition 701 in FIG. When the photographer selects the shooting composition 701, the shooting composition guidance flow shown in FIG. 6 is executed (step S502). The shooting composition guidance flow will be described later. In the shooting composition guidance flow, if the shooting composition information matches the subject recognition information, a still image is shot (step S503). Then, it is confirmed whether or not all the shooting compositions have been shot. If shooting has not been completed for all shooting compositions (step S504; NO), any one shooting composition is selected from the remaining shooting compositions that have not been shot. The photographer is selected (step S501). When the above procedure is repeated and all the shooting compositions have been shot (step S504; YES), the process ends.

  Here, the photographing composition guidance flow in FIG. 6 will be described. First, it is confirmed whether or not the position of the subject has been updated during shooting (step S601). The method for confirming the update is as follows. If the shutter key is not pressed halfway, it is determined that the subject position has not been updated (step S601; NO), and if the shutter key is pressed halfway, the subject position is updated. (Step S601; YES). When the position of the subject is updated, the image data acquired immediately after the shutter key is pressed halfway from the imaging unit 106 is temporarily stored in the temporary storage device 102. Then, the similarity between the subject recognition information of the stored image data and the shooting composition information is calculated. The method for calculating the similarity is not particularly limited. For example, a method of performing image region separation processing on the image data to extract the contour of the subject and calculating the correlation with the photographing composition information can be given. Then, it is determined whether or not the calculated similarity exceeds a first threshold value (threshold value 1) that is a determination reference value for determining whether or not the subject recognition information and the shooting composition information are similar (step S603). If the similarity does not exceed the first threshold (step S603; NO), it is presented on the screen of the display unit 105 that it is not similar to the shooting composition (step S604). On the other hand, if the similarity exceeds the first threshold (step S603; YES), the calculated similarity is a second criterion for determining whether the subject recognition information and the shooting composition information match. It is determined whether or not the threshold value (threshold value 2) is exceeded (step S605). If the similarity does not exceed the second threshold (step S605; NO), information for guiding the photographer's operation is displayed on the display unit 105 in order to correct the position of the subject in the preset shooting composition. Present it on the screen (step S606). Conversely, if the similarity exceeds the second threshold (step S605; YES), the fact that the shooting composition information and the subject recognition information match is presented on the screen of the display unit 105 (step S607). The process ends.

  Next, referring to FIG. 8, when the photographer selects a method for manually selecting a shooting composition, how the display screen of the display unit 105 is displayed when the shooting composition guidance flow shown in FIG. 6 is executed. Explain whether the transition occurs. Here, a case where the photographer selects the photographing composition 701 in FIG. Then, the first threshold (threshold 1), which is a determination reference value for determining whether or not the subject recognition information and the photographing composition information are similar, is set to 10, and the determination criterion for determining whether or not the photographing composition information and the subject recognition information match. A case where the second threshold value (threshold value 2) which is a value is set to 80 is taken as an example. First, in FIG. 6, the process waits until the shutter key is half-pressed (step S601). When the subject position is updated by half-pressing, the similarity between the shooting composition information and the subject recognition information is calculated. (Step S602). It is determined whether the calculated similarity exceeds a first threshold value that is a criterion for determining whether the subject recognition information and the shooting composition information are similar (step S603). Here, if the calculated similarity is 5, the first threshold value is not exceeded (step S603; NO), and it is presented on the screen of the display unit 105 that it is not similar to the imaging composition 701 (step S604). (FIG. 8 (a)).

  Thereafter, the process waits until the shutter key is pressed halfway again (step S601). When the shutter key is pressed halfway, the similarity between the shooting composition information and the subject recognition information is calculated (step S602). It is determined whether or not the calculated similarity exceeds a first threshold value (threshold value 1), which is a reference value for determining whether the subject recognition information and the shooting composition information are similar (step S603). Here, when the calculated similarity is 20, it exceeds the first threshold (threshold 1) (step S603; YES). Therefore, it is determined whether or not the calculated similarity exceeds a second threshold value (threshold value 2), which is a criterion value for determining whether or not the shooting composition information matches the subject recognition information (step S605). In this case, since it does not exceed 80 set as the second threshold value (threshold value 2) (step S605; NO), information for guiding the photographer's operation so that the photographing composition 701 matches the subject is displayed on the display unit 105. (Step S606) (FIG. 8B). In the example shown in FIG. 8B, since the subject is smaller than the shooting composition 701 and is closer to the upper right, an instruction to guide the photographer's operation of “zoom in / moving the position of the person to the lower left” is given to the photographer. Present. In addition, information “similarity 20%” is presented to allow the photographer to recognize how similar the subject and the shooting composition 701 are. Thereafter, the process waits until the shutter key is half-pressed again (step S601). When the half-press operation is performed, the similarity between the shooting composition information and the subject recognition information is calculated (step S602). It is determined whether or not the calculated similarity exceeds a first threshold value (threshold value 1), which is a reference value for determining whether the subject recognition information and the shooting composition information are similar (step S603). Here, when the calculated similarity is “70”, it exceeds the first threshold (threshold 1) (step S603; YES). Therefore, it is determined whether or not the calculated similarity exceeds a second threshold value (threshold value 2), which is a criterion value for determining whether or not the shooting composition information matches the subject recognition information (step S605). In this case, since the second threshold value (threshold value 2) is not exceeded (step S605; NO), information for guiding the photographer's operation so that the composition 701 matches the subject is displayed on the screen of the display unit 105. Presented above (step S606) (FIG. 8C). In the example shown in FIG. 8C, since the subject is closer to the right as compared with the photographing composition 701, the photographer is instructed to move the person's position to the left. Further, information “similarity 70%” is displayed in order to make the photographer recognize how similar the subject and the shooting composition 701 are.

  Thereafter, the process waits until the shutter key is pressed halfway again (step S601). When the shutter key is pressed halfway, the similarity between the shooting composition information and the subject recognition information is calculated (step S602). It is determined whether or not the calculated similarity exceeds a first threshold value (threshold value 1), which is a reference value for determining whether the subject recognition information and the shooting composition information are similar (step S603). Here, when the calculated similarity is “90”, it exceeds the first threshold (threshold 1) (step S603; YES). Therefore, it is determined whether or not the calculated similarity exceeds a second threshold value (threshold value 2), which is a criterion value for determining whether or not the shooting composition information matches the subject recognition information (step S605). In this case, since the second threshold value (threshold value 2) is exceeded (step S605; YES), it is presented on the screen of the display unit 105 that the photographing composition 701 matches the subject (step S607) (FIG. 8 ( d)). Further, in order for the photographer to recognize how similar the subject and the shooting composition 701 are, information of “similarity 90%” is also presented on the screen of the display unit 105 (step S607) (FIG. 8 (d)).

According to the present invention, photographing composition information is presented to a subject being photographed from the display unit of the photographing apparatus, so that photographing of a photographer can be assisted. With this shooting assistance, it is possible to prevent shooting omission and excessive shooting of the subject. In addition, when creating an album after shooting, it is possible to save the labor of selection. Furthermore, by guiding the correction of the subject arrangement position until the subject arrangement position is in an appropriate state as the composition of the photo used for the album, a photo that matches the composition of the album can be taken more easily.
(Second Embodiment)
A second embodiment according to the present invention will be described. With reference to FIG. 9, a moving image shooting flow in a method of manually selecting a shooting composition will be described. Here, the processing up to step S902 is the same as the processing in step S502 of FIG. First, moving image shooting starts (step S901). The CPU 101 reads out the shooting composition information of the album from the shooting composition information holding unit 201 and displays it on the screen of the display unit 105. The display unit 105 displays the shooting composition information of the album as shown in FIG. 7, and allows the photographer to manually select one shooting composition (step S902). Here, a case where the photographer selects the photographing composition 701 in FIG. 7 is considered. When the shooting composition 701 is selected, the shooting composition guidance flow shown in FIG. 6 is executed (step S903). If the shooting composition 701 matches the subject in the shooting composition guidance flow, a start tag is recorded during shooting of a moving image (step S904). After step S904, the similarity between the photographing composition 701 and the subject is calculated at predetermined intervals (step S905). Then, it is determined whether the similarity is below a second threshold (threshold 2), which is a criterion for determining whether or not the subject and the shooting composition 701 match (step S906).
If it is below the second threshold value (threshold value 2) (step S906; YES), an end tag is recorded during moving image shooting (step S907). If the recording time (time from the start tag to the end tag) does not exceed the time set in advance as album information (step S908; NO), the shooting composition guidance flow is continued (step S903). If the set time has been exceeded (step S908; YES), it is confirmed whether or not all the shooting compositions have been shot. If shooting has not been completed (step S909; NO), the photographer is allowed to select one shooting composition among the shooting compositions that have not been shot (step S902), and the shooting composition guidance flow is continued (step S903). To do. The same procedure is repeated, and when all the shooting compositions have been shot (step S909; YES), this processing ends.
(Third embodiment)
A third embodiment according to the present invention will be described. Consider a case in which the photographer selects a method for photographing still images to be used for an album by the digital camera 100 automatically selecting a photographing composition in step S402 in FIG. With reference to FIG. 10, a flowchart showing a still image shooting flow executed by the digital camera 100 will be described. First, the CPU 101 retrieves the shooting composition information of the album from the shooting composition information holding unit 201 and displays it on the display device 105. The display device 105 displays the shooting composition information of the album as shown in FIG. 11A, and notifies the photographer that the digital camera 100 automatically selects an appropriate shooting composition. Here, an appropriate shooting composition is automatically selected from the shooting composition 1101 to the shooting composition 1106 in FIG.

First, it waits until the shutter key is half-pressed (step S1001; NO). When the shutter key is pressed halfway and the subject content is updated (step S1001; YES), one of the plurality of shooting compositions that have not been selected is selected (step S1002). Then, the similarity between the shooting composition information and the subject recognition information (subject content) is calculated (step S1003). It is determined whether the calculated similarity exceeds a first threshold (threshold 1), which is a criterion for determining whether the subject recognition information and the shooting composition information are similar (step S1004). If the first threshold value (threshold value 1) has not been exceeded (step S1004; NO), the process proceeds to step S1010, and it is confirmed whether or not all shooting compositions have been selected (step S1010). If all the shooting compositions have been selected (step S1010; YES), the process waits until the subject content is updated (step S1001). If there is a shooting composition that has not yet been selected (step S1010; NO), the process returns to step S1002. Then, another one is automatically selected from the imaging compositions not yet selected (step S1002), and the same processing is performed (steps S1003 and S1004). In this way, when all the shooting composition information is not similar to the subject recognition information, the process waits until the shutter key is pressed halfway (step S1001; NO). On the other hand, if the degree of similarity of the selected shooting composition exceeds the first threshold (threshold 1) (step S1004; YES), the shooting composition guidance flow shown in FIG. 6 is executed (step S1006). If the photographing composition information does not match the subject in the photographing composition guidance flow (step S1007; NO), the photographing composition guidance flow shown in FIG. 6 is executed again. If the shooting composition information matches the subject recognition information in the shooting composition guidance flow (step S1007; YES), a still image is shot (step S1008). After shooting a still image, it is confirmed whether all shooting compositions have been shot. If shooting has not been completed (step S1009; NO), the process waits until the shutter key is pressed halfway (step S1001; NO). When all the shooting compositions have been shot (step S1009; YES), this process ends.
With reference to FIG. 11B, how the display screen of the display device 105 changes when the still image shooting flow shown in FIG. 10 and the shooting composition guidance flow shown in FIG. 6 are executed will be described. Here, the first threshold (threshold 1), which is a criterion for determining whether or not the subject recognition information (subject content) and the shooting composition information are similar, is 10, and whether or not the shooting composition information and the subject recognition information match. Assume that the second threshold value (threshold value 2), which is the determination criterion, is set to 80. First, it waits until the shutter key is half-pressed (step S1001; NO).

  When the shutter key is pressed halfway (step S1001; YES), a case is considered in which a shooting composition 1101 is automatically selected from a plurality of shooting compositions that have not yet been selected (step S1002). In this case, the similarity between the shooting composition 1101 and the subject recognition information is calculated (step S1003). It is determined whether or not the calculated similarity exceeds a first threshold (threshold 1) that is a criterion for determining whether or not the subject and the shooting composition 1101 are similar (step S1004).

  Here, if the calculated similarity is 5, the first threshold value (threshold value 1) is not exceeded (step S1004; NO), and it is displayed on the display device 105 that it is not similar to any shooting composition yet ( FIG. 11 (B) (a)). Thereafter, one of the unselected shooting compositions is automatically selected sequentially (step S1002), and the same processing is performed until a shooting composition whose similarity exceeds the first threshold (threshold 1) is found (step S1003). Step S1004). If the similarity with all shooting compositions is less than the first threshold (threshold 1) (step S1010; YES), the process goes through a loop and waits until the subject recognition information is updated (steps S1005 and S1001). Then, it continues to display on the display device 105 that it is not similar to any shooting composition (FIGS. 11B and 11A).

  Thereafter, the process waits until the subject recognition information (subject content) is updated (step S1001). When the subject recognition information (subject content) is updated, the similarity between the automatically selected shooting composition 1101 and the subject recognition information is calculated (step S1003). It is determined whether the calculated similarity exceeds a first threshold (threshold 1), which is a criterion for determining whether the subject recognition information and the shooting composition 1101 are similar (step S1004). Here, if the calculated similarity is 5, the first threshold value (threshold value 1) is not exceeded (step S1004; NO), so that it is not similar to the shooting composition 1101 is displayed on the display device 105 (FIG. 11 (B) (a)). Since the first threshold value (threshold value 1) is not exceeded (step S1004; NO), for example, the shooting composition 1102 is automatically selected from the shooting compositions that have not yet been selected (step S1002), and the same processing is performed (step S1002). Step S1003, Step S1004).

  Here, if the calculated similarity is 20, the first threshold value (threshold value 1) is exceeded (step S1004; YES), so the processing is executed from step S605 of the imaging composition guidance flow shown in FIG. 6 (step S1004). S1006).

  It is determined whether or not the calculated similarity exceeds a second threshold value (threshold value 2) that is a criterion for determining whether or not the photographing composition information matches the subject recognition information (step S605). Since the second threshold value (threshold value 2) is not exceeded (step S605; NO), information for guiding to the photographing composition 1102 is displayed on the display device 105 (step S606) (FIGS. 11B and 11B). As shown in FIGS. 11B and 11B, since the subject is smaller than the photographing composition 1102 and is closer to the right, an instruction “zoom in / move person's position to the right” is given to the photographer. Further, in order to make the photographer recognize how close the subject is to the photographing composition, information “similarity 20%” is displayed.

  After that, the system waits until the subject recognition information (subject content) is updated according to the guidance (step S601). When the subject recognition information (subject content) is updated, the similarity between the photographing composition 1102 and the subject recognition information (subject content) is calculated (step S602). . It is determined whether the calculated similarity exceeds a first threshold (threshold 1) that is a criterion for determining whether the subject recognition information and the shooting composition 1102 are similar (step S603). If the similarity calculated here is 5, the first threshold value (threshold value 1) is not exceeded (step S603; YES), and it is displayed on the display device 105 that it is not similar to the shooting composition 1102 (step 603). S604), the photographing composition guidance flow (step S1006) is terminated. Since the object recognition information and the shooting composition 1102 do not match (step S1007; NO), the process returns to step S1002, and the similarity with the automatically selected shooting composition information is sequentially calculated.

The similarity between the automatically selected shooting composition 1101 and the subject recognition information is calculated again (step S1003). It is determined whether or not the calculated similarity exceeds a first threshold (threshold 1) that is a criterion for determining whether or not the subject and the shooting composition 1101 are similar (step S1004). Here, if the calculated similarity is 20, the first threshold value (threshold value 1) is exceeded (step S1004; YES), so the processing is executed from step S605 of the imaging composition guidance flow shown in FIG. 6 (step S1004). S1006).
It is determined whether or not the calculated similarity exceeds a second threshold value (threshold value 2) that is a criterion for determining whether or not the photographing composition 1101 matches the subject recognition information (step S605). In this case, since the second threshold value (threshold value 2) is not exceeded (step S605; NO), information for guiding to the photographing composition 1101 is displayed on the display device 105 (step S606) (FIGS. 11B and 11C). ). As shown in FIGS. 11B and 11C, since the subject is smaller than the shooting composition 1101 and is closer to the upper right, an instruction “zoom in / move person's position to lower left” is given to the photographer. Further, information “similarity 20%” is displayed to make the photographer recognize how close the subject is to the shooting composition 1101.

  Thereafter, the process waits until the shutter key is half-pressed (step S601). If the shutter key is half-pressed, the similarity between the shooting composition information and the subject recognition information is calculated (step S602). It is determined whether or not the calculated similarity exceeds a first threshold (threshold 1) that is a criterion for determining whether or not the subject recognition information and the photographing composition information are similar (step S603). Here, if the calculated similarity is 70, it exceeds the first threshold (threshold 1) (step S603; YES). Therefore, it is determined whether the calculated similarity exceeds a second threshold value (threshold value 2), which is a criterion for determining whether or not the shooting composition information matches the subject recognition information (step S605). Since the second threshold value (threshold value 2) is not exceeded (step S605; NO), information for guiding to the photographing composition 1101 is displayed on the display device 105 (step S606) (FIGS. 11B and 11D). As shown in FIGS. 11B and 11D, since the subject is closer to the right as compared with the photographing composition, the photographer is instructed to “move the person's position to the left” and “similarity is 70%”. Is displayed.

  Thereafter, the process waits until the shutter key is half-pressed (step S601). If the shutter key is half-pressed, the similarity between the shooting composition information and the subject recognition information is calculated (step S602). It is determined whether or not the calculated similarity exceeds a first threshold (threshold 1) that is a criterion for determining whether or not the subject recognition information and the photographing composition information are similar (step S603). Here, if the calculated similarity is 90, it exceeds the first threshold (threshold 1) (step S603; YES). Therefore, it is determined whether the calculated similarity exceeds a second threshold value (threshold value 2), which is a criterion for determining whether or not the shooting composition information matches the subject recognition information (step S605). Since the second threshold value (threshold value 2) is exceeded (step S605; YES), it is displayed on the display device 105 that the photographing composition information and the subject recognition information match (step S607) (FIG. 11B ( e)), the photographing composition guidance flow (step S1006) is terminated. Since the subject recognition information (subject content) matches the shooting composition 1101 (step S1007; YES), a still image is shot (step S1008). After shooting a still image, it is confirmed whether all shooting compositions have been shot. If shooting has not been completed (step S1009; NO), the process returns to step S1001 and the same processing is repeated. If all of the shooting compositions 1101 to 1106 have been shot (step S1007; YES), the process ends.

  According to the present invention, it is possible to easily take a photo that matches the composition of the album by guiding the correction of the position of the subject until the position of the subject reaches an appropriate state as the composition of the photo used for the album. With this shooting assistance, it is possible to prevent omission of shooting of the subject and excessive shooting. In addition, when creating an album after shooting, it is possible to save the labor of selection.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

Claims (12)

Selecting means for selecting shooting composition information indicating a composition when shooting a subject to be shot from an information storage means for storing the shooting composition information;
Recognition means for recognizing the subject and acquiring subject recognition information indicating a recognition result of the subject;
Comparison means for comparing the photographing composition information selected by the selection means with the subject recognition information acquired by the recognition means;
Judging means for judging whether or not the photographing composition information and the subject recognition information match based on a result of the comparison by the comparing means;
Presenting means for presenting the result of the comparison by the comparing means and the result of the judgment by the judging means;
Guidance means for guiding a photographer's operation to match the subject recognition information and the photographing composition information based on the comparison result presented by the presenting means and the judgment result;
An imaging apparatus comprising:   The imaging apparatus according to claim 1, wherein the comparison unit obtains a similarity between the shooting composition information and the subject recognition information.   The imaging apparatus according to claim 1, wherein the guidance unit performs the guidance when the similarity obtained by the comparison unit exceeds a preset first threshold value.   After the guidance by the guidance unit, when the similarity obtained by the comparison unit exceeds a preset second threshold, the determination unit determines that the photographing composition information matches the subject recognition information. The imaging apparatus according to claim 3, wherein a determination is made.   After the guidance by the guidance means, when the similarity obtained by the comparison means exceeds the preset first threshold but does not exceed the preset second threshold, the guidance means The imaging apparatus according to claim 4, wherein the guidance is continuously performed.   After the guidance by the guidance unit, the imaging unit further includes a photographing unit for photographing the subject when the judgment unit determines that the photographing composition information matches the subject recognition information. Includes a moving image, and the comparing means obtains the similarity between the photographing composition information and the subject recognition information at a predetermined time, and while the second threshold is exceeded, the photographing means 6. The imaging apparatus according to claim 5, wherein the moving image shooting is continuously performed, and the shooting unit ends the moving image shooting when the second threshold value is exceeded.   6. The image captured by the imaging unit includes a still image, and the imaging unit captures the still image when the similarity exceeds the second threshold. Imaging device. Recording means for recording the image photographed by the photographing means;
The imaging apparatus according to claim 7, further comprising a creation unit that creates an album from the images recorded in the recording unit. The comparing means obtains a similarity between the photographing composition information and the subject recognition information;
The said selection means selects automatically the imaging composition information in which the said similarity exceeds the preset 1st threshold value from the said imaging composition information memorize | stored in the said information storage means. Imaging device. The guidance means performs the guidance when the similarity obtained by the comparison means exceeds the first threshold;
After the guidance by the guidance means, when the similarity exceeds a second threshold value that is preset and greater than the first threshold value, the determination means matches the photographing composition information with the subject recognition information. The imaging apparatus according to claim 9, wherein the imaging apparatus is determined to have performed. A selection step in which selection means selects shooting composition information indicating a composition when shooting a subject to be shot from an information storage means for storing the shooting composition information;
A recognition step of recognizing the subject and obtaining subject recognition information indicating a recognition result of the subject;
A comparison step for comparing the photographing composition information selected in the selection step with the subject recognition information acquired in the recognition step;
A determination step of determining whether or not the photographing composition information and the subject recognition information match based on a result of the comparison by the comparison step;
A presenting step in which the presenting means presents the result of the comparison in the comparison step and the result of the determination in the determination step;
A guiding step for guiding a photographer's operation to match the subject recognition information and the photographing composition information based on the result of the comparison presented by the presenting step and the result of the judgment; ,
A method for controlling an imaging apparatus, comprising:   The program for making a computer perform the control method of the imaging device of Claim 11.

Images