JP2010161547A - Composition selecting device and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To more simply select a composition suitable for recording during recording a photographed image. <P>SOLUTION: When an imaging optical system 11 and an imaging part 12 acquire the photographed image, a control part 13A detects attention objects included in the photographed image, and counts the number of detected attention objects. The control part 13A selects a composition for recording the entire picked-up images among a plurality of compositions recorded in a storage device 14C in advance on the basis of the number of the attention objects. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a composition selection device and a program for selecting a composition when recording a captured image.

  Conventionally, as a technique for presenting a photographing composition to a user when photographing a subject, an electronic camera described in Patent Document 1 below is known.

  This electronic camera composes a photographed image at the time of a fixed-point photographing performed before to obtain a composition image. The electronic camera then superimposes the finder image and the composition image at the time of fixed point shooting this time and aligns the positions, and sets the shooting condition of the previous shot image as the current shooting condition and performs fixed point shooting. Yes. Such an electronic camera stores a composition image corresponding to the photographing condition of the original image after the last photographing, and reproduces and displays the composition at the time of the current photographing. Further, the electronic camera can select an image having a composition from the previous photographed images, compose the photographed image, and superimpose it on the through image.

JP 2002-094854 A

  However, in the above-described technique, since the shooting composition is selected manually by the user, an operation for selecting the composition is complicated for the user.

  Therefore, the present invention has been proposed in view of the above-described circumstances, and an object thereof is to make it easier to select a composition suitable for recording when a captured image is recorded.

  According to a first aspect of the present invention, there is provided an image acquisition unit that acquires a captured image, a subject detection unit that detects a target subject included in the captured image acquired by the image acquisition unit, and an attention detected by the subject detection unit A counting unit that counts the number of subjects, a composition recording unit that records a plurality of compositions, and a plurality of compositions recorded in the composition recording unit based on the number of objects of interest counted by the counting unit. Composition selecting means for selecting a composition for recording the entire captured image.

  The second aspect of the present invention further includes an analysis unit that analyzes the target subject included in the captured image, and the composition selection unit analyzes the analysis by the analysis unit in addition to the number of the target subject counted by the counting unit. Select a composition based on the results.

  According to a third aspect of the present invention, the analysis means performs analysis method storage means for storing a plurality of types of analysis methods for the subject of interest included in the captured image, and a plurality of types of analysis methods stored in the analysis method storage means. Analysis method selection means for selecting a predetermined number of power analysis methods, and the analysis means analyzes the subject of interest with the analysis method selected by the analysis method selection means.

  According to a fourth aspect of the present invention, in the analysis method, an analysis based on a current date and time or a season, an analysis based on a vertical / horizontal posture of the imaging apparatus, an analysis based on a size of each target subject with respect to the captured image, and each target subject are registered. Analysis based on the age of each target subject, analysis based on the gender of each target subject, analysis based on a combination of all target subjects, and analysis based on the positional relationship of all target subjects.

  According to a fifth aspect of the present invention, there is further provided recognition means for recognizing a face portion, and the counting means counts the number of face portions recognized by the recognition means as the number of the subject of interest.

  The sixth invention further comprises setting means for setting the number of compositions selected by the composition selection means.

  According to a seventh aspect of the present invention, there is provided a computer having a memory in which a plurality of compositions are recorded in advance, an image acquisition unit that acquires a captured image, and a subject detection that detects a target subject included in the captured image acquired by the image acquisition unit Means for counting the number of target objects detected by the subject detection means, and based on the number of target objects counted by the counting means, the entire captured image among a plurality of compositions recorded in the memory It functions as a composition selection means for selecting a composition for recording.

  According to the present invention, the number of subjects of interest in the captured image is counted, and a composition for recording the entire captured image is selected from a plurality of previously recorded compositions based on the number of subjects of interest. When recording an image, it is possible to more easily select a composition suitable for recording.

It is a block diagram of an imaging device shown as an embodiment of the present invention. It is a flowchart which shows the whole process sequence of the imaging device shown as embodiment of this invention. It is a flowchart which shows the process sequence of the display setting process of the live view image by the imaging device shown as embodiment of this invention. It is a flowchart which shows the process sequence of the analysis process by the imaging device shown as embodiment of this invention. It is a figure which shows the utilization analysis result information in the imaging device shown as embodiment of this invention. It is a figure which shows the utilization analysis result information and composition number which are hold | maintained with the imaging device shown as embodiment of this invention. It is a figure which shows the specific example of the composition selection process by the imaging device shown as embodiment of this invention, (a) is a live view image, (b) is the live view image after extracting an attention object, (c) is a live view image. And an image including a shooting composition pattern. In the specific example of FIG. 7, it is a figure which shows the analysis result of a live view image, and the comparison result of an analysis result, (a) is the analysis result of a live view image, (b)-(d) is an analysis of a photography composition pattern. Results and comparison results. 4A and 4B are diagrams illustrating a specific example of composition selection processing by the imaging apparatus according to the embodiment of the present invention, in which FIG. 5A is a live view image after extracting a subject of interest, and FIG. is there. In the specific example of FIG. 9, it is a figure which shows the analysis result of a live view image, and the comparison result of an analysis result, (a) is the analysis result of a live view image, (b)-(d) is an analysis of a photography composition pattern. Results and comparison results. 4A and 4B are diagrams illustrating a specific example of composition selection processing by the imaging apparatus according to the embodiment of the present invention, in which FIG. 5A is a live view image after extracting a subject of interest, and FIG. is there.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[Configuration of imaging device]
First, a functional configuration of an imaging apparatus shown as an embodiment of the present invention will be described with reference to FIG. This imaging apparatus is provided with a composition selection function for selecting a photographing composition in the entire image including the subject of interest when a live view image is displayed during photographing. Therefore, the function as the composition selection device described below is not necessarily limited to the embodiment mounted on the imaging device, and for example, the function as the composition selection device can be realized in a personal computer.

  As shown in FIG. 1, the imaging apparatus includes an imaging optical system 11, an imaging unit 12, an information processing area 13 that handles information processing in the imaging apparatus, a recording area 14 that handles data recording operations in the imaging apparatus, and an imaging apparatus. And an operation input area 15 for performing an operation input operation.

  Here, the information processing area 13, the recording area 14, and the operation input area 15 respectively indicate functions necessary for the imaging apparatus. Each of the information processing area 13, the recording area 14, and the operation input area 15 may be composed of, for example, one chip or a plurality of chips. Accordingly, the information processing area 13, the recording area 14, and the operation input area 15 have various configurations necessary for information processing, data recording, and user operation input, respectively. The configurations in the information processing area 13, the recording area 14, and the operation input area 15 are not limited to those shown in FIG. 1 and the example described below, and the essence of the present invention is achieved even if the configuration is added or deleted as necessary. It does not deviate from the target part. Further, the configuration in the information processing area 13, the recording area 14, and the operation input area 15 may be provided close to each other or may be provided separately.

  Further, the imaging apparatus includes a main display control unit 16 and a main display unit 17 as a configuration for displaying various types of information to the user of the imaging device. The main display unit 17 includes a main touch panel 18.

  Furthermore, the imaging device includes an attitude detection unit 19, a time measuring unit 20, a sound processing unit 21, and a sound output unit 22 as incidental functions of the imaging device. In addition, the incidental function of this imaging device has shown only what is required in the following description.

  The imaging optical system 11 mainly includes a motor, a lens unit, and the like. This lens unit is composed of a plurality of lens groups for entering external light. The lens unit is an optical system for imaging external light in an imaging region within a predetermined range on an imaging element such as a CMOS (Complementary Metal-Oxide Semiconductor). Here, the imaging element is a CMOS, but it may be a CCD. The lens unit includes a shutter unit and an aperture unit (not shown). These shutter units and diaphragm units are moved in focus and diaphragm positions by driving a motor. This lens unit also includes a zoom lens that can freely zoom out and zoom in according to the control of the control unit 13A, and can change the shooting range.

  The imaging unit 12 includes the above-described imaging device such as a CMOS. The CMOS forms, for example, RGB primary color filters. The CMOS is scan-driven by a timing generator and a vertical driver (not shown). The CMOS outputs one screen of photoelectric conversion output corresponding to a light image formed at regular intervals.

  The imaging unit 12 includes a controller that operates according to control by the control unit 13A, an A / D conversion processing circuit, and the like. The operation of the lens unit and the CMOS in the imaging optical system 11 is controlled according to the control of the controller in the imaging unit 12 and the control unit 13A in the information processing area 13 described later. The A / D conversion processing circuit includes a sample hold circuit and an A / D converter. The A / D conversion processing circuit performs desired processing on the photoelectric conversion output output from the CMOS. Specifically, the gain is appropriately adjusted for each primary color component of RGB in the state of an analog signal with respect to the photoelectric conversion output from the CMOS. Thereafter, the sample and hold circuit performs sample and hold, converts the image into digital photographed image data by an A / D converter, and outputs the digital photographed image data to the imaging processing unit 13C in the information processing area 13.

  The information processing area 13 includes a control unit 13A, an image compression unit 13B, and an imaging processing unit 13C as components responsible for information processing.

  The imaging processing unit 13C performs predetermined image processing on the captured image data supplied from the imaging unit 12. The imaging processing unit 13C performs conversion processing, pixel interpolation processing, γ correction processing, and matrix calculation of captured image data supplied as RGB data. The captured image data that has been subjected to predetermined image processing by the imaging processing unit 13C is supplied to the temporary recording device 14D in the recording area 14.

  The captured image data may be used as a live view image or may be used as a recording image. Here, when used as a live view image, the image size is set to the same size as the main display unit 17, and when used as a recording image, it is set to a size desired by the user.

  The control unit 13A controls the imaging apparatus in an integrated manner. The control unit 13A performs various types of control necessary for the imaging apparatus by operating according to the program recorded in the program recording area in the storage recording apparatus 14C.

  In particular, the control unit 13A performs processing according to the program recorded in the program recording area in the storage recording device 14C. By executing the process according to the program for selecting the photographed composition image, the control unit 13A counts the subject detection process for detecting the subject of interest included in the photographed image, and the number of the detected subject of interest. Among a plurality of photographic composition patterns recorded in the photographic composition pattern recording area in the storage recording device 14C based on the counting means, analysis processing for variously analyzing the subject of interest, and the counting results by the counting means and the analysis results of the analyzing means Composition selection processing is performed for selecting a shooting composition pattern in the entire image including the subject of interest. Details of the photographing composition selection process by the control unit 13A will be described later.

  Then, the control unit 13A causes the main display unit 17 to display the shooting composition pattern selected according to a predetermined in-screen layout. Thus, the imaging apparatus presents a shooting composition pattern that is preferable for the subject of interest in the current shooting situation, superimposed on a so-called live view image in which the image at that time is displayed in real time as a monitor image. Can do.

  Under the control of the control unit 13A, the image compression unit 13B applies ADCT (Adaptive Discrete Cosine Transform) in accordance with the JPEG (Joint Photograph Coding Experts Group) standard to the captured image data stored in the temporary recording device 14D. (Cosine transform) processing is performed to compress the data. This compressed data is recorded in the external recording device 14B in the recording area 14 as data for external recording.

  The recording area 14 includes an external recording mounting portion 14A, an external recording device 14B, a storage recording device 14C, and a temporary recording device 14D as a configuration that performs data recording. The external recording mounting portion 14A and the external recording device 14B are composed of a recording / reproducing device for a memory card as a recording medium. The storage recording device 14 </ b> C includes a nonvolatile memory. The temporary recording device 14D includes a volatile memory.

  The external recording mounting portion 14A has a structure in which an external recording medium (memory card) that can be recorded and reproduced by the external recording device 14B is detachable. The external recording device 14B includes a memory card recording / reproducing mechanism provided in the imaging device. The external recording device 14B records captured image data captured by the imaging device on a memory card under the control of the control unit 13A. Further, the external recording device 14B reproduces and outputs the photographed image data recorded on the memory card under the control of the control unit 13A.

  The storage recording device 14C includes an imaging composition pattern recording area. The shooting composition pattern recording area functions as a composition recording means for recording a plurality of shooting composition patterns. This shooting composition pattern indicates the arrangement of the subject of interest in the entire image. The photographic composition pattern differs depending on the number of target subjects included in the photographic image. In addition, this shooting composition pattern includes not only the number of subjects of interest, but also “the current date and time of shooting or the season, the vertical and horizontal orientation of the imaging device, the size of each subject of interest with respect to the captured image, and the registered person for each subject of interest. It may be different depending on whether there is registration, the age of each subject of interest, the gender of each subject of interest, the combination of all subjects of interest, or the positional relationship of all subjects of interest. The shooting composition pattern recording area is recorded as a composition pattern table in which a plurality of shooting composition patterns are tabulated. The shooting composition pattern recorded in the shooting composition pattern recording area is selected according to the control of the control unit 13A.

  The imaging apparatus records composition pattern data indicating a photographed composition pattern in a photographed composition pattern recording area. However, the present invention is not limited to this embodiment, and the composition pattern data is downloaded via a communication line and will be described later. As described above, any one of the plurality of shooting composition patterns may be determined.

  The operation input area 15 includes an imaging instruction unit 15A, a determination instruction unit 15B, a mode setting unit 15C, a movement operation unit 15D, a menu operation unit 15E, and a power supply operation unit 15F as a configuration for a user to input an operation. .

  Each unit 15A to 15F in the operation input area 15 is operated by the user of the imaging apparatus. Each unit 15A to 15F in the operation input area 15 is a key group including a press button, a cross key, and the like. In addition, in FIG. 1, although each part 15A-15F in the operation input area 15 is divided functionally, it is needless to say that a plurality of roles may be given to a single button or a cross key. The units 15A to 15F in the operation input area 15 are connected to the control unit 13A, and an operation signal indicating the operation content of each button is read by the control unit 13A.

  The main display control unit 16 periodically reads the captured image data stored in the temporary recording device 14D, generates a video signal based on these data, and outputs the video signal to the main display unit 17. Further, when a shooting composition pattern is selected from the control unit 13A, the main display control unit 16 is supplied with a shooting composition image representing the shooting composition pattern. Then, the main display control unit 16 supplies image data of the photographic composition pattern to the main display unit 17 according to a predetermined layout together with the real-time live view image currently acquired by the imaging device.

  Although not shown, the main display unit 17 is provided on the back side of the housing of the imaging device. The main display unit 17 functions as a monitor display unit (electronic finder) in the shooting mode. In this shooting mode, the main display unit 17 performs display based on the video signal from the main display control unit 16. Thereby, the imaging device displays the live view image captured from the main display control unit 16 at that time in real time. The main display unit 17 displays the photographed composition image together with the live view image when display data including the photographed composition image is supplied to the live view image.

  In this way, the imaging apparatus is ready for imaging in a so-called live view image display state in which a captured image at that time is displayed in real time on the main display unit 17 as a monitor image. Then, when the imaging instruction unit 15A is operated at a timing at which shooting is desired, a trigger signal indicating a half-pressed state or a fully-pressed state is generated for the control unit 13A. In response to this trigger signal, the control unit 13A causes the temporary recording device 14D to store the captured image data for one screen captured from the imaging optical system 11 at that time.

  The main touch panel 18 is built in the display surface of the main display unit 17. The main touch panel 18 outputs the pressed position on the display surface of the main display unit 17 as coordinate data. This coordinate data is read by the control unit 13A. The control unit 13A identifies the operation performed by the user on the main touch panel 18 based on the display state of the menu screen or the like currently displayed on the main display unit 17 and the coordinate data, and follows the operation. Control. The main touch panel 18 enables the user to select whether or not to select the target subject when determining whether or not to adopt the target subject in the live view image in order to determine the shooting composition.

  The posture detection unit 19 detects the posture of the imaging device itself. The posture detection unit 19 generates posture information indicating whether the imaging device is in the vertical direction or the horizontal direction, and supplies the posture information to the control unit 13A. The posture detection unit 19 can be realized by using a known technique such as a configuration in which a spherical object moves according to the posture of the imaging device and the position of the spherical object is optically detected.

  The timer unit 20 is realized by a timer and calendar function of the imaging device. Time information indicating the year, month, day, and time, which is timed by the time measuring unit 20, is read by the control unit 13A.

  The sound processing unit 21 outputs a predetermined shutter sound, guidance voice for performing imaging with the selected composition, and the like from the sound output unit 22 which is a small speaker. Sound data for outputting sound from the sound output unit 22 is supplied from the control unit 13A to the sound processing unit 21. The sound processing unit 21 drives the sound output unit 22 using the supplied sound data. The sound processing unit 21 and the sound output unit 22 can display the shooting composition together with the live view image and instruct the shooting composition by sound according to the control of the control unit 13A. At this time, the sound output unit 22 calculates the difference between the subject of interest and the shot composition image, and in order to reduce the difference, for example, “Please turn the camera to the right (or left, up, down)”, “zoom in” (Or zoom out) "is output from the sound output unit 22.

[Overall processing of imaging device]
The imaging device configured as described above performs processing including imaging composition selection processing by performing the processing illustrated in FIGS. 2 to 4 when the imaging device is gripped by the user and an operation of imaging a subject is performed. Execute.

  First, in step S1, the imaging apparatus reads the current shooting mode setting state by the control unit 13A. In the next step S2, the control unit 13A determines whether or not a menu screen display instruction command due to the operation of the menu operation unit 15E is generated. If a menu screen display instruction command has not occurred, the process proceeds to step S4. When a menu screen display instruction command is generated, a menu process is performed in step S3 to display the menu screen and perform an operation in response to the operation of the determination instruction unit 15B or the movement operation unit 15D according to the menu screen. To proceed to step S4. Examples of the menu process include a change in the shooting mode of the imaging apparatus itself, a change in image processing settings, and a change in flash operation settings.

  In the next step S4, the imaging apparatus performs a live view image capturing process. In this photographing process, the imaging processing unit 13C captures RGB data captured by the imaging optical system 11 and the imaging unit 12, and stores the captured image data subjected to predetermined image processing in the temporary recording device 14D. This predetermined image processing includes automatic white balance processing and the like. Then, the control unit 13A causes the main display control unit 16 to capture the captured image data stored in the temporary recording device 14D every predetermined period and display the captured image data on the main display unit 17. As a result, a real-time live view image captured by the imaging device can be displayed on the main display unit 17.

  In the next step S5, the control unit 13A sets shooting composition guide information to be displayed together with the live view image. The shooting composition guide information is information presented to the user when the current live view image is captured with a preferable shooting composition. This guidance information corresponds to photographing composition patterns 102A to 102C in FIG. In order to present such guidance information, the control unit 13A performs a composition selection process for selecting a preferable shooting composition pattern for the current live view image. In step S5, the control unit 13A performs, for example, setting of a focus frame displayed on the face portion of the subject of interest and setting for displaying a grid-like grid in the screen.

  In the next step S <b> 6, the control unit 13 </ b> A displays a live view image on the main display unit 17. At this time, the control unit 13A may display the guide information set in step S5. Thus, the user can take an image according to the imaging composition selected by the imaging apparatus while viewing the guidance information in order to capture the current live view image.

  In the next step S7, the control unit 13A determines whether or not a half-press flag indicating that the imaging instruction unit 15A that is a shutter button is half-pressed is turned on. This half-press flag is turned on by the control unit 13A when the imaging instruction unit 15A is half-pressed. If the half-press flag is on, the process proceeds to step S11. If the half-press flag is not on, the process proceeds to step S8.

  In step S8, the control unit 13A determines whether or not the trigger signal for which the imaging instruction unit 15A is half-pressed is detected. If the trigger signal is not detected, the process proceeds to step S11. In step S11, the control unit 13A ends the process when the normal shooting mode is ended, and returns the process to step S2 otherwise.

  On the other hand, if a trigger signal is detected, the process proceeds to step S9. The controller 13A turns on the half-press flag in step S9, and performs basic shooting condition setting processing in step S10. This basic shooting condition setting process performs, for example, a setting process for the focus state, flash state, and image processing set in the normal shooting mode. After step S10, the process proceeds to step S11.

  In step S12, the control unit 13A monitors a trigger signal generated when the imaging instruction unit 15A is operated, and determines whether or not the half-pressed state is maintained. If the half-pressed state is maintained, the process proceeds to step S14. If the half-pressed state is not maintained, in step S13, the half-press flag is turned off and the process proceeds to step S14.

  In step S14, the control unit 13A determines whether or not the operation has been performed to the fully pressed state by a trigger signal from the imaging instruction unit 15A. If full press is detected, the process proceeds to step S15. If full press is not detected, the process proceeds to step S11.

  In step S15, the image pickup optical system 11, the image pickup unit 12, the image pickup processing unit 13C, and the image compression unit 13B perform a recording image shooting process. In this recording image shooting process, a predetermined data compression process is performed by the image compression unit 13B on the shot image data subjected to the predetermined image process in accordance with the control of the imaging processing unit 13C. This predetermined image processing includes automatic white balance processing and the like. In step S16, the external recording device 14B records the recorded photographed image compressed by the image compression unit 13B on the memory card.

  In the next step S17, the control unit 13A controls the main display control unit 16 so that the captured image recorded on the memory card in step S16 is displayed on the main display unit 17 for confirmation. Thereafter, in step S18, control unit 13A turns off the half-press flag and returns the process to step S11.

"Live View image display setting process"
Next, the live view image display setting process in step S5 in the overall operation of the imaging apparatus described with reference to FIG. 2 will be described with reference to FIG.

  In the live view image display setting process, first, in step S21, the control unit 13A determines whether or not it is a timing to set a set of photographic composition images. Whether or not it is this setting timing is determined at every predetermined time while the image pickup apparatus is activated, every number of times the live view image is taken, when a large change is detected in the design of the live view image, and the like. Whether or not it is every predetermined time is determined by the control unit 13A with reference to the timing information of the timing unit 20. Whether the live view image is taken or not is determined by the control unit 13A by the number of times the main display control unit 16 updates the live view image captured by the temporary recording device 14D. The timing at which a large change in the design of the live view image is detected is determined by calculating a time-series difference of the live view image temporarily recorded in the temporary recording device 14D by the control unit 13A. If it is determined that it is the setting timing of the set of the photographic composition image, the process proceeds to step S22, and if not, the process ends.

  In step S22, the control unit 13A detects the subject of interest by performing pattern matching using the live view image. At this time, the control unit 13A reads the entire person and the face image of the person recorded in the storage recording device 14C in advance and compares them with the live view image. As a result, the control unit 13A can extract the person included in the live view image and the face of the person. This extraction result is generated for each subject of interest.

  In the next step S23, the control unit 13A performs an analysis process on the state of the subject of interest included in the live view image and an analysis process on information necessary for determining the shooting composition. The analysis processing of information necessary for determining the shooting composition includes processing for acquiring the current date and time or the season timed by the posture detection unit 19, processing for acquiring the vertical and horizontal postures detected by the posture detection unit 19, and the like. Can be mentioned. The process of analyzing the state of the subject of interest included in the live view image is as follows: `` The size of each subject of interest, whether or not each subject of interest is registered as a registered person, the age of each subject of interest, the gender of each subject of interest , A combination of all the subjects of interest, and a positional relationship of all the subjects of interest ”. In this analysis process, it is desirable to obtain at least two analysis results including the number of objects of interest.

  Such an analysis process is executed in the order of step S31 to step S39, for example, as shown in FIG. The processing order of this analysis processing is performed with priority given to processing with a light processing load. That is, the analysis result A is obtained by performing the analysis process of the date / period timed by the time measuring unit 20 in step S31, and the vertical and horizontal states of the imaging device detected by the posture detecting unit 19 in step S32. An analysis process is performed to obtain an analysis result B. Step S33 and subsequent steps are analysis processing using the target subject extracted in step S22, which is performed by the control unit 13A. In step S33, the size of each subject of interest is analyzed to obtain an analysis result C. In step S34, the number of subjects related to all the subjects of interest is analyzed to obtain an analysis result D. In step S35, an analysis result E is obtained by analyzing whether or not a character related to each target subject is registered as a registered person. A step S36 analyzes the age related to each subject of interest and obtains an analysis result F. A step S37 analyzes the sex related to each subject of interest and acquires the analysis result G. A step S38 analyzes the combinations related to all the subjects of interest and acquires the analysis result H. In step S39, the positional relationship relating to all the subjects of interest is analyzed to obtain an analysis result I.

  In the next step S24, the control unit 13A presents a plurality of imaging composition candidates to the user based on the analysis result acquired in step S23 and the usage analysis result information R set by the user's operation. The shooting composition set which is the shooting composition of is set. Composition selection processing is realized by setting the photographing composition set. The setting process of the usage analysis result information R displays a menu screen for selecting the usage analysis result information R at the start of the composition image shooting mode, and the user selects it with the movement operation unit 15D and decides it with the decision instruction unit 15B. Usage analysis result information R is determined in accordance with the operation performed. Here, the usage analysis result information R and the composition number N are recorded in the storage recording device 14C as flag data in the initial stage as shown in FIG.

  In the usage analysis result information R, as shown in FIG. 5, the analysis results used for setting the imaging composition set are set corresponding to the identification numbers “1” to “9” of the usage analysis result information R. ing. Such usage analysis result information R is set to use an analysis result D indicating the number of subjects related to all the subjects of interest among various analysis results. When the identification number of the usage analysis result information R is operated to “1”, the imaging composition set is set using only the number of the subject of interest that is the analysis result D. Then, the higher the identification number of the usage analysis result information R is, the more the analysis result different from the number of the subject of interest is weighted, and the photographing composition set is set. With the use analysis result information R setting process, the type or number of analysis results can be determined based on a signal generated by a user operation.

  When the usage analysis result information R is set, the usage analysis result information R is specified and set for the analysis result of the live view image obtained in step S23 and the shooting composition pattern previously stored in the storage recording device 14C. Compare the analysis results. The closer the analysis result of the live view image obtained in step S23 and the analysis result set for the shooting composition pattern are, the closer the shooting composition pattern matches the current live view image. The control unit 13A selects a plurality of shooting composition patterns of analysis results approximate to the analysis result of the live view image obtained in step S23, and sets a shooting composition set.

  In step S24, the priority (presentation order) between the shooting composition patterns is determined from the shooting composition set set based on the usage analysis result information R set by the user. This priority is set higher for a shooting composition pattern that approximates the analysis result of the live view image obtained in step S23. The priority order determination process will be described using specific live view images and analysis results.

  Then, the control unit 13A reads out a predetermined number (for example, “3”) of imaging composition patterns with high priority determined from the storage recording device 14C and supplies the images to the main display control unit 16. Accordingly, the main display control unit 16 can create a display image by combining the supplied image of the photographic composition pattern and the live view image, and can display the display image on the main display unit 17. As shown in FIG. 7, the main display control unit 16 is not limited to an example in which the shooting composition patterns 102A to 102C having higher priority are displayed on the upper part in the screen, but may be in other display forms. Only the photographing composition pattern with the highest priority may be superimposed on the live view image.

  In the next step S25, the control unit 13A selects the shooting composition pattern selected for the current live view image based on the usage analysis result information R and the composition number N of the shooting composition pattern determined by the user's operation. Determine the image. At this time, in the imaging apparatus, with the shooting composition set set in step S24 being displayed on the main display unit 17, the user selects one of the shooting composition patterns with the movement operation unit 15D and decides with the decision instruction unit 15B. As a result, the composition number N of the photographing composition pattern is determined. By such processing, the composition number N recorded as flag data is changed.

  According to the display setting process of the live view image described above, when the captured image is acquired by the imaging optical system 11 and the imaging unit 12 and the live view image is displayed on the main display unit 17, it is included in the live view image. A subject of interest is detected (step S22), and the number of the subject of interest detected is determined (step S23). Then, the imaging apparatus can select a shooting composition pattern for recording the entire captured image among a plurality of shooting composition patterns recorded in advance in the storage recording device 14C based on the number of target subjects (step S24). , Step S25).

  After the shooting composition pattern is selected in this way (step S24), the selected shooting composition pattern is displayed on the main display unit 17, thereby allowing the user to select a shooting composition pattern used for shooting the entire actual captured image. it can.

  As described above in detail, according to the imaging device shown as the embodiment of the present invention, the number of target subjects in the live view image is determined, and based on the number of target subjects, among a plurality of pre-recorded compositions. Since a composition for recording the entire captured image is selected, it is possible to more easily select a composition suitable for recording when recording a captured image.

  Further, according to this imaging device, “current date / time or season, vertical / horizontal orientation of the imaging device, size of each subject of interest with respect to the captured image, whether each subject of interest is registered as a registered person, Multiple composition is selected based on at least one analysis result of `` age, gender of each target subject, combination of all target subjects, positional relationship of all target subjects '', so more preferable shooting composition should be selected Can do.

  Furthermore, according to this imaging apparatus, when a plurality of compositions are selected, the presentation order (priority order) in the plurality of compositions is set, so that a more preferable shooting composition can be presented to the user with priority.

  Furthermore, according to this imaging apparatus, since the type or number of analysis results is determined based on a signal operated by the user, it is possible to select a preferable imaging composition according to the user's instruction.

  Furthermore, according to this imaging apparatus, since the composition is selected based on the number of face parts of the subject of interest, it is possible to select a photographing composition preferable for imaging a person and present it to the user.

"Specific explanation of composition selection"
Next, a process of selecting a shooting composition with reference to a specific live view image in the imaging apparatus that performs the above-described operation will be described.

  FIG. 7 shows a case where a family consisting of a father, mother, and child is imaged.

  In the state in which the live view image 100 shown in FIG. 7A is displayed, when it is the setting timing of the shooting composition set (step S21), the control unit 13A selects a target subject from the live view image 100 by pattern matching. The extraction process is executed (step S22). In the process of extracting the subject of interest, pattern matching is performed between the pattern image of the human face portion recorded in advance in the storage recording device 14C and the live view image 100.

  As a result of the pattern matching, the control unit 13A can detect the face portion of the person as shown in FIG. By this attention subject extraction processing, the control unit 13A controls the main display control unit 16 to display the attention subject frame 101 representing the face portion of the person, and the main display control unit 16 adds the attention subject to the live view image 100. The frame 101 is displayed in a superimposed manner. Note that the target subject frame 101 follows the movement of the target subject in the live view image 100.

  After extracting the subject of interest, the control unit 13A performs an analysis process on the subject of interest. Here, in the target object analysis processing, the target subject image in the target subject frame 101 is used, and the entire analysis processing shown in FIG. 4 is performed to obtain analysis results A to I. It should be noted that not only the image data in the subject frame 101 but the whole person may be the target data for the analysis process.

  The analysis result is as shown in FIG. 8A. The number of subjects of interest (analysis result D) is “3”, and the size of the subject of interest (analysis result C) is “medium size 2 people, small size 1”. "People", the orientation of the imaging device (analysis result B) is "horizontal", and whether or not the character of the subject of interest is registered as a registered person (analysis result E) is registered "father, mother, child" The positional relationship of the subject of interest (analysis result I) is “three faces (subject of interest) are arranged substantially horizontally”, and the gender of the subject of interest (analysis result G) is “two men and one woman” Subject age (analysis result F) is “2 adults, 1 child”, subject combination (analysis result H) is “father, child, mother”, date / period (analysis result A) is “October” It becomes. The analysis results A to I are compared with the analysis results set for the photographing composition pattern recorded in the storage recording device 14C.

  As a result of comparison between the analysis results, a shooting composition set including the shooting composition patterns 102A, 102B, and 102B shown in FIG. 7C can be selected. The analysis result of the shooting composition pattern 102A is as shown in FIG. 8B, the analysis result of the shooting composition pattern 102B is as shown in FIG. 8C, and the analysis result of the shooting composition pattern 102C is FIG. It is like (d). Since the date / period (analysis result A) is not set as the analysis result of the photographing composition patterns 102A, 102B, and 102C, comparison with the analysis result A obtained from the live view image 100 is not performed. The analysis result of the photographic composition pattern only needs to include at least the number of the subject of interest (analysis result D) among the analysis results A to I.

  The comparison result between the analysis result obtained from the live view image 100 and the analysis result of the shooting composition pattern 102A is as shown in FIG. 8B, and is completely identical except for the combination of the subject of interest (analysis result H). ) The comparison result between the analysis result obtained from the live view image 100 and the analysis result of the shooting composition pattern 102B is as shown in FIG. 8C, and the positional relationship (analysis result I) of the subject of interest is substantially inconsistent (Δ). Except for the combination of the subject of interest (analysis result H) being substantially coincident (◯), it is completely coincident (◎). The comparison result between the analysis result obtained from the live view image 100 and the analysis result of the shooting composition pattern 102C is as shown in FIG. 8D, and the vertical and horizontal states (analysis result B) of the imaging device are inconsistent (x). Yes, the positional relationship of the subject of interest (analysis result I) is substantially coincident (O), and the combination of the subject of interest (analysis result H) is substantially identical (O), and is completely identical (（). .

  As can be seen from the comparison results, among the analysis results of the photographic composition patterns 102A to 102C, the one closest to the analysis result obtained from the live view image 100 is the photographic composition pattern shown in FIG. It is an analysis result of 102A. Next to the analysis result of the shooting composition pattern 102A, the analysis result of the shooting composition pattern 102B approximates the analysis result of the live view image 100. Next to the analysis result of the photographic composition pattern 102B, the analysis result of the photographic composition pattern 102C approximates the analysis result of the live view image 100. Accordingly, the control unit 13A can set the shooting composition pattern 102A with the highest priority, and set the shooting composition pattern 102B and the shooting composition pattern 102C in descending order of priority.

  According to the display setting process of the live view image including such a composition selection process, the three shooting composition patterns 102A to 102C can be displayed adjacent to the live view image 100. Then, when the control unit 13A recognizes the operation of the moving operation unit 15D and any shooting composition pattern is selected, and the control unit 13A recognizes the operation of the determination instruction unit 15B, the composition number of the selected shooting composition pattern. N is determined.

  Thereafter, the imaging apparatus performs, for example, a process of superimposing and displaying the shooting composition pattern of the determined composition number N on the live view image 100 and a process of outputting the camera direction and zoom guidance voice from the sound output unit 22. Thereby, the live view image 100 can be brought close to the shooting composition pattern.

  Another specific example is shown in FIG. A live view image 100 shown in FIG. 9A shows an image when an elementary school student is imaged at an entrance ceremony.

  When pattern matching is performed on the live view image 100 shown in FIG. 9A, the face portion of a person can be detected as shown in FIG. 9B, and the face portion is recognized as the subject of interest. . Then, the control unit 13A can perform analysis processing on the target subject after extracting the target subject, and obtain analysis results A to I shown in FIG.

  The analysis result of the live view image 100 is as shown in FIG. 10A. The number of the subject of interest (analysis result D) is “one”, and the size of the subject of interest (analysis result C) is “medium size one person”. The orientation of the imaging device (analysis result B) is “horizontal”, and whether the character of the subject of interest is registered as a registered person (analysis result E) is the position of the subject of interest where “child” is registered. The relationship (analysis result I) is “position on the upper right”, the gender of the subject of interest (analysis result G) is “one man”, the age of the subject of interest (analysis result F) is “one child”, and the combination of the subject of interest ( The analysis result H) is “one child as described above”, and the date / period (analysis result A) is “early April”. The analysis results A to I are compared with the analysis results set for the photographing composition pattern recorded in the storage recording device 14C.

  As a result of the comparison between the analysis results, a shooting composition set including the shooting composition patterns 102A, 102B, and 102B shown in FIG. 9B can be selected. The analysis result of the shooting composition pattern 102A is as shown in FIG. 10B, the analysis result of the shooting composition pattern 102B is as shown in FIG. 10C, and the analysis result of the shooting composition pattern 102C is as shown in FIG. It is like (d). It should be noted that the analysis result of the photographic composition pattern only needs to include at least the number of subjects of interest (analysis result D) in the analysis results A to I.

  FIG. 10B shows a comparison result between the analysis result obtained from the live view image 100 and the analysis result of the shooting composition pattern 102A. FIG. 10C shows a comparison result between the analysis result obtained from the live view image 100 and the analysis result of the shooting composition pattern 102B. FIG. 10D shows a comparison result between the analysis result obtained from the live view image 100 and the analysis result of the shooting composition pattern 102C.

  As can be seen from the comparison results, among the analysis results of the shooting composition patterns 102A to 102C, the analysis result of the shooting composition pattern 102A is closest to the analysis result obtained from the live view image 100. Accordingly, the control unit 13A can set the shooting composition pattern 102A with the highest priority, and set the shooting composition pattern 102B and the shooting composition pattern 102C in descending order of priority. In particular, the imaging apparatus can select a shooting composition pattern for the entrance ceremony that matches the current time.

  According to the display setting process of the live view image including such a composition selection process, it is preferable to combine other analysis results such as the current time and the registered person even if the number of the subject of interest is “one person”. A shooting composition pattern can be presented.

  Yet another specific example is shown in FIG. A live view image 100 shown in FIG. 11 is an image of a large number of persons arranged in a line.

  By performing pattern matching on such a live view image 100, it is possible to extract the face portion of the person as the subject of interest arranged in a substantially straight line as shown in FIG. By performing the analysis process on such a subject of interest, the control unit 13A causes the analysis result that the number of subjects of interest (analysis result D) is large, and the analysis result that the positional relationship (I) of the subject of interest is in a line. Can be obtained.

  In response to such an analysis result, the control unit 13A reads out an imaging composition pattern representing the positional relationship of the subject of interest from the storage recording device 14C. Then, the shooting composition pattern representing the positional relationship of each target subject is compared with the analysis result obtained from the live view image 100. As a result, as shown in FIG. 11 (b), it can be displayed as shooting composition patterns 102A to 102C representing the positional relationship among a number of subjects of interest.

  According to the display setting process of the live view image including such a composition selection process, a preferable shooting composition pattern can be presented in the positional relationship of the subject of interest even if the number of subjects of interest is “many”. it can.

  The above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and various modifications can be made depending on the design and the like as long as the technical idea according to the present invention is not deviated from this embodiment. Of course, it is possible to change.

DESCRIPTION OF SYMBOLS 11 Imaging optical system 12 Imaging part 13 Information processing area 13A Control part 13B Image compression part 13C Imaging processing part 14 Recording area 14A External recording mounting part 14B External recording apparatus 14C Storage recording apparatus 14D Temporary recording apparatus 15 Operation input area 15A Imaging instruction part 15B Determination instruction unit 15C Mode setting unit 15D Movement operation unit 15E Menu operation unit 15F Power supply operation unit 16 Main display control unit 17 Main display unit 18 Main touch panel 19 Posture detection unit 20 Timing unit 21 Sound processing unit 22 Sound output unit 100 Live view Image 101 Attention subject frame 102A-102C Shooting composition pattern

Claims (7)

Image acquisition means for acquiring a captured image;
Subject detection means for detecting a subject of interest included in the captured image acquired by the image acquisition means;
Counting means for counting the number of objects of interest detected by the subject detection means;
Composition recording means for recording a plurality of compositions;
Composition selecting means for selecting a composition for recording the entire captured image from a plurality of compositions recorded in the composition recording means based on the number of the subject of interest counted by the counting means;
A composition selection device comprising: Further comprising an analysis means for analyzing the subject of interest included in the captured image;
2. The composition selection apparatus according to claim 1, wherein the composition selection unit selects a composition based on an analysis result by the analysis unit in addition to the number of objects of interest counted by the counting unit. Analysis method storage means for storing a plurality of types of analysis methods for the subject of interest included in the captured image;
Analysis method selection means for selecting a predetermined number of analysis methods to be performed by the analysis means from a plurality of types of analysis methods stored in the analysis method storage means;
Further comprising
The composition selecting apparatus according to claim 2, wherein the analyzing unit analyzes the subject of interest by an analyzing method selected by the analyzing method selecting unit.   The analysis method includes analysis based on the current date and time or season, analysis based on the vertical and horizontal postures of the imaging device, analysis based on the size of each target subject with respect to the captured image, and analysis of whether each target subject is registered. 4. An analysis based on the age of each target subject, an analysis based on the gender of each target subject, an analysis based on a combination of all target subjects, and an analysis based on the positional relationship of all target subjects. The composition selecting device described. It further comprises a recognition means for recognizing the face part,
5. The composition selection device according to claim 1, wherein the counting unit counts the number of face portions recognized by the recognition unit as the number of the subject of interest. 6.   6. The composition selection apparatus according to claim 1, further comprising setting means for setting the number of compositions selected by the composition selection means. A computer having a memory in which a plurality of compositions are recorded in advance.
Image acquisition means for acquiring a captured image;
Subject detection means for detecting a target subject included in the captured image acquired by the image acquisition means;
Counting means for counting the number of the subject of interest detected by the subject detection means;
Composition selecting means for selecting a composition for recording the entire captured image from among a plurality of compositions recorded in the memory, based on the number of objects of interest counted by the counting means;
A program characterized by functioning as

Images