JP5013924B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging apparatus, an imaging method, and an imaging program.

2. Description of the Related Art In recent years, digital cameras that automatically detect the position of a face and shoot a still image by adjusting the focus and exposure according to the face position are commercially available (for example, Non-Patent Document 1). In these digital cameras, when a face is detected when the AE / AF lock is applied, the still image captured image is automatically classified into the category “person”, and the classification information “person” is added to the image file of the image. The
“Canon Digital Camera PowerShot G7 Camera User Guide Application”, Canon Inc., 2006, P25, P57

  However, in the technique of Non-Patent Document 1, the face position is detected when the AE / AF lock is performed by half-pressing the shutter button before taking a still image, and the image is classified into the image file based on the detection result. Information "person" is given. On the other hand, still image shooting is actually performed when the shutter button is fully pressed. For this reason, the classification information “person” is added even though the image of the still image has no face because the subject has moved between halfway pressing the shutter button and fully pressing it. Sometimes. On the other hand, the classification information “person” may not be given even though there is a face in the still image.

  An object of the present invention is to provide an imaging apparatus, an imaging method, and an imaging program that can accurately classify images taken with still images.

An imaging apparatus according to a first aspect of the present invention captures first image data before capturing a still image, captures second image data when capturing a still image, and captures a subject's face from the first image data. a second face detection process and the face detecting unit that performs for detecting a face of a subject from the first face detection processing second image data for detecting, determining means for determining the classification of the subject before Symbol second image data, comprising said second image data, storage means for storing the image file with the attribute information of the second image data including the classification of the subject of the second image data to which the determination means determines, the said determination When the second face detection process is performed, the means determines the classification of the subject of the second image data so as to include a classification indicating a person if the face of the subject is detected from the second image data. From the second image data If the face of the body is not detected, the classification of the subject of the second image data is determined so as not to include the classification indicating the person, and if the second face detection process is not performed, the first face detection process If the face of the subject is detected from the first image data, the classification of the subject of the second image data is determined so as to include the classification indicating a person, and the subject is detected from the first image data by the first face detection process. If no face is detected, the classification of the subject of the second image data is determined so as not to include the classification indicating the person .

An image pickup apparatus according to a second aspect of the present invention picks up first image data before taking a still image, picks up second image data at the time of still image shooting, and captures the face of the subject from the first image data. Face detection means for performing a first face detection process to detect and a second face detection process for detecting a face of a subject from the second image data; a determination means for determining a classification of a subject in the second image data; Storage means for storing an image file having second image data and attribute information of the second image data including classification of a subject of the second image data determined by the determination means, and the determination means If the shooting mode at the time of still image shooting is a shooting mode for shooting a person who is unlikely to move, if a face is detected in both the first face detection process and the second face detection process , The second image data If it is determined that a class representing a person is included in the class of the object and at least one of the first face detection process and the second face detection process is not detected, a person is included in the subject classification of the second image data. It is characterized in that it is determined not to include a classification indicating .

An imaging method according to a third aspect of the present invention is an imaging method executed by an imaging apparatus, in which an imaging unit captures first image data before capturing a still image and captures second image data when capturing a still image. An imaging step, a first face detecting step in which the face detecting means detects the face of the subject from the first image data, and a second face in which the face detecting means detects the face of the subject from the second image data. A detecting step; a determining step for determining a classification of the subject of the second image data; and a storage means for classifying the second image data and the subject of the second image data determined by the determining means. A storage step of storing an image file having the attribute information of the second image data including, wherein in the determination step, when the second face detection step is performed, If the face of the subject is detected from the second image data, the classification of the subject of the second image data is determined so as to include the classification indicating a person. If the face of the subject is not detected from the second image data, If the classification of the subject of the second image data is determined so as not to include a classification indicating a person, and the second face detection step is not performed, the face of the subject is determined from the first image data by the first face detection step. Is detected, the classification of the subject of the second image data is determined so as to include the classification indicating the person. If the face of the subject is not detected from the first image data by the first face detection step, the person is detected. The classification of the subject of the second image data is determined so as not to include the classification indicating .

An imaging method according to a fourth aspect of the present invention is an imaging method executed by an imaging apparatus, in which an imaging unit images first image data before still image shooting, and captures second image data at the time of still image shooting. An imaging step, a first face detecting step in which the face detecting means detects the face of the subject from the first image data, and a second face in which the face detecting means detects the face of the subject from the second image data. A detecting step; a determining step for determining a classification of the subject of the second image data; and a storage means for classifying the second image data and the subject of the second image data determined by the determining means. and a storing step of storing an image file having the attribute information of the second image data including, in said determining step, said determining means, possibly shooting mode when the still image shooting moves In the shooting mode for shooting a low person, if a face is detected in both the first face detection step and the second face detection step, the classification indicating the person as the subject classification of the second image data If a face is not detected in at least one of the first face detection step and the second face detection step, it is determined that the classification of the subject in the second image data does not include a classification indicating a person. It is characterized by that.

Engaged Help program to a fifth aspect of the present invention causes a computer of an imaging device, capturing the first image data before still image capturing, image capturing means for capturing the second image data when the still image shooting, the first image the second face detection process and the face detecting unit that performs for detecting a face of a subject from the data and the first face detection processing for detecting a face of a subject from the second image data, determining a pre-Symbol classification of the object of the second image data determination means for, the second image data, storage means for storing image files with the attribute information of the second image data including classification of the determination means of the second image data determined is subject function as, When the second face detection process is performed, the determination unit includes a classification indicating a person when a face of a subject is detected from the second image data. image If the face of the subject is not detected from the second image data, the subject classification of the second image data is determined so as not to include the classification indicating the person, and the second image data When face detection processing is not performed, if the subject's face is detected from the first image data by the first face detection processing, the subject classification of the second image data is determined so as to include a classification indicating a person. If the face of the subject is not detected from the first image data by the first face detection process, the subject classification of the second image data is determined so as not to include the classification indicating the person. .

According to a sixth aspect of the present invention, there is provided a program for imaging a computer of an imaging apparatus that captures first image data before capturing a still image and captures second image data when capturing a still image. Face detection means for performing first face detection processing for detecting the face of the subject and second face detection processing for detecting the face of the subject from the second image data, and determination means for determining the classification of the subject in the second image data And a storage means for storing an image file having the second image data and attribute information of the second image data including a classification of the subject of the second image data determined by the determination means. a program, the determining unit, when the shooting mode when the still image shooting is the image capture mode for capturing potential low person moves, the first face detection processing and the second face If a face is detected in both of the output processing, it is determined that a classification indicating a person is included in the subject classification of the second image data, and at least one of the first face detection processing and the second face detection processing If is not detected, it is determined that a classification indicating a person is not included in the classification of the subject of the second image data .

  According to the present invention, it is possible to accurately classify images taken with still images.

  In this specification, “updating” attribute information includes not only rewriting attribute information that has already been generated, but also generating new attribute information.

  An external configuration of the imaging apparatus 100 according to the embodiment of the present invention will be described with reference to FIG. FIG. 1 is an external configuration diagram of an imaging apparatus 100 according to the embodiment.

  As shown in FIG. 1, the imaging device 100 is, for example, a digital camera, a camcorder, a camera-equipped mobile phone, or the like. The imaging device 100 includes the following components in appearance.

  Reference numeral 28 denotes display means for displaying images and various information.

  Reference numeral 72 denotes a power switch that accepts an instruction for switching between a power-on state and a power-off state from a user.

  Reference numeral 61 denotes a shutter button that receives an instruction for detecting a face, an instruction for taking a still image, and the like from a user.

  Reference numeral 60 denotes a mode switch, which receives from the user a mode switching instruction for switching a plurality of operation modes in the imaging apparatus 100. The plurality of operation modes are, for example, a still image recording mode, a moving image recording mode, a reproduction mode, and the like.

  A connector 112 connects the connection cable 111 and the imaging apparatus 100. The connection cable 111 connects the imaging device 100 and an external device.

  Reference numeral 70 denotes an operation unit that receives instructions for various operations from the user. The operation unit 70 includes, for example, operation members such as various illustrated buttons and a touch panel provided on the screen of the display unit 28. Various buttons of the operation unit 70 are, for example, an erase button, a menu button, a SET button, a four-direction button (up button, down button, right button, left button) arranged in a cross, a wheel 73, and the like.

  A recording medium slot 201 stores the recording medium 200. The recording medium 200 is a recording medium such as a memory card or a hard disk. The recording medium 200 stored in the recording medium slot 201 can communicate with the imaging device 100.

  Reference numeral 202 denotes a lid of the recording medium slot 201.

  Next, the internal configuration of the imaging apparatus 100 according to the embodiment will be described with reference to FIG. FIG. 2 is a configuration diagram of the imaging apparatus 100 according to the embodiment.

  The imaging device 100 includes the following components.

  Reference numeral 103 denotes a photographing lens.

  Reference numeral 101 denotes a shutter having an aperture function.

  Reference numeral 22 denotes an imaging unit composed of a CCD, a CMOS element, or the like that converts an optical image into an electrical signal. The imaging unit 22 captures the first image data before capturing a still image, and captures the second image data when capturing the still image.

  Reference numeral 23 denotes an A / D converter that converts an analog signal into a digital signal. The A / D converter 23 is used when converting an analog signal output from the imaging unit 22 into a digital signal, or when converting an analog signal output from the sound control unit 11 into a digital signal.

  Reference numeral 102 denotes a barrier that covers the imaging system including the photographing lens 103, the shutter 101, and the imaging unit 22 to prevent the imaging system from being contaminated or damaged.

  A timing generation unit 12 supplies a clock signal and a control signal to the imaging unit 22, the audio control unit 11, the A / D converter 23, and the D / A converter 13. The timing generator 12 is controlled by the memory controller 15 and the system controller 50.

  An image processing unit 24 performs resize processing such as predetermined pixel interpolation and reduction, color conversion processing, and the like on the data from the A / D converter 23 and the data from the memory control unit 15. The image processing unit 24 performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation result. Thereby, AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing of the TTL (through-the-lens) method are performed. The image processing unit 24 further performs predetermined calculation processing using the captured image data, and also performs TTL AWB (auto white balance) processing based on the obtained calculation result.

  Reference numeral 32 denotes storage means. Output data (image data) from the A / D converter 23 is written into the storage unit 32 via the image processing unit 24 and the memory control unit 15 or directly via the memory control unit 15.

  For example, the storage unit 32 stores the first image data. The first image data is data corresponding to an analog image signal imaged by the imaging unit 22 before taking a still image, and is image data to be displayed on the display unit 28. Alternatively, for example, the storage unit 32 stores an image file having the second image data and the attribute information (header information) of the second image data including the classification (classification information) of the subject determined by the determination unit 50b described later. To do. The subject classification (classification information) indicates whether or not the subject is a “person”. Alternatively, for example, the storage unit 32 stores audio data recorded by the microphone 10, moving image data captured by moving images, and the like.

  The compression / decompression unit 16 compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like. The compression / decompression unit 16 reads the image data stored in the storage unit 32 using the drive signal of the shutter 101 as a trigger, performs compression processing, and writes the processed image data in the storage unit 32. Further, the compressed image data read into the storage unit 32 from the recording unit 19 of the recording medium 200 is expanded, and the processed image data is written into the storage unit 32. The image data written to the storage unit 32 by the compression / decompression unit 16 is filed in the file unit of the system control unit 50 and recorded on the recording medium 200 via the interface 18 as an image file. This image file is the same file as the image file stored in the storage means 32. The storage means 32 also serves as an image display memory (video memory).

  A D / A converter 13 converts the image display data stored in the storage unit 32 into an analog signal and supplies the analog signal to the display unit 28.

  Reference numeral 28 denotes a display unit that performs display according to the image data (first image data or second image data) captured by the imaging unit 22 on a display such as an LCD. For example, display image data captured by the imaging unit 22 and written in the storage unit 32 is converted into an analog image signal via the D / A converter 13 and supplied to the display unit 28. Thereby, the display means 28 displays the image according to the analog image signal.

  Reference numeral 10 denotes a microphone. The audio signal output from the microphone 10 is supplied to the A / D converter 23 via the audio control unit 11 configured by an amplifier or the like, converted into a digital signal by the A / D converter 23, and then subjected to memory control. Stored in the storage means 32 by the unit 15. On the other hand, the audio data recorded on the recording medium 200 is read into the storage means 32 and then converted into an analog signal by the D / A converter 13. The voice control unit 11 drives the speaker 39 by this analog signal and outputs a voice.

  The nonvolatile memory 56 is an electrically erasable / storable memory, such as an EEPROM. The nonvolatile memory 56 stores constants, programs, and the like for operating the system control unit 50. Here, the program is a program for executing various flowcharts described later in the present embodiment.

  Reference numeral 50 denotes a system control unit that controls the entire imaging apparatus 100. The system control unit 50 implements each process of the present embodiment, which will be described later, by executing a program stored in the nonvolatile memory 56 described above. The system control unit 50 includes a face detection unit 50a, a determination unit 50b, and an update unit 50c.

  The face detection unit 50a performs face detection processing for detecting the face of the subject on each of the first image data and the second image data. The first image data is image data captured by the imaging unit 22 before capturing a still image. The second image data is image data captured at the time of still image shooting by the imaging means 22. The face detection unit 50a performs face detection processing on the second image data when red-eye detection described later is performed. The face detection unit 50a does not perform face detection processing on the second image data when red-eye detection is not performed. The case where the red-eye detection is not performed includes, for example, a case where the red-eye correction is set to OFF, and a case where the flash is not emitted during still image shooting.

  The determination unit 50b classifies the subject based on the result of the face detection process performed by the face detection unit 50a on the first image data and the result of the face detection process performed by the face detection unit 50a on the second image data. judge. For example, when the determination unit 50b determines that the face detection unit 50a detects the face of the subject from the first image data and the face detection unit 50a detects the face of the subject from the second image data, Is determined to be “person”. Alternatively, for example, when the face detection unit 50a does not perform face detection processing on the second image data, the determination unit 50b determines the subject based on the result of the face detection processing performed by the face detection unit 50a on the first image data. Determine classification.

  The updating unit 50c updates the attribute information of the image file stored in the storage unit 32 based on the result determined by the determining unit 50b. That is, the update unit 50c newly creates classification information included in the header information of the image file of the second image data. Alternatively, the update unit 50c rewrites the classification information included in the header information of the image file of the second image data.

  A system memory 52 uses a RAM. In the system memory 52, constants and variables for operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like are expanded.

  Reference numeral 60 denotes a mode switch, which receives from the user a mode switching instruction for switching a plurality of operation modes in the imaging apparatus 100. The plurality of operation modes are, for example, a still image recording mode, a moving image recording mode, a reproduction mode, and the like.

  Reference numeral 61 denotes a shutter button that receives an instruction for detecting a face, an instruction for taking a still image, and the like from a user. A first shutter switch 62 and a second shutter switch 64 are connected to the shutter button 61.

  The first shutter switch 62 detects the half-press of the shutter button 61 and is turned on, thereby generating the first shutter switch signal SW1 and supplying it to the system control unit 50. The system control unit 50 starts operations such as AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (flash pre-emission) processing in response to the first shutter switch signal SW1.

  The second shutter switch 64 generates a second shutter switch signal SW2 and supplies it to the system control unit 50 by detecting that the shutter button 61 has been fully pressed and turning it on. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of shooting processing operations from reading a signal from the imaging unit 22 to writing image data on the recording medium 200.

  Reference numeral 70 denotes an operation unit that receives instructions for various operations from the user. The operation unit 70 includes, for example, operation members such as various illustrated buttons and a touch panel provided on the screen of the display unit 28. Various buttons of the operation unit 70 are, for example, an erase button, a menu button, a SET button, a four-direction button (up button, down button, right button, left button) arranged in a cross, a wheel 73, and the like. Each operation member of the operation unit 70 is appropriately assigned a function for each scene by selecting and operating various function icons displayed on the display unit 28, and functions as various function buttons. Examples of the function buttons include an end button, a return button, an image advance button, a jump button, a narrowing button, and an attribute change button. For example, when the menu button is pressed, a menu screen on which various settings can be made is displayed on the display means 28. The user can make various settings intuitively using the menu screen displayed on the display means 28, the four-way button, and the SET button.

  Reference numeral 72 denotes a power switch that accepts an instruction for switching between a power-on state and a power-off state from a user.

  A power control unit 80 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not a battery is mounted, the type of battery, and the remaining battery level. Further, the power control unit 80 controls the DC-DC converter based on the detection result and an instruction from the system control unit 50, and supplies a necessary voltage to each unit including the recording medium 200 for a necessary period.

  A power supply unit 30 includes a primary battery such as an alkaline battery and a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, and a Li battery, an AC adapter, and the like. Reference numerals 33 and 34 denote connectors, which connect the power supply unit 30 and the power supply control unit 80.

  Reference numeral 40 denotes an RTC (Real Time Clock), which measures the date and time. The RTC 40 holds a power supply therein separately from the power supply control unit 80, and keeps counting time even when the power supply unit 30 is turned off. The system control unit 50 sets a system timer using the date and time acquired from the RTC 40 at the time of startup (when the power supply is switched from the power-off state), and executes timer control.

  Reference numeral 18 denotes an interface with a recording medium 200 such as a memory card or a hard disk.

  Reference numeral 35 denotes a connector for connecting the recording medium 200 and the interface 18. The recording medium 200 is a recording medium such as a memory card or a hard disk. The recording medium 200 includes a recording unit 19 composed of a semiconductor memory, a magnetic disk, and the like, an interface 37 with the imaging apparatus 100, and a connector 36 for connecting the recording medium 200 and the imaging apparatus 100.

  Reference numeral 96 denotes a recording medium attachment / detachment detection unit that detects whether or not the recording medium 200 is attached to the connector 35.

  The communication unit 110 performs various communication processes such as RS232C, USB, IEEE1394, P1284, SCSI, modem, LAN, and wireless communication.

  A connector 112 connects the connection cable 111 and the imaging apparatus 100. The connection cable 111 connects the imaging device 100 and an external device. The connector 112 is, for example, an antenna for performing wireless communication, a connection terminal for performing wired communication, or the like.

  Next, the operation of the imaging apparatus 100 will be described with reference to FIG. FIG. 3 is a flowchart illustrating the operation of the imaging apparatus 100 according to the embodiment.

  In step S301, the system control unit 50 performs initial setting. That is, when the system control unit 50 receives an instruction for switching to the power-on state from the power switch 72, the system control unit 50 initializes a flag, a control variable, and the like.

  In step S <b> 302, the system control unit 50 performs management processing related to files recorded on the recording medium 200.

  In step S <b> 303, the system control unit 50 receives from the mode switch 60 a mode switching instruction for switching between a plurality of operation modes. The system control unit 50 determines whether or not the still image recording mode is selected in response to the mode switching instruction. If the system control unit 50 determines that the still image recording mode is selected, the process proceeds to step S304. If the system control unit 50 determines that the still image recording mode is not selected, the process proceeds to step S305.

  In step S304, still image recording mode processing is performed. The still image recording mode process will be described later.

  In step S305, the system control unit 50 determines whether or not the moving image recording mode has been selected in response to the mode switching instruction. If the system control unit 50 determines that the moving image recording mode is selected, the process proceeds to step S306. If the system control unit 50 determines that the moving image recording mode is not selected, the process proceeds to step S307.

  In step S306, moving image recording mode processing is performed. The moving image recording mode process will be described later.

  In step S307, the system control unit 50 determines whether or not the playback mode has been selected in response to the mode switching instruction. If the system control unit 50 determines that the playback mode has been selected, the process proceeds to step S308. If the system control unit 50 determines that the playback mode has not been selected, the process proceeds to step S309.

  In step S308, playback mode processing is performed. The reproduction mode process will be described later.

  In step S309, the system control unit 50 executes processing according to the other selected mode. Examples of the other modes include a transmission mode process for transmitting a file stored in the recording medium 200 and a reception mode process for receiving a file from an external device and storing it in the recording medium 200.

  In step S310, the system control unit 50 determines the set position of the power switch 72 and determines whether or not to switch to the power-off state. For example, when the system control unit 50 receives an instruction for switching to the power-off state from the power switch 72, the system control unit 50 determines that the power-off state should be switched. If the system control unit 50 determines that the power supply should be switched off, the process proceeds to step S311. If the system control unit 50 determines that the power supply should not be switched off, the process proceeds to step S303.

  In step S311, the system control unit 50 performs end processing. The termination process includes, for example, the following process. That is, the display of the display unit 28 is changed to the end state, the lens barrier 102 is closed to protect the imaging unit 22, and parameters, setting values, and setting modes including flags and control variables are recorded in the nonvolatile memory 56. Shut off the power to parts that do not require power supply. When the termination process of step S311 is completed, this process is terminated, and the power supply unit 30 is shifted to the OFF state.

  Next, the still image recording mode process (S304) will be described with reference to FIG. FIG. 4 is a flowchart showing still image recording mode processing. Note that the still image recording mode process shown in FIG. 4 is terminated by an interrupt process or the like when the mode switch 60 is switched to another mode or when the power switch 72 is set to OFF. And

  In step S401, the system control unit 50 determines the shooting mode in response to starting the still image recording mode. For example, the system control unit 50 determines the shooting mode by controlling the following operation (1) or (2).

  (1) The shooting mode at the end of the previous still image recording mode is acquired from the nonvolatile memory 56 and stored in the system memory 52.

  (2) When the operation unit 70 is operated by the user and the setting of the shooting mode is input, the shooting mode input by the setting is stored in the system memory 52.

  Here, the shooting mode is a mode realized by combining a plurality of conditions such as a shutter speed and an aperture value suitable for a shooting scene, a flash emission state, and sensitivity setting. The imaging apparatus 100 of the present embodiment has a plurality of shooting modes as follows.

  The shooting mode includes, for example, an auto mode. The auto mode is a mode in which various parameters of the imaging device 100 are automatically determined based on the measured exposure value by a program incorporated in the imaging device 100.

  The shooting mode includes, for example, a manual mode. The manual mode is a mode in which the user can freely change various parameters of the imaging apparatus 100.

  The shooting mode includes, for example, a scene mode. The scene mode is a mode in which a combination of a shutter speed and an aperture value, a flash emission state, sensitivity setting, and the like suitable for a shooting scene is automatically set. The scene mode includes the following shooting modes.

  The shooting mode includes, for example, a portrait mode. The portrait mode is a mode specialized for photographing people by blurring the background and making the person stand out.

  The shooting mode includes, for example, a night view mode. The night view mode is a mode for recording a background with a slow shutter speed by applying a strobe light to a person, and is a mode specialized for a night view scene.

  The shooting mode includes, for example, a landscape mode. The landscape mode is a mode specialized for a wide landscape scene.

  The shooting mode includes, for example, a night & snap mode. The night & snap mode is a mode suitable for taking beautiful night scenes and people without a tripod.

  The shooting mode includes, for example, a kids & pet mode. Kids & Pet mode is a mode that allows you to take pictures of kids and pets that move around without missing a photo opportunity.

  The shooting mode includes, for example, a fresh green & autumnal leaves mode. The fresh green & autumnal leaves mode is a mode suitable for shooting trees and leaves such as fresh greens vividly.

  The shooting mode includes, for example, a party mode. The party mode is a mode in which shooting is performed with a color faithful to the subject while suppressing camera shake under a fluorescent lamp or a light bulb.

  The shooting mode includes, for example, a snow mode. The snow mode is a mode in which a person is not darkened even when the snow scene is in the background, and the photograph is taken without leaving a bluish color.

  The shooting mode includes, for example, a beach mode. The beach mode is a mode in which a person or the like can be photographed without darkening even on the sea surface or sandy beach where sunlight is strongly reflected.

  The shooting mode includes, for example, a fireworks mode. The fireworks mode is a mode for shooting the fireworks display vividly with an optimal exposure.

  The shooting mode includes, for example, an aquarium mode. The aquarium mode is a mode for setting sensitivity, white balance, and color suitable for photographing fish in an indoor aquarium.

  The shooting mode includes, for example, an underwater mode. The underwater mode is a mode in which the white balance is set to be optimal for underwater, and shooting is performed with a hue that suppresses bluishness.

  In step S <b> 402, the system control unit 50 performs through display of image data (first image data) captured before taking a still image on the display unit 28. The through display is a display performed to confirm an image before taking a still image. In the through display, the image data (first image data) from the imaging unit 22 is sequentially displayed on the display unit 28 without being recorded on the recording medium 200 (through).

  In step S <b> 403, the system control unit 50 determines whether the remaining battery capacity of the power supply unit 30 is OK via the power supply control unit 80. Further, the system control unit 50 determines whether or not the remaining capacity of the recording medium 200 is OK. If the system control unit 50 determines that both the remaining battery capacity of the power supply unit 30 and the remaining capacity of the recording medium 200 are OK, the process proceeds to step S405. If the system control unit 50 determines that either the remaining battery capacity of the power supply unit 30 or the remaining capacity of the recording medium 200 is NG, the process proceeds to step S404.

  In step S404, the system control unit 50 performs a predetermined warning display or warning voice output by image or voice using the display unit 28, and returns the process to step S401.

  In step S405, the system control unit 50 performs red-eye correction ON / OFF setting as necessary. The red-eye correction ON / OFF setting can be arbitrarily set by the user on a menu screen (not shown) displayed on the display unit 28 by pressing a menu button included in the operation unit 70. For example, when it is determined that there is a high possibility that a red eye that causes the human eye of the photographed image to become red is generated, it is assumed that the red eye is desired to be corrected automatically in step S415 described later. The correction ON setting is input and stored in the system memory 52. Alternatively, for example, when it is not desired to automatically correct red-eye in step S415 described later, the red-eye correction OFF setting is input to the operation unit 70 and stored in the system memory 52.

  In step S406 (first face detection step), face detection processing is performed. That is, the face detection unit 50a performs face detection processing on the first image data. Details of the face detection processing will be described later with reference to FIG.

  In step S407, when the face of the subject is detected in the face detection process (step S406), the system control unit 50 detects the position coordinates, size (width, height), and number of detected faces in the first image data. The reliability coefficient and the like are specified as face information before taking a still image. The system control unit 50 stores face information before taking a still image in the system memory 52. On the other hand, when no face is detected in the face detection process, the system control unit 50 accesses the system memory 52 and stores information such as position coordinates, size (width, height), detected number, reliability coefficient, and the like. It is set to (NULL) and stored as face information before taking a still image.

  In step S408, the system control unit 50 determines whether the first shutter switch 62 is turned on or turned off. If the system control unit 50 determines that the first shutter switch 62 is turned off, the process is terminated. When determining that the first shutter switch 62 is turned on, the system control unit 50 advances the process to step S409.

  In step S409, the system control unit 50 performs a distance measurement process to focus the photographing lens 103 on the subject, performs a photometry process, determines an aperture value and a shutter time (shutter speed), and sets the set values. Store in memory 52. The system control unit 50 also sets the flash if necessary in the photometric process and stores the setting value in the system memory 52. At this time, if the face of the subject is detected in the face detection process (step S406), the system control unit 50 can perform distance measurement within the detected face range.

  In step S410, the system control unit 50 determines whether the second shutter switch 64 is turned on or off. If the system control unit 50 determines that the second shutter switch 64 has been turned off, the system control unit 50 proceeds to step S411. If the system control unit 50 determines that the first shutter switch 62 has been turned on, the system control unit 50 advances the process to step S412.

  In step S411, the system control unit 50 determines whether the first shutter switch 62 is turned on or turned off. If the system control unit 50 determines that the first shutter switch 62 is turned off, the process is terminated. When determining that the first shutter switch 62 is turned on, the system control unit 50 advances the process to step S410.

  In step S412, the system control unit 50 controls the display unit 28 to change the display state from the through display state to the fixed color display state.

  In step S413, shooting processing (still image shooting) is performed. Details of the photographing process will be described later with reference to FIG.

  In step S414, the system control unit 50 performs a quick review display (rec review display) of the image data (second image data) captured in the shooting process (S413) on the display unit 28. The quick review display is a display performed for confirming an image taken with a still image. In the quick review display, the image data is displayed on the display unit 28 for a predetermined time (review time) before the image data (second image data) is recorded on the recording medium 200 after the still image of the subject is captured. .

  In step S415, red-eye processing is performed. Details of the red-eye process will be described later with reference to FIG.

  In step S416, a recording process is performed. Details of the recording process will be described later with reference to FIG.

  In step S417, the system control unit 50 determines whether the second shutter switch 64 is turned on or off. When determining that the second shutter switch 64 is turned off, the system control unit 50 ends the quick review display (see step S414), and advances the process to step S418. When determining that the first shutter switch 62 is turned on, the system control unit 50 continues the quick review display and advances the process to step S417. With this configuration, the user can carefully check the captured image data using the quick review by continuing to fully press the shutter button 61.

  In step S418, the system control unit 50 refers to a timer (not shown) and determines whether or not a predetermined minimum review time has elapsed. If the system control unit 50 determines that the minimum review time has elapsed, the process proceeds to step S419. If the system control unit 50 determines that the minimum review time has not elapsed, the process proceeds to step S418.

  In step S419, the system control unit 50 sets the display state of the display unit 28 to return from the quick review display state to the through display state.

  In step S420, the system control unit 50 determines whether the first shutter switch 62 is turned on or turned off. When determining that the first shutter switch 62 has been turned off, the system control unit 50 ends the process in order to finish a series of shooting operations and return to the shooting standby state. When determining that the first shutter switch 62 is turned on, the system control unit 50 advances the process to step S410.

  Next, face detection processing (S406 or S703 described later) will be described with reference to FIG. FIG. 5 is a flowchart showing the face detection process.

  In step S <b> 501, the system control unit 50 supplies image data (first image data or second image data) to be detected to the image processing unit 24.

  In step S502, under the control of the system control unit 50, the image processing unit 24 applies a horizontal bandpass filter (horizontal BPF) to the image data (first image data or second image data).

  In step S503, under the control of the system control unit 50, the image processing unit 24 applies a vertical bandpass filter (vertical BPF) to the image data processed in step S502. By these band pass filters in the horizontal and vertical directions, edge components are detected from the image data (first image data or second image data).

  In step S504, the system control unit 50 (face detection unit 50a) performs pattern matching on the detected edge component, and extracts a candidate group of eyes, nose, mouth, and ears.

  In step S505, the system control unit 50 (face detection unit 50a) satisfies a preset condition (for example, distance between two eyes, inclination, etc.) from the eye candidate group extracted in step S504. Judge the pair of eyes. Then, the system control unit 50 (face detection means 50a) narrows down only those with eye pairs as eye candidate groups.

  In step S506, the system control unit 50 (face detection unit 50a) associates the eye candidate group narrowed down in step S505 with other parts (nose, mouth, and ear) that form the corresponding face, or The face is detected by passing through a preset non-face condition filter.

  In step S507, the system control unit 50 outputs the face information in accordance with the face detection result in step S506, and ends the process.

  As described above, using image data before shooting a still image (first image data) and image data at the time of shooting a still image (second image data), the feature amount of the image data is extracted to detect subject information. It is possible. In this embodiment, face information is taken as an example of subject information. However, subject information includes various other information such as red-eye detection results.

  For the face detection in the present invention, a known face detection technique may be used. As a known face detection technique, a method using learning typified by a neural network, a part having a characteristic shape such as an eye, nose, or mouth is searched from an image area using template matching, and is regarded as a face if the similarity is high. Techniques are listed. In addition, many other methods have been proposed, such as methods that detect image features such as skin color and eye shape and use statistical analysis. In general, multiple methods are used to recognize faces. Is common.

  As a specific example, there is a method of detecting a face using wavelet transform and an image feature amount described in JP-A-2002-251380.

  Next, the photographing process (S413) will be described with reference to FIG. FIG. 6 is a flowchart showing the photographing process.

  In step S <b> 601, the system control unit 50 acquires the date and time from the system timer at the start of shooting and stores it in the system memory 52.

  In step S602, the system control unit 50 opens the shutter 101 having an aperture function according to the set value (aperture value, etc.) stored in the system memory 52 determined in the distance measurement process and the photometry process (see step S409). .

  In step S603, the system control unit 50 controls the imaging system including the imaging unit 22 according to the setting value stored in the system memory 52 determined in the distance measurement process and the photometry process (see step S409) to perform exposure. Start. Here, the system control unit 50 controls a strobe (not shown) as necessary to emit a flash. When the flash is emitted, the system control unit 50 stores information indicating that the flash is emitted in the system memory 52.

  In step S604, the system control unit 50 refers to a timer (not shown) and determines whether or not the exposure should be terminated by determining whether or not the exposure time determined in step S409 has elapsed. If the system control unit 50 determines that the exposure should be terminated, the process proceeds to step S605. If the system control unit 50 determines that the exposure should not be terminated, the process proceeds to step S604.

  In step S605, the system control unit 50 closes the shutter 101.

  In step S <b> 606, the system control unit 50 reads out the charge signal imaged at the time of still image shooting from the imaging unit 22 and converts it by the A / D converter 23 to generate second image data. The second image data output from the A / D converter 23 is stored in the storage unit 32 via the image processing unit 24 and the memory control unit 15. Alternatively, the second image data output from the A / D converter 23 is directly stored in the storage unit 32 via the memory control unit 15.

  The storage means 32 may store an image file having the second image data and attribute information (header information) set as default information, instead of storing the second image data itself. .

  As described above, steps S601 to S606 correspond to the exposure process.

  In step S <b> 607, the system control unit 50 reads out the image data written in the storage unit 32 using the memory control unit 15 and the image processing unit 24 as necessary, and sequentially performs image processing. This image processing includes, for example, white balance processing and compression processing using the compression / decompression unit 16. The processed image data is written in the storage means 32.

  In step S608, the system control unit 50 reads the image data from the storage unit 32, expands the image data using the compression / decompression unit 16, and resizes the image data for display on the display unit 28. Then, the system control unit 50 transfers the resized image data to the D / A converter 13 via the memory control unit 15 so as to be displayed on the display unit 28. When a series of processing is finished, the photographing processing is finished.

  Next, the red-eye process (S415) will be described with reference to FIG. FIG. 7 is a flowchart showing the red-eye process.

  In step S701, the system control unit 50 refers to the system memory 52 and determines whether the red-eye correction is set to ON or OFF. If the system control unit 50 determines that red-eye correction is set to ON, the system control unit 50 advances the process to step S702. When determining that the red-eye correction is set to OFF, the system control unit 50 determines that the red-eye correction is not necessary and ends the process.

  In step S <b> 702, the system control unit 50 determines whether or not flash emission has been performed during still image shooting by determining whether or not information indicating that flash emission has been stored in the system memory 52. If the system control unit 50 determines that flash light emission has been performed, the system control unit 50 proceeds to step S707. When the system control unit 50 determines that the flash emission has not been performed, the system control unit 50 determines that red-eye correction is not necessary, and ends the process.

  In step S707, red-eye detection processing is performed. This red-eye detection process (step S707) includes the following processes of steps S703 to S706.

  In step S703 (second face detection step), face detection processing is performed. That is, the face detection unit 50a performs a face detection process on the second image data as part of the red-eye detection process (S707). The details of the face detection process are as described above with reference to FIG.

  In step S704, when the face of the subject is detected in the face detection process (step S703), the system control unit 50 detects the position coordinates, size (width, height), and number of detected faces in the second image data. The reliability coefficient is specified as face information at the time of still image shooting. The system control unit 50 stores face information at the time of still image shooting in the system memory 52. On the other hand, when no face is detected in the face detection process, the system control unit 50 accesses the system memory 52 and stores information such as position coordinates, size (width, height), detected number, reliability coefficient, and the like. It is set to (NULL) and stored as face information during still image shooting.

  In step S705, the system control unit 50 performs red-eye detection. That is, the system control unit 50 detects red eyes from the second image data based on the face information stored in step S704, for example, information such as the eye position.

  In step S706, the system control unit 50 corrects red eye in the second image data based on the result detected in step S705.

  The details of the red-eye detection / correction process are widely known and will not be described here. For example, it is disclosed in JP-A-10-233929.

  Next, the recording process (S416) will be described with reference to FIG. FIG. 8 is a flowchart showing the recording process.

  In step S801, the system control unit 50 generates a file name for the second image data to be recorded in accordance with a file name generation rule described later with reference to FIG.

  In step S802, the system control unit 50 acquires the date / time information stored in the system memory 52 in step S601 shown in FIG.

  In step S803, the system control unit 50 refers to the storage unit 32 and acquires the data size of the second image data to be recorded.

  In step S <b> 804, the system control unit 50 accesses the recording medium 200 and determines whether a directory in which the image file generated from the second image data is to be stored exists in the recording unit 19 of the recording medium 200. If the system control unit 50 determines that the directory does not exist, the process proceeds to step S805. If the system control unit 50 determines that the directory exists, the process proceeds to step S806.

  In step S805, the system control unit 50 generates a directory for storing image files. The directory name generation rule will be described later with reference to FIG. For example, a directory “100CANON” (directory 502 shown in FIG. 10) is created.

  In step S806, header creation processing is performed. In the header creation process, the system control unit 50 creates header information for the second image data. Details of the header creation processing will be described later with reference to FIG.

  When the image file having the second image data and the default attribute information (header information) is stored in the storage unit 32, the system control unit 50 sets the default attribute information (header). Information) may be rewritten.

  In step S807, the system control unit 50 generates a directory entry (management information) from the file name acquired in step S801 and the date / time information acquired in step S802. In addition, the system control unit 50 generates an image file having the second image data and header information (see step S806) and stores the image file in the storage unit 32. The system control unit 50 reads the image file from the storage unit 32 and records it in the directory corresponding to the directory entry in the recording unit 19 of the recording medium 200.

  Next, the header generation process (S806) will be described with reference to FIG. FIG. 9 is a flowchart showing the header generation process.

  In step S901, the system control unit 50 (determination unit 50b) refers to the system memory 52 to determine whether or not face information at the time of still image shooting is acquired (stored) in step S704 (see FIG. 7). If the system control unit 50 determines in step S704 (see FIG. 7) that face information during still image shooting has been acquired (stored), the process proceeds to step S902. If the system control unit 50 determines in step S704 (see FIG. 7) that face information at the time of still image shooting has not been acquired (stored) (for example, red-eye correction has not been performed), the process proceeds to step S903. Proceed.

  In step S902, the system control unit 50 (determination unit 50b) refers to the system memory 52, and the face information (such as the position coordinates of the face in the still image shooting) stored in step S704 (see FIG. 7) is stored. It is determined whether or not it is NULL. If the system control unit 50 determines that the face information at the time of still image shooting is not NULL, the process proceeds to step S904. If the face information at the time of still image shooting is determined to be NULL, the process proceeds to step S905. .

  In step S903, the system control unit 50 (determination unit 50b) refers to the system memory 52, and the face information before still image shooting (such as the face position coordinates) stored in step S407 shown in FIG. Judge whether or not. If the system control unit 50 determines that the face information before still image shooting is not NULL, the system control unit 50 proceeds to step S904. If the system control unit 50 determines that the face information before still image shooting is NULL, the process proceeds to step S905. .

  In step S904 (determination step), the system control unit 50 (determination unit 50b) determines that the subject classification is “person”. Then, the system control unit 50 (update unit 50c) updates the attribute information of the second image data based on the result determined by the determination unit 50b. That is, the system control unit 50 (update unit 50c) updates the classification information “person” to be included in the attribute information (header information) based on the determination that the determination unit 50b determines that the subject is classified as “person”. .

  In step S905, the system control unit 50 includes face information before taking a still image in the header information.

  In step S906, the system control unit 50 includes face information at the time of still image shooting in the header information.

  In step S907, the system control unit 50 includes other classification information in the header information. Other classification information is, for example, “landscape”, “event”, and the like.

  In step S908, the system control unit 50 creates other header information other than the classification information, and ends the process.

  As described above, it is determined whether there is a face in the still image captured image based on the facial information at the time of still image capture obtained in the red-eye correction process, and the classification information “person” is added. Therefore, it is possible to give accurate classification information “person”. As a result, the classification information “person” is assigned to the still image shot image even though the face is not present, or the classification information “person” is changed to the still image shot image even if there is a face. Disagreement of not being granted is eliminated. As a result, it is possible to accurately classify images taken with still images.

  At the same time, when detecting the face during red-eye correction, it is judged whether there is a face in the shot image, and when red-eye correction is not performed, red-eye correction is performed by not detecting whether the shot image has a face. When not, the shooting interval (release time lag) is shortened.

  Next, the directory and file structure will be described with reference to FIG.

  FIG. 10 shows an example of a directory structure recorded on the recording medium 200 as a result of the recording process described above. The directory name and file name generation rules will be described below with reference to FIG.

  A root directory 501 is generated with a directory name “DCIM”, and subdirectories 502 and 503 are generated under it with a directory name of 6 to 8 characters. The subdirectory names held by the subdirectories 502 and 503 are composed of the first 3 letters and the remaining 3 to 5 letters. The first three numbers start at 100 and are incremented by 1 each time a directory is created. In FIG. 10, the directory name of the subdirectory 502 is “100CANON” and the directory name of the subdirectory 503 is “101CANON”. In the subdirectory 502, image files 504 to 509 are recorded with predetermined file names. The file name generated here includes an identifier that is a part before “.” And an extension that is a part after “.”. In the identifier, the part before “_” (IMG, MVI) indicates the type of data, and the part after “_” (0001 to 0006) indicates the reference number. The extension is assigned, for example, JPG in the case of a still image, and is assigned, for example, AVI in the case of a moving image. The extension is given THM in the case of a thumbnail file that records management information.

  Next, an example of the data structure of an image file recorded on the recording medium 200 in the recording process (see FIG. 8) will be described with reference to FIG. FIG. 11 is a diagram illustrating the data structure of an image file.

  The image file 701 includes a marker (SOI) 702, a header portion HD, image data (second image data) IM, and a marker (EOI) 717. A marker (SOI) 702 is arranged at the head of the image file 701 and indicates the start of the image file. A marker (EOI) 717 is arranged at the end of the image file 701 and indicates the end of the image file.

  The attribute information (header information) is recorded in the header portion HD. The header portion HD includes items 703 to 710.

  In 703, an application marker (APP1) indicating the start of the header portion HD is recorded.

  In 704, size information (APP1 Length) indicating the size of the image file 701 is recorded.

  Reference numeral 705 denotes an identification code (APP1 Identifier Code) of the application marker 703.

  Reference numeral 706 denotes the creation date (Date Time) of the image data.

  Reference numeral 707 denotes a date (Date Time Original) when the image data is generated.

  Reference numeral 718 denotes classification information for the second image data.

  Reference numeral 719 denotes face information before taking a still image.

  Reference numeral 720 denotes face information at the time of still image shooting.

  Reference numeral 709 denotes other shooting information. Other shooting information 709 includes conditions for shooting a still image by the imaging unit 22. The conditions for still image shooting by the imaging means include at least one of a plurality of shooting modes and a plurality of shutter speeds.

  Reference numeral 710 denotes the above-described thumbnail image (Thumbnail Data).

  The image data IM includes a quantization table (DQT) 712, a Huffman table (DHT) 713, a frame start marker (SOF) 714, a scan start marker (SOS) 715, and compressed data 716. The compressed data 716 is obtained by compressing the second image data.

  Here, the classification information 718 of the header portion HD is information suitable for post-shooting operations such as search, which is different from the parameters for still image shooting, as described above with reference to FIG. The classification information 718 can store one or more of “person”, “landscape”, “event”, etc. described in FIG. Furthermore, classification information such as “category 1”, “category 2”, and “category 3” can be stored in the classification information 718 as general-purpose classification information. The classification information 718 includes classification information such as “for work” for encouraging special processing such as mail transmission at the transfer destination when transferring image data to an external device such as a PC via the communication unit 110. Can be stored in a playback mode to be described later.

  If these pieces of classification information are not automatically given by the processing of FIG. 9, the classification information can be edited in the playback mode processing (step S308 shown in FIG. 3). Alternatively, when the classification information set as default information is automatically given at the time of photographing (step S606), the classification information can be edited in the reproduction mode process (step S308 shown in FIG. 3). In this way, by providing classification information for slowly classifying while viewing image data in the reproduction mode processing, classification with higher convenience is possible.

  Specifically, the playback mode processing S308 shown in FIG. 3 may be performed according to the flow shown in FIG. FIG. 12 is a flowchart showing the playback mode.

  In step S1301, the system control unit 50 determines whether an image display event has been requested by the user based on information received from the operation unit 70 or the like. If the system control unit 50 determines that there is a request for an image display event, the process proceeds to step S1303. If the system control unit 50 determines that there is no request for an image display event, the process proceeds to step S1302.

  In step S1302, the system control unit 50 performs processing according to the requested event based on the information received from the operation unit 70 or the like.

  In step S1303, the system control unit 50 reads the image file from the storage unit 32 or the recording medium 200.

  In step S1304, the system control unit 50 expands the read image file from the compressed state to the expanded state and temporarily stores it in the system memory 52. The system control unit 50 extracts the second image data from the image file and converts it into an analog image signal, and then supplies the analog image signal to the display means 28. The display unit 28 displays an image corresponding to the second image data.

  In step S <b> 1305, when the operation unit 70 determines that the user viewing the image corresponding to the second image data via the display unit 28 should change the classification information to “person”, the classification information is “person”. An instruction for changing to is accepted. When the system control unit 50 receives an instruction for changing the classification information to “person” from the operation unit 70, the system control unit 50 determines that the classification information should be changed to “person”, and advances the process to step S 1306. If the system control unit 50 has not received an instruction for changing the classification information to “person” from the operation unit 70, the system control unit 50 determines that the classification information should not be changed to “person” and ends the process.

  In step S1306, the system control unit 50 refers to the system memory 52 and updates the classification information of the header information included in the image file. That is, the system control unit 50 adds “person” if “person” is not included in the classification information. Alternatively, if the classification information includes information indicating that it is not “person” (for example, “no person”), the system control unit 50 rewrites the information to “person”.

  Thus, according to the reproduction mode process shown in FIG. 12, the classification information generated in the still image recording mode process S304 has an error in order to prompt the user to determine whether the second image data has a face during reproduction. You can correct it. Therefore, it is possible to accurately classify images taken with still images.

  In the reproduction mode process shown in FIG. 12, the face detection process shown in FIG. 5 may be performed instead of step S1305. At this time, the face detection process in step S703 may be omitted in the red-eye correction process shown in FIG. As a result, it is possible to accurately classify images captured with still images without affecting the shooting interval (release timing lag).

  Note that the still image recording mode process S304 shown in FIG. 3 may be performed according to the flow shown in FIG. 13 instead of the flow shown in FIG. FIG. 13 is a flowchart showing still image recording mode processing in the modification. Below, it demonstrates centering on a different part from the flowchart shown in FIG.

  In step S1201, the system control unit 50 performs quick review ON / OFF setting as necessary. The quick review ON / OFF setting can be arbitrarily set by the user on a menu screen (not shown) displayed on the display means 28 by pressing a menu button included in the operation unit 70. For example, when it is desired to view the quick review display in step S414 described later, the quick review ON setting is input to the operation unit 70 and stored in the system memory 52. Alternatively, for example, when it is not desired to view the quick review display in step S414 described later, the quick review OFF setting is input to the operation unit 70 and stored in the system memory 52.

  In step S1202, the system control unit 50 refers to the system memory 52 and determines whether the quick review is set to ON or OFF. If the system control unit 50 determines that the quick review is set to ON, the system control unit 50 advances the process to step S704. When determining that the quick review is set to OFF, the system control unit 50 determines that the quick review display is not necessary, and ends the process.

  In step S1203, face detection processing is performed. That is, the face detection unit 50a performs face detection processing on the second image data. The details of the face detection process are as described above with reference to FIG.

  As described above, according to the still image recording mode process shown in FIG. 13, when performing a quick review, the face detection process is performed on the second image data, so that the classification information “person” in the file header is accurately given. Will be. On the other hand, when the quick review is not performed, since the face detection process is not performed on the second image data, it is possible to shorten the shooting interval (release time lag).

  The header creation processing S806 shown in FIG. 8 may be performed according to the flow shown in FIG. 14 instead of the flow shown in FIG. FIG. 14 is a flowchart showing the header creation process in the modification. Below, it demonstrates centering on a different part from the flowchart shown in FIG.

  In step S1401, the system control unit 50 (determination unit 50b) refers to the system memory 52, and based on the face information before still image shooting, the face information at the time of still image shooting, the shooting mode, the shutter speed, and the like, Determine the classification. For example, the system control unit 50 (determination unit 50b) determines that the subject is “person” according to the rules shown in FIG. 15 based on face information before still image shooting, face information at the time of still image shooting, shooting mode, shutter speed, and the like. Is determined.

  The system control unit 50 (update means 50c) updates the attribute information (header information) of the second image data based on the result determined by the determination means 50b. That is, the system control unit 50 (update unit 50c) updates the classification information to “person” when the determination unit 50b determines that the subject is “person”. When the determination unit 50b determines that the subject is not “person”, the system control unit 50 (update unit 50c) does not update the classification information to “person”.

  Next, rules when the determination unit 50b determines in step S1401 will be described with reference to FIG. FIG. 15 is a diagram illustrating the relationship between face information before still image shooting / face information at the time of still image shooting / shooting mode / shutter speed and the addition of the classification information “person”.

  When a face is detected both before still image shooting and during still image shooting, the classification information “person” is added regardless of the shooting mode and shutter speed. That is, when the determination unit 50b determines that the face detection unit 50a has detected the face of the subject from the first image data and the face detection unit 50a has detected the face of the subject from the second image data, Is determined to be “person”.

  If a face is not detected both during still image shooting and during still image shooting, the classification information “person” is not given regardless of the shooting mode and shutter speed.

  When the shooting mode is portrait / self-portrait, the classification information “person” is added only when a face is detected both before and during still image shooting.

  When the shooting mode is “kids” or “night”, the classification information “person” is given if a face is detected either before still image shooting or during still image shooting.

  In other shooting modes (auto, manual, shutter speed priority, aperture priority, etc.), the classification information “person” is always given when a face is detected during still image shooting. When a face is detected only before still image shooting, the classification information “person” is added when the shutter speed is so slow that it exceeds the camera shake limit. On the other hand, when the shutter speed is sufficiently high (the camera shake limit is not exceeded), the classification information “person” is not given.

  For example, when the shooting mode is portrait / self-portrait, it is often decided to shoot a person in advance. If you are trying to shoot a person but have not detected a person before taking a still image, it is likely that the person is not in focus. Do not grant "person". As described above, when the shooting mode for shooting a person is selected, the determination unit 50b detects when the face detection unit 50a detects the face of the subject from the first image data and the second image data. It is determined that the subject is a “person”. In addition, when the photographing mode for photographing a person is selected, the determining unit 50b is used when the face detecting unit 50a does not detect the face of the subject from at least one of the first image data and the second image data. , It is determined that the subject is not a “person”.

  When the shooting mode is kids, the subject is a child, so the subject is likely to move around. For this reason, even if a face is detected before still image shooting, the face may not be detected because it faces sideways at the time of still image shooting. For this reason, when a face is detected either before still image shooting or during still image shooting, classification information “person” is assigned.

  When the shooting mode is night, the shutter speed is often slow because of shooting in a dark place. Since the shutter speed is slow, there is a high possibility that the face is blurred during still image shooting and the face cannot be detected during still image shooting. For this reason, when a face is detected before still image shooting, the classification information “person” is given without detecting the face during still image shooting.

  As described above, when the photographing mode indicating that the subject shake is likely to occur is selected, the determination unit 50b detects the face of the subject from at least one of the first image data and the second image data. When detected, it is determined that the subject is a “person”. In addition, in the determination unit 50b, the face detection unit 50a does not detect the face of the subject from any of the first image data and the second image data when the shooting mode indicating that the subject shake is likely to occur is selected. Sometimes it is determined that the subject is not a “person”.

  In other shooting modes (auto, manual, shutter speed priority, aperture priority, etc.), if the shutter speed is slower than the camera shake limit, the imaging device 100 is shaken during still image shooting and the face during still image shooting cannot be detected. Probability is high. Therefore, when a face is detected before still image shooting, the classification information “person” is given only when the shutter speed is slow even if there is no face during still image shooting.

  As described above, in the determination mode 50b, the face detection unit 50a detects the face of the subject from the first image data and the face detection unit 50a from the second image data in the shooting mode indicating that subject shake is likely to occur. If does not detect the subject's face, the following operation is performed. That is, when the determination unit 50b determines that the selected shutter speed is less than the camera shake limit speed, the determination unit 50b determines that the subject is “person” and the selected shutter speed is equal to or higher than the camera shake limit speed. When determining that the subject is not a “person”.

  According to the rule shown in FIG. 15, it is possible to give classification information more in line with the user's intention by giving the classification information “person” in consideration of the shooting mode and the shutter speed.

  Further, in the still image recording mode processing, face detection processing may be performed even when red-eye detection is not performed (see FIG. 7) or quick review display is not performed (see FIG. 13). That is, the face detection unit 50a may always perform face detection processing on the first image data and perform face detection processing on the second image data.

  In addition, the face information during still image shooting is detected during single shooting when shooting one by one, and the classification information “People” is added from the time of still image shooting. You may comprise so that face information may not be detected before image | photographing. At this time, when continuous shooting is performed by the imaging unit 22, the face detection unit 50a performs face detection processing on the first image data captured before the continuous shooting by the imaging unit 22, and the continuous shooting is performed by the imaging unit 22. Face detection processing is not performed on the plurality of second image data captured at the time of shooting. The determination unit 50b determines the classification of the subject based on the result of the face detection unit 50a performing the face detection process on the first image data captured before the continuous shooting by the imaging unit 22.

1 is an external configuration diagram of an imaging apparatus 100 according to an embodiment. 1 is a configuration diagram of an imaging apparatus 100 according to an embodiment. 6 is a flowchart showing the operation of the imaging apparatus 100 according to the embodiment. The flowchart which shows a still image recording mode process. The flowchart which shows a face detection process. 6 is a flowchart showing a photographing process. The flowchart which shows a red eye process. The flowchart which shows a recording process. The flowchart which shows a header generation process. An example of a directory structure recorded on the recording medium 200 as a result of the recording process. The figure which shows the data structure of an image file. The flowchart which shows reproduction | regeneration mode. The flowchart which shows the still image recording mode process in a modification. The flowchart which shows the header creation process in a modification. The figure showing the relationship between the face information before still image shooting, the face information at the time of still image shooting, the shooting mode, the shutter speed, and the addition of the classification information “person”.

Explanation of symbols

22 imaging means 28 display means 32 storage means 50a face detection means 50b determination means 50c update means 100 imaging device

Claims (14)

Imaging means for capturing first image data before shooting a still image and capturing second image data when shooting a still image;
Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
Determination means for determining a classification of a subject of the second image data;
Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
With
The determination means includes
When the second face detection process is performed, if the face of the subject is detected from the second image data, the classification of the subject of the second image data is determined so as to include the classification indicating the person, and the second If the subject's face is not detected from the image data, the classification of the subject of the second image data is determined so as not to include the classification indicating the person,
When the second face detection process is not performed, if the subject's face is detected from the first image data by the first face detection process, the second image data includes a classification indicating a person. The classification is determined, and if the subject's face is not detected from the first image data by the first face detection process, the classification of the subject of the second image data is determined so as not to include the classification indicating the person. An imaging device that is characterized. The face detection means is configured to perform the second face detection process as part of a red-eye detection process,
The imaging apparatus according to claim 1, wherein the face detection unit does not perform the second face detection process when the red-eye detection process is not performed. A display unit for displaying an image corresponding to the second image data when the second image data is captured;
The face detection unit performs the second face detection process when the display unit displays an image according to the second image data, and the display unit does not display an image according to the second image data. The imaging apparatus according to claim 1, wherein the second face detection process is not performed. Imaging means for capturing first image data before shooting a still image and capturing second image data when shooting a still image;
Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
Determination means for determining a classification of a subject of the second image data;
Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
With
The determination means detects a face in both the first face detection process and the second face detection process when the shooting mode at the time of the still image shooting is a shooting mode for shooting a person who is unlikely to move. Then, it is determined that a classification indicating a person is included in the subject classification of the second image data, and if no face is detected in at least one of the first face detection process and the second face detection process, the first the classification of the subject 2 image data shall be the determining means determines that does not include a classification indicating a person imaging device. Imaging means for capturing first image data before shooting a still image and capturing second image data when shooting a still image;
Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
Determination means for determining a classification of a subject of the second image data;
Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
With
When the determination mode is a shooting mode for shooting a person who is highly likely to move in the still image shooting mode or a shooting mode in which subject shake is likely to occur, the first face detection processing and the second face detection processing are performed. If a face is detected in at least one of the face detection processes, it is determined that a classification indicating a person is included in the subject classification of the second image data, and both the first face detection process and the second face detection process are performed. if no face is detected, you and judging not to include the classification indicating the person classification of the subject of the second image data imaging device. Imaging means for capturing first image data before shooting a still image and capturing second image data when shooting a still image;
Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
Determination means for determining a classification of a subject of the second image data;
Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
With
The determination means detects a face in the first face detection process when the shooting mode at the time of the still image shooting is neither a shooting mode for shooting a person nor a shooting mode in which subject blurring is likely to occur. If a face is not detected in the second face detection process, if the shutter speed at the time of still image shooting is less than a threshold value, it is determined that a classification indicating a person is included in the classification of the subject of the second image data, and the shutter if speed is more than the threshold value shall be the determining means determines that does not include a classification indicating a person classification of the subject of the second image data imaging device. An imaging method executed by an imaging device,
An imaging step in which the imaging means captures the first image data before capturing a still image and captures the second image data during still image capture;
A first face detecting step for detecting a face of the subject from the first image data;
A second face detecting step in which the face detecting means detects a face of a subject from the second image data;
A determining step for determining a classification of a subject of the second image data;
A storage step of storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination unit;
With
In the determination step, the determination means includes:
When the second face detection step is performed, if the subject's face is detected from the second image data, the classification of the subject of the second image data is determined so as to include a classification indicating a person, and the second face is detected. If the subject's face is not detected from the image data, the classification of the subject of the second image data is determined so as not to include the classification indicating the person,
If the second face detection step is not performed and the face of the subject is detected from the first image data by the first face detection step, the subject of the second image data is included so as to include a classification indicating a person. The classification is determined, and if the subject's face is not detected from the first image data in the first face detection step, the classification of the subject of the second image data is determined so as not to include a classification indicating a person. A characteristic imaging method. An imaging method executed by an imaging device,
An imaging step in which the imaging means captures the first image data before capturing a still image and captures the second image data during still image capture;
A first face detecting step for detecting a face of the subject from the first image data;
A second face detecting step in which the face detecting means detects a face of a subject from the second image data;
A determining step for determining a classification of a subject of the second image data;
A storage step of storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination unit;
With
In the determination step, when the shooting mode at the time of the still image shooting is a shooting mode for shooting a person who is unlikely to move , the determination unit includes the first face detection step and the second face detection step. If a face is detected in both, it is determined that a classification indicating a person is included in the subject classification of the second image data, and a face is detected in at least one of the first face detection step and the second face detection step. Otherwise, it is determined that a classification indicating a person is not included in the classification of the subject in the second image data .   An imaging method executed by an imaging device,
  An imaging step in which the imaging means captures the first image data before capturing a still image and captures the second image data during still image capture;
  A first face detecting step for detecting a face of the subject from the first image data;
  A second face detecting step in which the face detecting means detects a face of a subject from the second image data;
  A determining step for determining a classification of a subject of the second image data;
  A storage step of storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination unit;
With
  In the determination step, the determination unit is configured to detect the first face when the shooting mode at the time of the still image shooting is a shooting mode for shooting a person who is highly likely to move or a shooting mode in which subject shake is likely to occur. If a face is detected in at least one of the step and the second face detection step, it is determined that a classification indicating a person is included in the subject classification of the second image data, and the first face detection step and the second face If no face is detected in both of the detection steps, it is determined that the classification of the person is not included in the classification of the subject of the second image data.
An imaging method characterized by the above.   An imaging method executed by an imaging device,
  An imaging step in which the imaging means captures the first image data before capturing a still image and captures the second image data during still image capture;
  A first face detecting step for detecting a face of the subject from the first image data;
  A second face detecting step in which the face detecting means detects a face of a subject from the second image data;
  A determining step for determining a classification of a subject of the second image data;
  A storage step of storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination unit;
With
  In the determination step, the determination unit includes the first face detection step when the shooting mode at the time of the still image shooting is neither a shooting mode for shooting a person nor a shooting mode in which subject shake is likely to occur. If a face is detected and no face is detected in the second face detection step, and if the shutter speed at the time of the still image shooting is less than a threshold value, a classification indicating a person is included in the classification of the subject of the second image data If the shutter speed is equal to or higher than the threshold, it is determined that the classification of the subject is not included in the classification of the subject of the second image data.
An imaging method characterized by the above. The computer of the imaging device,
Imaging means for capturing first image data before capturing a still image and capturing second image data when capturing a still image;
Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
Determining means for determining a classification of the subject of the second image data;
Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
Is a program for functioning as
The determination means includes
When the second face detection process is performed, if the face of the subject is detected from the second image data, the classification of the subject of the second image data is determined so as to include the classification indicating the person, and the second If the subject's face is not detected from the image data, the classification of the subject of the second image data is determined so as not to include the classification indicating the person,
When the second face detection process is not performed, if the subject's face is detected from the first image data by the first face detection process, the second image data includes a classification indicating a person. The classification is determined, and if the subject's face is not detected from the first image data by the first face detection process, the classification of the subject of the second image data is determined so as not to include the classification indicating the person. A featured program. The computer of the imaging device,
Imaging means for capturing first image data before capturing a still image and capturing second image data when capturing a still image;
Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
Determining means for determining a classification of the subject of the second image data;
Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
Is a program for functioning as
The determination means detects a face in both the first face detection process and the second face detection process when the shooting mode at the time of the still image shooting is a shooting mode for shooting a person who is unlikely to move. Then, it is determined that a classification indicating a person is included in the subject classification of the second image data, and if no face is detected in at least one of the first face detection process and the second face detection process, the first A program for determining that a classification indicating a person is not included in a classification of subjects of two-image data .   The computer of the imaging device,
  Imaging means for capturing first image data before capturing a still image and capturing second image data when capturing a still image;
  Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
  Determining means for determining a classification of the subject of the second image data;
  Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
Is a program for functioning as
  When the determination mode is a shooting mode for shooting a person who is highly likely to move in the still image shooting mode or a shooting mode in which subject shake is likely to occur, the first face detection processing and the second face detection processing are performed. If a face is detected in at least one of the face detection processes, it is determined that a classification indicating a person is included in the subject classification of the second image data, and both the first face detection process and the second face detection process are performed. If no face is detected, it is determined that a classification indicating a person is not included in the classification of the subject in the second image data.
A program characterized by that.   The computer of the imaging device,
  Imaging means for capturing first image data before capturing a still image and capturing second image data when capturing a still image;
  Face detection means for performing a first face detection process for detecting the face of the subject from the first image data and a second face detection process for detecting the face of the subject from the second image data;
  Determining means for determining a classification of the subject of the second image data;
  Storage means for storing an image file having the second image data and attribute information of the second image data including a classification of a subject of the second image data determined by the determination means;
Is a program for functioning as
  The determination means detects a face in the first face detection process when the shooting mode at the time of the still image shooting is neither a shooting mode for shooting a person nor a shooting mode in which subject blurring is likely to occur. If a face is not detected in the second face detection process, if the shutter speed at the time of still image shooting is less than a threshold value, it is determined that a classification indicating a person is included in the classification of the subject of the second image data, and the shutter If the speed is equal to or higher than the threshold, it is determined that the classification of the person is not included in the classification of the subject of the second image data.
A program characterized by that.

Images