JP4577252B2 - Camera, best shot shooting method, program - Google Patents

Description

  The present invention relates to a so-called best shot shooting technique for shooting with an image quality parameter optimized, and more particularly to a camera, a best shot shooting method, and a program that can realize shooting in a shooting state according to a specific individual.

  Conventionally, when shooting an image, setting the image quality using the shooting environment as a parameter, automatically changing the shooting parameter according to the color state of the subject, or correcting the image quality according to the age and gender of the person Techniques for manually changing correction parameters are known. In addition, a digital camera having a so-called best shot shooting function for shooting an image with good image quality by optimizing the image quality parameter is commercially available.

  On the other hand, there is a technique for detecting a face portion with high accuracy by detecting an image (see, for example, Patent Document 1). In the technique described in Patent Document 1, face image information of at least one registered user is stored in advance, and the face image of the identification target user is obtained from an image including the face of the identification target user acquired by the image acquisition unit. Continuous detection of a person to be detected and person identification to determine whether the user to be identified matches any registered user by comparing the face image detected by the person detection with previously stored face image information When the continuous execution of the person detection is started, the situation of the image acquisition by the image acquisition means is appropriate for the person detection. Or not, and the determination result is presented to the user.

  In addition, there is a technique for identifying “individual” from image characteristics regardless of the face angle (see, for example, Patent Document 2). In the technique described in Patent Document 2, a plurality of photographed images having a predetermined main subject in at least one image are obtained by photographing a camera from the same position in the same direction and photographing at multiple imaging distances. The subject related information of the main subject obtained by extracting the image area of the main subject from the plurality of captured images is registered in the camera in advance, and the registered main subject related information is used at the time of shooting with the camera. Then, an area in the imaging area that matches the main subject related information is detected, and the imaging conditions are adjusted according to the detected area.

JP 2003-274271 A JP 2003-296711 A

  However, when shooting a person, the quality of the image may differ depending on the attribute of the person (for example, age, gender, race, etc.), so the best shot shooting function described above has good image quality optimized for each person. There was a problem that some images could not be taken. For example, when photographing an elderly person, the contrast is lowered so that the wrinkles are not noticeable, and the light emission is adjusted to improve the complexion. The flash does not emit light, the contrast and color are adjusted, and when shooting a child, the skin color is slightly emphasized so that it can be taken relatively, the sharpness is strong, and if it can be captured clearly, good image quality optimized for each individual However, the above-described best shot shooting function, in which only a limited number of parameters are set, may result in failure to capture an image with good image quality optimized for each individual.

  Also, if the subject to be photographed is an elderly person, mature woman, adolescent, child, etc., the image quality parameters set for each subject can be automatically selected. The shot shooting function has a problem that the user has to manually select the shooting target.

  Further, the technique described in Patent Document 1 described above can accurately detect a face portion, and the technique described in Patent Document 2 uses main subject related information registered in advance at the time of shooting, By detecting the area within the appropriate shooting area and adjusting the shooting conditions according to the detected area, it is possible to identify “individual” from the image characteristics regardless of the shooting angle. If you use it, you can identify an individual, but you cannot identify whether the individual is an elderly person, a mature woman, an adolescent, a child, etc. You cannot shoot with image quality.

  The present invention has been made to solve the above problems, and automatically identifies an individual based on personal attribute information (for example, age, sex, race, etc.) registered by recognizing a face. An object of the present invention is to provide a camera, a best shot photographing method, and a program capable of automatically setting the optimum image quality parameter for the individual and performing the best shot photographing.

In order to solve the above problems, the camera of the first aspect of the present invention, an imaging means for obtaining an image by imaging a subject, in the face information for identifying a person in the acquired image by said image pickup means there, the priority and the face information including the cumulative recording time of the person thereof, and storage means for storing the image quality parameters of the person specified by the face information between the person and those of other persons, by the image pickup means Image recording means for recording and storing captured images, image display control means for displaying an image to be imaged by the imaging means, and face detection for detecting face portions of a plurality of persons from the images acquired by the imaging means It means, and personal identification means for identifying an individual respectively corresponding to the basis of the face information stored in the storage means in the face portion of the plurality of persons detected by the face detecting means, said storage hand Wherein the image quality parameter acquisition means for acquiring the image quality parameter based on the priority included in the face information corresponding to each individual identified, the image quality parameter acquired by the image quality parameter acquisition unit by the personal identification means from the An imaging control unit that executes imaging as an imaging parameter of the imaging unit, an accumulated imaging time update unit that updates the cumulative imaging time of an individual specified by the face information every time imaging is performed, and the above based on the accumulated imaging time And an acquisition priority order update means for updating the priority order.

Further, in the invention described in claim 2, the camera according to claim 1, further comprising adding means for storing face information and / or image quality parameters corresponding to a new individual in addition to the storing means. I will provide a.
As a result, a new individual can be registered.

According to a third aspect of the present invention, there is provided the camera according to the first aspect, further comprising editing means for arbitrarily editing the image quality parameter stored in the storage means.
As a result, the image quality parameters registered in the memory can be arbitrarily edited, so that there is no need to re-register when the image quality parameters are corrected or changed.

In the invention according to claim 4 , the image quality parameter acquiring means stores the image quality parameter of the person with the highest priority included in the face information corresponding to each individual specified by the individual specifying means from the storage means. It is characterized by acquiring .

Further, in the invention according to claim 5, further comprising a priority change section for changing the priority contained in each individual's facial information identified by the personal identification means, the image quality parameter acquisition means, priority The image quality parameter associated with the face information whose priority is changed by the changing means is acquired from the storage means .

In the invention according to claim 6 , the image quality parameter acquisition unit acquires a value calculated by a predetermined formula based on the image quality parameter of each individual specified by the individual specifying unit as an image quality parameter for shooting. It is characterized by that.

In the invention according to claim 7 , the storage means stores the face information and the image quality parameter as individual records for each individual .

In the invention according to claim 8 , the storage means stores face information storage means storing face information storing face information for each individual, and image quality parameters storing image quality parameter records storing image quality parameters. Each of the individual face information stored in the face information storage means and the image quality parameter stored in the image quality parameter storage means are associated with each other by predetermined association information .

In the invention according to claim 9 , the storage means stores face information storage means storing face information storing face information for each individual, and attribute information storing attribute information representing human attributes. The image processing apparatus includes storage means and image quality parameter storage means for storing image quality parameter records storing image quality parameters, and each individual face information stored in the face information storage means and image quality parameters stored in the image quality parameter storage means. Are related by the attribute information stored in the attribute information storage means .

The invention according to claim 10 further comprises attribute information selection means for selecting attribute information, wherein the image quality parameter acquisition means is based on the attribute information selected by the attribute information selection means from the image quality parameter storage means to the individual identification means. The image quality parameter of the individual specified by is acquired .

Further, in the invention described in claim 11 , the face information includes personal face feature information, the face detection means includes means for extracting the face feature information detected from the image, and the individual identification means includes the face detection means. Means for comparing the facial feature information detected by the facial feature information with the facial feature information included in the facial information, and obtaining facial information having facial feature information with the highest similarity. And means for identifying the individual .

Further, in the best shot photographing method according to the twelfth aspect of the present invention , face information for specifying a person in an image acquired at the time of photographing, the priority order between the person and another person, and the person face information including the accumulated imaging time of a person, and a camera having a memory storing the image quality parameters of the person specified by the face information, obtaining and displaying an image of the imaging object, an image by imaging a subject A step of detecting faces of a plurality of persons from the acquired image, and a step of identifying individuals corresponding to the detected face portions of the plurality of persons based on the face information stored in the memory. If, and a step of acquiring the image quality parameter, the obtained image quality parameters and the imaging parameters based on the priority included in the face information corresponding to each person who is the specific from the memory Performs imaging, obtaining a quality image corresponding to the person who is the specific, a step of recording and storing the captured image, the cumulative recording time of person specified by the face information each time photographing A step of updating, and a step of updating the priority order based on the cumulative shooting time.

In the program of the invention described in claim 13 , face information for specifying a person in an image acquired at the time of imaging , the priority between the person and another person, and the accumulation of the person face information including the recording time, and the computer having a memory storing an optimum image quality parameters person specified by the face information, the ability to display a function of obtaining an image by imaging an object, the image of the imaging target A function of capturing an image of a subject to obtain an image, a function of detecting a plurality of human faces from the acquired image, and an individual corresponding to each of the detected face portions of the plurality of persons is stored in the memory. A function for specifying the number of identified individuals, a function for determining the number of identified individuals, and, if the number of identified individuals is one as a result of the determination , corresponds to each identified individual from the memory Face to do Acquires image quality parameter based on the priority contained in the broadcast, a function the identified individuals if a plurality of acquiring the image quality parameter from the memory based on the acquired priority included in the face information, A function of capturing the acquired image quality parameter as a shooting parameter, obtaining an image of an image quality according to the specified individual, a function of recording and storing the captured image, and the face information for each shooting A function of updating the cumulative shooting time of the specified individual and a function of updating the priority order based on the cumulative shooting time are executed.

According to the present invention, the image quality parameters of the person identified from an image in the frame during photographing because the photographing is automatically set, can obtain a quality image in accordance with the age and sex and the like of the person, further to the frame When there are multiple people, the image quality parameter to be set as the shooting parameter is determined based on the priority of each person updated according to the cumulative shooting time of each person. In such a case, for example, the image quality parameter of the person with the longest cumulative shooting time can be automatically set as the shooting parameter.

  FIG. 1 is a view showing the appearance of a digital camera as an embodiment of the camera according to the present invention, and here, mainly the appearance of the front (FIG. 1 (a)) and the back (FIG. 1 (b)) is shown. As shown in FIG. 1A, the digital camera 100 includes a strobe light emitting unit 1 and an imaging lens (lens group) 2 on the front side. Further, as shown in FIG. 1B, the back of the digital camera 100 has a mode dial 3, a liquid crystal monitor screen 4, a cursor key 5, a SET key 6, a zoom button 7 (W button 7-1, T button 7- 2) etc. are provided. A shutter key 8 and a power button 9 are provided on the upper surface. Although not shown in the figure, a USB terminal connection portion used when connecting to an external device such as a personal computer (hereinafter referred to as a personal computer) or a modem and a USB cable is provided on the side portion.

  FIG. 2 is a diagram showing an embodiment of the electronic circuit configuration of the digital camera shown in FIG. In FIG. 2, the digital camera 100 is focused by moving the zoom lens 11-1 and the focus lens 12-2 for moving the zoom lens 12-1 and performing the optical zoom operation in the photographing mode which is the basic mode. An AF driving unit 11-2 that performs the operation, a lens optical system 12 that constitutes the imaging lens 2 including the zoom lens 12-1 and the focus lens 12-2, a CCD 13 that is an imaging device, a timing generator (TG) 14, and a vertical Driver 15, sample hold circuit (S / H) 16, A / D converter 17, color process circuit 18, DMA (Direct Memory Access) controller 19, DRAM interface (I / F) 20, DRAM 21, control unit 22, VRAM Controller 23, VRAM 24, digital video encoder 25, display unit 26, JPEG times 27, storage memory 28, the face detection unit 29-1, and a face recognition unit 29-2, and a database 29-3 and the key input unit 30,.

In the monitoring state in the photographing mode, when there is an optical zoom instruction, the zoom drive unit 11-1 drives a zoom lens drive motor (not shown) based on a control signal from the control unit 22 to light the zoom lens 12-1. By moving back and forth along the axis, the magnification itself of the image formed on the CCD 13 is changed.
The AF drive unit 11-2 drives a focus lens drive motor (not shown) to move the focus lens 12-2.
Then, a CCD 13 which is an image pickup device disposed behind the photographing optical axis of the optical system 12 constituting the image pickup lens 2 is scanned and driven by a timing generator (TG) 14 and a vertical driver 15 to form an image at regular intervals. A photoelectric conversion output corresponding to the optical image is output for one frame.

  The CCD 13 is a solid-state imaging device that captures a two-dimensional image of a subject, and typically captures an image of several tens of frames per second. The imaging element is not limited to a CCD, and may be a solid-state imaging device such as a CMOS (Complementary Metal Oxide Semiconductor).

  The photoelectric conversion output is appropriately gain-adjusted for each primary color component of RGB in the state of an analog value signal, sampled and held by a sample hold circuit (S / H) 16, and digital data by an A / D converter 17. Color process processing including image interpolation processing and γ correction processing is performed in the color processing circuit 18 to generate a luminance signal Y and color difference signals Cb and Cr, and the DMA (Direct Memory Access). ) Is output to the controller 19.

  The DMA controller 19 uses the luminance signal Y and the color difference signals Cb and Cr output from the color process circuit 18 by using the composite synchronization signal, the memory write enable signal, and the clock signal from the color process circuit 18 as well as a DRAM interface. DMA transfer is performed via the (I / F) 20 to the DRAM 21 used as a buffer memory.

  The control unit 22 controls the overall control operation of the digital camera 100, and includes an operation program executed by the CPU or MPU (hereinafter referred to as a CPU) and the CPU including a program for taking a best shot as described later. A program storage memory such as a flash memory, and a RAM used as a work memory. After the DMA transfer of the luminance and chrominance signals to the DRAM 21, the luminance and chrominance signals are transmitted via the DRAM interface 20. Reading from the DRAM 21 and writing to the VRAM 24 via the VRAM controller 23.

  The control unit 22 also extracts a processing program and menu data corresponding to each mode stored in a program storage memory such as a flash memory in response to the status signal from the key input unit 30, and Execution control of each function, for example, best shot shooting operation according to the present invention, zoom lens operation control during optical zoom, electronic zoom, through display, automatic focusing, shooting, recording, and playback of recorded images・ Execution control of display etc., display control of function selection menu at function selection, display control of setting screen, etc. are performed.

  The digital video encoder 25 periodically reads the luminance and color difference signals from the VRAM 24 via the VRAM controller 23, generates a video signal based on these data, and outputs the video signal to the display unit 26.

  As described above, the display unit 26 functions as a monitor display unit (electronic finder) in the shooting mode. By performing display based on the video signal from the digital video encoder 25, the display unit 26 receives from the VRAM controller 23 at that time. An image based on the stored image information is displayed on the liquid crystal monitor screen 4 in real time.

  In response to the focus instruction, the controller 22 immediately stops the path from the CCD 13 to the DRAM 21 after the completion of the DMA transfer of the luminance and color difference signals for one frame that are being fetched from the CCD 13 to the DRAM 21 at that time. Transition to saved state.

  In this stored recording state, the control unit 22 transmits the luminance and color difference signals for one frame written in the DRAM 21 through the DRAM interface 20 to each of Y, Cb, and Cr components of 8 pixels × 8 pixels horizontally. Are read in units called basic blocks and written into a JPEG (Joint Photograph Cording Experts Group) circuit 27. The JPEG circuit 27 uses ADCT (Adaptive Discrete Cosine Transform), a Huffman code which is an entropy coding system. Data compression is performed by processing such as conversion. The obtained code data is read out from the JPEG circuit 27 as a data file of one image, and is recorded and stored in the storage memory 28. In addition, the controller 22 activates the path from the CCD 13 to the DRAM 21 again with the completion of the compression processing of the luminance and color difference signals for one frame and the writing of all the compressed data to the storage memory 28.

  In the playback mode, which is the basic mode, the control unit 22 selectively reads out the image data recorded in the storage memory 28, and is compressed by a procedure completely opposite to the procedure of data compression in the image shooting mode by the JPEG circuit 27. The expanded image data is decompressed, the decompressed image data is expanded and stored in the VRAM 24 via the VRAM controller 23, and then periodically read out from the VRAM 24 to generate a video signal based on the image data. The display unit 26 reproduces and outputs.

The JPEG circuit 27 supports a plurality of compression ratios, and a mode for storing data corresponding to the compression ratio includes a mode corresponding to a high resolution (generally called high definition, fine, normal, etc.) with a low compression ratio. There is a low-resolution (commonly called economy) mode with a high compression rate.
It also supports high to low pixel counts. For example, there are recording pixel sizes called SXGA (1600 × 1200), XGA (1024 × 786), SVGA (800 × 600), VGA (640 × 480), QVGA (320 × 240) and the like.

  The storage memory 28 includes a recording medium such as a built-in memory (flash memory), a hard disk, or a removable memory card, and stores and records image data, shooting information, and the like.

  The face detection unit 29-1 detects a face (face area) from an image for one frame, and extracts face feature data (see FIG. 4B). When there are a plurality of faces, that is, when a plurality of faces are captured in the frame, the faces of a plurality of persons are detected, and feature data of each face is extracted. A known method can also be used as the face detection method. For example, the technique described in Patent Document 1 (Japanese Patent Laid-Open No. 2003-274271) or the technique described in Japanese Patent Laid-Open No. 2000-30033 is used as appropriate. can do. A dedicated circuit may be provided for the face detection process, or the control unit 22 may execute a face detection program.

  The face recognition unit 29-2 determines the similarity by comparing the face feature data extracted by the face detection unit 29-1 with the feature data stored in the face recognition record of the face recognition table of the database 29-3. , Identify which individual's face the detected face is (that is, identify the individual). For the determination of the similarity, for example, a distance (root mean square) is obtained from the difference between the detected facial feature data and the registered human facial feature data, and the similarity is high when the distance is equal to or less than a predetermined threshold ( Alternatively, it can be determined that they match.

  The database 29-3 stores a face recognition table in which a plurality of face recognition records including personal face recognition data and image quality parameters are stored, and collation image data, and is referenced by the face recognition unit 29-2. (For example, see FIGS. 3 and 4). The database 29-3 can also be updated such as new registration, adjustment, or deletion by a user key input operation.

  The key input unit 30 includes the mode dial 3, the cursor key 5, the SET key 6, the zoom button 7 (W button 7-1, T button 7-2), the shutter key 8, the power button 9, and those keys. The key processing unit (not shown) that generates an operation signal of the operated key and sends it to the control unit 22 is operated.

  The mode dial 3 is used to select a shooting mode and a playback mode. The user can select a shooting mode such as (still image) normal shooting mode, macro shooting mode, continuous shooting mode, rapid shooting mode,..., Moving image shooting mode,.

  The cursor key 5 is a key operated when pointing (designating) a menu or icon displayed on the liquid crystal monitor screen 4 with the cursor when setting a mode or selecting a menu. Can be moved to. The SET key 6 is a key that is pressed when the item displayed by the cursor key 5 is selected and set. The SET key 6 can also be used as a confirmation key.

  The zoom button 7 is used for a zoom operation. In the case of optical zoom, the zoom lens (variable focal length lens) 12-1 corresponds to the operation of the zoom button 7 (W button 7-1 or T button 7-2). The zoom value is determined in response to the operation of the zoom button 7 by moving to the wide side or the tele side, the angle of view actually changes following the change of the zoom value, and a wide (wide angle) image is displayed on the LCD monitor screen 4. Alternatively, a tele (telephoto) image is displayed.

  The shutter key 8 performs a release operation at the time of shooting, has a stroke of two steps, and performs auto focus (AF) and automatic exposure (AE) by the first step operation (half-pressed state). And a shooting instruction signal for performing a shooting process in the second-stage operation (fully pressed state). In this embodiment, it is assumed that execution of the best shot shooting mode is started by pressing the shutter key 8 halfway.

  FIG. 3 is a diagram showing an example of the structure of the database 29-3. The database 29-3 registers personal names, facial feature data, pointers for extracting collation face images, image quality parameters, and the like. It stores a face recognition table 40 that stores a plurality of face recognition records, collation image data 50 in which face images (compressed image data) of the best shot scene of the person to be recognized are registered, and the like. Although the database 29-3 is stored in a predetermined area of the storage memory in the embodiment, a dedicated memory for the database 29-3 may be provided.

  FIG. 4 is a diagram showing an example of the structure of the face recognition table 40. As shown in FIG. 4A, the face recognition table 40 stores a personal ID field for storing a personal ID for identifying a face recognition record. 41, a face recognition data field including a name field 42 for recording a name, a priority field 43 for recording a priority, a feature data field 44 for recording facial feature data, a collation image pointer field 45 for storing a collation image pointer, and the like. A plurality of face recognition records including an image quality parameter column including a sharpness column 46 for storing sharpness, a saturation column 47 for storing saturation, a contrast column 48 for storing contrast, a filter column 49 for storing filters, and the like. Become.

  The feature data column 44 further includes a position column 44-1 for storing the position of each part of the face (eyes, nose, mouth, ear, forehead,...) As shown in FIG. A size field 44-2 for storing the size of the part, an angle field 44-3 for storing the angle of each part, a relative relationship between each part of the face, for example, the spacing between the left and right eyes, the ratio to the horizontal size of the face ) Is stored and is compared with each feature data extracted by the face recognition unit 29-2 to determine similarity. The collation image pointer 45 is the head address of the storage destination of collation image data in which a personal face image is stored. The face feature data and feature data fields extracted by the face detection unit 29-1 by the face recognition unit 29-2. When the user confirms the personal face identified by the comparison result with the feature data stored in 44, the user uses it as a face image indicating the identified individual together with the name stored in the name field 42, or at the time of shooting. Can be used as an image (see FIG. 5) to be displayed as a best shot scene.

  When the user confirms the identified individual face, the user can determine whether the person is correct by looking at the displayed individual face and the matching image displayed as a result of the face recognition. In addition, when there are a plurality of face recognition records having a similarity equal to or greater than a predetermined threshold for the same person, the user can sequentially display the items in the descending order of the similarity and select right or wrong.

  When the face detection unit 29-1 detects the face of the person in the image in the frame and extracts the facial feature data during shooting, the face recognition unit 29-2 recognizes the extracted feature data in the database 29-3. Compared with the feature data stored in the feature data column 44 of each face recognition record constituting the table 40, the individual registered in the face recognition record having the largest similarity is specified as the detected face person. Then, the image quality parameter value registered in the face recognition record (value stored in the sharpness 46 to filter 49 column in the example of FIG. 4) is set as a shooting parameter, and is specified by executing shooting. It is possible to obtain an image with an image quality suitable for each individual.

  When pieces of recognition data and quality data are registered in the face recognition table 40 of FIG. 4 (that is, the name column 42 to the filter column 49 of FIG. 4), as shown in FIG. In 50, a matching image registered in association with the face recognition table 40 is inserted and displayed (in the example shown in the figure, “Yutta” 51), and a best shot scene capable of 1: 1 correspondence is formed and displayed. To be able to. This best shot scene can be selected by operating the cursor key 5. For example, when the cursor key 5 is operated downward (↓), the next best shot scene can be displayed. When the cursor key 5 is operated upward (↑), the previous best shot scene can be displayed. Further, when the SET key 6 is operated, the displayed best shot scene is selected.

  After selecting the best shot scene 50 of FIG. 5, when the face detection unit 29-1 detects the face of the person 61 as shown in FIG. 6 in the frame and extracts facial feature data, the face recognition unit 29-2 Compares the extracted feature data with the feature data stored in the feature data 44 column of the face recognition table 40 of the database 29-3, and the person of the face recognition table with the highest degree of similarity (in this case “Yuta”). ) Is identified as the detected face person 61. Then, the image quality parameter of “Yuta” registered in the face recognition table 40 is read, and when shooting is performed, shooting is performed with the image quality parameter. In addition, when a person other than “Yuta” is detected, the image quality parameter “Yuta” is not photographed. That is, when the person's face recognition table is registered, the image is shot with the image quality parameter of the person, but when the person's face recognition table is not registered, the image cannot be shot with the image quality optimum for the individual.

  Further, a plurality of human images are shown in the frame, and as shown in FIG. 7, the face detection unit 29-1 detects the facial images 111, 112, and 113 of each person, extracts feature data, If the face recognition unit 29-2 can identify the plurality of persons ("Kiyo Grandma", "Yuta", "Makiko"), among the priorities registered in the priority column 43 of the face recognition record The image quality parameter of the person determined to have the highest priority is read out. In the example of FIG. 7, the priority is “Yutta”> “Makiko”, “Kiyo Grandma”, as is clear from FIG. 4, and “Yuta” has the highest priority. The image quality parameter of “Yuta” is automatically set as a shooting parameter and shot.

  When a plurality of persons are specified in a frame in which a plurality of persons are shown, the image quality parameter of the person with the highest priority is used in the example shown in FIG. There may be provided means for photographing with a non-biased image quality (for example, average image quality) calculated based on the degree value. Further, as shown in FIG. 8, a selection menu 114 for selecting priority or averaging based on the priority value may be displayed at a predetermined position on the screen so that the user can select. Further, the image quality may be obtained by an eclectic method such as averaging the priorities of some of the top players. In the example of FIG. 8, when the user selects “prioritize one person” in the selection menu 114, the image is shot using the image quality parameter of the person with the highest priority, and when “average image quality” is selected, When the average value of each image quality parameter, for example, when a plurality of persons are three, shooting is performed using the average value of each image quality parameter value of the three people.

  In addition, when a plurality of persons are specified in a frame in which a plurality of persons are shown, first, the person with the highest priority (in this example, “Yuta”) is given priority as shown in FIG. When the user performs a confirmation operation (for example, pressing down the SET key 6), the image quality parameter is used, but the user changes the person whose image quality is prioritized by the change operation (for example, person designation by the cursor key 5). However, it may be configured to shoot using the image quality parameter of the person. In FIG. 9, an arrow 151 means that the user has made a change so as to give priority to the face person in the direction of the arrow.

FIG. 10 is a flowchart showing an example of a control operation performed by the control unit 22 during the best shot shooting according to the present invention. This flowchart is for explaining a program for causing the digital camera 100 to realize the best shot photographing function of the present invention.
The processing shown below is basically explained by an example in which the control unit 22 executes in accordance with a program stored in advance in a program memory such as a flash memory, but it is not necessary to store all functions in the program memory. Alternatively, a part or all of them may be received via a network. Hereinafter, description will be given with reference to FIGS. In the flowchart shown in FIG. 10, when the shutter key 8 is half-pressed, the best shot shooting by the face recognition after step S3 is started and the image quality is optimized for one person with high priority (FIGS. 6 and 7). FIG. 9) will be described as an example.

  When the face recognition best shot shooting mode is selected by the operation of the mode dial 3 by the user (step S1), the control unit 22 checks the signal from the key input unit 30 to determine whether or not the shutter key 7 has been pressed halfway. If the determination is made and the shutter key 7 is half-pressed, the process proceeds to step S4, and if not, the process proceeds to step S16 (step S2).

  When the shutter key 8 is pressed halfway, the control unit 22 uses the name stored in the name column 42 of the face recognition table 40 of the database 29-3 and the image pointer for verification stored in the image pointer column 45 for verification. Further, a collation image (compressed file) corresponding to the collation image pointer is extracted from the database 29-3, extracted by the JPEG circuit 27, and fitted into a predetermined best shot format together with the name to obtain the best shot scene (Refer to FIG. 5) is displayed to prompt the user to confirm (step S3).

  The user performs a confirmation operation (for example, pressing down the SET key 6) if the displayed best shot scene is acceptable, and otherwise performs a cursor operation to repeat the operation of displaying the next scene. The signal from the key input unit 30 is examined, and if there is a confirmation operation, it is determined that the face recognition best shot is valid (that is, the face recognition best shot is possible) and the process proceeds to step S5. Accordingly, the name and collation image pointer stored in the next face recognition record are extracted from the face recognition table 40, and the best shot scene is generated and displayed. If the face recognition record of the desired person is not registered in the face recognition table 40, it is determined that the face recognition best shot is not valid (that is, the face recognition best shot is not possible), and the process proceeds to step S16 (step S16). S4).

  The control unit 22 executes AE processing at a focal length corresponding to the zoom value at that time, obtains image data through the CCD 13 to the color process circuit 18 based on the subject image from the optical system 12, and performs automatic white balance (AWB). The color process circuit 18 adjusts the white balance corresponding to the color of the light source by processing, and then DMA-transfers to the DRAM 21 via the DMA controller 19 and the DRAM interface (I / F) 20 and takes in the DRAM 21. The VRAM 27 is rewritten with the video-through image data obtained by thinning the number of pixels from the image data, and the through-display is performed on the liquid crystal monitor screen 4 of the display unit 26 (step S5).

  Since the user attempts to frame an image with a suitable composition within the screen by displaying the through-displayed image, the control unit 22 uses the sampling image (a still image for one frame) from the image being framed. Is detected in the DRAM 21 (step S6), the face detection unit 29-1 is controlled to detect the face from the sampled image, the feature data of the detected face is extracted (step S7), and the number of detected faces ( = Number of people is acquired and stored in RAM (temporary storage) (step S8). A person whose face cannot be detected by the face detection unit 29-1 even if a person is shown is not counted as the number of persons. Although not shown, it is assumed that the autofocus process is executed in parallel between steps S3 to S15.

  After setting 1 to the counter n (step S9), the control unit 22 controls the face recognition unit 29-2 to execute the face recognition process, and the feature data and the face recognition process data 40 extracted in the above step S7. The feature data stored in the feature data field 44 of the face recognition record is sequentially compared, and the face recognition record storing the feature data having the highest similarity is selected from the faces (= persons) detected in step S7. Is obtained as a face recognition record of the kth face (kth person) (step S10), 1 is added to the counter n (step S11), and the value of the counter n and the number of people obtained in step S8 are obtained. If the value of the counter n exceeds the number of persons, the face recognition process is completed for all detected faces, and the process proceeds to step S13. Otherwise, the face recognition process for the next face is performed. Returns to the step S10 to the execution (step S12). The face recognition record acquired in step S10 may be stored in the RAM, but the record ID (= ID stored in the personal ID column 41 in the example of FIG. 4) is used. It is desirable to keep it in RAM.

  When the face recognition processing is completed for all the detected faces, the control unit 22 compares the priorities stored in the priority column 43 of each face recognition record acquired in step S10, and the highest priority is stored. The recognized face recognition record is acquired as a priority record (step S13).

  Next, the image quality parameter of the acquired priority record (face recognition record) is extracted and set as a shooting parameter (step S14). As the image quality parameter, sharpness, saturation, contrast, and filter are illustrated in FIG. 4, but the image quality parameter is not limited to these.

  The control unit 22 executes AE processing at a focal length corresponding to the zoom value at that time, captures a subject image from the optical system 12, obtains image data through the CCD 13 to the color process circuit 18, and performs automatic white balance (AWB). The color process circuit 18 adjusts the shooting parameters set as described above so that the white balance corresponding to the color of the light source is obtained by processing, and then the DRAM 21 is connected to the DRAM 21 via the DMA controller 19 and the DRAM interface (I / F) 20. The VRAM 27 is rewritten with video-through image data obtained by DMA transfer and the number of pixels thinned out from the image data taken into the DRAM 21, and displayed on the liquid crystal monitor screen 4 of the display unit 26. At this time, a face cursor is displayed so as to clearly indicate the face of the person with the highest priority so that the user can select the face of another person. When the face of another person is selected with the face cursor, the face recognition record corresponding to that face becomes the priority record (step S15).

  If the user does not select another person's face in step S15, the user fully presses the shutter key 8 to take a picture, so the control unit 22 examines the signal from the key input unit 30 and the shutter key 8 is fully pressed. If so, the process proceeds to step S17, and if not, the process returns to step S14 (step S16). That is, when another person's face is selected with the face cursor in step S15, the face recognition record corresponding to the selected face becomes a priority record, and in step S14, the image quality parameter for the selected person is extracted from the priority record. Is set as a shooting parameter.

  When the shutter key 8 is fully pressed, the path from the CCD 13 to the DRAM 21 is immediately stopped at that time, and switching to the CCD driving system at the time of actual photographing different from the through image acquisition is performed and the above setting is performed. The image data adjusted based on the shooting parameters is taken in, the JPEG circuit 26 performs image compression processing, the image file composed of the compressed data is recorded in the storage memory 28, and the best shot shooting processing for one frame is completed. (Step S17).

  According to the flowchart shown in FIG. 10, the face of a person in a frame can be detected, an individual can be identified, and photographing can be performed using personal image quality parameters registered in advance in the database. You can shoot images with image quality according to age and gender. Also, if there are multiple people in the frame, the image quality parameter of the person with the highest priority is set as the shooting parameter. Can be obtained.

(Modification 1)
In the flowchart shown in FIG. 10 above, when a plurality of faces are recognized in a frame, an example of shooting a person's face with optimum image quality using the image quality of one person with high priority is shown as an example. Alternatively, the average value of each image quality parameter stored in the face recognition record corresponding to may be calculated, and shooting may be performed using the calculated average value. In this case, for example, step S13 in FIG. 10 is changed to “When the face recognition processing is completed for all the detected faces, the control unit 22 is stored in the priority column 43 of each face recognition record obtained in step S10. The image quality parameters are taken out, ”is set, and step S14 is changed to“ Next, the average value of each taken image quality parameter is calculated and the calculated average value is set as the imaging parameter ”. For example, in FIG. 8, when the user selects “average image quality” from the selection menu 114, the average value of each image quality parameter, for example, if there are three persons, the sharpness value of three persons Is taken using the average value, the average value of the saturation, the average value of the contrast, the average value of the filter,.

In the database 29-3 shown in FIG. 3, the face recognition table 40 has a data structure in which one record = 1 person and an image quality parameter is individually set for each person. As shown in FIGS. 11A and 11B, the structure may be a format in which the face recognition table for identifying an individual and the image quality parameters are independent.
FIG. 11 is a diagram showing another embodiment of the structure of the database 29-3. FIG. 11A shows the face recognition table 60, the image quality parameter tables 90-1 to 90-N for each nationality, and the matching image data. FIG. 11B shows an example in which the face recognition table 70, nationality / keyword table 80, image quality parameter table 90, and collation image data 50 are stored. Hereinafter, an example in which the database 29-3 is configured as illustrated in FIG. 12A will be described in Modification 2 below, and an example in which the database 29-3 is configured as illustrated in FIG. 12B will be described in Modification 3. .

(Modification 2)
FIG. 12 is a diagram illustrating an example of the structure of the face recognition table 60 and the image quality parameter tables 90-1 to 90-N for each nationality, and shows the case where nationality = JP (Japan). The face recognition table 60 corresponds to the face information storage means of the present invention. As shown in FIG. 12A, a personal ID column 61 for storing a personal ID, a name column 62 for recording a name, and a priority for recording priority. A degree field 63, a feature data field 64 that records facial feature data, a personal face recognition table field that includes a matching image pointer field 65 that stores a matching image pointer, a nationality field 66 that stores a nationality ID, and an image quality ID are stored. It consists of an image quality ID column 67. The structure of the feature data column 64 may be the same as the structure of the feature data column 44 of the face recognition table 40 shown in FIG. The nationality ID and image quality ID stored in the nationality column 66 and the image quality ID column 67 are reference IDs.

  The nationality-specific image quality parameter table 90-1 (-90-N) corresponds to the image quality parameter storage means of the present invention. The image quality ID column 91 stores the image quality ID, the sharpness column 92 stores the sharpness, and stores the saturation. A plurality of image quality parameter records including a saturation column 93 for storing, a contrast column 94 for storing contrast, a filter column 95 for storing filters, a flash column 96 for storing flash intensity, and the like. By providing the flash field 96, it is possible to automatically set illumination parameters (flash intensity) corresponding to different facial colors depending on the race at the time of shooting, so that it is possible to take an image with optimum image quality even if the nationality (race) is different. it can. In addition, once registered image quality parameters can be reused again, it is possible to save the trouble of setting image quality parameters in the face recognition table each time the number of people increases. The image quality ID is a reference ID of the image quality parameter tables 90-1 to 90-N and the like.

FIG. 13 is a flowchart showing an example of the control operation by the control unit 22 at the time of best shot shooting according to the modification 2. The operations of steps S1 to S13 and steps S15 to S17 are steps S1 to S13 of the flowchart shown in FIG. , And the operations in steps S15 to S17.
In FIG. 13, when a priority record (a face recognition record with the highest priority) is selected in step S13 (see FIG. 10), the control unit 22 uses the image quality ID stored in the image quality ID column 67 as a key. The image quality ID column 91 of the parameter table 90-1 is searched (step S14-1), each image quality parameter stored in the image quality parameter record with the matching image quality ID is extracted and set as a shooting parameter, and the process proceeds to step S15 (step S15). Step S14-2).

(Modification 3)
FIG. 14 is a diagram showing an embodiment of the structure of the face recognition table 70, the key table 80, and the image quality parameter table 90. As shown in FIG. 14A, the face recognition table 70 records a personal ID column 71 for storing a personal ID, a name column 72 for recording a name, a priority column 73 for recording a priority, and facial feature data. It comprises a feature data column 74, a collation image pointer column 75 for storing a collation image pointer, and an auxiliary ID column 76 for storing an ID for defining the association with the nationality / keyword record in the nationality / keyword table 80. The structure of the feature data column 74 may be the same as the structure of the feature data column 44 of the face recognition table 40 shown in FIG. The auxiliary ID is used to search the nationality / keyword table 80.
The nationality / keyword table 80 corresponds to the attribute information storage means of the present invention, and is a search key table for searching the image quality parameter table 90 of the specified individual nationality. The auxiliary ID column 81, the nationality storing the nationality A plurality of keyword records including a column 82, a keyword 83, and an image quality ID column 84 storing image quality IDs are stored. The nationality and keyword correspond to attribute information of the present invention.
The structure of the image quality parameter table 90 may be the same as the structure of the image quality parameter tables 90-1 to 90-N for each nationality shown in FIG.
By configuring in this way, the trouble of adding new table data to the database 29-3 or updating the table data is greatly reduced.

  FIG. 15 is a view showing an embodiment of the nationality / keyword selection screen when the database 29-3 having the structure shown in FIG. 11B is used. FIG. 15A is a nationality selection window, and FIG. b) is a keyword selection window. When the user first selects a nationality name in the nationality selection window 151 by a cursor operation or the like, and selects a keyword reminiscent of an individual's age group or gender in the keyword selection window 152 to be displayed next, the user selects the image quality. An image quality parameter record optimum for the face person specified in the frame is read from the parameter table and automatically set as the image quality parameter.

FIG. 16 is a flowchart showing an example of the control operation by the control unit 22 at the time of best shot shooting according to the modification 3. The operations of steps S1 to S13 and steps S15 to S17 are steps S1 to S13 of the flowchart shown in FIG. , And the operations in steps S15 to S17.
In FIG. 16, when a priority record is selected in step S13 (see FIG. 10), the control unit 22 uses the auxiliary ID stored in the auxiliary ID column 76 of the face recognition record set as the priority record as a key. The auxiliary ID column 81 of the table 80 is searched (step S14-1), and the nationality / keyword record with the matching auxiliary ID is extracted and held in the RAM (step S14-2). The number of nationality / keyword records with matching auxiliary IDs is not limited to one, and there may be a plurality of them.

  Next, the control unit 22 opens a nationality selection window 151 as shown in FIG. 15 in a predetermined area of the liquid crystal monitor screen 4 to prompt selection by the user (step S14-3). The keyword selection window 152 is opened to prompt the user to select (step S14-4).

  The control unit 22 checks the nationality / keyword record held in the RAM in step S14-2 with the selected nationality + keyword, and stores the image quality stored in the image quality ID column 84 of the nationality / keyword record with the matching nationality + keyword. The image quality parameter table 90 is searched using the ID as a key (step S14-5), the image quality parameter record with the matching image quality ID is extracted and set as a shooting parameter, and the process proceeds to step S15 (step S14-6).

(Modification 4)
FIG. 17 is a diagram illustrating an example of the structure of a face recognition table according to the fourth modification. The priority stored in the priority column of the face recognition table of FIGS. 4, 12, and 14 described above may be configured to be set only manually, but according to the manual setting and the shooting frequency of the individual. The priority may be updated.
Specifically, as shown in the figure, the face recognition table 170 records a personal ID column 171 for storing a personal ID, a name column 172 for recording a name, a priority column 173 for recording a priority, and facial feature data. In addition to the feature data field 175, the collation image pointer field 176 for storing the collation image pointer, and the auxiliary ID field 177, a plurality of face recognition records provided with a total number of photographing times 174 for storing the total number of photographing times are stored. The step of adding 1 to the cumulative number of shots field 174 of the face recognition record set as the priority record in step S14 is added to the subsequent stage or the previous stage of the shooting process of step S17 in the flowchart of FIG. A step of recording and updating the priority according to the cumulative number of times of photographing stored in the total number of times of photographing column 174 may be provided. In the example shown in the figure, Grandmother Kiyo currently has the third priority. However, if Grandmother Kiyo has more photographs than others, the cumulative number of photographs increases, and the rank increases.

In the fourth modification, the priority is updated according to the number of times of shooting, but the priority may be updated according to the shooting time.
Specifically, in the face recognition table 170, the cumulative number-of-photographs field 174 that stores the total number of times of photographing is changed to the “total number of times of photographing field 174 that stores the total number of photographing times”, and step S17 in the flowchart of FIG. The step of adding the shooting time of the image to the cumulative shooting time column 174 of the face recognition record that was set as the priority record in step S14, and the cumulative shooting time stored in the cumulative shooting time column 174 at the latter stage or the previous stage of the shooting process Accordingly, a step for updating the priority may be provided.

  Although not shown in the drawings, in each of the above-described embodiments, additional means for adding and storing face information and / or image quality parameters corresponding to a new individual in the database 29-3 so that a new individual can be registered. It is desirable to prepare.

  In addition, it is desirable to include an editing unit that arbitrarily edits the image quality parameter stored in the database 29-3. As a result, the image quality parameters registered in the memory can be arbitrarily edited, so that there is no need to re-register when the image quality parameters are corrected or changed.

  As mentioned above, although several Example of this invention was described, it cannot be overemphasized that this invention is not limited to said each Example, A various deformation | transformation implementation is possible. For example, the term camera applies not only to digital cameras, but also to devices that have a function of recording image data captured via an optical system and an image sensor, such as mobile phones with cameras and electronic devices that have an imaging function. it can.

It is a figure which shows the external appearance of the digital camera as one Example of the camera which concerns on this invention. It is a figure which shows one Example of the electronic circuit structure of the digital camera shown in FIG. It is a figure which shows one Example of the structure of a database. It is a figure which shows one Example of the structure of a face recognition table. It is a figure which shows an example of the best shot scene. It is a figure which shows an example of the face of the person detected within the flame | frame. It is explanatory drawing of the image quality parameter record determination method when the face of a several person is recognized. It is explanatory drawing of the image quality parameter record determination method when the face of a several person is recognized. It is explanatory drawing of the image quality parameter record determination method when the face of a several person is recognized. It is a flowchart which shows the example of control operation at the time of the best shot imaging | photography concerning this invention. It is a figure which shows the other Example of the structure of a database. It is a figure which shows one Example of structures, such as a face recognition table which concerns on the modification 2. FIG. 10 is a flowchart illustrating an example of a control operation during best shot shooting according to Modification 2. It is a figure which shows one Example of structures, such as a face recognition table which concerns on the modification 3. FIG. It is a figure which shows one Example of a nationality / keyword selection screen. 12 is a flowchart illustrating an example of a control operation during best shot shooting according to Modification 3. It is a figure which shows one Example of the structure of the face recognition table which concerns on the modification 4. FIG.

Explanation of symbols

5 Cursor
6 SET key
8 Shutter key
22 Control unit
23 VRAM controller
26 Display section
28 Storage memory
29-1 Face detection unit
29-2 Face recognition unit
29-3 Database
30 Key input part
40, 60, 70 Face recognition table
80 Nationality / Keyword Table
90, 90-1 National Image Quality Parameter Table
51, 61, 70, 75 Zoom region 100 without deterioration Digital camera

Claims (13)

Imaging means for capturing an image of a subject and obtaining an image;
A face information for identifying a person in an image obtained by the imaging means, the person object and face information including the cumulative recording time priority and the person thereof with the other person, and the face information Storage means for storing personal image quality parameters specified by
Image recording means for recording and saving an image captured by the imaging means;
Image display control means for displaying an image to be imaged by the imaging means;
Face detection means for detecting face portions of a plurality of persons from the image acquired by the imaging means;
And personal identification means for identifying each corresponding individual based on the face information stored in the storage means in the face portion of the plurality of persons detected by the face detecting means,
Image quality parameter acquisition means for acquiring image quality parameters based on the priority order included in the face information corresponding to each individual specified by the individual specifying means from the storage means;
An imaging control unit that performs imaging using the image quality parameter acquired by the image quality parameter acquisition unit as a shooting parameter of the imaging unit;
Cumulative shooting time updating means for updating the cumulative shooting time of the individual specified by the face information every time shooting is performed;
An acquisition priority update means for updating the priority based on the cumulative shooting time;
A camera characterized by comprising   The camera according to claim 1, further comprising an adding unit that stores the face information and / or the image quality parameter corresponding to a new individual in addition to the storage unit.   2. The camera according to claim 1, further comprising editing means for arbitrarily editing the image quality parameter stored in the storage means. It said image quality parameter acquiring unit, claims and acquires the image quality parameters of the highest person priority included respectively in the face information corresponding to each person identified by the personal identification unit from the storage means Item 14. The camera according to Item 1 . Further comprising a priority change section for changing the priority contained in each individual's facial information identified by the personal identification means,
The camera according to claim 1 , wherein the image quality parameter acquisition unit acquires the image quality parameter associated with the face information whose priority has been changed by the priority change unit from the storage unit. It said image quality parameter acquiring means, to claim 1, characterized in that to obtain the value calculated based on the image quality parameters of each individual identified by a predetermined calculation formula by the individual identification means as the image quality parameter for photographing The listed camera.   The camera according to claim 1, wherein the storage unit stores the face information and the image quality parameter for each individual as a single record. The storage means comprises face information storage means for storing the face information record storing the face information for each person, and image quality parameter storage means for storing the image quality parameter record for storing the image quality parameter,
The face information of each individual stored in the face information storage unit and the image quality parameter stored in the image quality parameter storage unit are associated with each other with predetermined association information.
The camera according to claim 1. The storage means stores face information storage means for storing individual face information records storing the face information, attribute information storage means for storing attribute information representing human attributes, and stores the image quality parameters. Image quality parameter storage means for storing the image quality parameter record,
The face information of each individual stored in the face information storage means and the image quality parameters stored in the image quality parameter storage means are associated by attribute information stored in the attribute information storage means.
The camera according to claim 1. Attribute information selection means for selecting attribute information is provided,
The quality parameter acquisition means, according to claim 9, characterized in that to obtain the image quality parameters of the individual identified by the personal identification unit from the image quality parameter storage unit based on the attribute information selected by the attribute information selection means Camera described in. The face information includes personal face feature information;
The face detection means includes means for extracting facial feature information detected from the image;
The personal identification means includes means for comparing the face feature information detected by the face detection means with the face feature information included in the face information to determine similarity, and the face having the highest similarity Including means for acquiring face information including feature information and identifying an individual.
The camera according to any one of claims 1 to 10 , wherein the camera is characterized by that. A face information for identifying a person in the image acquired during imaging, the person object and face information including the cumulative recording time priority and the person thereof with the other person, and identified by the face information In a camera equipped with a memory that stores personal image quality parameters
Displaying an image to be imaged;
Capturing a subject and obtaining an image;
Detecting a plurality of human faces from the acquired images;
Identifying the individual corresponding to each of the detected face portions of the plurality of persons based on the face information stored in the memory;
Obtaining an image quality parameter from the memory based on the priority order included in the face information corresponding to each identified individual;
Imaging the acquired image quality parameter as a shooting parameter and obtaining an image of an image quality according to the identified individual;
Recording and storing the captured image;
Updating the cumulative shooting time of the individual specified by the face information every time shooting is performed;
Updating the priority based on the cumulative shooting time;
A best shot shooting method characterized by comprising: A face information for identifying a person in the image acquired during imaging, the person object and face information including the cumulative recording time priority and the person thereof with the other person, and identified by the face information A computer with a memory that stores image quality parameters that are optimal for the individual
A function to capture an image of a subject,
A function for displaying an image to be imaged;
A function to capture an image of a subject,
A function of detecting the faces of a plurality of persons from the acquired image;
A function for identifying individuals corresponding to the detected face portions of the plurality of persons based on the face information stored in the memory;
A function of determining the number of identified individuals;
As a result of the determination, when the identified individual is one person , an image quality parameter is acquired from the memory based on the priority order included in the face information corresponding to each identified individual, and the identified individual A function of acquiring image quality parameters from the memory based on an acquisition priority order included in the face information in the case of a plurality of cases,
A function of taking the acquired image quality parameter as a shooting parameter and obtaining an image of an image quality according to the identified individual;
A function of recording and saving the captured image;
A function of updating the cumulative shooting time of an individual specified by the face information every time shooting is performed;
A function of updating the priority order based on the cumulative shooting time;
A program that executes

Images