JP2007282119A - Electronic camera and image processing apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an electronic camera and an image processing apparatus for executing various processes on the basis of information of a principal object designated as a result of face recognition. <P>SOLUTION: The electronic camera includes: an imaging element; a memory; a face detection section; a face recognition section; an object designation section; and a photographing control section. The imaging element applies photoelectric conversion to an object image to produce an image signal. The memory records registration data denoting a characteristic point of a face to be a recognition object. The face detection section detects a face region in a photographed image on the basis of the image signal and extracts the characteristic point of the face of the object from the face region. The face recognition section discriminates whether or not the face region is a recognition object on the basis of data of the characteristic point corresponding to the face region and the registration data. The object designation section designates a principal object located among the recognition objects corresponding to the face region. The photographing control section detects a state of the principal object on the basis of the image signal and controls photographing operations of the electronic camera depending on a detection state. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an electronic camera and an image processing apparatus having a face recognition function for a person or the like.

Conventionally, as shown in Patent Document 1, for example, feature points of a person's face are extracted from a captured image obtained by photographing the person's face, and based on the degree of coincidence between face recognition data related to the person to be recognized and the above feature points. A technique for performing face recognition is disclosed.
JP-A-6-259534

By the way, as one means for enhancing the convenience of an electronic camera or the like, an electronic camera or image processing that designates a person as a main subject according to the result of face recognition and performs various processes using information on the main subject. An apparatus is desired.
The present invention is to solve the above-mentioned problems of the prior art. An object of the present invention is to provide an electronic camera and an image processing apparatus that perform various processes based on information of a main subject designated based on a result of face recognition.

  An electronic camera according to a first invention includes an imaging device, a memory, a face detection unit, a face recognition unit, a subject designation unit, and a shooting control unit. The image sensor photoelectrically converts the subject image to generate an image signal. The memory records registration data indicating facial feature points to be recognized. The face detection unit detects a face area in the shooting screen based on the image signal, and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registration data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The photographing control unit detects the state of the main subject based on the image signal and controls the photographing operation of the electronic camera according to the detected state.

In the first aspect of the invention, it is preferable that the imaging control unit performs focusing control with the main subject as a reference.
In the first aspect of the invention, it is preferable that the imaging control unit detects the image blur of the main subject based on the image signal and controls the shooting operation according to the detection state of the image blur. .

In the first aspect of the invention, it is preferable that the shooting control unit estimates the facial expression of the main subject based on the image signal and controls the shooting operation according to the type of facial expression.
In the first aspect, it is preferable that the imaging control unit detects each in-focus state of the plurality of main subjects based on the image signal and controls the depth of field according to the in-focus state.

  An electronic camera according to a second invention includes an image sensor, a memory, a face detection unit, a face recognition unit, a subject designation unit, and an image processing unit. The image sensor photoelectrically converts the subject image to generate an image signal. The memory records registration data indicating facial feature points to be recognized. The face detection unit detects a face area in the shooting screen based on the image signal, and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The image processing unit generates captured image data based on the image signal, and performs image processing different from the other regions on the region corresponding to the main subject of the captured image.

In the second aspect of the invention, it is preferable that the image processing unit changes the correction processing related to the contour enhancement in the region corresponding to the main subject with another region.
In the second aspect of the invention, it is preferable that the image processing unit changes the characteristics of gradation correction in an area corresponding to the main subject from other areas.
In the second aspect of the invention, it is preferable that the image processing unit changes the correction processing related to the saturation in the region corresponding to the main subject with another region.

In the second aspect, it is preferable that the image processing unit executes a light amount correction process for adjusting a gradation of a dark part or a highlight part of an image based on a result of image analysis on an area corresponding to a main subject. .
In the second aspect, it is preferable that the image processing unit changes the noise reduction processing in the area corresponding to the main subject to another area.

In the second aspect, it is preferable that the image processing unit changes the correction process related to red-eye reduction in the area corresponding to the main subject to another area.
In the second aspect of the invention, it is preferable that the image processing unit changes the correction processing related to blur reduction in the area corresponding to the main subject with another area.
An electronic camera according to a third invention includes an image sensor, a memory, a face detection unit, a face recognition unit, a subject designation unit, an image processing unit, and an image file generation unit. The image sensor photoelectrically converts the subject image to generate an image signal. The memory records registration data indicating facial feature points to be recognized. The face detection unit detects a face area in the shooting screen based on the image signal, and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The image processing unit generates captured image data based on the image signal. The image file generation unit generates attached data indicating the main subject in the captured image and generates an image file in which the attached data is associated with the captured image data.

  An electronic camera according to a fourth aspect of the present invention includes an image sensor, a memory, a face detection unit, a face recognition unit, a subject designation unit, an image processing unit, and a print setting data generation unit. The image sensor photoelectrically converts the subject image to generate an image signal. The memory records registration data indicating facial feature points to be recognized. The face detection unit detects a face area in the shooting screen based on the image signal, and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The image processing unit generates captured image data based on the image signal. The print setting data generation unit generates print setting data related to the print setting of the captured image in accordance with the main subject specified in the captured image.

  An electronic camera according to a fifth aspect includes an imaging device, a memory, a face detection unit, a face recognition unit, a subject designation unit, an image processing unit, and a control unit. The image sensor photoelectrically converts the subject image to generate an image signal. The memory records registration data indicating feature points of the face to be recognized and address data used for data communication with the person of the registration data. The face detection unit detects a face area in the shooting screen based on the image signal, and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject as a recognition target from subjects corresponding to the face area. The image processing unit generates captured image data based on the image signal. The control unit associates the address data corresponding to the main subject with the data of the captured image.

  An image processing apparatus according to a sixth aspect includes a data reading unit, a memory, a face detection unit, a face recognition unit, a subject designation unit, and an image processing unit. The data reading unit reads captured image data generated by the electronic camera. The memory records registration data indicating facial feature points to be recognized. The face detection unit detects a face area in the captured image and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The image processing unit performs image processing different from other regions on the region corresponding to the main subject of the captured image.

  An image processing apparatus according to a seventh aspect includes a data reading unit, a memory, a face detection unit, a face recognition unit, a subject designation unit, and a reproduction control unit. The data reading unit reads captured image data generated by the electronic camera. The memory records registration data indicating facial feature points to be recognized, and reproduction setting data indicating display settings relating to reproduction of an image obtained by photographing the subject of the registration data. The face detection unit detects a face area in the captured image and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The reproduction control unit obtains reproduction setting data corresponding to the main subject and reproduces the captured image based on the reproduction setting data.

  An image processing apparatus according to an eighth invention includes a data reading unit, a memory, a face detection unit, a face recognition unit, a subject designation unit, and a print setting data generation unit. The data reading unit reads captured image data generated by the electronic camera. The memory records registration data indicating facial feature points to be recognized. The face detection unit detects a face area in the captured image and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The print setting data generation unit generates print setting data related to the print setting of the captured image in accordance with the main subject specified in the captured image.

  An image processing apparatus according to a ninth aspect includes a data reading unit, a memory, a face detection unit, a face recognition unit, a subject designation unit, and a control unit. The data reading unit reads captured image data generated by the electronic camera. The memory records registration data indicating feature points of the face to be recognized and address data used for data communication with the person of the registration data. The face detection unit detects a face area in the captured image and extracts a feature point of the face of the subject from the face area. The face recognition unit determines whether or not the face area is a recognition target based on the feature point data corresponding to the face area and the registered data. The subject designating unit designates a main subject from subjects corresponding to the face region based on the determination result. The control unit associates the address data corresponding to the main subject with the data of the captured image.

  An image processing apparatus according to a tenth aspect includes a data reading unit, a subject specifying unit, and an image processing unit. The data reading unit reads an image file. This image file is configured by associating captured image data generated by the electronic camera with attached data indicating the main subject in the captured image designated by the electronic camera based on face recognition processing. The subject designating unit designates the main subject from among the subjects of the captured image based on the attached data. The image processing unit performs image processing different from other regions on the region corresponding to the main subject of the captured image.

  An image processing apparatus according to an eleventh aspect includes a data reading unit, a memory, a subject specifying unit, and a reproduction control unit. The data reading unit reads an image file. This image file is configured by associating captured image data generated by the electronic camera with attached data indicating the main subject in the captured image designated by the electronic camera based on face recognition processing. The memory records reproduction setting data indicating display settings relating to reproduction of a captured image including a registered person. The subject designating unit designates the main subject from among the subjects of the captured image based on the attached data. When the main subject matches the registered person, the playback control unit plays back the captured image based on the playback setting data corresponding to the registered person.

  An image processing apparatus according to a twelfth aspect includes a data reading unit, a subject designating unit, and a print setting data generating unit. The data reading unit reads an image file. This image file is configured by associating captured image data generated by the electronic camera with attached data indicating the main subject in the captured image designated by the electronic camera based on face recognition processing. The subject designating unit designates the main subject from among the subjects of the captured image based on the attached data. The print setting data generation unit generates print setting data related to the print setting of the captured image in accordance with the main subject specified in the captured image.

  An image processing apparatus according to a thirteenth aspect includes a data reading unit, a memory, a subject designating unit, and a control unit. The data reading unit reads an image file. This image file is configured by associating captured image data generated by the electronic camera with attached data indicating the main subject in the captured image designated by the electronic camera based on face recognition processing. The memory records address data used for data communication with a registered person. The subject designating unit designates the main subject from among the subjects of the captured image based on the attached data. When the main subject matches the registered person, the control unit associates the address data corresponding to the main subject with the captured image data.

  An electronic camera according to a fourteenth aspect includes authentication means, registration means, and registration control means. The authentication unit authenticates a subject other than the person together with the person. The registration means registers authentication data used by the authentication means to authenticate the subject. The registration control unit registers authentication data related to a subject other than a person together with authentication data related to the person. In the fourteenth invention, the subject other than the person is preferably an animal.

  Here, in the image processing apparatuses according to the seventh and tenth inventions, the image processing unit may perform the same image processing as the image processing unit of the second invention. In addition, a configuration obtained by converting the configurations related to the sixth to thirteenth inventions into methods, recording media, computer programs, and the like is also effective as a specific aspect of the present invention.

  According to the present invention, it is possible to realize an electronic camera and an image processing apparatus that perform various processes based on information on a main subject designated based on a result of face recognition.

FIG. 1 is a block diagram showing the configuration of the electronic camera of this embodiment.
The electronic camera includes a photographing lens 11, a lens driving unit 12, a diaphragm 13, a diaphragm driving unit 14, an image sensor 15, an analog processing unit 16, an A / D conversion unit 17, and a timing generator (TG) 18. The first memory 19, the image processing unit 20, the recording I / F 21, the display I / F 22, the monitor 23, the operation unit 24, the communication unit 25, the external I / F 26, the CPU 27, 2 has a memory 28 and a system bus 29. The first memory 19, the image processing unit 20, the recording I / F 21, the display I / F 22, the communication unit 25, the external I / F 26, and the CPU 27 are connected via a system bus 29.

  The photographing lens 11 is composed of a plurality of lens groups including a zoom lens and a focus lens for adjusting a focus position. Each lens constituting the photographing lens 11 is moved in the optical axis direction by the lens driving unit 12. Further, the lens driving unit 12 includes an encoder (not shown) that detects the position of the photographing lens 11 in the optical axis direction. The input / output of the lens driving unit 12 is connected to the CPU 27.

The diaphragm 13 adjusts the amount of incident light from the photographic lens 11. The aperture amount of the diaphragm 13 is adjusted by the diaphragm drive unit 14. The input / output of the aperture driving unit 14 is connected to the CPU 27.
The image sensor 15 photoelectrically converts the light beam that has passed through the photographing lens 11 to generate an analog image signal of the subject image. In the photographing mode for photographing a subject, the image sensor 15 captures a recording image for recording at the time of shooting, and outputs a through image by thinning out at predetermined intervals even during standby for shooting. The through image data is used for various arithmetic processes by the CPU 27 and display on the monitor 23.

  The analog processing unit 16 is an analog front end circuit that performs analog signal processing on the output of the image sensor 15. The analog processing unit 16 has a CDS circuit and a gain circuit inside. The CDS circuit of the analog processing unit 16 reduces the noise component of the output of the image sensor 15 by correlated double sampling. The gain circuit of the analog processing unit 16 amplifies the gain of the input signal based on an instruction from the CPU 27. In the gain circuit described above, the imaging sensitivity corresponding to the ISO sensitivity can be adjusted.

The A / D conversion unit 17 performs A / D conversion on the analog image signal output from the analog processing unit 16. The output of the A / D converter 17 is connected to the first memory 19.
The TG 18 supplies timing pulses to the image sensor 15, the analog processing unit 16, and the A / D conversion unit 17 based on instructions from the CPU 27. The drive timing of the image sensor 15, the analog processing unit 16, and the A / D conversion unit 17 is controlled by the timing pulse of the TG 18.

The first memory 19 is a buffer memory for temporarily recording image data in the pre-process and post-process of image processing described later.
The image processing unit 20 performs various kinds of image processing on the digital image signal at the time of shooting in the above shooting mode to generate a shot image. The image processing unit 20 compresses the captured image data in the JPEG format. Furthermore, the image processing unit 20 generates a display image (view image) from the image signal of the through image according to an instruction from the CPU 27 in the above-described shooting mode.

On the other hand, in an edit mode in which a captured image is reproduced, the image processing unit 20 executes a process of decompressing and restoring the compressed captured image data. The image processing unit 20 can also perform image processing on captured image data in the editing mode. The specific contents of the image processing by the image processing unit 20 will be described later.
A connector for connecting the recording medium 30 is formed on the recording I / F 21. The recording I / F 21 executes writing / reading of the captured image data with respect to the recording medium 30 connected to the connector. The recording medium 30 includes a hard disk, a memory card incorporating a semiconductor memory, or the like. In FIG. 1, a memory card is illustrated as an example of the recording medium 30.

The display I / F 22 controls display on the monitor 23 based on an instruction from the CPU 27. The display I / F 22 has a video terminal for outputting an image to the outside. Therefore, in the electronic camera of the present embodiment, it is possible to display a reproduced image on an external display device (such as a television) via the video terminal of the display I / F 22.
The monitor 23 displays various images in accordance with instructions from the CPU 27 and the display I / F 22. The monitor 23 in this embodiment is a liquid crystal monitor. The monitor 23 displays a moving image of the view image during shooting standby in the shooting mode. The monitor 23 displays various information necessary for shooting (for example, the number of frames that can be shot, the position of the focus detection area, the frame display of the face area detected by the face detection process described later, etc.) by the on-screen function. ) Can be superimposed on the view image.

Further, the monitor 23 can also display a playback image based on the captured image data, a menu screen that can be input in a GUI (Graphical User Interface) format, and the like (the illustration of the view image and the menu screen on the monitor 23 is omitted). To do).
The operation unit 24 has a release button, an operation button, and the like. The release button of the operation unit 24 receives an instruction input for starting an exposure operation from the user. The operation buttons of the operation unit 24 accept input from the user such as an input on the menu screen or the like, an input for switching the photographing mode of the electronic camera, and the like.

The communication unit 25 controls communication with an external device in accordance with a specification defined in the wireless LAN standard IEEE 802.11. For example, when transmitting captured image data to an external device, the communication unit 25 converts the captured image data into data that can be wirelessly communicated, and transmits the converted data to the external device.
The external I / F 26 has a connection terminal of a serial communication standard such as USB (Universal Serial Bus). The external I / F 26 controls data transmission / reception with a computer or the like connected via the connection terminal in accordance with the communication standard.

The CPU 27 controls the operation of each part of the electronic camera according to a sequence program stored in a ROM (not shown), and executes various calculations necessary for shooting and the like (the contents will be described later). Further, the CPU 27 of the present embodiment functions as an AF control unit 31, a face detection unit 32, and a face recognition unit 33.
The AF control unit 31 performs drive control of the focus lens, a known AF calculation in a contrast detection method based on through image data, and the like. The AF control unit 31 can also acquire the position of the focus lens at the time of focusing from the lens driving unit 12 and calculate the subject distance of each subject in the shooting screen.

  The face detection unit 32 extracts feature points from the data of the through image or the photographed image, and detects the face area of the subject, the size of the face and the like. For example, the face detection unit 32 extracts a face region by a feature point extraction process described in Japanese Patent Laid-Open No. 2001-16573. Examples of the feature points include eyebrow, eye, nose, and lip end points, face contour points, head vertices, and chin lower end points. Note that the face detection unit 32 can also detect the faces of animals such as dogs, cats, and birds.

The face recognition unit 33 generates face recognition data based on the feature points detected by the face detection unit 32. For example, the face recognition unit 33 generates face recognition data of a registered person to be recognized from the position of the detected feature point of the face, the size of the face part obtained from the feature point, the relative distance of each feature point, and the like.
Further, the face recognition unit 33 performs face recognition processing for determining whether or not the face of the person in the shooting screen is the face of the person in the face recognition data. Specifically, first, the face recognition unit 33 calculates the position of the feature point of the photographed person's face, the size of each face part, the relative distance of each feature point, and the like based on the detected feature points of the face. Next, the face recognition unit 33 compares the above calculation result with the face recognition data, and obtains the similarity between the face of the person in the face recognition data and the face of the photographed person. Then, the face recognition unit 33 determines that the photographed person matches the person in the face recognition data when the similarity is above the threshold. Note that the CPU 27 executes designation of a main subject, which will be described later, based on the face recognition result of the face recognition unit 33.

In the present embodiment, the face recognition unit 33 may generate animal face recognition data as in the case of a human being. The face recognition unit 33 can also perform face recognition for an animal in the shooting screen based on the animal face recognition data.
The second memory 28 is connected to the CPU 27. In the second memory 28, face recognition data generated by the face recognition unit 33 is recorded. In the second memory 28, a group folder can be generated for each registered person (registered person), and face recognition data can be grouped for each registered person by the group folder. For example, in the group folder, a plurality of face recognition data with different face orientations, shooting conditions, etc. can be recorded for the same registered person.

Further, setting data indicating various settings applied by the CPU 27 when the registered person is recognized can be recorded in each group folder of the second memory 28. For example, the setting data includes (1) playback display settings, (2) print settings, and (3) transmission settings.
In the playback display setting in (1) above, various playback display settings in the edit mode can be made. The content of the playback display setting includes, for example, the display time, display pattern, music at the time of display, and the like of a captured image in which a registered person is captured in a slide show display. In the print setting (2), for example, whether or not print setting data is generated according to the DPOF (Digital Print Order Format) standard, detailed contents of the print setting (designation of the number of prints and size), and the like can be set. In the transmission setting of (3) above, it is possible to set the necessity of transmission of a captured image of a registered person and the address data (e-mail address) of the transmission destination.

  In the above description, the case of human face recognition data has been described. However, a group folder can also be generated and grouped for animal face recognition data. In addition, setting data can be recorded in the group folder for animal face recognition data. For example, a pet dog can be registered in a “family” group folder in which family members are registered.

Next, an example of the operation of the shooting mode in the electronic camera of the present embodiment will be described with reference to the flowcharts of FIGS. In the following description, the description is given on the assumption that a person is photographed.
Step 101: First, the user inputs a shooting mode setting to the CPU 27 to turn on the face recognition function. Note that if the above setting has been made in advance in the previous shooting or the like, the user can omit step S101.

  For example, in a state where the electronic camera is set to the shooting mode, the user performs an operation for calling a menu screen by the operation unit 24. As a result, the CPU 27 displays a menu screen on the monitor 23. Then, the user operates the cursor on the menu screen with the operation unit 24 to input to the CPU 27 for turning on the face recognition function. Thereby, the CPU 27 executes face recognition based on the face recognition data. In the menu screen, various settings related to the main subject described later can be performed.

  Step 102: The CPU 27 drives the imaging device 15 to start acquiring a through image. The imaging element 15 acquires an image signal of a through image by thinning out reading at predetermined intervals. The image processing unit 20 sequentially generates view images based on through-image data. The view image is displayed as a moving image on the monitor 23 at the time of shooting standby. Therefore, the user can perform framing for determining the shooting composition based on the view image on the monitor 23.

Step 103: The face detection unit 32 of the CPU 27 performs a face detection process on the through image data to detect a face area in the shooting screen.
Step 104: The CPU 27 determines whether or not a face area is detected in the face detection process of S103. If a face area is detected (YES side), the process proceeds to S105. On the other hand, when the face area is not detected (NO side), the process proceeds to S110.

Step 105: The face recognition unit 33 of the CPU 27 is registered as a recognition target from the face areas based on the feature point data acquired in the face detection process of S103 and the face recognition data of the second memory 28. A face recognition process for detecting a human face is executed.
Step 106: The CPU 27 determines whether or not the face of the registered person has been detected in the face recognition process in S105. When the face of the registered person is detected (YES side), the process proceeds to S107. On the other hand, when the face of the registered person is not detected (NO side), the process proceeds to S109.

  Step 107: The CPU 27 designates a main subject from subjects corresponding to the face area based on the result of the face recognition process in S105. Here, the CPU 27 can designate two or more persons as main subjects. The number of main subjects that can be designated by the CPU 27 can be changed by the operation of the operation unit 24 by the user. This is to realize a shooting environment according to the user's intention by adjusting the number of main subjects. Note that the input of the number of main subjects to the CPU 27 is performed, for example, on the menu screen described above.

Hereinafter, a method for specifying the main subject by the CPU 27 will be specifically described.
First, the CPU 27 designates a registered person as a main subject.
Secondly, the CPU 27 further designates a subject in the face region that satisfies a predetermined condition among the face regions not corresponding to the registered person as a main subject. Of course, when the number of main subjects has already reached the upper limit, the CPU 27 omits the second step.

For example, in the second step, the CPU 27 further designates a main subject from a person other than the registered person by any one of the following methods (1) to (3).
(1) The CPU 27 designates, as a main subject, a subject whose subject distance is substantially equal to the subject distance (reference subject distance) of the registered person among the subjects whose face areas are detected. That is, in this case, a person whose subject distance is substantially the same as the registered person even if it is far from the registered person in the shooting screen is designated as the main subject together with the registered person.

  Specifically, the CPU 27 designates the main subject as follows. First, the CPU 27 drives the imaging element 15 while scanning the focus lens in one direction to acquire a plurality of through images. Next, the CPU 27 acquires the contrast value of each face area in each through image by the same method as the AF calculation. The CPU 27 calculates the subject distance of each face area in the shooting screen based on the position of the focus lens that provides the highest contrast value for each face area. Then, the CPU 27 designates the subject in the face area whose subject distance difference from the subject distance (reference subject distance) of the registered person is within the threshold as the main subject.

(2) The CPU 27 selects a person (a face area within the predetermined range from the registered person's face area) positioned within a predetermined range from the registered person on the shooting screen among the subjects whose face areas are detected. Specify as. That is, in this case, a person near the registered person is designated as the main subject together with the registered person.
(3) The CPU 27 designates, as a main subject, a subject whose face region size is equal to or greater than a threshold among subjects whose face region is detected. At this time, the CPU 27 sets the threshold value based on the size of the face area of the registered person. For example, the CPU 27 may set a subject having a face area larger than the face area of the registered person as the main subject. In this case, a person who is considered to be located closer to the registered person is designated as the main subject together with the registered person. Further, the CPU 27 can set a subject whose face area size is not significantly different from that of a registered person as a main subject. In this case, similarly to the above (1), a person who is considered to have a subject distance substantially equal to the registered person can be designated as the main subject together with the registered person.

Step 108: The CPU 27 displays on the monitor 23 the face area detected in S103 and the main subject specified in S107. The CPU 27 thereafter proceeds to S110.
FIG. 4A shows a display example of the face area and main subject on the monitor 23. In the example of FIG. 4A, the CPU 27 displays a rectangular frame superimposed on the position of the face area in the view image on the monitor 23. Then, the CPU 27 shows the face area corresponding to the main subject on the monitor 23 by means such as changing the thickness or color of the rectangular frame. As a result, the user can confirm the face detection result and the main subject designated by the CPU 27 in the view image. In addition, in the frame display of the main subject in FIG. 4A, the display of the registered person and other persons may be changed.

Step 109: The CPU 27 displays on the monitor 23 only the face area detected in S103. Note that the display on the monitor 23 in this case is substantially the same as in the case of S108 except that the main subject is not displayed, as shown in FIG. 4B.
Step 110: The CPU 27 determines whether or not the release button is half-pressed. When the release button is half-pressed (YES side), the process proceeds to S111. On the other hand, when the release button is not half-pressed (NO side), the CPU 27 returns to S102 and repeats the above operation.

Step 111: The CPU 27 determines whether or not a main subject is designated in S107. When the main subject is designated (YES side), the process proceeds to S112. On the other hand, when the main subject is not designated (NO side), the process proceeds to S125.
Step 112: The CPU 27 determines whether or not the main subject is single. When the main subject is alone (YES side), the process proceeds to S113. On the other hand, when there are a plurality of main subjects (NO side), the process proceeds to S114.

Step 113: The AF control unit 31 of the CPU 27 executes AF control and AE calculation with the main subject (registered person) designated in S107 as a reference. The CPU 27 thereafter proceeds to S116.
Step 114: The CPU 27 determines a face as a reference for focus detection from the main subjects.

  First, the CPU 27 limits the face serving as a reference for focus detection to the face area of the registered person. When there is only one registered person's face, the CPU 27 uses the registered person's face as a reference for focus detection. Next, when there are a plurality of registered person's faces, the CPU 27 performs focus detection on the face of the registered person whose face is considered to be the largest and closest, or the face close to the center of the shooting screen. The standard.

Step 115: The CPU 27 executes AF control and AE calculation based on the face of the main subject (registered person) selected in S114. Here, the CPU 27 may control the diaphragm 13 in accordance with the focus state of each main subject's face at the time of AF calculation to widen the depth of field so that all the main subjects' faces are in focus. .
Step 116: The CPU 27 determines whether or not subject blur has occurred on the face of any of the main subjects specified in S107. If subject blurring has occurred on the face of the main subject (YES side), the flow proceeds to S117. On the other hand, if subject blurring has not occurred on the face of the main subject (NO side), the flow proceeds to S118. Note that the CPU 27 may skip the subject blur determination in S116 in accordance with the setting on the menu screen and proceed to S118.

  Here, the detection of subject blur in S115 is performed by a known means. For example, when a subject moves, a portion corresponding to an edge flows and is imaged. Therefore, the CPU 27 extracts a high frequency portion of a spatial frequency from a plurality of through images, and based on a change in the edge between the through images. Detect subject blur of the subject. Alternatively, the CPU 27 may obtain an area where the pattern matches between the through images and detect the subject blur based on the moving distance between the areas. As an algorithm for obtaining a region where patterns match between images, for example, a residual sequential test method, a structure matching method, and the like are known.

  Step 117: The CPU 27 resets imaging conditions such as imaging sensitivity and aperture value to shorten the exposure time in order to suppress subject blurring. This reduces the possibility of shooting failure due to subject blur due to the movement of the main subject. Since the CPU 27 does not detect subject blur for a person other than the main subject, the CPU 27 does not change unnecessary shooting conditions due to the movement of a person other than the main subject.

  Step 118: The CPU 27 estimates the facial expression of the main subject based on the detection state of the facial feature points in the facial area. Then, the CPU 27 determines whether or not the facial expressions of all the main subjects are in a predetermined state (for example, no blinking state or a smiling state). If the above condition is satisfied (YES side), the process proceeds to S119. On the other hand, if the above condition is not satisfied (NO side), the CPU 27 waits until the facial expressions of all the main subjects are in a predetermined state. At this time, the CPU 27 may display a warning display regarding the facial expression of the main subject on the monitor 23. Note that the CPU 27 can omit the process in S118 according to the setting on the menu screen.

  Here, the detection of the facial expression in S118 is performed by a known means. For example, as disclosed in Japanese Patent Application Laid-Open No. 2004-272933, learning face images classified into classes such as a normal expression, a face with closed eyes, a face with an open mouth, and a smile are prepared in advance. After performing discrimination by discriminant analysis, facial expressions may be discriminated based on evaluation values set for each class. Alternatively, standard patterns such as open eyes, closed eyes, open mouths, closed mouths, etc., may be prepared in advance, and the CPU 27 may match each pattern with the face area and estimate the facial expression from the combination of patterns. .

  In the case of NO at S118, the CPU 27 does not allow photographing until the facial expression of the main subject changes. Therefore, the user can take a picture with the expression of the main subject in a desired state, and the possibility of shooting failure is reduced. In addition, since the CPU 27 does not estimate the expression for a person other than the main subject, the photographing of the electronic camera is not restricted by a person other than the main subject.

Step 119: The CPU 27 determines whether or not the release button has been fully pressed. When the release button is fully pressed (YES side), the process proceeds to S120. On the other hand, if the release button is not fully pressed (NO side), the process returns to S118.
Step 120: The CPU 27 drives the image sensor 15 to shoot a subject image.
Step 121: The CPU 27 causes the image processing unit 20 to generate captured image data. Here, as shown in the following (1) to (8), the image processing unit 20 performs different image processing on the area corresponding to the main subject (S107) of the photographed image from the other areas. Also good. The on / off of each of the following image processes can be changed by the CPU 27 according to the setting on the menu screen.

(1) The image processing unit 20 changes the outline emphasis processing for the main subject region from that of the other regions. For example, the image processing unit 20 executes contour enhancement processing by applying a contour enhancement filter having a lower degree of contour enhancement to the region of the main subject in the captured image than other regions. As a result, it is possible to obtain a preferable captured image in which rough skin of a person as a main subject is not noticeable.
(2) The image processing unit 20 changes the tone correction characteristics of the main subject area from other areas. For example, the image processing unit 20 performs gradation correction by applying a gradation characteristic table having a gradation curve different from that of the other areas to the main subject area of the captured image. Specifically, a gradation characteristic table of a soft gradation curve in which contrast is relatively lower than the gradation curves of other areas is applied to the main subject area. As a result, it is possible to obtain a preferable captured image with softness on the face of the main subject.

(3) The image processing unit 20 performs correction to increase the saturation of the main subject area more than other areas. For example, the image processing unit 20 sets the saturation parameter of the main subject area of the captured image relatively higher than other areas. As a result, it is possible to obtain a preferable captured image in which the skin color dullness of the person who is the main subject is reduced.
(4) The image processing unit 20 executes a light amount correction process for adjusting the gradation of the dark part or highlight part of the image based on the result of the image analysis on the area of the main subject. The above light amount correction processing is performed by, for example, a known technique disclosed in Japanese Patent Application Laid-Open No. 2006-5699. Specifically, the image processing unit 20 extracts a local fluctuation component from the captured image, and generates a local fluctuation image including the fluctuation component. Next, the image processing unit 20 obtains a modulation signal that modulates the captured image into a local variation image, and level-compresses the modulation signal. The image processing unit 20 then modulates the captured image with the level-compressed modulation signal to obtain a gradation corrected image. As a result, it is possible to obtain an image in a good state in which a gradation that is easily buried is visually restored while moderately suppressing a change in brightness of the correction range. In particular, it is possible to correct a photographed image in a good state in the case of backlight photography or when the flash does not reach the person sufficiently by flash photography. Further, the calculation time can be shortened by omitting a part of the image processing applied to areas other than the main subject area.

  (5) The image processing unit 20 changes the noise reduction processing of the main subject area from the other areas. For example, the image processing unit 20 performs noise reduction processing using a median filter or the like for only the main subject region in the captured image. As a result, the graininess of the face of the main subject can be reduced. Further, the calculation time can be shortened by omitting a part of the image processing applied to areas other than the main subject area.

  (6) The image processing unit 20 performs red-eye reduction correction by image processing only on the area of the main subject. The red-eye reduction correction is performed by a known technique disclosed in, for example, Japanese Patent Laid-Open No. 10-233929. Specifically, the image processing unit 20 detects a red-eye area from the face area and performs correction to reduce the lightness or saturation of the detected red-eye area. As a result, red eyes of the main subject can be prevented. Also, the calculation time can be shortened by omitting part of the image processing for a person other than the main subject.

  (7) The image processing unit 20 performs blur reduction correction only on the main subject area. For example, the image processing unit 20 may perform an unsharp mask process on the area of the main subject to reduce camera shake and blurring. As a result, the blurring and blurring of the main subject can be alleviated to some extent. Further, the calculation time can be shortened by omitting a part of the image processing applied to areas other than the main subject area.

(8) The image processing unit 20 performs soft focus processing on the captured image only for the area of the main subject. As a result, it is possible to obtain a preferable captured image in which the main subject is emphasized and soft.
Here, the soft focus processing of the image processing unit 20 is performed by the following means. For example, the image processing unit 20 generates a soft focus image by performing filter processing using a filter that exhibits a predetermined soft focus effect, a low-pass filter, or the like on the captured image. The image processing unit 20 may generate a mask image from the captured image, and may generate a soft focus image by synthesizing the filtered image and the original image based on the mask image.

  Step 122: The CPU 27 generates an image file compliant with the Exif (Exchangeable image file format for digital still cameras) standard. The CPU 27 uses the work area of the first memory 19 or the second memory 28 to generate header data of the image file. For example, the CPU 27 records data indicating the position of the main subject and the registered person specified in S107 in the header using the MakerNote tag together with the data of the shooting conditions (exposure time, aperture value, imaging sensitivity, etc.) of the shot image. To do. Data such as the position of the main subject recorded in the header is used when the user intends to perform image processing (processing similar to S121) on the main subject after the fact. Then, the CPU 27 associates the captured image data with the header data to generate an image file, and finally records the image file on the recording medium 30.

Step 123: The CPU 27 generates print setting data relating to the image file in S122 in accordance with the DPOF standard. The CPU 27 can omit the process in S123 according to the setting on the menu screen.
Specifically, the CPU 27 first designates an image file of a photographed image to be printed, and counts the number of main subjects of the photographed image and designates the number of print setting data to be printed. Further, the CPU 27 designates the print size (L, 2L, etc.) in the print setting data according to the setting on the menu screen. Note that the CPU 27 may read the print setting of the registered person detected in S105 from the second memory 28 and specify the number of prints and the print size of the print setting data.

Step 124: The CPU 27 associates the address data related to the wireless communication with the image file in S122 and transmits the image file to the outside via the communication unit 25. The CPU 27 may omit the process in S124 according to the setting on the menu screen and end the series of shooting operations.
Specifically, the CPU 27 reads the registered person transmission setting detected in S <b> 105 from the second memory 28. When the transmission setting of the captured image is on, the CPU 27 instructs the communication unit 25 to transmit the image file to the transmission destination indicated by the address data. On the other hand, when the transmission setting of the captured image is off or wireless communication is not possible, the CPU 27 may record address data in the header of the image file.

Step 125: In this case, the CPU 27 executes AF and AE with the same algorithm as in normal shooting. Then, in response to the release button being fully pressed, the CPU 27 captures the subject and generates captured image data. This is the end of the description of the shooting mode operation.
Hereinafter, the effect in the photographing mode of the electronic camera in the present embodiment will be described.
In the above shooting mode, shooting control, image processing, and the like in the electronic camera are performed based on the main subject specified based on the face recognition result. In addition, the electronic camera can automatically generate print setting data, external transmission by wireless communication, and the like for the captured image data of the main subject specified. Therefore, according to this embodiment, an electronic camera that is functional and highly convenient for the user can be realized.

  Further, in the designation of the main subject, the CPU 27 detects a registered person in the face recognition process and designates the registered person as the main subject. Depending on the shooting scene, the CPU 27 can designate a person who can be assumed to be treated in the same way as a registered person as a main subject together with the registered person. Therefore, according to the present embodiment, it is possible to easily obtain a captured image according to the user's intention.

  Next, an example of the edit mode operation in the electronic camera of the present embodiment will be described with reference to FIG. This editing mode is a mode for reproducing an Exif standard image file recorded in advance on the recording medium 30 or the like. The editing mode is activated in response to an input from the operation button by the CPU 27 while the electronic camera is activated in the shooting mode. Alternatively, the CPU 27 may directly activate the edit mode without going through the shooting mode in response to a user mode selection operation.

Step 201: The CPU 27 reads an image file designated by the user from the recording medium 30 of the recording I / F 21 or an external device (not shown) connected to the external I / F 26. Note that the image file read by the CPU 27 in step S201 may be generated by another electronic camera as long as the image file by the electronic camera has the same standard.
Step 202: The CPU 27 determines whether or not the image file read in S201 includes data indicating the position of the main subject and the registered person. The data such as the position of the main subject corresponds to the data recorded in the header in S122 of the shooting mode. When the above data is included in the image file (YES side), the process proceeds to S209. When the above data is not included in the image file (YES side), the process proceeds to S203.

Step 203: The CPU 27 executes face detection processing on the captured image data.
Step 204: The CPU 27 determines whether or not a face area has been detected in the face detection process of S203. If a face area is detected (YES side), the process proceeds to S205. On the other hand, when the face area is not detected (NO side), the process proceeds to S209.
Step 205: The face recognition unit 33 of the CPU 27 is registered as a recognition target from the face areas based on the feature point data acquired in the face detection process of S203 and the face recognition data of the second memory 28. A face recognition process for detecting a human face is executed.

Step 206: The CPU 27 determines whether or not the face of the registered person has been detected in the face recognition process of S205. When the face of the registered person is detected (YES side), the process proceeds to S207. On the other hand, when the face of the registered person is not detected (NO side), the process proceeds to S209.
Step 207: The CPU 27 designates a main subject from subjects corresponding to the face area based on the result of the face recognition processing in S205. Here, the method of designating the main subject by the CPU 27 is almost the same as the case of S107 described above except that the main subject is not designated based on the subject distance, and therefore a duplicate description is omitted.

  Step 208: The CPU 27 records data indicating the position of the main subject and the registered person specified in S207 in the header of the image file. Alternatively, the CPU 27 may generate an image file including data such as the position of the main subject acquired in S207, separately from the image file read in S201. As a result, the CPU 27 can utilize data such as the position of the main subject designated in S207 in subsequent readings.

  Step 209: The CPU 27 reproduces and displays the captured image data on the monitor 23. At this time, the CPU 27 displays a menu display in a GUI format as shown in FIG. 6 on the monitor 23, and accepts an item selection input by the user. Menu display items include, for example, a slide show, image processing, print setting data generation, wireless communication, and the like. Then, the CPU 27 executes various processes according to the item selected on the menu display. For the image file in which the main subject is designated, a mode in which the CPU 27 can display a frame display indicating the main subject superimposed on the reproduced image may be provided as in FIG. The illustration of the display is omitted).

Details of each item will be described below.
(1) Slideshow When a slideshow item is selected in the menu display, the CPU 27 executes a slideshow of image files, and sequentially reproduces captured images of a plurality of image files (for example, all image files in the recording medium 30). Here, for the image file in which the main subject is designated, the CPU 27 performs the following processing in the slide show.

  The CPU 27 sets a long display time of the captured image in the slide show according to the number of main subjects included in the captured image. In addition, the CPU 27 may perform display with special effects based on the position of the face of the main subject in the slide show display. For example, the CPU 27 may display zoom-in, zoom-down, image rotation, fade-in, fade-out, and the like based on the position of the face of the main subject.

  Further, when the faces of a plurality of main subjects are included in the photographed image, the CPU 27 may divide and display the photographed images for the number of main subjects in the slide show display. For example, the CPU 27 performs the above-described divided display by means such as an enlarged display of the face of each main subject. Note that if the second memory 28 has reproduction display setting data relating to the registered person who has become the main subject, the CPU 27 may display a slide show based on the reproduction display setting data.

(2) Photo Retouch When the item of photo retouch is selected in the menu display, the CPU 27 instructs the image processing unit 20 to perform image processing on the captured image data. The image processing unit 20 executes contour enhancement processing, gradation correction, saturation adjustment, light amount correction processing, noise reduction processing, red-eye reduction correction, blur reduction correction, and the like on the captured image data being reproduced and displayed. Here, for the image file in which the main subject is specified, the image processing unit 20 can perform image processing different from other regions on the region corresponding to the main subject of the captured image, as in S121. . The description of the individual image processing is omitted because it overlaps with the above S121.

(3) DPOF
When the DPOF item is selected in the menu display, the CPU 27 generates print setting data related to the image file to be reproduced in accordance with the DPOF standard. Here, for the image file in which the main subject is specified, the CPU 27 automatically specifies the number of print setting data by counting the number of main subjects in the captured image. When the print setting data relating to the registered person who is the main subject is stored in the second memory 28, the CPU 27 reads the print setting of the registered person from the second memory 28, and prints the number of print settings data and prints. You may specify the size.

(4) Wireless communication When the item of wireless communication is selected in the menu display, the CPU 27 transmits an image file to be reproduced to the outside via the communication unit 25. Here, when address data is recorded in the header of the image file, the CPU 27 executes transmission of the image file based on the address data. If the second memory 28 has transmission setting data relating to the registered person who has become the main subject, the CPU 27 may read the address data from the second memory 28 and transmit the image file to be reproduced to the outside. Good. This is the end of the description of the editing mode operation.

Hereinafter, the effect in the edit mode of the electronic camera in this embodiment will be described.
In the editing mode described above, image processing and slide show display in the electronic camera can be performed according to the main subject specified based on the face recognition result. The electronic camera can also generate print setting data, externally transmit by wireless communication, and the like for the captured image data of the main subject. Therefore, according to this embodiment, an electronic camera that is functional and highly convenient for the user can be realized.

  In particular, in the editing mode of the present embodiment, even when there is no data relating to the designation of the main subject in the image file, the CPU 27 can perform face recognition processing on the captured image data to designate the main subject. Therefore, even when face recognition is not performed at the time of shooting, the same effect as in the above shooting mode can be obtained, so that the convenience of the electronic camera can be further improved.

  In the designation of the main subject in the edit mode, the CPU 27 performs face recognition processing on the captured image to detect a registered person, and designates the registered person as the main subject. The CPU 27 can also designate a person who can be estimated from the composition of the photographed image as a registered person as a main subject together with the registered person. Therefore, according to the present embodiment, it is possible to specify the main subject according to the user's intention.

(Supplementary items of the embodiment)
(1) In the above embodiment, an example of an electronic camera that performs face detection or the like using the image sensor 15 for acquiring a captured image has been described. However, the configuration of the present invention is not limited to the example of the above embodiment. Absent. For example, in a single-lens reflex type camera system, an image sensor for performing face detection may be provided in a focus detection mechanism, an optical viewfinder, or the like. In this case, the present invention can be implemented even with a single-lens reflex type electronic camera.

(2) In the above embodiment, an example in which an image is reproduced by an electronic camera has been described. However, in the present invention, image processing for executing processing similar to the editing mode of the electronic camera of the above-described embodiment on a playback-only device (viewer) having a function of playing back an image file or a general-purpose computer that executes an image playback program. An apparatus may be configured.
(3) In the shooting mode of the above embodiment, the CPU 27 may perform face detection processing, face recognition processing, or the like with a half-press of the release button as a trigger.

(4) In the edit mode of the above embodiment, the CPU 27 may display an image on an external display device (such as a television) via the video terminal of the display I / F 22.
(5) The electronic camera of the present invention does not necessarily match the configuration of the electronic camera of the embodiment. For example, the first memory 19 and the second memory 28 may be configured by a common memory. Moreover, some structures, such as the communication part 25, may be abbreviate | omitted.

The block diagram which shows the structure of the electronic camera of this embodiment Flowchart for explaining an operation example of the shooting mode in the electronic camera of the present embodiment Flowchart for explaining an operation example of the shooting mode in the electronic camera of the present embodiment The figure which shows the example of a display of the view image at the time of face detection A flowchart for explaining an operation example of the edit mode in the electronic camera of the present embodiment The figure which shows an example of the menu display on the monitor in edit mode

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 ... Shooting lens, 12 ... Lens drive part, 13 ... Diaphragm, 14 ... Diaphragm drive part, 15 ... Image sensor, 20 ... Image processing part, 21 ... Recording I / F, 22 ... Display I / F, 23 ... Monitor, 24 ... operation unit, 25 ... communication unit, 26 ... external I / F, 27 ... CPU, 28 ... second memory, 29 ... system bus, 30 ... recording medium, 31 ... AF control unit, 32 ... face detection unit, 33 ... Face recognition part

Claims (26)

An image sensor that photoelectrically converts a subject image to generate an image signal;
A memory storing registration data indicating facial feature points to be recognized;
A face detection unit for detecting a face area in the shooting screen based on the image signal and extracting a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
A shooting control unit that detects a state of the main subject based on the image signal and controls a shooting operation of the electronic camera according to the detection state;
An electronic camera comprising: The electronic camera according to claim 1,
The electronic camera according to claim 1, wherein the photographing control unit performs focusing control with the main subject as a reference. The electronic camera according to claim 1,
The electronic camera, wherein the photographing control unit detects image blur of the main subject based on the image signal, and controls the photographing operation according to a detection state of the image blur. The electronic camera according to claim 1,
The electronic camera, wherein the photographing control unit estimates facial expression of the main subject based on the image signal, and controls the photographing operation according to the type of facial expression. The electronic camera according to claim 1,
The electronic camera, wherein the photographing control unit detects each in-focus state of the plurality of main subjects based on the image signal, and controls the depth of field according to the in-focus state. An image sensor that photoelectrically converts a subject image to generate an image signal;
A memory storing registration data indicating facial feature points to be recognized;
A face detection unit for detecting a face area in the shooting screen based on the image signal and extracting a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
An image processing unit that generates data of a captured image based on the image signal, and that performs image processing different from other regions on a region corresponding to the main subject of the captured image;
An electronic camera comprising: The electronic camera according to claim 6.
The electronic camera according to claim 1, wherein the image processing unit changes a correction process related to contour enhancement in an area corresponding to the main subject from the other area. The electronic camera according to claim 6.
The electronic camera according to claim 1, wherein the image processing unit changes a characteristic of gradation correction in an area corresponding to the main subject from the other area. The electronic camera according to claim 6.
The electronic camera according to claim 1, wherein the image processing unit changes a correction process related to saturation in an area corresponding to the main subject from the other area. The electronic camera according to claim 6.
The electronic camera is characterized in that the image processing unit executes a light amount correction process for adjusting a gradation of a dark part or a highlight part of an image based on a result of image analysis on an area corresponding to the main subject. The electronic camera according to claim 6.
The electronic camera according to claim 1, wherein the image processing unit changes a noise reduction process in an area corresponding to the main subject to the other area. The electronic camera according to claim 6.
The electronic camera according to claim 1, wherein the image processing unit changes a correction process related to red-eye reduction in an area corresponding to the main subject with the other area. The electronic camera according to claim 6.
The electronic camera according to claim 1, wherein the image processing unit changes correction processing related to blur reduction in an area corresponding to the main subject from the other area. An image sensor that photoelectrically converts a subject image to generate an image signal;
A memory storing registration data indicating facial feature points to be recognized;
A face detection unit for detecting a face area in the shooting screen based on the image signal and extracting a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
An image processing unit that generates data of a captured image based on the image signal;
Generating ancillary data indicating the main subject in the captured image, and generating an image file in which the attached data is associated with the captured image data; and
An electronic camera comprising: An image sensor that photoelectrically converts a subject image to generate an image signal;
A memory storing registration data indicating facial feature points to be recognized;
A face detection unit for detecting a face area in the shooting screen based on the image signal and extracting a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
An image processing unit that generates data of a captured image based on the image signal;
A print setting data generation unit that generates print setting data related to print settings of the captured image according to the main subject specified in the captured image;
An electronic camera comprising: An image sensor that photoelectrically converts a subject image to generate an image signal;
A memory that records registration data indicating facial feature points to be recognized, and address data used for data communication with the person of the registration data;
A face detection unit for detecting a face area in the shooting screen based on the image signal and extracting a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
An image processing unit that generates data of a captured image based on the image signal;
A control unit that associates the address data corresponding to the main subject with the data of the captured image;
An electronic camera comprising: A data reading unit for reading data of a captured image generated by an electronic camera;
A memory storing registration data indicating facial feature points to be recognized;
A face detection unit that detects a face area in the captured image and extracts a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
An image processing unit that performs image processing different from other regions on a region corresponding to the main subject of the captured image;
An image processing apparatus comprising: A data reading unit for reading data of a captured image generated by an electronic camera;
A memory in which registration data indicating facial feature points to be recognized and reproduction setting data indicating display settings relating to reproduction of an image obtained by photographing the subject of the registration data are recorded;
A face detection unit that detects a face area in the captured image and extracts a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
A reproduction control unit that obtains the reproduction setting data corresponding to the main subject and reproduces the captured image based on the reproduction setting data;
An image processing apparatus comprising: A data reading unit for reading data of a captured image generated by an electronic camera;
A memory storing registration data indicating facial feature points to be recognized;
A face detection unit that detects a face area in the captured image and extracts a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
A print setting data generation unit that generates print setting data related to print settings of the captured image according to the main subject specified in the captured image;
An image processing apparatus comprising: A data reading unit for reading data of a captured image generated by an electronic camera;
A memory that records registration data indicating facial feature points to be recognized, and address data used for data communication with the person of the registration data;
A face detection unit that detects a face area in the captured image and extracts a feature point of the face of the subject from the face area;
A face recognition unit that determines whether the face area is the recognition target based on the feature point data corresponding to the face area and the registration data;
A subject designating unit for designating a main subject from subjects corresponding to the face area based on the determination result;
A control unit that associates the address data corresponding to the main subject with the data of the captured image;
An image processing apparatus comprising: A data reading unit that reads an image file in which data of a captured image generated by an electronic camera and associated data indicating a main subject in the captured image specified by the electronic camera based on face recognition processing are associated;
A subject designation unit for designating a main subject among subjects of the captured image based on the attached data;
An image processing unit that performs image processing different from other regions on a region corresponding to the main subject of the captured image;
An image processing apparatus comprising: A data reading unit that reads an image file in which data of a captured image generated by an electronic camera and associated data indicating a main subject in the captured image specified by the electronic camera based on face recognition processing are associated;
A memory in which reproduction setting data indicating display settings relating to reproduction of the captured image including a registered person is recorded;
A subject designation unit for designating a main subject among subjects of the captured image based on the attached data;
A reproduction control unit that reproduces the captured image based on the reproduction setting data corresponding to the registered person when the main subject matches the registered person;
An image processing apparatus comprising: A data reading unit that reads an image file in which data of a captured image generated by an electronic camera and associated data indicating a main subject in the captured image specified by the electronic camera based on face recognition processing are associated;
A subject designation unit for designating a main subject among subjects of the captured image based on the attached data;
A print setting data generation unit that generates print setting data related to print settings of the captured image according to the main subject specified in the captured image;
An image processing apparatus comprising: A data reading unit that reads an image file in which data of a captured image generated by an electronic camera and associated data indicating a main subject in the captured image specified by the electronic camera based on face recognition processing are associated;
A memory in which address data used for data communication with a registered person is recorded;
A subject designation unit for designating a main subject among subjects of the captured image based on the attached data;
A control unit that associates the address data corresponding to the main subject with data of the captured image when the main subject matches the registered person;
An image processing apparatus comprising: An authentication means for authenticating a subject other than a person together with a person;
Registration means for registering authentication data used by the authentication means to authenticate the subject;
Registration control means for registering authentication data related to a subject other than the person together with authentication data related to the person;
An electronic camera comprising: The electronic camera according to claim 25,
An electronic camera, wherein the subject other than the person is an animal.

Images