JP4906632B2 - Image processing apparatus, image processing method, and image processing program - Google Patents

Description

  This is a configuration related to a user interface of an image processing apparatus that detects a subject in image data and displays the position of the subject.

  In recent years, various functions have been installed due to technical progress of digital cameras. In such a situation, a face detection function that can detect a person's face from image data being displayed on a display provided in a digital camera has attracted attention. By using the face detection function to detect an area including a face, and performing color adjustment according to the area or performing autofocus, the user can automatically and easily take a beautiful person.

As a user interface at that time, for example, there is an interface that displays a frame with a frame surrounding the detected face area (see Patent Document 1).
JP 2005-286940 A

  When a plurality of persons are detected, it may be difficult to perform color adjustment or autofocus on all faces. For this reason, it is desirable that when a plurality of persons are detected, one of the persons is determined as a main subject, and a process for photographing is performed around the main subject.

  However, if the face area detected by the camera is simply displayed uniformly, the user can recognize that a plurality of persons are detected. Can not recognize which person will be. Also, when the camera automatically selects a main subject from a plurality of people using various parameters, the determined person is not necessarily the same as the main subject that the user actually wants to shoot. .

  One possible solution in such a case is to provide a means by which a user can select a person to be photographed as a main subject from the detected persons. Here, since the camera does not necessarily succeed in detecting all the persons, it is desirable to display an indicator that informs the user which person the camera has successfully detected. It is done.

  However, when there are a large number of detected persons, displaying an index indicating which persons the camera has successfully detected may cause troublesome display.

In order to solve the above-described problems, the present invention provides a region detection unit that detects a region including a target object from image data, and a region detected by the region detection unit. In the case where the display unit has an indicator superimposed on an image generated from the image data, and the display unit has a number of areas detected by the area detection unit greater than a predetermined upper limit. The index is displayed for the upper limit number of areas, and when it is determined that the user has performed a predetermined operation, the index is displayed for the upper limit number of areas. from the state, there is provided an image processing apparatus characterized by switching to a state of displaying the indicator for all areas detected by at most than the number of the upper limit said area detection means

Similarly, in order to solve the above problems, the present invention includes a detection step region detecting means detects a region including the subject of interest from the image data, can recognize the area where the display unit is detected And a display step of displaying an index for superimposing on the image generated from the image data, and in the display step, the display means has a predetermined number of areas detected by the area detection means. If more than a defined limit is for displaying the indicator for the number of regions of the upper limit, when it is determined that the predetermined operation by the user, the number of the upper image of the state where the relative area for displaying the indicator, characterized in that switching to a state of displaying the indicator for all areas detected by most said region detection unit than the number of the upper Processing method, and is intended to provide an image processing program for executing this to the image processing apparatus.

  According to the present invention, when selecting any region from the regions where the target target of the user is detected, while considering the visibility of the screen by limiting the number of indicators to be displayed, If necessary, an index related to a selectable area can be presented to the user.

(First embodiment)
Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram of the imaging apparatus according to the present embodiment. Although the present invention can be realized with a video camera, a digital camera will be described as an example here. In FIG. 1, reference numeral 100 denotes a digital camera body. Reference numeral 10 denotes a photographic lens, 12 a shutter having a diaphragm function, 14 an image sensor that converts an optical image transmitted through the photographic lens 10 into an electrical signal and generates image data, and 16 an analog signal output from the image sensor 14 as a digital signal. A / D converter for converting to

  A timing generation circuit 18 supplies a clock signal and a control signal to the image sensor 14, the A / D converter 16, and the D / A converter 26, and is controlled by the memory control circuit 22 and the system control circuit 50.

  An image processing circuit 20 performs predetermined pixel interpolation processing and color conversion processing on the image data from the A / D converter 16 or the image data from the memory control circuit 22. The image processing circuit 20 performs predetermined arithmetic processing on the captured image data. Based on the obtained arithmetic result, the exposure control means 40 and the focus control means 42 perform AF (autofocus) processing and AE (automatic exposure). Processing and EF (flash pre-emission) processing are performed. Further, predetermined calculation processing is performed using image data captured by the image processing circuit 20, and AWB (auto white balance) processing is also performed based on the obtained calculation result.

  A memory control circuit 22 controls the A / D converter 16, the timing generation circuit 18, the image processing circuit 20, the image display memory 24, the D / A converter 26, the memory 30, and the compression / decompression circuit 32. The image data of the A / D converter 16 is sent via the image processing circuit 20 and the memory control circuit 22, or the image data of the A / D converter 16 is sent directly via the memory control circuit 22 and the image display memory 24 or the memory 30. Is written to.

  Reference numeral 24 denotes an image display memory, 26 denotes a D / A converter, and 28 denotes an image display unit comprising an LCD (Liquid Crystal Display) or the like. The display image data written in the image display memory 24 is displayed as an image by the image display unit 28 via the D / A converter 26. By sequentially displaying images generated from image data captured using the image display unit 28, it is possible to realize an electronic viewfinder function for displaying an image of a subject in real time. The image display unit 28 can arbitrarily turn on / off the display according to an instruction from the system control circuit 50. When the display is turned off, the power consumption of the digital camera 100 can be reduced.

  Reference numeral 30 denotes a memory for storing captured still images and moving images, and has a sufficient storage capacity to store a predetermined number of still images and a predetermined time of moving images. Thereby, even in the case of continuous shooting or panoramic shooting in which a plurality of still images are continuously shot, it is possible to write a large amount of images to the memory 30 at high speed. The memory 30 can also be used as a work area for the system control circuit 50.

  Reference numeral 32 denotes a compression / decompression circuit that compresses and decompresses image data by adaptive discrete cosine transform (ADCT) or the like, reads an image stored in the memory 30, performs compression processing or decompression processing, and stores the processed image data in the memory Write to 30.

  Reference numeral 40 denotes an exposure control means for controlling the shutter 12 having a diaphragm function, and has a flash light control function in cooperation with the flash 48.

  Reference numeral 42 denotes focus control means for controlling the focal position of the taking lens 10, reference numeral 44 denotes zoom control means for controlling zooming of the taking lens 10, and reference numeral 46 denotes barrier control means for controlling the operation of the protection means 102 serving as a barrier. A flash 48 has an AF auxiliary light projecting function and a flash light control function. The exposure control means 40 and the focus control means 42 are controlled using a TTL (Through The Lens) method. The system control circuit 50 controls the exposure control means 40 and the focus control means 42 based on the result of calculation performed on the image data captured by the image processing circuit 20.

  A system control circuit 50 controls the entire digital camera 100, and a memory 52 stores constants, variables, programs, and the like for operation of the system control circuit 50.

  Reference numeral 54 denotes a display unit such as a liquid crystal display device or a speaker that displays an operation state, a message, and the like using characters, images, sounds, and the like in accordance with execution of a program in the system control circuit 50. The display unit 54 is installed in a single or a plurality of positions near the operation unit of the digital camera 100 so as to be easily visible, and is configured by a combination of, for example, an LCD, an LED, and a sounding element. The display unit 54 has a part of its function installed in the optical viewfinder 104. Among the display contents of the display unit 54, what is displayed on the LCD or the like includes single shot / continuous shooting display, self-timer display, compression rate display, number of recorded pixels, number of recorded pixels, number of remaining images that can be captured, shutter There are speed display, aperture value display, and exposure compensation display. Furthermore, flash display, red-eye reduction display, macro shooting display, buzzer setting display, clock battery level display, battery level display, error display, information display with multiple digits, display / removal status display of external recording medium 120, There are communication I / F operation display, date / time display, and the like. Among the display contents of the display unit 54, what is displayed in the optical viewfinder 104 includes in-focus display, camera shake warning display, flash charge display, shutter speed display, aperture value display, exposure correction display, and the like.

  Reference numeral 56 denotes an electrically erasable / recordable nonvolatile memory such as an EEPROM.

  Reference numerals 60, 62, 64, 66, 68, and 70 are operation means for inputting various operation instructions of the system control circuit 50. A single unit such as a switch, a dial, a touch panel, pointing by line-of-sight detection, a voice recognition device, etc. Consists of multiple combinations. Here, a specific description of these operating means will be given.

  Reference numeral 60 denotes a mode dial switch, which can switch and set various function modes such as power-off, automatic shooting mode, shooting mode, panoramic shooting mode, playback mode, multi-screen playback / erase mode, and PC connection mode.

  Reference numeral 62 denotes a shutter switch SW1, which is turned on during the operation of a shutter button (not shown), and performs AF (auto focus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, EF (flash pre-flash) processing, and the like. Instruct to start operation.

  A shutter switch SW2 64 is turned on when the operation of a shutter button (not shown) is completed. When the shutter SW2 64 is turned on, an exposure process for writing the image data to the memory 30 via the A / D converter 16 and the memory control circuit 22 is performed on the signal read from the image sensor 14, and the image processing circuit 20 and the memory control circuit The development processing using the calculation at 22 is performed. Further, a series of processing is performed in which the image data is read from the memory 30, compressed by the compression / decompression circuit 32, and written to the external recording medium 120 or 210.

  Reference numeral 66 denotes an image display on / off switch, which can set the image display unit 28 on / off. With this function, when taking an image using the optical viewfinder 104, it is possible to save power by cutting off the current supply to the image display unit 28 such as an LCD.

  Reference numeral 68 denotes a quick review on / off switch, which sets a quick review function for automatically reproducing image data taken immediately after photographing. In this embodiment, in particular, it is assumed that a function for setting a quick review function when the image display unit 28 is turned off is provided.

  An operation unit 70 includes various buttons, a touch panel, and the like, and includes a menu button, a set button, a macro button, a multi-screen playback page break button, a flash setting button, and a single shooting / continuous shooting / self-timer switching button. Further, menu movement + (plus) button, menu movement-(minus) button, playback image movement + (plus) button, playback image-(minus) button, shooting image quality selection button, exposure compensation button, date / time setting button And a subject all display button to be described later.

  Reference numeral 80 denotes power supply control means, which includes a battery detection circuit, a DC-DC converter, a switch circuit for switching a block to be energized, and the like. This power supply control means 80 detects the presence / absence of a battery, the type of battery, and the remaining battery level, controls the DC-DC converter based on the detection result and instructions from the system control circuit 50, and requires the necessary voltage. It is supplied to each part including the recording medium for a long period.

  Reference numeral 82 denotes a connector, 84 denotes a connector, and 86 denotes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like.

  Reference numeral 90 denotes a card controller that transmits and receives image data to and from an external recording medium such as a memory card, 91 denotes an interface with the external recording medium such as a memory card, and 92 denotes a connector that connects to the external recording medium such as a memory card. Reference numeral 98 denotes recording medium attachment / detachment detection means for detecting whether or not the external recording medium 120 is attached to the connector 92.

  In the present embodiment, the interface or the connector for attaching the recording medium may have a single or a plurality of systems, any number of systems. Moreover, it is good also as a structure provided with combining the interface and connector of a different standard. The interface and the connector may be configured using a PCMCIA card, a CF (Compact Flash (registered trademark)) card, or the like based on a standard.

  Furthermore, the interface 91 and the connector 92 can be configured using a PCMCIA card or other standard. In this case, by connecting various communication cards such as a LAN card and a modem card, it is possible to transfer image data and management information attached to the image data to / from peripheral devices such as other computers and printers. Other communication cards such as a USB card, an IEEE 1394 card, a P1284 card, a SCSI card, and a PHS can be considered.

  Reference numeral 101 denotes a face detection unit as a region detection unit that detects a target object (a human face in the present embodiment). The image data processed by the image processing circuit 20 and the image data stored in the image display memory 24 are analyzed to detect a region that is considered to be a face in the image data. In the face detection unit, when a region that seems to be a face is detected, the probability that the face is likely to be a human face, the position in the input image data, the size, and the like are output. It is also possible to output the feature amount of each feature point of the detected face.

  Reference numeral 102 denotes protection means that is a barrier that prevents the imaging unit from being soiled or damaged by covering the imaging unit including the taking lens 10 of the digital camera 100.

  Reference numeral 104 denotes an optical viewfinder, which can take an image using only the optical viewfinder without using the electronic viewfinder function of the image display unit 28. In the optical viewfinder 104, some functions of the display unit 54, for example, a focus display, a camera shake warning display, a flash charge display, a shutter speed display, an aperture value display, an exposure correction display, and the like are installed.

  Reference numeral 120 denotes an external recording medium such as a memory card.

  FIG. 2 is a flowchart of a person photographing mode in the digital camera of the present invention. The portrait shooting mode is a shooting mode that can be selected by setting a shooting mode setting switch included in the operation member 70 or a GUI menu.

  In step 201, the user can select a face auto mode (described later with reference to FIG. 3) and a face selection mode (described later with reference to FIG. 4) as the person photographing mode. In the face auto mode, the face detection unit 101 automatically determines a face region to be the main subject from the face region detected by the face detection unit 101 by processing described later. On the other hand, in the face selection mode, the user can select the face area as the main subject from the face areas detected by the face detection unit 101. The selection of the face auto mode and the face selection mode can be made by using a setting switch included in the operation member 70 or a GUI menu.

  In steps 202 and 203, the main subject is set in a mode selected by a method described later, and the current main subject can be recognized by the respective display methods for the face area including the main subject.

  If it is determined in step 204 that SW1 of the shutter switch 62 is pressed, the process proceeds to step 205. If not, the process returns to step 201.

  In step 205, AE processing is performed so that the exposure of the face of the person included in the set face area as the main subject is appropriate.

  In step 206, AF processing is performed on the face area that is the main subject that has been set, and control is performed so that the face of a person included in the face area is focused.

  If SW2 of the shutter switch 64 is pressed in step 207, a photographing process is performed in step 208, and the image data photographed in step 208 is recorded on the external recording medium 120 in step 209. As described above, in the person shooting mode, the person who is the main subject can be shot beautifully.

  FIG. 3 is a flowchart showing main subject selection processing in the face auto mode.

  In step 301, a face area is detected from image data stored in the image display memory 24 using the face detection unit 101. When there are a plurality of areas that are regarded as faces in the image data, all areas that are regarded as faces are detected.

  In step 302, main subject selection processing is performed for selecting a face region that seems to be suitable as the main subject from the plurality of face regions detected in step 301. As the main subject selection process, for example, an evaluation value is calculated for each face area detected by the face detection unit 101, and the face area having the highest evaluation value is selected as the main subject. Further, even if the highest evaluation value does not exceed a predetermined threshold value, there may be no main subject. Further, the main subject may be selected by a method other than the evaluation value.

  As a method for calculating the evaluation value, it is conceivable that the evaluation value is set high with respect to a method having a high probability of being considered to be a human face. Alternatively, the evaluation value is set high when the detection position of the face area is close to the center of the image data, the evaluation value is set high when the detection size of the face area is large, or another face detected in the face area A method of setting an evaluation value according to a correlation position with a region can be considered. An evaluation value is set by using at least one of these or multiplying a plurality of them.

  In step 303, the index is superimposed on the image being displayed on the image display unit 28 so that the user can recognize the face area that is the main subject selected in step 302. An example of the display is shown in FIG.

  FIG. 7 is a display example by the image display unit 28 when five persons are included in the angle of view.

  Here, the face region which is the main subject selected in step 302 is displayed in a black line bracket. In addition, other face regions that are not main subjects but have a high evaluation value are displayed in gray brackets so that the display format is different from that of the main subject. If the face area that is not the main subject is displayed too much, there is a possibility that the composition setting or the like will be hindered, and the load on the display processing will increase, which may affect the response of the operation. For this reason, in the present embodiment, the maximum number of parenthesis frames displayed at the same time is three (one of which is a black line parenthesis frame indicating the main subject), but the number may be less than this, and only the main subject is displayed. It doesn't matter. Then, as shown in FIG. 2, the processing shown in FIG. 3 is repeated until the SW1 of the shutter switch 62 is pressed.

  As a result, in the face auto mode, the face area to be the main subject automatically determined by the digital camera 100 among the plurality of faces is presented to the user, and the user has recognized the face of the person to be the main subject. You can shoot above.

  Next, the face selection mode will be described. In the face selection mode, since the user selects a desired face, a parenthesis frame is displayed only for the face area as the main subject. An example of this display is shown in FIG.

  In FIG. 8, in order to differentiate from the face auto mode, a double black bracket frame is displayed only on the current main subject. In addition, when there are other face areas that can be selected, an arrow indicating that the parenthesis frame can be switched to the left or right is also displayed. In the face selection mode, normally, only the face area is displayed from the viewpoint that the user selects a desired face area and is not interested in other face areas.

  FIG. 4 is a flowchart showing main subject selection processing in the face selection mode.

  In step S <b> 401, the face detection unit 101 is used to detect a face area from image data stored in the image display memory 24.

In step S <b> 402, it is determined whether or not the subject all display button included in the operation member 70 is operated by the user. If it is operated by the subject more button, the process proceeds to step S40 9 as a request to display all face detection results is made, if not operated, the process proceeds to step S403.

  In step S403, if the face area selected by the digital camera 100 is not the user's desired face area, the user switches the face area using a face selection button such as a left / right button included in the operation member 70, and the user Can select a subject to be photographed. If the user has not yet selected a face area, the process proceeds to step S405. When the process of step S403 is performed for the first time, the process of selecting the face area as the main subject has not yet been performed, and thus the process proceeds to step S405.

  In step S405, one of the detected faces is selected as the main subject, and a double black bracket frame is displayed on the selected face. For example, as a default, as in the face auto mode, the face located at the center of the screen is selected as the temporary main subject, and the process proceeds to step S406.

  In step S406, a double black bracket frame is displayed on the face selected as the main subject. At this time, no parenthesis frame is displayed for any other face.

  In step S407, it is determined whether a face selection button such as a left / right button has been operated by the user in a situation where a double black bracket frame is displayed on any face. If the left and right buttons have been operated, the face adjacent to either the left or right is selected as the main subject in order according to the operation of the left and right buttons, and the process proceeds to step S408. If the face selection button has not been operated by the user, this flow is finished assuming that a face area according to the user's intention is selected. For example, when the left button is operated, the coordinate of the center position of the face in the horizontal direction is located on the left side of the face area that is the current main subject, and the coordinate in the horizontal direction is the current main subject. A face area closest to a certain face area is selected as a new main subject. Here, the faces that can be selected as the main subject are limited to the faces that can be detected in step S401. Even if there are seven faces in the angle of view, only five faces can be selected in step S401. If it cannot be detected, there are five faces that can be selected as the main subject.

  In step S408, the double black bracket frame display is moved to the face area newly selected as the main subject. A display example of the image display unit 28 at this time is shown in FIG. In this way, in the face auto mode, the face area located at the edge of the screen that is unlikely to be selected as the main subject can be selected as the main subject.

  As described above, in the face selection mode, an arbitrary face area is switched to the main subject by sequentially switching the face area to the face area close to the direction in accordance with the face selection button such as the left / right button designated by the user. Can be selected.

  Returning to step S403, if any face area has already been selected as the main subject after passing through steps S405, S406, or S407, the process proceeds to step S404.

  In step S404, the face detection result of the face area selected as the previous main subject is compared with the latest face detection result in order to continuously display the parenthesis frame on the face as the main subject selected by the user. Then, the most relevant face area is selected from the plurality of face areas obtained from the latest face detection result. As a comparison method, a method of selecting the most similar feature amount detected by the face detection unit 101 can be considered. Alternatively, the history of the movement of the display position of the face bracket frame up to the previous time is saved, and the face area detected at the position closest to the position estimated from the history is selected, or simply the most recent display position and A method of selecting a face area with a short moving distance is conceivable. Alternatively, if the face detection unit 101 can also perform personal authentication, a method of selecting the same person as the person previously selected as the main subject using the personal authentication result is also conceivable. Then, a double black bracket frame is displayed for the selected face area, and the process proceeds to steps S406 and S407.

  As described above, in step S407, it is possible to select a face on which a double black bracket frame is displayed, but the face is displayed even though there are a plurality of persons on the image display unit 28. Only a double black bracket frame superimposed on the main subject is displayed as an index indicating that it has been detected. Even in situations where a person who faces the front under normal ambient light can recognize a face, for example, the face orientation, face tilt, face size on the screen, overall screen brightness, face part The detection rate varies greatly depending on conditions such as the brightness of the camera and the presence or absence of sunglasses. There is also a limit to the number that can be detected. Therefore, there may be a face that has not been detected in step S401, and not all the faces that actually exist in step S407 can be selected as the main subject. Therefore, there is a problem that it is difficult for the user to grasp which face area is selected next until the face selection button is actually pressed. Therefore, it may be desirable to provide the user with means for displaying selectable face area candidates.

  Therefore, when it is determined in step S402 that the subject all display button included in the operation member 70 is operated by the user, the process proceeds to step S409. In step S409, the parenthesis frame display is performed for all the face areas detected by the face detection unit 101 in step S401 only while the all subject display button is operated. A display example at that time is shown in FIG.

  In FIG. 10, among the detected face areas, a black line bracket frame is displayed in the face area which is the main subject, and a gray line bracket frame is displayed in all other face areas. In FIG. 10, parenthesis frames are displayed for all face areas, but this gray line bracket frame is not displayed for the face areas that failed to be detected in step S401. That is, by performing the display as shown in FIG. 10, the user can quickly recognize which face area can be selected. In addition, when displaying the parenthesis frame on all detected faces as shown in FIG. 10, the number of detections may be displayed simultaneously so that the number of detected faces can be immediately recognized. If the user has selected the main subject, the selected face area is set as the main subject. If the user has not selected the main subject, the main subject is selected by the same method as in step S405. May be. In addition, a parenthesis frame that can be recognized as the main subject is not provided, and a similar form of index may be displayed for all detected face regions.

  Then, as shown in FIG. 2, the processing shown in FIG. 4 is repeated until SW1 of the shutter switch 62 is pressed.

  As described above, according to the present embodiment, if there is no instruction from the user, there is a limit to the number of parenthesis frames indicating the face detection results in view of screen visibility and image processing load reduction. It is On the other hand, when instructed by the user, the user can select which subject by providing a function of displaying a parenthesis frame for all the temporarily detected faces. It can be recognized at a glance. By changing the upper limit of the number of indicators to be displayed in this way, it is possible to check the list of selectable face areas as necessary while reducing the visibility of images and the load of image processing. Become.

  In addition, when there is an instruction from the user, it is possible to display in step S409 more than the upper limit number of parenthesis frames that can be displayed in step S406 without necessarily displaying the parenthesis frames for all detected face regions. It is good also as a structure which increases the upper limit number of parenthesis frames. Even in this configuration, it is possible to provide an effect that more selectable face regions can be confirmed as necessary.

(Second Embodiment)
FIG. 5 is a flowchart showing main subject selection processing in the face auto mode according to the second embodiment of the present invention. This embodiment is different in that detection results of all face areas can be displayed in the face auto mode and detection results of all face areas can be continuously displayed in the face selection mode.

  In step S 501, the face detection unit 101 is used to detect a face area from the image data stored in the image display memory 24. When there are a plurality of areas that are regarded as faces in the image data, all areas that are regarded as faces are detected. In the first embodiment, all face detection results are displayed only while the subject all display button included in the operation member 70 is operated. However, in this embodiment, every time the subject all display button is operated. Assume that the subject display button can be switched on and off.

  In step S502, main subject selection processing is performed for selecting a face region that is considered suitable as the main subject from the plurality of face regions detected in step S501. As the main subject selection process, a method similar to step S302 of FIG. 3 described in the first embodiment can be considered.

  In step S503, if the all-subject display button included in the operation member 70 is turned on, the process proceeds to step S505 if a request to display all face detection results is made, and if the all-subject display button is not turned on. The process proceeds to step S504.

  In step S504, as shown in FIG. 7, the face area that is set as the main subject in step S502 is displayed in a black line bracket, and the other face areas that are not the main subject but have a high evaluation value are gray lines. It is displayed in brackets. In this case, a maximum of two gray line brackets are displayed. Then, this flow ends.

  In step S505, as shown in FIG. 10, the face area that is the main subject in step S502 is displayed in a black line bracket frame, and all the remaining detected face areas are displayed in a gray line bracket frame. ing. Unlike step S504, in this step, there is no limit on the number of displays in the brackets of gray lines. Then, this flow ends.

  FIG. 6 is a flowchart showing main subject selection processing in the face selection mode according to this embodiment.

  Steps S601 through S608 perform the same processing as steps S401 through S408 in FIG. What differs from the first embodiment is the processing of steps S609 and S610.

  If it is determined in step S602 that the all subject display button included in the operation member 70 is turned on by the user, the process proceeds to step S609.

  In step S609, it is determined whether or not a parenthesis frame is already displayed for all face areas detected by the face detection unit 101. If not, the process proceeds to step S610.

  In step S610, parenthesis frame display is performed for all face areas detected by the face detection unit 101 in step S601, and the process proceeds to step S607. A display example at that time is shown in FIG. In FIG. 10, among the detected face areas, a black line bracket frame is displayed in the face area which is the main subject, and a gray line bracket frame is displayed in all other face areas.

  If it is determined in step S609 that parenthesis frames are already displayed for all face regions detected by the face detection unit 101, the process proceeds to step S607 without updating the display of the parenthesis frames. This is because if the detection results of all face areas are updated each time the face detection unit 101 detects a face, the screen becomes difficult to see when many bracket frames are displayed. Therefore, when displaying the detection results of all face areas, the parenthesis frame is temporarily fixed when instructed by the user, and the parenthesis frame is compared with the case where the all subject display button is not turned on. By setting a long update cycle, the appearance is not impaired.

  In step S607, if a face selection button such as a left / right button is operated by the user, a face corresponding to the operation is selected as a main subject and a double black bracket frame is displayed. The display shown in 10 is continued.

  As described above, according to the present embodiment, when displaying the parenthesis frame indicating the main subject using the face detection result, the parenthesis frame is displayed in consideration of the ease of viewing the screen and the reduction of the image processing load. There is a limit to the number to be played. On the other hand, when the user gives an instruction, which subject can be selected by the user by providing a function to display a parenthesis frame for all temporarily detected faces. Can be recognized at a glance.

  Further, when displaying a parenthesis frame for all the detected faces, the visibility of the screen is ensured by limiting the update frequency of the parenthesis frame.

  In each of the above embodiments, a parenthesis frame surrounding the face area is shown as an index indicating the face area. However, the display form of the frame is not limited to this, and may be a circle or an octagon. Also, apply color processing to areas other than the face area, apply a low-pass filter, apply color processing to the face area, apply a low-pass filter, and enhance contrast. You may perform the process which can identify a face area | region. Furthermore, since the present invention can be applied to any configuration that detects a plurality of target objects from image data and indicates the detected area, the detection target does not necessarily have to be a human face. For example, as a detection target other than a human face, a specific animal, a specific vehicle type, a specific car number, an object having a specific shape and color, and the like can be considered. Further, a configuration may be adopted in which a person's face is analyzed in more detail and a person is recognized to detect a specific individual.

  Further, the configuration for carrying out the present invention is not limited to a single imaging apparatus. For example, it may be a personal computer or the like that is connected to an imaging device such as a digital camera or a video camera and displays an index indicating the face area on the display unit using image data transmitted from the imaging device.

  That is, as long as it functions as an image processing apparatus that detects an area including a target object from an image and displays an indicator for recognizing the area superimposed on the image data It is possible to implement the present invention.

  Next, a program for realizing the functions of the above-described embodiment will be described.

  Software program codes (programs) that operate various devices so as to realize the functions of the above-described embodiments, and realize the functions of the above-described embodiments for a computer in an apparatus or system connected to the various devices. ).

  Further, the present invention can also be implemented by operating the various devices described above in accordance with an image processing program (software or hardware) stored in a computer (CPU or MPU) of the system or apparatus. Included in the category.

  In this case, the image processing program itself of the software realizes the functions of the above-described embodiment.

  The image processing program itself and means for supplying the program code of the image processing program to a computer, for example, a storage medium storing such a program are also included in the scope of the present invention.

  As a storage medium for storing such an image processing program, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

  In addition, the functions of the above-described embodiments are not only realized by the computer executing the supplied image processing program.

  For example, even when the image processing program realizes the functions of the above-described embodiment in cooperation with an OS (operating system) or other application running on the computer, the image processing program is not limited to the present invention. Included in the category.

  Further, the supplied image processing program is stored in a memory provided in a function expansion board of the computer or a function expansion unit connected to the computer.

  The CPU of the function expansion board or function expansion unit performs part or all of the actual processing based on the instruction of the image processing program, and the functions of the above-described embodiments are realized by the processing. Such an image processing program is included in the category of the present invention.

It is a block diagram of an imaging device in an embodiment of the present invention. It is a flowchart of the person photographing mode in the embodiment of the present invention. It is a flowchart which shows the selection process of the main subject in the face auto mode in the 1st Embodiment of this invention. It is a flowchart which shows the selection process of the main subject in the face selection mode in the 1st Embodiment of this invention. It is a flowchart which shows the selection process of the main subject in the face auto mode in the 2nd Embodiment of this invention. It is a flowchart which shows the selection process of the main subject in the face selection mode in the 2nd Embodiment of this invention. It is a display example of the parenthesis frame which shows the face area | region in the face auto mode in embodiment of this invention. It is a display example of the parenthesis frame which shows the face area | region in the face selection mode in embodiment of this invention. It is the example of a display after the movement of the parenthesis frame which shows the face area | region in the face selection mode in embodiment of this invention. It is a display example of the parenthesis frame which shows a face area | region when the to-be-photographed object display button in embodiment of this invention is operated.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Shooting lens 12 Shutter 14 Image pick-up element 16 A / D converter 18 Timing generation circuit 20 Image processing circuit 22 Memory control circuit 24 Image display memory 26 D / A converter 28 Image display part 30 Memory 32 Image compression / decompression circuit 40 Exposure Control means 42 Focus control means 44 Zoom control means 46 Barrier control means 48 Flash 50 System control circuit 52 Memory 54 Display unit 56 Non-volatile memory 60 Mode dial switch 62 Shutter switch SW1
64 Shutter switch SW2
66 Image display on / off switch 68 Quick review on / off switch 70 Operation unit 80 Power supply control means 82 Connector 84 Connector 86 Power supply means 90 Card controller 91 Interface 92 Connector 98 Recording medium attachment / detachment detection means 100 Digital camera 101 Face detection part 102 Protection Means 104 Optical finder 120 External recording medium

Claims (7)

Area detecting means for detecting an area including a target object from image data;
Display means for displaying an index for recognizing the area detected by the area detection means in an superimposed manner on an image generated from the image data;
The display means displays the index for the upper limit number of areas when the number of areas detected by the area detection means is larger than a predetermined upper limit, and is displayed by a user. If it is determined that a predetermined operation has been performed, from the state in which the index is displayed for the upper limit number of areas, all areas detected by the area detection means are detected at most than the upper limit number. On the other hand, the image processing apparatus is switched to a state in which the index is displayed.   The image processing apparatus according to claim 1, wherein the display unit displays the number of all the regions together with the index for all the regions detected by the region detecting unit.   When the display means displays the index for all the areas detected by the area detection means, the display means displays the index for a part of the areas detected by the area detection means. The image processing apparatus according to claim 2, wherein the update period of the index is set to be longer by comparison. The display means displays an index indicating that it is a main area with respect to any of the plurality of areas detected by the area detecting means,
In accordance with an operation by the user, the main area is changed to another area detected by the area detection means,
When the display means is in a state in which the change of the area by the change means can be accepted, all of the areas detected by the area detection means are detected in response to a predetermined operation by the user at a number greater than the upper limit. The image processing apparatus according to claim 1, wherein the index is displayed for a region. An image sensor for generating the image data from an optical image transmitted through the photographing lens, and a focus control means for controlling a focal position of the photographing lens;
The image processing apparatus according to claim 1, wherein the focus control unit performs control based on a calculation result with respect to the image data in the region detected by the region detection unit. A detection step in which the region detection unit detects a region including the target object from the image data, and an index for enabling the display unit to recognize the detected region is generated from the image data. A display step of superimposing and displaying on the image;
In the display step, the display means displays the index for the upper limit number of areas when the number of areas detected by the area detection means is larger than a predetermined upper limit. When it is determined that the user has performed a predetermined operation, the area detecting unit detects at least the upper limit number from the state in which the index is displayed for the upper limit number of areas. And switching to a state in which the index is displayed for all the regions.   An image processing program causing an image processing apparatus to execute the control method according to claim 6.

Images