JP5580623B2 - Image processing apparatus, image processing apparatus control method, program, and storage medium - Google Patents

Description

  The present invention relates to an image processing apparatus, a control method for the image processing apparatus, a program, and a storage medium.

  In recent years, various techniques related to image processing applied to an image captured by an imaging apparatus such as a digital camera have been proposed. For example, Patent Document 1 discloses a technique for statistically acquiring a tendency (imaging tendency) when an image is captured and adding retouching (correction or processing) to the image according to the imaging tendency.

JP-A-2005-72949

  However, the technique disclosed in Patent Document 1 is a technique for retouching the entire image, and this part of the image, for example, a part designated by the user (a part to be subjected to image processing) It is not a technique for performing image processing suitable for the above. In general, when image processing is performed on a part of an image, it is necessary to instruct the image processing target part and the content of the image processing to be performed on the part. Will be necessary.

  Therefore, the present invention has been made in view of such problems of the conventional technology, and an object of the present invention is to provide a new technology capable of easily performing image processing on an image.

In order to solve the above problems, an image processing apparatus according to one aspect of the present invention, specifying means for specifying a processing part that performs a display control means for displaying an image on a display screen of the display device, the image processing before Symbol image A determination means for determining whether or not a face is included in the processing portion from image characteristics of the processing portion specified by the specification means; and a plurality of image processing determined based on the determination result of the determination means from a determining means for determining an image processing performed in said processing section, the image processing determined by said determining means have a, a processing unit for performing the processing portion, does not include a face by the determining means When the same processing portion determined to be specified multiple times, the determination means performs a plurality of processes determined based on the determination result of the determination means so that different processing is performed for each specification. From the image processing, and determines the image processing performed in said processing section.

  Further objects and other aspects of the present invention will become apparent from the preferred embodiments described below with reference to the accompanying drawings.

  According to the present invention, for example, a new technique for easily performing image processing on an image can be provided.

It is a figure which shows the imaging device which functions as an image processing device as one aspect of the present invention. 3 is a flowchart for explaining an image processing operation in the imaging apparatus shown in FIG. 1. FIG. 3 is a diagram illustrating a display example of an image displayed on the display screen of the display unit of the imaging apparatus illustrated in FIG. 1 in the image processing operation illustrated in FIG. 2. FIG. 2 is a diagram illustrating an example of a table (a table indicating a relationship between attribute information and image processing) stored in a memory of the imaging apparatus illustrated in FIG. 1. 6 is a flowchart for explaining another image processing operation in the imaging apparatus shown in FIG. 1. FIG. 2 is a diagram illustrating an example of a table (a table indicating a relationship between attribute information and image processing) stored in a memory of the imaging apparatus illustrated in FIG. 1. FIG. 6 is a diagram illustrating a display example of an image displayed on the display screen of the display unit of the imaging apparatus illustrated in FIG. 1 in the image processing operation illustrated in FIG. 5.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments of the invention will be described with reference to the accompanying drawings. In addition, in each figure, the same reference number is attached | subjected about the same member and the overlapping description is abbreviate | omitted.

  FIG. 1 is a diagram illustrating an imaging apparatus 100 that functions as an image processing apparatus according to an aspect of the present invention. FIG. 1A is a schematic external view of the imaging apparatus 100, and FIG. 2 is a schematic block diagram showing the configuration of the device 100. FIG. The imaging apparatus 100 is an imaging apparatus that captures an image of a subject, and is embodied as a digital camera in the present embodiment. The imaging device 100 also displays a display device that displays (reproduces) an image corresponding to image data generated by imaging a subject or image data recorded on the recording medium 200, and image processing that performs image processing on the displayed image. It also functions as a device. Here, the recording medium 200 is composed of, for example, a memory card or a hard disk, and records various data. The recording medium 200 is accommodated in the slot of the imaging apparatus 100, so that communication with the imaging apparatus 100 is possible via an interface (I / F).

  As shown in FIGS. 1A and 1B, the imaging apparatus 100 includes an imaging optical system 102, a shutter unit 104, an imaging unit 106, a barrier unit 108, an A / D conversion unit 110, An image processing unit 112, a memory 114, a D / A conversion unit 116, and a display unit 118 are included. In addition, the imaging apparatus 100 includes a memory control unit 120, a nonvolatile memory 122, a system control unit 124, a system memory 126, a mode change switch 128, a shutter button 130, a cross button 132, and a wheel 134. Have. Furthermore, the imaging apparatus 100 includes a power switch 136, a power control unit 138, and a power unit 140.

  The imaging optical system 102 includes an imaging lens, a focus lens, and the like, and focuses light from the subject on the imaging surface of the imaging unit 106 (that is, forms an optical image). In this embodiment, the shutter unit 104 has a diaphragm function. The imaging unit 106 includes a CCD, a CMOS element (photoelectric conversion element), and the like, and converts an optical image formed by the imaging optical system 102 into an electrical signal. The barrier unit 108 covers the imaging system including the imaging optical system 102, the shutter unit 104, and the imaging unit 106, and prevents dirt from being attached to the imaging system and damage to the imaging system. The A / D conversion unit 110 has a function of converting an analog signal into a digital signal. In the present embodiment, the A / D conversion unit 110 converts the analog signal output from the imaging unit 106 into a digital signal.

  The image processing unit 112 has a function of performing image processing on an image (the entire image or a part of the image). For example, the image processing unit 112 performs resizing processing such as pixel interpolation and reduction, and color conversion processing on data input from the A / D conversion unit 110 or data input from the memory control unit 120. The image processing unit 112 performs predetermined calculation processing using the captured image and outputs the calculation result to the system control unit 124. The system control unit 124 performs exposure control and focus detection control based on the calculation result from the image processing unit 112. As a result, TTL (through the lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are performed. In addition, the image processing unit 112 performs predetermined calculation processing using the captured image, and also performs TTL AWB (auto white balance) processing based on the calculation result. Further, the image processing unit 112 performs a predetermined calculation process using the captured image, and based on the calculation result, selects the type of imaging scene (for example, blue sky, evening scene, snow, night scene) at the time of imaging. judge. Note that the type (information) of the imaging scene determined by the image processing unit 112 is an attribute obtained when the image is captured, along with the imaging conditions used when capturing the image (for example, whether the flash is emitted). Information is recorded in the image data.

  The memory 114 stores data output from the A / D conversion unit 110 via the image processing unit 112 and the memory control unit 120 or via the memory control unit 120. For example, the memory 114 is displayed from the image data (still image data or moving image data) output from the imaging unit 106 and converted into a digital signal by the A / D conversion unit 110 or the display unit 118 (that is, image display). Image data). Accordingly, the memory 114 has a storage capacity capable of storing a predetermined number of still image data, moving image data and audio data for a predetermined time. The memory 114 also functions as an image display memory (video memory).

  The D / A conversion unit 116 converts image data for image display stored in the memory 114 into an analog signal and supplies the analog signal to the display unit 118. The display unit 118 has a display screen composed of a display element such as an LCD, and displays an image corresponding to the analog signal supplied from the D / A conversion unit 116 and various types of information related to the imaging device 100.

  The memory control unit 120 controls data (such as image data) stored in the memory 114 and data read from the memory 114. The nonvolatile memory 122 is a memory that can electrically erase and record data, and includes, for example, an EEPROM. The non-volatile memory 122 stores constants and programs for operating the system control unit 124 (programs for executing various flowcharts described later) and the like.

  The system control unit 124 controls the entire imaging apparatus 100. The system control unit 124 executes a program stored in the nonvolatile memory 122 to realize each process of the present embodiment. For example, the system control unit 124 performs display control by controlling the memory 114, the D / A conversion unit 116, the display unit 118, and the like. The system memory 126 is composed of, for example, a RAM, and expands constants and variables for operation of the system control unit 124, a program read from the nonvolatile memory 122, and the like.

  A plurality of switches and buttons including a mode change switch 128, a shutter button 130, a cross button 132, a wheel 134, a power switch 136, and the like receive an operation of a user (input various operation instructions to the system control unit 124). Function as. A plurality of switches and buttons constituting the operation unit are function buttons such as an end button, a return button, an image feed button, a jump button, and a narrowing button, for example, according to various screens displayed on the display screen of the display unit 118. Function. For example, when a menu button is pressed, a menu screen that allows various settings is displayed on the display screen of the display unit 118. Thereby, the user uses the menu screen displayed on the display screen of the display unit 118 and the cross button 132 and the set button including the upper button, the lower button, the left button, and the right button arranged in a cross shape. Various settings can be made intuitively. The operation unit includes a display screen of the display unit 118 and a touch pad (position input unit) provided on the display screen, and includes a touch panel that can detect a user operation on the touch pad. Note that various types of touch panels such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method can be used as the touch panel.

  The mode switch 128 is a switch for switching the operation mode of the imaging apparatus 100 (system control unit 124). In the present embodiment, the operation mode of the image capturing apparatus 100 can be switched to a still image capturing mode, a moving image capturing mode, a playback mode, an image processing mode, and the like.

  The shutter button 130 is a button for instructing imaging of a subject, and includes a first shutter switch 130a and a second shutter switch 130b. The first shutter switch 130 a is turned on in the middle of the operation of the shutter button 130 (half-pressed), generates the first shutter switch signal SW <b> 1, and supplies it to the system control unit 124. The system control unit 124 starts AF processing, AE processing, EF processing, and the like in response to the first shutter switch signal SW1 supplied from the first shutter switch 130a. The second shutter switch 130b is turned on when the operation of the shutter button 130 is completed (fully pressed), generates the second shutter switch signal SW2, and supplies the second shutter switch signal SW2 to the system control unit 124. Note that the system control unit 124 performs a series of imaging operations from reading a signal from the imaging unit 106 to recording image data on the recording medium 200 by the second shutter switch signal SW2 supplied from the second shutter switch 130b. Start processing.

  The wheel 134 is a rotatable member and is used together with the cross button 132 when instructing a selection item displayed on the display screen of the display unit 118. The wheel 134 generates an electrical pulse signal according to the amount of rotation and supplies it to the system control unit 124. The system control unit 124 controls each unit of the imaging apparatus 100 based on the pulse signal supplied from the wheel 134. The wheel 134 may be any member as long as it can detect the rotation operation by the user. For example, the wheel 134 may be a dial member that generates a pulse signal by rotating the wheel itself in response to a rotation operation by the user, or the wheel itself does not rotate and detects the rotation operation on the wheel by the user. It may be a touch wheel.

  The power switch 136 is a switch for switching the power state of the imaging apparatus 100 to a power ON state or a power OFF state. The power supply control unit 138 includes a battery detection circuit, a DC-DC converter, a switch circuit that switches a block to be energized, and the like, and detects whether or not the battery is installed in the power supply unit 140, the type of battery, and the remaining capacity of the battery. Further, the power supply control unit 138 controls the DC-DC converter based on the detection result in the power supply unit 140 and the instruction from the system control unit 124, and the necessary voltage is applied to the imaging apparatus 100 including the recording medium 200 for a necessary period. Supply to each part. The power supply unit 140 detachably holds a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery or a Li battery, or an AC adapter, and outputs a voltage (DC voltage).

  In the imaging apparatus 100, it is possible to image a subject using the central one-point AF and the face AF. The central one-point AF is to perform AF on one point at the central position in the imaging screen, and the face AF is AF to a human face in the imaging screen detected by the face detection process. Is to do. Further, the imaging apparatus 100 can perform the face AE, the face FE, and the face WB simultaneously with the face AF. The face AE is to optimize the exposure of the entire imaging screen according to the brightness of the face detected by the face detection process. The face FE is to perform flash light control around the face detected by the face detection process. The face WB is to optimize the WB of the entire imaging screen in accordance with the face color detected by the face detection process.

  Here, the face detection process will be briefly described. In the face detection process, first, the system control unit 124 inputs image data to be detected to the image processing unit 112. The image processing unit 112 detects edge components from the image data by applying a horizontal bandpass filter and a vertical bandpass filter to the input image data under the control of the system control unit 124. The system control unit 124 performs pattern matching on the edge component detected by the image processing unit 112 and extracts a candidate group of eyes, nose, mouth, and ears. In addition, the system control unit 124 determines that an eye that satisfies a preset condition (for example, the distance or inclination of two eyes) among the extracted candidate groups is an eye and narrows it down as an eye candidate group. Further, the system control unit 124 associates the narrowed-down eye candidate group with other patterns of the face (nose, mouth, ears) corresponding thereto, and applies a preset non-face condition filter to apply the face. To detect. Then, the system control unit 124 generates face information according to the face detection result, and ends the face detection process. Note that the face information includes, for example, the number, position, size, and the like of faces, and is stored in the memory 114 or the recording medium 200 in association with image data (image).

  As described above, the imaging apparatus 100 analyzes image data corresponding to an image displayed (reproduced) on a live view display or the display screen of the display unit 118, and detects a feature amount of image data such as face information. be able to.

Further, the system control unit 124 can detect a user operation on the touch panel which is one of the operation units. Here, the user's operation is that the touch panel is touched with a finger or pen (touch down), the touch panel is touched with a finger or pen (touch on), and the finger or pen is moved while touching the touch panel. Including the move. Further, the user operation includes releasing a finger or pen that has been touching the touch panel (touch-up) and not touching the touch panel (touch-off). Operation information including the user's operation on the touch panel and the position coordinates on the touch panel touched by the finger or pen is notified to the system control unit 124 via the internal bus. Then, the system control unit 124 detects the type of user operation on the touch panel (that is, what operation has been performed) based on the notified operation information. Regarding the move, the system control unit 124 can also detect the moving direction of the finger or pen on the touch panel for each vertical component and horizontal component based on the change of the position coordinates.
<First Embodiment>
With reference to FIG. 2, the image processing operation in the imaging apparatus 100 will be described. Here, it is assumed that an image (image data) to be subjected to image processing is selected from a plurality of images (image data) recorded on the recording medium 200 and has been read into the memory 114 in advance. Note that an image subjected to image processing in the imaging apparatus 100 may be an image captured by the imaging apparatus 100 or an image captured by another imaging apparatus.

  In step S202, the system control unit 124 acquires attribute information including at least one of the imaging condition and the type of the imaging scene recorded in the image data of the image to be subjected to image processing.

  In step S <b> 204, the system control unit 124 performs face detection processing on image data of an image to be subjected to image processing in cooperation with the image processing unit 112. As a result, the face of a person included in the image to be subjected to image processing is detected, and face information including the number, position, size, and the like of the face is generated. As described above, when face detection processing is performed when an image is captured and face information is associated with the image and recorded on the recording medium 200 or the like, the system control unit 124 causes the face detection processing in S204. There is no need to perform the process, and the recorded face information may be acquired.

  In S206, the system control unit 124 superimposes a face frame representing the position of the person's face on the image to be image-processed based on the face information generated by the face detection process in S204, and displays the display screen of the display unit 118. To display. FIG. 3A is a diagram illustrating a display example of an image displayed on the display screen of the display unit 118 in S206. In the present embodiment, since three persons are included in the image IM to be subjected to image processing, three face frames FF1, FF2, and FF3 are displayed. In the present embodiment, as shown in FIG. 3A, the image IM is an image IM displayed on the display screen of the display unit 118 (that is, in order to specify a processing portion for performing image processing in the image IM (that is, the image IM). A message prompting the user to touch the image IM) on the touch panel is also displayed.

  In step S <b> 208, the system control unit 124 determines whether an image displayed on the display screen of the display unit 118 (that is, the display screen of the display unit 118) has been touched. As described above, a touch panel is configured on the display screen of the display unit 118, so that the system control unit 124 touches the user's operation on the touch panel, that is, the image displayed on the display screen of the display unit 118. Can be detected. When the image displayed on the display screen of the display unit 118 is not touched, the process waits until the image is touched (repeats S208), and the image displayed on the display screen of the display unit 118 is touched. The process proceeds to S210.

  In S210, the system control unit 124 detects a touched portion of the image displayed on the display screen of the display unit 118 based on the operation information including the touched position coordinates on the touch panel, and detects the touched portion as an image. Specify as the processing part to perform processing.

  In S212, the system control unit 124 determines whether or not the type of the processing part designated in S210 is a human face (that is, specifies the type of the processing part). If the type of the processing part is not a person's face, the process proceeds to S234. On the other hand, if the type of the processing portion is a human face, the process proceeds to S214.

  In step S <b> 214, the system control unit 124 determines whether or not the strobe light is emitted when an image to be subjected to image processing is captured. Specifically, the system control unit 124 refers to the attribute information acquired in S202, and the imaging condition included in the attribute information indicates that the strobe is emitted when the image is captured, or the strobe is not emitted. It is determined whether it represents.

  If the strobe light is emitted when the image to be processed is captured, the process proceeds to S216. If the strobe light is not emitted when the image to be processed is captured, the process proceeds to S218. In S <b> 216 and S <b> 218, the system control unit 124 determines image processing to be performed on the processing portion from a plurality of image processing predetermined for the attribute information and the type of processing portion. For example, as shown in FIG. 4A, the memory 114 stores a table representing the relationship between attribute information (imaging conditions) and image processing. The system control unit 124 stores the table shown in FIG. By referring to the table shown, image processing to be performed on the processing portion can be determined. In the present embodiment, in S216, the system control unit 124 determines the red-eye correction process as an image process to be performed on a processing portion of an image to be subjected to image processing. In step S <b> 218, the system control unit 124 determines the dark portion correction processing as image processing to be performed on the processing portion of the image to be subjected to image processing. As described above, in this embodiment, when the type of the processing portion is a person's face, the processing portion is configured so that different image processing is performed depending on whether the strobe is emitted or not when the image is captured. Determine the image processing to be performed.

  In S220, the system control unit 124 cooperates with the image processing unit 112 to perform the image processing determined in S216 or S218 on the processing portion of the image to be subjected to image processing (in this embodiment, red-eye correction processing or Dark area correction processing).

  In step S222, the system control unit 124 displays the image on which the image processing has been performed in step S220 on the display screen of the display unit 118. Note that when displaying an image that has been subjected to image processing, as shown in FIG. 3B, the description of the content of the image processing is also displayed, and the content of the image processing (for example, red-eye correction processing) is displayed by the user. It is preferable to be able to recognize. In addition, as shown in FIG. 3B, a save button for instructing to save the image that has been subjected to image processing, a return button for instructing to return to the image before the image processing is performed, and the like are also displayed. Good.

  In step S224, the system control unit 124 determines whether to save the image that has undergone image processing (the image displayed in step S222). For example, the system control unit 124 detects whether or not a save button shown in FIG. 3B is touched (that is, whether or not an image save is instructed). If it is detected that the save button has been touched, the system control unit 124 determines to save the image that has been subjected to image processing, and the image that has been subjected to image processing is stored in the recording medium 200 in S226. save. If it is not detected that the save button has been touched, the system control unit 124 determines that the image that has been subjected to image processing is not to be saved, and proceeds to S228. Note that determination as to whether or not to save an image that has been subjected to image processing is not limited to the method described above. For example, an image subjected to image processing depending on whether a specific operation (for example, tracing an image frame) is performed on the touch panel, whether the second shutter switch 130b is turned on, or the like. It may be determined whether or not to save.

  In step S <b> 228, the system control unit 124 determines whether an image displayed on the display screen of the display unit 118 (that is, an image subjected to image processing) has been touched. If the image is not touched, the process waits until the image is touched (repeats S228). If the image displayed on the display screen of the display unit 118 is touched, the process proceeds to S230.

  In S230, as in S210, the system control unit 124 detects a touched portion of the image that has been subjected to image processing, and designates this portion as a processing portion that performs image processing.

  In S232, the system control unit 124 determines whether the type of the processing part specified in S230 is a human face (that is, specifies the type of the processing part), as in S212. If the type of the processing part is not a person's face, the process proceeds to S234. On the other hand, if the type of the processing portion is a human face, the process proceeds to S214.

  In S234, the system control unit 124 determines image processing to be performed on the processing portion specified in S230 from a plurality of predetermined image processing according to the type of the imaging scene included in the attribute information acquired in S202. For example, as shown in FIG. 4B, the memory 114 stores a table representing the relationship between attribute information (type of captured scene) and image processing, and the system control unit 124 stores the table shown in FIG. ), It is possible to determine image processing to be performed on the processing portion. Referring to FIG. 4B, the system control unit 124 performs the blue enhancement process on the image to be processed when the type of the imaging scene of the image to be processed is “blue sky”. The image processing to be performed on the processing portion is determined. In addition, when the type of the imaging scene of the image to be image-processed is “evening scene”, the system control unit 124 determines the red enhancement process as the image process to be performed on the processing portion of the image to be image-processed. To do. Further, the system control unit 124 performs the contrast correction processing on the processing portion of the image to be image-processed when the type of the imaging scene of the image to be image-processed is “snow” or “night scene”. Determine as image processing.

  In S <b> 236, the system control unit 124 cooperates with the image processing unit 112 to perform the image processing (blue enhancement processing, red enhancement processing, contrast correction processing) determined in S <b> 234 on the processing portion of the image to be processed. Etc.).

  In step S238, the system control unit 124 displays the image on which the image processing has been performed in step S236 on the display screen of the display unit 118. As described above, when displaying an image on which image processing has been performed, it is preferable that the user can recognize the content of the image processing (for example, blue enhancement processing). In addition, a save button or the like for instructing to save an image that has been subjected to image processing may be displayed.

  In S240, the system control unit 124 determines whether or not to save the image that has undergone image processing (the image displayed in S238), as in S224. When storing the image that has been subjected to the image processing, the system control unit 124 stores the image that has been subjected to the image processing in the recording medium 200 in S242. If the image that has undergone image processing is not stored, the process proceeds to S244.

  In step S244, the system control unit 124 determines whether an image displayed on the display screen of the display unit 118 (that is, an image on which image processing has been performed) has been touched. If the image is not touched, the process waits until the image is touched (repeats S244). If the image displayed on the display screen of the display unit 118 is touched, the process proceeds to S246.

  In S246, as in S210 and S230, the system control unit 124 detects a touched portion of the image that has been subjected to image processing, and designates this portion as a processing portion that performs image processing.

  In S248, similarly to S212 and S232, the system control unit 124 determines whether the type of the processing part specified in S246 is a human face (that is, specifies the type of the processing part). If the type of the processing part is not a human face, the process proceeds to S250. On the other hand, if the type of the processing portion is a human face, the process proceeds to S214.

  In S250, similarly to S234, the system control unit 124 performs an image to be performed on the processing portion specified in S246 from a plurality of predetermined image processing according to the type of the imaging scene included in the attribute information acquired in S202. Determine processing. However, here, the system control unit 124 determines the image processing different from the image processing determined in S234 as the image processing to be performed on the processing portion of the image that is the target of the image processing. In other words, when the same processing portion is designated a plurality of times, the image processing to be performed on the processing portion is determined so that different image processing is performed for each designation of the processing portion. For example, with reference to the table shown in FIG. 4B, the system control unit 124 performs contrast correction processing when the type of the imaging scene of the image to be subjected to image processing is “blue sky” or “evening scene”. Are determined as image processing to be performed on the processing portion of the image to be processed. Further, the system control unit 124 determines that the noise reduction process is performed as the image process to be performed on the image processing target when the type of the imaging scene of the image to be processed is “night scene”. To do.

  In S252, the system control unit 124 cooperates with the image processing unit 112 to perform the image processing (contrast correction processing, noise reduction processing, etc.) determined in S250 on the processing portion of the image to be subjected to image processing. .

  In S254, the system control unit 124 displays the image that has been subjected to the image processing in S252 on the display screen of the display unit 118, as in S238.

  In S256, the system control unit 124 determines whether or not to save the image that has been subjected to image processing (the image displayed in S238), as in S224 and S240. In the case of storing the image that has been subjected to the image processing, the process proceeds to S242, and the system control unit 124 stores the image that has been subjected to the image processing in the recording medium 200. If the image that has been subjected to image processing is not stored, the process proceeds to S258.

  In step S258, the system control unit 124 determines whether an image displayed on the display screen of the display unit 118 (that is, an image subjected to image processing) has been touched. If the image is not touched, the process waits until the image is touched (repeats S258). If the image displayed on the display screen of the display unit 118 is touched, the process proceeds to S260.

  In S260, as in S210, S230, and S246, the system control unit 124 detects a touched portion of the image that has been subjected to image processing, and designates this portion as a processing portion that performs image processing.

  In S262, as in S212, S232, and S248, the system control unit 124 determines whether or not the type of the processing part specified in S260 is a human face (that is, specifies the type of the processing part). If the type of the processing portion is not a person's face, the process proceeds to S206, and an image that has not been subjected to image processing (that is, the original image) is displayed on the display screen of the display unit 118 together with the face frame. On the other hand, if the type of the processing portion is a human face, the process proceeds to S214.

  As described above, the imaging apparatus 100 according to the present embodiment determines the image processing to be performed on the processing portion according to the attribute information of the image to be image-processed and the type of the processing portion to be subjected to the image processing. Automatically perform image processing. Therefore, even if the user has no knowledge about image processing, the user can easily perform image processing suitable for an image by simply touching a portion of the image that he / she does not like (ie, a processing portion for performing image processing). It can be carried out.

In addition, instead of automatically performing the image processing determined according to the attribute information of the image to be processed and the type of the processing portion to perform the image processing, the user is notified of the content of the determined image processing. Alternatively, it may be performed in accordance with a user instruction. Thereby, for example, when the user feels that the image processing determined as the image processing to be performed on the processing portion is not preferable, the user can stop performing the image processing.
<Second Embodiment>
With reference to FIG. 5, another image processing operation in the imaging apparatus 100 will be described. As in the first embodiment, an image (image data) to be subjected to image processing is selected from a plurality of images (image data) recorded on the recording medium 200 and read into the memory 114 in advance. To do. Further, S502 to S512 shown in FIG. 5 are the same as S202 to S212 shown in FIG. In S512, if the type of the processing part specified in S510 is not a person's face, the process proceeds to S534. If the type of the processing part specified in S510 is a person's face, the process proceeds to S514. .

  In step S514, the system control unit 124 notifies the user that a plurality of image processes corresponding to the attribute information acquired in step S502 can be selected. For example, as shown in FIG. 6, the memory 114 stores a table representing the relationship between attribute information (imaging conditions) and image processing. The system control unit 124 refers to the table shown in FIG. The selectable image processing is displayed on the display screen of the display unit 118. FIG. 7A is a diagram illustrating a display example of an image displayed on the display screen of the display unit 118 in S514, and the imaging condition indicates that the strobe is not emitted when the image is captured. It is a figure which shows the example of a display. Referring to FIG. 7A, an image processing selection menu including a backlight correction process and a beautiful skin correction process is displayed as selectable image processes. The user can select the image processing to be performed on the processing portion by touching the item portion of the backlight correction processing or the skin softening correction processing in the image processing selection menu. When the image capturing condition indicates that the strobe is emitted at the time of image capturing, an image processing selection menu including red eye correction processing and skin softening correction processing is displayed.

  In S516, the system control unit 124 determines the image processing selected by the user from the plurality of image processing notified in S514 as the image processing to be performed on the processing portion specified in S510.

  In S518, the system control unit 124 cooperates with the image processing unit 112 to perform the image processing (for example, backlight correction processing or skin beautification processing) determined in S516 on the processing portion of the image to be processed. Do.

  In step S520, the system control unit 124 displays the image on which image processing has been performed in step S518 on the display screen of the display unit 118. When an image that has been subjected to image processing is displayed, as shown in FIG. 7B, a description of the content of the image processing performed on the processing portion is also displayed so that the user can recognize the content of the image processing. It is preferable to be able to do this. In FIG.7 (b), the icon showing that the beautiful skin correction process and the red eye correction process were performed is displayed on the process part. In addition, a save button for instructing to save an image that has been subjected to image processing, a return button for instructing to return to an image before the image processing is performed, and the like may be displayed.

  In step S522, the system control unit 124 determines whether to save the image on which image processing has been performed (the image displayed in step S520). When storing the image that has been subjected to the image processing, the system control unit 124 stores the image that has been subjected to the image processing in the recording medium 200 in S524. If the image that has been subjected to image processing is not stored, the process proceeds to S526.

  In step S526, the system control unit 124 determines whether to end the image processing. For example, the system control unit 124 detects whether an image processing end button that is one of the operation units is selected (that is, whether the end of image processing is instructed). If it is detected that the image processing end button has been selected, the system control unit 124 ends the image processing. If it is not detected that the image processing end button has been selected, the system control unit 124 determines that the image processing is not to be ended, and proceeds to S528.

  In step S <b> 528, the system control unit 124 determines whether an image displayed on the display screen of the display unit 118 (that is, an image subjected to image processing) has been touched. If the image is not touched, the process waits until the image is touched (S528 is repeated). If the image displayed on the display screen of the display unit 118 is touched, the process proceeds to S530.

  In S530, the system control unit 124 detects the touched portion of the image displayed on the display screen of the display unit 118 based on the operation information including the touched position coordinates on the touch panel, and detects the touched portion as an image. Specify as the processing part to perform processing.

  In S532, the system control unit 124 determines whether or not the type of the processing part specified in S530 is a human face (that is, specifies the type of the processing part). If the type of the processing part is not a human face, the process proceeds to S534. If the type of processing part is a human face, the process proceeds to S514.

  In step S534, the system control unit 124 notifies the user that a plurality of image processes corresponding to the attribute information acquired in step S502 can be selected. For example, as shown in FIG. 4B, the memory 114 stores a table representing the relationship between attribute information (type of captured scene) and image processing, and the system control unit 124 stores the table shown in FIG. The selectable image processing is displayed on the display screen of the display unit 118 with reference to the table shown in FIG. When the type of the imaging scene is “blue sky”, an image processing selection menu including blue enhancement processing and contrast correction processing is displayed. Further, when the type of the imaging scene is “night scene”, an image processing selection menu including a contrast correction process and a noise reduction process is displayed.

  In S536, the system control unit 124 determines the image processing selected by the user from among the plurality of image processing notified in S534 as the image processing to be performed on the processing portion specified in S530.

  In step S538, the system control unit 124 cooperates with the image processing unit 112 to perform the image processing (for example, blue enhancement processing or contrast correction processing) determined in step S536 on the processing portion of the image to be processed. Do.

  In step S540, the system control unit 124 displays the image on which image processing has been performed in step S518 on the display screen of the display unit 118. Note that when displaying an image that has been subjected to image processing, it is preferable to display an explanation of the content of the image processing so that the user can recognize the content of the image processing. In addition, a save button for instructing to save an image that has been subjected to image processing, a return button for instructing to return to an image prior to image processing, and the like may be displayed.

  In S542, the system control unit 124 determines whether to save the image that has been subjected to image processing (the image displayed in S540), as in S522. When storing the image that has been subjected to image processing, the process proceeds to S524, and the system control unit 124 stores the image that has been subjected to image processing in the recording medium 200. If the image that has been subjected to image processing is not stored, the process proceeds to S544.

  In S544, the system control unit 124 determines whether to end the image processing, as in S526. As described above, when detecting that the image processing end button has been selected, the system control unit 124 ends the image processing. If it is not detected that the image processing end button has been selected, the system control unit 124 determines not to end the image processing, and the process proceeds to S546.

  In S546, as in S528, the system control unit 124 determines whether an image displayed on the display screen of the display unit 118 (that is, an image subjected to image processing) has been touched. If the image is not touched, the process waits until the image is touched (repeats S546). If the image displayed on the display screen of the display unit 118 is touched, the process proceeds to S548.

  In S548, the system control unit 124 detects a touched portion of the image displayed on the display screen of the display unit 118, and designates this portion as a processing portion for performing image processing, as in S530.

  In S550, the system control unit 124 determines whether or not the type of the processing part specified in S548 is a human face (that is, specifies the type of the processing part). If the type of the processing part is a human face, the process proceeds to S514. If the type of the processing part is not a person's face, the process proceeds to S534.

  As described above, in the imaging apparatus 100 according to the present embodiment, a plurality of images that can be performed on the processing portion according to the attribute information of the image to be subjected to image processing and the type of the processing portion on which the image processing is performed. Notify the process. Then, the image processing selected by the user is determined as the image processing to be performed on the processing portion, and the image processing is automatically performed. Therefore, even if the user has no knowledge about image processing, the user touches a portion that is not liked by the image (that is, a processing portion that performs image processing) and selects image processing that can be performed on the processing portion. Image processing suitable for an image can be easily performed only by performing an operation.

  In the first embodiment and the second embodiment, since the device that performs image processing is an imaging device, a processing portion is designated according to a user operation on the touch panel. However, when the image processing apparatus is an image processing apparatus such as a personal computer, a pointing device for moving the pointer in the image displayed on the display screen is generally provided. In such a case, the processing portion may be designated according to the operation of the pointing device by the user.

  Further, the control of the system control unit 124 in the imaging apparatus 100 may be performed by one hardware, or the entire imaging apparatus 100 may be controlled by a plurality of hardware sharing the processing.

  In the above-described embodiment, the case where the present invention is applied to a digital camera has been described as an example. However, the present invention is not limited to this. For example, the present invention can be applied to an apparatus including a display device capable of controlling image display, such as a personal computer, a mobile phone terminal, a portable image viewer, and a printer.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or each storage medium, and a computer (or CPU, MPU, etc.) of the system or apparatus reads the program. It is a process to be executed. In this case, the program and the storage medium storing the program constitute the present invention.

  As mentioned above, although preferable embodiment of this invention was described, it cannot be overemphasized that this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary. For example, the above-described embodiments can be appropriately combined.

Claims (16)

Display control means for displaying an image on the display screen of the display device;
Designating means for designating processing part for performing image processing in the previous SL image,
Determining means for determining whether or not a face is included in the processing portion from the characteristics of the image of the processing portion specified by the specifying means;
Determining means for determining image processing to be performed on the processing portion from a plurality of image processing determined based on the determination result of the determining means;
Processing means for performing the image processing determined by the determination means on the processing portion;
I have a,
When the same processing part determined not to contain a face by the determination unit is specified a plurality of times, the determination unit is based on the determination result of the determination unit so that different processing is performed for each specification. An image processing apparatus for determining image processing to be performed on the processing portion from a plurality of predetermined image processing. When a plurality of image processing performed by repeatedly specifying the same processing portion is completed, the display control unit displays an image that has not been subjected to image processing according to the specification of the processing portion. the image processing apparatus according to claim 1, characterized in that control. It further has an acquisition means for acquiring attribute information associated with the image,
The said determination means determines the image process performed to the said process part based on the said attribute information from the several image processing defined based on the determination result of the said determination means, The Claim 1 or 2 characterized by the above-mentioned. Image processing device. A table representing a relationship between a plurality of image processing said attribute information and is Me before Kijo, further comprising a storage means for storing distinguished by a processing portion that does not include the processing portion and the face including a face,
It said determining means includes a wherein with reference to stored pre-Symbol table in the storage means, determines the image processing corresponding to the attribute information acquired by the acquisition means as the image processing performed in the processing portion The image processing apparatus according to claim 3 . A table representing a relationship between a plurality of image processing said attribute information and is Me before Kijo, further comprising a storage means for storing distinguished by a processing portion that does not include the processing portion and the face including a face,
The determination unit refers to the pre-Symbol table stored in the storage means, it has been notified to selectably user a plurality of image processing corresponding to the attribute information acquired by the acquisition means, the plurality of images The image processing apparatus according to claim 3 , wherein an image process selected by the user among the processes is determined as an image process to be performed on the processing portion. It further has an acquisition means for acquiring attribute information associated with the image,
When the determination unit determines that a face is included in the designated processing portion, the determination unit is included in the attribute information from a plurality of image processes determined based on the determination result of the determination unit. Determine image processing to be performed on the processing portion based on the imaging conditions used at the time of imaging the image,
When the determination unit determines that no face is included in the designated processing portion, the determination unit includes the plurality of image processes determined based on the determination result of the determination unit and is included in the attribute information. The image processing apparatus according to claim 1, wherein image processing to be performed on the processing portion is determined based on a type of an imaging scene determined at the time of capturing the image. Further comprising an acquisition means for acquiring attribute information including a type of an imaging scene determined at the time of imaging the image;
When the same processing part determined not to contain a face by the determination unit is specified a plurality of times, the determination unit determines the determination result of the determination unit and the determination unit so that different processing is performed for each specification. The image processing apparatus according to claim 1, wherein image processing to be performed on the processing portion is determined from a plurality of image processing determined based on attribute information. The processing means, the image processing apparatus according to any one of claims 1 to 7, characterized in that the automatically the treated portion of the image processing determined by said determining means. Wherein the display control unit, any one of claims 1 to 8, characterized in that the image which the image processing has been performed by the processing means, to be displayed on the display screen together with the description of the contents of the image processing An image processing apparatus according to 1. Before SL determining means, when it is determined that a face is included in the specified processing portion, or the imaging condition included in the attribute information indicates that the flash is emitted when imaging the image strobe The image processing apparatus according to claim 4 , wherein image processing to be performed on the processing portion is determined so that different image processing is performed depending on whether or not the light is emitted. Before SL determining means, when it is determined that no face is included in the specified processing portion, so that different image processing according to the type of the image scene included in the attribute information is performed, the processing The image processing apparatus according to claim 4 , wherein image processing to be performed on the portion is determined. Position input means is provided on the display screen of the display device,
It said specifying means, the image processing apparatus according to any one of claims 1 to 11, wherein the designating the processing part in response to a user's operation to the position input means. A pointing device for moving a pointer in the image displayed on the display screen;
It said specifying means, the image processing apparatus according to any one of claims 1 to 11, wherein the designating the processing part in response to the operation of the pointing device by the user. A control method for an image processing apparatus, comprising:
A display control step for causing the display control means to display an image on the display screen of the display device;
Specified means, a designation step of designating a processing part for performing image processing in the image,
A determining step for determining whether or not a face is included in the processing portion from the feature of the image of the processing portion specified in the specifying step;
A determination step for determining image processing to be performed on the processing portion from a plurality of image processing determined based on the determination result in the determination step;
A processing step in which processing means performs the image processing determined in the determining step on the processing portion;
I have a,
When the same processing part determined not to contain a face in the determination step is specified a plurality of times, the determination result in the determination step is such that a different process is performed for each specification in the determination step. A control method for determining image processing to be performed on the processing portion from a plurality of image processing determined based on the method. A program that causes a computer to function as each unit of the image processing apparatus according to any one of claims 1 to 13 . A storage medium storing a program that causes a computer to function as each unit of the image processing apparatus according to any one of claims 1 to 13 .

Images