JP2008278468A - Image correction apparatus, image correction method, skin diagnosis method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image correction technology for causing the image of a person to appear more beautiful. <P>SOLUTION: An image correction apparatus is provided which is equipped with a partial region specifying section that specifies a partial region of a skin that satisfies a predetermined condition, within a first image captured under a first image capturing condition; a corresponding region specifying section that specifies a corresponding region, that corresponds to the partial region within a second image captured under a second image capturing condition that is different from the first image capturing conditions; and an image correction section that corrects the second image by performing predetermined image processing on the corresponding region of the second image. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an image correction apparatus, an image correction method, a skin diagnosis method, and a program. In particular, the present invention relates to an image correction apparatus, an image correction method, a skin diagnosis method, and a program that can beautifully correct the skin of the person in human photographing and can be used for skin diagnosis.

  When reflecting linearly polarized light on the surface of an object, it is known that the polarization direction of irradiation light is maintained. In addition, when the irradiation light enters the object and is reflected, the polarization direction rotates according to the light travel inside the object, and light having a polarization direction different from the polarization direction of the irradiation light is reflected. It is known that If this light reflection property is applied to the photographing of a person, it is possible to perform photographing with emphasis on the skin condition of the person.

For example, in Patent Document 1, S-polarized light and P-polarized light are separately incident on the skin, and the reflected light from the skin for each incident light separately receives both the S-polarized component and the P-polarized component. An apparatus for observing the skin surface is described. Further, Patent Document 2 describes a skin color measuring device that measures the color of a melanin component or the like by internally reflected light that excludes surface reflected light using polarized light.
JP-A-7-323013 JP 2002-200050 A

  However, in the existing technology, the state of the person's skin is simply observed using polarized light or the like. In the field of photographing human images, there is a demand for image correction techniques for making human images appear more beautiful.

  In order to solve the above-described problem, in the first aspect of the present invention, a partial region specifying unit that specifies a partial region of the skin that satisfies a predetermined condition in the first image imaged under the first imaging condition; Applying a predetermined image processing to the corresponding area of the second image, and a corresponding area specifying unit for specifying a corresponding area corresponding to the partial area in the second image captured under a second imaging condition different from the first imaging condition And an image correcting unit that corrects the second image.

  The above summary of the invention does not enumerate all the necessary features of the present invention, and sub-combinations of these feature groups can also be the invention.

  As is apparent from the above description, according to the present invention, a partial region of the skin that satisfies a predetermined condition can be specified, and image processing can be performed on a corresponding region corresponding to the partial region. As a result, an image obtained by correcting the person image more beautifully can be obtained.

  Hereinafter, the present invention will be described through embodiments of the invention. However, the following embodiments do not limit the invention according to the scope of claims, and all combinations of features described in the embodiments are included. It is not necessarily essential for the solution of the invention.

  FIG. 1 shows an example of an imaging apparatus 100 according to the present embodiment. The imaging apparatus 100 of this embodiment includes an irradiation unit 110, an imaging unit 120, a polarizing plate drive control unit 130, a display unit 140, an operation unit 150, an image processing unit 160, a system control unit 170, and a storage unit 180. The imaging device 100 is an example of an image correction device. The image correction apparatus described in the claims may be a personal computer in addition to the imaging apparatus 100 or a server connected to a communication network such as the Internet.

  The irradiation unit 110 includes a light source 112 and an irradiation light polarizing plate 114. The light source 112 may be a so-called flash lamp and emits light for irradiating the subject. The light emitted from the light source 112 includes a polarization component in an arbitrary direction, and the irradiation light polarizing plate 114 transmits only polarized light in a specific direction. The light emitted from the irradiation unit 110 passes through the irradiation light polarizing plate 114 and becomes linearly polarized light having only a polarization component in a specific direction.

  In addition, the irradiation light polarizing plate 114 may be rotated or removed from the optical path by a polarizing plate driving unit described later. When the irradiation light polarizing plate 114 is rotated, the polarization direction of the linearly polarized light of the light emitted from the irradiation unit 110 is rotated according to the rotation. When the irradiation light polarizing plate 114 is removed from the optical path, the light emitted from the irradiation unit 110 is not linearly polarized light but circularly polarized light including an arbitrary polarization component.

  The imaging unit 120 includes an imaging signal processing unit 122, a light receiving element 124, and a light receiving polarizing plate 126. The imaging signal processing unit 122 converts the analog output of the light receiving element 124 from analog to digital, for example, into 8-bit luminance data. When the analog output of the light receiving element 124 is color-separated into RGB components, the 8-bit luminance data is obtained for each RGB component.

  The imaging signal processing unit 122 can adjust each component of RGB to achieve white balance. The imaging signal processing unit 122 interfaces with the system control unit 170 and the like. The light receiving element 124 converts incident light into an electrical signal (analog value). A typical example of the light receiving element 124 is a charge-coupled device (CCD).

  The light receiving polarizing plate 126 transmits polarized light in a specific direction, like the irradiation light polarizing plate 114. Of the light reflected by the subject, the reflected light of the polarization component that matches the polarization direction of the light receiving polarizing plate 126 passes through the light receiving polarizing plate 126 and reaches the light receiving element 124. Note that the light receiving polarizing plate 126 may be rotated or removed from the optical path by a polarizing plate driving unit described later. When the light receiving polarizing plate 126 is rotated, the polarization direction of the transmitted light is also rotated according to the rotation. When the light receiving polarizing plate 126 is removed from the optical path, the total polarization component of the light reflected from the subject reaches the light receiving element 124.

  The polarizing plate driving control unit 130 includes an irradiation light polarizing plate driving unit 132 and a light receiving polarizing plate driving unit 134. The irradiation light polarizing plate driving unit 132 drives rotation of the irradiation light polarizing plate 114 or removal from the optical path. The light receiving polarizing plate driver 134 drives rotation of the light receiving polarizing plate 126 or removal from the optical path. The polarizing plate drive control unit 130 receives the control from the system control unit 170 and controls the irradiation light polarizing plate driving unit 132 and the light receiving polarizing plate driving unit 134.

  The display unit 140 includes, for example, a liquid crystal display panel and a panel driver, and displays an image captured by the imaging device 100. The operation unit 150 includes, for example, a power switch, a release switch, a zoom button, a function setting button, and the like. In particular, the operation unit 150 includes a mode setting unit 152 that sets whether to perform imaging in the skin-beautifying mode or imaging in the normal mode that enables imaging with the imaging apparatus 100.

  The image processing unit 160 processes the images captured under the various conditions described above alone or in combination, and corrects the correction target image so that the subject looks beautiful. The image processing unit 160 includes a partial region specifying unit 161, a corresponding region specifying unit 162, an image correcting unit 163, a gamma correcting unit 164, and a person specifying unit 165.

  The partial area specifying unit 161 specifies a wrinkle partial area from the above-described wrinkle partial area specifying image. The partial area specifying unit 161 specifies a spot partial area from the above-described spot partial area specifying image. For specifying the wrinkle or spot partial area, for example, a skin area is specified, and a series of pixels having a large luminance change is specified in the skin area.

  If this series of pixels forms a closed area and the brightness in the closed area is lower than the surrounding area, there is a high possibility that the closed area is a spot area. When a series of pixels open linearly and there are a plurality of the series of pixels in parallel, there is a high possibility that the pixel is a wrinkled region. If the luminance data of each pixel is processed under the inference as described above, a partial area of wrinkles or spots can be specified.

  The corresponding area specifying unit 162 specifies an area corresponding to the wrinkle partial area or an area corresponding to the spot partial area in the correction target image. Corresponding to the wrinkle partial area or the spot partial area when the image for specifying the partial wrinkle area or the image for specifying the partial spot area and the correction target image are taken close in time and the composition of the subject in the image is almost the same. The corresponding region can be specified by specifying the pixel of the correction target image corresponding to the pixel to be corrected. If the subject composition of the wrinkle partial area specifying image or the spot partial area specifying image does not match the subject composition of the correction target image, for example, the face image of a person in the subject composition is analyzed, and the eyes, eyebrows, and mouth are analyzed. Etc. are extracted. Then, the position of the wrinkle partial area or the spot partial area is normalized by the relative distance from the feature point, and the corresponding position in the correction target image can be specified as the corresponding area.

  The image correction unit 163 performs image correction on the correction target image in a corresponding area corresponding to the wrinkle partial area or the blot partial area. By image correction, wrinkles or spots existing in the corresponding area of the correction target image can be made inconspicuous. The correction of wrinkles or spots can replace the luminance of the pixels in the corresponding area with the average luminance of the peripheral pixels in the corresponding area, for example.

  In order to correct more naturally, the spatial frequency of the luminance change for each pixel may be extracted to cut the high frequency region of the spatial frequency and interpolate the luminance between the pixels for the low frequency region. When the high frequency region of the spatial frequency reflects, for example, moles, the high frequency region can be stored. Note that any existing image correction method can be applied as the image correction method.

  The gamma correction unit 164 changes the luminance data for each pixel by applying a predetermined gamma curve to the wrinkle partial region specifying image, the blot partial region specifying image, and the correction target image. Here, the gamma correction refers to an input / output conversion operation in which luminance data for each pixel before correction is converted according to a gamma curve in which an output value is determined according to the input value to obtain a corrected value. A gamma curve is defined as a conversion curve indicating an output value corresponding to an input value. That is, the gamma correction calculates an output value according to a gamma curve using luminance data of a certain pixel as an input value. Then, an operation for setting the output value as corrected luminance data is performed for all the pixels.

  The non-linear input / output characteristics of the image input / output device can be linearized by the gamma correction, and the contrast of the luminance region to be particularly emphasized for a certain image can be increased. When the luminance data is decomposed into RGB components, gamma correction can be performed on the luminance data of each RGB component.

  In the gamma correction performed by the gamma correction unit 164, the gamma curve applied to the wrinkle partial region specifying image and the blot partial region specifying image is different from the gamma curve applied to the correction target image. The gradient in the skin luminance range of the gamma curve applied to the wrinkle partial region specifying image and the blot partial region specifying image is larger than the gradient in the skin luminance range of the gamma curve applied to the correction target image. By increasing the slope of the gamma curve applied to the wrinkle partial area identification image and the spot partial area identification image, the brightness difference appears clearly in the range of skin luminance. Identification becomes easy.

  Note that the skin brightness range can be determined by specifying a skin area from a wrinkle or spot partial area specifying image captured in advance and using the maximum brightness and the minimum brightness of each pixel in the skin area as an upper limit and a lower limit. Then, the gamma curve can be defined so that the inclination is maximized within the luminance range of the skin. Further, when the luminance data is decomposed into RGB components, the gamma curve inclination of the skin luminance range can be increased for each color component. In the observation of a stain having a high possibility of having an absorption band in the blue system color, it is highly possible that a stain is observed as a change in the B component luminance. Therefore, it is possible to apply gamma correction especially by increasing the gradient of the B component gamma curve.

  The person specifying unit 165 specifies a person included in the correction target image. The person specifying unit 165 calculates a face pattern by extracting feature points such as eyes, eyebrows, nose and mouth from the face image of the person, for example. Then, a face pattern storage unit of the storage unit 180 described later is accessed to search for a matching face pattern. When a matching face pattern is found, the person is specified.

  The system control unit 170 controls the entire imaging apparatus 100. The system control unit 170 includes a control CPU 172 and a mode switching unit 174. The control CPU 172 executes calculations required for system control. The mode switching unit 174 switches between the skin beautification imaging mode and the normal imaging mode. In the beautiful skin imaging mode, drive control of the irradiation light polarizing plate 114 and the light receiving polarizing plate 126, acquisition and recording of a wrinkle partial region specifying image, a blot partial region specifying image and a correction target image, a blot partial region and a wrinkle partial region In addition, various controls peculiar to the skin beautifying mode such as identification of the corresponding area, gamma correction and image correction are executed.

  The storage unit 180 stores various data used by the imaging apparatus 100. The storage unit 180 includes a partial region position storage unit 182 and a face pattern storage unit 184. The partial area position storage unit 182 stores the position of the wrinkle or blot partial area of the person in association with the person identification information such as a name. The face pattern storage unit 184 stores the face pattern of the person in association with the person identification information such as a name. As described above, the face pattern is used for specifying a person.

  FIG. 2 shows a combination of rotation of the illuminating light polarizing plate 114 and the light receiving polarizing plate 126 and exclusion from the optical path. FIG. 2A shows a case where the polarization direction of the light receiving polarization plate 126 is set in the same direction as the polarization direction of the irradiation light polarization plate 114. FIG. 2B shows a case where the polarization direction of the light receiving polarizing plate 126 is set in a direction perpendicular to the polarization direction of the irradiation light polarizing plate 114. FIG. 2C shows a case where the irradiation light polarizing plate 114 and the light receiving polarizing plate 126 are removed from the optical path. By combining the rotation of the irradiation light polarizing plate 114 and the light receiving polarizing plate 126 and the exclusion from the optical path as shown in FIG. 2, the light component reflected from the subject and the light component reflected on the subject surface and the inside of the subject are reflected. Can be separated from the light component.

  That is, it utilizes the property of reflected light that the polarization direction of light reflected from the surface of the subject is maintained while the polarization direction of light that has entered the subject changes. That is, if the polarization direction of the light receiving polarizing plate 126 is set in substantially the same direction as the irradiation light polarizing plate 114 (in the case of FIG. 2A), the light incident on the light receiving element 124 is reflected by the surface of the subject. Light will be the main. Conversely, if the polarization direction of the light receiving polarizing plate 126 is set in a direction substantially perpendicular to the polarization direction of the illuminating light polarizing plate 114 (in the case of FIG. 2B), the light incident on the light receiving element 124 enters the inside of the subject. The light that enters and reflects is mainly used. If imaging is performed with light reflected from the subject surface, for example, wrinkles on the skin surface will be emphasized, and if imaging is performed using light that has entered the subject and reflected, stains within the skin will be enhanced, for example.

  An image obtained by emphasizing wrinkles on the skin surface or spots inside the skin as described above can be used for image correction. That is, a captured image (an image in which the skin surface is emphasized) under a condition in which the polarization directions of the irradiation light polarizing plate 114 and the light receiving polarizing plate 126 coincide can be used as a wrinkle partial region specifying image. Further, a captured image (an image in which the inside of the skin is emphasized) under a condition in which the polarization directions of the irradiation light polarizing plate 114 and the light receiving polarizing plate 126 are perpendicular can be used as a spot partial region specifying image. When either or both of the irradiation light polarizing plate 114 and the light receiving polarizing plate 126 are removed from the optical path (in the case of FIG. 2C), light including any polarization direction that is the same as the reflected light from the subject is emitted. The light enters the light receiving element 124. An image captured under such conditions can be used as a correction target image.

  FIG. 3 shows the first half of an example of the imaging method of the present embodiment. Note that the imaging method of the present embodiment is an example of an image correction method. First, when processing is started, an imaging mode is selected (S200). When the beautiful skin mode is selected, the process proceeds to step S210, and when the normal imaging mode is selected, the process proceeds to step S430. The case of the normal imaging mode will be described later.

  In the skin beautifying mode (S210), it is first determined whether to use person information (S220). When using the person information, the person information flag PIFlag is set to ON (PIFflag is set to true) (S230), and the process proceeds to step S260. If it is determined in step S220 that no personal information is used, a wrinkle partial region specifying image is captured (S240). Thereafter, a spot partial area specifying image is captured (S250), and the process proceeds to step S260.

  In step S260, a correction target image is captured (S260). Next, gamma correction is performed on the captured wrinkle partial region specifying image, blot partial region specifying image, and correction target image (S270). Note that when the wrinkle partial region specifying image and the blot partial region specifying image are not captured, gamma correction is performed on the captured correction target image.

  FIG. 4 shows the latter half of the imaging method example of the present embodiment. After performing gamma correction in step S270, it is determined whether PIFlag is set to true (S280). If PIFlag is set to true, that is, if personal information is used, it is determined whether a name is input as personal identification information (S290). If a name is input, a person is identified from the name (S300), and the process proceeds to step S330.

  If no name is input in step S290, the captured correction target image is analyzed to extract a face pattern (S310). The face pattern storage unit 184 is searched with the extracted face pattern to identify a person (S320). If the face pattern identification fails, the process may be terminated at that time, or the process may be resumed by returning to step S240. If a person is specified in step S300 or step S320, the wrinkle partial area position and the spot partial area position recorded in the partial area position storage unit 182 in association with the person are acquired (S330).

  If it is determined in step S280 that the PIF flag is not set to true, that is, the person information is not used, the wrinkle partial area is specified from the wrinkle partial area specifying image (S340). Further, a spot partial area is specified from the spot partial area specifying image (S350). Next, it is determined whether to record person information (S360). When recording personal information, a face pattern is analyzed from the correction target image (S370), and a name associated with the face pattern is registered as personal identification information (S380). The face pattern analysis may use a wrinkle partial region specifying image or a blot partial region specifying image.

  Next, the position of the wrinkle partial area and the spot partial area specified in steps S340 and S350 and the face pattern analyzed in step S370 are associated with the name registered in step S380, respectively, and the partial area position storage unit 182 and the face pattern storage respectively. The data is recorded in the unit 184 (S390). The recorded positions of the wrinkle partial area and the blot partial area and the face pattern can be used later when the person information is used.

  Next, the wrinkle corresponding region and the blot corresponding region of the correction target image are specified from the wrinkle partial region and the blot partial region specified in steps S340 and S350, or the wrinkle partial region position and the blot partial region position acquired in step S330 (S400). ). Correction processing is performed on the specified wrinkle-corresponding area and spot-corresponding area (S410), and the corrected image is recorded in a nonvolatile memory or the like (S420). Thereafter, the process ends.

  When the normal imaging mode is selected in step S200, the process proceeds to the normal imaging mode after step S430 (S430). In the normal imaging mode, the light receiving polarizing plate 126 is turned off (S440), and the irradiation light polarizing plate 114 is turned off (S450). Thereafter, an image is taken (S460). The captured image is recorded in a nonvolatile memory or the like (S470), and the process ends.

  FIG. 5 shows an example of imaging of a wrinkle partial region specifying image. In capturing the wrinkle partial region specifying image, first, the light receiving polarizing plate 126 is turned on (S241), and the irradiation light polarizing plate 114 is turned on (S242). Here, ON means that the polarizing plate is set on the optical path (hereinafter the same). The polarization direction of the irradiation light polarizing plate 114 is the same as the polarization direction of the light receiving polarization plate 126. Thereafter, an image is taken (S243), and the taken image is recorded as a wrinkle partial region specifying image (S244).

  FIG. 6 shows an example of capturing a spot partial area specifying image. In capturing the spot partial area specifying image, the light receiving polarizing plate 126 is turned on (S251), and the irradiation light polarizing plate 114 is turned on (S252). The polarization direction of the irradiation light polarizing plate 114 is perpendicular to the polarization direction of the light receiving polarization plate 126. Thereafter, the image is picked up (S253), and the picked-up image is recorded as a spot partial area specifying image (S254).

  FIG. 7 shows an example of capturing a correction target image. In capturing the correction target image, the light receiving polarizing plate 126 is turned off (S261), and the irradiation light polarizing plate 114 is turned off (S262). Here, OFF means that the polarizing plate is excluded from the optical path. Thereafter, an image is taken (S263), and the taken image is recorded as a correction target image (S264).

  According to the imaging apparatus 100 described above, it is possible to acquire a wrinkle partial region specifying image in which the subject surface is emphasized by a combination of polarizing plates and a blot partial region specifying image in which the inside of the subject is emphasized. The wrinkle partial area and the spot partial area specifying image can be specified by the wrinkle partial area specifying image and the spot partial area specifying image, and the correction target image can be corrected so that the wrinkles and the spots are not noticeable by specifying the corresponding area of the correction target image. As a result, the person image can be displayed more beautifully.

  As mentioned above, although this invention was demonstrated using embodiment, the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiment. It is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  For example, in the above-described embodiment, the example in which the image for specifying the wrinkle partial region, the image for specifying the partial region of the blot, and the correction target image is captured by the single light receiving element 124 is shown. However, a dedicated light receiving element may be provided for each of the wrinkle partial region specifying image, the spot partial region specifying image, and the correction target image.

  FIG. 8 shows a modification example of the imaging apparatus 100. In the following description, the description of the same members having the same reference numerals as those of the imaging device 100 is omitted. The imaging apparatus 800 includes an irradiation unit 810 and an imaging unit 820. The irradiation light polarizing plate 814 included in the irradiation unit 810 may be a fixed polarizing plate disposed on the optical path of the light source 112. Accordingly, the irradiation unit 810 always emits light having a fixed polarization direction.

  The imaging unit 820 includes a light receiving element 124a, a light receiving element 124b, and a light receiving element 124c. Since the light receiving element 124a does not have a light receiving polarizing plate on its optical path, an image picked up by the light receiving element 124a is a correction target image. Since the light receiving element 124b has a light receiving polarizing plate 822 in the same polarization direction as the irradiation light polarizing plate 814 of the irradiation unit 810 on its optical path, an image captured by the light receiving element 124b becomes a wrinkle partial region specifying image. Since the light receiving element 124c has a light receiving polarizing plate 824 having a polarization direction perpendicular to the changing direction of the irradiation light polarizing plate 814 of the irradiation unit 810 on the optical path, the image captured by the light receiving element 124c is an image for specifying a spot partial area. become.

  According to the imaging apparatus 800, since the dedicated light receiving element is provided for each of the wrinkle partial region specifying image, the spot partial region specifying image, and the correction target image, it is not necessary to drive the polarizing plate. As a result, the imaging apparatus can be simplified.

  Moreover, in the said embodiment, the polarizing plate which has the single permeation | transmission area | region which permeate | transmits the light of a predetermined | prescribed polarization direction was illustrated as the light-receiving polarizing plate 126, the light-receiving polarizing plate 822, and the light-receiving polarizing plate 824. However, the polarizing plate may have a first transmission region that transmits light in the first polarization direction and a second transmission region that transmits light in the second polarization direction substantially perpendicular to the first polarization direction. The light receiving element corresponding to the plate may have a first light receiving region that receives light transmitted through the first transmission region and a second light receiving region that receives light transmitted through the second transmission region.

  FIG. 9 shows an example of an imaging apparatus 900 that is a modified example of the imaging apparatus 800. In the following description, the description of the same members having the same reference numerals as those of the imaging device 800 is omitted. The imaging unit 820 of the imaging apparatus 900 includes a light receiving element 924 and a light receiving polarizing plate 926.

  FIG. 10 shows a plan example of the light receiving polarizing plate 926. The light-receiving polarizing plate 926 includes a first transmission region 926a that transmits light in the first polarization direction and a second transmission region 926b that transmits light in the second polarization direction substantially perpendicular to the first polarization direction. The first transmissive region 926a and the second transmissive region 926b form one pixel region 926e. The pixel region 926e is repeatedly formed in a two-dimensional direction and corresponds to one pixel of the captured image.

  The pixel region 926e may include each color component region corresponding to a color component for each of the first transmissive region 926a and the second transmissive region 926b. That is, the first transmission region 926a may include, for example, color component regions for each of R (red), G (green), and B (blue) color components. Similarly, the second transmission region 926b includes, for example, R (red) ), G (green) and B (blue) color component regions may be included.

  The light receiving element 924 includes a first light receiving region that receives light transmitted through the first transmission region 926a and a second light receiving region that receives light transmitted through the second transmission region 926b. The light receiving element 924 may be, for example, a CCD (Charge Coupled Device) image sensor, and the first light receiving region and the second light receiving region may be photodiodes arranged in the image sensor. When the first transmission region 926a and the second transmission region 926b include a color component region, the first light reception region and the second light reception region of the light receiving element 924 also include a light reception region corresponding to the color component region.

  In the light receiving element 924 in the imaging apparatus 900 of the present embodiment, the wrinkle partial region specifying image (step S240), the blot partial region specifying image (step S250), and the correction target image (step S250) in FIG. S260) is performed simultaneously. That is, in the skin measurement mode, the light receiving element 924 captures a wrinkle partial region specifying image, which may be the first image, with light from the subject received in the first light receiving region corresponding to the first transmission region 926a. In the skin measurement mode, the light receiving element 924 captures a spot partial area specifying image that may be the first image with light from the subject received in the second light receiving area corresponding to the second transmission area 926b. Further, the light receiving element 924 synthesizes a signal of light from the subject received in the first light receiving region corresponding to the first transmission region 926a and the second light receiving region corresponding to the second transmission region 926b in the correction imaging mode, A correction target image that may be the second image is captured.

  According to the imaging apparatus 900, the wrinkle partial region specifying image, the spot partial region specifying image, and the correction target image can be simultaneously imaged by the single light receiving polarizing plate 926 and the light receiving element 924, so that the number of components can be reduced and irradiation can be performed. The optical polarizing plate 814 may not be driven. As a result, the imaging apparatus 900 can be further simplified. The light receiving polarizing plate 926 may be replaced with a light receiving polarizing plate that further includes a third transmission region that transmits light including light in the first polarization direction and light in the second polarization direction.

  FIG. 11 shows a plan example of the light receiving polarizing plate 928. The light-receiving polarizing plate 928 includes a first transmission region 928a that transmits light in the first polarization direction, a second transmission region 928b that transmits light in the second polarization direction substantially perpendicular to the first polarization direction, and the first polarization direction and the first polarization direction. A third transmission region 928c that transmits light in both directions of two polarization directions is provided. The first transmissive region 928a, the second transmissive region 928b, and the third transmissive region 928c form one pixel region 928e. The pixel region 928e is repeatedly formed in a two-dimensional direction and corresponds to one pixel of the captured image. The pixel region 928e may include a color component region as in the case of the light receiving polarizing plate 926.

  In the above case, the light receiving element 924 may further include a third light receiving region that receives light transmitted through the third transmission region 928c. In the correction imaging mode, the light receiving element 924 can capture a correction target image, which may be the second image, by the light received in the third light receiving region corresponding to the third transmission region 928c.

  Further, the imaging apparatus described above may include a change amount calculation unit that calculates a luminance change amount or a chromaticity change amount of the image before and after treatment in the treatment region from images before and after the treatment region including the treatment region to be treated. A case storage unit that stores the luminance change amount or the chromaticity change amount calculated by the amount calculation unit in association with an index of a successful case or a failure case may be provided. FIG. 9 illustrates an example in which the imaging apparatus 900 includes a change amount calculation unit 990 and a case storage unit 986.

  The change amount calculation unit 990 calculates the luminance change amount or chromaticity change amount of the image before and after treatment in the treatment region from the image before and after treatment including the treatment region to be treated. The case storage unit 986 stores the luminance change amount or chromaticity change amount calculated by the change amount calculation unit 990 in association with the success case or failure case index. Then, when correcting the correction target image, which is an example of the second image, as the predicted image of the successful case, the image correction unit 163 associates with the success case index and stores the amount of change in luminance stored in the case storage unit 986. Alternatively, the correction target image is subjected to image processing so that the luminance or chromaticity of the corresponding region changes by the chromaticity change amount. When correcting the correction target image as a predicted image of a failure case, the image correction unit 163 correlates the corresponding region with the luminance change amount or the chromaticity change amount stored in the case storage unit 986 in association with the failure case index. Image processing is performed on the correction target image so that the luminance or chromaticity changes. The display unit 140 displays the correction target image (second image) corrected by the image correction unit 163 as a predicted image of either a successful case or a failed case.

  According to the imaging apparatus 900 including the change amount calculation unit 990 and the case storage unit 986, the skin state when the treatment is successful or the treatment fails can be confirmed with the predicted image before the skin treatment. Note that the imaging apparatus 900 including the change amount calculation unit 990 and the case storage unit 986 can be grasped as a skin diagnosis method if it is applied to skin diagnosis. In the skin diagnosis method, the step of calculating the luminance change amount or chromaticity change amount of the image of the corresponding region before and after the skin treatment by the change amount calculating unit 990, and the calculated luminance change amount or chromaticity change amount succeeded. And storing in the case storage unit 986 in association with the case or failure case index.

  Further, in the above-described embodiment, the example of the imaging device has been described as an example of the image correction device of the present application. However, the image correction device of the present application, in particular, the image processing unit 160, the system control unit 170, and the storage unit 180 in the imaging device 100 can be configured by an electronic information processing device such as a personal computer or a network-connected server.

  FIG. 12 shows an example of a hardware configuration when the image correction apparatus of the present application is configured by an electronic information processing apparatus 1500 such as a personal computer. The image correction apparatus includes a CPU peripheral part, an input / output part, and a legacy input / output part. The CPU peripheral section includes a CPU 1505, a RAM 1520, a graphic controller 1575, and a display device 1580 that are connected to each other by a host controller 1582. The input / output unit includes a communication interface 1530, a hard disk drive 1540, and a CD-ROM drive 1560 that are connected to the host controller 1582 by the input / output controller 1584. The legacy input / output unit includes a ROM 1510, a flexible disk drive 1550, and an input / output chip 1570 connected to the input / output controller 1584.

  The host controller 1582 connects the RAM 1520, the CPU 1505 that accesses the RAM 1520 at a high transfer rate, and the graphic controller 1575. The CPU 1505 operates based on programs stored in the ROM 1510 and the RAM 1520 to control each unit. The graphic controller 1575 acquires image data generated by the CPU 1505 or the like on a frame buffer provided in the RAM 1520 and displays the image data on the display device 1580. Alternatively, the graphic controller 1575 may include a frame buffer that stores image data generated by the CPU 1505 or the like.

  The input / output controller 1584 connects the host controller 1582 to the hard disk drive 1540, the communication interface 1530, and the CD-ROM drive 1560, which are relatively high-speed input / output devices. The hard disk drive 1540 stores programs and data used by the CPU 1505. The communication interface 1530 is connected to the network communication device 1598 to transmit / receive programs or data. The CD-ROM drive 1560 reads a program or data from the CD-ROM 1595 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520.

  The input / output controller 1584 is connected to the ROM 1510, the flexible disk drive 1550, and the relatively low-speed input / output device of the input / output chip 1570. The ROM 1510 stores a boot program that is executed when the image correction apparatus starts up, a program that depends on the hardware of the image correction apparatus, and the like. The flexible disk drive 1550 reads a program or data from the flexible disk 1590 and provides it to the hard disk drive 1540 and the communication interface 1530 via the RAM 1520. The input / output chip 1570 connects various input / output devices via the flexible disk drive 1550 or a parallel port, serial port, keyboard port, mouse port, and the like.

  A program executed by the CPU 1505 is stored in a recording medium such as the flexible disk 1590, the CD-ROM 1595, or an IC card and provided by the user. The program stored in the recording medium may be compressed or uncompressed. The program is installed in the hard disk drive 1540 from the recording medium, read into the RAM 1520, and executed by the CPU 1505. The program executed by the CPU 1505 is caused to function as the image processing unit 160, the system control unit 170, and the storage unit 180 described with reference to FIGS.

  The program shown above may be stored in an external storage medium. As the storage medium, in addition to the flexible disk 1590 and the CD-ROM 1595, an optical recording medium such as a DVD or PD, a magneto-optical recording medium such as an MD, a tape medium, a semiconductor memory such as an IC card, or the like can be used. Alternatively, the image correction apparatus may be provided as a program via a network using a storage device such as a hard disk or a RAM provided in a server system connected to a dedicated communication network or the Internet as a recording medium.

  The present invention relates to an imaging apparatus and an image correction technique that can be used in the imaging apparatus. Therefore, the present invention can be used in the imaging device industry and the industry using the image correction technology.

1 shows an example of an imaging apparatus 100 according to the present embodiment. A combination of rotation of the irradiation light polarizing plate 114 and light receiving polarizing plate 126 and exclusion from the optical path is shown. An example of the imaging method of this embodiment is shown. An example of the imaging method of this embodiment is shown. An example of the imaging of a wrinkle partial area specifying image is shown. An example of the imaging of a spot partial area specifying image is shown. An example of imaging of a correction target image is shown. The example of a change of the imaging device 100 is shown. An example of an imaging apparatus 900 that is a modified example of the imaging apparatus 800 is shown. A plane example of the light receiving polarizing plate 926 is shown. The plane example of the light-receiving polarizing plate 928 is shown. An example of a hardware configuration when the image correction apparatus of the present application is configured by an electronic information processing apparatus such as a personal computer is shown.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Imaging device 110 Irradiation part 112 Light source 114 Irradiation light polarizing plate 120 Imaging part 122 Imaging signal processing part 124 Light receiving element 124a Light receiving element 124b Light receiving element 124c Light receiving element 126 Light receiving polarizing plate 130 Polarizing plate drive control part 132 Irradiation light polarizing plate drive part 134 Light receiving polarizer driving unit 140 Display unit 150 Operation unit 152 Mode setting unit 160 Image processing unit 161 Partial region specifying unit 162 Corresponding region specifying unit 163 Image correcting unit 164 Gamma correcting unit 165 Person specifying unit 170 System control unit 172 Control CPU
174 Mode switching unit 180 Storage unit 182 Partial region position storage unit 184 Face pattern storage unit 800 Imaging device 810 Irradiation unit 814 Irradiation light polarizing plate 820 Imaging unit 822 Light reception polarizing plate 824 Light reception polarizing plate 900 Imaging device 924 Light reception element 926 Light reception polarizing plate 926a First transmission region 926b Second transmission region 926e Pixel region 928 Light receiving polarizing plate 928a First transmission region 928b Second transmission region 928c Third transmission region 928e Pixel region 986 Case storage unit 990 Change amount calculation unit 1500 Electronic information processing device 1505 CPU
1510 ROM
1520 RAM
1530 Communication interface 1540 Hard disk drive 1550 Flexible disk drive 1560 CD-ROM drive 1570 Input / output chip 1575 Graphic controller 1580 Display device 1582 Host controller 1584 Input / output controller 1590 Flexible disk 1595 CD-ROM
1598 Network communication device

Claims (18)

A partial region specifying unit that specifies a partial region of the skin that satisfies a predetermined condition in the first image imaged under the first imaging condition;
A corresponding area identifying unit that identifies a corresponding area corresponding to the partial area in a second image captured under a second imaging condition different from the first imaging condition;
An image correcting unit that corrects the second image by performing predetermined image processing on the corresponding area of the second image;
An image correction apparatus comprising: An imaging unit that captures the first image and the second image;
A mode setting unit that switches between a skin measurement mode that causes the imaging unit to capture the first image under the first imaging condition, and a correction imaging mode that causes the imaging unit to capture the second image under the second imaging condition;
The image correction apparatus according to claim 1, further comprising: The imaging unit
A polarizing plate that transmits light in the first polarization direction;
In the skin measurement mode, light from the subject is received through the polarizing plate and the first image is captured. In the correction imaging mode, light from the subject is received without passing through the polarizing plate and the second image is received. A light receiving element for capturing an image;
The image correction apparatus according to claim 2, comprising: An irradiation unit for irradiating the subject with light in the first polarization direction;
The image correction device according to claim 3, wherein the partial region specifying unit specifies the partial region of the skin in which the skin surface satisfies a predetermined condition in the first image. The light receiving element receives light having a polarization substantially parallel to the first polarization direction through the polarizing plate and captures the first image,
The partial region specifying unit specifies the partial region where wrinkles are present in the first image,
The image correction apparatus according to claim 4, wherein the image correction unit performs image processing for correcting wrinkles on the corresponding area of the second image. An irradiation unit for irradiating the subject with light in a second polarization direction substantially perpendicular to the first polarization direction;
The image correction apparatus according to claim 3, wherein the partial region specifying unit specifies a partial region of the skin that satisfies a predetermined condition of the inside of the skin in the first image. The light receiving element receives light having a polarization substantially perpendicular to the first polarization direction through the polarizing plate and captures the first image,
The partial region specifying unit specifies the partial region where a stain exists in the first image,
The image correction device according to claim 6, wherein the image correction unit performs image processing for correcting a stain on the corresponding area of the second image. The first image captured by the imaging unit is gamma-corrected using a first gamma curve, and the second image captured by the imaging unit is gamma-corrected using a second gamma curve different from the first gamma curve. It further includes a gamma correction unit for correcting,
The image correction apparatus according to claim 2, wherein the partial region specifying unit analyzes the first image that has been gamma-corrected using the first gamma curve, and specifies the partial region in the first image.   The image correction apparatus according to claim 8, wherein an inclination of the first gamma curve is larger than an inclination of the second gamma curve in a range of skin luminance in the first image captured by the imaging unit. A partial area position storage unit that stores the position of the partial area of the person in association with the person identification information for identifying the person;
A person specifying unit for specifying a person included in the second image;
Further comprising
In the second image, the corresponding area specifying unit is based on the position of the partial area stored in the partial area position storage unit in association with person identification information for identifying the person specified by the person specifying unit. The image correction apparatus according to claim 1, wherein the corresponding area corresponding to the partial area is specified. The imaging unit
A polarizing plate having a first transmission region that transmits light in a first polarization direction and a second transmission region that transmits light in a second polarization direction substantially perpendicular to the first polarization direction;
A light-receiving element having a first light-receiving region that receives light transmitted through the first transmission region and a second light-receiving region that receives light transmitted through the second transmission region;
Have
The light receiving element picks up the first image by light from a subject received in the first light receiving region or the second light receiving region in the skin measurement mode;
The image correction apparatus according to claim 2. The light receiving element synthesizes a signal by light received in the first light receiving region and a signal by light received in the second light receiving region in the corrected imaging mode to capture the second image;
The image correction apparatus according to claim 11. The polarizing plate further includes a third transmission region that transmits light including light in the first polarization direction and light in the second polarization direction,
The light receiving element further includes a third light receiving region that receives light transmitted through the third transmission region, and captures the second image with light received by the third light receiving region in the correction imaging mode.
The image correction apparatus according to claim 11. A change amount calculation unit for calculating a luminance change amount or a chromaticity change amount of the image before and after treatment in the treatment region from images before and after treatment including the treatment region to be treated;
A case storage unit that stores the luminance change amount or the chromaticity change amount calculated by the change amount calculation unit in association with an index of a successful case or a failure case;
A display unit that displays the second image corrected by the image correction unit as a predicted image of either the successful case or the failed case;
Further comprising
The image correction unit
When the second image is corrected as the predicted image of the successful case, the corresponding region is set by the luminance change amount or the chromaticity change amount stored in the case storage unit in association with the success case index. Image processing is performed on the second image so that the luminance or chromaticity of the image changes,
When correcting the second image as the predicted image of the failure case, the corresponding area is set by the luminance change amount or the chromaticity change amount stored in the case storage unit in association with the failure case index. Image processing is performed on the second image so that the luminance or chromaticity of the
The image correction apparatus according to claim 1. A partial region specifying step for specifying a partial region of the skin that satisfies a predetermined condition in the first image captured under the first imaging condition;
A corresponding area specifying step for specifying a corresponding area corresponding to the partial area in a second image captured under a second imaging condition different from the first imaging condition;
An image correction step of correcting the second image by performing predetermined image processing on the corresponding area of the second image;
An image correction method comprising: Capturing a first image under a first imaging condition;
In the first image, a partial region specifying step for specifying a partial region of the skin that satisfies a predetermined condition;
Capturing a second image under a second imaging condition different from the first imaging condition;
In the second image, a corresponding area specifying step for specifying a corresponding area corresponding to the partial area;
The brightness change amount or chromaticity change amount of the image before and after treatment in the treatment region, calculated from the images before and after treatment including the treatment region to be treated, is correlated with the success case or failure case index, or the luminance change amount or Reading from the case storage unit storing the chromaticity change amount;
When the second image is corrected as a predicted image of the successful case, the corresponding region is correlated with the success case index by the luminance change amount or the chromaticity change amount stored in the case storage unit. When the second image is subjected to image processing so that luminance or chromaticity changes, and the second image is corrected as a predicted image of the failure case, the second image is stored in the case storage unit in association with the failure case index. An image correction step of performing image processing on the second image so that the luminance or chromaticity of the corresponding region changes by the luminance change amount or the chromaticity change amount,
A display step of displaying the second image corrected in the image correction step as a predicted image of either the successful case or the failure case;
Skin diagnosis method equipped with. Calculating luminance change amount or chromaticity change amount of the image of the corresponding region before and after skin treatment;
Storing the calculated luminance change amount or the chromaticity change amount in the case storage unit in association with an index of a successful case or a failure case;
The skin diagnosis method according to claim 16, further comprising: A program for an image correction apparatus for correcting an image, wherein the image processing apparatus is
A partial region specifying unit that specifies a partial region of the skin that satisfies a predetermined condition in the first image imaged under the first imaging condition;
A corresponding area identifying unit that identifies a corresponding area corresponding to the partial area in a second image captured under a second imaging condition different from the first imaging condition; and
An image correcting unit that corrects the second image by performing predetermined image processing on the corresponding area of the second image;
Program to function as.

Images