JP6058902B2 - Skin condition analysis method, skin condition analysis apparatus, skin condition analysis system, program for executing the skin condition analysis method, and recording medium recording the program - Google Patents

Description

  The present invention relates to a skin condition analysis method, a skin condition analysis apparatus, a skin condition analysis system, and a program for causing a computer to execute the skin condition analysis method for analyzing a skin condition by analyzing a skin groove on the skin surface. And a computer-readable recording medium on which the program is recorded.

  The human skin condition (hereinafter referred to as “skin condition”) changes the shape of the skin surface with aging (for example, FIG. 1 (a) is in the twenties, FIG. 1 (b) is in the forties, FIG. 1 (c) is a photograph of the skin surface of the 60s.) At this time, in order to develop a cosmetic suitable for the age, it is necessary to clarify the skin state that changes with aging. In order to evaluate the developed cosmetic, it is necessary to clarify the state of the skin surface before and after the use of the cosmetic.

  Patent Document 1 discloses a technique capable of measuring the three-dimensional shape of a pore by acquiring three-dimensional shape measurement data of a replica obtained by collecting the skin surface state in order to evaluate the pore.

  In Patent Document 2 and Patent Document 3, in order to quantify the epidermis tissue, the luminance value of each pixel is converted from a two-dimensional image captured by the camera so that the variation of the luminance value of the image becomes a predetermined value or more. Thus, a technique for calculating an index quantifying the epidermal tissue is disclosed.

JP 2005-345297 A International Publication No. 2009/142069 Pamphlet JP 2008-61892 A

  Smooth skin (fine skin) is said to be the ideal skin condition. Here, the smooth skin means a skin state in which the skin groove ST and the skin hill SH have a three-dimensional shape (shining skin that reflects light from multiple directions in all directions) (FIG. 2 (a). )). In addition, FIG.2 (b) is the skin state of a planar shape. For this reason, in order to analyze a well-organized skin, it is necessary to analyze the three-dimensional shapes of the skin groove ST and the skin hill SH.

  With the technique disclosed in Patent Document 1, pores (about 100 μm) can be analyzed, but the three-dimensional shape of the skin groove (for example, the depth of the skin groove is about 10 to 20 μm) cannot be analyzed. There was a case. In particular, the amount of change in the three-dimensional shape of the skin groove with aging is several μm or less. For this reason, the technique disclosed in Patent Document 1 sometimes fails to analyze the skin condition in consideration of the amount of change in the shape of the skin groove due to aging. In addition, in the techniques disclosed in Patent Document 2 and Patent Document 3, there are cases where the three-dimensional shape of the skin groove cannot be analyzed due to the analysis using a two-dimensional image.

  The present invention is made under such circumstances, and measures the three-dimensional shape of the skin groove on the skin surface, and can analyze the skin state based on the measured three-dimensional shape of the groove. An object is to provide a skin condition analysis apparatus and a skin condition analysis system.

  According to one aspect of the present invention, there is provided a skin condition analysis method for analyzing the state of the skin surface based on the shape of the skin groove on the skin surface, the three-dimensional shape of the skin surface being measured, Based on the shape acquisition step of acquiring three-dimensional shape data of the skin surface, an original image generation step of generating an original image related to the skin surface based on the acquired three-dimensional shape data, and the generated original image, A skin condition analysis method is provided, comprising: a skin groove extraction step for extracting the skin groove; and a skin evaluation step for evaluating the state of the skin surface based on the extracted skin groove. The skin groove extracting step includes a groove bottom extracting step of extracting a lowest point group of the skin groove. Furthermore, the skin groove extracting step further includes a correction image processing step of performing Gaussian filter processing, binarization processing, and / or noise removal processing.

  According to another aspect of the present invention, there is provided a skin condition analyzing method for analyzing the condition of the skin surface based on the shape of the skin groove on the skin surface, and measuring the three-dimensional shape of the skin surface, Based on the shape acquisition step of acquiring three-dimensional shape data of the skin surface, an original image generation step of generating an original image related to the skin surface based on the acquired three-dimensional shape data, and the generated original image, A skin groove extraction step for extracting the skin groove, and a skin evaluation step for evaluating the state of the skin surface based on the extracted skin groove, wherein the skin evaluation step includes the area, length of the skin groove There is provided a skin condition analysis method characterized by evaluating the condition of the skin surface based on the height, width and / or depth. The skin evaluation step calculates an evaluation age corresponding to the area, the length, the width, and the depth, and evaluates the state of the skin surface based on the calculated evaluation age. A skin condition analysis method is provided. Furthermore, in the shape acquisition step, the three-dimensional shape data is acquired by measuring a replica obtained by collecting the shape of the skin surface.

  According to another aspect of the present invention, there is provided a skin condition analyzing apparatus for analyzing the condition of the skin surface based on the shape of the skin groove on the skin surface, and measuring the three-dimensional shape of the skin surface, Measuring means for acquiring three-dimensional shape data of the skin surface, and extracting the skin groove based on the three-dimensional shape data, and analyzing means for evaluating the state of the skin surface based on the skin groove, The analysis means includes an image generation unit that generates an original image related to the skin surface based on the three-dimensional shape data, a skin groove analysis unit that extracts the skin groove based on the generated original image, and the extracted And a result evaluating unit that evaluates the condition of the skin surface based on the skin groove. The skin groove analysis unit may correct the original image by any one or more of Gaussian filter processing, binarization processing, and / or noise removal processing. Provided. Furthermore, a skin condition analyzing apparatus is provided, wherein the skin groove analyzing unit extracts a lowest point group of the skin groove.

  According to the present invention, the three-dimensional shape of the skin groove on the skin surface can be measured, and the skin condition can be analyzed based on the measured three-dimensional shape of the skin groove.

It is explanatory drawing explaining the surface of the skin classified by age. It is the schematic explaining the skin with the texture. It is a schematic block diagram explaining an example of the skin condition analyzer which concerns on embodiment of this invention. It is a functional block diagram which shows an example of the function of the skin condition analyzer which concerns on embodiment of this invention. It is a flowchart figure explaining an example of the operation | movement which the skin condition analyzer which concerns on embodiment of this invention analyzes. It is a flowchart figure explaining an example of the operation | movement which the skin condition analyzer which concerns on Example 1 of this invention analyzes. It is explanatory drawing explaining the skin surface which the skin condition analyzer which concerns on Example 1 of this invention analyzes. It is explanatory drawing explaining the analysis result of the skin condition analyzer which concerns on Example 1 of this invention. It is explanatory drawing explaining the evaluation result (the area of a skin groove, and the length of a skin groove) of the skin condition analyzer which concerns on Example 1 of this invention. It is explanatory drawing explaining the evaluation result (the width of a skin groove, and the depth of a skin groove) of the skin condition analyzer which concerns on Example 1 of this invention. It is a schematic block diagram explaining an example of the skin condition analysis system which concerns on Example 2 of this invention.

  Non-limiting exemplary embodiments of the present invention will be described with reference to the accompanying drawings. In the description of all the attached drawings, the same or corresponding parts or parts are denoted by the same or corresponding reference numerals, and redundant description is omitted. Also, the drawings are not intended to show the relative ratio between parts or parts. Accordingly, specific dimensions in the drawings can be determined by one skilled in the art in light of the following non-limiting embodiments.

(Configuration of skin condition analyzer)
The schematic block diagram of the skin condition analyzer which concerns on embodiment of this invention is shown in FIG.

  As shown in FIG. 3, the skin condition analysis apparatus 100 according to the embodiment of the present invention measures the shape of the skin groove on the skin surface, and based on the measured shape of the skin groove (hereinafter referred to as “ It is a device that analyzes skin condition. In this embodiment, the skin condition analyzing apparatus 100 instructs each component of the entire skin condition analyzing apparatus 100 to operate, and controls the control means 10 for controlling the operation, and measures the three-dimensional shape of the skin surface to thereby determine the skin surface. Measuring means 20 for obtaining the three-dimensional shape data, and analyzing means 30 for extracting the skin groove based on the three-dimensional shape data and evaluating the skin state based on the extracted skin groove. Further, in this embodiment, the skin condition analysis apparatus 100 includes a storage unit 40 that stores measurement conditions and measurement results of the measurement unit 20, analysis conditions, analysis results, and evaluation results of the analysis unit 30, and measurement of the measurement unit 20. Interface means 50 is provided for inputting conditions and the like from the skin condition analysis apparatus 100 to the skin condition analysis apparatus 100 and outputting measurement results and the like to the skin condition analysis apparatus 100.

  In the following description, the part (part) for analyzing the skin state is the cheek part of the subject in this embodiment. In addition, the site | part (part) which analyzes a skin state is not limited to a cheek part, The skin state of arbitrary site | parts (parts) can be analyzed.

  The control means 10 is a means for instructing each component of the skin condition analyzing apparatus 100 (such as a measuring unit 20 described later) to control the operation of each component. In the present embodiment, the control means 10 controls the measurement means 20 based on measurement conditions and the like input using the interface means 50 (input unit 51 described later). Further, the control means 10 controls the analysis means 30 (described later) based on the analysis conditions and the evaluation conditions input using the interface means 50. Further, the control unit 10 outputs the measurement result, the analysis result, the evaluation result, and the like to the interface unit 50 (an output unit 52 and a display unit 53 described later).

  The measuring unit 20 is a unit that measures the three-dimensional shape of the skin surface, acquires three-dimensional shape data of the skin surface (hereinafter referred to as “three-dimensional shape data Df”), and outputs the data to the analyzing unit 30. In the present embodiment, the measuring means 20 includes a test unit 21 that arranges the skin surface (or replica) to be measured, an imaging unit 22 that measures (images) the three-dimensional shape of the skin surface, and the test unit 21. And a drive unit 23 that changes a relative positional relationship with the skin surface.

  In the present embodiment, the test unit 21 arranges a replica collected on the skin surface. The replica used for measurement is a replica with a diameter of about 30 mm collected at a site for analyzing the skin condition. Moreover, the collection position of the skin surface by the replica is not limited to the cheek, but can be collected from the skin surface of an arbitrary site (part). Further, the skin state may be directly measured (imaged) by the imaging unit 22 described later without collecting the replica.

  The imaging unit 22 measures a three-dimensional shape of a replica (or skin surface) arranged in the test unit 21. In this embodiment, the imaging unit 22 acquires, as a shape acquisition step, the three-dimensional shape data Df of the collected replica as image data using a confocal microscope. The confocal microscope can be configured by using a condensing lens, a beam splitter, an objective lens, a pinhole, a photodetector, and the like. Further, the confocal microscope can collect the emitted light emitted from the light source (laser light source) with a condenser lens, transmit the light through a beam splitter, and irradiate the replica with the objective lens. Further, in the confocal microscope, the reflected light reflected by the replica surface of the irradiation light can be transmitted through the objective lens, reflected by the beam splitter, and incident on the photodetector through the pinhole. At this time, the confocal microscope can acquire the replica three-dimensional shape data Df by detecting the reflected light.

  The drive unit 23 changes the relative positional relationship between the test unit 21 (replica) and the imaging unit 22 (confocal microscope). Further, the drive unit 23 can move the imaging unit 22 (such as an objective lens of a confocal microscope) in the optical axis direction of the irradiation light in order to acquire the three-dimensional shape data Df of the replica. Furthermore, the drive unit 23 can change the position of the test unit 21 in order to place the replica on the test unit 21. The driving unit 23 may be a well-known driving device (such as a parallel movement device and a rotation movement device).

  The analysis unit 30 is a unit that evaluates (analyzes) the skin state of the part from which the replica is collected based on the three-dimensional shape data Df of the replica (or skin surface) acquired by the measurement unit 20. In this embodiment, the analysis unit 30 includes an image generation unit 31 that generates a three-dimensional image of the skin state (hereinafter referred to as “original image Do”) based on the three-dimensional shape data Df acquired by the measurement unit 20. A skin groove analysis unit 32 that extracts an image related to the skin groove (hereinafter referred to as “skin groove ST”) based on the generated original image Do, and a result evaluation unit that evaluates the skin state based on the extracted skin groove ST 33.

  As the original image generation step, the image generation unit 31 generates the original image Do based on the three-dimensional shape data Df acquired by the imaging unit 22 (measurement unit 20). Specifically, the image generation unit 31 synthesizes a plurality of optical tomographic images (three-dimensional shape data Df) acquired by the imaging unit 22 while changing the in-focus position by the driving unit 23, thereby generating a replica. A three-dimensional image (original image Do) can be synthesized (generated).

  The skin groove analysis unit 32 extracts the skin groove ST based on the generated original image Do as the skin groove extraction step. In the present embodiment, the skin groove analysis unit 32 generates an image (hereinafter referred to as “corrected image Dr”) obtained by correcting the original image Do using Gaussian filter processing and / or noise removal processing (hereinafter referred to as “corrected image Dr”). 4), a skin groove extraction unit 32E (FIG. 4) that extracts a skin groove ST using Gaussian filter processing and binarization processing based on the generated correction image Dr, and noise included in the extracted skin groove ST A noise removing unit 32N (FIG. 4) that generates an image from which noise is removed (hereinafter referred to as “image Dn after noise removal”), and information on the groove bottom of the skin groove ST based on the image Dn after noise removal. The lower point group extraction unit 32Z (FIG. 4) and the skin state calculation unit 32C (FIG. 4) that calculates the skin state based on the extracted information about the groove bottom.

  The image correction unit 32R can generate the corrected image Dr by correcting the original image Do using Gaussian filter processing and / or noise removal processing. Here, the Gaussian filter process (Gaussian Filter Process) is a process of correcting the image (smoothing process) to remove the inclination and warp distortion of the entire replica. Specifically, the image correction unit 32R uses a Gaussian filter having a wavelength (for example, a wavelength of 2.4 mm) that does not affect the image portion representing the shape of the pores, skin grooves, and skins, and focuses attention on the image. An image is corrected by a Gaussian distribution function that has a greater weight when calculating an average value as it is closer to the pixel and becomes smaller as it is farther from the target pixel of the image.

  The skin groove extraction unit 32E extracts the skin groove ST based on the generated correction image Dr. Specifically, the skin groove extraction unit 32E, as the correction image processing step, has a wavelength (for example, 0.4 mm) of Gaussian that can smooth the pore and skin shape without affecting the skin groove shape. After smoothing the corrected image Dr by the filter process, the skin groove part (skin groove ST) is specified by the binarization process. Accordingly, the skin groove extraction unit 32E can extract the skin groove ST from the correction image Dr. Here, the binarization processing sets a predetermined threshold value for the luminance value (brightness) of each pixel of the image, and sets it to “0” if it is less than the predetermined threshold value, and “1” if it is greater than or equal to (2). This is image processing.

  As a corrected image processing step, the noise removal unit 32N removes noise included in the extracted skin groove ST and generates a noise-removed image Dn. Here, as the noise removal processing, a smoothing filter, a median filter, and other noise removal filters can be used. In the present embodiment, the skin groove extraction unit 32E performs a labeling process on the skin groove part extracted by the binarization process to remove a small-sized lump, thereby removing noise. The minute size can be a value corresponding to the size (size) of the skin groove to be extracted. Further, the minute size can be set to a predetermined value by numerical calculation, experiment, or the like.

  The lowest point group extraction unit 32Z extracts information related to the groove bottom of the skin groove ST based on the image Dn after noise removal as a groove bottom extraction step. Specifically, in the present embodiment, the lowest point group extraction unit 32Z is based on the coordinates in the z-axis direction (the direction toward the inside of the skin) of the post-noise-removed image Dn of the skin state based on the three-dimensional shape data Df. Thus, the lowest point group STz of the skin groove ST can be specified. Thereby, the skin groove analysis part 32 can acquire the lowest point group STz of the skin groove ST as information regarding the groove bottom.

  The skin condition calculation unit 32C calculates the shape of the skin groove (the surface area, length, width, and depth of the skin groove) based on the noise-removed image Dn and the extracted information about the groove bottom. Specifically, in the present embodiment, the skin groove shape analyzing unit 32C is configured based on the lowest point group STz of the skin groove ST and the total area Sa (image Dn after noise removal) of the analysis range (imaging range). The area Sf, the length Lf, the width Wf, and the depth Df of the skin groove can be calculated from (1) to Expression (4).

Sf = (ΣSTs) / Sa × 100 [%] Formula (1)
Lf = Σ (STz _n (x, y) −STz _n−1 (x, y)) [mm ² / mm] Formula (2)
Wf = Sa · Sf / Lf [μm] Formula (3)
Df = ΣSTz _n (z) / n [μm] Formula (4)
Here, STs is the area of skin groove ST on the xy plane, Σ is the sum, STz _n (x, y) is the total number n of the nth point of the lowest point group STz on the xy plane (skin surface) The coordinate, STz _n (z), is the z coordinate of the nth point in the total number n of the lowest point group STz. The method of calculating the skin groove area Sf, length Lf, width Wf, and depth Df is not limited to the above formula.

  As a skin evaluation step, the result evaluation unit 33 evaluates the skin condition (skin groove area Sf, length Lf, width Wf, and depth Df) calculated based on the skin groove ST. Further, the result evaluation unit 33 calculates the evaluation age corresponding to the area, length, width and depth of the skin groove as the skin evaluation step, and uses the calculated evaluation age and the input unit 51 (interface means 50). The skin condition may be evaluated by comparing with the evaluation condition (for example, the age of the subject) input. Furthermore, the result evaluation unit 33 may evaluate the skin groove ST using a predetermined evaluation index.

  Specifically, the result evaluation unit 33 can compare the calculated skin state with a predetermined evaluation index, and can evaluate the skin state based on the magnitude or difference thereof. As a result, it is possible to obtain a quantitative index of how “good” the skin condition is instead of dividing it into “good” or “bad”. In addition, it is possible to obtain an evaluation result of how close the analyzed skin condition is to the predicted value, and to obtain guidelines for subsequent research and development.

  Here, the predetermined evaluation index may be a value corresponding to the collected skin region, age, skin exposure environment, and the like. In addition, the predetermined evaluation index can be based on the skin condition when it was collected last time (evaluation of change over time). Furthermore, the predetermined evaluation index can be a value determined in advance by numerical calculation, experiment, or the like.

  The storage unit 40 includes a measurement result measured by the measurement unit 20 of the skin condition analysis apparatus 100, an analysis result analyzed by the analysis unit 30, an evaluation result evaluated, and a measurement condition and analysis input by the interface unit 50 (input unit 51). Conditions (such as filters used for image correction) and evaluation conditions (such as evaluation indices) are stored. In addition, the storage unit 40 stores information and a control program necessary for the control unit 10 to control the operation of each component of the skin condition analysis apparatus 100. The storage means 40 can use a known technique.

  The interface means 50 is information transmission means or information communication means for inputting / outputting information to / from the skin condition analysis apparatus 100. In this embodiment, the interface unit 50 inputs the measurement condition, analysis condition, and evaluation condition from the outside to the skin condition analysis apparatus 100, and the measurement result, analysis result, and evaluation result to the outside of the skin condition analysis apparatus 100. It has the output part 52 which outputs, and the display part 53 which displays a measurement result, an analysis result, an evaluation result, etc. The interface unit 50 can use a known technique.

(Function of skin condition analyzer)
The function of the skin condition analysis apparatus 100 according to the present embodiment analyzing the skin condition will be described with reference to FIG. FIG. 4 is a functional block diagram illustrating an example of functions of the skin condition analysis apparatus 100 (analysis means 30).

  In FIG. 4, the skin condition analysis apparatus 100 acquires the replica three-dimensional shape data Df by the imaging unit 22 (measurement means 20) in order to start analysis of the skin condition in response to an operation instruction of the interface means 50. It outputs to the production | generation part 31 (analysis means 30) (30 inches in a figure).

  Next, the image generation unit 31 generates an original image Do based on the three-dimensional shape data Df acquired by the imaging unit 22, and temporarily stores the original image Do in the original image storage unit 31m. Thereafter, the control means 10 outputs the original image Do to the image correction unit 32R.

  The image correcting unit 32R generates a corrected image Dr based on the original image Do generated by the image generating unit 31, and temporarily stores it in the corrected image storage unit 32Rm. Thereafter, the control means 10 outputs the corrected image Dr to the skin groove extraction unit 32E. Here, the image correction unit 32R can generate the corrected image Dr by Gaussian filter processing.

  The skin groove extraction unit 32E uses the correction image Dr generated by the image correction unit 32R to extract the skin groove ST (image related to the skin groove) in the correction image Dr, and temporarily stores the skin groove ST in the extraction skin groove storage unit 32Em. Remember me. Thereafter, the control unit 10 outputs the skin groove ST to the noise removing unit 32N. Here, the skin groove extraction unit 32E can process the correction image Dr by Gaussian filter processing and / or binarization processing, and can extract the skin groove ST from the image after the processing.

  The noise removing unit 32N removes noise included in the skin groove ST extracted by the skin groove extracting unit 32E, generates a noise-removed image Dn, and temporarily stores the noise-removed image storage unit 32Nm. Thereafter, the control means 10 outputs the noise-removed image Dn to the lowest point group extraction unit 32Z. Here, the noise removal unit 32N can generate the noise-removed image Dn using a noise removal filter such as a median filter.

  The lowest point group extraction unit 32Z uses the skin ST extracted by the skin groove extraction unit 32E, the noise-removed image Dn generated by the noise removal unit 32N, and the three-dimensional shape data Df acquired by the imaging unit 22, The lowest point group STz of the groove ST is extracted and temporarily stored in the lowest point group storage unit 32Zm. Thereafter, the control means 10 outputs the skin groove ST and the lowest point group STz to the skin condition calculation unit 32C. Here, the lowest point group extraction unit 32Z scans in one direction of the image to be extracted (for example, the x-axis direction or the y-axis direction on the skin surface (xy plane)), and sequentially extracts the lowest point. Also good.

  The skin condition calculation unit 32C uses the skin ST extracted by the skin groove extraction unit 32E, the lowest point group STz extracted by the lowest point group extraction unit 32Z, and the three-dimensional shape data Df acquired by the imaging unit 22, The skin condition (skin groove area Sf, length Lf, width Wf and depth Df) is calculated and temporarily stored in the calculation result storage unit 32Cm. Thereafter, the control unit 10 outputs the calculated result (skin state) to the result evaluation unit 33. Here, the skin condition calculation unit 32C can calculate the skin condition using Equations (1) to (4).

  Next, the result evaluation unit 33 evaluates the skin state based on the result (skin state) calculated by the skin state calculation unit 32C. Further, the result evaluation unit 33 can evaluate the skin state based on the evaluation age Ae corresponding to the result (skin state) calculated by the skin state calculation unit 32C. Furthermore, the result evaluation unit 33 may compare the calculated result (skin state) with a predetermined evaluation index, and may evaluate the skin state based on the magnitude or difference thereof. When the evaluation is completed, the evaluation result is output to the interface means 50 (output unit 52, display unit 53) (30out in the figure).

  As described above, each configuration of the skin condition analysis apparatus 100 according to the present embodiment has a function for analyzing the skin condition. The skin condition analysis apparatus 100 includes an original image storage unit 31m, a corrected image storage unit 32Rm, an extracted skin groove storage unit 32Em, a noise-removed image storage unit 32Nm, a lowest point group storage unit 32Zm, and a calculation result storage unit 32Cm. You may include in the memory | storage means 40. FIG. Further, the skin condition analyzing apparatus 100 may store the result regarding the skin condition evaluated by the result evaluation unit 33 in the storage unit 40.

(Operation to analyze skin condition)
A skin condition analysis method in which the skin condition analysis apparatus 100 according to the embodiment of the present invention analyzes and evaluates a skin condition will be described with reference to FIG. FIG. 5 is a flowchart for explaining an example of an operation analyzed by the skin condition analysis apparatus 100 according to the present embodiment.

  As shown in FIG. 5, in step S <b> 501, the skin condition analysis apparatus 100 according to the present embodiment first arranges a replica (or skin surface) to be measured in the test unit 21 (measurement means 20). In the skin condition analysis apparatus 100, measurement conditions, analysis conditions, and evaluation conditions are input by the input unit 51 (interface means 50). Thereafter, the process proceeds to step S502.

  Next, in step S502, the skin condition analysis apparatus 100 acquires the three-dimensional shape data Df by the imaging unit 22 (measurement unit 20) as a shape acquisition step, and the image generation unit 31 (analysis unit 30) as an original image generation step. To generate the original image Do. Thereafter, the process proceeds to step S503.

  In step S503, the skin condition analysis apparatus 100 extracts the skin groove ST by the skin groove analysis unit 32 (analysis means 30) as a skin groove extraction step. Moreover, the skin condition analysis apparatus 100 calculates a skin condition by the skin groove analysis part 32 as a skin evaluation step. Thereafter, the process proceeds to step S504.

  In step S504, the skin condition analysis apparatus 100 stores the analysis result (step S503) by the recording unit 40. Moreover, the skin condition analysis apparatus 100 outputs the analysis result to the result evaluation part 33 (analysis means 30). Thereafter, the process proceeds to step S505.

  In step S505, the skin condition analysis apparatus 100 evaluates the analysis result by the result evaluation unit 33 as a skin evaluation step. Thereafter, the process proceeds to step S506. Here, skin condition analysis apparatus 100 evaluates the skin condition (skin groove area Sf, length Lf, width Wf, and depth Df) calculated based on skin groove ST. Further, the result evaluation unit 33 calculates an evaluation age corresponding to the skin condition (skin area Sf, length Lf, width Wf, and depth Df), respectively, and the calculated evaluation age and input unit 51 (interface unit 50). The skin condition may be evaluated by comparing with the evaluation conditions (such as the age of the subject) input by. Furthermore, the result evaluation unit 33 may evaluate the skin state using a predetermined evaluation index.

  Next, in step S506, the skin condition analysis apparatus 100 determines whether or not the analysis of the skin condition is terminated by the control unit 10. That is, the control means 10 determines whether or not to end the analysis of the skin condition based on the analysis condition and the evaluation condition input by the input unit 51 (interface means 50). When the analysis ends, the process proceeds to END in the figure. When analyzing again, the process returns to step S502. Note that the skin condition analysis apparatus 100 may proceed to END in the drawing without performing the determination in step S506.

  Thus, the operation (skin condition analysis method) in which the skin condition analysis apparatus 100 analyzes and evaluates the skin condition is completed.

(Program and recording medium on which the program is recorded)
The program Pr according to the present invention is a skin condition analyzing method for analyzing the condition of the skin surface based on the shape of the skin groove on the skin surface, and measuring the three-dimensional shape of the skin surface, A shape acquisition step for acquiring the three-dimensional shape data, an original image generation step for generating an original image related to the skin surface based on the acquired three-dimensional shape data, and the skin based on the generated original image A skin groove extraction step for extracting a groove and a skin evaluation step for evaluating the state of the skin surface based on the extracted skin groove are performed. Further, the skin groove extraction step of the program Pr according to the present invention may include a groove bottom extraction step of extracting the lowest point group of the skin groove. Furthermore, the skin groove extraction step of the program Pr according to the present invention may further include a correction image processing step of performing Gaussian filter processing, binarization processing, and / or noise removal processing.

  The program Pr according to the present invention is a skin condition analyzing method for analyzing the condition of the skin surface based on the shape of the skin groove on the skin surface, and measuring the three-dimensional shape of the skin surface, Based on the shape acquisition step of acquiring three-dimensional shape data of the skin surface, an original image generation step of generating an original image related to the skin surface based on the acquired three-dimensional shape data, and the generated original image, A skin groove extraction step for extracting the skin groove, and a skin evaluation step for evaluating the state of the skin surface based on the extracted skin groove, and the skin evaluation step includes an area of the skin groove, The length, width and / or depth can be calculated. In addition, the skin evaluation step of the program Pr according to the present invention can evaluate the state of the skin surface based on the area, the length, the width and / or the depth. Furthermore, the skin evaluation step of the program Pr according to the present invention calculates an evaluation age corresponding to the area, the length, the width, and the depth, and the state of the skin surface based on the calculated evaluation age Can be evaluated.

  According to these configurations, the program Pr according to the present invention can obtain the same effects as the skin condition analysis apparatus 100 according to the present invention.

  Further, the present invention may be a recording medium Md that can be read by a computer in which the program Pr is recorded. As the recording medium Md on which the program Pr is recorded, a flexible disk, a CD-ROM, a memory card, and other computer-readable media can be used.

  The present invention will be described using examples including the skin condition analysis apparatus 100 according to the embodiment. The present invention can be used for any device other than the present embodiment as long as it analyzes (evaluates) the state of the skin surface (skin state) based on the shape of the skin groove on the skin surface. For example, in order to confirm the effect of cosmetics, it can use for what analyzes the skin state before and behind application of cosmetics.

Example 1
(Configuration of skin condition analyzer)
FIG. 3 shows the configuration of the skin condition analysis apparatus 200 according to this embodiment. The configuration of the skin condition analysis apparatus 200 is the same as the configuration of the skin condition analysis apparatus 100 of the embodiment, and a description thereof will be omitted.

(Operation in which skin condition analyzer evaluates skin condition)
A skin condition analysis method in which the skin condition analysis apparatus 200 according to the present embodiment analyzes the skin condition will be described with reference to FIGS.

  FIG. 6 is a flowchart illustrating an example of an operation analyzed by the skin condition analysis apparatus 200 according to the present embodiment.

  FIG. 7A shows the surface of the replica transferred from the skin surface analyzed by the skin condition analysis apparatus 200 according to the present embodiment. FIG. 7B shows a three-dimensional image (original image Do) based on the result of three-dimensional measurement of the surface of the replica. FIG. 7C shows a three-dimensional image (corrected image Dr) based on the result of three-dimensional measurement of the surface of the replica.

  FIG. 8A shows the analysis result of the corrected image Dr analyzed by the skin condition analysis apparatus 200 according to the present embodiment. FIG. 8B shows a binarization process after performing smoothing by Gaussian filter processing of a wavelength (for example, 0.4 mm) that smoothes the shape of pores and skins without affecting the shape of the skin groove. The analysis result of the correction | amendment image Dr which extracted the skin groove is shown. FIG. 8C illustrates an image (noise-removed image Dn) obtained by enlarging a part of the corrected image Dr in FIG. FIG. 8D shows an analysis result explaining the lowest point group STz of the skin groove. FIG. 8E shows an enlarged view of the analysis result of the lowest point group STz of the skin groove. FIG. 8F shows an enlarged view of the analysis result obtained by extracting the skin groove by the thinning process.

  FIG. 9A shows an evaluation result of the area of the skin groove of the skin condition analysis apparatus 200 according to the present embodiment. FIG. 9B shows the evaluation result of the length of the skin groove. Fig.10 (a) is the evaluation result of the width | variety of the skin groove | channel of the skin condition analyzer which concerns on a present Example. FIG. 10B shows the evaluation result of the depth of the skin groove. In FIGS. 9 (a), 9 (b), 10 (a) and 10 (b), A, B, C, D and E on the horizontal axis are 5-9 years old, 10-19 years old. Shown are subjects aged 20-44, 45-59 and 60-90.

  As shown in FIG. 6, in step S <b> 601, the skin condition analysis apparatus 200 captures a three-dimensional shape by capturing an image of a replica (FIG. 7A) placed on the test unit 21 by the imaging unit 22 (measurement unit 20). Data Df is acquired, and an original image Do (FIG. 7B) is generated by the image generation unit 31 (analyzing means 30). Thereafter, the process proceeds to step S602.

  Next, in step S602, the skin condition analysis apparatus 200 generates a correction image Dr by the image correction unit 32R (skin groove analysis unit 32) based on the original image Do generated by the image generation unit 31. Specifically, the image correcting unit 32R generates a corrected image Dr (FIG. 7C) from which the inclination of the entire replica of the original image Do (FIG. 7B) is removed by Gaussian filter processing. Next, the image correcting unit 32R generates a corrected image Dr (FIG. 8A) obtained by removing (smoothing) relatively large irregularities of the corrected image Dr (FIG. 7C) by Gaussian filter processing. Thereafter, the skin condition analysis apparatus 200 proceeds to step S603.

  In step S603, the skin condition analysis apparatus 200 extracts the skin groove ST from the corrected image Dr by the skin groove extraction unit 32E (skin groove analysis unit 32). Specifically, the skin groove extraction unit 32E specifies and extracts the skin groove ST (FIG. 8B) from the correction image Dr (FIG. 8A) by Gaussian filter processing and / or binarization processing. To do. Thereafter, the skin condition analysis apparatus 200 proceeds to step S604.

  In step S604, the skin condition analysis apparatus 200 performs noise removal after removing noise from the skin groove ST (FIG. 8B) extracted by the skin groove extraction unit 32E by the noise removal unit 32N (skin groove analysis unit 32). An image Dn (FIG. 8C) is generated. Thereafter, the skin condition analysis apparatus 200 proceeds to step S605.

  In step S605, the skin condition analysis apparatus 200 uses the lowest point group extraction unit 32Z (skin groove analysis unit 32) to generate the noise-removed image Dn (FIG. 8C) and the three-dimensional shape data Df (step S601). The lowest point group STz (FIG. 8D) of the skin groove ST is extracted. Here, the lowest point group extraction unit 32Z scans in one direction of the image to be extracted (for example, the x-axis direction or the y-axis direction on the skin surface (xy plane)), and extracts the lowest point group STz. Also good. Thereafter, the skin condition analysis apparatus 200 proceeds to step S606.

  8E and 8F show the lowest point group STz obtained by extracting the lowest point and the fine line STn obtained by the thinning process. FIG. 8E and FIG. 8F both show the shape of the groove bottom of the skin groove ST. As shown in FIGS. 8 (e) and 8 (f), the extraction of the lowest point (FIG. 8 (e)) is more effective than the thinning process (FIG. 8 (f)). It can be seen that the shape of the groove bottom is accurately approximated. That is, the skin condition analysis apparatus 200 according to the present embodiment uses the lowest point group extraction unit 32Z to generate the skin groove ST based on the skin groove ST (FIG. 8C) and the three-dimensional shape data Df (step S601). The lowermost point group STz (FIG. 8D) can be extracted, and the skin groove ST and the three-dimensional shape inside the skin groove ST can be extracted.

  Next, in step S606 of FIG. 6, the skin condition analysis apparatus 200 uses the skin condition calculation unit 32C skin groove analysis unit 32) and the skin ST (FIG. 8 (c)) extracted by the skin groove extraction unit 32E. Using the lower point group STz (FIG. 8D) and the three-dimensional shape data Df acquired by the imaging unit 22, the skin state (skin groove area Sf, length Lf, width Wf, and depth Df) is calculated. . Specifically, the skin condition analysis apparatus 200 can calculate the skin condition by using the formula (1) to the formula (4) by the skin condition calculation unit 32C. Thereafter, the skin condition analysis apparatus 200 proceeds to step S607.

  In step S607, the skin condition analysis apparatus 200 evaluates the skin condition calculated by the skin condition calculation unit 32C by the result evaluation unit 33. Specifically, the skin condition analysis apparatus 200 uses the reference values (FIGS. 9A and 9B) of the skin condition (skin area Sf, length Lf, width Wf, and depth Df) of each age. 10 (a) and 10 (b)) are stored in advance in the storage means 40, and from the skin state (skin area Sf, length Lf, width Wf, and depth Df) calculated in step S606. The evaluation age Ae is calculated. That is, in the skin condition analysis apparatus 200, the result evaluation unit 33 compares the calculated skin groove area Sf with FIG. 9A, and the age corresponding to the calculated area Sf by linear interpolation (evaluation age Ae). Is calculated. Similarly, the skin condition analyzing apparatus 200 uses the result evaluation unit 33 to determine the length Lf, the width Wf, and the depth Df of the skin groove, and FIGS. 9B, 10A, and 10B. Can be calculated to calculate the evaluation age Ae.

  Next, the skin condition analysis apparatus 200 can output the calculated evaluation age Ae as an evaluation result by the output unit 52 and the display unit 53 (interface means 50). The skin condition analysis apparatus 200 can output the result of comparing the actual age Ar (age of the subject who collected the replica) and the calculated evaluation age Ae by the output unit 52 and the display unit 53. Thereby, the skin condition analysis apparatus 200 can quantitatively evaluate the skin condition.

  When the evaluation of the skin condition is completed, the process proceeds to END in the figure, and the skin condition analysis apparatus 200 ends the operation of evaluating the skin condition.

(Example 2)
The present invention will be described using the skin condition analysis system of Example 2.

(Configuration of skin condition analysis system)
FIG. 11 is an example of a schematic configuration diagram of the skin condition analysis system of the present embodiment.

  As shown in FIG. 11, the skin condition analysis system 300 includes a skin condition analysis device 300S and an external device 300E. Since the basic configuration of the skin condition analyzing apparatus 300S is the same as that of the skin condition analyzing apparatus 200 of the first embodiment (FIG. 3), only different configurations will be described.

  In this embodiment, the skin condition analyzing apparatus 300S includes NW means (network means, communication means) 300Sn. Similarly, the external device 300E has NW means 300En. Skin condition analyzing apparatus 300S and external apparatus 300E can communicate with each other by wire or wirelessly by means of NW means 300Sn and NW means 300En. The external device 300E can use cloud computing or the like.

  The external device 300E includes an analysis unit 30, a storage unit 40E, and an interface unit 50E. The external apparatus 300E can calculate the skin condition (skin groove area Sf, length Lf, width Wf, and depth Df) based on the information output from the skin condition analysis apparatus 300S. Note that the external device 300E may include only a part of the analysis unit 30.

  As described above, the skin condition analysis system 300 can reduce the processing amount in the skin condition analysis apparatus 300S, and thus the skin condition analysis apparatus 300S can be reduced in size, weight, and simplification. The skin condition analysis system 300 can use a PC or the like for the external device 300E. Further, the external device 300E can store the past skin condition of the client (cosmetic user, subject, etc.) in the storage unit 40E. For this reason, the skin condition analysis system 300 can evaluate the temporal change of the skin condition of the client.

(Operation in which skin condition analyzer evaluates skin condition)
The skin condition analysis method by which the skin condition analysis system 300 according to the present embodiment evaluates the skin condition is the same as that in the first embodiment, and thus description thereof is omitted.

  Although the present invention has been described above with reference to the exemplary embodiments and examples, the present invention is not limited thereto, and various modifications and changes can be made in light of the appended claims. .

Note that the skin condition analysis method, the skin condition analysis apparatus, and the skin condition analysis system according to the present invention may be combined with other analysis methods for analyzing dullness, wrinkles, spots, texture, pores, and the like of the skin. Good. In addition, the skin condition analysis method, skin condition analysis apparatus and skin condition analysis system according to the present invention are combined with skin sebum amount, skin elasticity, skin color analysis, pigmentation status and other skin diagnosis results, The skin condition may be evaluated. Thereby , in the sale of cosmetics, etc., not only specialists, but using the evaluation results of the skin condition analysis method, the skin condition analysis device and the skin condition analysis system according to the present invention, quantitative skin condition evaluation (diagnosis, Beauty counseling, etc.) can be realized.

100, 200, 300S: Skin condition analysis apparatus 10: Control means 20: Measuring means, 21: Test part, 22: Imaging part, 23: Imaging part 30: Analyzing means, 31: Image generating part, 32: Skin groove analysis Unit 33: result evaluation unit 40: storage unit 50: interface unit 51: input unit 52: output unit 53: display unit 300: skin condition analysis system 300E: external device 300Sn, 300En: NW device (communication unit)
Pr: Program Md: Storage medium Df: Three-dimensional shape data Do: Original image Dr: Corrected image Dn: Image after noise removal ST: Skin groove STz: Bottom point of skin groove (bottom point group)
SH: leather hill Sf: skin groove area Lf: skin groove length Wf: skin groove width Df: skin groove depth
Ae: Evaluation age Ar: Actual age

Claims (14)

A skin condition analysis method for analyzing the condition of the skin surface based on the shape of the skin groove on the skin surface,
A shape acquisition step of measuring a three-dimensional shape of the skin surface while changing a focus position using a confocal microscopic environment and acquiring a plurality of optical cross-sectional images which are three-dimensional shape data of the skin surface When,
An original image generation step of generating an original image related to the skin surface by synthesizing the plurality of optical cross-sectional images that are the acquired three-dimensional shape data;
A Gaussian filter process and a binarization process are performed on the original image to generate a correction image, the skin groove is extracted based on the generated correction image, and the skin groove extracted using a median filter is extracted. A labeling process is performed to remove a small-sized lump contained in the skin groove to create a noise-removed image, and the plurality of optical cross-sectional images are referred to, and the noise-removed image is inside the skin. A skin groove analysis step for extracting a groove bottom composed of a lowermost point group of the skin groove based on a coordinate in a direction to go;
A skin evaluation step for evaluating the state of the skin surface based on the shape of the skin groove calculated from the extracted groove bottom ;
The skin condition analysis method characterized by including. The skin according to claim 1 , wherein the skin evaluation step calculates an area, length, width and / or depth of the skin groove based on the image after noise removal and the groove bottom. State analysis method. The area, the length, the width and the depth of the skin groove are calculated by the following formulas,
Area Sf = (ΣSTs) / Sa × 100 [%];
Length Lf = Σ (STzn (x, y) −STzn−1 (x, y)) [mm ² / mm];
Width Wf = Sa · Sf / Lf [μm];
Depth Df = ΣSTzn (z) / N [μm];
STs is the area of skin groove ST on the xy plane, Σ is the sum, STzn (x, y) is the coordinate on the xy plane (skin surface) of the nth point of the total number N of the lowest point group STz, STzn ( z) is the z coordinate of the nth point in the total number N of the lowest point group STz.
The skin condition analysis method according to claim 2 . The skin condition analysis according to claim 2 or 3 , wherein the skin evaluation step evaluates a state of the skin surface based on the area, the length, the width and / or the depth. Method. The skin evaluation step calculates an evaluation age corresponding to the area, the length, the width and / or the depth, and evaluates the state of the skin surface based on the calculated evaluation age. The skin condition analyzing method according to any one of claims 2 to 4 . The shape acquisition step acquires the plurality of optical cross-sectional images which are three-dimensional shape data of the skin surface by measuring the shape of a replica obtained by collecting the shape of the skin surface. Item 6. The skin condition analysis method according to any one of Items 1 to 5 . The program for making a computer perform the skin condition analysis method as described in any one of Claims 1 thru | or 6 . A computer-readable recording medium on which the program according to claim 7 is recorded. A skin condition analysis device for analyzing the condition of the skin surface based on the shape of the skin groove on the skin surface,
Measuring means for measuring a three-dimensional shape of the skin surface while changing a focus position using a confocal microscopic environment, and obtaining a plurality of optical cross-sectional images which are three-dimensional shape data of the skin surface; ,
Extracting the skin groove based on the three-dimensional shape data, and analyzing the skin surface state based on the skin groove, and
The analysis means includes
An original image generation unit that generates an original image related to the skin surface by synthesizing the plurality of optical cross-sectional images that are the acquired three-dimensional shape data;
An image correction unit that performs a Gaussian filter process and a binarization process on the original image to generate a corrected image;
A skin groove extraction unit that extracts the skin groove based on the generated corrected image ;
Using a median filter, a noise removing unit that creates a post-noise-removed image by labeling the extracted crevice and removing a small-sized lump ,
With reference to the plurality of optical section image, based on the direction of the coordinate toward the interior of the skin in the noise removal after image, it extracts the groove bottom made from the lowest point group of the skin grooves, the lowest point group An extractor ;
A result evaluation unit that evaluates the state of the skin surface based on the shape of the skin groove calculated from the extracted groove bottom,
A skin condition analyzing apparatus characterized by that. The skin according to claim 9 , wherein the result evaluation unit calculates an area, length, width and / or depth of the skin groove based on the image after noise removal and the groove bottom. State analysis device. The result evaluation unit calculates the area, the length, the width, and the depth according to the following formula:
Area Sf = (ΣSTs) / Sa × 100 [%];
Length Lf = Σ (STzn (x, y) −STzn−1 (x, y)) [mm ² / mm];
Width Wf = Sa · Sf / Lf [μm];
Depth Df = ΣSTzn (z) / N [μm];
STs is the area of skin groove ST on the xy plane, Σ is the sum, STzn (x, y) is the coordinate on the xy plane (skin surface) of the nth point of the total number N of the lowest point group STz, STzn ( z) is the z coordinate of the nth point in the total number N of the lowest point group STz.
The skin condition analysis apparatus according to claim 10 . The skin condition analysis according to claim 10 or 11 , wherein the result evaluation unit evaluates the state of the skin surface based on the area, the length, the width and / or the depth. apparatus. The result evaluation unit calculates an evaluation age corresponding to the area, the length, the width, and the depth, and evaluates the state of the skin surface based on the calculated evaluation age, The skin condition analysis apparatus according to any one of claims 10 to 12 . A skin condition analysis system including the skin condition analysis apparatus according to any one of claims 9 to 13 ,
The said analysis means communicates with the said skin condition analysis apparatus using a radio | wireless or a wire communication, The skin condition analysis system characterized by the above-mentioned.