WO2023058464A1 - Skin evaluation device, method, and program - Google Patents

Skin evaluation device, method, and program Download PDF

Info

Publication number
WO2023058464A1
WO2023058464A1 PCT/JP2022/035274 JP2022035274W WO2023058464A1 WO 2023058464 A1 WO2023058464 A1 WO 2023058464A1 JP 2022035274 W JP2022035274 W JP 2022035274W WO 2023058464 A1 WO2023058464 A1 WO 2023058464A1
Authority
WO
WIPO (PCT)
Prior art keywords
skin
light
intensity
specularly reflected
reflected light
Prior art date
Application number
PCT/JP2022/035274
Other languages
French (fr)
Japanese (ja)
Inventor
久美子 菊地
頼子 長谷川
Original Assignee
株式会社資生堂
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社資生堂 filed Critical 株式会社資生堂
Publication of WO2023058464A1 publication Critical patent/WO2023058464A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/47—Scattering, i.e. diffuse reflection
    • G01N21/49—Scattering, i.e. diffuse reflection within a body or fluid
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/55—Specular reflectivity

Definitions

  • the present invention relates to a skin evaluation device, method, and program.
  • optical properties of objects create textures such as glossiness and transparency.
  • the optical properties of the skin are involved in the texture of the skin.
  • the texture of the skin is an important factor that influences the perception of the beauty of the skin. Therefore, skin is evaluated based on the optical characteristics of the skin (Patent Document 1).
  • an object of the present invention is to improve the accuracy of skin texture evaluation.
  • a skin evaluation device that is an embodiment of the present invention is a device for evaluating the texture of a subject's skin, and comprises: the intensity of specularly reflected light specularly reflected on the surface of the skin due to light irradiation; a calculation unit for calculating the uniformity of light and the intensity of subsurface scattered light emitted outside the skin after scattering inside the skin due to the illumination of the light; and the intensity of the specularly reflected light. and an evaluation unit that evaluates the texture of the skin from the uniformity of the specularly reflected light and the intensity of the subsurface scattered light.
  • FIG. 1 is an overall configuration diagram according to an embodiment of the present invention
  • FIG. 1 is a functional block diagram of a skin evaluation device according to one embodiment of the present invention
  • FIG. 4 is a diagram for explaining the uniformity of specularly reflected light according to one embodiment of the present invention
  • FIG. 3 is a diagram for explaining separation of surface reflection/subsurface scattering and separation of specular reflection/diffuse reflection according to an embodiment of the present invention
  • FIG. 4 is a diagram for explaining a method of separating surface reflection and subsurface scattering according to one embodiment of the present invention
  • FIG. 4 is a diagram for explaining classification of skin texture according to one embodiment of the present invention
  • FIG. 4 is a diagram for explaining the relationship between the optical characteristics of skin and the state of skin according to one embodiment of the present invention
  • FIG. 4 is a diagram for explaining the relationship between optical characteristics of skin and age according to one embodiment of the present invention
  • 4 is a flowchart of skin evaluation processing according to one embodiment of the present invention. It is a block diagram showing an example of hardware constitutions of a skin evaluation device concerning one embodiment of the present invention.
  • specular reflection refers to reflection of light occurring on the surface of the skin where the angle of incidence and the angle of reflection are equal.
  • diffuse reflection refers to reflection of light occurring on the surface of the skin, excluding specular reflection.
  • specular reflection refers to reflection of light occurring on the surface of the skin, excluding specular reflection.
  • FIG. 1 is an overall configuration diagram according to one embodiment of the present invention.
  • the skin evaluation system 1 includes a skin evaluation device 10, an imaging device 20, and a light source 30. Each of these will be described below.
  • the skin evaluation device 10 is a computer for evaluating skin texture.
  • the skin evaluation device 10 measures the intensity of the light specularly reflected on the surface of the skin by the irradiation from the light source 30 (hereinafter also referred to as specular reflected light), the uniformity of the specularly reflected light, and the irradiation from the light source 30.
  • specular reflected light the intensity of the light specularly reflected on the surface of the skin by the irradiation from the light source 30
  • specular reflected light specular reflected light
  • the texture of the skin is evaluated from the intensity of the light emitted outside the skin after scattering inside (hereinafter also referred to as subsurface scattered light).
  • the skin evaluation device 10 is a personal computer, a tablet terminal, a smart phone, or the like.
  • the skin evaluation device 10 uses an image captured by the imaging device 20 (specifically, using skin shape information and skin color information) to specularly reflect the skin surface by irradiation from the light source 30.
  • the intensity and uniformity of the reflected light that is, specular reflected light
  • the intensity of the diffusely reflected light from the surface of the skin due to the illumination from the light source 30 hereinafter also referred to as the diffusely reflected light from the surface
  • the light source 30 and the intensity of light emitted outside the skin after scattering inside the skin ie, subsurface scattered light due to illumination from the skin.
  • the physical characteristics of the skin (skin shape) and the optical characteristics of the skin can be evaluated.
  • the imaging device 20 is a device for photographing the skin. Specifically, the image capturing device 20 captures an image of the skin (for example, the entire face or part of the face) whose texture is to be evaluated.
  • the skin evaluation apparatus 10 obtains shape information and color information indicating the three-dimensional shape of the skin from the image captured by the imaging device 20 (specifically, the values of the X coordinate, Y coordinate, and Z coordinate of each point, and , RGB values of each point), or shape information and color information indicating the two-dimensional shape of the skin (specifically, X coordinate and Y coordinate values of each point, and RGB values of each point ) can be obtained.
  • the light source 30 is an artificial light source that emits light by itself.
  • the skin evaluation device 10, the imaging device 20, and the light source 30 are described as separate devices, but at least two of the skin evaluation device 10, the imaging device 20, and the light source 30 can be combined into one device. May be implemented.
  • FIG. 2 is a functional block diagram of the skin evaluation device 10 according to one embodiment of the invention.
  • the skin evaluation device 10 can include an image acquisition unit 101 , a calculation unit 102 , an evaluation unit 103 and a presentation unit 104 .
  • the skin evaluation device 10 can function as an image acquisition unit 101, a calculation unit 102, an evaluation unit 103, and a presentation unit 104 by executing programs.
  • the image acquisition unit 101 acquires an image of skin irradiated with light from the light source 30 from the imaging device 20 .
  • the image acquisition unit 101 acquires shape information and color information indicating the three-dimensional shape of the skin from the image acquired from the imaging device 20 (specifically, the values of the X, Y, and Z coordinates of each point, and RGB values of points), or shape information and color information indicating the two-dimensional shape of the skin (specifically, X-coordinate and Y-coordinate values of each point, and RGB values of each point). get.
  • the calculation unit 102 calculates the intensity of specularly reflected light specularly reflected on the surface of the skin due to light irradiation, the uniformity (for example, the degree of unevenness) of the specularly reflected light, and the scattering inside the skin due to light irradiation. and the intensity of subsurface scattered light emitted outside the skin after .
  • the light intensity e.g., luminance
  • the light intensity may be an absolute value or a relative value (e.g., the ratio of each to the total (specular reflected light, diffuse reflected light, and subsurface scattered light)). good.
  • the calculation unit 102 uses the skin shape information and the skin color information acquired by the image acquisition unit 101 to determine the intensity of the specular reflected light, the uniformity of the specular reflected light, the intensity of the subsurface scattered light, may be calculated.
  • FIG. 3 is a diagram for explaining the uniformity of specularly reflected light according to one embodiment of the present invention.
  • ⁇ A> in FIG. 3 shows specularly reflected light when the skin has no unevenness.
  • the incident angle of incident light (the angle formed by the traveling direction of the incident light and the normal to the boundary surface) and the reflection angle of the reflected light (the angle formed by the traveling direction of the reflected light and the normal to the boundary surface) are equal.
  • the traveling direction of the reflected light (asterisk in FIG. 3) is uniform. That is, the light specularly reflected on the surface of the skin due to the irradiation of light is uniform.
  • ⁇ B> in FIG. 3 shows specular reflected light when the skin has unevenness (for example, when the skin has pores, pimples, fine wrinkles, texture, etc.).
  • the incident angle of incident light (the angle formed by the traveling direction of the incident light and the normal to the boundary surface) and the reflection angle of the reflected light (the angle formed by the traveling direction of the reflected light and the normal to the boundary surface) are equal.
  • the direction of travel of the reflected light (asterisks in FIG. 3) is non-uniform. That is, the light that is specularly reflected on the surface of the skin due to the irradiation of light is non-uniform.
  • the uniformity of the specularly reflected light is calculated based on the reflection direction of the specularly reflected light (the traveling direction of the reflected light in FIG. 3). Furthermore, the uniformity of the specular light is also based on the intensity of the specular light (the intensity of the reflected light in FIG. 3) (that is, based on both the direction of reflection of the specular light and the intensity of the specular light). may be calculated.
  • B1 indicates the non-uniformity based on the reflection direction of the specularly reflected light on the concave portion of the skin
  • B2 indicates the non-uniformity based on the reflecting direction of the specularly reflected light on the convex portion of the skin.
  • B3 show the non-uniformity based on the intensity of the specularly reflected light.
  • the calculation unit 102 separates the specular reflected light, the diffuse reflected light, and the subsurface scattered light by the following method, and calculates the intensity of the specular reflected light, the uniformity of the specular reflected light, and the intensity of the subsurface scattered light. , may be calculated.
  • the following description will be divided into ⁇ separation of surface reflection and subsurface scattering>> and ⁇ separation of specular reflection and diffuse reflection>>.
  • the calculation unit 102 calculates the amount of light reflected by the surface of the skin (hereinafter also referred to as surface reflected light) and the amount of light emitted outside the skin after being scattered inside the skin (subsurface scattered light). and .
  • the calculation unit 102 calculates the difference between the amount of light in the irradiated area and the amount of light in the non-irradiated area in an image of the skin projected by the projector with pattern light of irradiation and non-irradiation, and calculates the difference between the light amount in the irradiation area and the light amount in the non-irradiation area. It separates into a component of reflected light (surface reflected light) and a component of light emitted outside the skin after being scattered inside the skin (subsurface scattered light). The calculation unit 102 calculates each light amount (that is, the light amount of the surface reflected light and the light amount of the subsurface scattered light) based on the separation.
  • the calculation unit 102 calculates the amount of light specularly reflected on the surface of the skin (specularly reflected light) and the amount of light diffusely reflected by the surface of the skin (diffuse reflected light on the surface).
  • the light reflected on the surface of the skin in ⁇ separation of surface reflection and subsurface scattering>> is the same as the light reflected by the skin surface in ⁇ separation of specular reflection and diffuse reflection>> and the skin surface light diffusely reflected at
  • FIG. 4 the separation of surface reflection/subsurface scattering and the separation of specular reflection/diffuse reflection according to an embodiment of the present invention will be described with reference to FIGS. 4 and 5.
  • FIG. 4 the separation of surface reflection/subsurface scattering and the separation of specular reflection/diffuse reflection according to an embodiment of the present invention will be described with reference to FIGS. 4 and 5.
  • FIG. 4 is a diagram for explaining separation of surface reflection/subsurface scattering and separation of specular reflection/diffuse reflection according to one embodiment of the present invention.
  • the imaging device 20 photographs the skin of the subject's face illuminated by the light from the light source 30 . Specifically, the imaging device 20 captures an image for separating surface reflection and subsurface scattering, and an image for separating specular reflection and diffuse reflection. Thus, in one embodiment of the present invention, the images for separating surface and subsurface scatter, and for separating specular and diffuse reflection are produced by a single imaging device 20 and a single The image is captured using the light source 30 .
  • the skin evaluation device 10 acquires information indicating the shape (three-dimensional shape or two-dimensional shape) and color of the skin from the image, and measures the light specularly reflected on the surface of the skin (specularly reflected light) by the irradiation from the light source 30.
  • FIG. 5 is a diagram for explaining a method of separating surface reflection and subsurface scattering according to one embodiment of the present invention.
  • step 101 the projector (light source 30) projects illuminated/non-illuminated pattern light onto the subject's face.
  • the image capturing device 20 captures an image of the subject's face on which the irradiated/non-irradiated pattern light is projected.
  • the black portion that is, the non-projected portion
  • the other portion that is, the projected portion
  • step 102 the light from the projector (light source 30) is reflected on the surface of the skin, or passes through the surface of the skin and scatters inside the skin, and then exits from the surface of the skin.
  • Arrow 1 in FIG. 5 indicates light emitted by the projector (light source 30).
  • Arrow 2 in FIG. 5 indicates the specularly reflected light in the illuminated area.
  • Arrow 3 in FIG. 5 indicates light diffusely reflected in the illuminated area.
  • Arrows 4 in FIG. 5 indicate the light emitted outside the skin after scattering inside the skin in the illuminated and non-illuminated areas.
  • Arrows 5 in FIG. 5 indicate scattered light inside the skin.
  • step 103 the projector (light source 30) moves the irradiation/non-irradiation pattern light projected onto the subject's face, and changes the region that was the irradiation region in S101 to the non-irradiation region (that is, the non-irradiation region).
  • the area that used to be the area is made the irradiation area).
  • the image pickup device 20 photographs the face of the subject on which the pattern light of irradiation and non-irradiation that has been moved is projected.
  • the calculation unit 102 of the skin evaluation device 10 calculates the irradiation area of S101 and S103 (that is, both the light reflected on the surface of the skin and the light emitted to the outside of the skin after scattering inside the skin. Subtracting the light component in the non-irradiated areas of S101 and S103 (i.e., the areas where there is only light emitted outside the skin after scattering inside the skin) from the light components in the non-exposed areas of S101 and S103 can obtain the component of the light reflected on the surface of the skin.
  • the evaluation unit 103 calculates the intensity of the specularly reflected light specularly reflected on the surface of the skin due to the light irradiation, the uniformity of the specularly reflected light (for example, the degree of unevenness), and the light irradiation.
  • the texture of the skin is evaluated from the intensity of the subsurface scattered light emitted outside the skin after scattering inside the skin by .
  • the evaluation unit 103 also evaluates the intensity of the diffusely reflected light (that is, the intensity of the specularly reflected light, the uniformity of the specularly reflected light, the intensity of the subsurface scattered light, and the intensity of the diffusely reflected light). based), skin texture may be assessed.
  • the evaluation unit 103 can evaluate the texture of the subject's skin by classifying it into one of a plurality of types. Specifically, the evaluation unit 103 evaluates the skin texture of the subject based on the correspondence relationship between the "intensity and uniformity of the specular reflected light and the intensity of the subsurface scattered light" and the "type of skin texture". The type of texture can be determined.
  • the presentation unit 104 presents the evaluation result of the texture of the skin (for example, displays it on the skin evaluation device 10 or another device). For example, the presentation unit 104 presents beauty information according to the skin condition that is a factor in skin texture (the skin condition that is a factor in skin texture will be described later).
  • FIG. 6 is a diagram for explaining the classification of skin texture according to one embodiment of the present invention.
  • Each type of skin texture for example, shiny skin, oily skin, Spaces for matte skin, dull skin, glitter skin, and transparent skin are arranged.
  • the evaluation unit 103 evaluates the skin texture of the subject based on the correspondence relationship between "calculating the intensity and uniformity of the specular reflected light and the intensity of the subsurface scattered light" and the "type of skin texture".
  • the type of texture can be determined. If the texture of the subject's skin corresponds to a plurality of types (that is, the spaces of the plurality of types overlap), the evaluation unit 103 regards the plurality of types as the type of the skin texture of the subject. Alternatively, any one of the plurality of types may be determined as the texture type of the subject's skin.
  • the texture of the skin is glossy skin, shiny skin, matte skin, dull skin, glaring skin, and transparent skin.
  • the intensity of each type of specular reflected light, the uniformity of specular reflected light, and the intensity of subsurface scattered light will be described below.
  • the intensity level of specular reflection indicates the degree of intensity of specular reflection, and the higher the level value, the higher the intensity of specular reflection.
  • the level of uniformity of specular reflection indicates the degree of uniformity of specular reflection, and the higher the level, the more uniform.
  • the intensity level of subsurface scattered light indicates the degree of intensity of subsurface scattered light, and the higher the level value, the higher the intensity of subsurface reflected light.
  • Glossy skin has specular reflection intensity levels 2-8, specular reflection uniformity levels 4-10, and subsurface scattered light intensity levels 4-10.
  • Shiny skin has specular reflection intensity levels 5-9, specular reflection uniformity levels 0-5, and subsurface scattered light intensity levels 1-7.
  • Matte skin has specular light intensity levels 0-5, specular light uniformity levels 1-9, and subsurface scattered light intensity levels 2-10.
  • Dull skin has specular reflection intensity levels 0-8, specular reflection uniformity levels 1-9, and subsurface scattered light intensity levels 0-6.
  • Glittering skin has specular reflection intensity levels 5-10, specular reflection uniformity levels 0-4, and subsurface scattered light intensity levels 0-7.
  • Transparent skin has specular reflection intensity levels 0-8, specular reflection uniformity levels 4-10, and subsurface scattered light intensity levels 5-10.
  • the parameters of the optical properties used in the present invention that is, the intensity of the specular reflected light, the uniformity of the specular reflected light, and the intensity of the subsurface scattered light
  • the type of skin texture were found from the following experiments. .
  • Skin measurement ⁇ First, the subject's skin data was obtained. Specifically, the light of the skin was measured, and an image showing the appearance of the skin, an image showing the specular reflected light, an image showing the diffuse reflected light, and an image showing the subsurface scattered light were obtained. [Visual judgment] - Next, the observer observed and classified the images obtained by [skin measurement].
  • skin conditions that contribute to skin texture are estimated from at least one of the intensity of specular reflected light, the uniformity of specular reflected light, and the intensity of subsurface scattered light. be able to.
  • the relationship between the optical characteristics of the skin and the condition of the skin will be described in detail with reference to FIG.
  • FIG. 7 is a diagram for explaining the relationship between the optical characteristics of the skin and the state of the skin according to one embodiment of the present invention.
  • the intensity of the specularly reflected light correlates with the hardness of the stratum corneum of the skin, the sebum of the skin, and the stratification of the stratum corneum of the skin.
  • the uniformity of specularly reflected light correlates with skin viscoelasticity, skin pores, skin acne, skin fine lines, and skin texture.
  • Subsurface scattered light is correlated with epidermal melanin of the skin, transparency of the stratum corneum of the skin, water content of the stratum corneum of the skin, stratification of the stratum corneum of the skin, hemoglobin of the skin, and collagen of the dermis of the skin.
  • the evaluation unit 103 determines, from at least one of the intensity of the specular reflected light, the uniformity of the specular reflected light, and the intensity of the subsurface scattered light, the intensity of the skin, which is a factor of the texture of the skin. state can be estimated.
  • the evaluation unit 103 can estimate at least one of the hardness of the stratum corneum of the skin, the sebum of the skin, and the stratification of the stratum corneum of the skin from the intensity of the specularly reflected light.
  • the evaluation unit 103 estimates at least one of skin viscoelasticity, skin pores, skin acne, skin fine wrinkles, and skin texture from the uniformity of specularly reflected light. can be done.
  • the evaluation unit 103 determines the melanin of the epidermis of the skin, the transparency of the stratum corneum of the skin, the water content of the stratum corneum of the skin, the stratification of the stratum corneum of the skin, and the hemoglobin of the skin. , collagen in the dermis of the skin.
  • FIG. 8 is a diagram for explaining the relationship between optical characteristics of skin and age according to one embodiment of the present invention.
  • specular reflected light intensity correlates with age
  • specular reflected light uniformity correlates with age
  • subsurface scattered light intensity correlates with age.
  • the intensity of specularly reflected light increases with aging.
  • the uniformity (degree of non-uniformity) of specularly reflected light increases with age.
  • the intensity of subsurface scattered light decreases with age.
  • the evaluation unit 103 can evaluate whether or not the texture of the skin of the subject corresponds to the age of the subject.
  • FIG. 9 is a flowchart of skin evaluation processing according to one embodiment of the present invention.
  • step 1 the image acquisition unit 101 acquires an image of skin irradiated with light from the light source 30 from the imaging device 20 .
  • the image acquisition unit 101 acquires shape information and color information indicating the three-dimensional shape of the skin from the image acquired from the imaging device 20 (specifically, X coordinate, Y coordinate, and Z coordinate values of each point, and RGB values of each point), or shape information and color information indicating the two-dimensional shape of the skin (specifically, the X-coordinate and Y-coordinate values of each point, and the RGB values of each point). value).
  • step 2 (S2) the calculation unit 102 uses the skin shape information and the skin color information acquired in S1 to determine the intensity of the specularly reflected light reflected by the surface of the skin due to light irradiation and the specular reflection of the specular surface.
  • the uniformity (eg, the degree of non-uniformity) of the reflected light and the intensity of the subsurface scattered light emitted outside the skin after scattering inside the skin due to light irradiation are calculated.
  • step 3 the evaluation unit 103 evaluates the intensity of the specularly reflected light that is specularly reflected on the surface of the skin due to the light irradiation, the uniformity of the specularly reflected light, and the skin by the light irradiation calculated in S2.
  • Skin texture is evaluated from the intensity of subsurface scattered light emitted to the exterior of the skin after scattering within the skin.
  • the evaluation unit 103 can evaluate the texture of the subject's skin by classifying it into one of a plurality of types. Specifically, the evaluation unit 103 determines the subject's The type of skin texture can be determined.
  • FIG. 10 is a block diagram showing an example of the hardware configuration of the skin evaluation device 10 according to one embodiment of the invention.
  • the skin evaluation device 10 has a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, and a RAM (Random Access Memory) 1003.
  • the CPU 1001, ROM 1002, and RAM 1003 form a so-called computer.
  • the skin evaluation device 10 can also have an auxiliary storage device 1004 , a display device 1005 , an operation device 1006 , an I/F (Interface) device 1007 and a drive device 1008 .
  • Each piece of hardware of the skin evaluation device 10 is connected to each other via a bus B. As shown in FIG.
  • the CPU 1001 is an arithmetic device that executes various programs installed in the auxiliary storage device 1004 .
  • the ROM 1002 is a non-volatile memory.
  • the ROM 1002 functions as a main storage device that stores various programs, data, etc. necessary for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004 .
  • the ROM 1002 functions as a main storage device that stores boot programs such as BIOS (Basic Input/Output System) and EFI (Extensible Firmware Interface).
  • BIOS Basic Input/Output System
  • EFI Extensible Firmware Interface
  • the RAM 1003 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory).
  • the RAM 1003 functions as a main storage device that provides a work area that is developed when various programs installed in the auxiliary storage device 1004 are executed by the CPU 1001 .
  • the auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when various programs are executed.
  • the display device 1005 is a display device that displays the internal state of the skin evaluation device 10 and the like.
  • the operating device 1006 is an input device for the administrator of the skin evaluation device 10 to input various instructions to the skin evaluation device 10 .
  • the I/F device 1007 is a communication device for connecting to a network and communicating with the skin evaluation device 10.
  • a drive device 1008 is a device for setting a storage medium 1009 .
  • the storage medium 1009 here includes media such as CD-ROMs, flexible disks, magneto-optical disks, etc., which record information optically, electrically or magnetically.
  • the storage medium 1009 may also include a semiconductor memory that electrically records information such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, or the like.
  • auxiliary storage device 1004 Various programs to be installed in the auxiliary storage device 1004 are installed by, for example, setting the distributed storage medium 1009 in the drive device 1008 and reading the various programs recorded in the storage medium 1009 by the drive device 1008. be done. Alternatively, various programs installed in the auxiliary storage device 1004 may be installed by being downloaded from the network via the I/F device 1007 .

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Pathology (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

The present invention improves the accuracy of evaluating the texture of skin. A skin evaluation device according to an embodiment of the present invention evaluates the texture of a subject's skin, and comprises: a calculation unit that calculates the intensity of specularly reflected light specularly reflected on the surface of the skin due to the radiation of light, the uniformity of the specularly reflected light, and the intensity of subsurface scattered light emitted to the outside of the skin after being scattered inside the skin due to the radiation of the light; and an evaluation unit that evaluates the texture of the skin on the basis of the intensity of the specularly reflected light, the uniformity of the specularly reflected light, and the intensity of the subsurface scattered light.

Description

肌評価装置、方法、およびプログラムSKIN EVALUATION APPARATUS, METHOD AND PROGRAM
　本発明は、肌評価装置、方法、およびプログラムに関する。 The present invention relates to a skin evaluation device, method, and program.
　従来、物体が有する光学的な特性（以下、光学特性ともいう）が光沢感や透明感などの質感を生み出すことが知られている。肌についても、肌の光学特性が肌の質感に関与していることが知られている。 Conventionally, it is known that the optical properties of objects (hereinafter also referred to as optical properties) create textures such as glossiness and transparency. As for the skin, it is also known that the optical properties of the skin are involved in the texture of the skin.
　肌の質感は、肌の美しさの知覚を左右する重要な因子である。そのため、肌の光学特性に基づいた肌の評価が行われている（特許文献１）。 　The texture of the skin is an important factor that influences the perception of the beauty of the skin. Therefore, skin is evaluated based on the optical characteristics of the skin (Patent Document 1).
特開２０１６－９４４１３号公報JP 2016-94413 A
　しかしながら、従来の手法では、肌の光学特性に基づいて、肌のツヤの程度を評価するに過ぎなかった。 However, conventional methods only evaluated the degree of skin gloss based on the optical characteristics of the skin.
　そこで、本発明では、肌の質感の評価の精度を向上させることを目的とする。 Therefore, an object of the present invention is to improve the accuracy of skin texture evaluation.
　本発明の一実施形態である肌評価装置は、対象者の肌の質感を評価する装置であって、光の照射により前記肌の表面で鏡面反射された鏡面反射光の強度と、前記鏡面反射光の均一性と、前記光の照射により前記肌の内部での散乱の後に前記肌の外部に放出された表面下散乱光の強度と、を算出する算出部と、前記鏡面反射光の強度と、前記鏡面反射光の均一性と、前記表面下散乱光の強度と、から、前記肌の質感を評価する評価部と、を備える。 A skin evaluation device that is an embodiment of the present invention is a device for evaluating the texture of a subject's skin, and comprises: the intensity of specularly reflected light specularly reflected on the surface of the skin due to light irradiation; a calculation unit for calculating the uniformity of light and the intensity of subsurface scattered light emitted outside the skin after scattering inside the skin due to the illumination of the light; and the intensity of the specularly reflected light. and an evaluation unit that evaluates the texture of the skin from the uniformity of the specularly reflected light and the intensity of the subsurface scattered light.
　本発明によれば、肌の質感の評価の精度を向上させることができる。 According to the present invention, it is possible to improve the accuracy of skin texture evaluation.
本発明の一実施形態に係る全体の構成図である。1 is an overall configuration diagram according to an embodiment of the present invention; FIG. 本発明の一実施形態に係る肌評価装置の機能ブロック図である。1 is a functional block diagram of a skin evaluation device according to one embodiment of the present invention; FIG. 本発明の一実施形態に係る鏡面反射光の均一性について説明するための図である。FIG. 4 is a diagram for explaining the uniformity of specularly reflected light according to one embodiment of the present invention; 本発明の一実施形態に係る表面反射・表面下散乱の分離と鏡面反射・拡散反射の分離について説明するための図である。FIG. 3 is a diagram for explaining separation of surface reflection/subsurface scattering and separation of specular reflection/diffuse reflection according to an embodiment of the present invention; 本発明の一実施形態に係る表面反射・表面下散乱の分離の手法について説明するための図である。FIG. 4 is a diagram for explaining a method of separating surface reflection and subsurface scattering according to one embodiment of the present invention; 本発明の一実施形態に係る肌の質感の分類について説明するための図である。FIG. 4 is a diagram for explaining classification of skin texture according to one embodiment of the present invention; 本発明の一実施形態に係る肌の光学特性と肌の状態の関係について説明するための図である。FIG. 4 is a diagram for explaining the relationship between the optical characteristics of skin and the state of skin according to one embodiment of the present invention; 本発明の一実施形態に係る肌の光学特性と年齢の関係について説明するための図である。FIG. 4 is a diagram for explaining the relationship between optical characteristics of skin and age according to one embodiment of the present invention; 本発明の一実施形態に係る肌評価処理のフローチャートである。4 is a flowchart of skin evaluation processing according to one embodiment of the present invention. 本発明の一実施形態に係る肌評価装置のハードウェア構成の一例を示すブロック図である。It is a block diagram showing an example of hardware constitutions of a skin evaluation device concerning one embodiment of the present invention.
　以下、図面に基づいて本発明の実施の形態を説明する。なお、光（例えば、鏡面反射光および表面下散乱光）の計測方法は、本明細書に記載の計測方法に限られない。 Embodiments of the present invention will be described below based on the drawings. Note that the method of measuring light (for example, specularly reflected light and subsurface scattered light) is not limited to the measuring method described in this specification.
＜用語の説明＞
・本明細書において、「鏡面反射」とは、肌の表面において発生する光の反射のうち、入射角と反射角が等しいものである。
・本明細書において、「拡散反射」とは、肌の表面において発生する光の反射のうち、鏡面反射を除いたものである。
・本明細書において、「表面下散乱」とは、光が肌の表面を透過し、肌の内部で散乱した後に、肌の表面から外部に出ることをいう。 <Description of terms>
- In this specification, the term "specular reflection" refers to reflection of light occurring on the surface of the skin where the angle of incidence and the angle of reflection are equal.
- In this specification, the term "diffuse reflection" refers to reflection of light occurring on the surface of the skin, excluding specular reflection.
- In this specification, "subsurface scattering" means that light passes through the surface of the skin, scatters inside the skin, and then exits from the surface of the skin.
＜全体の構成＞
　図１は、本発明の一実施形態に係る全体の構成図である。肌評価システム１は、肌評価装置１０と、撮像機器２０と、光源３０と、を含む。以下、それぞれについて説明する。 <Overall configuration>
FIG. 1 is an overall configuration diagram according to one embodiment of the present invention. The skin evaluation system 1 includes a skin evaluation device 10, an imaging device 20, and a light source 30. Each of these will be described below.
　肌評価装置１０は、肌の質感を評価するためのコンピュータである。肌評価装置１０は、光源３０からの照射により肌の表面で鏡面反射された光（以下、鏡面反射光ともいう）の強度と、鏡面反射光の均一性と、光源３０からの照射により肌の内部での散乱の後に肌の外部に放出された光（以下、表面下散乱光ともいう）の強度と、から、肌の質感を評価する。例えば、肌評価装置１０は、パーソナルコンピュータ、タブレット端末、スマートフォン等である。 The skin evaluation device 10 is a computer for evaluating skin texture. The skin evaluation device 10 measures the intensity of the light specularly reflected on the surface of the skin by the irradiation from the light source 30 (hereinafter also referred to as specular reflected light), the uniformity of the specularly reflected light, and the irradiation from the light source 30. The texture of the skin is evaluated from the intensity of the light emitted outside the skin after scattering inside (hereinafter also referred to as subsurface scattered light). For example, the skin evaluation device 10 is a personal computer, a tablet terminal, a smart phone, or the like.
　例えば、肌評価装置１０は、撮像機器２０が撮影した画像を用いて（具体的には、肌の形状情報および肌の色情報を用いて）、光源３０からの照射により肌の表面で鏡面反射された光（つまり、鏡面反射光）の強度および均一性と、光源３０からの照射により肌の表面で拡散反射された光（以下、表面での拡散反射光ともいう）の強度と、光源３０からの照射により肌の内部での散乱の後に肌の外部に放出された光（つまり、表面下散乱光）の強度と、を算出してもよい。このように、本発明の一実施形態では、単一の撮像機器２０および単一の光源３０を用いて撮影された画像から、肌の物理特性（肌の形状）と肌の光学特性（肌で生じる全ての光）とを評価することができる。 For example, the skin evaluation device 10 uses an image captured by the imaging device 20 (specifically, using skin shape information and skin color information) to specularly reflect the skin surface by irradiation from the light source 30. The intensity and uniformity of the reflected light (that is, specular reflected light), the intensity of the diffusely reflected light from the surface of the skin due to the illumination from the light source 30 (hereinafter also referred to as the diffusely reflected light from the surface), and the light source 30 and the intensity of light emitted outside the skin after scattering inside the skin (ie, subsurface scattered light) due to illumination from the skin. Thus, in one embodiment of the present invention, the physical characteristics of the skin (skin shape) and the optical characteristics of the skin (the all light generated) can be evaluated.
　撮像機器２０は、肌を撮影するための機器である。具体的には、撮像機器２０は、質感を評価される肌（例えば、顔全体、あるいは、顔の一部）を撮影する。 The imaging device 20 is a device for photographing the skin. Specifically, the image capturing device 20 captures an image of the skin (for example, the entire face or part of the face) whose texture is to be evaluated.
　なお、肌評価装置１０は、撮像機器２０が撮影した画像から、肌の３次元形状を示す形状情報および色情報（具体的には、各点のＸ座標・Ｙ座標・Ｚ座標の値、および、各点のＲＧＢの各値）、あるいは、肌の２次元形状を示す形状情報および色情報（具体的には、各点のＸ座標・Ｙ座標の値、および、各点のＲＧＢの各値）を取得することができる。 In addition, the skin evaluation apparatus 10 obtains shape information and color information indicating the three-dimensional shape of the skin from the image captured by the imaging device 20 (specifically, the values of the X coordinate, Y coordinate, and Z coordinate of each point, and , RGB values of each point), or shape information and color information indicating the two-dimensional shape of the skin (specifically, X coordinate and Y coordinate values of each point, and RGB values of each point ) can be obtained.
　光源３０は、自ら光を発する人工光源である。 The light source 30 is an artificial light source that emits light by itself.
　なお、図１では、肌評価装置１０と撮像機器２０と光源３０とを別々の機器として説明したが、肌評価装置１０と撮像機器２０と光源３０とのうちの少なくとも２つを１つの機器で実装してもよい。 In FIG. 1, the skin evaluation device 10, the imaging device 20, and the light source 30 are described as separate devices, but at least two of the skin evaluation device 10, the imaging device 20, and the light source 30 can be combined into one device. May be implemented.
＜機能ブロック＞
　図２は、本発明の一実施形態に係る肌評価装置１０の機能ブロック図である。図２に示されるように、肌評価装置１０は、画像取得部１０１と、算出部１０２と、評価部１０３と、提示部１０４と、を備えることができる。また、肌評価装置１０は、プログラムを実行することで、画像取得部１０１、算出部１０２、評価部１０３、提示部１０４として機能することができる。 <Functional block>
FIG. 2 is a functional block diagram of the skin evaluation device 10 according to one embodiment of the invention. As shown in FIG. 2 , the skin evaluation device 10 can include an image acquisition unit 101 , a calculation unit 102 , an evaluation unit 103 and a presentation unit 104 . Moreover, the skin evaluation device 10 can function as an image acquisition unit 101, a calculation unit 102, an evaluation unit 103, and a presentation unit 104 by executing programs.
　画像取得部１０１は、光源３０からの光が照射された肌の画像を、撮像機器２０から取得する。画像取得部１０１は、撮像機器２０から取得した画像から、肌の３次元形状を示す形状情報および色情報（具体的には、各点のＸ座標・Ｙ座標・Ｚ座標の値、および、各点のＲＧＢの各値）、あるいは、肌の２次元形状を示す形状情報および色情報（具体的には、各点のＸ座標・Ｙ座標の値、および、各点のＲＧＢの各値）を取得する。 The image acquisition unit 101 acquires an image of skin irradiated with light from the light source 30 from the imaging device 20 . The image acquisition unit 101 acquires shape information and color information indicating the three-dimensional shape of the skin from the image acquired from the imaging device 20 (specifically, the values of the X, Y, and Z coordinates of each point, and RGB values of points), or shape information and color information indicating the two-dimensional shape of the skin (specifically, X-coordinate and Y-coordinate values of each point, and RGB values of each point). get.
＜＜鏡面反射光の強度と均一性および表面下散乱光の強度＞＞
　算出部１０２は、光の照射により肌の表面で鏡面反射された鏡面反射光の強度と、鏡面反射光の均一性（例えば、不均一の程度）と、光の照射により肌の内部での散乱の後に肌の外部に放出された表面下散乱光の強度と、を算出する。なお、光の強度（例えば、輝度）は、絶対値であってもよいし、相対値（例えば、全体（鏡面反射光と拡散反射光と表面下散乱光）に対する各々の比率）であってもよい。例えば、算出部１０２は、画像取得部１０１が取得した肌の形状情報および肌の色情報を用いて、鏡面反射光の強度と、鏡面反射光の均一性と、表面下散乱光の強度と、を算出してもよい。 <<Intensity and Uniformity of Specularly Reflected Light and Intensity of Subsurface Scattered Light>>
The calculation unit 102 calculates the intensity of specularly reflected light specularly reflected on the surface of the skin due to light irradiation, the uniformity (for example, the degree of unevenness) of the specularly reflected light, and the scattering inside the skin due to light irradiation. and the intensity of subsurface scattered light emitted outside the skin after . The light intensity (e.g., luminance) may be an absolute value or a relative value (e.g., the ratio of each to the total (specular reflected light, diffuse reflected light, and subsurface scattered light)). good. For example, the calculation unit 102 uses the skin shape information and the skin color information acquired by the image acquisition unit 101 to determine the intensity of the specular reflected light, the uniformity of the specular reflected light, the intensity of the subsurface scattered light, may be calculated.
　図３は、本発明の一実施形態に係る鏡面反射光の均一性について説明するための図である。 FIG. 3 is a diagram for explaining the uniformity of specularly reflected light according to one embodiment of the present invention.
　図３の＜Ａ＞は、肌に凹凸が無い場合の鏡面反射光を示す。入射光の入射角（入射光の進行方向と境界面の法線とのなす角度）と反射光の反射角（反射光の進行方向と境界面の法線とのなす角度）は、等しい。この場合、反射光の進行方向（図３の星印）は、均一である。つまり、光の照射により肌の表面で鏡面反射された光は、均一である。 <A> in FIG. 3 shows specularly reflected light when the skin has no unevenness. The incident angle of incident light (the angle formed by the traveling direction of the incident light and the normal to the boundary surface) and the reflection angle of the reflected light (the angle formed by the traveling direction of the reflected light and the normal to the boundary surface) are equal. In this case, the traveling direction of the reflected light (asterisk in FIG. 3) is uniform. That is, the light specularly reflected on the surface of the skin due to the irradiation of light is uniform.
　図３の＜Ｂ＞は、肌に凹凸が有る場合（例えば、肌に毛穴、ニキビ、小じわ、キメ等が存在する場合）の鏡面反射光を示す。入射光の入射角（入射光の進行方向と境界面の法線とのなす角度）と反射光の反射角（反射光の進行方向と境界面の法線とのなす角度）は、等しい。この場合、反射光の進行方向（図３の星印）は、不均一である。つまり、光の照射により肌の表面で鏡面反射された光は、不均一である。 <B> in FIG. 3 shows specular reflected light when the skin has unevenness (for example, when the skin has pores, pimples, fine wrinkles, texture, etc.). The incident angle of incident light (the angle formed by the traveling direction of the incident light and the normal to the boundary surface) and the reflection angle of the reflected light (the angle formed by the traveling direction of the reflected light and the normal to the boundary surface) are equal. In this case, the direction of travel of the reflected light (asterisks in FIG. 3) is non-uniform. That is, the light that is specularly reflected on the surface of the skin due to the irradiation of light is non-uniform.
　このように、鏡面反射光の均一性は、鏡面反射光の反射方向（図３の反射光の進行方向）に基づいて算出される。さらに、鏡面反射光の均一性は、鏡面反射光の強度（図３の反射光の強度）にも基づいて（つまり、鏡面反射光の反射方向と鏡面反射光の強度との両方に基づいて）算出されてもよい。なお、図３において、Ｂ１は、肌の凹部での鏡面反射光の反射方向に基づく不均一性を示し、Ｂ２は、肌の凸部での鏡面反射光の反射方向に基づく不均一性を示し、Ｂ３は、鏡面反射光の強度に基づく不均一性を示す。 Thus, the uniformity of the specularly reflected light is calculated based on the reflection direction of the specularly reflected light (the traveling direction of the reflected light in FIG. 3). Furthermore, the uniformity of the specular light is also based on the intensity of the specular light (the intensity of the reflected light in FIG. 3) (that is, based on both the direction of reflection of the specular light and the intensity of the specular light). may be calculated. In FIG. 3, B1 indicates the non-uniformity based on the reflection direction of the specularly reflected light on the concave portion of the skin, and B2 indicates the non-uniformity based on the reflecting direction of the specularly reflected light on the convex portion of the skin. , B3 show the non-uniformity based on the intensity of the specularly reflected light.
　図２に戻る。例えば、算出部１０２は、以下の手法により、鏡面反射光と拡散反射光と表面下散乱光を分離し、鏡面反射光の強度と、鏡面反射光の均一性と、表面下散乱光の強度と、を算出してもよい。以下、＜＜表面反射と表面下散乱の分離＞＞と＜＜鏡面反射と拡散反射の分離＞＞に分けて説明する。 Return to Figure 2. For example, the calculation unit 102 separates the specular reflected light, the diffuse reflected light, and the subsurface scattered light by the following method, and calculates the intensity of the specular reflected light, the uniformity of the specular reflected light, and the intensity of the subsurface scattered light. , may be calculated. The following description will be divided into <<separation of surface reflection and subsurface scattering>> and <<separation of specular reflection and diffuse reflection>>.
＜＜表面反射と表面下散乱の分離＞＞
　算出部１０２は、肌の表面で反射された光（以下、表面反射光ともいう）の光量と、肌の内部での散乱の後に肌の外部に放出された光（表面下散乱光）の光量と、を算出する。 <<Separation of surface reflection and subsurface scattering>>
The calculation unit 102 calculates the amount of light reflected by the surface of the skin (hereinafter also referred to as surface reflected light) and the amount of light emitted outside the skin after being scattered inside the skin (subsurface scattered light). and .
　例えば、算出部１０２は、プロジェクタにより照射・非照射のパターン光を投影された肌が撮影された画像において、照射領域における光量と非照射領域における光量との差分を算出して、肌の表面で反射された光（表面反射光）の成分と、肌の内部での散乱の後に肌の外部に放出された光（表面下散乱光）の成分と、に分離する。算出部１０２は、分離に基づいて、各々の光量（つまり、表面反射光の光量および表面下散乱光の光量）を算出する。 For example, the calculation unit 102 calculates the difference between the amount of light in the irradiated area and the amount of light in the non-irradiated area in an image of the skin projected by the projector with pattern light of irradiation and non-irradiation, and calculates the difference between the light amount in the irradiation area and the light amount in the non-irradiation area. It separates into a component of reflected light (surface reflected light) and a component of light emitted outside the skin after being scattered inside the skin (subsurface scattered light). The calculation unit 102 calculates each light amount (that is, the light amount of the surface reflected light and the light amount of the subsurface scattered light) based on the separation.
＜＜鏡面反射と拡散反射の分離＞＞
　算出部１０２は、肌の表面で鏡面反射された光（鏡面反射光）の光量と、肌の表面で拡散反射された光（表面での拡散反射光）の光量と、を算出する。 << Separation of Specular Reflection and Diffuse Reflection >>
The calculation unit 102 calculates the amount of light specularly reflected on the surface of the skin (specularly reflected light) and the amount of light diffusely reflected by the surface of the skin (diffuse reflected light on the surface).
　例えば、算出部１０２は、偏光フィルタを用いて撮影された無偏光画像と偏光フィルタを用いずに撮影された偏光画像との差分を算出して、肌からの光の全体量から肌の表面で鏡面反射された光（鏡面反射光）の成分を分離する（なお、肌からの光の全体量＝鏡面反射光＋それ以外の光（表面での拡散反射光＋表面下散乱光）であるので、分離された後の残りの光には、表面での拡散反射光と表面下散乱光が含まれる）。算出部１０２は、分離された後の残りの光から表面下散乱光を差し引くことによって、表面での拡散反射光の光量を算出することができる。算出部１０２は、分離に基づいて、各々の光量（つまり、鏡面反射光の光量および表面での拡散反射光の光量）を算出する。 For example, the calculation unit 102 calculates the difference between the non-polarized image captured using the polarizing filter and the polarized image captured without using the polarizing filter, and calculates the total amount of light from the skin on the surface of the skin. Separate the components of specularly reflected light (specularly reflected light) (because the total amount of light from the skin = specularly reflected light + other light (diffuse reflected light on the surface + subsurface scattered light) , the remaining light after separation includes diffusely reflected light at the surface and subsurface scattered light). The calculator 102 can calculate the amount of diffusely reflected light on the surface by subtracting the subsurface scattered light from the remaining light after separation. The calculation unit 102 calculates each light amount (that is, the light amount of the specularly reflected light and the light amount of the diffusely reflected light on the surface) based on the separation.
　なお、本明細書では、偏光フィルタを用いる手法を説明したが、本発明では、二色性反射モデルによる分離の手法、形状情報を利用した鏡面反射の分離の手法を適用することもできる。 In this specification, a method using a polarizing filter has been described, but in the present invention, a separation method using a dichroic reflection model and a specular reflection separation method using shape information can also be applied.
　なお、＜＜表面反射と表面下散乱の分離＞＞の肌の表面で反射された光は、＜＜鏡面反射と拡散反射の分離＞＞の肌の表面で鏡面反射された光と肌の表面で拡散反射された光とからなる。 In addition, the light reflected on the surface of the skin in <<separation of surface reflection and subsurface scattering>> is the same as the light reflected by the skin surface in <<separation of specular reflection and diffuse reflection>> and the skin surface light diffusely reflected at
　ここで、図４および図５を参照しながら、本発明の一実施形態に係る表面反射・表面下散乱の分離と鏡面反射・拡散反射の分離について説明する。 Here, the separation of surface reflection/subsurface scattering and the separation of specular reflection/diffuse reflection according to an embodiment of the present invention will be described with reference to FIGS. 4 and 5. FIG.
　図４は、本発明の一実施形態に係る表面反射・表面下散乱の分離と鏡面反射・拡散反射の分離について説明するための図である。 FIG. 4 is a diagram for explaining separation of surface reflection/subsurface scattering and separation of specular reflection/diffuse reflection according to one embodiment of the present invention.
　撮像機器２０は、光源３０からの光が照射された対象者の顔の肌を撮影する。具体的には、撮像機器２０は、表面反射と表面下散乱を分離するための画像、および、鏡面反射と拡散反射を分離するための画像を撮影する。このように、本発明の一実施形態では、表面反射と表面下散乱を分離するための画像、および、鏡面反射と拡散反射を分離するための画像は、単一の撮像機器２０および単一の光源３０を用いて撮影される。肌評価装置１０は、画像から肌の形状（３次元形状または２次元形状）および色を示す情報を取得し、光源３０からの照射により肌の表面で鏡面反射された光（鏡面反射光）の光量と、光源３０からの照射により肌の表面で拡散反射された光（表面での拡散反射光）の光量と、光源３０からの照射により肌の内部での散乱の後に肌の外部に放出された光（表面下散乱光）の光量と、を算出することができる。 The imaging device 20 photographs the skin of the subject's face illuminated by the light from the light source 30 . Specifically, the imaging device 20 captures an image for separating surface reflection and subsurface scattering, and an image for separating specular reflection and diffuse reflection. Thus, in one embodiment of the present invention, the images for separating surface and subsurface scatter, and for separating specular and diffuse reflection are produced by a single imaging device 20 and a single The image is captured using the light source 30 . The skin evaluation device 10 acquires information indicating the shape (three-dimensional shape or two-dimensional shape) and color of the skin from the image, and measures the light specularly reflected on the surface of the skin (specularly reflected light) by the irradiation from the light source 30. The amount of light, the amount of light diffusely reflected on the surface of the skin (diffuse reflected light on the surface) due to the irradiation from the light source 30, and the amount of light emitted to the outside of the skin after scattering inside the skin due to the irradiation from the light source 30. It is possible to calculate the light amount of the light (subsurface scattered light).
　図５は、本発明の一実施形態に係る表面反射・表面下散乱の分離の手法について説明するための図である。 FIG. 5 is a diagram for explaining a method of separating surface reflection and subsurface scattering according to one embodiment of the present invention.
　ステップ１０１（Ｓ１０１）において、プロジェクタ（光源３０）は、対象者の顔に照射・非照射のパターン光を投影する。また、撮像機器２０は、照射・非照射のパターン光が投影されている対象者の顔を撮影する。図５では、黒い部分（つまり、投影されていない部分）が非照射領域であり、その他の部分（つまり、投影されている部分）が照射領域である。 In step 101 (S101), the projector (light source 30) projects illuminated/non-illuminated pattern light onto the subject's face. In addition, the image capturing device 20 captures an image of the subject's face on which the irradiated/non-irradiated pattern light is projected. In FIG. 5, the black portion (that is, the non-projected portion) is the non-illuminated area, and the other portion (that is, the projected portion) is the illuminated area.
　ステップ１０２（Ｓ１０２）において、プロジェクタ（光源３０）からの光が、肌の表面で反射する、あるいは、肌の表面を透過して肌の内部で散乱した後に肌の表面から外部に出る。図５の矢印１は、プロジェクタ（光源３０）が照射する光を示す。図５の矢印２は、照射領域において鏡面反射された光を示す。図５の矢印３は、照射領域において拡散反射された光を示す。図５の矢印４は、照射領域および非照射領域において、肌の内部での散乱の後に肌の外部に放出された光を示す。図５の矢印５は、肌の内部において散乱している光を示す。 In step 102 (S102), the light from the projector (light source 30) is reflected on the surface of the skin, or passes through the surface of the skin and scatters inside the skin, and then exits from the surface of the skin. Arrow 1 in FIG. 5 indicates light emitted by the projector (light source 30). Arrow 2 in FIG. 5 indicates the specularly reflected light in the illuminated area. Arrow 3 in FIG. 5 indicates light diffusely reflected in the illuminated area. Arrows 4 in FIG. 5 indicate the light emitted outside the skin after scattering inside the skin in the illuminated and non-illuminated areas. Arrows 5 in FIG. 5 indicate scattered light inside the skin.
　ステップ１０３（Ｓ１０３）において、プロジェクタ（光源３０）は、対象者の顔に投影する照射・非照射のパターン光を移動させて、Ｓ１０１において照射領域であった領域を非照射領域（つまり、非照射領域であった領域を照射領域）にする。また、撮像機器２０は、移動された照射・非照射のパターン光が投影されている対象者の顔を撮影する。 In step 103 (S103), the projector (light source 30) moves the irradiation/non-irradiation pattern light projected onto the subject's face, and changes the region that was the irradiation region in S101 to the non-irradiation region (that is, the non-irradiation region). The area that used to be the area is made the irradiation area). In addition, the image pickup device 20 photographs the face of the subject on which the pattern light of irradiation and non-irradiation that has been moved is projected.
　Ｓ１０１およびＳ１０３により、顔全体の照射領域における光の成分および非照射領域における光の成分が得られる。肌評価装置１０の算出部１０２は、Ｓ１０１およびＳ１０３の照射領域（つまり、肌の表面で反射された光と、肌の内部での散乱の後に肌の外部に放出された光と、の両方が存在する領域）における光の成分から、Ｓ１０１およびＳ１０３の非照射領域（つまり、肌の内部での散乱の後に肌の外部に放出された光のみが存在する領域）における光の成分を減算することによって、肌の表面で反射された光の成分を得ることができる。 Through S101 and S103, the light component in the illuminated area and the light component in the non-illuminated area of the entire face are obtained. The calculation unit 102 of the skin evaluation device 10 calculates the irradiation area of S101 and S103 (that is, both the light reflected on the surface of the skin and the light emitted to the outside of the skin after scattering inside the skin. Subtracting the light component in the non-irradiated areas of S101 and S103 (i.e., the areas where there is only light emitted outside the skin after scattering inside the skin) from the light components in the non-exposed areas of S101 and S103 can obtain the component of the light reflected on the surface of the skin.
＜＜肌の評価＞＞
　図２に戻る。評価部１０３は、算出部１０２が算出した、光の照射により肌の表面で鏡面反射された鏡面反射光の強度と、鏡面反射光の均一性（例えば、不均一の程度）と、光の照射により肌の内部での散乱の後に肌の外部に放出された表面下散乱光の強度と、から、肌の質感を評価する。なお、評価部１０３は、拡散反射光の強度にも基づいて（つまり、鏡面反射光の強度と、鏡面反射光の均一性と、表面下散乱光の強度と、拡散反射光の強度と、に基づいて）、肌の質感を評価してもよい。 <<Evaluation of skin>>
Return to FIG. The evaluation unit 103 calculates the intensity of the specularly reflected light specularly reflected on the surface of the skin due to the light irradiation, the uniformity of the specularly reflected light (for example, the degree of unevenness), and the light irradiation. The texture of the skin is evaluated from the intensity of the subsurface scattered light emitted outside the skin after scattering inside the skin by . Note that the evaluation unit 103 also evaluates the intensity of the diffusely reflected light (that is, the intensity of the specularly reflected light, the uniformity of the specularly reflected light, the intensity of the subsurface scattered light, and the intensity of the diffusely reflected light). based), skin texture may be assessed.
　評価部１０３は、対象者の肌の質感を複数の類型のうちのいずれかに分類することによって評価することができる。具体的には、評価部１０３は、"鏡面反射光の強度と均一性、および、表面下散乱光の強度"と"肌の質感の類型"との対応関係に基づいて、対象者の肌の質感の類型を決定することができる。 The evaluation unit 103 can evaluate the texture of the subject's skin by classifying it into one of a plurality of types. Specifically, the evaluation unit 103 evaluates the skin texture of the subject based on the correspondence relationship between the "intensity and uniformity of the specular reflected light and the intensity of the subsurface scattered light" and the "type of skin texture". The type of texture can be determined.
　提示部１０４は、肌の質感の評価の結果を提示（例えば、肌評価装置１０あるいは他の装置に表示）する。例えば、提示部１０４は、肌の質感の要因となる肌の状態に応じた美容情報を提示する（なお、肌の質感の要因となる肌の状態については後述する）。 The presentation unit 104 presents the evaluation result of the texture of the skin (for example, displays it on the skin evaluation device 10 or another device). For example, the presentation unit 104 presents beauty information according to the skin condition that is a factor in skin texture (the skin condition that is a factor in skin texture will be described later).
＜＜肌の質感の分類＞＞
　以下、肌の質感の分類について説明する。 <<Classification of skin texture>>
Classification of skin texture will be described below.
　図６は、本発明の一実施形態に係る肌の質感の分類について説明するための図である。
。鏡面反射光の強度の軸と、鏡面反射光の均一性の軸と、表面下散乱光の強度の軸と、からなる空間内に、肌の質感の各類型（例えば、ツヤ肌、テカリ肌、マット肌、クスミ肌、ギラツキ肌、透明肌）の空間が配置される。評価部１０３は、このような"鏡面反射光の強度と均一性、および、表面下散乱光の強度を算出"と"肌の質感の類型"との対応関係に基づいて、対象者の肌の質感の類型を決定することができる。なお、対象者の肌の質感が複数の類型に該当する（つまり、複数の類型の空間が重複している）場合、評価部１０３は、該複数の類型を対象者の肌の質感の類型として決定してもよいし、該複数の類型のうちのいずれか１つの類型を対象者の肌の質感の類型として決定してもよい。 FIG. 6 is a diagram for explaining the classification of skin texture according to one embodiment of the present invention.
. Each type of skin texture (for example, shiny skin, oily skin, Spaces for matte skin, dull skin, glitter skin, and transparent skin are arranged. The evaluation unit 103 evaluates the skin texture of the subject based on the correspondence relationship between "calculating the intensity and uniformity of the specular reflected light and the intensity of the subsurface scattered light" and the "type of skin texture". The type of texture can be determined. If the texture of the subject's skin corresponds to a plurality of types (that is, the spaces of the plurality of types overlap), the evaluation unit 103 regards the plurality of types as the type of the skin texture of the subject. Alternatively, any one of the plurality of types may be determined as the texture type of the subject's skin.
　ここで、各類型について説明する。例えば、肌の質感は、ツヤ肌、テカリ肌、マット肌、クスミ肌、ギラツキ肌、透明肌である。以下、各類型の鏡面反射光の強度と、鏡面反射光の均一性と、表面下散乱光の強度と、について説明する。なお、鏡面反射光の強度のレベル（レベル1～10）は鏡面反射光の強度の度合いを示し、レベルの値が大きいほど鏡面反射光の強度が高い。鏡面反射光の均一性のレベル（レベル1～10）は鏡面反射光の均一性の度合いを示し、レベルの値が大きいほど均一である。表面下散乱光の強度のレベル（レベル1～10）は表面下散乱光の強度の度合いを示し、レベルの値が大きいほど表面下反射光の強度が高い。 Here, each type will be explained. For example, the texture of the skin is glossy skin, shiny skin, matte skin, dull skin, glaring skin, and transparent skin. The intensity of each type of specular reflected light, the uniformity of specular reflected light, and the intensity of subsurface scattered light will be described below. The intensity level of specular reflection (levels 1 to 10) indicates the degree of intensity of specular reflection, and the higher the level value, the higher the intensity of specular reflection. The level of uniformity of specular reflection (levels 1 to 10) indicates the degree of uniformity of specular reflection, and the higher the level, the more uniform. The intensity level of subsurface scattered light (levels 1 to 10) indicates the degree of intensity of subsurface scattered light, and the higher the level value, the higher the intensity of subsurface reflected light.
　ツヤ肌は、鏡面反射光の強度がレベル2～8であり、鏡面反射光の均一性がレベル4～10であり、表面下散乱光の強度のレベルが4～10である。 Glossy skin has specular reflection intensity levels 2-8, specular reflection uniformity levels 4-10, and subsurface scattered light intensity levels 4-10.
　テカリ肌は、鏡面反射光の強度がレベル5～9であり、鏡面反射光の均一性がレベル0～5であり、表面下散乱光の強度のレベルが1～7である。 Shiny skin has specular reflection intensity levels 5-9, specular reflection uniformity levels 0-5, and subsurface scattered light intensity levels 1-7.
　マット肌は、鏡面反射光の強度がレベル0～5であり、鏡面反射光の均一性がレベル1～9であり、表面下散乱光の強度のレベルが2～10である。 Matte skin has specular light intensity levels 0-5, specular light uniformity levels 1-9, and subsurface scattered light intensity levels 2-10.
　クスミ肌は、鏡面反射光の強度がレベル0～8であり、鏡面反射光の均一性がレベル1～9であり、表面下散乱光の強度のレベルが0～6である。 Dull skin has specular reflection intensity levels 0-8, specular reflection uniformity levels 1-9, and subsurface scattered light intensity levels 0-6.
　ギラツキ肌は、鏡面反射光の強度がレベル5～10であり、鏡面反射光の均一性がレベル0～4であり、表面下散乱光の強度のレベルが0～7である。 Glittering skin has specular reflection intensity levels 5-10, specular reflection uniformity levels 0-4, and subsurface scattered light intensity levels 0-7.
　透明肌は、鏡面反射光の強度がレベル0～8であり、鏡面反射光の均一性がレベル4～10であり、表面下散乱光の強度のレベルが5～10である。 Transparent skin has specular reflection intensity levels 0-8, specular reflection uniformity levels 4-10, and subsurface scattered light intensity levels 5-10.
　なお、本発明で用いる光学特性のパラメータ（つまり、鏡面反射光の強度と、鏡面反射光の均一性と、表面下散乱光の強度）および肌の質感の類型は、以下の実験から見い出された。
［肌計測］
・まず、被験者の肌データを取得した。具体的には、肌の光を計測して、肌の見た目の状態を示す画像、鏡面反射光を示す画像、拡散反射光を示す画像、表面下散乱光を示す画像、を取得した。
［視感判定］
・次に、観察者が、［肌計測］で取得された画像を観察して分類した。
［肌の質感の評価に関連する光学特性のパラメータの抽出］
・［肌計測］および［視感判定］の結果から、鏡面反射光の強度と、鏡面反射光の均一性と、表面下反射光の強度と、が肌の質感に影響を与えることが明らかとなった。 The parameters of the optical properties used in the present invention (that is, the intensity of the specular reflected light, the uniformity of the specular reflected light, and the intensity of the subsurface scattered light) and the type of skin texture were found from the following experiments. .
[Skin measurement]
・First, the subject's skin data was obtained. Specifically, the light of the skin was measured, and an image showing the appearance of the skin, an image showing the specular reflected light, an image showing the diffuse reflected light, and an image showing the subsurface scattered light were obtained.
[Visual judgment]
- Next, the observer observed and classified the images obtained by [skin measurement].
[Extraction of optical characteristic parameters related to evaluation of skin texture]
・From the results of [Skin measurement] and [Visual judgment], it is clear that the intensity of specular reflected light, the uniformity of specular reflected light, and the intensity of subsurface reflected light affect the texture of the skin. became.
＜肌の質感の要因となる肌の状態の推定＞
　本発明の一実施形態では、鏡面反射光の強度と、鏡面反射光の均一性と、表面下散乱光の強度と、の少なくとも１つから、肌の質感の要因となる肌の状態を推定することができる。以下、図７を参照しながら、肌の光学特性と肌の状態の関係について詳細に説明する。 <Estimation of skin condition as a factor of skin texture>
In one embodiment of the present invention, skin conditions that contribute to skin texture are estimated from at least one of the intensity of specular reflected light, the uniformity of specular reflected light, and the intensity of subsurface scattered light. be able to. Hereinafter, the relationship between the optical characteristics of the skin and the condition of the skin will be described in detail with reference to FIG.
　図７は、本発明の一実施形態に係る肌の光学特性と肌の状態の関係について説明するための図である。鏡面反射光の強度は、肌の角層の硬さ、肌の皮脂、肌の角層重層化と相関する。鏡面反射光の均一性は、肌の粘弾性、肌の毛穴、肌のニキビ、肌の小じわ、肌のキメと相関する。表面下散乱光は、肌の表皮のメラニン、肌の角層の透明度、肌の角層水分量、肌の角層重層化、肌のヘモグロビン、肌の真皮のコラーゲンと相関する。 FIG. 7 is a diagram for explaining the relationship between the optical characteristics of the skin and the state of the skin according to one embodiment of the present invention. The intensity of the specularly reflected light correlates with the hardness of the stratum corneum of the skin, the sebum of the skin, and the stratification of the stratum corneum of the skin. The uniformity of specularly reflected light correlates with skin viscoelasticity, skin pores, skin acne, skin fine lines, and skin texture. Subsurface scattered light is correlated with epidermal melanin of the skin, transparency of the stratum corneum of the skin, water content of the stratum corneum of the skin, stratification of the stratum corneum of the skin, hemoglobin of the skin, and collagen of the dermis of the skin.
　図７の相関関係から、評価部１０３は、鏡面反射光の強度と、鏡面反射光の均一性と、表面下散乱光の強度と、の少なくとも１つから、肌の質感の要因となる肌の状態を推定することができる。 From the correlation in FIG. 7, the evaluation unit 103 determines, from at least one of the intensity of the specular reflected light, the uniformity of the specular reflected light, and the intensity of the subsurface scattered light, the intensity of the skin, which is a factor of the texture of the skin. state can be estimated.
　例えば、評価部１０３は、鏡面反射光の強度から、肌の角層の硬さと、肌の皮脂と、肌の角層重層化とのうちの少なくとも１つを推定することができる。 For example, the evaluation unit 103 can estimate at least one of the hardness of the stratum corneum of the skin, the sebum of the skin, and the stratification of the stratum corneum of the skin from the intensity of the specularly reflected light.
　例えば、評価部１０３は、鏡面反射光の均一性から、肌の粘弾性と、肌の毛穴と、肌のニキビと、肌の小じわと、肌のキメとのうちの少なくとも１つを推定することができる。 For example, the evaluation unit 103 estimates at least one of skin viscoelasticity, skin pores, skin acne, skin fine wrinkles, and skin texture from the uniformity of specularly reflected light. can be done.
　例えば、評価部１０３は、表面下散乱光の強度から、肌の表皮のメラニンと、肌の角層の透明度と、肌の角層水分量と、肌の角層重層化と、肌のヘモグロビンと、肌の真皮のコラーゲンとのうちの少なくとも１つを推定することができる。 For example, from the intensity of the subsurface scattered light, the evaluation unit 103 determines the melanin of the epidermis of the skin, the transparency of the stratum corneum of the skin, the water content of the stratum corneum of the skin, the stratification of the stratum corneum of the skin, and the hemoglobin of the skin. , collagen in the dermis of the skin.
＜年齢に応じた肌の質感の評価＞
　本発明の一実施形態では、対象者の年齢に応じた肌の質感であるか否かを評価することができる。以下、図８を参照しながら、肌の光学特性と年齢の関係について詳細に説明する。 <Evaluation of skin texture according to age>
In one embodiment of the present invention, it is possible to evaluate whether the skin texture is suitable for the age of the subject. Hereinafter, the relationship between the optical characteristics of skin and age will be described in detail with reference to FIG.
　図８は、本発明の一実施形態に係る肌の光学特性と年齢の関係について説明するための図である。図８に示されるように、鏡面反射光の強度は年齢と相関し、鏡面反射光の均一性は年齢と相関し、表面下散乱光の強度は年齢と相関する。具体的には、鏡面反射光の強度（図８の左側）は、加齢とともに増加する。鏡面反射光の均一性（不均一の程度）は、加齢とともに増加する。表面下散乱光の強度は、加齢とともに減少する。 FIG. 8 is a diagram for explaining the relationship between optical characteristics of skin and age according to one embodiment of the present invention. As shown in FIG. 8, specular reflected light intensity correlates with age, specular reflected light uniformity correlates with age, and subsurface scattered light intensity correlates with age. Specifically, the intensity of specularly reflected light (left side of FIG. 8) increases with aging. The uniformity (degree of non-uniformity) of specularly reflected light increases with age. The intensity of subsurface scattered light decreases with age.
　図８の相関関係から、評価部１０３は、対象者の肌の質感が対象者の年齢に応じた肌の質感であるか否かを評価することができる。 From the correlation in FIG. 8, the evaluation unit 103 can evaluate whether or not the texture of the skin of the subject corresponds to the age of the subject.
＜方法＞
　図９は、本発明の一実施形態に係る肌評価処理のフローチャートである。 <Method>
FIG. 9 is a flowchart of skin evaluation processing according to one embodiment of the present invention.
　ステップ１（Ｓ１）において、画像取得部１０１は、光源３０からの光が照射された肌の画像を、撮像機器２０から取得する。次に、画像取得部１０１は、撮像機器２０から取得した画像から、肌の３次元形状を示す形状情報および色情報（具体的には、各点のＸ座標・Ｙ座標・Ｚ座標の値、および、各点のＲＧＢの各値）、あるいは、肌の２次元形状を示す形状情報および色情報（具体的には、各点のＸ座標・Ｙ座標の値、および、各点のＲＧＢの各値）を取得する。 In step 1 ( S<b>1 ), the image acquisition unit 101 acquires an image of skin irradiated with light from the light source 30 from the imaging device 20 . Next, the image acquisition unit 101 acquires shape information and color information indicating the three-dimensional shape of the skin from the image acquired from the imaging device 20 (specifically, X coordinate, Y coordinate, and Z coordinate values of each point, and RGB values of each point), or shape information and color information indicating the two-dimensional shape of the skin (specifically, the X-coordinate and Y-coordinate values of each point, and the RGB values of each point). value).
　ステップ２（Ｓ２）において、算出部１０２は、Ｓ１で取得された肌の形状情報および肌の色情報を用いて、光の照射により肌の表面で鏡面反射された鏡面反射光の強度と、鏡面反射光の均一性（例えば、不均一の程度）と、光の照射により肌の内部での散乱の後に肌の外部に放出された表面下散乱光の強度と、を算出する。 In step 2 (S2), the calculation unit 102 uses the skin shape information and the skin color information acquired in S1 to determine the intensity of the specularly reflected light reflected by the surface of the skin due to light irradiation and the specular reflection of the specular surface. The uniformity (eg, the degree of non-uniformity) of the reflected light and the intensity of the subsurface scattered light emitted outside the skin after scattering inside the skin due to light irradiation are calculated.
　ステップ３（Ｓ３）において、評価部１０３は、Ｓ２で算出された、光の照射により肌の表面で鏡面反射された鏡面反射光の強度と、鏡面反射光の均一性と、光の照射により肌の内部での散乱の後に肌の外部に放出された表面下散乱光の強度と、から、肌の質感を評価する。評価部１０３は、対象者の肌の質感を複数の類型のうちのいずれかに分類することによって評価することができる。具体的には、評価部１０３は、"鏡面反射光の強度と均一性、および、表面下散乱光の強度を算出"と"肌の質感の類型"との対応関係に基づいて、対象者の肌の質感の類型を決定することができる。 In step 3 (S3), the evaluation unit 103 evaluates the intensity of the specularly reflected light that is specularly reflected on the surface of the skin due to the light irradiation, the uniformity of the specularly reflected light, and the skin by the light irradiation calculated in S2. Skin texture is evaluated from the intensity of subsurface scattered light emitted to the exterior of the skin after scattering within the skin. The evaluation unit 103 can evaluate the texture of the subject's skin by classifying it into one of a plurality of types. Specifically, the evaluation unit 103 determines the subject's The type of skin texture can be determined.
＜ハードウェア構成＞
　図１０は、本発明の一実施形態に係る肌評価装置１０のハードウェア構成の一例を示すブロック図である。 <Hardware configuration>
FIG. 10 is a block diagram showing an example of the hardware configuration of the skin evaluation device 10 according to one embodiment of the invention.
　肌評価装置１０は、ＣＰＵ（Central Processing Unit）１００１、ＲＯＭ（Read Only Memory）１００２、ＲＡＭ（Random Access Memory）１００３を有する。ＣＰＵ１００１、ＲＯＭ１００２、ＲＡＭ１００３は、いわゆるコンピュータを形成する。また、肌評価装置１０は、補助記憶装置１００４、表示装置１００５、操作装置１００６、Ｉ／Ｆ（Interface）装置１００７、ドライブ装置１００８を有することができる。なお、肌評価装置１０の各ハードウェアは、バスＢを介して相互に接続されている。 The skin evaluation device 10 has a CPU (Central Processing Unit) 1001, a ROM (Read Only Memory) 1002, and a RAM (Random Access Memory) 1003. The CPU 1001, ROM 1002, and RAM 1003 form a so-called computer. The skin evaluation device 10 can also have an auxiliary storage device 1004 , a display device 1005 , an operation device 1006 , an I/F (Interface) device 1007 and a drive device 1008 . Each piece of hardware of the skin evaluation device 10 is connected to each other via a bus B. As shown in FIG.
　ＣＰＵ１００１は、補助記憶装置１００４にインストールされている各種プログラムを実行する演算デバイスである。 The CPU 1001 is an arithmetic device that executes various programs installed in the auxiliary storage device 1004 .
　ＲＯＭ１００２は、不揮発性メモリである。ＲＯＭ１００２は、補助記憶装置１００４にインストールされている各種プログラムをＣＰＵ１００１が実行するために必要な各種プログラム、データ等を格納する主記憶デバイスとして機能する。具体的には、ＲＯＭ１００２はＢＩＯＳ（Basic Input/Output System）やＥＦＩ（Extensible Firmware Interface）等のブートプログラム等を格納する、主記憶デバイスとして機能する。 The ROM 1002 is a non-volatile memory. The ROM 1002 functions as a main storage device that stores various programs, data, etc. necessary for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004 . Specifically, the ROM 1002 functions as a main storage device that stores boot programs such as BIOS (Basic Input/Output System) and EFI (Extensible Firmware Interface).
　ＲＡＭ１００３は、ＤＲＡＭ（Dynamic Random Access Memory）やＳＲＡＭ（Static Random Access Memory）等の揮発性メモリである。ＲＡＭ１００３は、補助記憶装置１００４にインストールされている各種プログラムがＣＰＵ１００１によって実行される際に展開される作業領域を提供する、主記憶デバイスとして機能する。 The RAM 1003 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). The RAM 1003 functions as a main storage device that provides a work area that is developed when various programs installed in the auxiliary storage device 1004 are executed by the CPU 1001 .
　補助記憶装置１００４は、各種プログラムや、各種プログラムが実行される際に用いられる情報を格納する補助記憶デバイスである。 The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when various programs are executed.
　表示装置１００５は、肌評価装置１０の内部状態等を表示する表示デバイスである。 The display device 1005 is a display device that displays the internal state of the skin evaluation device 10 and the like.
　操作装置１００６は、肌評価装置１０の管理者が肌評価装置１０に対して各種指示を入力する入力デバイスである。 The operating device 1006 is an input device for the administrator of the skin evaluation device 10 to input various instructions to the skin evaluation device 10 .
　Ｉ／Ｆ装置１００７は、ネットワークに接続し、肌評価装置１０と通信を行うための通信デバイスである。 The I/F device 1007 is a communication device for connecting to a network and communicating with the skin evaluation device 10.
　ドライブ装置１００８は記憶媒体１００９をセットするためのデバイスである。ここでいう記憶媒体１００９には、ＣＤ－ＲＯＭ、フレキシブルディスク、光磁気ディスク等のように情報を光学的、電気的あるいは磁気的に記録する媒体が含まれる。また、記憶媒体１００９には、ＥＰＲＯＭ (Erasable Programmable Read Only Memory)、フラッシュメモリ等のように情報を電気的に記録する半導体メモリ等が含まれていてもよい。 A drive device 1008 is a device for setting a storage medium 1009 . The storage medium 1009 here includes media such as CD-ROMs, flexible disks, magneto-optical disks, etc., which record information optically, electrically or magnetically. The storage medium 1009 may also include a semiconductor memory that electrically records information such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, or the like.
　なお、補助記憶装置１００４にインストールされる各種プログラムは、例えば、配布された記憶媒体１００９がドライブ装置１００８にセットされ、該記憶媒体１００９に記録された各種プログラムがドライブ装置１００８により読み出されることでインストールされる。あるいは、補助記憶装置１００４にインストールされる各種プログラムは、Ｉ／Ｆ装置１００７を介して、ネットワークよりダウンロードされることでインストールされてもよい。 Various programs to be installed in the auxiliary storage device 1004 are installed by, for example, setting the distributed storage medium 1009 in the drive device 1008 and reading the various programs recorded in the storage medium 1009 by the drive device 1008. be done. Alternatively, various programs installed in the auxiliary storage device 1004 may be installed by being downloaded from the network via the I/F device 1007 .
　以上、本発明の実施例について詳述したが、本発明は上述した特定の実施形態に限定されるものではなく、特許請求の範囲に記載された本発明の要旨の範囲内において、種々の変形・変更が可能である。 Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications can be made within the scope of the gist of the present invention described in the claims.・Changes are possible.
　本国際出願は２０２１年１０月５日に出願された日本国特許出願２０２１－１６４２７５号に基づく優先権を主張するものであり、２０２１－１６４２７５号の全内容をここに本国際出願に援用する。 This international application claims priority based on Japanese Patent Application No. 2021-164275 filed on October 5, 2021, and the entire contents of No. 2021-164275 are hereby incorporated into this international application.
１　肌評価システム
１０　肌評価装置
２０　撮像機器
３０　光源
１０１　画像取得部
１０２　算出部
１０３　評価部
１０４　提示部
１００１　ＣＰＵ
１００２　ＲＯＭ
１００３　ＲＡＭ
１００４　補助記憶装置
１００５　表示装置
１００６　操作装置
１００７　Ｉ／Ｆ装置
１００８　ドライブ装置
１００９　記憶媒体 1 skin evaluation system 10 skin evaluation device 20 imaging device 30 light source 101 image acquisition unit 102 calculation unit 103 evaluation unit 104 presentation unit 1001 CPU
1002 ROMs
1003 RAM
1004 auxiliary storage device 1005 display device 1006 operation device 1007 I/F device 1008 drive device 1009 storage medium

Claims (13)

  1. 　対象者の肌の質感を評価する装置であって、
    　光の照射により前記肌の表面で鏡面反射された鏡面反射光の強度と、前記鏡面反射光の均一性と、前記光の照射により前記肌の内部での散乱の後に前記肌の外部に放出された表面下散乱光の強度と、を算出する算出部と、
    　前記鏡面反射光の強度と、前記鏡面反射光の均一性と、前記表面下散乱光の強度と、から、前記肌の質感を評価する評価部と
    　を備えた肌評価装置。     A device for evaluating the texture of a subject's skin,
    The intensity of specularly reflected light specularly reflected on the surface of the skin due to light irradiation, the uniformity of the specularly reflected light, and the light emitted to the outside of the skin after being scattered inside the skin due to the irradiation of the light. a calculation unit that calculates the intensity of the subsurface scattered light;
    a skin evaluation device that evaluates the texture of the skin based on the intensity of the specularly reflected light, the uniformity of the specularly reflected light, and the intensity of the subsurface scattered light.
  2. 　前記評価部は、前記肌の質感を複数の類型のうちのいずれかに分類することによって評価する、請求項１に記載の肌評価装置。 The skin evaluation device according to claim 1, wherein the evaluation unit evaluates the texture of the skin by classifying it into one of a plurality of types.
  3. 　前記複数の類型は、ツヤ肌、テカリ肌、マット肌、クスミ肌、ギラツキ肌、透明肌である、請求項２に記載の肌評価装置。 The skin evaluation device according to claim 2, wherein the plurality of types are glossy skin, shiny skin, matte skin, dull skin, shiny skin, and transparent skin.
  4. 　前記評価部は、前記鏡面反射光の強度と、前記鏡面反射光の均一性と、前記表面下散乱光の強度と、の少なくとも１つから、前記肌の質感の要因となる前記肌の状態を推定する、請求項１に記載の肌評価装置。 The evaluation unit determines the condition of the skin, which is a factor of the texture of the skin, from at least one of the intensity of the specularly reflected light, the uniformity of the specularly reflected light, and the intensity of the subsurface scattered light. The skin evaluation device according to claim 1, which estimates.
  5. 　前記肌の質感の要因となる前記肌の状態は、前記肌の角層の硬さと、前記肌の皮脂と、前記肌の角層重層化とのうちの少なくとも１つであり、
    　前記評価部は、前記鏡面反射光の強度から、前記肌の角層の硬さと、前記肌の皮脂と、前記肌の角層重層化とのうちの少なくとも１つを推定する、請求項４に記載の肌評価装置。     The condition of the skin, which is a factor of the texture of the skin, is at least one of hardness of the stratum corneum of the skin, sebum of the skin, and stratification of the stratum corneum of the skin,
    5. The method according to claim 4, wherein the evaluation unit estimates at least one of hardness of the stratum corneum of the skin, sebum of the skin, and stratification of the stratum corneum of the skin from the intensity of the specularly reflected light. The described skin evaluation device.
  6. 　前記肌の質感の要因となる前記肌の状態は、前記肌の粘弾性と、前記肌の毛穴と、前記肌のニキビと、前記肌の小じわと、前記肌のキメとのうちの少なくとも１つであり、
    　前記評価部は、前記鏡面反射光の均一性から、前記肌の粘弾性と、前記肌の毛穴と、前記肌のニキビと、前記肌の小じわと、前記肌のキメとのうちの少なくとも１つを推定する、請求項４に記載の肌評価装置。     The skin condition that is a factor of the texture of the skin is at least one of the viscoelasticity of the skin, the pores of the skin, the acne of the skin, the fine wrinkles of the skin, and the texture of the skin. and
    The evaluation unit determines at least one of the viscoelasticity of the skin, the pores of the skin, the acne of the skin, the fine wrinkles of the skin, and the texture of the skin, based on the uniformity of the specularly reflected light. The skin evaluation device according to claim 4, which estimates
  7. 　前記肌の質感の要因となる前記肌の状態は、前記肌の表皮のメラニンと、前記肌の角層の透明度と、前記肌の角層水分量と、前記肌の角層重層化と、前記肌のヘモグロビンと、前記肌の真皮のコラーゲンとのうちの少なくとも１つであり、
    　前記評価部は、前記表面下散乱光の強度から、前記肌の表皮のメラニンと、前記肌の角層の透明度と、前記肌の角層水分量と、前記肌の角層重層化と、前記肌のヘモグロビンと、前記肌の真皮のコラーゲンとのうちの少なくとも１つを推定する、請求項４に記載の肌評価装置。     The condition of the skin, which is a factor of the texture of the skin, is the melanin of the epidermis of the skin, the transparency of the stratum corneum of the skin, the water content of the stratum corneum of the skin, the stratification of the stratum corneum of the skin, and the at least one of skin hemoglobin and dermal collagen of said skin;
    The evaluation unit determines, from the intensity of the subsurface scattered light, the melanin of the epidermis of the skin, the transparency of the stratum corneum of the skin, the water content of the stratum corneum of the skin, the stratification of the stratum corneum of the skin, and the 5. The skin evaluation device according to claim 4, wherein at least one of hemoglobin of skin and collagen of dermis of said skin is estimated.
  8. 　前記肌の質感の要因となる前記肌の状態に応じた美容情報を提示する提示部、をさらに備えた請求項４から７のいずれか一項に記載の肌評価装置。 The skin evaluation device according to any one of claims 4 to 7, further comprising a presentation unit that presents beauty information according to the skin condition that is a factor in the texture of the skin.
  9. 　前記評価部は、前記対象者の年齢に応じた肌の質感であるか否かを評価する、請求項１に記載の肌評価装置。 The skin evaluation device according to claim 1, wherein the evaluation unit evaluates whether the skin texture is appropriate for the age of the subject.
  10. 　光が照射された肌の形状情報および色情報を取得する取得部をさらに備え、
    　前記算出部は、前記形状情報および前記色情報から、前記鏡面反射光の強度と、前記鏡面反射光の均一性と、前記表面下散乱光の強度と、を算出する、請求項１から９のいずれか一項に記載の肌評価装置。     further comprising an acquisition unit for acquiring shape information and color information of the skin irradiated with light,
    10. The method of claim 1, wherein the calculation unit calculates the intensity of the specularly reflected light, the uniformity of the specularly reflected light, and the intensity of the subsurface scattered light from the shape information and the color information. The skin evaluation device according to any one of the items.
  11. 　前記形状情報は、前記肌の３次元形状を示す、請求項１０に記載の肌評価装置。 The skin evaluation device according to claim 10, wherein the shape information indicates a three-dimensional shape of the skin.
  12. 　光の照射により肌の表面で鏡面反射された鏡面反射光の強度と、前記鏡面反射光の均一性と、前記光の照射により前記肌の内部での散乱の後に前記肌の外部に放出された表面下散乱光の強度と、を算出するステップと、
    　前記鏡面反射光の強度と、前記鏡面反射光の均一性と、前記表面下散乱光の強度と、から、前記肌の質感を評価するステップと
    　を含む方法。     The intensity of specularly reflected light specularly reflected on the surface of the skin due to light irradiation, the uniformity of the specularly reflected light, and the light emitted to the outside of the skin after being scattered inside the skin due to the irradiation of the light calculating the intensity of subsurface scattered light;
    assessing the texture of the skin from the intensity of the specularly reflected light, the homogeneity of the specularly reflected light, and the intensity of the subsurface scattered light.
  13. 　コンピュータを
    　光の照射により肌の表面で鏡面反射された鏡面反射光の強度と、前記鏡面反射光の均一性と、前記光の照射により前記肌の内部での散乱の後に前記肌の外部に放出された表面下散乱光の強度と、を算出する算出部、
    　前記鏡面反射光の強度と、前記鏡面反射光の均一性と、前記表面下散乱光の強度と、から、前記肌の質感を評価する評価部
    　として機能させるためのプログラム。     intensity of specularly reflected light specularly reflected on the surface of the skin due to light irradiation, uniformity of the specularly reflected light, and emission outside the skin after scattering inside the skin due to the irradiation of the light a calculation unit that calculates the intensity of the subsurface scattered light that has been obtained;
    A program for functioning as an evaluation unit that evaluates the texture of the skin from the intensity of the specularly reflected light, the uniformity of the specularly reflected light, and the intensity of the subsurface scattered light.
PCT/JP2022/035274 2021-10-05 2022-09-21 Skin evaluation device, method, and program WO2023058464A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021-164275 2021-10-05
JP2021164275 2021-10-05

Publications (1)

Publication Number Publication Date
WO2023058464A1 true WO2023058464A1 (en) 2023-04-13

Family

ID=85804191

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/035274 WO2023058464A1 (en) 2021-10-05 2022-09-21 Skin evaluation device, method, and program

Country Status (1)

Country Link
WO (1) WO2023058464A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007105457A (en) * 2005-09-16 2007-04-26 Kao Corp Method of forming simulation image of skin
US20110206254A1 (en) * 2010-02-22 2011-08-25 Canfield Scientific, Incorporated Reflectance imaging and analysis for evaluating tissue pigmentation
US20150099947A1 (en) * 2013-10-04 2015-04-09 Access Business Group International Llc Skin youthfulness index, methods and applications thereof
JP2015085039A (en) * 2013-10-31 2015-05-07 シャープ株式会社 Measuring device
JP2020122717A (en) * 2019-01-31 2020-08-13 キヤノン株式会社 Imaging apparatus and imaging method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007105457A (en) * 2005-09-16 2007-04-26 Kao Corp Method of forming simulation image of skin
US20110206254A1 (en) * 2010-02-22 2011-08-25 Canfield Scientific, Incorporated Reflectance imaging and analysis for evaluating tissue pigmentation
US20150099947A1 (en) * 2013-10-04 2015-04-09 Access Business Group International Llc Skin youthfulness index, methods and applications thereof
JP2015085039A (en) * 2013-10-31 2015-05-07 シャープ株式会社 Measuring device
JP2020122717A (en) * 2019-01-31 2020-08-13 キヤノン株式会社 Imaging apparatus and imaging method

Similar Documents

Publication Publication Date Title
Nielsen et al. On optimal, minimal BRDF sampling for reflectance acquisition
US8264490B2 (en) Practical modeling and acquisition of layered facial reflectance
US11452455B2 (en) Skin reflectance and oiliness measurement
JP6554638B2 (en) Identification of objects in the volume based on the characteristics of the light reflected by the objects
US7916910B2 (en) Image processing method and apparatus
EP2005886B1 (en) Method and apparatus for measuring skin texture
JP5024067B2 (en) Face authentication system, method and program
US11710289B2 (en) Information processing apparatus, information processing system, and material identification method
JP6756524B2 (en) How to analyze the effects of cosmetic procedures
EP1693003A1 (en) Device and method for demonstrating and quantifying skin texture
US20090043363A1 (en) Method and apparatus for measuring skin texture
JP2009211151A (en) Face image processor
JP6029379B2 (en) Skin condition evaluation method and skin condition evaluation apparatus
KR20170105974A (en) Evaluation device for skin texture based on skin blob and method thereof
WO2023058464A1 (en) Skin evaluation device, method, and program
JP2008212189A (en) Method for easily measuring transparency of skin
JP2023120414A (en) Optical measurement device, method and program
JP6527765B2 (en) Wrinkle state analyzer and method
JP6898150B2 (en) Pore detection method and pore detection device
JP5398354B2 (en) Evaluation method of skin surface condition
JP2022096316A (en) Skin evaluation device, method, program, and system
Ding et al. Obtaining malignant melanoma indicators through statistical analysis of 3D skin surface disruptions
KR20240030209A (en) Device and method for evaluating glossiness of skin based on analysis of image
SOHAIB et al. 3D In-Vivo Measurement of Skin Topography Using Photometric Stereo
CN114845628A (en) Illumination compensation in imaging

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22878335

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023552793

Country of ref document: JP