KR102512358B1 - Portable electronic device, accessory and operation method thereof - Google Patents

Abstract

The present invention relates to a portable electronic device, an accessory, and an operating method thereof, and a portable electronic device according to an embodiment includes a light source for radiating light to the skin, and at least one light detector for detecting light received from the skin. detector), at least one memory for storing instructions, and a processor that executes the instructions, controls the light source to emit the light, and analyzes the state of the skin based on the light detected by the light detector. .

Description

Portable electronic device, accessory, and operation method thereof {PORTABLE ELECTRONIC DEVICE, ACCESSORY AND OPERATION METHOD THEREOF}

The present invention relates to portable electronic devices, accessories and methods of operation thereof.

Portable electronic devices have some limitations in their performance due to their portability. However, with the development of technology, the performance of portable electronic devices has improved so that they can perform more complex and diverse functions. In particular, as the performance of each device mounted on the portable electronic device improves, the role that the portable electronic device can perform is increasing. For example, with the development of camera modules, more sophisticated images can be acquired, and a processing device with improved performance can analyze the obtained sophisticated images at high speed to obtain necessary results.

Recently, attempts have been made to analyze the condition of the skin using portable electronic devices having such improved performance. In particular, various methods have been proposed for a user to easily analyze a skin condition using a portable electronic device without complicated and expensive measuring instruments or equipment.

Republic of Korea Patent Publication No. 10-2016-0023441 (2016.03.03) Republic of Korea Patent Publication No. 10-2009-0097904 (2009.09.16)

An embodiment may provide a portable electronic device, an accessory, and an operating method for analyzing a skin condition by irradiating light onto the skin and using light reflected and/or scattered from the skin.

A portable electronic device according to an embodiment includes a light source for radiating light to the skin, at least one light detector for detecting light received from the skin, at least one memory for storing instructions, and executing the instructions. By doing so, a processor controlling the light source to radiate the light and analyzing the state of the skin based on the light detected by the light detector is included.

A method of operating a portable electronic device according to an embodiment includes radiating light to skin, detecting light received from the skin, and analyzing a state of the skin based on the detected light. .

A computer program product including a recording medium according to an embodiment stores a program for performing an operation of a portable electronic device.

1 is a diagram showing energy transfer of coproporphyrin.
2 is a diagram showing the light spectrum of porphyrin.
3 is a diagram illustrating a process of visualizing wrinkles according to an exemplary embodiment.
4 is a diagram illustrating a difference in visualization results according to the sharpness of wrinkles according to an exemplary embodiment.
5 is a diagram illustrating an electronic device according to an exemplary embodiment.
6 is a diagram for explaining a process of analyzing a skin condition using a portable electronic device according to an exemplary embodiment.
7 is a diagram illustrating a portable electronic device including an optical element according to an exemplary embodiment.
FIG. 8 is a diagram illustrating a connection between a portable electronic device and a shield by using a magnetic link according to an exemplary embodiment.
FIG. 9 is a diagram showing how to combine a portable electronic device and a shield by using a slider according to an exemplary embodiment.
9 is a diagram illustrating mounting of a detection shield (phone case).
10 is a diagram illustrating a shielding unit configured as an accessory attachable to a portable electronic device according to an exemplary embodiment.
11 is a block diagram illustrating a configuration of a portable electronic device according to an exemplary embodiment.
12 is a flowchart illustrating a method of operating a portable electronic device according to an exemplary embodiment.

Hereinafter, embodiments of the present disclosure will be described in detail so that those skilled in the art can easily practice them with reference to the accompanying drawings. However, the present disclosure may be embodied in many different forms and is not limited to the embodiments described herein. In addition, in order to clearly describe the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar reference numerals are attached to similar parts throughout the specification.

Some embodiments of the present disclosure may be represented as functional block structures and various processing steps. Some or all of these functional blocks may be implemented as a varying number of hardware and/or software components that perform specific functions. For example, functional blocks of the present disclosure may be implemented by one or more microprocessors or circuit configurations for a predetermined function. Also, for example, the functional blocks of this disclosure may be implemented in various programming or scripting languages. Functional blocks may be implemented as an algorithm running on one or more processors. In addition, the present disclosure may employ prior art for electronic environment setting, signal processing, and/or data processing.

In addition, connecting lines or connecting members between components shown in the drawings are only examples of functional connections and/or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that can be replaced or added.

In addition, terms such as "...unit" and "module" described in this specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software, or a combination of hardware and software. there is. "Unit" and "module" may be implemented by a program stored in an addressable storage medium and executed by a processor.

For example, "part" and "module" refer to components such as software components, object-oriented software components, class components, and task components, processes, functions, properties, and programs. It can be implemented by procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays and variables.

1 is a diagram showing energy transfer of coproporphyrin.

Porphyrins are porphyrin derivatives present in animals and plants, and are substances constituting hemoglobin, cytochrome or chlorophyll. Human skin tissue contains porphyrin, a phosphor that absorbs energy of a specific wavelength and emits energy having a wavelength different from the corresponding wavelength. These porphyrins are also associated with the activity of certain bacteria on the skin. In one embodiment, in order to monitor the skin condition, the concentration of moisture and porphyrin contained in human skin may be monitored.

In one embodiment, as a method for analyzing a skin condition, light is irradiated to a target skin area, and light reflected and/or scattered from the target skin area is analyzed to determine the distribution of moisture and/or porphyrin contained in the skin. can be monitored. More specifically, measurement of reflectance and color spectra of human skin, experimental determination of intrinsic optical parameters (μ _a , μ _s , g, n) of skin and light propagation in tissue This can be done through mathematical modeling of the process. By analyzing light reflected from the skin and returning, information on various skin components such as melanin, hemoglobin, moisture, carotene, and bilirubin, and the presence and concentration of porphyrin in the skin can be obtained.

Coproporphyrin is one of the types of porphyrins, and is a porphyrin containing four methyl groups and four propionic acid groups, respectively, in a side chain.

Referring to Figure 1, coproporphyrin can be excited to provide fluorescence in the red region of the light spectrum having a wavelength of about 620 nm (S ₀ -> S ₂ ). More specifically, coproporphyrin may be excited using blue light having a wavelength of about 405 nm. Here, blue light having a wavelength of about 405 nm is in the visible spectrum range and is not dangerous to humans. The excited coproporphyrin returns to the ground state (S ₁ -> S ₀ ) and emits light having a wavelength of about 620 nm.

2 is a diagram showing the fluorescence spectrum of porphyrin.

Protoporphyrin IX (PPIX) is another type of porphyrin found in the skin and can be produced by the body through the biosynthesis of heme.

Referring to FIG. 2, fluorescence spectra obtained from two types of porphyrins, coproporphyrin and protoporphyrin IX (PPIX), are shown.

Referring to FIG. 2, fluorescence spectra obtained from two types of porphyrins, coproporphyrin and protoporphyrin IX (PPIX), are shown. Like coproporphyrin, protoporphyrin IX also returns to the ground state when excited using blue light having a wavelength of about 405 nm and produces fluorescence in the red region of the spectrum (wavelength of about 635 nm).

In one embodiment, excitation and emission using such blue light can be used to detect the presence of coproporphyrin and/or protoporphyrin IX (PPIX). Furthermore, the detection of coproporphyrin and/or protoporphyrin IX (PPIX) can be used to analyze the purity of skin, the activity of acne, potential sites of acne, etc.

In one embodiment, light emitted from a light source (eg, a light emitting diode (LED), etc.) may pass through a first filter that transmits light in a wavelength range that excites porphyrin and may be irradiated to the skin. The light irradiated to the skin interacts with the skin through absorption, reflection, scattering, etc., and then passes through a second filter that transmits light in a wavelength range emitted by the excited porphyrin and may be received by the photodetector. In this case, the photodetector may include a CMOS module and an objective lens. After that, the processor may analyze the skin condition based on the detected light. The processor may perform intensity analysis of the image to obtain quantitative and qualitative characteristics of the visualized skin. At this time, the processor may perform analysis using the image intensity matrix. The pixel or group of pixels with the highest intensity can characterize the concentration of protoporphyrin IX (PPIX) produced by the body from the biosynthesis of heme, and the average intensity can characterize the amount of sebum.

More specifically, the processor may analyze the intensities of pixels or groups of pixels from the images and the spatial distribution of their values. The processor then determines the characteristic coefficients of the dynamics associated with the progression of acne on the skin. Next, the processor can display the intensity of pixels or groups of pixels and the spatial distribution of their values in the image, and analyze the image to provide visualization and biological feedback. Here, biological feedback refers to the dependence of the brightness of a pixel or group of pixels on the visualization parameters of porphyrins. The brightness of a pixel or group of pixels is proportional to the porphyrin concentration. Therefore, monitoring the efficiency of washing the face can display the body's response to external influences in real time, so it can be said to be an effective biological feedback.

In one embodiment, the processor may display the altered skin image or coefficient on the screen.

According to one embodiment, based on the fluorescence properties of porphyrin, the purity of the skin, the activity of acne, the potential site of acne, etc. can be analyzed. As described above, when human skin containing porphyrin is irradiated with light having a wavelength of 405 nm, the porphyrin is excited to emit fluorescence and re-emit energy at a different wavelength, particularly a wavelength of 650 nm, to form a secondary light source. This can be. Therefore, it is necessary to record an image of the object (hole with fluorescent porphyrin) using a secondary light source while physically blocking the detection radiation using a narrowband filter with a central bandwidth of about 650 nm.

Eventually, the fluorescence effect of porphyrins produces an image of a system of bright fluorescent spots corresponding to the blind pores. The image is then binarized, and the resulting image can be analyzed. Depending on the intensity and/or brightness of the fluorescent spot and its concentration per unit area of the skin, the purity of the skin, the activity of acne, and the potential site of acne can be determined.

3 is a diagram illustrating a process of visualizing wrinkles according to an exemplary embodiment.

The reflective properties of the human skin surface and subsurface have a dependence on age-related changes. That is, human skin has a smoother surface as the age increases. Due to this characteristic, the younger the age, the higher the surface reflectance of the skin and the higher the reflectance below the skin surface. According to an embodiment, a component of surface reflection from the skin, known as specular reflection from a smooth surface, is removed by using a characteristic of polarization, and only a reflection component under the human skin surface can be captured and displayed as an image.

As people age, the sebaceous glands of a person's skin produce less sebum, and the skin becomes dry and dehydrated. Water loss from the skin increases with age because aging skin cells are unable to restore their protective barrier on their own. Human skin cells (or derma by another name), fibroblasts, gradually lose their ability to conserve and retain water, as well as produce high-quality collagen and elastic fibers, which leads to visible wrinkles. leads to formation

Wrinkles refer to sudden changes in the depth of the localized skin surface at a specific location. In one embodiment, skin wrinkles may be measured to analyze skin condition. In this case, the process of measuring skin wrinkles may include a process of visualizing wrinkles. In the process of visualizing wrinkles, surface components of the skin can be visualized using polarized light. More specifically, when the skin is irradiated with linearly polarized light, the transition boundary between the skin and the air (ie, the stratum corneum) generates mirror-reflected light that preserves the polarization of the incident light. However, some photons with random polarization states incident on the skin penetrate deep into the skin tissue before escaping diffuse reflection and then experience subsequent scattering in skin collagen fibers and ligaments.

Splitting of the light into two unrelated parts in the polarization of the reflected component by linear polarization results in the formation of small geometrical features of the skin surface, such as wrinkles, higher-than-peripheral borders of lesions, and pore structures. Skin visualization can be very useful as it allows visual features to be well differentiated from subsurface features of the skin, such as pigment changes due to melanin or redness of the skin (erythema).

In one embodiment, the wrinkle visualization process obtains a skin image by irradiating parallel-polarized light on the skin, and displays the acquired image in a red channel. Thereafter, the direction of the wrinkles may be calculated and displayed on the acquired skin image, and finally, the wrinkles may be identified and only the wrinkles may be displayed on the skin image.

Referring to FIG. 3 , image 310 is an image obtained by irradiating the skin with parallel-polarized light, and image 320 is an image showing the acquired image in a red-channel. In addition, image 330 is an image in which the direction of wrinkles is calculated and the calculated direction is displayed on image 320, and image 340 is an image in which wrinkles identified after performing final filtering on the normalized original skin image are displayed.

4 is a diagram illustrating a difference in visualization results according to the sharpness of wrinkles according to an exemplary embodiment.

Referring to FIG. 4 , image 410 shows wrinkles identified by visualizing wrinkles on skin having clear wrinkles, and image 420 shows wrinkles identified by visualizing wrinkles on skin having clear wrinkles. According to one embodiment, it is possible to identify and visualize not only clear wrinkles but also wrinkles that are difficult to identify with the naked eye.

5 is a diagram showing an electric car device according to an embodiment.

Referring to FIG. 5 , a portable electronic device 500 may include a light source 501, a light detector 502, a lens 503, a processor 504, a display 505, and a shielding unit 506.

The light source 501 emits light. In one embodiment, the light source may radiate light to the skin. Here, the light may include white light.

The photodetector 502 receives and detects light. In one example, light detector 502 detects received light. More specifically, light emitted from the light source 501 and reflected and/or scattered from the skin and returned may be detected.

The lens 503 adjusts the light received by the photodetector 502 . In one embodiment, the lens 503 may change the focus of light received by the photodetector 502 .

Processor 504 controls the operation of light source 501 , light detector 502 and display 505 . Also, the processor 504 may convert the light received by the photodetector 502 into an electrical signal and process it according to a specific algorithm.

In one embodiment, the processor considers the instability of the light source (the effect of battery charging, changes in the spectrum of the light source, movement of the light source, dust, etc.), and the data on the reflected intensity of the skin is a reference standard white color (BaSO ₄ ). It can be normalized to an image. Through this process, small imperfections such as moles or other lumps on the skin and instabilities such as changes in battery charge, changes in the spectral intensity of the light source, dust, etc. can be ignored.

The display 505 displays an image under the control of the processor 504.

The shielding portion 506 blocks a light path receiving light emitted from the light source 501 and reflected and/or scattered from the skin and returned from the photodetector 502 from other external light. In one embodiment, the shield 506 may include a hole for passing light emitted from the light source 501 and received light to the photo detector 502 . Further, in one embodiment, the shield 506 may be opaque, have an arbitrary shape, or may be configured in the form of a hollow cylinder having an opaque substrate with a bottom plate. Furthermore, it may have a telescopic function, and the inside may be coated or coated with a light absorbing material or a high reflective material, or may be formed of a high reflective material. In one embodiment, the inner surface of the shield 506 may have a diffuse reflectance in the visible range of not more than 4-5%, and may also have a reflective inner surface that reflects light. surface) shall have a diffuse reflectance in the visible range not less than 95-99%.

In addition, the opacity of the shielding portion 506 is one of the main characteristics for determining measurement conditions. Opacity excludes external illumination and can be taken into account in the calculation of light transmission.

The type of surface coating (absorption or reflection) is an important parameter for calculating light transmission, but the moisture of the skin depends only on the type of skin and its current functional state. If an absorbing surface coating is used, all re-reflected light components can be excluded from the calculation, since the contribution of multiple sudden reflections alters the final color of the skin image. In comparison, in the case of a reflective surface, the contribution of multiple sudden reflections can be taken into account and appropriate modifications of the calculation algorithm can be made. In any case, the reflection and absorption properties of the surface are diametrically opposed (excluding or including light reflection), and must be taken into account since either of them can be used in the present disclosure.

In one embodiment, the above-described components are not necessarily all required and some components may be omitted. For example, light reflected and/or scattered from the skin may be directly received by the photodetector 502 without the lens 503 . Also, for example, when the portable electronic device 500 is connected to another external device having a display, the display 505 may be omitted. However, this is only an example and can be modified in various ways.

Also, in one embodiment, all or some of the above-described components may be configured as accessories of the portable electronic device 500 . For example, the light source 501, the light detector 502, the lens 503, the shield 506, etc. may be configured as accessories attachable to the portable electronic device 500 rather than being part of the portable electronic device 500. can Alternatively, the light source 501 , the photo detector 502 , the lens 503 , the processor 504 , the display 505 , and the shield 506 may all be configured as accessories attachable to the portable electronic device 500 . In this case, the accessory may be configured to mutually communicate with the portable electronic device 500 .

6 is a diagram for explaining a process of analyzing a skin condition using a portable electronic device according to an exemplary embodiment.

Referring to FIG. 6 , a light source 501 radiates light to the skin 507, and the light irradiated to the skin 507 is reflected and/or scattered by the skin and passes through a lens 503 to a photodetector 502. is received as At this time, the shielding unit 506 blocks the light path from other external light so that more accurate analysis can be performed. The processor 504 may analyze the skin condition by processing the light received by the photodetector 502 . In one embodiment, the processor 504 may determine the color coordinates of the skin image and compare the results to mathematical modeling results. In this case, the value of the color may correspond to a specific moisture level of the skin.

7 is a diagram illustrating a portable electronic device including an optical element according to an exemplary embodiment.

Referring to FIG. 7 , a portable electronic device may include one or more optical elements 710 , 720 , and 730 . Here, the optical element 710 may include a scattering plate, a lens, and the like. According to one embodiment, the size of the shielding portion 706 may be reduced by using the optical elements 710 , 720 , and 730 .

In order to reduce the size of the shield 706, more specifically, the height of the shield 706, the rear focal segment of the Own Optical System (OOS) used in the tram apparatus (the distance from the final surface to the rear focal point) ) should be reduced. To this end, various optical elements 710, 720, and 730 may be used. More specifically, the electronic device's own optical system must be supplemented with a focus reducer (eg an additional optical element). From an optical point of view, the focal reducer is a convex lens, and the reduction in focal length can be calculated from the equation

R = 1-D/FR,

where R is the reduction ratio of the focal length, D is the distance to the image plane, and FR is the focal length of the objective lens. For example, if an objective lens having a focal length of 100 mm is located at a distance of 20 mm from the image plane, the focal length can be reduced as follows.

R = 1-20 / 100 = 0.8

In one embodiment, the objective lens is an achromatic lens for detecting macro images, or a general configuration of objective lenses (or lens systems) may be used.

In FIG. 7 , the lenses 720 and 730 provide a reduction in the focal length of the camera of the portable electronic device, making the shield 706 more compact, and the scattering plate can provide uniform illumination of the surface. At least some or all of these optical elements 710 , 720 , and 730 may be integrated into the shield 706 . Also, the shield 706 may have a lid having a standard white color on the inside.

As described above, the shield 706 may be configured separately from the portable electronic device or configured as an accessory of the portable electronic device. In this case, the shield 706 may be combined with the portable electronic device using a specific coupling method. It will be described with reference to FIGS. 7 and 8 .

FIG. 8 is a view illustrating coupling of a portable electronic device and a shield using a magnetic link according to an embodiment, and FIG. 9 illustrates coupling of a portable electronic device and a shield using a slider according to an embodiment. it is a drawing

As described above, all or some of the above-described components may be configured as accessories of a portable electronic device. Referring to FIGS. 8 and 9 , the shielding unit is illustrated as being configured as an accessory attachable to a portable electronic device. In this case, the shield and the portable electronic device may be combined in various ways.

First, referring to FIG. 8 , the portable electronic device 801 and the shield 802 may be coupled using a magnetic link, that is, a magnet. In one embodiment, the portable electronic device 801 includes a metal plate 810 and the shield 802 includes a magnetic plate 820, so that the portable electronic device 801 and the shield 802 include a metal plate ( 810) and the magnetic plate 820 may be coupled. Conversely, the portable electronic device 801 may include a magnetic plate and the shield 802 may include a metal plate. More specifically, the portable electronic device 801 may include a metal plate 810 under the rear surface of the main body. Also, the shield may include a magnetic plate on its surface.

Referring to FIG. 9 , the portable electronic device 901 and the shield 902 may be coupled using a slider. In one embodiment, the portable electronic device 901 includes a guide 910 and the shield 902 includes a guide groove 920 so that the portable electronic device 901 and the shield 902 slide. can be combined Conversely, the portable electronic device 901 may include a guide groove, and the shield 902 may include a guide.

10 is a diagram illustrating a shielding unit configured as an accessory attachable to a portable electronic device according to an exemplary embodiment.

Referring to FIG. 10 , a mobile phone 1010 is illustrated as a portable electronic device, and accessories 1020 and 1030 attachable to the portable electronic device are illustrated. Shielding parts 1021 and 1031 for analyzing skin conditions are formed in the accessories 1020 and 1030 . Although a mobile phone 1010 is illustrated as a portable electronic device in FIG. 10 , the portable electronic device is not limited thereto and may include a laptop computer, a tablet computer, a mobile terminal, a smart phone, and the like. In addition, although accessories 1020 and 1030 are illustrated as mobile phone cases in FIG. 10 , various types of accessories may be used without being limited thereto. For example, only the shielding parts 1021 and 1031 may be separate accessories.

11 is a block diagram illustrating a configuration of a portable electronic device according to an exemplary embodiment.

Referring to FIG. 11 , a portable electronic device 1100 according to an embodiment may include a light source 1110, a light detector 1120, a memory 1130, and a processor 1140.

The light source 1110 emits light. In one embodiment, the light source may radiate light to the skin. Also, the light source may emit light having different wavelengths as needed. Furthermore, the light source may include one or more light sources, and when a plurality of light sources exist, each light source may emit light having the same wavelength or different wavelengths.

The photodetector 1120 receives and detects light. In one example, light detector 1120 detects received light. More specifically, light emitted from the light source 1110 and reflected and/or scattered from the skin and returned may be detected. Furthermore, light emitted from the skin may be detected.

The memory 1130 may store programs and data necessary for the operation of the portable electronic device 1100 . Also, the memory 1130 may store data processed by the portable electronic device 1100 . The memory 1130 may include a storage medium such as a ROM, a RAM, a hard disk, a CD-ROM, and a DVD, or a combination of storage media. Also, the memory 1130 may include a plurality of memories. In one embodiment, memory 1130 may store instructions executable by processor 1140 .

The processor 1140 may control a series of processes in which the portable electronic device 1100 operates. In one embodiment, the processor 1140 may radiate light to the skin, detect light received from the skin, and analyze a state of the skin based on the detected light by executing a program stored in the memory 1130. there is. Also, the processor 1140 may generate an image by processing light detected by the photodetector 1120 .

The processor 1140 may determine quantitative (brightness) and qualitative (color) color characteristics of the skin using colorimetric systems. The processor 1140 may determine three color coordinates (R, G, and B) in units of pixels using a colorimetric system in order to measure the reflectance of the skin for each skin image. Thereafter, the processor 1140 uses a simple ratio for the three color coordinates to determine the color coordinates X, Y, and Z of the color system MKO1931 (Yxy) and the color system L*, a*, and b* MKO1976 (L* a* b* ) can be converted to The contents of melanin, hemoglobin and water in human skin can be evaluated using an algorithm based on the solution of the reverse Monte-Carlo problem. Using this algorithm, at least a two-layer model of the skin can consider all parts of the body. The processor 1140 may calculate the reflection coefficient of the skin using the Monte-Carlo method in the visible spectrum range. After that, the spectrum can be recalculated in the color coordinate system and compared with the experimental data on the reflectance of the skin to determine whether the color coordinates and each spectrum match. Through this process, the contents of melanin, hemoglobin and water in the skin can be evaluated. In addition, RGB values are converted to tricolor values in a color space that is a device-independent color system compatible with existing RGB working spaces (NTSC, sRGB, etc.). Monte-Carlo modeling (MCM) of radiation transport on a human skin model can be used to determine the relationship between the concentrations of melanin, water and blood and the three color values XYZ.

The spectral composition of light penetrating a biological tissue depends on the concentration and spatial distribution of the chromophore in the tissue and the specific experimental conditions, including a plurality of parameters of the incident optical radiation and detection geometry. In one embodiment, processor 1140 may model the visible reflectance spectrum of skin and use computational methods specifically designed to calculate skin color. At this time, the calculated data is compared with the experimental data obtained from the measurement of the extended dynamic range through various parts of the human body.

In view of the very complex structures of tissues and real conditions of detection in the present disclosure, there is no general analysis solution capable of simulating the detected scattered light and its interaction with tissues, structural disorders and/or physiological changes. Thus, probabilistic Monte-Carlo modeling (MCM) can be used. In this disclosure, object-oriented Monte-Carlo modeling is used that can describe the photons and structural components of tissue as objects interacting with each other. Thus, the object (photon) propagates through the object (medium or interlayer) and interacts with the components of the object (medium or interlayer), such as cells, blood vessels, collagen fibers, etc. Representation of the medium by objects enables the development of realistic models of tissues representing the three-dimensional spatial variation of biological structures. A multi-layered model of tissue was applied to model the transmission spectrum. This model, known in the prior art, has been extended to 17 layers by including muscle and bone structures.

Monte-Carlo modeling can be performed considering the actual geometry of the probe used in the experiment using at least 10 ¹⁰ packets of photons. Conversion of the distribution of spectral power to CIE XYZ (CIE 1976 L*a*b*) coordinates and RGB color values can be performed using the standard CIE 2° system and the trichromatic values of the light source used. Observation of the effects of tissue color changes induced by changes in blood moisture and oxygen can potentially have practical diagnostic and bioengineering applications.

These deformations can be quantified and characterized by the developed Monte-Carlo modeling. The main points of this modeling are:

1) Visualization of the skin under certain conditions of light detection is ensured by the use of a specially designed hood for the object

2) Numerical experiments on light transmission in the skin are performed for known light detection conditions and light sources, the result being the number of spectra and respective color coordinates for different amounts of skin chromophores

3) The captured color coordinates are compared with the color coordinates obtained through numerical modeling and each spectrum.

The comparative data (acquired numerically) already contains information about the concentrations of melanin, water and blood for a particular image of the skin. Thus, when comparing coordinates, detecting a match can determine the concentration of the chromophore.

Relationship between RGB values and chromophore concentrations in skin

The RGB values of pixels on a skin surface image generated by a digital camera can be expressed as:

here,

where CIE XYZ are trichromatic values in the color system, (...) ^t is a vector permutation. L ₁ is a conversion matrix for converting XYZ values to corresponding RGB values, and exists for each working space (NTSC, PAL/SECAM, sRGB, etc.). λ, e(λ) and 0(λ) represent the wavelength of the light source, the spectral distribution (eg, the absolute luminous intensity spectrum of a diode) and the diffuse reflectance spectrum of the skin, respectively. x(λ), y(λ), and z(λ) are functions of color matching in the color system CIE XYZ. Integration is done at wavelengths in the visible and near-infrared range (400 to 1000 nm). Assuming that the skin tissue is mainly composed of the epidermis containing melanin and the dermis containing blood, water, etc., which are not considered, the diffuse reflection of the skin tissue can be expressed as follows.

Here, I ₀ and I are the standard reflected light and detected light intensity, respectively. P(μ _s , μ _g , i) is a probability function of the path length that depends on the scattering properties and the geometry of the measurement. _μs , _μg , g and I are the scattering coefficient, absorption coefficient, anisotropy coefficient and path length of the photon, respectively. The indices w, m, b, e and d represent water, melanin, blood, epidermis and dermis, respectively. The absorption coefficient of each chromophore is expressed as the product of the concentration C and the extinction coefficient ε and μ _α = c _ε . Therefore, RGB values are expressed as functions of C _w , C _m and C _b .

The following procedure is used when evaluating the concentration of chromophores in skin based on RGB images. First, the RGB values of each pixel of the skin image are converted into XYZ values using matrix N ₁ as follows. At each pixel of the image,

Then, the matrix N ₁ has 24 color components and must be determined based on measurements of a Color Checker standard, provided with data giving the CIE XYZ values for each component in a specific illumination and corresponding reflectance spectrum. do. Further, X, Y and Z values are converted into C _w , C _m , C _b by matrix N ₂ .

Then, C _w , C _m , C _b The diffuse reflectance spectrum o(λ) is calculated in the wavelength range of 400 to 1000 nm at 5 nm intervals by Monte-Carlo modeling for light transmission in skin tissue at a diffusion value of , and the corresponding X, Y and X values are is obtained In this Monte-Carlo modeling, the melanin absorption coefficient for C _m is introduced as μ _a , m in the epidermis. The absorption coefficient of blood for C _b is introduced into the dermis as μ _a , B . The absorption coefficient of water relative to C _w is introduced into the dermis as μ _a , w . The thicknesses of the epidermal and dermal layers are defined as 0.05 and 5.05 mm, respectively, and the refractive index of each layer is set to 1.4. After that, XYZ values were calculated based on the modeled o(λ). These calculations were performed using _Cw , _Cm , _Cb to obtain a data set of chromophore concentrations and XYZ values. was performed for various combinations of Multiple regression analysis using the data set revealed two regression equations for Cm and Cb.

C _m =α ₀ +α _1x +a _y +α _3z ,

C _b =b _o +b _1x +b _2y +b _3z .

C _w =w _o +w _1x +w _2y +w _3z .

The regression coefficients ai and bi (i=0, 1, 2, 3) reflect the contribution of XYZ values in C _w , C _m , and C _{b ,} respectively, and are used as elements of the 4 × 3 matrix N ₂ . Thus, the conversion from three color values to chromophore concentrations with the help of N ₂ is expressed as:

After determining matrices N ₁ and N ₂ , images C _w , C _m , C _b can be reconstructed without Monte-Carlo modeling.

In one embodiment, the processor 1140 takes into account the instability of the light source 1110 (the effect of battery charging, changes in the spectrum of the light source, movement of the light source, dust, etc.), and data on the reflected intensity of the skin is a reference standard white color. (BaSO ₄ ) can be normalized to the reference image. Through this process, small imperfections such as moles or other lumps on the skin and instabilities such as changes in battery charge, changes in the spectral intensity of the light source, dust, etc. can be ignored.

Furthermore, although not shown in FIG. 11 , the portable electronic device 1100 may further include additional components. For example, the portable electronic device 1100 may further include a display, a shielding unit, one or more filters, and a communication unit.

In one embodiment, the display may display analysis results under the control of the processor 1140 . The display may display information about the content of the chromophore on the target skin. This information may include warnings about sunburn or the need to moisturize the skin, as well as various advice on how the user's skin can be protected. This information can be displayed in a variety of ways. For example, the concentration may be expressed in numerical form or in the form of a two-dimensional color distribution map. Furthermore, information on the skin condition may be transmitted to the outside through a communication unit. With the information transmitted to the outside in this way, advice on skin conditions and information related to treatment may be received.

In one embodiment, the shielding unit may shield light emitted from the light source 1110 to the skin and light received from the skin to the photodetector 1120 from the outside. In one embodiment, the shield may include a hole for passing light emitted from the light source 1110 and light received to the photo detector 1120 . Also, in one embodiment, the shield may be opaque, have an arbitrary shape, or may be configured in the form of a hollow cylinder having an opaque substrate with a bottom plate. Furthermore, it may have a telescopic function, and the inside may be coated or coated with a light absorbing material or a high reflective material, or may be formed of a high reflective material. According to one embodiment, by using a shield, it is possible to analyze the skin condition, for example, the chromophore concentration, under any external conditions (natural light, artificial light, no light).

In one embodiment, the filter may include a first filter and a second filter. The first filter may filter light emitted from the light source 1110 to the skin, and the second filter may filter light received from the skin to the photodetector 1120 . Accordingly, the first filter may be positioned between the light source 1110 and the skin, and the second filter may be positioned between the skin and the light detector 1120 .

In one embodiment, the first filter may include a first polarization filter, and the first filter may include a second polarization filter. Here, the first polarization filter and the second polarization filter may be polarization filters that select a fixed polarization component or may be polarization filters that select a polarization component of light received from the skin to the photodetector. In this case, a polarization filter capable of selecting a polarization component of light may operate under the control of the processor 1140 . When the portable electronic device 1100 includes a first polarization filter and a second polarization filter, the photodetector 1120 detects light of a polarization component, and the processor 1140 expresses the skin based on the detected polarization component. shape can be analyzed.

In one embodiment, the processor 1140 determines a depolarization ratio of light irradiated to the skin through a first polarization filter and light received by a detector through a second polarization filter, and determines the depolarization ratio of the skin based on the depolarization ratio. wrinkles can be detected. In this case, the processor 1140 controls the first polarization filter and/or the second polarization filter so that the polarization components of the first polarization filter and the second polarization filter are in the same direction and in the vertical direction, and are detected by the photodetector 1120. The degree of depolarization may be determined by comparing a polarization component in the same direction as a first polarization filter and a polarization component in a direction perpendicular to the first polarization filter.

In one embodiment, the first filter may include a filter that transmits light in a wavelength range that excites porphyrin, and the second filter may include a filter that transmits light in a wavelength range emitted by excited porphyrin. In this case, the photodetector 1120 may detect light passing through the second filter, and the processor 1140 may analyze the purity of the skin based on the detected light.

In one embodiment, the light source 1110 may include a light source emitting light in a wavelength range that excites porphyrin, and the second filter may include a filter that transmits light in a wavelength range emitted by the excited porphyrin. In this case, the photodetector 1120 may detect light passing through the second filter, and the processor 1140 may analyze the purity of the skin based on the detected light. In this case, the processor 1140 may analyze the distribution of porphyrins in the skin based on the intensity of detected light, and determine the purity of the skin based on the distribution of porphyrins in the skin.

In an embodiment, the light source 1110 may include a light source that emits near-infrared rays, and the photodetector 1120 may include one or more near-infrared detectors that detect near-infrared rays received from the skin. In this case, the processor 1140 may analyze the moisture state of the skin based on the near-infrared rays detected by the near-infrared detector. At this time, the processor 1140 may determine the reflectivity of the skin based on the detected near-infrared rays and analyze the moisture state of the skin based on the reflectivity of the skin.

12 is a flowchart illustrating a method of operating a portable electronic device according to an exemplary embodiment.

Referring to FIG. 12 , in step 1210, the portable electronic device radiates light to the skin, and in step 1220, detects light received from the skin. In one embodiment, the light source may include a linear polarization filter to radiate light of a polarization component to the skin. In addition, the photodetector may include a CMOS (complementary metal-oxide-semiconductor) camera, and a liquid crystal polarizer capable of electrically rotating the polarization angle from a direction parallel to the polarization plane of the polarization filter of the light source to a polarization angle of 90 °. It may further include (that is, it is possible to create crossed directions of polarization planes).

In step 1230, the portable electronic device may analyze the skin condition based on the detected light. The portable electronic device processes the captured image through analysis of the intensities within the image being executed.

In one embodiment, step 1210 may include irradiating polarized light to the skin, and step 1220 may include selecting and receiving polarization components in the same direction as the polarized light irradiated to the skin and in the vertical direction, respectively. . In this case, step 1230 may include determining a degree of depolarization by comparing a polarization component in the same direction as the polarization applied to the skin with a polarization component in a vertical direction, and detecting skin wrinkles based on the degree of depolarization. .

In one embodiment, the portable electronic device can capture facial images for both polarization states very rapidly and continuously. As a result, in the images acquired by the portable electronic device, the position and angle of the face in the parallel and crossing directions of the polarization plane are the same, and the corresponding pixels in the two images are compared with each other using image processing to search for the surface reflection component. It can be.

In one embodiment, after detecting the skin region, data about the degree of rotation of the plane of polarization of the scattered light is used to determine an anisotropy parameter of the skin region that correlates with the photographic age of the human skin, and is reflected from the human skin surface. The step of determining the degree of depolarization of the light dispersed therein may be further included. The method may further include determining depth of wrinkles, length of wrinkles, density of wrinkles, and characteristic coefficients of the distribution of wrinkle clusters in the skin region by using an analysis of the image of the pixel intensities and the spatial distribution of their values. .

Furthermore, although not shown in FIG. 12 , a method of operating a portable electronic device displays result data of characteristic coefficients of a human skin region on a screen, visualizes wrinkles, and optionally, a human skin region of interest or the entire human face. The method may further include displaying an image of, displaying text information about characteristics of wrinkles on the skin area, and displaying information about dermatological advice and recommended cosmetic treatments. Also, in an embodiment, the operating method of the portable electronic device may monitor the photo age of the human skin region based on the displayed result and data of the characteristic coefficient of the skin region.

This method can be performed more specifically as follows.

1) Polarization photographing of skin

As explained above, wrinkles refer to sudden changes in the depth of the skin surface localized in a specific location. Therefore, the image of the skin should be recorded so that the intensity vector of the detected signal, that is, the detected light reflected and/or scattered from the skin, is aligned in the same direction as the intensity vector of the probing beam, which is the light irradiating the skin. Thus, the polarization plane of the analyzer (eg Polaroid) positioned in front of the detection device (eg photo detector) is in the same direction (i.e., parallel) to the polarization plane of the polarizer positioned behind the probing source (eg light source). ) (or transmit a common component of the backscattered light if the source itself produces linearly polarized radiation).

This process is necessary to divide the detected signal into two parts, and the detected signal can be separated into a Fresnel component and a diffuse component. Here, the Fresnel component means a component with no change in polarization state (ie, the part reflected by the skin, including all defects (wrinkles)), and the diffusion component means a component that is at least partially depolarized (near the surface of the skin). formed by scattering of light in a layer). By filtering the diffuse component of the detected light, the portion of the light reflected by the skin surface is “amplified”.

2) Determining incoming digital data

Since the electronic device includes a camera (CMOS or CCD), a flash (one or more LEDs), and an ADC, a process of receiving and processing digital signals is required. The electronic device can receive three signals corresponding to the three primary color channels (red, blue and green, RGB) (because the photodetector contains a Baeyer filter). The electronic device can select the red channel (blue and green channels are ignored) containing information about the morphology of the skin surface along with minimal information about its components (melanin, blood, etc.) for processing and analysis of the signal. .

3) Increasing contrast of the image

The electronic device may adjust the contrast of the image using automatic control of the slope of the histogram of pixel intensities (spatial distribution of brightness). This can increase the analyzed dynamic range of pixel brightness without affecting the overall contrast of the image.

4) Normalization of the image

The electronic device may normalize the resultant image of the skin to have a preselected mean value and variance value. This process is necessary to normalize the distribution of dynamic gray scale levels and facilitate further processing, without modifying the image structure.

5) Assessment of local orientation of wrinkles

The electronic device can identify (ie, obtain) information about the local direction of the characteristic of the image form. The mathematical least squares method can be applied to this process. The step of evaluating the local direction of wrinkles can be divided into the following sub-steps.

5.1. For each pixel in the image, form (select) a window from the values of adjacent pixels.

5.2. Computes gradient values for two possible directions (x and y) for each pixel in the window.

5.3. Evaluate the local orientation of the central pixel using the least squares method.

5.4. Convert the image acquired in the previous step to a continuous vector field by calculating the sine and cosine of the values in the local direction at a specific location in the image.

At this time, the obtained value can be expressed as follows.

co(i,j) = cos(o(i,j)), so(i,j) = sin(o(i,j)), where o(i,j) is the coordinate for (i,j) is the calculated direction.

5.5. Smooth the vector field by convolution with the derivative of the Gauss function.

The obtained values may be denoted as gso (i, j) and gso (i, j), respectively.

5.6. Computing the resulting direction as the arctangent of the ratio: gсо (i, j) / gsо (i, j), denoted o (i, j).

In addition to information about the local orientation of image non-homogeneities, the evaluation of the local orientation of wrinkles is a step to evaluate reliability, i.e., to ascertain information about how accurately the local orientation was evaluated. can include The reliability of the orientation evaluation is determined as the covariance momentum of the center (i.e., selected) pixel relative to neighboring pixels.

6) Determination of frequency of wrinkles

The electronic device may evaluate the frequency of wrinkles in the image. The image is divided into small blocks of pixels, and for each block the intensity values are "projected" along a direction orthogonal to the average direction of the block. If the image contains elongated peculiarities (ie features, particularly wrinkles), the projection will exhibit a sinusoidal function with local minima corresponding to the wrinkles in the image. The frequency of the function to be determined corresponds to the frequency of the local non-homogeneity for each image block.

7) Improvement of image quality by Gabor filtering

The electronic device may apply a Gabor filter to each pixel of the image having a true value (ie, a positive value) in a direction and frequency similar to those determined for the current pixel. Through this process, it is possible to improve the shape of wrinkle features in an image. Gabor filtering can be used to detect object boundaries to improve image quality.

8) Detection of wrinkles

The electronic device may binarize the obtained result image with a threshold value defined as a percentage of the maximum value in the analyzed source image. In the acquired binarized image, wrinkles exist in an image area with a pixel value of 1, and If it is 0, it can be said to be a mask of wrinkles in that wrinkles do not exist.

9) Quantitative evaluation of wrinkles

The electronic device may define the number of wrinkles as the total number of pixels having a value of 1 in the binarized image scaled in the total area. In addition, pixels with a value of 1 adjacent to the previous pixel may be counted to evaluate the continuity of wrinkles. This wrinkle evaluation method does not consider the depth of wrinkles and only determines the quantity and degree of divergence. The resulting map of wrinkles can be divided into 3 classes and 9 subclasses according to the Fitzpatrick scale of wrinkles.

In one embodiment, step 1210 may include irradiating the skin with light in a wavelength range that excites porphyrin, and step 1220 may include detecting light in a wavelength range emitted by the excited porphyrin. . In this case, step 1230 may include analyzing the distribution of porphyrins in the skin based on the detected light intensity and determining the purity of the skin based on the distribution of porphyrins in the skin.

In an embodiment, operation 1210 may include irradiating the skin with near-infrared (NIR) rays, and operation 1220 may include detecting near-infrared rays received from the skin. In this case, operation 1230 may include determining the reflectivity of the skin based on the detected near-infrared rays and analyzing the moisture state of the skin based on the reflectivity of the skin.

In one embodiment, near-infrared rays may be radiated to the skin through a near-infrared LED mounted on a portable electronic device. Near-infrared LEDs interact with human skin areas through absorption, reflection, and scattering, and emit light that is received by a near-infrared (NIR) detector. Quantitative and qualitative characteristics of skin moisture are determined by analysis of signals reflected from the skin at different wavelengths in the near infrared range.

In one embodiment, the portable electronic device images light received by a near-infrared (NIR) detector, and from the acquired images (at least two or more images corresponding to the boundaries of a selected spectral range) two or more arrays to be used in future processes. form Here, since the image represents at least a portion of the skin region, the size of the array may vary. Accordingly, the portable electronic device may perform alignment to cut out a region having specific coordinates.

In one embodiment, the portable electronic device uses a filter (eg, Gabor filter, median value) to remove noise from the image, and automatically identifies a region corresponding to “blank paper” in the obtained image. By averaging the brightness values in these areas, it is possible to determine the white light brightness level, that is, the area where the reflection coefficient is 100%. After normalizing all array elements to their white brightness values, the array formed on each element becomes the reflection coefficient of the object. Here, those whose reflection coefficient values exceed 100% are excluded (which may be delayed due to non-uniform illumination).

In one embodiment, the portable electronic device uses the obtained array of reflection coefficients to determine the moisture concentration in the skin region, the optical density of a selected spectral range in the skin region (the optical density being the inverse of the reflection coefficient of the selected wavelength). is the logarithm of ) can be determined. The spectral range can be chosen such that its beginning corresponds to the minimum absorption of the main chromophore and its end corresponds to the maximum absorption of water. Moisture concentration dynamics in the skin region can then be determined by determining the slope of the temporal signal of the optical density.

In one embodiment, the portable electronic device may determine a characteristic coefficient of moisture in the skin region (ie, another image), and display resultant data of the characteristic coefficient of the skin region. In addition, it can optionally display a skin region of interest or an entire face image, visualize moisture distribution in facial skin, display textual information about skin moisture, and display information about dermatological advice and recommended cosmetic treatments. can As a result, the portable electronic device can monitor the moisture of the human skin region based on the displayed result data of the characteristic coefficient of the human skin.

This method can be performed more specifically as follows.

Skin reflection in the infrared region of the spectrum can be differentiated based on an evaluation of the reflection coefficient at a particular wavelength normalized to the skin reflection coefficient of the forehead. In this case, the greatest difference can be obtained by measuring the reflection at wavelengths of 1310 nm and 1470 nm corresponding to the spectral regions with minimum and maximum water absorption. The measurement of the reflection coefficient of the skin, which is applied to calculate the moisture concentration in the skin, is not very effective because it does not take into account the individual characteristics of the user's skin and, furthermore, the metabolic characteristics of the person.

In one embodiment, the portable electronic device may evaluate ratios of reflection coefficients of different skin regions, such as eyelid/forehead, eyelid/cheek, to determine moisture concentration. In this case, the ratio of moisture concentration to each area of the skin may be constant. For example, the normalized reflection coefficient of the skin of the eye region is always less than 1, but it is always greater than that of the cheek.

In one embodiment, the portable electronic device uses spectrophotometry of the Fourier transform in the near-infrared region to obtain a diffuse reflectance spectrum in the wavelength range of 950-1500 nm from the skin of the forehead, cheeks, chin, elbows, forearms, palms, knees, and heels. can measure The portable electronic device can then compare the local difference in skin moisture calculated from the peak height of moisture in the wavelength range of about 980 nm normalized to the peak height in the wavelength range of about 1450 nm.

As a result, the portable electronic device can obtain a relative skin moisture content having a value where 0 corresponds to dry skin and a maximum value corresponds to skin saturated with moisture.

On the other hand, the embodiments of the present invention disclosed in the present specification and drawings are only presented as specific examples to easily explain the technical content of the present invention and help understanding of the present invention, and are not intended to limit the scope of the present invention. That is, it is obvious to those skilled in the art that other modifications based on the technical idea of the present invention can be implemented. In addition, each of the above embodiments can be operated in combination with each other as needed.

Claims (18)

a light source that irradiates light onto the skin;
at least one or more light detectors for detecting light received from the skin;
a first filter filtering light emitted from the light source to the skin;
a second filter filtering light received from the skin to the photodetector;
at least one memory for storing instructions; and
A processor configured to control the light source to emit the light by executing the instruction and to analyze a state of the skin based on light detected by the photodetector,
The first filter,
Including a first polarization filter,
The second filter,
A second polarization filter for selecting a polarization component of light received from the skin to the photodetector under the control of the processor;
The photodetector,
detecting light of the selected polarization component;
the processor,
The second polarization filter is controlled to select the polarization component, the surface shape of the skin is analyzed based on the detected polarization component, and the light irradiated to the skin through the first polarization filter and the second polarization A portable electronic device that determines a depolarization ratio of light received to the detector through a filter, and detects wrinkles of the skin based on the depolarization ratio.
delete delete delete According to claim 1,
the processor,
The second polarization filter is controlled to select polarization components in the same direction as the first polarization filter and in the vertical direction, respectively, and the polarization component in the same direction as the first polarization filter detected by the photodetector and the first polarization filter A portable electronic device, wherein the degree of depolarization is determined by comparing polarization components in a vertical direction.
According to claim 1,
The first filter,
A filter that transmits light in a wavelength range that excites porphyrin,
The second filter,
A filter that transmits light in a wavelength range emitted by the excited porphyrin,
The photodetector,
Detecting light transmitted through the second filter;
the processor,
A portable electronic device that analyzes the purity of the skin based on the detected light.
According to claim 1,
The light source,
A light source for irradiating light in a wavelength range that excites porphyrin,
The second filter,
A filter that transmits light in a wavelength range emitted by the excited porphyrin,
The photodetector,
Detecting light transmitted through the second filter;
the processor,
and analyzing the purity of the skin based on the detected light.
According to claim 7,
the processor,
The portable electronic device of claim 1 , wherein the distribution of the porphyrin in the skin is analyzed based on the intensity of the detected light, and the purity of the skin is determined based on the distribution of the porphyrin in the skin.
According to claim 1,
The light source,
Including a light source for irradiating near-infrared rays,
The photodetector,
Includes at least one near infrared detector for detecting near infrared rays received from the skin;
the processor,
A portable electronic device that analyzes the moisture state of the skin based on the near-infrared rays detected by the near-infrared detector.
According to claim 9,
The processor
The portable electronic device of claim 1 , wherein a reflectance of the skin is determined based on the detected near-infrared rays, and a moisture state of the skin is analyzed based on the reflectance of the skin.
According to claim 1,
Including more displays,
the processor,
A portable electronic device that controls the display to display analysis results.
According to claim 1,
The portable electronic device of claim 1, further comprising a shielding unit for shielding light irradiated to the skin and light received from the skin from the outside.
According to claim 1,
The light received from the skin,
A portable electronic device comprising at least one of light scattered, reflected, and emitted from the skin.
A method of operating a portable electronic device including a light source, a light detector, a memory and a processor,
The processor controls the light source and the photodetector, and the memory stores instructions executable by the processor, the instructions
radiating light to the skin by the light source;
detecting, by the photodetector, light received from the skin; and
Analyzing, by the processor, a state of the skin based on the detected light;
The step of irradiating light to the skin,
Including irradiating polarized light to the skin,
Detecting the light received from the skin,
Selecting and receiving polarization components in the same direction and in the vertical direction as the polarization irradiated to the skin,
Analyzing the state of the skin based on the detected light,
determining a degree of depolarization by comparing a polarization component in the same direction as the polarization irradiated onto the skin and a polarization component in a vertical direction; and
and detecting wrinkles of the skin based on the degree of depolarization.
delete According to claim 14,
The step of irradiating light to the skin,
irradiating the skin with light in a wavelength range that excites porphyrin;
Detecting the light received from the skin,
Detecting light in a wavelength range emitted by the excited porphyrin,
Analyzing the state of the skin based on the detected light,
Analyzing the distribution of the porphyrin in the skin based on the intensity of the detected light;
A method of operating a portable electronic device comprising determining the purity of the skin based on the distribution of the porphyrin in the skin.
According to claim 14,
The step of irradiating light to the skin,
Including the step of irradiating the skin with near-infrared rays,
Detecting the light received from the skin,
Detecting near infrared rays received from the skin,
Analyzing the state of the skin based on the detected light,
determining reflectance of the skin based on the detected near infrared rays;
A method of operating a portable electronic device comprising the step of analyzing the moisture state of the skin based on the reflectance of the skin.
A computer program product comprising a recording medium storing a program for performing the operation of the portable electronic device according to any one of claims 14, 16 and 17.

Images