KR20100101173A - System and method for analysis of light-matter interaction based on spectral convolution - Google Patents

Abstract

According to a system and method according to an embodiment of the present invention, a method and algorithm for generating a unique spectral signal are made through convolution of RGB color channel spectral diagrams generated in a digital image. Digital images are captured by the interaction between light and materials of a single wavelength and / or multiple wavelengths.

Description

System and method for analyzing the interaction between light and materials based on spectral convolution {SYSTEM AND METHOD FOR ANALYSIS OF LIGHT-MATTER INTERACTION BASED ON SPECTRAL CONVOLUTION}

Embodiments of the present invention enable the collection of skin and non-skin using a non-invasive imaging device, at least in part using such image analysis to improve the skin state and at least collect subsequent acquired images. And it relates to a method and apparatus that can monitor the skin condition by analyzing. In addition, embodiments of the present invention relate to a skin care device and system that can help determine skin care, and more particularly, skin condition assessment, recommendation of skin care prescriptions, and skin care. A device for tracking the effectiveness of a prescription.

Embodiments of the invention may also relate to an image processing technique. Specifically, embodiments of the present invention relate to determining the skin photo morphology of an image captured in an imaging system of red, green, and blue (RGB), including other skin features (eg, elasticity, melanin, oil, etc.), The same applies to the classification of melanoma, skin-related tumors, and skin-related abnormalities.

This application is directed to United States Provisional Patent Application Nos. 61 / 019,440 (January 7, 2008) and 61 / 061,852 (January 16, 2008) and US Patent Application Nos. 11 / 970,448 This is a priority claim application filed on January 7, 2008. The entire contents of these applications are included herein.

The skin is the widest organ in the cortex, including the auxiliary structures of the skin, hair, nails, scales, feathers, keratin, sweat glands, and by-products thereof. The skin consists of a multilayered epithelial tissue that protects the underlying muscles and organs. Skin suffers from many diseases because it is always attacked by a variety of internal and external factors. Therefore, it is important to monitor the health of the skin and the effects on the skin, prescriptions, skin care products, cosmetics, and the like.

Several methods of skin care determination systems using conventional photography are known as "clinical imaging." In some of the known methods, white light is irradiated on the skin surface to obtain a digital image with a camera. However, the effect of clinical imaging is degraded by reflections on the skin (reflective action such as mirrors).

Existing processes for the determination of medical and cosmetic skin care are generally based on sporadic information gathered from various sources over different time periods. These existing treatments are inconvenient and inefficient, delaying and optimizing skin care decisions. Examples of skin care decisions that can be significantly improved by the concepts of the present invention include the diagnosis of skin conditions, skin care products and prescriptions, and tracking of the effects of skin care products and prescriptions over time. The skin care regimen here includes both the selection of an appropriate skin care product and all procedures for applying the selected skin care product (including dosage, timing, methodology and frequency of application of the skin care product).

There are a variety of ways to determine and monitor skin health, but most require access to dermatologists or dermatologists. However, accessing them is not easy, inconvenient, and expensive and avoided. There is a request for a simple solution for skin health care decisions and monitoring that can be implemented by the general user, whether or not there is a counselor and not trained or not. You can submit.

Skin characteristics are typically determined by the Fitzpatrick classification. Skin picture types are categorized according to existing Fitzpatrick Skin Type Classification Questions (skin type criteria)-ranging from very white skin (eg skin type I) to very dark skin (eg skin type VI). . Previously, various image processing techniques for detecting skin characteristics using captured images of skin have been disclosed. It is useful to detect many features (such as skin color) in skin images captured by conventional digital image processing techniques. This information is used, for example, to adjust the skin color of the image to make it easier to recognize. Skin color position is also used in face detection and face recognition algorithms, automatic image retrieval algorithms, and red-eye correction algorithms.

There is relatively little research on the objective measurement of human skin pigmentation to enable color classification. Classification of human skin pigmentation would be useful, for example, in the medical field for the classification of skin erythema, damage, ultraviolet radiation effects, and other skin pigmentation phenomena. Using computer graphics, it is possible to more accurately draw a human image in a video conference, and to improve or change a person's appearance. Until now, the skin response has been judged by digital skin image analysis technology, which has been a useful display means indicating various skin condition parameters. However, there is still a desire to further define and use more detailed skin responses that indicate skin conditions and skin characteristics.

For most humans in modern society, appearance embellishment is one of the top priorities. A technique or system of a model known in the art will analyze a skin condition and propose a product suitable for improving a person's appearance.

Therefore, there is a need for a method and system that minimizes errors and speeds up the identification of these types of skin.

Real-time analysis of digitally captured skin features enables timely skin condition feelings, recommendation of skin prescriptions, and tracking the effectiveness of skin prescriptions.

The problem of evaluating the skin condition in real time is a skin condition analysis module which analyzes digital skin data obtained in part by real-time spectroscopic techniques and / or techniques for detecting red, green and blue components from re-radiated white light. Solved by

In one embodiment of the present invention, a skin care device includes an electromagnetic radiation wave emission source for irradiating an electromagnetic wave to a position on a skin of a user, a radiation wave detector for measuring various parameters of the wave re-radiated at an irradiation position, and the detector. And a skin condition analysis module configured to perform skin condition emotion in real time based in part on at least one of RGB analysis and diffuse reflection analysis of the radiation wave parameter. In this device, the incident electromagnetic radiation may comprise at least one of visible light, near ultraviolet light and near infrared light. The incident radiation wave may include white light. Radiation wave parameters in this device may include at least the degree of polarization of the radiated radiation wave. The emotion of the skin condition in this device may also be based in part on analysis of the photographic image of the skin region around the radiation irradiation site. This device may be a compact device whose detector does not exceed six inches in size. The device may further comprise a memory module for storing the skin condition emotion results. The device may further comprise a user interface capable of operating with voice commands. In this device, skin emotion data at that location may be displayed on the display surface in superimposition with an image of a larger skin area. The device may further include an access restriction module to allow only authorized users access. This access restriction module may be based on biometric access control. The device can be informed in real time of abnormal skin conditions. The device may further include a skin care prescription recommendation module that generates a displayable skin care prescription recommendation. The skin care prescription recommendation may be based on judgment of the skin condition of the user and at least part of the use of the skin care prescription recommendation of a person having a similar situation. The skin care prescription recommendation module can be linked to the product database. The product database may include products that are in stock in the sales office. The availability of a specific product recommended by the skin care prescription recommendation module may be indicated by an audiovisual signal. The device may further include a skincare prescription effect module for generating a displayable skincare prescription effect report. The device may further comprise a communication module for communicating with the remote computer, the communication may be wireless. In addition, communication can be made via the Internet. The remote computer can be operated by a doctor. This device may be in the form of a cane. The device may be wearable to the user.

According to one embodiment of the present invention, a skin care device includes an electromagnetic radiation wave emission source for irradiating electromagnetic waves to a position on a user's skin, a radiation wave detector for measuring various parameters of waves reradiated at an irradiation position, and the detector And a skin condition analysis module which performs skin condition emotion in real time based in part on at least one of RGB analysis and diffuse reflection analysis of a radiation wave parameter, and a display panel displaying a user image. In this device, the display panel may be touch-sensitive so that the image of this region is enlarged by touching the position where the skin region image is displayed. The device may further include a camera, the camera may be integral with the display panel, and the camera may be wirelessly connected to the display panel. In this device, the display panel may be a mirror. In this device, stored user images can be used to automatically identify a person. The device may further comprise a user interface for controlling the skin care device. The user interface can operate with voice commands. The device may further include a skin care prescription recommendation module that generates a displayable skin care prescription recommendation. The skin care prescription recommendation may be based on judgment of the skin condition of the user and at least part of the use of the skin care prescription recommendation of a person having a similar situation. The device may further include a skincare prescription effect module for generating a displayable skincare prescription effect report.

In accordance with aspects of the present invention, for recommendation and follow-up of medical, non-medical and cosmetic analysis, diagnosis and treatment, a user may use a imaging device to take high-magnification images of the skin near the region of interest, You can submit. When submitting a video, text and data responses can be submitted together.

In one embodiment of the present invention, a non-invasive imaging apparatus method and system comprises: an illumination source having an incident light source for irradiating light to the skin; It may include a detector for detecting the degree of polarization of light reflected from the skin. In the present method and system, the dimming source can be positioned to irradiate light at a selected angle alpha. By changing the alpha, you can change the measurement depth of each layer in your skin. Each depth may have a particular angle that produces fully polarized reflected light. In the present methods and systems, the incident light source may be a light source that is not polarized. The unpolarized light can be white light, multiple selected wavelengths or light of a single wavelength. The method and system may further comprise a sensor to capture an image of reflected or re-radiated light. The method and system may further comprise an optical device for detecting light reflected or re-radiated from the skin. The method can determine both reflected or re-radiated light and newly emitted light through absorption and re-radiation processes. The method and system may further comprise a communication device for transmitting the detected information. The method and system may further comprise a storage device for storing information collected by the imaging device.

In one aspect of the invention, a method and system for determining a skin condition comprises the steps of irradiating the skin with an incident light source; Detecting a degree of polarization of light reflected from the skin; And determining the skin condition based on the aspect of polarization of the reflected or re-radiated light. In the present method and system, incident light can be irradiated at a selected angle alpha. By changing the alpha it is possible to change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces fully polarized reflected light. In the present methods and systems, the incident light source may be a light source that is not polarized. The unpolarized light can be white light, multiselected wavelengths or light of a single wavelength. In the method claims of the present invention, the aspect of polarization may be at least one in direction, amplitude, phase, angle, shape, degree, magnitude, and the like. In the present method and system, the determining may be performed using an algorithm. Algorithms may include artificial neural networks, nonlinear regression, genetic algorithms, fuzzy logic, fractal and multiple fractal analysis, and the like. The method and system may further comprise filtering the reflected or re-radiated light to obtain polarized light having at least one wavelength defined as the filter output. Algorithm analysis may be performed on the filtered image. In the present methods and systems, the determining may include generating an image from the difference between reflected or re-radiated diffused light and reflected polarized light. In the present methods and systems, the determining may include comparing the polarization pattern of the reflected or re-radiated light with a calibration signal. In the present methods and systems, the determining may further include considering at least one of user input and visual analysis.

In one embodiment of the present invention, a non-invasive imaging device includes: an illumination light source having an incident light source for irradiating light to a region of interest; It may include a detector for detecting the degree of polarization of the light reflected in the region of interest. In the present method and system, the dimming source can be positioned to irradiate light at a selected angle alpha. By changing the alpha it is possible to change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces fully polarized reflected light. In the present methods and systems, the incident light source may be a light source that is not polarized. The unpolarized light can be white light, multiple selected wavelengths or light of a single wavelength. The method and system may further comprise a sensor to capture an image of reflected or re-radiated light. The method and system may further comprise an optical device for detecting light reflected or re-radiated from the skin. The method and system may further comprise a communication device for transmitting the detected information. The method and system may further comprise a storage device for storing information collected by the imaging device.

In one embodiment of the present invention, the method for determining the moisture content in the skin comprises the steps of irradiating incident light to the skin structure; Detecting a degree of polarization of light induced by the skin structure; Determining the moisture content based on the amount of polarized light and reflected or re-radiated light. The method and system may further comprise combining skin color measurements with an estimated moisture content to determine skin brightness. In the present methods and systems, the incident light can be unpolarized light. The unpolarized light may be white light, light of multiple selected wavelengths, light of a single wavelength, or one or more monochromatic lights. In the present method and system, the determining may involve the use of an algorithm. In the present method and system, the process of determining the moisture content can be made based on the ratio of polarized light and reflected or re-radiated light.

In one aspect of the invention, a method and system for determining the elasticity of the skin comprises the steps of irradiating incident light to the skin structure; Detecting a polarization pattern of light reflected from the skin structure; Correlating the concentration of elastin with the polarization pattern; Determining elasticity level based on the concentration of elastin. In the present method and system, the determining may involve the use of an algorithm. In the present methods and systems, the incident light can be unpolarized light. The unpolarized light may be white light, light of multiple selected wavelengths, or light of a single wavelength.

In one aspect of the invention, a method and system for determining firmness of skin comprises the steps of: emitting incident light into a skin structure; Detecting a polarization pattern of light reflected by the skin structure; Correlating the polarization pattern with the concentration of at least one of elastin, collagen, and sebaceous gland activity; And determining the firmness based on the concentration of at least one of elastin and collagen and sebaceous gland activity. In the present methods and systems, the activity of sebaceous glands can be indicated by at least one of the number of sebaceous glands, the ratio of open and closed, and the degree of blockage and filling. In the present method and system, the correlating process may include the use of an algorithm.

In one aspect of the invention, a method and system for obtaining skin biophysical properties may comprise performing a spectral analysis of image data obtained from polarization degrees of reflected light reflected from incident light from a skin structure, wherein the characteristics Corresponds to the structure, form, concentration, number, size, condition and at least one of the following. -Melanocytes, melanin, hemoglobin, porphyrin, keratin, carotene, collagen, elastin, sebum, sebaceous gland activity, pores (pores and sebum), moisture content, elasticity, brightness, firmness, fine lines, number of wrinkles and stages, pores Size, percentage of open pores, skin elasticity, skin tension lines, moles, skin color, psoriasis, allergies, red areas, common skin abnormalities or infections, tumors, sunburn, rashes, scratches, acne, acne, bites, Itching, bleeding, injury, inflammation, photodamage, pigmentation, color tone, tattoos, burn rate / type, mole (naevi, nevus), aspects of skin damage (structure, color, size / asymmetry), melanoma, observed through the skin Disease, skin damage, cellulite, boil, blister disease, congenital skin syndrome, subcutaneous filamentous fungal disease, melasma, vascular condition, rosachea, spider vein, texture, skin ulcer, wound treatment, surgical prognosis, melanocyte damage, non Melaninse Damage, basal cell carcinoma, as sevoflurane Extended Mosquera Sat system, sebum (oily), the nails and / or hair related problems.

In one aspect of the present invention, a system and method may comprise providing an interface comprising at least one of a social network domain or rating and rating system, a skin condition determining means and a recommendation engine, and allowing the user of the interface (all or all) to Selected number of minutes) may be included to determine the skin condition within this interface. In this method and system, the skin condition determining means may comprise capturing an image with a non-invasive imaging device. Here, the imaging device includes an illumination source having an incident light source for irradiating light to the skin, and a detector for detecting the skin condition based on the polarization pattern of the reflected or re-radiated light by detecting the polarization degree of the light reflected from the skin ( detectors). The method and system may further include receiving product and prescription recommendations from the recommendation engine based on data relating to ingredients, effects, safety, etc. and based on what the user with similar skin condition is using. have. The method and system may further comprise comparing skin conditions, products, prescriptions, recommended products or prescriptions with people of the same class in the social network domain of the interface. This comparison process may include analyzing the similarity based on the polarization spectral analysis of the reflected or re-radiated light at the user's skin. In this method and system, the interface may include a prescription tracker. This prescription tracker can be configured using drag-and-drop or click-to-add functionality. In this method and system, the interface may comprise a rating means or a product information means. The product information means may allow the user to obtain product information by searching. The search may be a search for product identifier, product rating, drag and drop item, image, barcode scan, skin condition, profile.

In one aspect of the invention, a method and system for determining skin condition comprises the steps of: obtaining an answer to a series of subjective questions about skin; Obtaining an objective skin analysis using a skin imaging device; It may include a process of algorithmically combining the subjective and objective results to obtain a skin condition.

In one embodiment of the present invention, a system and method for providing recommendations for skin care and skin care targets based on skin conditions include the steps of: acquiring a skin condition of an individual; Classifying the individual by skin condition; It may include the process of recommending effective products and prescriptions to other individuals classified to achieve their skin care goals. In the present method and system, the system can operate on a network. Skin conditions in the present methods and systems can be determined based on an analysis of the degree of polarization of light reflected from the individual's skin.

In one embodiment of the present invention, a method for tracking the effect of a skin care product or a prescription comprises the steps of: acquiring baseline skin condition feelings; Recommending a monitoring interval based on at least one of a skin care goal, a product, and a prescription; Obtaining a second skin condition emotion; Comparing the second emotion with the baseline emotion to determine progress toward the skin care target; Optionally, it may include the process of optimizing prescriptions or products to improve skin condition. In the present methods and systems, skin emotion can be made based on a polarization analysis of light reflected from the individual's skin.

In one aspect of the present invention, an individual skin condition analysis system and related method includes an imaging device including a dimming source having an incident light source for irradiating light to the skin, a detector for detecting a degree of polarization of light reflected from the skin, and the imaging device. It may include a user interface for controlling the device. In the present method and system, the imaging device is configured to interact with the physical interface to download the image data and update the record of at least one of a practitioner, spa, beauty salon, cosmetics store, cosmetics manufacturer, clinic trial database and third party database. Can be. In the present method and system, the dimming source can be positioned to irradiate light at a selected angle alpha. By changing the alpha it is possible to change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces fully polarized reflected light. In the present methods and systems, the incident light source may be a light source that is not polarized. The unpolarized light may be white light, light of multiple selected wavelengths, or light of a single wavelength. The method and system may further comprise a sensor to capture an image of reflected or re-radiated light. The method and system may further comprise an optical device for detecting light reflected or re-radiated from the skin. The method and system may further comprise a communication device for transmitting the detected information. The method and system may further comprise a storage device for storing information collected by the imaging device.

In one embodiment of the present invention, a non-invasive imaging device includes: a light source including an incident light source for irradiating light to the skin; It may include a detector for detecting the characteristics of the light reflected from the skin. In an imaging device, a dimming source may be positioned to irradiate light at a selected angle alpha. By changing the alpha it is possible to change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces fully polarized reflected light. In the imaging device, the incident light source may be a polarized light source or an unpolarized light source. The unpolarized light can be at least one of white light, light of a single wavelength, and multiple light of a single wavelength. The imaging device may further include a sensor to capture an image of reflected or re-radiated light. The imaging device may further include an optical device for detecting light reflected or re-radiated from the skin. The imaging device may further comprise a communication device for transmitting the detected information. The imaging device may further include a storage device for storing the information collected by the imaging device. In the imaging device, the reflected or re-radiated light may be at least one of polarized light and non-polarized light.

In one aspect of the invention, a method and system for determining a skin condition comprises the steps of irradiating the skin with an incident light source; Detecting characteristics of light reflected from the skin; And determining the skin condition based on at least one characteristic of the reflected or re-radiated light. In the present method and system, incident light can be irradiated at a selected angle alpha. By changing the alpha it is possible to change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces fully polarized reflected light. In the present methods and systems, the incident light may be unpolarized light or polarized light. The unpolarized light can be at least one of white light, light of a single wavelength, and multiple light of a single wavelength. In the present methods and systems, the reflected or re-radiated light may be at least one of polarized light and non-polarized light. In the present methods and systems, the property may be at least one of a light source, light intensity, wavelength of light, angle of light and electrical and magnetic properties of light and polarization state of light. The aspect of polarization may be at least one of direction, amplitude, phase, angle, shape, degree and magnitude. In the present method and system, the decision process may be performed using an algorithm. Algorithms may include artificial neural networks, nonlinear regression, genetic algorithms, fuzzy logic, or analysis of fractals and multiple fractals. The method and system may further include filtering the reflected or re-radiated light to obtain light having a wavelength defined by the filter output. The analysis may be performed on the filtered image. In the present methods and systems, the determining process may include generating an image of the difference between the reflected diffused light and the reflected polarized light. In the present method and system, the determining process may include comparing the polarization pattern of the reflected or re-radiated light with a calibration signal. In the present method and system, the determining process may further comprise considering at least one of user input and visual analysis.

In one embodiment of the present invention, a non-invasive imaging device includes: an illumination light source having an incident light source for irradiating light to a region of interest; And a detector for detecting the characteristics of the light reflected from the region of interest. In an imaging device, a dimming source may be positioned to irradiate light at a selected angle alpha. By changing the alpha it is possible to change the measurement depth of the layers in the skin. Each depth may have a particular angle that produces fully polarized reflected light. In the imaging device, the incident light source may be a polarized light source or an unpolarized light source. The unpolarized light can be at least one of white light, light of a single wavelength, and multiple light of a single wavelength. The imaging device may further include a sensor to capture an image of reflected or re-radiated light. The imaging device may further include an optical device for detecting light reflected or re-radiated from the skin. The imaging device may further comprise a communication device for transmitting the detected information. The imaging device may further include a storage device for storing the information collected by the imaging device. In the imaging device, the reflected or re-radiated light may be at least one of polarized light and non-polarized light.

In one embodiment of the present invention, the system and method can be used to determine healthy skin and abnormal skin. First, the spectrum (SN) reflected from normal healthy skin is subtracted from the spectra reflected from the abnormal skin sample and / or the radiation spectrum (SM). Next, from the result of the spectral subtraction (SM-SN), the spectrum reflected on the appropriate comparison screen (representing the spectrum SO of the light source) is subtracted. This results in the purely changing nature of the skin. Maximum, minimum, and zero data can be used on the wavelength axis scale and maximum minimum magnitude (intensity) axis for differences between melanoma or other malignant / benign nevus and healthy skin points.

In one aspect of the present invention, a system and method are provided for a process of capturing an image of a substance or an object by irradiating an incident angle of white light (an incidence incident white light) and an incident angle of white light (angled incident white light), and a normalized red channel for each image. Generating the spectral diagrams of the red and blue channels by correlating the histograms of the normalized red and blue channels to the wavelength scale, and obtaining the spectral diagrams of the red and blue channels. To generate a color channel spectral plot, for each color channel, subtract the spectral plot for slanted incident light from the angled incident light, and for the spectral signal for a substance, Subtract the blue channel spectral plot to convolve the spectral plot It may include forward. In the present system and method, a dimming source can be installed to illuminate light at a selected angle alpha. By changing the alpha the measurement depth of the material is changed. In the present system and method, the unit scale on the spectral signal can be the wavelength difference. In the present systems and methods, the material is inorganic and / or organic. In the present system and method, the spectral signal can be analyzed for at least one of the peak number and the lowest number, the amplitude and shape of the peak, the intermediate structure and the pattern. In the present systems and methods, spectral signals can be analyzed for the synthesis, type, purity, and intensity of the metal. In the present systems and methods, spectral signals can be analyzed for water quality, water synthesis, and purity. In the present systems and methods, the components of the spectral signal can be displayed and tracked over time to track changes in material properties. In the present systems and methods, spectral signals can be analyzed to measure, track, or monitor skin condition. In the present systems and methods, spectral signals may be useful for the analysis of counterfeit money. In the present systems and methods, the spectral signal can be analyzed for at least one of gland activity and late action. In the present system and method, the spectral signal can be analyzed to know for mad cow disease. In the present systems and methods, the spectral signals can be analyzed to know food, all skin diseases, melanoma and skin cancer, rheumatic diseases, and all diseases that occur in the skin. In the present systems and methods, spectral signals can be useful for monitoring cosmetic problems after surgery. In the present systems and methods, spectral signals may be useful for predicting and monitoring lactation in the lactating mammary glands. In the present systems and methods, spectral signals can be input to the recommendation engine to provide follow-up and changes to the type of prescription. In the present system and method, when convolving a composite spectral plot to obtain a spectral signal, the position of the ideal blue wavelength in the Maxwell color triangle is aligned to the position of the ideal red wavelength in the Maxwell color triangle.

A method and system for determining skin characteristics and cosmetic characteristics are disclosed. The result is minimized. In a representative embodiment of the present invention, according to the first aspect of the present invention, a method for determining skin characteristics and cosmetic characteristics using color analysis is performed in a red, green, and blue (RGB) color scheme for an acquired digital image. Analyzing the color of the skin image for each pixel. Analyzing the color of the skin image for each pixel in the red, green, and blue (RGB) color system for the acquired digital image involves creating a color table with the colors most frequently appearing in the person's skin photo and analyzing the photo. It may include.

According to the first aspect, a method for determining skin characteristics and cosmetic characteristics using color analysis may be performed by converting a color acquired in a device-dependent RGB color system into a device-independent standard RGB color system (sRGB color system). And in response to analyzing the color of the skin image pixel by pixel in the RGB color system, for the acquired digital image, generating a sample of the most frequent sRGB color. For the acquired digital image, generating a sample of the most frequent sRGB colors in response to analyzing the color of the image in the RGB color system includes preserving a plurality of sRGB color values.

In this embodiment, the sRGB color system can be used for image analysis. In determining other skin features, melanoma, skin-related tumors and diseases, image analysis is based on various color analysis schemes such as YIQ, YCbCr, L * a * b *, L * u * v * and HSL / HSV can do. Improvements to this algorithm may include at least one of these color analysis schemes and a correlation between the sRGB color scheme and the color analysis scheme (s).

According to the first aspect, a method for determining skin characteristics and cosmetic characteristics through color analysis includes predicting parameters on a sRGB color sample generated from a digital, green, and blue primary color distribution having a Gaussian probability distribution. Modeling as (predictions and standard deviations), which further includes approximating the color on the generated sRGB color sample as a Gaussian standard distribution. According to an exemplary embodiment of the present invention, approximating the color on the generated sRGB color sample as a Gaussian standard distribution includes approximating the color on the generated sRGB color sample by overlapping a plurality of Gaussian standard distributions.

According to a first aspect, a method of determining skin characteristics and cosmetic characteristics through color analysis includes generating a phototype of a corresponding skin through a decision tree unit in response to the estimated distribution modeling parameter color. The type of skin can be generated according to a modified Fitzpatrick classification or other applicable color classification. According to an exemplary embodiment of the present invention, generating the type of skin according to the modified Fitzpatrick classification method includes generating the type of skin according to a skin type grade having a grade from very white skin to very dark skin. .

According to a second aspect, a system for determining skin type through photo analysis can be disclosed. The system may include an image capture device that captures a digital image of the skin. The image capture device may include a digital camera unit.

According to a second aspect, a system for determining skin type through photo analysis may be connected to an image capture device and may include an analyzer for pixel-by-pixel analysis of a partial photograph of a human skin. The analyzer can include a quantization device that generates a lookup table of the colors that most frequently appear in some photographs of the skin.

According to a second aspect, a system for determining skin type through photo analysis may be coupled to an image capture device and include a sampling device for generating standard RGB (sRGB) color samples for a digitally captured image of the skin.

According to a second aspect, a system for determining skin type through photo analysis is connected to a sampling device, using color distribution parameters for generated sRGB color samples using estimates of digital capture skin images and estimates of standard deviation. Approximation apparatus to approximate may be included. This approximation device may comprise at least one Gaussian normal distribution unit.

According to a second aspect, a system for determining skin type through photo analysis may be connected to an approximation device and may include a decision tree unit for generating the type of skin using the red and blue components of the approximated color. This decision tree unit may include a Fitzpatrick classification unit that classifies skin types according to skin type grades from very white skin to very dark skin.

According to a second aspect, a representative embodiment of the present invention discloses a Gaussian normal distribution unit that approximates color distribution parameters for generated sRGB color samples using estimates of the digital captured skin image and estimates of standard deviation.

According to a second aspect of the present invention, a system for determining skin type through photo analysis may include an accessory system for determining cosmetic characteristics of a human body and a part of the animal. The cosmetic properties may further include hair, nail, and skin-related properties.

In another form, the system may include a sampling device for generating standard red, green, and blue samples of a digitally captured image of the skin, wherein the generated standard red, green, and blue samples are in the range of 0 to 255 and in the future. Are preserved for treatment.

In another form, the system is coupled to a sampling device and uses color distribution parameters for sRGB color samples generated in the range of 0 to 255 by Gaussian normal distribution to use estimates of the digital capture skin image and estimates of standard deviation. It may include an approximation device to approximate.

In another form, the system may include a decision tree unit coupled to an approximation device and generating a type of skin using standard red and blue components of the approximated color, which decision tree unit may be used with an algorithm to determine the skin type. Estimates and standard deviations of the captured images for the Fitzpatrick skin analysis method to determine.

In another form, the system can automatically adjust light intensity, light wavelength, and angle of incidence to assess various skin factors.

In another form of the system, the skin type can be determined using photo analysis used in the cosmetic and medical industries.

In one embodiment of the invention, the skin care device is an electromagnetic radiation wave emission source for irradiating electromagnetic waves at a location on the user's skin, a radiation wave detector for measuring various parameters of the re-radiated wave at the irradiation location, and connected to the detector And a skin condition analysis module which performs skin condition emotion in real time based in part on at least one of RGB analysis and diffuse reflection analysis of the radiation wave parameter. In this device, the incident electromagnetic radiation may comprise at least one of visible light, near ultraviolet light and near infrared light. The incident radiation wave may include white light. In this apparatus, the radiation wave parameter may include at least the degree of polarization of the re-radiated radiation wave. In this device, the emotion of the skin condition may also be based in part on the analysis of the photographic image of the skin region around the radiation irradiation site. In this device, the device may be a compact device whose size does not exceed 6 inches. The device may further comprise a memory module for storing the skin condition emotion results. The device may further comprise a user interface. The device may further comprise a display surface. The skin emotion data at the corresponding position may be displayed on the display surface by overlapping the image of the larger skin region. The device may further include an access restriction module to allow only authorized users access. This access restriction module may be based on biometric access control. The device can be informed in real time of abnormal skin conditions. The user interface may operate with voice commands and / or eye movement commands. The device may further include a skin care prescription recommendation module that generates a displayable skin care prescription recommendation. The skin care prescription recommendation may be based on judgment of the skin condition of the user and at least part of the use of the skin care prescription recommendation of a person having a similar situation. The skin care prescription recommendation module can be linked to the product database. The product database may include products that are in stock in the sales office. The availability of a specific product recommended by the skin care prescription recommendation module may be indicated by an audiovisual signal. The device may further include a skincare prescription effect module for generating a displayable skincare prescription effect report. The device may further comprise a communication module for communicating with the remote computer. Communication can be wireless. Communication can be made via the Internet. The remote computer can be operated by a doctor. This device may be in the form of a cane. The device may be wearable to the user.

According to one embodiment of the present invention, a skin care device includes an electromagnetic radiation wave emission source for irradiating electromagnetic waves to a location on a user's skin, a radiation wave detector for measuring various parameters of the wave reradiated at an irradiation position, and a detector. And a skin condition analysis module which performs skin condition emotion in real time based in part on at least one of RGB analysis and diffuse reflection analysis of a radiation wave parameter, and a display panel displaying a user image. In this device, the display panel may be touch-sensitive so that the image of this region is enlarged by touching the position where the skin region image is displayed. The device may further comprise a camera. The camera may be integrated with a display panel, and the camera may be wirelessly connected to the display panel. In this device, the display panel may be a mirror. In this device, stored user images can be used to automatically identify a person. The device may further comprise a user interface for controlling the skin care device. The user interface may operate with voice commands and / or eye movement commands. The device may further include a skin care prescription recommendation module that generates a displayable skin care prescription recommendation. The skin care prescription recommendation may be based on judgment of the skin condition of the user and at least part of the use of the skin care prescription recommendation of a person having a similar situation. The device may further include a skincare prescription effect module for generating a displayable skincare prescription effect report.

In one aspect of the invention, a system and method for moving information objects available on a website up to a receptacle to communicate with a large number of people in an access-restricted community network includes prescriptions for people, daily life, multiple information objects. A process of moving a plurality of information objects from a predetermined website to a web-based network, in response to the purpose of use of the first person and the intimacy of the first person with a second person, a plurality of information objects from the predetermined website. In response to the process of moving, the drop-down movement; Drag and drop to collect data; Initiating at least one custom action from among actions involving pop-up movement in a graphical user interface (GUI), and transporting the plurality of information entities across multiple websites; Can be. In the present systems and methods, the plurality of information objects may be related to a questionnaire about at least one of human skin conditions, product information, articles, blog postings, images, videos, personal messages, forum postings, and animal skin conditions. In the present systems and methods, a number of information objects relate to questions about human cosmetic parameters and cosmetic parameters of animals. Questions regarding human cosmetic parameters and animal cosmetic parameters may include questions about at least one of human nails and animal nails. The questionnaire about human cosmetic parameters and animal cosmetic parameters may include questions about at least one of human hair and animal hair. In the present system and method, the purpose of using information object is to cleanse, protect, treat, moisturize, elasticity, harden, gloss, brightness, anti-inflammatory property, anti-itch property, anti-wrinkle property, hardening, peeling of human skin , Erythema prevention properties, oil inhibition, anti-aging properties, and luminous may be adjusted. In the present system and method, the intimacy of the first person towards the second person is defined as the friendship between the first person and the second person, the similarity between the first person and the second person, and the similarity of lifestyle between the first person and the second person. At least one of a climatic similarity between the first and second person living environments, and a similarity of the skin type between the first and second person. In the present systems and methods, the process of transporting the plurality of information entities across a plurality of websites may be performed by dragging a user's item of interest outside the website of the plurality of websites into a predetermined format and accessing the website. It may include a sub-step of transferring through the electronic signal to the affiliates of. The affiliates of the user may be friends and relatives of the user or affiliated expert. In the present system and method, the process of moving a plurality of information objects from a predetermined website to a web-based network is a drop down on a graphical user interface (GUI) in response to a number of end-user convenience and requirements parameters. It may include a substep that enables a menu. In the present system and method, a number of people in a web-based network include a number of people in an online friendship network. In the present system and method, a number of people in a web-based network include a number of people in an online social network.

In one aspect of the invention, the social network domain, and in addition to allowing the user of the interface to perform skin health assessments within the interface, recommend recommendation of products and prescriptions from the recommendation engine based on predetermined usage of the health emotion and maintenance data. An interface comprising at least one skin health appraisal and recommendation unit for receiving is provided using drag and drop means to provide a prescription tracker, a rating unit to rate multiple health care measures, and a user to drag and drop onto multiple web bases. And a product information unit that enables to obtain product information by performing a web-based search for scanable products, web-based images, and bar code scans. The prescription tracker in the interface includes a feeding (diet) tracking unit. In this interface, a number of health care measures include skin cleansing, skin protection, skin moisture control, skin treatment, skin elasticity, skin brightness, skin firmness, skin wrinkles, pore size, spots on skin, skin shine, hair color, hair type And at least one of age and life stages (including marriage, pregnancy, dating, and social life). In the above interface, the product information includes product type, product function, product type, product suitability, prescription information, product related article, product related blog, product safety, product addiction, product effect index, product price information and It may contain one of the timely information about the product. In this interface, the interface is a multilingual and customized interface for web-based applications, mobile phone applications, touch screen applications, personal digital assistant (PDA) applications. In the interface, the interface is constantly connected with the skin imaging device for custom web-based access, control and maintenance of spectral analysis of the image data acquired from the degree of polarization of light reflected or re-radiated from the skin structure. The degree of polarization of the reflected or re-radiated light in the skin structure is derived from at least one of RGB color analysis and spectroscopic image data analysis of a plurality of digital images.

In one aspect of the present invention, a system and method for determining a health condition includes obtaining a response to a series of subjective questions related to a health condition, obtaining an objective health emotion report through a skin imaging device, and a series of subjective Generating a combination of questions and answers to objective health emotional reporting to produce a health status output and an actual skin type output. In the present systems and methods, the actual skin type output is generated based on the biophysical properties generated by at least one of the human health monitoring, spa, and beauty advisors. In the present system and method, objective health emotion reporting includes hydration, skin hydration, skin firmness, skin wrinkles, skin pore size, skin puncture, skin glow, melanocytes, melanin, hemoglobin, porphyrin, keratin, Carotene, collagen, elastin, sebum, sebaceous gland activity, pores, sebum, moisture content, elasticity, brightness, firmness, fine lines, number of wrinkles, pore size, percentage of open pores, skin elasticity, skin tension lines, dots, Viscous, epithelial, sebum level of the skin, skin color, psoriasis, allergy, red zone, abnormal skin abnormalities, infection, tumor, sunburn, rash, scratches, acne, acne, bites, itching, bleeding, injury, inflammation, Photodamage, pigmentation, hue, tattoo, burn rate, burn type, warts, aspects of skin damage, melanoma, disease observed through the skin, skin damage, cellulite, boil, blister disease, congenital skin syndrome, blood Lower filamentous fungal disease, melasma, vascular condition, Rosacea, spider vein, texture, skin ulcer, wound treatment, surgical prognosis, melanocyte damage, non-melanocyte damage, basal cell carcinoma, seboroic keratosis, sebum, hair Objective health sentiment reporting on at least one of color, hair type, nail condition, age, and stage of life (including marriage, pregnancy, dating, and social life). In the present system and method, the objective health assessment report is delivered to the end user via at least one of email, SMS, MMS, mobile phone, graphical user interface (GUI) of Internet-connected device and personal digital assistant (PDA) with touch screen. Is sent to. The system and method may further comprise obtaining health emotion and retention data from physiologically polarized light data. Obtaining health emotion and maintenance data from physiologically polarized light data includes acquiring health emotion and maintenance data from a red green blue (RGB) color analysis device, where the data includes white light data, blue light data, At least one of the ultraviolet light data. This step may include obtaining at least one of white light data, blue light data, and ultraviolet light data by determining at least one of the dermis and epithelium and recording the state of at least one of them. Obtaining health emotion and retention data from physiologically polarized light data includes obtaining geographic and demographic data about the age of the person monitoring health.

In one aspect of the invention, a web-enabled health tracking method and system may comprise a camera, which includes a photo guide unit, a camera and a web that generate a description of each captured picture. Connected between feature-driven electronic calculation systems, an interface for uploading photographs captured by the camera, graphics included in a web-function-driven electronic calculation system, and generating frequently asked question units (including self-answer guide modules) A score module connected to the user interface, frequently asked questions unit, a score module connected to the score module, a comparison module to compare color parameters, symmetry parameters, boundary parameters, a graphical user interface, a frequently asked question unit, a score module, Connected to the automation unit, which enables the time synchronization of the comparison module, and the user's practice mode A learning unit for activating a reporting unit including a module, an article module connected to this user exercise module, a blogging unit connected to these user exercise modules and an article module, and an email unit responsible for sending an email of health related information. . In the present system and method, the camera has a skin point change over time, the effect of laser treatment, the cellulite contained in the skin, the condition of veins and capillaries, the effect of botox treatment, the effect of anti-aging treatment, acne removal treatment And a tracking unit for tracking at least one of the illustrated skin history provided to the physician. Skin points over time include one of a tee, wound, rash (rash), trauma, or wart. In the present system and method, a web function-driven electronic calculation system for uploading photographs captured by a camera is provided with a skimming module that allows a user to scan the features of the skin health record of the first user of the system. And a personal skin photo album for reviewing the pictorial history, and a product quality menu for tracking the shelf life of the product. In the present system and method, the interface for uploading a photo includes a dunning unit for instructing a normal user of the system to enter the next photo, and a cosmetic state connected to the dunning unit to indicate the current state of use of the cosmetic product for a normal user of the system. It further includes a unit. This current state of use includes the use of at least one of a moisturizer, antiseptic (disinfectant), toner, laser, botox. The system and method may further comprise a photo review unit for reviewing at least one of a predetermined body part, a current state of use of the cosmetic product, a recommendation list for use of the cosmetic product by date. In the present system and method, the reporting unit further comprises a secure transmission unit for sending a health appraisal report to a medical practitioner, an affiliate unit for discussing the health appraisal data with a friend, and a printing unit for printing the health appraisal data. Can be.

In one aspect of the invention, a mobile device-based health emotion system and method includes a photo capture device for capturing a skin image of a mobile device user, a transmission unit connected to the photo capture device and uploading the captured skin image to a network; Earth Positioning Device (GPS) to determine the location of the Photo Capture Device, to the Photo Capture Device, to determine the weather conditions at the location of the mobile device user and to obtain remote diagnostic reports. It may include a prediction device. In the present systems and methods, the photo capture device may capture at least one of a skin photo emotion unit, a nail photo emotion unit, and a hair photo emotion unit. In the present systems and methods, the geolocation device includes a location tracking for answering a question posted by the user with respect to the user's geographic location. In the present system and method, the location tracker includes a database relating to climate resistant cosmetics. The system and method may further comprise a telephone number tracker that allows the mobile user to contact the Health Emotion and Beauty Center.

In one aspect of the invention, a system and method for estimating skin type and skin properties to generate a unique spectral signal comprises a process of convolving data from a first image captured by incidence of diffuse white light, wherein the data Is related to reflected and / or re-radiated polarized light or white light), the process of convolving data from a second image captured by incident polarization, where the data is related to reflected and / or re-radiated polarized light, a first Comparing the extreme positions of at least two inherent convolutions generated by convolution of the data from the image and the second image, convoluted from the at least two inherent convolutions to produce a numerical output of the skin type (red spectrum Determining a distance between the minimum intensity and the maximum intensity of FIG. In the present systems and methods, physiological white light includes three spectral intervals that include a width less than 100 nanometers. Three spectral intervals are related to red, green, and blue (RGB). Three spectral spacings give the human eye a natural white light feel. In the present system and method, comparing the extreme positions of at least two inherent convolutions compares component (RB) (WP) for reflected and / or re-radiated polarization with component (RB) W for white light. Process. Two inherent convolutions for white light and polarization are white red component (WR), white blue component (WB), reflected and / or re-radiated polarized blue component (PB), and reflected and / or re-radiated polarized red component ( PR) further. Two inherent convolutions are based on numerical value differences correlated to medical standards. The system and method may further comprise spectral convolution techniques that determine various combinations of subtracting the blue spectrum from the red spectrum included in the white light and the polarized white light. Here, the spectral spacing is indicated on the wavelength axis with a scale spacing of 100 to 300 nanometers.

In one aspect of the invention, systems and methods for generating intrinsic spectral signals of skin properties include skin type feature output, skin moisture conductivity, and skin elasticity in numerical and descriptive formats by including light-to-object interactions of single wavelengths. It may include the RGB (red green blue) color channel spectrum generated from the digital image outputting the. In the present systems and methods, the RGB (red-green) color channel spectral diagram generated from a digital image may include multiple wavelengths of light-to-object interactions.

In one aspect of the invention, a system and method for tracking and storing movement parameters of an imaging device moving over a target area includes capturing images of the target area at multiple locations, the image processing technique for at least one capture frame Finding the moving direction of the imaging device using the method, comparing each frame with at least three different captured features, triangulating the location of the imaging device, and recognizing the moving direction of the imaging device; The method may include storing an image of the target area in comparison with a database and storing displacement parameters of the imaging apparatus. In the present systems and methods, capturing an image of a target area at multiple locations includes sub-steps of capturing a continuous video image of the target area. In the present systems and methods, capturing images of a target area at multiple locations includes capturing a series of images of the target area frame by frame. In the present system and method, the step of finding a moving direction of the imaging apparatus using an image processing technique includes a lower step of finding a moving parameter of the imaging apparatus by comparing the captured images frame by frame. In the present systems and methods, the step of triangulating the imaging device position by comparing each frame with at least three different captured features to recognize the direction of movement of the imaging device is by comparing three or more different positions across different frames. A substep of capturing the direction of movement of the imaging device.

In one aspect of the invention, an automated location tracking and data storage method for an imaging device includes an image capture unit, a positioning unit connected to the image capture unit and determining a location of the imaging device over a target area, and a captured image. The image processing unit may be configured to compare frame by frame and allow the imaging device to capture three or more different points to triangulate the location of the imaging device to find a moving direction of the imaging device. In the present system and method, the image capture unit comprises a digital camera. In the present systems and methods, the image capture unit comprises at least one of a mobile device and a personal digital assistant (PDA). In the present system and method, the image processing unit includes a comparison unit for capturing the moving direction of the imaging apparatus by comparing three or more different points over different frames. The system and method may further comprise a subsystem for measuring the lateral movement of the imaging device from a predetermined point of the subject area to a new position.

In one aspect of the invention, a system and method for determining surgical incision size includes irradiating incident light to melanocyte damaged skin, detecting a feature of reflected and / or re-radiated light at the melanocyte damage site, and Determining a boundary between melanocyte damage and surrounding healthy tissue based on at least one characteristic of the reflected and / or re-radiated light. In the present system and method, incident light is irradiated at a selected angle alpha. In the present systems and methods, altering alpha may alter the measurement depth of the layers in the melanocyte damage. Each depth may have a particular angle that produces fully polarized reflected light. In the present systems and methods, the incident light source is an unpolarized light source. The unpolarized light is at least one of white light, light of a single wavelength and multiple light of a single wavelength. In the present systems and methods, the incident light is polarized light (polarized light). In the present systems and methods, the reflected and / or re-radiated light is at least one of polarized light and non-polarized light. In the present systems and methods, the feature is at least one of a light source, light intensity (light intensity), wavelength of light, angle of light, electrical and magnetic properties of light, and polarization state of light. The aspect of polarization is at least one of direction, amplitude, phase, angle, shape, degree and amount (magnitude). In the present system and method, the decision process is performed using an algorithm. The algorithm includes at least one of artificial neural network, fuzzy logic, fractal and multiple fractal analysis, nonlinear regression analysis, genetic algorithm, white light analysis, RGB color analysis. The system and method may further include filtering the reflected and / or re-radiated light to obtain a light wavelength defined by the filter output. Analysis by the algorithm is performed on the filtered image. In the present systems and methods, the determining process includes generating a difference image between reflected diffused light and reflected polarized light. In the present systems and methods, the determining process includes comparing the polarization pattern of the reflected and / or re-radiated light with a calibration signal. In the present systems and methods, the determining process further includes considering at least one of user input and visual analysis.

These and other systems, methods, objects, features, and effects of the present invention will be clearly understood by those skilled in the art through the accompanying drawings and detailed description of the embodiments. All documents described herein are hereby incorporated by reference in their entirety.

Various advantages can be obtained by various embodiments of the present invention.

First, the present invention can determine skin type with conventional low cost digital photography equipment under standard environmental conditions.

Second, the analysis performed on the captured digital image makes it useful to recommend cosmetic products and to use them for medical or surgical purposes.

Third, the photo quantization algorithm and the calculation of the estimated predictions and standard deviations are fast, making it easy to determine the skin type in a short time using a simple program routine.

Fourth, the analysis method performed in the present invention can be usefully used for classification of other skin features (eg, elasticity, melanin, oil concentration, etc.), melanoma, skin tumors or skin diseases.

Detailed description of the invention and embodiments will be understood with reference to the following figures.
1 illustrates a skin care system for analysis and monitoring of skin health and skin care emotions and recommendations.
2 shows a mechanism for analyzing light polarized by skin structures.
3 shows a process for skin care investigation.
4 (a) and 4 (b) show the front and rear surfaces of the skin imaging apparatus.
5 shows a skin health monitoring page of the skin care system.
6 illustrates an interaction model tool of a skin care system.
7 shows a recommendation page of the skin care system.
8 shows a user interface of the skin care system.
9 shows a welcome page of the skin care system.
10 shows a question page of the skin care system.
11 shows a skin image capture page of a skin care system.
12 shows a histogram results page of a skin care system.
13 shows a line graph results page of the skin care system.
14 shows a summary screen of the skin care system.
15 shows the elasticity summary screen of the skin care system.
16 shows a summary screen of the skin care system.
17 shows the elasticity summary screen of the skin care system.
18 shows the configuration of a user interface for a skin care system.
19 shows a REVIEW page of the skin care system.
20 shows a REVIEW page of the skin care system.
21 shows the MY EXPERIENCE page of the skin care system.
22 shows the WHAT WORKS page of the skin care system.
23 shows an INFO FOR ME page of the skin care system.
24 shows an example of a skin care shelf of the user interface of the skin care system.
25 shows an example of a skin care shelf of the user interface of the skin care system.
26 shows a user interface of the skin care system.
27 shows a registration page of the skin care system.
28 shows a recommendation page of the skin care system.
29 illustrates a mobile communication content map for a mobile communication user interface of a skin care system.
30 shows the "how good is this product" message flow.
Figure 31 shows the "what to look for" message flow.
32 shows the "sun confirmation" message flow.
33 shows the "Notification" message flow.
34 shows a "optional" message flow.
35 illustrates an algorithm and method for analyzing a substance.
36 illustrates white light reflected from a sample and polarized light reflected by a change in an incident angle.
37A and 37B show color coordinate systems that can be used for digital image processing.
38 shows a histogram of color density.
39 shows a histogram of correlated normalized color channels for wavelength magnitude.
40A and 40B show histograms in which normalized color channels are superimposed.
41A and 41B show convolution histograms of individual color channels.
42 shows a histogram of two convolutions of two color channels.
43 shows a mathematical model of a portion of the color triangle of Maxwell.
44A and 44B show spectral signatures for light and dark skin.
45A-C show spectral signals for pure metals and alloys.
46a and b show spectral signals for different kinds of water.
47 shows a block diagram of an embodiment of a skin care device.
48 shows an embodiment of a skin care device in the form of a cane.
49 illustrates a vertical display panel including a skin care device.
50 shows an embodiment of the wearable skin care device.
51 shows the bipolar and cathodic intensities of a waveform as a function of emission and absorption in skin tissue of a particular wavelength.
52 compares spectral signals of healthy and malignant diseased skin with reference wavelength attention.
Figure 53 shows malignant diseased skin deposited with white color and physiologically polarized white light.
54 compares convolutions between healthy skin, benign and malignant skin damage.
55 illustrates a system for tracking and targeting an image.
56 shows a system for determining the incision size.
57 shows a system for determining the incision size.
58 is a flowchart showing an RGB color separation process.
Fig. 59 is a schematic diagram showing pixels of a digital image of a human skin sample.
60 is a schematic diagram illustrating pixels of a digital image of a human skin sample after quantization is performed.
FIG. 61 shows histograms and distribution maps of standard RGB colors for patient images classified as skin type III by Fitzpatrick classification and with normal approximation / hull Gaussian distribution.
FIG. 62 shows histograms and distribution maps of standard RGB colors for patient images classified as skin type VI by Fitzpatrick classification and with normal approximation / hull Gaussian distribution.
63 is a flowchart of an algorithm for determining skin type according to mathematical prediction values of R and B in a standard RGB color system.
64 illustrates an embodiment of a friend toolbar.
65 shows the auto scroll function of the friend toolbar.
66 shows a drag and drop sharing function of the friend toolbar.
67 illustrates a drag and drop sharing function of the friend toolbar.
68 illustrates sharing skin data with a friend as a data object.
69 illustrates posting skin data as a data object to a blog or forum where users can discuss the data.
70 illustrates sharing skin data as a data object, where the data object becomes part of what the user may wish to discuss.

Provided herein may be methods, systems, and imaging devices of the skin and non-skin. As used herein, “such as” or “such as” is used to mean “including, but not limited to”. "For example" is used in the sense of "but not limited to". "In an example" is used to mean "but not limited to, in this example." "Product" refers to a medical, non-medical, cosmetic, skin, hair, or nail care product. Any or all examples used in the specification as a whole are used for the purpose of explanation and not for the purpose of limitation.

The real-time analysis of digitally captured skin-related information and other information enables real-time emotions of the skin condition, real-time recommendation of skin prescriptions, and real-time evaluation of this skin prescription effect. Real-time analysis of digitally captured data can be done by a skin care device embodying the spirit of the present invention described below. The skin care device embodying the idea of the present invention includes, for example, an electromagnetic radiation wave emission source for emitting electromagnetic waves, a radiation wave detector for measuring various parameters of re-radiated waves, and a skin condition analysis module for outputting skin condition evaluation results in real time. This includes.

Emotions of the skin condition may be cosmetic and / or medical in nature. For example (but never limiting the scope of the present invention), skin condition feelings include acne condition feelings, pore feelings, wrinkle feelings, skin elasticity feelings, skin oil feelings, skin moisture feelings, skin luminescence feelings, skin Sebum feelings, skin flushing feelings, skin inflammation feelings, skin structure feelings, skin color feelings, and various combinations of these conditions. For example, pore state feeling can help determine whether a pore is clean or open, and optimal health.

The skin condition data can be obtained, for example, by irradiating electromagnetic waves to a point (for example, a pin mark) of the human skin and detecting a wave reflected from the radiation wave detector. The efficiency of the high quality real-time skin condition emotion can be improved using the skin condition analysis module according to some embodiments. The skin analysis module is at least partially analyzed using a diffuse reflection spectrometer. The quality of real-time skin condition emotion can also be further improved by irradiating the skin with white light and detecting the RGB components in the light reflected there.

In FIG. 1, the skin health analysis, monitoring, and recommendation system captures biophysical skin features, such as made in skin health test 160, performs prognostics 162, and remotely monitors 164 using light source 127. Host hardware 108, such as an imaging device 108 for performing < RTI ID = 0.0 > Interface with host hardware 108, online platform 120, or mobile platform 124 to provide demographic information, additional descriptive information about skin health, current skin care prescriptions (118), current skin care products and prescription grades; Capture ratings 138, place skin care shelf 114, skin cycle monitor 140, health and / or wellness information 142, games 148, gift guide 144, wishes A user interface 102 that accesses an item list 119, a daily report 134, a simulation tool 132, a type determination engine 130, a shopping cart 113, and the like; The host system for processing and analyzing the captured information using algorithm 150, for example, to perform expert consultation 128, data integration 152 and tool / API analysis 154 to define skin condition 158. 104); Provides additional skin granularity (grain size) information to the host system 104 in identifying and monitoring skin conditions 158 (grade / rating feedback 138 may be used). Reference numeral 112 includes a wearable monitor 182, a mobile communication device 184, a social network 188, product information 190, health information 192, a plug-in (web capture) 194, a barcode scanner 198. , Existing information / question 101, query / search 103, third-party expert 105, third-party hardware 109, third-party service provider 111, etc. Host hardware 108 Data store 110 for storing data from host system 104, user interface 102, other input 112, including hardware 168, removable memory 170, and wireless communication device 174. Computer (178), record (180) of practitioners such as dermatologist, general doctor, beauty worker, spa staff, beauty salon staff, cosmetics salesperson, personal production Records 172, etc. Although described herein as embodiments relating to skin, these embodiments, except where prohibited in context, are not skin related fields, such as hair, nails, agriculture, veterinary medicine, and the like. It is to be understood that the examples also include those related to the fields of intestines, biochemistry and non-biochemistry.

Imaging device 108 acquires biophysical skin properties by capturing an image of the skin structure, such as in skin health test 160, prognostics 162, remote monitoring 164, and the like. Imaging device 108 may also be used to capture images of non-skin structures, such as hair, nails, teeth, eyes, organs, and structures. Internal or external light sources 127 may be used in the imaging device 108, which are non-polarized light (e.g., diffused light, white light, monochromatic light, single wavelength multiple light, etc.) and polarized light to obtain data on the skin structure. The predetermined light is irradiated using. In an embodiment, the incident light may be polarized or non-polarized. Polarization can be caused by reflections in the skin, rather than being polarized in the light source. Capturing and storing the reflected light enables imaging and analysis of all types of skin damage and skin diseases, skin problems, cosmetic concerns and instructions. Through analysis of polarized reflected light, thermal, electrical, and magnetic properties can be obtained from skin images. The images may be sent to analysis facility 154, analysts, practitioners, and the like (which may also include diagnosis using patient questions) to determine the final analysis of skin health. Imaging device 108 may also determine a desired target wavelength (ie, red, green, blue range) to identify major skin features based on spectroscopic and quantitative analysis of skin damage. Imaging device 108 may use diffuse reflection techniques in addition to color image analysis based on indirect results from spectroscopic techniques (DR, SR, etc.). In one embodiment, imaging device 108 may be implemented to illuminate polarization. The imaging device 108 may be implemented to irradiate one or more types of light or to select one or a combination of various light sources 127. By comparing the analysis of skin health with previous user skin health analysis, analysis of other users' skin health, experience data of other users, and features of components, products, and prescriptions, the product or prescription 108 is recommended and its effects. Can be tracked.

Referring to FIG. 2, in one embodiment, the imaging apparatus 108 includes a light source 127 that irradiates non-polarized light, diffused light, white light, monochromatic light, single light, multiple light, polarized light, and the like to the skin at an angle of incidence alpha. And a sensor for detecting light reflected from the skin structure, that is, re-radiated light, and an image storage device for storing and transmitting the captured image. The skin construct may be at least one of cells, molecules, cell populations, molecular groups, epidermal and underlying layers, basement membranes, dermis, subcutaneous tissue, glands, strata, vesicles, pores, blood vessels, and other skins. In one embodiment, the light source may be white light that generates reflected light and diffused light (eg, polarized light) to measure the electrical and magnetic components of the skin. White light can be emitted as a combination of light wavelengths that span the visible light spectrum. Non-polarized incident light may be irradiated to a target at an angle of 'alpha' with respect to the vertical line. As this alpha angle changes (eg, in the range of 0 to 90 degrees with respect to the vertical line, but not limited to), unpolarized incident light can interact with other structures of the skin. This is because the projection depth is affected by the change of the incident angle. The alpha angle can be changed by changing the position of the light source manually or remotely via the user interface 102 or the like. The relationship between transmission depth and alpha can be defined by the formula "(depth) = f (alpha)". Since each skin structure has a predetermined depth within the skin, there is a predetermined angle of incidence in which light is reflected so as to be completely polarized. By analyzing the reflected or re-radiated light and / or diffuse reflection (whether polarized and / or diffused) light, information of the underlying skin structure in response to the reflected and / or re-radiated light can be obtained. Diffuse reflection occurs because light is scattered or absorbed around the underlying structure. Polarization can be caused by the classical and quantum physical effects of the skin structure interacting with moisture. That is, the skin structure has a magnetic field and an electric field that can change (polarize) the polarity of light while colliding with the skin structure to change the wavelength of light. The polarization pattern (eg, direction, amplitude, phase, angle, shape, degree, amount, etc.) of the reflected light (or re-radiated light) may vary in relation to the target point (and absolutely, skin condition 158) of a particular skin structure. It may be related to the manner. For example, a portion of reflected light (or re-radiated light) diffuses in damage to certain skin structures, resulting in partially polarized and partially diffused reflected light (or re-radiated light). For example, collagen structure is one of the indicators of biochemical differences between benign and malignant melanocyte skin damage. Due to the difference in collagen, the polarization state of the reflected light may be changed, and the resulting image may reveal the location of the center and the periphery of the tumor. These images can help practitioners in visualizing the margin of skin excision. This is described later. Because melanocytes are located in the lower part of the epithelium, appropriate wavelengths can be selected for this depth and for chromophores in various types of spots or nevi.

When the incident light is polarized, only the electrical properties of the skin will be apparent, and in the case of unpolarized incident light, both the electrical and magnetic properties of the skin work. Although optical activity may be improved by using polarization, the data generated may be less valuable than data captured using non-polarized incident light (eg, white light, monochromatic light, single wavelength multiple light, etc.). . By measuring the influence between 10E-34 Js and 10E-30 Js, it is possible to measure the difference between the electric and magnetic forces of the valence electrons of the skin biomolecules and at the boundary region of the quantum / classical physics effect on the skin.

In one embodiment, the wavelength and / or intensity of the incident light can be varied to measure the presence of certain molecules (eg, collagen, elastin, cadherin, hemoglobin, etc.). Certain molecules have endogenous fluorescence. For example, when limiting incident light to a particular wavelength (eg 325 nm), collagen can be detected at emission wavelengths 400 nm and 405 nm. Table 1 illustrates the maximum excitation and emission values of endogenous fluorescent biochemical molecules (eg, amino acids, structural proteins, enzymes and coenzymes, vitamins and vitamin derivatives, lipids (lipids), porphyrins, etc.). Doing. In order to detect the presence of certain molecules in the skin, the user may shine light onto the skin of a particular wavelength band (e.g., but not limited to those shown in the column of maximum excitation values), where the reflected light is received to reflect this reflected light. You can find the presence of a specific emission wavelength in. It will be understood by those skilled in the art that various single wavelengths of light and multiple wavelengths of light can be irradiated to the skin (in Table 1, FAD is flavin adenide dinucleotide and NADH is reduced nicotine Reduced nicotinamide adenine dinucleotide, AND (P) H is reduced nicotinamide adenine dinucleotide phosphate).

Endogenous fluorescent properties

Excitation value (nm)
Max Radiation Value (nm)
amino acid Tryptophan
(tryptophan) 280 350 Tyrosine
(tyrosine) 275 300 Phenylalanine
(phenylalanine) 260 280 Structural protein Collagen
(collagen) 325 400, 405 Elastin
(elastin) 290, 325 340, 400
Enzymes and Coenzymes FAD, Flavin
(flavins) 450 535 NADH 290, 351 440, 460 NADPH 336 464
vitamin Vitamin A 327 510 Vitamin K 335 480 Vitamin D 390 480




Vitamin B6 Compound Pyridoxine
(pyridoxine) 332, 340 400 Pyridoxamine
(pyridoxamine) 335 400 Pyridoxal
(pyridoxal) 330 385 Pyridoxic acid
(pyridoxic acid) 315 425 _{Pyridoxal-50-phosphate} (pyridoxal 5 ₀ -phosphate) 330 400 Vitamin B ₁₂ 275 305
Geology Phospholipid
(phospholipid) 436 540, 560 Lipofucin
(lipofuscin) 340-395 540, 430-460 Seroid
(ceroid) 340-395 430-460, 540 Porphyrin
(porpyrin) 400-450 630, 690

In one embodiment, light may be emitted at any wavelength (eg, in the range of 280 to 3800 nm). The incident light can be blue, yellow, orange, red, or other colored light.

With continued reference to FIG. 1, in one embodiment, the light source may be integrally constructed with the imaging device 108 or provided as an associated component. The light source can be any wavelength (280, 340, 360, 385, 405, 395, 400 nm internal excitation wavelength, but not limited to), infrared and far-infrared light emitting diodes or laser diodes (LEDs). The intensity of the ultraviolet and infrared region wavelengths may also be emitted by the imaging device 108. As a light source (light source), diffused light, white light, monochromatic light, single wavelength multiple light, incandescent light, electroluminescent light, fluorescence, halogen, ultraviolet light, polarization, collimated light, light provided by a wireless communication device And light provided in the optical fiber cable. In one embodiment, the light source may comprise a diffuser to emit diffuse incident light.

In one embodiment, the sensor for detecting light reflected from the skin is a CCD camera, a CMOS imaging system, a digital camera, a web camera (webcam), a camera embedded in a communication device such as a mobile phone or iPhone, to continuously monitor the skin In order to be used for sports wearable devices such as watches, scanners, etc. may be implemented in the optical system. This sensor can be applied to absorb any wavelength of light (rays or visible light of wavelengths close to infrared). The sensor can be applied to automatically filter certain wavelengths. The sensor can be applied to image at any size (eg, a small portion of the skin, an entire face, an irradiation of the entire skin, etc.). The sensor can be operated without intervening fluid between the imaging device 108 and the region of interest. Or by applying an oil component or other reflective medium to the region of interest. The sensor may be configured to detect reflected light at or in close proximity to the region of interest, which may be used for subsequent visual and / or algorithmic analysis. Images generated from the reflected light can be examined by visual and spectroscopically constructed images or electromagnetic skin images. The sensor may have an internal adjustment scale to enable measuring the size of the area to be imaged as well as the distance from the imaged area. In one embodiment, the lens may form a focal point of light entering the CCD, CMOS, and other detection devices that are reflected from the detection optics and sensitive to visible NIR. In one embodiment the sensor may be adapted to acquire images at high frame rates and may have a high magnification lens.

In one embodiment, the imaging device 108 may store the captured image for transmission to the analysis and / or analysis facility 154. Analysis facility 154 may be a practitioner, automated analysis tools, analysis tools employed by practitioners, and the like. The data store 110 may be operated manually at the start of image capture, or may be operated automatically or in a remote control form when in contact with the skin. The data may be stored in the internal memory 168 or in an external recording medium 170 such as a USB memory, an external hard drive, or a mass storage device. The device can be wired or wirelessly connected to an external computer (laptop, kiosk, desktop, central server, etc.). For example, it can be directly connected via USB. When the imaging device 108 is connected to a computer, the captured information may be downloaded or transferred automatically or manually from the imaging device 108 to the computer. For example, imaging device 108 may have a cradle that is coupled to a computer. When the imaging device 108 is contained in the cradle, information may be downloaded or transmitted from the imaging device 108. The imaging device 108 may also be software updated when connected to a computer, for example via this cradle. In various embodiments, imaging device 108 may be configured to have no onboard storage and only transmit or store information externally, either hardwired or wirelessly. The transmission and storage of information can be fully automatic or manually operated. The information may be transmitted in a wireless communication network, cellular communication, wired communication, Bluetooth, or the like. The transmission of information from the imaging device 108 may enable remote emotion techniques. In one embodiment, non-image data (eg, voice response, text response, video data, etc.) may also be stored and / or transmitted by imaging device 108. Imaging device 108 may have a built-in microphone for recording audio, a video camera for recording images, an input keyboard for recording text responses, and the like. In one embodiment, the imaging device 108 may use audio and video that can be used externally.

In one embodiment, the data may be stored in the skin health record 121. The skin health record 121 may be a personal item, a database, a large intestine that contains status information about major medical, non-medical, and cosmetic instructions related to the user's skin. This may include the level of cosmetic conditions such as images, graphics, icons, historical descriptions, personal information, non-medical conditions such as moisture, elasticity, firmness, tissue, color, inflammation, and the like. The user can write this record 121 by himself as the data from the device 108, 109 or the input means 112. This record 121 may include skin care history, comments, user blogs, and the like. In one embodiment, the skin health record 121 may be automatically generated when an image is input. For example, when a user submits an image for analysis, the record 121 may be automatically generated with the image and information derived from the analysis (this information is editable).

In one embodiment, data store 110 may be included in practitioner record 180. The practitioner record 180 may be an important health feature storage location including background demographic information, personal information, dietary information, skin health record 121, and the like. This can include embedded images, links to other image data files, tracking the effects of personal skin products, medical products, OTC products, and other important historical points for key parameters. It may also capture selected personal data, which may be similar to community information, patients or users, and may include ratings, comments, and the like.

In one embodiment, the data store 110 may be in a custom manufacturing record 172. Based on the health care measurement unit 160, a product component for obtaining a desired effect of making the skin healthy may be selected. These product components track changes in skin health over a period of time through a personalized manufacturing record 172 and use imaging device 108 to analyze changes in various skin health parameters through the use of various products and ingredients. Can be selected by tracking. Once the selected product ingredients are determined, these ingredients can be blended to create a product that is optimal for personal skin features and / or desired goals (eg, improved moisturization). Therefore, it is possible to develop a personalized product for the user. This process can also be utilized to generate components for specific custom skin products and medical / non-medical purposes and conditions.

In one embodiment, the format of the captured data may be compatible with any standard image processing and manipulation software and techniques, word processor software, slide presentations, spreadsheet applications, and the like. For example, the captured data can be any suitable image format, such as jpeg, tiff, pict, png, bmp, gif, pdf, and the like. In one embodiment, multiple images can be captured in a movie. Alternatively, you can make a movie by combining multiple images.

In one embodiment, the power of imaging device 108 may be applied in a variety of ways, such as electrical plugs, batteries, solar power, USB power, and the like. The user may apply power by turning on the imaging device 108 to obtain an image. Acquisition may be started automatically, may be initiated when the imaging device 108 touches the skin, or may be initiated when the user presses a button or the like.

Imaging device 108 may include a display for viewing the area to be imaged. For example, a display with a positioning tool may be used to obtain an accurate image over a period of time (eg, to capture a series of images over several days). This display may be integral to the imaging device 108 or may be a separate device. For example, imaging device 108 may be connected to a monitor (eg, a computer monitor) by wire or wirelessly. In one embodiment, the image may be displayed in real time by the user interface 102 of the imaging device 108.

The positioning tool can track (track) and target (target). 55 shows a tracking and targeting method. The positioning tool may track and store the movement parameters of the imaging device 108 moving over the target area. First, imaging device 108 may capture an image of a target area at multiple locations. Next, the imaging device 108 may find a moving direction of the imaging device 108 by using an image processing technique for at least one capture frame. According to the image processing technique, as shown in FIG. 55, the moving direction of the imaging apparatus may be recognized by comparing each capture frame with at least three different shapes captured to triangulate the position of the imaging apparatus. The captured image data may be compared with a predetermined image database to store an image of the target area and to store positional parameters of the imaging device 108. If the item does not exist in the database, a new item can be created. Capturing a target region image at multiple locations may include a substep of capturing a continuous image of the target region. Capturing the target region images at the plurality of locations may include a sub-step of capturing a series of images in the target region for each frame. The step of finding a moving direction of the imaging apparatus by using an image processing technique may include a lower step of finding a moving parameter of the imaging apparatus by comparing the captured image for each frame. Recognizing the direction of movement of the imaging device by comparing each capture frame with at least three different shapes captured to triangulate the position of the imaging device involves comparing three or more different positions across different frames to determine the imager's position. And a lower step of finding the direction of movement. The positioning tool may be an automatic tracking and data storage system for the imaging device 108, which is coupled with the image capture unit to determine the position of the imaging device in the target area and the frame of the captured image. An image processing unit is included that allows the imaging device to capture three or more different points to perform star comparison and triangulate the location of the imaging device. The image capturing unit may include a digital camera. The image capture unit may comprise at least one mobile device and a personal digital assistant (PDA). The image processing unit may include a comparison unit that finds a moving direction of the image device by comparing positions of three or more different points that span different frames. The automated position tracking and data storage system may further include a subsystem for measuring the lateral movement of the image capture unit from a point to a new point on the subject area.

In one embodiment, imaging device 108 may have a security measure to protect user data. For example, the imaging device 108 may have a unique MAC-ID to which an encryption scheme is applied.

In one embodiment, imaging device 108 may be associated with a peripheral or other functional accessory. For example, the imaging device 108 may be associated with a blood pressure monitor or sensor, heart rate monitor or sensor. For example, the imaging device 108 may perform a preliminary diagnosis 162 of skin damage while monitoring end points such as blood pressure and heart rate in order to diagnose other health items in addition to skin health.

In one embodiment, the imaging device 108 may be sized to allow the user to hold the imaging device 108 by hand. Imaging device 108 may be operated by hand one time. For example, the imaging device may be implemented as shown in FIGS. 4A and 4B. However, the device may be implemented in other embodiments of various shapes and / or sizes, such as mirrors, large devices capable of capturing large areas of imagery, personal digital assistants (PDAs), scanners, mobile devices, etc. have. In FIG. 4A, the light source consists of a ring-shaped LED around the central sensing area. In both cases, the image, size, handheld features, and portability were clearly indicated. Because of its operational convenience, even inexperienced users (home users) can use this imaging device 108 by connecting to a laptop. Imaging device 108 does not need to be implemented in such a way that it is included in a larger camera system as an independent unit. In one embodiment, imaging device 108 may be designed to be ergonomically held by one hand. In one embodiment, imaging device 108 may be used with or without a reflective medium. In one embodiment, the imaging device 108 may capture images at close distances, at close distances, and in close contact. For example, near and far image capture may be controlled by software installed in a computer connected to the imaging device 108.

In one embodiment, the imaging device 108 may have a structure that cannot be held by a freestanding hand. In this case, a plurality of images or a specific body or material may be taken.

Some embodiments of skin care devices can be made small in size that is portable and handheld. Some embodiments of the skin care device may be in the form of a cane that is portable and handheld to allow convenient passage of the skin area to be detected. Some embodiments of other skin care devices can be made small in size no more than six inches. Such skin care devices may be embedded in wearable accessories (bracelets, necklaces, earrings, etc.). Some embodiments of skin care devices may have a convenient user interface and / or display screen. In some embodiments, the skin care device may be coupled to or embedded in a vertical display panel (eg, but not limited to mirrors, LCD screens, plasma screens, etc.).

In FIG. 47, a representative example of a skin care device 4700 that implements the concepts of the present invention is shown in a block diagram. The skin care device 4700 may include an electromagnetic radiation emission source 4702, a radiation wave detector 4704, and a skin condition analysis module 4708.

The electromagnetic radiation source 4702 can radiate electromagnetic waves to one or more points on the skin. For example (but not limited to), the electromagnetic radiation emitter 4702 may be a set of light emitting diodes (LEDs). In certain embodiments, the wave emitted from the electromagnetic radiation source 4702 may include waves in the visible, near infrared (NIR), and near ultraviolet (NUV) bands. In other embodiments, white light may be included in this radiation wave.

In FIG. 47, an electromagnetic radiation emitting source 4702 can be combined with a radiation detector 4704. The radiation wave detector 4704 can detect the re-radiated (reflected) wave at the irradiation point and measure various radiation parameters in the re-radiated wave. As shown in FIG. 47, the radiation wave detector 4704 may be combined with the skin condition analysis module 4708. The radiation wave detector 4704 detects various radiation wave parameters (e.g., but is not limited to polarization degree, radiation intensity at other wavelengths, etc.). The electromagnetic wave emission source 4702, the radiation wave detector 4704, and the skin condition analysis module 4708 have been described above.

The skin condition analysis module 4708 may analyze the radiation parameters of the reflected radiation wave and other information and output a skin condition emotion result. The skin condition analysis module 4708 may output the skin condition emotion result in real time. In some embodiments, radiation detector 4704 detects diffuse reflection. In some embodiments, the incident radiation wave may be white light, and the radiation wave detector 4704 may detect the red, green, and blue components of the re-radiated light.

In certain embodiments, the skin condition results may be based in part on analysis of the photographic image of the skin spot.

As used in the specification and claims, "diffused reflectance" means radiation (sometimes broadly referred to as light) that is scattered in many directions in the target sample. Diffuse reflection is a term corresponding to specular reflection. When the surface is completely antireflective, reflected or re-radiated light will be evenly scattered on the hemispheres around this surface. The diffuse reflection is caused by the fact that the surface of the target site is somewhat uneven, and the incident light reflected from this uneven surface, that is, the granular surface, is scattered at various angles.

Some embodiments of a skin care device may include a memory module that stores skin condition assessment results and other data (eg, date time data). Some embodiments of the skin care device may include a communication module that transmits skin condition appraisal results and other data (date time) to a remote computer. Data communication may be via wired, wireless, the Internet, for example. Skin condition assessment results and other data may also be accessed remotely through mobile devices and / or computers. Such remote access can be particularly convenient for service providers (eg, dermatologists).

Some embodiments of skin care devices may include a user interface that allows a user to interact with the skin care device. The user interface may instruct the user to command the device to analyze possible information, for example, to output real-time skin condition emotional results for the location of the skin or greater skin damage. In some other embodiments, the user interface may be implemented in a voice activated manner to provide a device for verbally inputting commands to the skin care device. Other examples of user interfaces used in skin care devices include graphical user interfaces (GUIs), web-based user interfaces (WUIs), command line interfaces, contact interfaces, and combinations thereof.

In certain embodiments, the user interface may also warn the user when an abnormality is found in a skin condition (eg, when a pore is blocked). This alert may be a light signal, a beep, an email alert, an SMS alert, or the like. Alerting the user about a skin condition that the user should be aware of may include other ways, such as small electrical stimulation, indication, sound, light, heat generation signals, and the like.

Some embodiments of skin care devices also provide for more convenient and intuitive user interfaces and / or to show images of skin areas and / or other useful skin-related information (eg, skin condition reports, skin prescriptions). And a display panel to show a recommendation report and / or a report of skin prescription effects). In some embodiments, the display panel and / or the user interface may be touch sensitive to allow for touch control of the device.

In some embodiments, useful health information of the entire skin area may be displayed on one screen by superimposing the locational skin condition emotion data on the large skin area image displayed on the display panel.

In some embodiments of the skin care device, an access control module may be included that restricts only authorized users to access patient data. This access control module may be based on user name and password and / or biometric information for access control, for example, fingerprint recognition, facial recognition, retinal recognition, and the like.

In some embodiments, skin condition analysis module 4708 can access user information such as age, gender, race, etc., which can be used to form user profiles and analyze skin conditions.

The skin care device 4700 may be used while moving to a user's home, a user's bathroom, a beauty salon, a provider office, or the like. Skin care device 4700 can be used at any time of the day, such as before bedtime, before and after skin washing.

The skin care device 4700 may include a skin care prescription recommendation module 4710 that displays a skin care prescription recommendation. The skin care prescription recommendation module 4710 may display information on the most suitable skin care product, as well as information on the optimal method of using and using the product, time used, frequency of use, and the like. The skin care prescription recommendation module 4710 may be connected to the skin condition analysis module 4708 to generate a skin care prescription recommendation according to the skin condition of each user. The skin care prescription recommendation may be generated in real time based on skin care emotion results and product information generated by skin condition analysis module 4708 and other relevant information analyzed using algorithms, as described herein. In some embodiments, the skin care recommendation output from the skin care recommendation module 4710 may be displayed to the user in real time through, for example, a display panel attached to the skin care device 4700.

In some embodiments, it is possible to print the skin care recommendation generated by the skin care recommendation module 4710.

In some embodiments, the skin care prescription recommendation output from the skin care recommendation module 4710 is at least in accordance with the determination of the skin shape or skin condition 158 of the user and the use of the skin care prescription for people with similar skin conditions. Partly based.

In some other embodiments skin care recommendation module 4710 is associated with skin care product database 190. If the products recommended by the skin care prescription module 4710 are in the product database 190, the user may be provided with the information and a selection tool for purchasing the corresponding product. In some embodiments, a user may operate skin care device 4700 at a point of sale, for example, at a retail store, and the availability of products recommended by skin care recommendation module 4710 may be provided as an audiovisual signal (eg, A lamp that illuminates the shelf where the product is located.

A user using a particular skin care regimen (eg, using a skin care product in a predetermined manner) may want to track the effectiveness of the skincare regimen over a period of time. Accordingly, the skin care device 4700 may include a skin care prescription effect module 4712. This skin care prescription effect module 4712 may be coupled to the skin condition analysis module 4708. The skin condition of the user may be tracked at different times using the skin care device 4700, and may be displayed to the user through a display panel. The device can also track changes with various activities (exercises, meals, smoking, work, etc.).

48 illustrates an embodiment of a skin care device 4700 in which the skin care device is in the form of a cane. For example, a user can switch on a stick-shaped device 4800 and let it pass over his face. The stick shaped device may include a handle 4802, a radiation detector 4808, an indicator 4804 (which may be indicated by light, heat, sound, etc.), an LED light 4810, and a power source 4812.

The stick-shaped device 4800 is similar in function to the skin care device 4700 described above. The stick shaped device 4800 may include an electromagnetic radiation emitter, a radiation detector, and a skin condition analysis module. Stick-shaped device 4800 can be hand-held to be compact and portable.

In some embodiments of the cane shaped device, one or more LEDs may be used as the electromagnetic radiation emission source. Each LED may have its own predetermined frequency. In some embodiments, one or more LEDs may be arranged linearly to form a strip-shaped light source.

In some embodiments, cane shaped device 4800 may be driven via a USB connected to an external power source, or via an internal battery or other similar power source.

As the wand-shaped device moves over the skin, light is emitted from the radiation source 4702. The radiation beam detector 4704 then detects the re-radiated light and sends the information to the skin condition analysis module 4708. The skin condition analysis module 4708 employs an algorithm for skin condition analysis.

49 illustrates another embodiment of a skin care device 4900 that includes a vertical display panel. The skin care apparatus may include an electromagnetic radiation wave emission source 4702, a radiation wave detector 4704, a skin condition analysis module 4708, a user interface 4714, and a vertical display panel 4902.

The vertical display panel 4902 can include a user interface 4714 on the side of the vertical display panel 4902. In some embodiments, the display panel may be touch sensitive, in which case the vertical display panel may itself be a user interface. An image of the skin region can be displayed through this vertical display panel. When the user touches a hand on the position of the image, the enlarged image may be displayed on this display panel or another screen. The user interface 4714 may display a menu bar, and the user may view various reports (eg, skin condition feeling report, skin prescription recommendation report, skin prescription effect tracking report, etc.).

The user interface 4714 may input a command to the skin care device 4900. For example, the command may generate a real-time skin condition emotion result for a skin point or a larger skin area and analyze the useful information therefrom. In some other embodiments, the user interface may be implemented in a voice-activated manner to provide a device for inputting commands in normal writing to the skin care device. Other examples of user interfaces used in skin care device 4900 include graphical user interfaces (GUIs), web-based user interfaces (WUIs), command line interfaces, contact interfaces, and combinations thereof.

The basic function of the skin care device 4900 having a vertical display panel is similar in many respects to the skin care device 4700. The electromagnetic radiation source 4702 can radiate electromagnetic waves to one or more points on the skin. For example (but not limited to), the electromagnetic radiation emitter 4702 may be a set of light emitting diodes (LEDs). In certain embodiments, the wave emitted from the electromagnetic radiation source 4702 may include waves in the visible, near infrared (NIR), and near ultraviolet (NUV) bands. In other embodiments, white light may be included in this radiation wave.

As shown in FIG. 49, an electromagnetic radiation emitting source 4702 can be combined with a radiation detector 4704. The radiation wave detector 4704 can measure various radiation parameters. Various radiation wave parameters may be, for example, polarization degrees, emission intensities at other wavelengths, and the like. However, it is not limited to these.

In certain embodiments of a skin care device having a vertical display, the skin condition emotion is also based in part on analyzing the photographic image of that skin spot.

In some embodiments of a skin care device having a vertical display panel, a memory module may be included to store skin condition evaluation results and other data (such as date time data).

Some embodiments of a skin care device having a vertical display panel may include a communication module for transmitting skin condition evaluation results and other data (date time) to a remote computer. Data communication may be via wired, wireless, the Internet, for example. Skin condition assessment results and other data may also be accessed remotely through mobile devices and / or computers. Such remote access can be particularly convenient for service providers (eg, dermatologists).

In certain embodiments, user interface 4714 may also alert the user when an abnormality is found in a skin condition (eg, when a pore is blocked). This alert may be a light signal, a beep, an email alert, an SMS alert, or the like. Alerting the user about a skin condition that the user should be aware of may include other methods, such as small electrical stimulation, indications, sounds, light, heat generation signals, and the like.

In some embodiments, useful skin information of the entire skin region may be displayed on one screen by superimposing the locational skin condition emotion data on the large skin region image displayed on the vertical display panel 4902.

Some embodiments of a skin care device having a vertical display panel may include an access restriction module that restricts only authorized users to access patient data. This access control module may be based on user name and password and / or biometric information for access control, for example, fingerprint recognition, facial recognition, retinal recognition, and the like.

In some embodiments, skin condition analysis module 4708 can access user information such as age, gender, race, etc., which can be used to form user profiles and analyze skin conditions.

The skin care device 4900 having a vertical display panel can be used in a customer's home, a customer's bathroom, a beauty salon, a provider's office, a moving position, and the like. The skin care apparatus 4900 having a vertical display panel may be used at any time of the day, for example, before going to bed, before and after skin washing.

In some embodiments of a skin care device having a vertical display panel, the skin care device may include or be coupled to a skin care prescription recommendation module that displays a skin care prescription recommendation.

In some other embodiments of a skin care device having a vertical display panel, the skin care device may include or be coupled to a skin care prescription effect module that displays and outputs a skin care prescription effect report.

In some embodiments of a skin care device having a vertical display panel, the vertical display panel is a mirror.

In some embodiments of the skin care device having a vertical display panel, the vertical display panel is an LCD panel or a plasma screen.

In some embodiments of a skin care device having a vertical display panel, the skin care device also includes or is coupled to a camera that photographs an image of the skin area.

In a particular embodiment of the skin care device, the camera may be integrally attached to the display panel or the display panel. In another particular embodiment, the camera may be wired to the display panel or the display panel. In another particular embodiment, the camera may be wirelessly connected to the display panel or the display panel.

In certain embodiments of a skin care device having a vertical display panel, user interface 4714 may include one or more buttons (not explicitly displayed) to perform skin scans and / or analyzes. These buttons can be in various formats-for example, pushbuttons, hard wired buttons, or a combination thereof. The user can operate other buttons instructing the machine to perform skin analysis while manipulating the buttons on the display panel to scan the skin.

FIG. 50 illustrates one embodiment of a wearable skin care device 5000 made in a wearable form. The wearable device refers to what the user can wear in the form of a necklace, earrings, bracelets, patches, sensors mounted on the belt, and the like. This wearable device allows for continuous skin care for each individual use.

The wearable skin care device 5000 is functionally similar to the skin care device 4700 described above. Similar to the skin care device 4700, the wearable skin care device 5000 may include an electromagnetic radiation source, a radiation wave detector, and a skin condition analysis module. The wearable skin care device 5000 is compact and is made portable so that it can be held in a hand, and preferably, its size does not exceed 6 inches.

In some embodiments of the wearable skin care device, one or more LEDs may be used as the electromagnetic radiation emitter. Each LED may have its own predetermined frequency. In some embodiments, one or more LEDs may be arranged linearly to form a strip-shaped light source.

Some embodiments of the wearable skin care device 5000 may be driven through a USB connected to an external power source or through an internal battery, mobile power, solar power, or similar power sources.

Embodiments of the wearable skin care device may also include a sensor that measures various body and environmental parameters. Examples of body parameters that can be measured with a wearable skin care device include body temperature, hemoglobin antioxidant levels, and the like. Examples of environmental parameters that can be measured with the wearable skin care device include air cleanliness, humidity, temperature, UV index, outside air quality, smoke index, and the like.

In one embodiment, the imaging device 108 is a laparoscopy, cystoscopy, urethoscopy, arthroscopy, endoscopy, dermatology, gynecology, urology, dentistry, natural oral implantation, such as the ear canal, oral cavity, anus, nasal cavity, skin It is applicable as a part of the minimally invasive medical device related to external analysis of breast cancer through. For example, the system is capable of data processing and may be displayed on displays such as image monitors in operating rooms or other medical facilities. The medical professional may select an image viewing mode (eg still image capture or video capture). In addition, parameters of the light source, the sensor, and the display unit may be manually adjusted to assist in observing, identifying, and monitoring the skin with the imaging device 108. In one embodiment, the system may be preprogrammed with a variety of protocols for the various medical procedure formats and tissue types that a healthcare professional may face. Thus, the imaging device 108 may be automatically operated based on the type of procedure and the medical professional's instructions for the tissue to be investigated.

For example, imaging device 108 may serve as part of a system and method that distinguishes between healthy and suspect tissue from a patient in real time or near real time. Imaging device 108 may allow a surgeon or other practitioner to precisely determine the border area around a surgical treatment subject, such as skin melanoma, skin cancer, and other ablative skin diseases. Surgical excision of suspicious tissue (such as cutaneous melanoma) is usually performed by a surgeon's experience or by a punch biopsy that measures the breathable scale, the thickness of the melanoma and the approximately acceptable border area. It can be determined through. However, the imaging device 108 may automatically determine the extent of ablation of the major skin melanoma based on the optical characteristics of the surrounding skin. By precisely determining where healthy tissue and suspect tissue are located, the surgeon minimizes surgical integrity, apparently leaving healthy tissue in large areas around the lesion, reducing recurrence, and smiling to the surrounding skin. It will be able to reduce metastatic cancer. Imaging device 108 implemented in software and associated algorithms 150 and analysis techniques (e.g., convolution techniques and RGB color analysis, which will be described later) to image specific areas, and prior to surgery, in preparation for surgery, During surgery, it may be employed to determine the border area and the suspected tissue. The software also enables post-surgical analysis of skin affected tissues. By using the imaging device 108, it is possible to determine the boundary area more accurately without relying on objective experiences or materials in medical journals and other publications. The advantage of this method is that it can better isolate suspicious tissues and maintain healthy tissues. In Figure 56, the damage of melanocytes is shown. Visible melanoma 5602 or suspected tissue is surrounded by skin (quasi-normal skin) 5604, which may look normal but may contain unhealthy tissue / sick tissue to be excised. Imaging device 108 may visualize the boundary between healthy and unhealthy tissue 5608 to allow the surgeon to leave healthy tissue that should not be touched. Imaging device 108 may estimate and provide an area within boundary 5612 at which the surgeon should perform tissue resection. In FIG. 57, melanin cell damage is visualized together with a tool 5702 for analyzing damaged images, a tool 5704 for manually selecting a border, a tool 5808 for automatically selecting a border, and a tool 5710 for drawing a border area. One embodiment of a user interface is shown.

In one embodiment, imaging device 108 enables skin health test 160. The imaging device 108 may perform a skin health test 160 to identify and diagnose skin features. The hardware device can capture the image and perform its analysis. Imaging portions within imaging device 108 may measure various skin health features (color, age, damage, collagen, elastin, pore and pore morphology, keratin, and the like). The skin health test 160 may be performed in a home, spa, clinic, hospital, etc. and anywhere via mobile phone. Skin health test 160 may be associated with specific background information through questions, image uploads, genetic tests, DNA samples, and lifestyles to determine skin condition 158. Skin health test 160 may respond to specific information related to the biophysical health of the skin with some physical and genetic abnormalities to a medical or non-medical or cosmetic problem or situation.

In an embodiment, the imaging device 108 may enable prognostics 162. This proactive diagnostic system allows practitioners (users, dermatologists, medical practitioners, beauticians, etc.) to perform proactive diagnostics based on algorithms that receive or request images and / or questions about skin health, etc. from the user, and analyze existing situations. It is a system that can receive. The user may submit a questionnaire and images for the pre-diagnosis before visiting and receiving care from the practitioner. The images captured by the imaging device can be submitted for preliminary diagnosis in order to efficiently refer to the case to the best practitioner. Prognostics 162 may be performed by software algorithms for images, manual analysis, combinations thereof, and the like. The prediagnosis 162 may include preliminary emotions, along with indicating the time and procedure required for the final diagnosis or emotion. The feature of this pre-diagnosis 162 can enable practitioners to schedule effectively. This prognostic 162 can also help to find a user with a particular problem and to screen for a particular skin problem.

In one embodiment, imaging device 108 may enable remote monitoring 164. A user may use the imaging device while protecting privacy at home, work, or other places by submitting an image that tracks his or her skin health or medical condition history by executing remote sensing 164. Practitioners can guide remotely about changes or prohibitions on treatment. Remote diagnostics can greatly increase the efficiency of the monitoring process. This is because the user does not need to visit the provider and the provider can conveniently set a time to look at the patient's condition. Monitoring data can be viewed through records or in real time.

In one embodiment of the present invention, the imaging device 108 may irradiate the affected part with light that is not polarized at a predetermined angle. To create a spectral plot based solely on the magnetic properties of the affected part, the reflected polarized light with the electrical properties of the affected part is excluded from the scattered scattered light having the electromagnetic properties of the affected part. The pixel distribution in the image corresponding to the diffused light and the reflected polarization can be determined, which can be displayed by any existing means. In a known image sensor, 1: 1 pixel mapping of an image distribution between a diffuse light image (corresponding to an electromagnetic signal) and a reflected polarization image (corresponding to an electrical signal) is performed as a distribution of intensity of spectral data for the same region. can do. Magnetic gradient images in the region can be obtained by a device such as AFM-MMR (Atomic Force Microscopy in Magnetic Mode Regime). And, from the 1: 1 correspondence method, the skin state 158 may be based on the grayscale image, the diffused light image, and the reflected polarized image.

In one embodiment, the imaging device 108 may be an imaging device 108 that performs digital spectroscopic images of the skin. Unpolarized incident light from an unpolarized light source (eg, white light, diffused light, monochromatic light, single light, multiple light, etc.) associated with the imaging device 108 may be incident on the skin structure either vertically or at an angle of alpha relative to the vertical. . White light, having both electrical and magnetic properties, interacts with the components of the skin structure when it is incident on the skin structure at a particular angle to produce reflected or re-radiated light with polarization components. In an embodiment, incident light may be polarized. Unpolarized light reflected from the skin structure may be at least partially polarized. Reflected or re-radiated light may be captured by imaging device 108, whether polarized or diffused light. Such multispectral skin imaging can be used to produce electromagnetic skin topography. The biophysical properties of the skin structure can be obtained by measuring the aspect of polarization of the reflected or re-radiated light (eg, the direction, amplitude, phase, angle, shape, degree, amount, wavelength of the reflected or re-radiated light). Skin condition 158 may be determined from a number of biophysical data acquired from one or more skin structures and visual analysis of captured images and other additional data obtained from stories from users. For example, skin condition 158 includes data on moisture, wrinkles, pores, elasticity, brightness, and many other measurements described herein. By varying the incident angle alpha of the white light, the depth of penetration of the light into the skin structure can also be varied. The depth of penetration into the skin depends on the skin structure. For each skin structure or depth there is a certain angle to cause full polarized reflection. For example, certain angles of incidence can be used to obtain data about skin structure in the dermis. However, the angle of incidence needs to be altered to obtain data on the skin structures in the subcutaneous tissue present at different depths inside the skin. The angle of incidence can be altered to capture anything that is transmitted from anywhere in the skin, ranging from a few microns to a few centimeters, and reflected from structures other than the skin. For example, imaging device 108 may be used as a non-invasive imaging tool to image tumors, breast cancer, melanoma, and the like, for example. In one embodiment, the area to be imaged may be any biochemical tissue that may have normal or pathological changes in the structure (eg, changes due to birefringence of the tissue). For example, wounds, keloids, hypertrophic wounds, and tape measures are all organized with collagen fibers that are different from normal skin. Since collagen is a major determinant of skin wound healing, monitoring collagen structure and concentration changes can be of concern. For example, the size of collagen can be used to lengthen the course of treatment, and the structure of collagen structures in molecules or small fibrils that can lengthen the course of treatment, and by reversing or increasing the birefringence to determine the stage of treatment. Can be. Since the collagen structure responds to polarization, changes that occur in this structure can be monitored using polarization-based techniques during wound formation, during treatment, and during wound healing. This has been explained before and will be explained in more detail later.

By measuring the electrical and magnetic properties of various skin structures, it is possible to distinguish between healthy and unhealthy skin structures. Normal or healthy skin structure has a distinctive form that differs from that exhibited by the equivalent structure of unhealthy or abnormal times. Such morphological changes can be sensed by, for example, the polarization aspect of the reflected or re-radiated light by the difference in the aspect of the reflected light, the re-radiated light or the amount of absorption in the skin. The aspect of polarization may be the wavelength, direction, amplitude, phase, angle, shape, degree, amount, etc. of the polarization. According to the Maxwell's equation, light can be described by two vectors, E and B, which act like waves. These vectors are perpendicular to the direction of propagation of light and orthogonal to each other. Furthermore, given the electric field E, B can be found from the Maxwell's equation, and vice versa. Therefore, by measuring the electrical components of the light reflected, re-radiated, and absorbed in the skin structure, it is possible to determine the magnetic component or the degree of polarization / polarization state. Light can also be diffused at other wavelengths that can be measured. The skin structure and its molecular form or structural form by comparing the electrical and magnetic measurements readable from the polarized component of the reflected or re-radiated light and non-polarized white light with that of normal or healthy skin structures incident at the same or similar angles. The change in can be detected. Based on electrical and magnetic crystal amounts or other aspects, specific defects for cancer, skin diseases, cosmetic labels, and the like can be detected. Because each measurement range can correspond to a particular type of bond. If other molecules, cells or structures are currently being irradiated with the same type of light at the same angle, the intensity of the morphological differences of the measured components can be determined by the intensity of the particular wavelength of the component being reflected. The polarization state of reflected or re-radiated light can be described by a number of parameters. The polarization state can be described by a polarization ellipse, in particular by its orientation and elongation. Parameters that can be used to describe the state of polarization include the azimuth angle (ψ), the angle between the major semi-axis and the x-axis of the ellipse, the ellipticity (ε), the ratio between the two semi-axis, and the ellipticity. The ellipticity angle, the eccentricity, and the amplitude and phase of the vibration occurring in the two components of the electric field vector in the polarization plane may be included. For example, an ellipticity of zero corresponds to linear polarization and an ellipticity of 1 corresponds to rotational polarization. The polarization of the reflected or re-radiated light can be at least one of elliptical, linear, rotational, left-turned, right-turned, and any combination of these potentials.

In one embodiment, determining the skin condition 158 may include processing and analyzing 154 the reflected or re-radiated light to obtain an image for visual and spectral analysis. Analysis 154 may be accomplished by examining the wavelengths and other characteristics of the reflected or re-radiated light. For example, if the incident light is white light, the reflected or re-radiated light can be filtered to irradiate a collection or multiple wavelengths of multiple wavelengths and ultimately specific skin structure fluorescence. In another example, monochromatic or semi-chromatic light provided by, for example, LEDs can be used to excite the target fluorophore and chromophore. In this example, phosphors of deeper layers can be extracted. In this example, the particular phosphor can also be separated by filtering the reflected or re-radiated light. In another example, the biophysical properties can be detected from various depths in the skin by changing the wavelength of the light to be irradiated. In addition, certain chromophores, such as the various forms of hemoglobin found in the blood, have specific absorption bands, and thus can produce information about the distribution of chromophores that may be sensitive to polarization by processing data generated with light of different colors. Can be. The wavelength dependence can be obtained by the following method. 1) continuously irradiate a single wavelength of light or multiple wavelengths of a single wavelength to collect each resultant image individually, or 2) irradiate white light to reflect an individual wavelength or set of individual wavelengths during detection or processing or Analyze the re-radiated light. Algorithm 150 may be used to obtain information from data obtained with one of the above methods by processing and analyzing one or more wavelengths of light to form an image based on spectroscopic polarization. In one embodiment, a combination of the two techniques can remove reflected light from the skin surface.

In one embodiment, filtering may be used to filter wavelength ranges that belong to, for example, ultraviolet light, infrared light, near infrared light, visible light, and the like. The filter can be a digital or analog filter. For example, the captured image can be processed by software that can use digital filter technology to process the image analysis. For example, any digital filter parameters may be selected using software such as a predetermined cutoff wavelength, a single set of wavelengths, a sampling interval, and the like. For example, a digital filter can be used to separate reflected waves of 405 nm, 458 nm, 488 nm, 532 nm, 580 nm, and 633 nm wavelengths. However, it is not limited to these wavelengths. In another example, for example, an analog filter for filtering a captured image, such as a filter integrally formed in the optical unit of the imaging device 108, or an analog filter for filtering a stored, transmitted, manipulated, or processed image, such as an external analog filter. Can be adopted. By filtering the image, an image of the underlying structure can be obtained and / or a specific polarization pattern can be obtained. The image can be filtered to separate the electrical and magnetic components of the reflected or re-radiated light. The filtered image may be subjected to algorithm analysis. By separating certain wavelengths of light by filtering, reflected waves due to skin surface reflections can be eliminated. For example, sebaceous glands can appear as bright spots in an image only when a specific wavelength of light is analyzed separately, while separation of other wavelengths of light can visualize all pores in the image region. Thus, it is possible to separate the phosphor from the deeper layers. Changes in sebaceous glands and pores (e.g., number, size, activity of sebaceous glands, amount of sebum / other substances in sebaceous glands, amount of sebum / other substances in pores, age of contents in sebaceous glands, age of contents in pores, Image processing can be used to count and measure infection progression around the sebaceous glands. Multiple images from different sources can be combined and analyzed. This analysis reveals the function, diagnosis, and prognosis of skin health such as acne propensity, oiliness, radiance, viscosity, and the like. Color image processing (eg, RGB analysis) may be utilized to analyze other skin features.

In one aspect of the invention, the host system 104 may include an algorithm 150, data integration 152, analysis tools / API 154, skin conditions 158, expert counsel 128, and the like. The skin condition 158 may include tests 160, prognostics 162 and monitoring 164, user inputs, expert consultation 128, other inputs 112, analysis 154 performed by the imaging device 108. , A skin characteristic or a data object based on the algorithm 150 or the like. Skin condition 158 along with all sub-data and user information may be stored in skin health record 121. In one embodiment, the host system 104 may include a server structure. The host system may be a technology agnostic. The host system 104 may include one or more cloud computing, service oriented structures, distribution objects, and the like.

In one embodiment, expert consultation 128 may provide advice regarding analysis, recommendation, appraisal (evaluation), and the like. In addition to any other similar data such as the physician's diagnosis, insurance, blood analysis, etc., pre-diagnostic and collected skin imaging data may be consulted by a user, by practitioners, or by other users and analyzed accordingly. Get advice, recommendations or feelings. Experts can be geographically remote and have very different proficiency. For example, skin imaging data and analysis can be shared with herbalists in India at the request of another user. Or, the user can request to share the image data with a French aging specialist to learn the best skin care treatment from their experience. The expert's counseling analysis can be recorded on the host system 104 as part of the skin history record 121, which the user can conveniently access (access) or share with other users.

In one embodiment, the system 104 may be home based or installed at a clinic or medical facility, at a spa and beauty salon, at a cosmetic checkout desk and in a cosmetic store to perform skin analysis individually and accurately in a low cost, fast and safe manner. have. In some embodiments, imaging device 108 may perform analysis 154, record skin condition 158, and receive consultation / analysis from remote practitioner or algorithm 150 for user interface 102, online. Platform 129, mobile communication platform 124, and the like. Home-based system 104 allows practitioners with or without advice to analyze cosmetic or non-cosmetic conditions that may be captured by imaging device 108 or third party device 109, and a questionnaire. Based on the input from the uploaded video, you can give advice and recommendations on products, prescriptions, eating, lifestyle, etc. The system may consist of a startup website that can be customized for a personal business where practitioners can do client skin care and health care, prescription tracking, product recommendations, online advice, and the like. This can leverage the analytics and device platform to enable practitioners to analyze comments, videos, questions and / or interests, and to enable counseling and tracking of advice and lifestyle improvements. Spa / beauty salon based systems can enable personalized skin assets. For example, the spar may be equipped with an imaging device that enables the practitioner to simulate the therapeutic effect while displaying the captured image on a large display panel configured to display skin conditions. The user may compare skin condition 158 with peers or other spa customers and generate recommendations based on their customers' occupations or the goods they have purchased. Desired improvements can be considered in connection with the ingredients for the user's skin and the most effective product / prescription 118. This prescription 118 allows the user to create a personalized skin care emotion 122 made by hardware and / or a type of decision 130 for the experience of the skin and the product. Learning to create a shared experience through ratings and ratings (138) and / or comments about the best suitability and collection of the product's effects and experiences (eg, smell, taste, feel, touch, color, etc.). May have characteristics. This prescription 118 may dynamically make recommendations based on inputs collected by the user, as well as expert inputs for products that best fit the user's personal needs.

The spa / beauty salon based system 104 generates a product / service recommendation based on the skin condition 158 and provides one-click shopping based on this recommendation to enable tracking of stock keeping units (SKUs). Optimizing advice and prescriptions, such as providing a wellness package through contractual relationships, allowing prescriptions to be delivered between spa-spas, home-spas, etc., helping practitioners adjust the length of the procedure, Enable the development of targeted treatments, enable transparent and visual delivery to clients, generate product / service effect reports, and the like. The reporting may be based on or include correlation with other users, feedback on prescription 118, changes in prescription 118, monitoring of skin cycles (cycles), and the like. Medical practitioner-based systems, such as dermatologists, general practitioners, and metabolists, enable prediagnosis, link to practitioner scheduling systems, enable pre- pricing of services, and follow-up. up) tracking and so on. Cosmetic sales or retail-based systems 104 may be integrated with product inventory to exhaust inventory. The handheld / portable imaging device 108 can be used in cosmetic shelves, pharmacies, home or cosmetic trade shows / parties, and the like. The user may purchase peripherals or accessories of the imaging apparatus such as a holster and a charger. The user may use a paid scan or use a membership scan service. The system 104 may be installed in a health club, gymnasium, amusement facilities, and the like. Beauty-based manufacturing / testing-based systems enable the design of skin-based products, tailor skin care samples to specific consumers, and other functions. The system 104 can be built on a veterinary basis to monitor veterinarians' interest in skin and non-skin. The system 104 can be installed in hospitals, ERs, military installations, etc., thereby enabling rapid appraisal of medical conditions, urgent skin care screening, and the like. The system 104 can be built on an agricultural basis that can be applied to fruits, vegetables, and other agricultural products. The system 104 may be used in extreme environments or at war, such as in spacecraft, airplanes, underwater, submarines, and the like. This enables injury management, diagnosis and screening on the battlefield. The system 104 can be fabricated for research purposes that allow for comparison of any material with its composition. By reading the electrical properties of the light, the user can find out similarities or differences between the imaged objects.

In one embodiment, determining skin condition 158 may include employing analysis 154. In one embodiment, the data obtained may be analyzed by practitioners such as physicians, dermatologists, spa employees, clinic examination practitioners, aestheticians, cosmetologists, nutritionists, cosmetics salesmen, and the like. The practitioner may visually analyze the acquired data with the help of an algorithm 150, expert consultation 128, database 115, and the like. In one embodiment, practitioners may obtain data remotely. In one embodiment, algorithm 150 may be used to process and analyze 154 the reflected or re-radiated light automatically or by manipulation of a user or practitioner to obtain a spectroscopically resolved image. For example, an algorithm 150 can be used to obtain spectroscopic images of magnetic properties in this area only between reflected polarized light with electrical properties in this area and reflected diffused light with electromagnetic properties in the area of interest. The difference may be used to generate an image of the ROI. Algorithm 150 may be rule-based software and a process whereby 1) skin imaged evidence to obtain skin health, and 2) skin components, medicines and / or products that may be best suited for the determined skin health. Determine health, 3) correlate skin health with peers in the skin health community, 4) recommend and design personalized products based on skin health and / or other similar user experience, and 5) Allows you to observe measurable changes in skin health. Algorithm 150 may be automated. Algorithm 150 may be used to analyze 154 medical concerns (eg, the degree of suspicion, such as cancer or rash analysis, etc.). Algorithm 150 may be used to analyze 154 non-medical interests (e.g., medical, non-medical, beauty prescriptions 118, acne avoidance prescriptions 118, sun protection effects, anti-itch creams, etc.). . Algorithm 150 may be useful for correlating a product that has the best effect with ingredients for improving and maintaining skin health of a user to a desired improvement. The algorithm 150 may use the calibration scale to determine the imaged skin structure based on the angle of incidence, wavelength and intensity of the light source, the pattern of reflected or re-radiated light, filter parameters, and the like. Algorithm 150 may be used to determine dermascopic effects, luminescent effects, spectral effects, and the like. For all algorithms 150, there may be input, output, and functional parameters for modulating the algorithm 150. In one embodiment, the analysis 154 may include images of physical data and / or materials using diffuse white light; Imaging of physical data and / or materials using single wavelength light or multiple wavelengths of single wavelength; Imaging of physical data and / or materials using polarized reflected light or re-radiated light at a particular angle; Images of physical data and / or materials generated using the difference between diffuse white light and polarized reflected light or re-radiated light at a particular angle; It may be implemented for at least one of physical data and / or images of materials generated using the difference between single wavelength or multiple wavelength light and polarized reflected light or re-radiated light at a particular angle. Algorithm 150 may be used with data and images generated by imaging device 108 or third party hardware 109. Algorithm 150 captures using any image capture device or technique, using any type of incident light (eg, unpolarized light, polarized light, monochromatic light, diffused light, white light, single wavelength multiple light, etc.). Can be used with data and images. In one embodiment, any captured data or image may be subjected to algorithmic analysis as shown herein.

In one embodiment, algorithm 150 may be based on artificial neural networks, nonlinear regression, or fuzzy logic. For example, algorithm 150 may be used to diagnose skin damage based on a probabilistic framework for classification. Two kinds of data, that is, numerical data such as intensity, size, and number, and technical (descriptive) data such as white, gray, and black may be input to artificial neural networks or nonlinear regression analysis. Fuzzy logic can directly encode structured descriptive data in a numerical structure. Learning the algorithm 150, the operation of the adaptive control system, the intelligence of the neural and fuzzy machines, the correspondence between the collected images and the input data obtained from the biophysical skin condition 158 is made possible by the associated memory. .

In one embodiment, the algorithm 150 may be based on fractal and multi-fractal analysis of an image based on biophysical and spatial temporal data. Digital imaging data and spectral data on the skin can be analyzed using Hausdorff dimensions (fractional properties) and Kolmogorov's entropy (K-entropy). In this case, the spectral data may be divided into cells in space and time and analyzed as objects of multiple fractals, thereby calculating information on the degree of functional mismatch of the skin structures (epithelial and dermis). The structural data in these two analyzes can be correlated with each other to determine a one-to-one correspondence between them. Once the fractal relationship is established between the digital image data and the spectral data of the skin, it is possible to obtain information about the functional state of the skin structure through multiple fractal analysis of the digital image data.

In one embodiment, algorithm 150 may be for data integrity analysis 154. For example, algorithm 150 may determine whether an image was captured with a precision high enough to reliably follow up the analysis.

In one embodiment, algorithm 150 may be used for analysis of skin features, thereby obtaining the biophysical properties of the skin and determining skin condition 158. Skin condition 158 can capture a combination of time-based variance and underlying skin structure. Some variation can be predicted, but some may be based on transients such as infections, sunburn, and hormonal imbalances. Algorithm 150 includes melanocytes / melanin, hemoglobin, porphyrin, keratin, carotene, collagen, elastin, sebum, sebaceous gland activity, pores (pore and sebum), wrinkles, moisture, elasticity, brightness, derivatives, salts, complexes, etc. All aspects of the types listed above (e.g., structure, shape, concentration, number, size, condition, stage, etc.) can be measured. The algorithm 150 includes clinic, medical, non-medical and cosmetic indicators (moisture, firmness, fine lines, number of wrinkles and stages, pore size, percentage of open pores, skin elasticity, skin tension lines, moles, skin color) , Psoriasis, allergies, red areas, general skin abnormalities and infections, etc., or other skin-related diseases for the user (eg, tumors, sunburn, rashes, scratches, acne, acne, bites, itching, bleeding, injuries, Inflammation, photodamage, pigmentation, hue, tattoo, burn rate / type, warts (spots, birthmarks), skin damage (structure, color, size / asymmetry), melanoma, disease seen through the skin, skin damage, Cellulite, boil, blister, management of congenital skin syndrome, subcutaneous filamentous fungal disease, melasma, vascular condition, rosachea, spider vein, texture, skin ulcer, wound treatment, surgical prognosis, melanocyte damage, non-melanin cell damage, basal Cell carcinoma, three Boric keratosis, sebum (oiliness), nails and / or hair related problems, etc.). Algorithm 150 may also be useful for obtaining and analyzing physical properties and compositions of hair, nails, biochemicals, gaseous substances, food, alcohol, water, liquids, metals, nonmetals, synthetic resins, polymers, and the like. . Certain final measurements may be made by manually or by employing the target wavelength or target wavelengths as a determination by the algorithm 150.

As the incident light, a specific wavelength or multiple wavelengths can be selected and the specific wavelength or wavelengths can be separated by filtering as described in the specification. The algorithm 150 may determine the presence, absence, structure, shape, etc. of a particular skin structure based on the properties of the reflected or re-radiated light. For example, algorithm 150 may detect which axis / angle the light is polarized and compare it to the characteristic emission spectrum of each protein / lower skin structure. Each skin structure may have unique pattern features based on the electrical and magnetic contributions of the molecule (s) present in the skin structure. Algorithm 150 may identify, analyze, and separate the electrical and magnetic components of the unique polarized signal as described herein. These signals may be correlated with the state of the bound form of the molecules in the skin structure. By comparing this signal with a standard calibration signal, the aspect of the underlying skin structure can be determined. Standard calibration signals can be obtained from skin structures / molecules and a table of specific observation wavelengths. This lookup table can be prepared by the techniques mentioned in the specification or by any other spectroscopic technique. For example, to determine the moisture level in the skin, algorithm 150 may determine the ratio of reflected polarized light and reflected diffused light and correlate this ratio with the moisture level. Ideally, nearly 100% polarized light can result from reflected waves, but if some of the reflected or re-radiated light is diffuse light (eg, 95% polarization component, 5% diffusion component), then the amount of diffused light is at the moisture level. It can be correlated to. Unpolarized incident light can interact with the skin structure and allow to alter the amount of polarization of reflected or refracted light. The intensity of this polarized reflected or refractive light can be measured. Although this polarization may be 100 percent polarization, the degree of reflection and polarization may in some cases be even less than 100 percent. The angle of incidence and the imaged material can help to determine the maximum intensity that enables polarization of reflected or re-radiated light. While there may be a maximum that polarizes up to 100% for a particular angle of incidence, it will be appreciated that any amount of polarization that is polarized from 0 to 100% can be predicted from light reflected from any skin structure. The cause of this difference in reflected waves may be due to the ratio of moisture to free moisture trapped in the skin. To determine elasticity, algorithm 150 may determine the concentration of elastin for each region of interest. To determine the brightness, the algorithm 150 may merge the moisture level and the skin color to make the object assessment at once. Subject measurements may be correlated with professional scales or other external measurements. To determine firmness / tension, algorithm 150 measures emotions of the concentrations of collagen and elastin in the region of interest, along with the sebaceous gland's activity (measured as the number of sebaceous glands, the ratio of open and closed, blocked and filled). Merge can be performed. Algorithm 150 may superimpose varying wavelengths and intensities on spectroscopic techniques (eg, reflection, excitation / emission, etc.). Algorithm 150 may process and analyze 154 images collected by imaging device 108 or other imaging device using non-polarization, polarization, or a combination thereof. Algorithm 150 includes various types of images (e.g., thermoelectromagnetic (TEM) or electromagnetic (EM) images, images collected using polarized incident light, images obtained by traditional skin imaging, spectroscopically resolved images, Image, harmonic light image, etc.) may be processed and analyzed (154). Algorithm 150 may calculate a deviation measure of skin condition 158 over time. Determining skin condition 158 also includes processing and analyzing images of the skin for various measurements and endpoints as described herein, as well as images, user input information and third party information (e.g., lifestyle patterns, Visual analysis of smoking history, exercise habits, diet, allergies, etc.). For example, a user may enter daily information, such as medications that can be taken, recent overexposure to the sun, and menstrual cycle phases.

In the embodiment of FIG. 35, the algorithm 150 performs spectral convolution of the digital image. The acquisition of a digital image is performed by 1) "white light having an incident angle", that is, white light incident at an angle sufficient to cause polarized light reflection 2) "white light without incident angle", that is, white light incident at an angle that hardly causes polarized light reflection Is made by. The above discussion was about the use of skin as the main sample, but other samples, such as covalent valence effects, ionic effects, and hydrogen bonding effects (such as skin, hair, biochemicals, food, liquids, alcohol, It is to be understood that metal materials, nonmetal materials, etc.) can be used as the target samples of the algorithm 150. In simple terms, a digital image is captured (3502, 3504) from a sample with light without angle of incidence (an incidence incident light) and light with angle of incidence (angled incident light), generating a histogram of the blue and red channels for each image and the relative Normalized to intensity (3508, 3510). The color channel histogram is then correlated (correlated) to the wavelength axis scale (3512, 3514). Spectral convolution proceeds in two steps. In the first step, the color channel histogram for the angled incident light is subtracted from the color channel histogram for the angled incident light for each of the red and blue channels (3518). This produces two composite histograms, a blue channel composite histogram and a red channel composite histogram. In the second stage of spectral convolution, the blue channel composite histogram is subtracted from the red channel composite histogram (3520). Hereinafter, each step of the algorithm will be described in detail with reference to FIG. 35 through FIGS. 36 to 43.

Referring to FIG. 36, as described above, various object samples 3604 suitable for imaging may be irradiated with incidence incident white light and angular incident white light (3608 and 3610). As described above, the depth of penetration of light into the skin structure is affected by the change in the angle of incidence. For each skin structure that corresponds to a known depth within the skin, there may be an angle of incidence that causes polarized reflection. By analyzing the reflected or re-radiated light, polarization 3614 and / or diffusion 3612 are reflected from the skin to obtain information about the underlying structure of the skin captured by imaging device 3602. Here, the term "incident incident white light 3610" refers to white light irradiated at an incident angle at which polarized light reflection occurs in a sample. By "incidentally incident white light" is meant white light that is not incident on a sample at a particular angle and is incident at an angle that causes diffusion. In this case, the angleless incident white light may cause white light reflection, polarized light reflection, or combined reflection thereof. In one embodiment, the polarized light reflection by the angled incident white light may have a different characteristic from the polarized light generated by the angled incident white light.

See FIG. 37. The Maxwell color triangle of FIG. 37B can tell us well about the nature of the white light. Maxwell color triangles represent the complete visible color spectrum at a particular wavelength. To create a mathematical coordinate system in the RGB color space, a simple model using a straight line is used as shown in FIG. 37A. Each vertex of the outer triangle represents an ideal color, ideally green, red and blue, clockwise from above. Along the sides of the Maxwell triangle, mixing two of the three color components produces all possible colors. As you move from the edge toward the center, the third primary color becomes more important. Along the axes passing through each of the three vertices, near the center "equal energy" point E, it becomes true white. When red, green and blue are mixed in full, they become pure white. Therefore, at all points of the triangle including the point where the white light is emitted, it is possible to obtain a mixed color of at least one of red, green, and blue. For example, the solid circle 3702 in the figure represents the point at which a color is formed between pure blue / black blue and pure white. Similarly, dashed circle 3704 represents the point at which a color is formed between pure red / black blue and pure white. As shown by the inner triangle 3708, a digital photograph of the white paper can be used to validate this coordinate system. This coordinate system is valid when the sides of the inner triangle 3708 are parallel to the limits of the color space lines of the original coordinate system. If not parallel, this coordinate system is not valid.

Referring to FIG. 38, an RGB histogram for each color channel is generated for each image. RGB digital video has three color channels: red, green, and blue. Each of these channels can be examined and analyzed separately. One blue channel histogram is generated for an image acquired by an incidence white light, and another blue channel histogram is generated for an image acquired by an incident angle white light. Similarly, one red channel histogram is generated for an image acquired by an incidence white light, and another red blue channel histogram is generated for an image acquired by an incident angle white light. For example, as shown in FIG. An automated system can be used to generate a histogram for. By simply specifying the desired channel 3804 by the user, a histogram 3802 can be generated for that channel. The histogram can be normalized to the relative intensity of the light. Normalizing the histogram to the intensity of the incident light is important for processing histograms generated from other images. Next, as shown in FIG. 39, the RGB color channel histogram is correlated to a specific wavelength axis scale in order to generate an RGB color channel spectral diagram.

40A and 40B, a set of image data is mathematically combined. This is done in two steps, in the first step, the blue channel spectral diagram generated from the image acquired by the blind white light 4004 is subtracted from the blue channel spectral diagram generated from the image acquired by the blind white light 4002, Generate a blue channel composite spectral plot. The red channel spectral diagram generated from the image acquired by the blind white light 4008 is subtracted from the red channel spectral diagram generated from the image acquired by the blind white light 4010 to generate a red channel composite spectral diagram. The first superimposition of these two spectral diagrams 4008 and 4010 is shown in FIG. 40B and the subtracting one is shown in FIG. 41B. Subtraction (subtraction) can be performed by mathematically subtracting the intensity (magnitude) normalized for each wavelength by aligning the spectral plots to match wavelengths. For example, if the intensity is 0.005 at the wavelength of 470 nm of the blue channel spectral diagram obtained by the angled incident white light, and the intensity at the same wavelength of the blue channel spectral diagram obtained by the incidence white light is 0.003, In the final spectral diagram subtracted, the intensity at this 470 nm wavelength will be -0.002. The specific intensity and wavelength in the spectral diagram reflect the properties of the underlying material irradiated with light and the angle of incident light irradiated onto the material.

Next, as shown in FIG. 42, the normalized composite spectral diagram of the two color channels is combined to generate a spectral signature of this sample. The normalized composite red channel spectral diagram is subtracted from the normalized composite blue channel spectral diagram. The scale of the wavelength axis is determined by the wavelength difference between the red and blue images, starting with the darkest part of the two colors. This wavelength scale is based on the mathematical coordinate system for the Maxwell color triangle. For example, in FIG. 43, the bottom of the Maxwell color triangle is shown in FIG. 43B, with the arrow indicating the corresponding position of the color triangle in FIG. 43A. Point 1 corresponds to the ideal blue color of the Maxwell color triangle, point 2 corresponds to pure white, and point 3 corresponds to ideal red. Align points 1 and 3 when convoluting the complex spectral diagram to obtain a spectral signal. Thus, the unit scale on the convoluted histogram is the wavelength difference (eg, 500-400 nm to 700-400 nm).

By analyzing the acquired spectral signals, many features can be identified, such as the number of peaks and peaks, the amplitude and shape of the peaks, and the intermediate structure and pattern. Various mathematical, visual and algorithmic processing techniques can be used to process and analyze spectral signals. The spectral signals acquired for the various samples are unique. For example, the spectral signal of FIG. 44A is for bright skin and the spectral signal of FIG. 44B is for dark skin.

In one embodiment, algorithms may be used to determine the composition, purity, strength, and the like of the metal. For example, spectral signals can be used to distinguish metals. The spectral signal of FIG. 45A is for aluminum which is pure metal, and the spectral signal of FIG. 45B is for alloy PbMnTe. The spectral signal can also be used to distinguish the same substance with different components. For example, while the spectral signals in FIGS. 45B and 45C are both for PbMnTe alloys, the alloy of FIG. 45B is composed of different components compared to that shown in FIG. 45A.

In one embodiment, algorithm 150 may be used to analyze the water quality, composition, purity, etc. of water. For example, the spectral signal for purified water is shown in FIG. 46A, whereas the spectral signal for very high purity water is shown in FIG. 46B.

The spectral signal can be further developed. In other words, by subtracting the contribution of the spectrum due to the light source from the spectrum of the reflected light, it is possible to normalize the spectral signal for a particular skin condition. For example, the spectral signals shown in Figs. 51-54 can be normalized by subtracting the spectral signal of the light source from the spectral signal of the reflected light. The spectral waveform obtained by subtracting the spectral signal of the light source is normalized only for changes in the skin caused by interaction with incident light. In practicing this method, certain types of incident light may be used that are more suitable for detecting specific structures, components, or conditions. In some embodiments, a spectral signal for subtracting the angle due to the angle of incidence in the RGB histogram with the angled incident light may be calculated and used to subtract from the final spectral signal for the material.

Other convolutions, such as convolution for yellow or other color channels, may also be used. In addition, predetermined convolutions are also available.

In FIG. 51, the bipolar intensity 5101 represents the actual size of reflecting or re-radiating at a specific wavelength depending on the properties of the material, and the negative intensity 5102 represents the actual mass absorbed from the spectral signal of the light source. Indicates. Negative intensity 5202 indicates no absorption of the light source at a particular wavelength, depending on the material properties. In examining specific biophysical or material criteria, this data can be used to generate specific wavelengths for analysis.

As shown in FIG. 52, the change in the skin condition 158 may be determined using the spectral characteristics of a light source specifically selected based on a specific biophysical criterion. FIG. 52 compares PB (S-0) spectral signals illustrating the difference between tissues predicted positive / healthy and diseased tissues. In FIG. 52, for example, a change in the 462 nm-485 nm range (absorption or release in the spectral diagram) may correspond to a further change in tissue progression, tissue activity, or the presence of other molecules that indicate a change in skin condition. . By measuring these changes, it is possible to determine the health and ailing state of the skin or the disturbed state. Characteristics of healthy tissue based on the emission and absorption of light can be determined at a particular reference wavelength 5209 based on the selection of the light source. For example, the spectral signal of healthy skin 5201 using a particular light source shows little or no absorption or radiation in the spectral range 5205. This spectral diagram shows the normal spectral feature 5206 to the right of reference wavelength line 5203. In addition, the features of the 5207 region to the left of the reference wavelength line 5204 are indicative of diseased skin through reradiation or radiation characteristics 5211. On the other hand, area 5208 to the right of baseline 5204 exhibits absorption characteristics 5210. The 5207 region in the 462 nm-485 nm wavelength region indicates additional activity resulting from further changes in tissue progression, activity, or other molecules that indicate a change in skin condition. The size and shape of the peak (peak), the lowest point, the curvature, the frequency (frequency), the interval, the specific interval of the wavelength difference, etc. may also correspond to the concentration of the molecule, the stage of disease progression, skin characteristics, and the like.

In one embodiment, algorithm 150 may only use reflected polarized light for reasons of increased selectivity for certain biophysical or physical characteristics. Referring to FIG. 53, for example, the spectral signal 5302 of reflected polarized and / or radiated polarized light may be much more sensitive to biophysical features than a simple white light convolution 5301. It is a spectral signal for melanin cell damage. The spectral diagram representing the emission 5305 in the polarized 5302 spectral signal is much higher than the spectral diagram representing the emission 5303 in the unpolarized spectral signal 5301. Similarly, the spectral diagram representing the absorption 5308 in the polarized 5302 spectral signal is much deeper than the spectral diagram representing the absorption 5304 in the unpolarized 530 1 spectral signal.

In one embodiment, algorithm 150 may be used to analyze healthy and unhealthy or malignant skin. For example, FIG. 54 shows spectral signals for healthy and uncolored skin 5401, 5402, healthy and pigmented skin 5403, 5404, and malignant, pigmented skin 5404, 5406. For comparison, both spectral signal convolutions of polarized light (bottom) and white light (top) are shown. The spectral signals of healthy normal skin 5401 and 5402 have very little absorption or radiation compared to the light source spectrum around the reference wavelength of 485 nm. Similarly, healthy, benign pigmented skin 5403, 5404 has very little absorption or radiation on either side of the reference wavelength of 485 nm. However, malignant tissue clearly shows very large and varying absorption and radiation patterns of the peak and trough of the spectrum around the reference wavelength.

In embodiments, such spectroscopic techniques may be useful in a variety of analytical tests in which a photosensitive accessory is included in the test material.

In one embodiment, some elements of the waveform are tagged and tracked over time to track changes in material or sample characteristics (eg, peaks, troughs, curvatures, frequencies, intervals, specific portions of wavelength differences, etc.). Can be.

In one embodiment, algorithm 150 may be integrated into an automated measurement device as part of a device that performs surface analysis (eg, a skin imaging device or a metal testing device). In one embodiment, algorithm 150 may be included as part of a telemetry system having a surface imaging device that captures an image and sends it to a processing center for algorithmic electronic calculations.

In one embodiment, algorithm 150 may be used for analysis to determine the health of hair follicles, hair compositions, and the like.

In one embodiment, algorithm 150 may be used for counterfeit currency reading. For example, a unique signal can be generated for the nominee number and / or issue number.

In one embodiment, algorithm 150 may be used to analyze the action of arresting sweating. In some cases, the axillary odor may indicate a disease or other medical condition (eg, lymphoma, sweating on apocrine glands, hyperhidrosis, purulent cholangitis, other medical problems associated with sweating). Algorithm 150 may also be used to determine the degree of deodorant effect based on the activity and type of a particular glands of the individual. It is also possible to measure the activity of sweat glands in the armpits, feet, palms, etc. by the algorithm 150. By algorithmic analysis, it is possible to classify sweat glands and present products / components appropriate for the treatment. The algorithm 150 may determine the late action based on the effect on sweat gland activity.

In one embodiment, algorithm 150 may also be used for veterinary conditions, such as mad cow disease. For example, the disease may capture an image from the mucous membranes or skin of the bovine tongue or other lesions to detect the disease state using the algorithm 150. As described in the specification, the state of mad cow disease can be easily detected by acquiring images together with white light and ultraviolet light.

In one embodiment, the algorithm 150 may be used to monitor cosmetic problems after surgery (eg, enlargement or reduction of pregnancy lines, etc.).

In one embodiment, algorithm 150 may be used to predict and monitor lactation from the mammary gland of lactating mothers. If the analysis by the algorithm predicts that the yield of breast milk is low, it can suggest increasing breast milk yield.

In one embodiment, the algorithm 150 for determining the skin condition 158 is used to measure, track, and measure the skin condition 158, as well as the effects of the prescription 118, temporary and / or systematic treatments, avoidance procedures, feedings, and the like. Monitoring can be facilitated. For example, skin condition 158 can be measured at timed intervals, and current measurements can be compared with previous measurements to determine changes in skin health. As will be further described later, the results from algorithm 150 may be entered into the recommendation engine to provide feedback and changes to aspects of prescription 118.

In one embodiment, the algorithm 150 for determining the skin condition 158 may enable diagnosis. Diagnosis can be made early by distinguishing between important and non-significant indicators. For example, the algorithm 150 may distinguish between sunburned skin and third degree sunburn requiring medical attention. Using the imaging device 108 to capture the image allows the user to easily transmit the image to any practitioner for remote evaluation, to track the progress of the skin condition, and to transfer the image to the previous image, It allows for quick comparisons with user images or third party images (eg, images in skin database 115) and allows for immediate emotions without the need for historical knowledge. Historical data and modeling tool 132 results may be compared with images to aid analysis by one of algorithms 150, practitioners, or practitioners using the algorithms. In addition, user input in the form of audio, video, or textual narratives that describe a specific problem (eg, pain, fever, itching, etc.) in addition to the image may be useful for analyzing the image to determine a diagnosis. Algorithm 150 may enable nonlinear regression analysis, such as principle component analysis (PCA), which may be a biomedical analysis associated with spectrometric analysis to analyze medical and health conditions. Algorithm 150 may enable simple pattern analysis for diagnosis. The algorithm 150 may determine the heat conduction and the conduction state of skin damage. In one embodiment, since the change in collagen may represent a change from normal damage to dysplastic damage (but not porphyrin), the algorithm 150 may examine melanin cells by examining an image for the relationship between changes in collagen and porphyrin. Can diagnose damage. Skin condition 158 can be compared with an indicator table for various types of damage. In one embodiment, algorithm 150 may diagnose damage caused by ultraviolet light. Since damage caused by ultraviolet light may exist even in wrinkle-free skin, it may be difficult to assess the damage caused by ultraviolet light through conventional superficial observation. But an increase in melanin product; Total distribution, damage and number of superficial blood vessels; Change in hemoglobin number; Change in thickness of the epidermis; Damage to ultraviolet rays can be judged by inspecting the skin structure for changes in the amount of collagen, changes in the overall distribution, and the like. In one embodiment, the boundary of injury does not have to be addressed at diagnosis, since this may not be the key point in the final analysis of skin damage. In one embodiment, oral cancer may be diagnosed by algorithm 150.

In one embodiment, the algorithm 150 for determining the skin condition 158 may enable cosmetic manufacturing verification or skin clinic testing. For example, the skin condition 158 may be determined before the application of medical or non-medical skin care products or cosmetics, and over time a series of images may show the effects of medical and non-medical skin care products and cosmetics. May be required to track.

In one embodiment, there may be methods for storing, handling, integrating and analyzing skin condition 158. The skin condition 158 may be stored in the imaging device 108 itself, or may be stored in a PC, a central server, a beauty salon record, an electronic medical record, a medical repository, a beauty clinic studio database 115, a mobile device, or the like. Imaging device 108 communicates with user interface 102, online platform 120, mobile communication platform 124, and the like, uploading images, analysis 154, skin condition 158, data, tracking history, user profile, and the like. , Communicate, share and / or move. This will be further explained later. For example, a user may use an imaging device 108 implemented in a mobile device to capture an image of the skin and upload it to the mobile communication platform 124 to analyze the image 154 to determine the skin condition 158. can do. In response, the user may receive a personalized prescription 118 for sun protection given as the skin condition 158 of the user. Other factors that may be used to determine prescription 118 may be the current UV index, time of day, location, type of sun protection product the user prefers, and the like. In the same example, the user may have already obtained a determination of skin condition 158, in which case the user does not need to upload a new image. However, the mobile communication platform 124 may request a recommendation of the prescribed prescription 118 for the already determined and stored skin condition 158. Once the skin condition 158 is determined, it may be accessed by and / or formed integrally with any of the user interface 102, the online platform 120, the mobile communication platform 124. The user may choose to share the skin condition 158 as part of the practitioner record 180.

In one embodiment, the algorithm 150 for determining skin condition 158 may enable analysis of differences and similarities among peers of a user. Algorithm 150 may be used in terms of skin condition 158 or other criteria (e.g., behavior such as gender, age, race, smoking, outdoor work, eating, prescription 118, and any other identifying factors). Determine which classmates may resemble The algorithm 150 may interface with the online platform 120, third party database 115, or third party service provider 111 and access skin condition 158 and demographic information for comparison. For example, a user may want to know what foundation other women in their mid-30s of the same skin color are wearing. By using the algorithm 150, the user can determine his / her skin color, select peers according to the search criteria, and view details of the search results according to the prescription 118 or specific search term 103 for the peers. Can be. This algorithm 150 may grade the skin for a group that is cohort. Algorithm 150 may be used to compare a skin condition 158 of a user with a previously defined skin condition 158 to monitor skin condition 158 over time. The skin condition 158 of the user may also be compared with the skin condition 158 of another individual or group to identify a group of peers having the skin condition 158 closest to the user. Once a peer is identified, such as a similar individual or group, the system may display skin care products and / or skin care prescriptions that are effective for that peer. Similarly, the system may allow for comparisons between users (eg, at least one of age, gender, place of residence, climate, color, race, etc.). In one embodiment, when imaging device 108 captures data from the user and determines skin condition 158, the information is fed back to algorithm 150 to further improve peer identification and product recommendation processes. Can be.

In one embodiment, the algorithm 150 for determining the skin condition 158 may enable the prediction / simulation tool 132. Upon determining the skin condition 158, the algorithm 150 can simulate the progress of aging, simulate the effects of skin care treatment and skin care and cosmetic prescription 118 and simulate the progress of the skin condition. Referring to FIG. 6, a user can use the user interface 102 to access the simulation tool 132. In this example, full face images may be used, but it should be understood that the simulation tool 132 may simulate for any size region of interest. After selecting or capturing the initial image, the user can specify the type of simulation to be performed. For example, a user may want to perform only aging simulations, or may want to perform aging and treatment effect simulations. The simulation tool 132 may return data on overall appearance, wrinkle count, elasticity, radiance, moisture, product usage simulation, and the like. For example, a split image may be output in which half of the output screen has an original face and the other half has a newly simulated face.

In one embodiment, an algorithm 150 for determining skin condition 158 may enable skin cycle monitoring 140. By monitoring the skin at determined time intervals, skin conditions with periodic characteristics can be monitored, predicted, and acquired. For example, skin cycle monitor 140 may identify and monitor skin conditions associated with seasons, weather, pollen counts, hormone amounts, environmental conditions, and the like.

In one embodiment, algorithm 150 may be used to generate searchable and / or indexable tags associated with an image and may tag the image. The image may include a tag including information about the content of the image (eg, skin condition, skin condition, sex, race, age, prescription, treatment, etc.). This information may be collected by algorithmic analysis, user input, visual inspection of the image, and the like. Algorithm 150 may perform search 103 using these information associated with the image as a search item. In one embodiment, this information may be stored separately from or in conjunction with the image, such as an item included in the user profile. In one embodiment, a search 103 may be performed on information or images from other users or third party databases 115 to identify similarities or differences in the images or information. For example, a user may use this information to search for peers with similar skin conditions to see what is expected as the situation progresses. In another embodiment, a search 103 or query for product information 190, wellness information 192, skin care prescription 118, third party specialist 105, etc., for advice or recommendation from an expert. You can do For example, the user can use this information to retrieve product information 190 that represents the product effect on the user's skin condition. In one embodiment, the search 103 may be performed to know the availability of the product, the inventory of the product, the product price, and the like. For example, a user may use this information to search a sales catalog for a particular product that may be effective for the user. In this example, the user may be the owner of pale skin and may be interested in looking up an inventory of self-tanning products made specifically for pale skin. In one embodiment, the image itself may be used as the search query 103. For example, the image itself may be used to search the skin image database 115. In one embodiment, the images and information input to the system 104 may serve as a lever to develop a new algorithm 150 for improved diagnosis. For example, algorithm 150 may be developed for certain non-skin diseases (eg, rheumatoid arthritis) with dermal manifestations.

In one embodiment, algorithm 150 may be used to analyze product characteristics. For example, algorithm 150 may take a component of a product and apply it to the product so that the product has an excellent effect on a particular skin condition 158.

In one embodiment, algorithm 150 may use RGB color analysis. In determining the type of skin, this algorithm 150 may use standard RGB analysis and correlation with skin structures. By using a simple skin and beauty parameter classification routine, the parameters that determine the skin type can be quickly calculated and the skin type found in a very short time.

Exemplary embodiments of the present invention provide methods and systems for determining skin characteristics and cosmetic characteristics. The method and system provide minimal error and rapid skin analysis. The technique of the present invention is directed to a method and system for determining the skin type of an acquired data image within an RGB color system.

In a representative embodiment of the present invention, the method for determining skin characteristics and cosmetic characteristics using color analysis includes analyzing the color of the skin image for each pixel in the RGB color system with respect to the acquired digital image. Colors from the device-dependent RGB color system are converted to colors from the device-independent standard RGB color system (sRGB) for subsequent color analysis. Analyzing the color of the skin image pixel by pixel in the sRGB color system with respect to the acquired digital image includes generating a color table of the colors most frequently occurring in the image and analyzing an image of a part of the human skin. do.

In this embodiment of the present invention, the sRGB color system is used for image analysis. In determining other skin features (e.g. elasticity, melanin, oil concentration, etc.), melanoma, skin-related tumors and diseases, various color analysis systems (e.g., YIQ, YCbCr, L * a * b *, L * u * v * and HSL / HSV). Improvements to the algorithm 150 may include at least one of these color analysis schemes and a correlation between the sRGB color scheme and the color analysis scheme (s). This will ensure not only another embodiment of the present invention, but also the deep refinement and overall accuracy of current results. Apart from the problems associated with human skin, image analysis methods can also be applied to any object (animal, product, plant, or other material) that needs to be analyzed on a digital image.

The method of judging skin and cosmetic characteristics through color analysis includes converting a color acquired in a device-dependent RGB color system into a device-independent standard RGB color system (sRGB color system), and then performing RGB on an acquired digital image. And in response to analyzing the color of the skin image for each pixel in the color system, generating a sample of the most frequent sRGB color. For the acquired digital image, in response to analyzing the color of the image in the RGB color system, generating the sample of the most frequent sRGB color includes preserving a plurality of sRGB color values.

The method of judging skin characteristics and cosmetic characteristics through color analysis includes a standard green-blue three-primary color distribution having a Gaussian probability distribution as a prediction parameter (prediction value and standard deviation) on an sRGB color sample generated on an acquired digital image. Modeling, which further includes approximating the color on the generated sRGB color sample as a Gaussian standard distribution. According to an exemplary embodiment of the present invention, approximating the color on the generated sRGB color sample as a Gaussian standard distribution includes approximating the color on the generated sRGB color sample by overlapping a plurality of Gaussian standard distributions.

The method for determining skin characteristics and cosmetic characteristics through color analysis includes generating a corresponding skin type through a decision tree unit in response to the estimated distribution modeling parameter color. The type of skin is produced according to a modified Fitzpatrick classification or other applicable color classification. According to an exemplary embodiment of the present invention, the step of generating the type of skin according to the modified Fitzpatrick classification method comprises the generation of the type of skin according to a skin type grade having a grade from very white skin to very dark skin. .

According to a representative embodiment of the present invention, a system for determining skin type through photo analysis includes an accessory system (subsystem) for determining cosmetic characteristics of a human body and a part of an animal. Cosmetic properties include hair (hair), nails, and skin-related properties.

According to a representative embodiment of the present invention, an image sample of a human body may be captured by any digital camera. Digital image samples of the acquired human skin may be analyzed pixel by pixel in an RGB color system. You can convert a color from a device-dependent RGB color system to a device-independent standard RGB color system (sRGB color system) color, and then create an sRGB color table with the most frequent colors that appear in the image. According to an example, the generated color palette may include 256 most frequently appearing colors appearing in the image of the human skin. These color samples from the image can be approximated by a Gaussian normal distribution (or by superimposing several Gaussian normal distributions (after adjusting them to the same size)). Therefore, the estimated estimates (predicted using the weighted average) and the standard deviation (calculated using the unbiased (n-1) method because the exact predicted values are unknown / estimated) are calculated for each acquired digital image. Skin type is determined through a decision tree using estimated estimates and standard deviations. Fitzpatrick classification can be used to classify skin types according to skin type grades ranging from very white skin to very dark skin.

58 is a flow chart 5800 of a process for determining skin type of a digital image of a portion of human skin. When the process begins initially, it captures some images of the human skin (5810). Video capture can be performed with a digital camera or the like. Next, the acquired digital image is analyzed for each pixel in the RGB color system (5820). After converting the color of the device-dependent RGB color system to the color of the device-independent standard RGB color system (sRGB color system), a color table is created using quantization techniques for the colors most frequently appearing in the acquired digital image (5830). ). According to an exemplary embodiment of the present invention, multiple sRGB color values / samples generated within the range of 0-255 may be preserved for further analysis (5840). The range of these values has proven to be more convenient than the range between 0 and 1 when determining skin type. By simply dividing the color values by 255 (or vice versa), the conversion between them can be achieved. In the next steps 5850 and 5860, the estimated prediction value and the standard deviation are calculated, and finally, the decision tree is used to determine the skin type of the acquired digital image according to the modified Fitzpatrick classification method.

According to a representative embodiment of the present invention, in determining the skin type, the decision tree has an estimated prediction value and standard deviation calculated as a Fitzpatrick classification / display value. The effectiveness of this approach has been published in studies relating to parametric skin distribution modeling for skin segmentation / detection.

59 shows pixels of a digital image acquired from part of the human skin. An image of the skin sample is captured by irradiating white light. This image can be captured with a digital camera or the like while irradiating white light. An analyzer connected to the image capture device can analyze the digital image pixel by pixel within the RGB color system. Analyzing pixel-by-pixel digital images within the RGB color system is not limited to determining the skin type, but also other skin features (eg, elasticity, melanin, oil levels, etc.), melanoma, and other skin tumors / diseases. It may also be useful for other purposes, such as classification.

Digital images obtained from human skin samples are usually given in an RGB color system. The technique, which employs an algorithm 150 for determining skin type according to one form, relies on this color system, although device-independent because of its conversion to the sRGB color system. Calibration of image capture devices, such as digital cameras, must be done carefully to compensate for the final color deviation (offset). The color deviation correction in the present invention may be performed by any technique of the prior art, and the color deviation correction may also be performed by software in determining the skin type by the technique of the present invention.

Fig. 60 shows the pixels of the digital image acquired on part of the human skin after quantization. An image of a skin sample of a human body is captured by irradiating white light. This image can be captured with a digital camera or the like while irradiating white light. An analyzer connected to the image capture device analyzes the digital image pixel by pixel within the RGB color system. Analyzing pixel-by-pixel digital images within the RGB color system is not limited to determining the skin type, but may also affect other skin features (e.g., elasticity, melanin, oil levels, etc.), melanoma, and other skin tumors / diseases. It may be useful for other purposes, such as classification. Color quantization or color image quantization is a process of reducing the number of different colors used in an image. This is usually done to make the new image look as similar as possible to the original image. Color quantization is necessary when displaying an image with a large number of colors, in a display of a capacity capable of displaying only a limited number of colors, because of the problem of memory shortage, and color quantization is an efficient compression of such an image. To make it possible.

Image quantization can also be applied to captured images. Using a sampling device connected to the analyzer, it is possible to create a palette of 256 colors that most frequently appear in digital images acquired from parts of the human skin. Colors sampled from digital images can be preserved within the sRGB color system. According to an exemplary embodiment of the present invention, it is possible to preserve colors generated within the range of 0 to 255 of the sRGB color system. The range of these values has proven to be more convenient than the range between 0 and 1 when determining skin type.

Thus, the colors on the sample can be approximated by a Gaussian normal distribution (or by overlapping some Gaussian normal distributions (after adjusting them to be the same size)). This can be done via an approximation device connected to the sampling device. In addition, predicted estimates (predicted using weighted averages) and standard deviations (calculated using the unbiased (n-1) method because the exact predicted values are unknown / estimated) are calculated for each acquired digital image. .

The use of the algorithm 150 of the present invention is shown in FIGS. 61 and 62 and the algorithm 150 for RGB color analysis is shown in FIG.

FIG. 61 shows a histogram / distribution diagram of standard RGB color for one of the photographs of patients whose skin type is classified as Type III by Fitzpatrick classification, with Gaussian normal approximation / hull. Corresponding estimates are, for example, μ _R (red predicted value) = 171.1304 and μ _B (blue predicted value) = 135.3047. These estimates are compared to the decision tree described below to determine the skin type. The type of skin is determined according to the modified Fitzpatrick classification. To determine the skin type, the Fitzpatrick Skin Input Test Questionnaire (skin type grade), from very white skin (skin type I) to very dark skin (skin type VI), is often used.

 Dermatologists use the Fitzpatrick classification scale to classify humans' sensitivity to face and sunlight. According to a representative embodiment of the present invention, the skin types on the Fitzpatrick classification criteria are as follows.

Type I-very white or freckled skin, very well sunburn (the very white skin here is often seen in people with red hair or blond blue eyes)

Type II-white skin, sunburn (white skin is often seen in people with red or blond hair, blue eyes, green eyes and brown eyes)

Type III-white or olive tones, occasional sunburn (white skin here is seen in people with all hair color or colored eyes)

Type IV-brown skin, poorly sunburned (common to people of Mediterranean pedigree)

Type V-dark brown skin, rarely burns in the sun (common to people in the Middle East)

Type VI-black skin, no burning at all

The skin image is captured by an image capture device such as a digital camera, a video camera, etc. while irradiating white light. The analyzer analyzes a portion / sample of the skin pixel by pixel. The sampling device connected to the analyzer produces a color palette of 256 colors that most often appears in the captured image. Color samples obtained from digital images are preserved in the sRGB color system. The generated color samples are preserved in the range of 0 to 255 in the sRGB color system. The approximation device connected to the sampling device calculates the predictive estimate (predicted using the weighted average) and the standard deviation (calculated using the unbiased (n-1) method because the exact predicted value is unknown / estimated). Can be calculated for. The skin type is determined by a decision tree connected to the approximation device. This imaging provides an estimate of R and B that may be sufficient to determine the skin type according to the decision tree below. Hereinafter, exemplary embodiments of the present invention will be described.

값은 프로그램된 신경망을 이용해 분석한 영상으로부터 결정된 것이다.

Values are determined from images analyzed using programmed neural networks.

FIG. 62 shows a histogram / distribution diagram of RGB color for one of the photographs of patients classified as type VI by Fitzpatrick classification, with Gaussian normal approximation / half. Corresponding estimates are, for example, μ _R (red predicted value) = 189.7173 and μ _B (blue predicted value) = 103.537. These estimates are compared with the decision tree described above to determine the skin type.

FIG. 63 is a process flow diagram 6300 of an algorithm 150 for determining skin type according to mathematical prediction estimates for standard R and B colors of the sRGB color system. This flowchart captures a picture of a portion of the human skin with a digital camera or the like while illuminating the white light at block 6310. In block 6320, the captured digital image is analyzed pixel by pixel within an RGB color system. At block 6330, a quantization technique is used to analyze the captured image pixel by pixel within the sRGB color system. The color samples obtained from the image can be approximated by a Gaussian normal distribution (or by superimposing several Gaussian normal distributions (after adjusting them to the same size)). Therefore, the estimated estimates (predicted using the weighted average) and the standard deviation (calculated using the unbiased (n-1) method because the exact predicted values are unknown / estimated) are calculated for each acquired digital image. In block 6330, the type of skin is determined by the decision tree.

As will be appreciated by those skilled in the art, various advantages are provided by the various embodiments of the present invention. First, the present invention enables skin type determination with conventional low cost digital photography equipment under standard environmental conditions. Second, the analysis performed on the captured digital image makes it useful to recommend cosmetic products and to use them for medical or surgical purposes. Third, the photo quantization algorithm and the calculation of the estimated predictions and standard deviations are fast, making it easy to determine the skin type in a short time using a simple program routine. Fourth, the analysis method performed in the present invention can be usefully used for classification of other skin features (eg, elasticity, melanin, oil concentration, etc.), melanoma, skin tumors or skin diseases.

In one embodiment, the development of new algorithms 150 by practitioners, users, service providers 111, etc. may be enabled by software development kits, which allow anyone to use the new algorithm 150 for imaging device 108. It can be utilized to develop API 154.

Referring now to FIG. 3, in one embodiment, the processes of collecting images, conducting skin analysis, communicating search results, and planning follow-up (if necessary) are performed by an imaging device ( 108), you can start by capturing the image. The user may also answer questions or provide additional details about the image, cosmetic prescription, region of interest, and the like entered by the user. The data may be transmitted to the computer for analyst 304 or analysis 154 using user interface 102 via any communication scheme (eg, network, internet, wireless, etc.). In certain embodiments, when data is collected or transmitted, the user may access the charging device 302. In the example shown, the insurance company may access the data, but the payment may be made by any interested party (eg, a lump sum by the user, a user's subscription, a third party service provider 111, the platform 120, 124, May be made or requested by practitioners). The input data can be analyzed by the analyst, in real time by the software, by the analyst using the software as an aid, and the like. The initial analysis may be to determine data integrity. If the data does not pass the integrity test, this data can be passed back to the user. At the time of appraisal, the analyst may be assisted by software using algorithms to determine the situation and / or the type of recommended management / action. Historical analysis and data, and modeling tools can be used to assist analysts' emotions. Relevant parties (particularly company employees, payment providers, physicians, medical staff, users) may receive details of the user and / or analysis of necessary follow-up or other actions. The analysis 154 may be submitted to the practitioner for storage 308 and / or approval 310 by the system. In one embodiment, practitioner approval 310 may be required upon storage 308. At the severe test 312, an appropriate communication scheme with the user may be selected. If the result of this test 312 is affirmative, the user can be immediately notified in the desired communication manner, such as by telephone, instant message, or the like. Even if the result of this test 312 is negative, the user may be similarly informed, but may take a rather slow communication method such as email or mail. In any case, the software tool may recommend appropriate communication methods and media based on the content of the emotions, and may include information / messages to be delivered in a preset template. In addition, the notification by any means may further include a notification of the availability of the practitioner. Analysis 154 may initiate practitioner availability / scheduling tools. For example, prior to sending the results of the harsh test 312 to the user, the availability of the practitioner can be assessed and transmitted simultaneously. The user can access availability and scheduling tools to confirm the appointment time.

In one embodiment, the user interface 102 for the skin analysis system 104 is interfaced with the imaging device 108 to store images, to deploy algorithms 150, from any number of regions of interest. The ability to track skin condition 158 by tracking images (i.e., the time interval between image capture and the next image capture date), the ability to send search results to practitioners, simulation tools 132, skin type determination tools ( 130), the skin cycle monitor 140, a function of the practitioner's availability / scheduling tools and the like.

In one embodiment, the user interface 102 may operate as an application running on an imaging platform 108, a computer, a server, a kiosk, or the like, an online platform 120, a mobile communication platform 124, or the like. Any and all aspects of the user interface 102 described herein may apply to the user interface 102 running in any environment.

In one embodiment, as will be described in more detail later, the user interface 102 for an imaging device may be implemented as a keypad or a series of buttons, switches, keys, etc. disposed on the imaging device 108, or the like. 108, or may be formed outside the imaging device 108, such as software running on a computer, the Internet, an intranet, a mobile communication device, an online platform 102, a mobile communication platform 124, or the like. Can be. The user interface 102 may be configured with settings of the imaging device 108 (e.g., magnification, light source, amount of light, light wavelength, angle of light, electrical magnetic properties of the light, positioning of the sensor, image capture period, image size, data storage, data transmission). Etc.).

Referring now to FIG. 5, the user interface 102 can construct and index captured images by date, region of interest, and skin condition. For example, as shown in FIG. 5, four images captured from the same region of interest are indexed by number in a series of images. However, the present invention is not limited thereto. In one embodiment, the user interface 102 may not only show the imaged skin region in real time, but also include the image captured or submitted by the user in the user interface 102. The user interface 102 may track the first image, the last image, the next image, and the like. The user interface 102 allows the user to view the images and use the images as a basis for the simulation 132 as described in the specification. The user interface 102 can be used to set up a dunning function to capture the next image. User interface 102 may be used to generate an image and skin condition 158 report. User interface 102 may be used to convey this report to the practitioner. In one embodiment, the user interface 102 can be used to initiate a skin type test. In one embodiment, the user interface 102 may show a body photo of the human body. For example, the user may link the image to the body part such that the image related to the specific body part may be popped up or accessed by interacting with the body picture through the display device. User interface 102 may be configured to collect data from a user in response to a prompt. The user interface 102 can include an algorithm 150 that checks the integrity of the captured image. User interface 102 may capture an image and guide user input associated with the image.

In one embodiment, user interface 102 may interface with host hardware 108 or third-party hardware 109. The hardware 108, 109 is connected to the computer, the online platform 120, the mobile platform 124, etc. via the user interface 102 to allow the user to measure various parameters regarding skin health, situation and type. And an imaging device. The hardware devices 108, 109 may be independent imaging devices or may be connected to or implemented within a medical or non-medical electronic computing device. The user interface 102 may guide the connection process of the hardware imaging devices 108 and 109. Imaging devices 108 and 109 store the generated images, reports and recommendations and may include a repository of images, all of which may be part of skin health record 121. This may allow for systematic storage of the skin health record 121. Third party hardware 109 may include devices such as moisture sensors, cosmetic analyzers, dermascopes, cameras, x-ray machines, MRIs, medical record providers and software, web cameras, communication devices, and the like. Third party hardware 109 may be coupled to system 104 to allow a user to continue to obtain better analysis or to share data with other professionals or users.

In one embodiment, the user interface 102 may enable type determination 130. Features may be captured to determine features of the user's skin and skin condition 158. In addition to imaging and skin health data, a wide range of genetic parameters (e.g. race, color, location, environmental factors (such as pollen count, weather, etc.) and lifestyle factors) can be used to determine the skin condition 158 of a user. Can be collected. Skin condition 158 correlates with product usage ratings and grades 138 to enable recommendation of products with the best effect.

User interface 102 may display prescription 118. This prescription 118 may be used to share product experiences through personal skin care emotions 160 and / or type judgments 130 and grades and ratings 138 made by hardware or community and / or the effectiveness and experience of the product (e.g., , Smell, taste, feel, touch, color, etc.) can enable the user to learn what product and how to use the product optimally on the user's skin. Prescription 118 may be a dynamic recommendation based on inputs collected and input by a user as well as expert input on a product that will best suit the user's personal needs.

In one embodiment, the user interface 102 may enable the simulation tool 132. The user can upload an image, model various skin parameters (moisture content in the skin, collagen amount, age, etc.) and observe the change in the image. Additionally, the user can model the effects of various products and prescriptions 118 (skin care, beauty, medical care, nail care, hair care, etc.) on the image. The simulation tool 132 may allow a user to view the whole image or to view a split image for comparing the current image and the modeled change image by half. The user's image may be automatically or manually optimized for the best appearance, and a product or prescription 118 may be provided to obtain the appearance. Simulation tool 132 allows consumers to model skin features or conditions 158 of other selected or non-users, such as celebrities, leaders, ordinary users, and the like.

In one embodiment, the user interface 102 may generate a daily report 134. The daily report 134 may be a report that provides the most relevant and highly optimized user information based on the skin condition 158 of the user. The daily report 134 may enumerate skin care regimens 118 to be based on environmental and lifestyle factors related to the user, display new product information 190, and display current skin care shelves. Changes in 114 and grade 138 or grade 138 and the user's or expert's 105 response to the product most relevant to the user (feedback), and so forth. Daily reports (134) are valuable for clinic trials and follow-ups, new product launches and ignitions, events, factors that affect the skin (e.g. weather forecasts, UV index, temperature, pollen count, etc.) May contain information about the data. The daily report 134 may report whether the product is close to expiration date or may request replenishment based on the recommended usage protocol. The daily report 134 may be provided to the user by the user interface 102, document, email, SMS, RSS, video or other communication medium.

In one embodiment, the user interface 102 may enable the wish list 134. The desired item list 134 may have a function of allowing a user to select a product and add it to the skin care shelf 114. This function may be accomplished using a drag and drop function or other selection means, such as in other ways in which users can surf the web or access product information 190. A user can share this functionality with other users, friends or family members so that others can view this wish list 134. Other users may also select a product from the wish list 134 and purchase and send the product to the user.

In one embodiment, the user interface 102 may enable ratings and ratings 138. Ratings and ratings 138 may be performed on various product features as well as various raters and rankers. Product experience may be collected from the user in the form of simple ratings and ratings 138, as well as textual comment data to be stored in the database. This rating and rating 138 may be performed in real time, and may be similar users or peers (e.g., users with one of the same characteristics, such as same age, same sex, same skin type, same race, area, moisture content, etc.). It may be synthesized to show the most relevant to the user based on the. Such ratings and ratings 138 may be dynamically scored and scored. Users may be shown one of the ratings 138 and the percentage value of ratings 138 reflecting the total number and / or weight of raters / scorers. The rating and rating 138 may include one of features such as subjective effect, odor, touch, feel, feel, product absorbency, product debris, ease of use, and the like. Users can also upload their own images and get ratings / ratings 138 for different product recommendations from other users or experts 105. For example, a user may upload data and / or images and inquire about ratings and advice on better products from herbalists in India, aging professionals in Japan, and the like. Users who provide ratings and ratings 138 for various products may themselves receive rating points from other users. This can help you choose the most effective and neutral user and help you find a competent professional 105. A small number of high scored users may be given exclusive writing / publishing and rating / rating privileges.

In one embodiment, user interface 102 may enable skin cycle monitor 140. Skin cycle monitor 140 may indicate when the last image is collected and count down to the next scan based on a time interval (eg, the time required for skin to recover or any other time interval). Currently, the skin is believed to restore itself every 28 days. Skin cycle monitor 140 may consider age, environmental changes, and other factors to indicate future scan schedules.

In one embodiment, the user interface 102 may include a wellness / health module 142. The user interface 102 collects lifestyle data and relates to lifestyle (eg, sleep, rest, exercise, etc.) and health (eg, vitamins, food, product use, etc.) based on the skin condition 158 and characteristics of the user. You can provide recommendations. The health module 142 allows a user to obtain a personalized health schedule and prescription 118.

In one embodiment, the user interface 102 may include game 148 functionality. The user can play the game 148, which allows the user to model a variety of products, take advantage of features such as try different hairstyles, model different hairstyles and clothing, and the like. Can be. Users can interact with other users or computers to make product selection a fun process. This process may be used to gather information about the user's preferences and appearance.

In one embodiment, the user interface 102 may include a gift guide 144. Based on the skin condition 158 of the user, advice regarding this user's gift may be provided to other users in the network.

In one embodiment, the user interface 102 may be implemented to be navigated by a touch screen. The touchscreen system may allow the user to obtain a visual appearance and to navigate various parts of the user interface 102. For example, the simulation tool 132 may function as a navigator, a photo orientation change, and a drag and drop. Touchscreen navigation can be particularly helpful when the hardware imaging device 108 is connected to an electronic computing platform. The user interface 102 collects and coordinates information from other devices 109 and / or emotions (eg, skin observations, blood reports, biopsy reports, etc.) to provide additional information to the skin record 121. Can be.

In one embodiment, the user interface 102 enables a purchase / sample portal. The user interface 102 may include a purchase / sample portal that allows a user to select a product to complete a purchase process or request a sample delivery to a pre-entered address. This portal is used on various social network platforms 188 and various electronic computing platforms (e.g., online platform 120, mobile communication platform 124, computers, laptops, mobile phones, other mobile communication devices, medical devices, etc.). It is possible.

In one embodiment, the user interface 102 may include scheduling and data sharing functions. A user may schedule a meeting online with a particular professional or practitioner, and may share part or all of the skin condition 158 or skin record 121 and the history with the expert or practitioner, if desired. To assist in this selection and scheduling process, the ratings, availability and other criteria of experts or practitioners may be displayed to the user. Experts can also share specific data among themselves (eg between physicians, between physicians and spa practitioners, spa practitioners, etc.).

Other input 112 (eg, device) to augment data submitted by the user or as key data to obtain personalized feelings about the user's appearance, beauty, or medical interest related to skin, hair, nails, and the like. , Features and data). For example, certain devices may be usable as commercially available, purchased, and owned.

In one embodiment, wearable monitor 182 may be used as input 112 to system 104 and user interface 102. Wearable skin health monitor 182 allows tracking of environmental and skin health changes in real time. These devices may be worn directly on the body or attached to the user's clothes, clothing and / or ornaments. One example is a user with a device that monitors the amount of ultraviolet light and alerts when the level of sunlight protection imparted by the product the user is using falls below a set target level. These wearable monitors 182 may have independent user interfaces 102 or may be programmed as personal parameters using other input devices. The wearable monitor 182 may capture various physical parameters such as heart rate, blood pressure, exercise, water consumption, obesity, calorimeters, and the like. The monitor 182 can also monitor hydration levels.

In one embodiment, social network 188 may be included as input 112 to system 104 and user interface 102. The beauty-related social network 188 is made to communicate personally and socially, and may be formed by gathering users who want to know and share the beauty or medical field. The intent of creating a cosmetology social network 188 is that a user can invite and link other users to discuss cosmetology and medical care, obtain information 190, 192, product, prescription, specialists, practitioners, and other evaluators / Rate and review scorers, reviewers, make purchases, access wishlists (119), access gift guides (144), play games (148), and report daily (134) You can do activities such as reading). All of these activities can be done as users share their experiences with other users in the beauty social network.

In one embodiment, product information 190 may be included as input 112 to system 104 and user interface 102. The database of product information 190 includes product, name, claims, manufacturer information, ratings and ratings (138), packaging information, images, usage parameters, product development history or forecasts, special handling, upcoming changes, safety information, and effect information. , Odor, taste, color, texture, price, place of manufacture, brand information, consumer opinions and experiences, and best suited to your personal preferences or circumstances in order to obtain the best cosmetic or medical results for your skin, hair, and nails. You can include other variables that can help you choose a product. In addition to information on liposuction, botox treatment, laser hair removal, cosmetic and / or medical procedures related to improving the appearance of the user and improving or maintaining the skin condition 158, service related products (eg, massages, etc.) , Face, pigmentation, etc.) can be captured. The manufacturer may register product information 190 and may provide information about procedures, products in production, products under clinic testing, and the like. A user may rate and grade a product (rating and rating 138.) The database update utility may update the database with new product information 190, store inventory, and the like.

In one embodiment, wellness information 192 may be included as input 112 to system 104 and user interface 102. Health, such as the effects of various products, including, but not limited to, over-the-counter medicines, supplements that support or maintain health, wellness, and other consumable products (e.g., vitamins, protein shakes, supplements, etc.) wellness) information 192 may be captured. In addition, information about lifestyle recommendations (e.g., sleep, rest, eating, and exercise recommendations for a specific age group / race, etc.) is collected and correlated with user preferences and features, resulting in overall health, wellness and beauty / Makeup can provide optimally personalized solutions and services.

In one embodiment, as input 112 to system 104 and user interface 102, plug-in web capture 194 may be included. The software component, a plug-in for Internet web browsers and baskets (or repositories), recognizes graphical objects in any web page and allows the user to view pages of the web browser (eg, the skin care shelf 114). You can select and drag (drag and drop) a graphic object in a basket or repository in). The graphical object may be recognized either as part of the plug-in module 194 or as part of a resident program on the electronic computing platform, via remote reference or through a standard reference table that will reside on the user's PC. Graphical objects may include images of commercial products (eg, skin care products or creams, or other objects that form part of any e-commerce site). Once recognized, the plug-in 194 may highlight the picture (picture) and may notify the user that it has been recognized or provide additional information or reference. The plug-in 194 may also recognize brand names, transaction names, generic drug names, brand names, and the like.

In one embodiment, barcode input 198 may be included as input 112 to system 104 and user interface 102. The bar code information displayed on various products may be tracked, identified, priced and other product information (190) to identify similar substitutes or other similar product information, usage recommendations, other users' experiences, price and shipping information among other related data. Can be captured to assist in correlation with The barcode scanner 198 may be part of a handheld imaging device 108, a standalone system, a manual input mechanism, or the like.

In one embodiment, as input 112 to system 104 and user interface 102, conventional information / question paper 101 may be included. Information 101 about users and products can be captured via dynamic and static questions. Experience with other products according to variables such as age, sex, location, personal lifestyle features, smoking habits, sleep patterns, dry / oily and water content of the skin, dissatisfaction with the product, odor, taste, absorption, and color tendency Information may be interestingly captured using Q & A, game and service products, system 104, or other conversational tools interspersed in various aspects of the user interacting with user interface 102. Information 101 may be captured directly from the user, or via an intermediate medium, or automatically augmented through computer data collection as an output of algorithm 150 or based on expert sentiment. Information 101 can be obtained through on-the-fly techniques and adaptive questions in quiz, twenty-four format. The question to get the information 101 is: How long do you go shopping every time? When do you go shopping for cosmetics? Where do you usually go? Why do you go there? Who do you shop with? Why? What do you ask your friend when you ask, where do you go to get new products / latest information on your cosmetics, when do you go to the department store or when you buy online ?, when do you want to know something from your friend immediately? What to do, how to choose a mobile phone, how to use the menus on your phone, and when to buy a new phone? And so on.

In one embodiment, third party expert 105 may be included as input 112 to system 104 and user interface 102. System 104 includes practitioners, physicians, healthcare professionals, beauticians, schedulers, product ingredient specialists, cosmetologists, herbalists, ayurvedic and homeopathic specialists, health, wellness specialists, media Connect professionals, photo quality experts, and more with you and others. The user may ask questions through this system to experts 105 who may be in different geographical locations for personal advice. Expert 105 may be provided with collected user data and features, and expert emotions may be preserved in record 121. Recommendations provided by the expert may be provided to the user through a purchase / sample request or the like. Experts can flag specific issues or datasets within the expert community or for discussion or consultation with users.

In one embodiment, third party hardware 109 may be included as input 112 to system 104 and user interface 102. The system may be connected to various third party hardware 109 such as conventional imaging methods, camera devices, computers, lighting systems, sports devices (eg, pedometers), and the like.

In one embodiment, third party service provider 111 may be included as input 112 to system 104 and user interface 102. The third party service provider 111 may be integrated into the system 104 to allow a user to select an optimal personalized product or service for hair, skin, nails, etc. for medical or cosmetic / beauty use. Third-party service providers 111 include hospitals, physicians, spas, beauty salons, beauticians, cosmetologists, cosmetic shelves, pharmacies, cosmetics dealerships and websites, rating and rating services, product information databases, test organizations, magazines and information. It may include providers, insurance companies, social networking sites, health services, picture quality improvement services, and the like. For example, based on skin concerns, a scheduling system for physicians may be integrated to provide the user with scheduling options online, while connecting with the insurer to verify the coverage of the user. In addition, to facilitate and facilitate the user's selection process, prior assessment of skin conditions, the availability of historical medical and / or cosmetic products made through shelves or by medication, and / or recommended services are captured. can do.

Referring to FIG. 7, a system that provides recommendations for skin care based on skin condition 158, skin care goals, and environmental factors affecting the skin may include the ability to obtain an individual's skin condition 158; And the ability to classify individuals by skin condition 158 and to recommend products and prescriptions that may be effective in achieving skin care goals. The system may be computer based, internet based, network based, or the like. The system can be community driven with skin-related services. In one embodiment, the recommendation may be based on distinguishing other users with similar skin conditions and determining which products or prescriptions are effective for those users. In one embodiment, the recommendation may be made based on product information 190, wellness information 192, third party database 115, expert 105, service provider 111, and the like. As shown in FIG. 7, the user may acquire an initial image and perform analysis on a specific endpoint (in this case, moisture). The system can automatically recommend specific products based on the moisture content that may be effective for a given moisture content, skin condition 158, and the like. The system may also depict skin conditions 158 based on various skin care regimens 118 (eg, maximum care, normal care or poor care). In one embodiment, these images may be captured using imaging device 108 or third party hardware 109. Images can be captured using any image capture device or technique using unpolarized light, polarized light, monochromatic light, diffused light, white light, single wavelength multiple light, and the like. Any captured image can be used to obtain skin condition 158.

An embodiment of the skin care recommendation page of the skin care system may include a report on a product currently being used by the user, a user's input to obtain the skin condition 158, a request for recommendation, and the like. Reports on the products the user is currently using may include a rating or rating 138. For example, when a user accesses the user interface 102, the user accesses the adaptive questionnaire to the user's current prescription 118, the current product or treatment, or the past product or prescription ( 118) experiences can be answered. For example, how effective are the users, how is the fragrance, how much they absorb, what causes the rash, how does it feel, and what do you think the product is worth? You may be asked. Of course, there is no need to ask questions about ratings and ratings in the form of questions, but it can be done simply in a story form, in a non-question form, and in a drop-down menu. To obtain skin condition 158, a user may enter data in the form of gender, age, race, location, skin color, environmental factors, and the like. In one embodiment, to determine the skin condition 158, an image acquired from the imaging device 108 or third party hardware 109 may be analyzed 154. Based on the skin condition 158 derived from user input, image analysis, or a combination thereof, the user may have a database (health 192, prescription 118, specialist 105, service provider 111 and product information ( And 190) determine which products and prescriptions 118 may work best for their skin condition 158. Here, the information may include product components, product claims, product instructions, product organization, product usage, product grades and ratings (138), and the like. By including ratings and ratings 138, community-led recommendations can be made for skin-related products that have been adjusted for age, skin color, location, race, environmental factors, and the like. In one embodiment, the user may have a skin target (eg, moisture, protection, cleansing, color tone, beauty, anti aging, anti wrinkle, skin tightening, deep cleansing, pore reduction, rosacea treatment, skin exfoliation, skin brightening, Features such as sunburn, sun protection, self-tanning, acne treatment, acne removal, glow improvement, skin refreshment, spot treatment, crow's feet treatment, hair removal, wound treatment, etc. A recommendation request can be executed. In one embodiment, the skin target may be automatically selected by the system 104. Automatic selection may be performed based on aspects of skin condition 158. For example, if the analysis 154 indicates that the result is severe dryness, the system may recommend a moisturizing product that applies to severe dry skin. Alternatively, the system may recommend ingredients that can be found in the product. The user may purchase the product directly from the recommendation page by putting the product in the electronic shopping cart 113, or may go to another site for purchase. In one embodiment, the user may put the product in the wish list 119 for later purchase. In one embodiment, a user may add product to skin care shelf 114 by usage plan (eg, morning, afternoon, night, etc.) and by intent (eg, work, entertainment, etc.). This skin care shelf 114 may be interfaced to or depict the prescription 118, allowing the user to present their product and prescription 118 in a logical manner based on the user's specific skin characteristics 130. To be configured. The cosmetic shelf 114 may include a number of screens displaying recommendations by various people (eg, physicians, dermatologists, beauticians, spa specialists, entire users, professionals, people most similar to the user, etc.). The cosmetic shelf 114 may place the product in a personal manner. In addition to automatically collected recommendations, users can drag and drop products (or select and add products) as they would when searching for new products while surfing the web. Such functionality may include programs that can highlight products of interest while surfing the web. Cosmetic shelf 114 may be an application that can be installed independently on social networking sites and other personal homepages and / or toolbars. The cosmetic shelf 114 may also display the purchase date, purchase history, purchase expiration date notice, and other usage updates. Purchases made outside of the website may be automatically added to the user's beauty shelf 114, which may otherwise be entered manually by the user at the time of offline purchase.

In one embodiment, a user can get a sample of recommended or unrecommended products directly from the recommendation page. The shopping cart 113 may be a function integrated in the skin care shelf 114. The user can use a personalized recommendation and select the product for purchase or for sample delivery. The user may be queried for personal information such as address, delivery method, credit card number, etc., which information may be maintained by the shopping cart 113. The shopping cart 113 may be an independent program, such as the skin care shelf 114. That is, it may reside in a toolbar as part of the user interface 102 or as a program on a web page. Thus, the product may be highlighted and dragged into the shopping cart 113 for future purchase. Dragging and dropping a product into the shopping cart 113 may also initiate a query through the database and through various websites about the lowest price, location, availability, consumer experience, rating and rating of the product.

9 shows a product rating page of the skin care system. In order to receive a recommendation, users may be asked about their experiences with their medical, non-medical, cosmetic and skin care products. This allows you to scale your data collection inexpensively. For example, a user can define a product and provide for an effect assessment, a rating and rating 138 for the product, daily information, usage information, and the like. Such information may be stored in the health 192, prescription 118, and product information 190 databases to aid future recommendations. In one embodiment, the user's response to the product usage experience may be shared automatically with friends and / or other users or by request.

In FIG. 10, the user interface 102 homepage 1000 of the skin care system 104 is shown. The user may be required to enter demographic information such as name, gender, age, occupation, ID, address, phone number, email address, billing information, newly associated user, etc., which may be stored in a user profile or may include skin records ( 121). The home page may show a skin record 121 or display a list of imaged areas, imaging dates, and analysis status. Once the work is completed in the skin history / record 121, an icon may be displayed near the Status. The user may start a new skin health test or submit a new skin problem from the homepage 1000. The user may deliver the results of the analysis 154 to interested parties, and may ask the expert questions about skin aspects, skin history / record 121, image analysis, and the like, and view payment information and history.

11 shows the welcome page 1100 of the skin health test. The welcome page may output information on the skin health test about which endpoint to test (e.g., elasticity, wrinkles / fine lines, sun damage, flushing / gloss, etc.). The skin health test analysis allows the system to provide personalized emotional results of the user's skin prescription 118. The user may begin the skin health test from the welcome page 1100.

12, a question page 1200 of the skin care system is shown. The questions in this question can capture a relevant skin history that can be useful for subsequent image analysis. The questions can be asked in a multi-choice or unlimited way. For example, in response to the question 'Where do you use the product?' You can answer it with your face, hands, neck, legs, or upper body. For another question, take 'Why use this product?', For example, the answer might be to protect the skin, treat the skin, moisturize, or other skin care goals. The question 'Why are you trying to use this product?' Can be answered with skin care goals such as reducing wrinkles / fine lines, promoting radiance / gloss, and increasing softness / elasticity. "How long have you used the product?", "How often do you use this product?", "When do you use it?" And the like, and the response may include the mentioned time interval. Other gathering information may include how much you like notifications, where you purchased your products, and whether you use them seasonally. From question page 1200, the user can begin a skin care test.

13 illustrates a skin image capture page 1300 of a skin care system. In this example, the user interface 102 can access the imaging device 108 to capture the image. However, it should be understood that other devices 109 may also be conveniently used in this system. This page 1300 can show the area being imaged in real time. The user can use the positioning tool to take an accurate image that matches the previously imaged area. Once the image is captured and submitted, the algorithm 150 can verify the integrity of the image. If an image suitable for analysis is captured, the user may proceed to the analysis page 1400.

In Fig. 14, the results page of the skin care system is shown in a bar graph. As described above, the algorithm 150 may analyze the image and provide measurement results such as wrinkles, elasticity, gloss, firmness, tightness, and the like. In one embodiment, these measurements may be quantitative measurements. The first analysis can be done on the baseline for tracking. At each measurement, the user is compared to the baseline for his age, skin condition, gender, race, or other category. For example, the first bar in each graph displays the measurements for the user, and the second bar displays the average baseline for people of the same age. In this case, it is clear that this user is better than average. These results can be coded by color to facilitate interpretation. The result page 1400 may include a description of each measurement value. The user can request more information for hints and tips on why a particular condition is the cause and how to improve skin condition. The user may be instructed when to rescan the area, which product to use, which prescription 118 to adopt, and the like. The desired improvement may be related to the ingredient and recommend the product that is most effective for the user's skin. The user can access and / or edit the skin record 121 where information about the user, images, images by date, information derived from the images, recommendations, products, prescriptions 118, and the like are recorded. The user can access the reporting device to get the report.

In Fig. 15, the results page of the skin care system with trend analysis is shown. Methods to track the effectiveness of skin care products or prescriptions include obtaining baseline skin health feelings; Recommending a monitoring interval based on at least one of a skin care goal, a product, and a prescription; Obtaining a second skin health feeling; Comparing a second feeling to a baseline feeling to track progress toward skin care goals; And as an optional step (optional), may include optimizing the prescription 118 or product to improve skin health feelings. When subsequent images are acquired and submitted to the system 104, trend analysis may be performed. Subsequent images can be used to track the effectiveness of the product and / or prescription 118 and ultimately advise and optimize the user about the skin prescription 118, product and / or situation. Trend analysis 1502 can be used to know the intermediate skin condition 158 while receiving prescription 118. This trend analysis 1502 can show baseline readings, mean readings for healthy skin of others in the user's age, and individual measurements for each skin condition type. Progress can be seen over time. Images may be captured over time (eg, over a 28-day skin cycle, over treatment times, seasonally, periodically, for a year, etc.) to track the progress of skin condition 158.

The data may be displayed as a photo, a graphic screen, a trend display screen, a numerical screen, a text screen, or the like on which the data is displayed. Progress may be categorized by interest / skin care goals that the user may have indicated at the start of the test. The user can hear when to capture the next image, know how long to continue the prescription 118, how to modify the prescription 118, reaffirm the effectiveness of the product or the prescription 118, and useful tips. You can get information. The user can also view / view and edit skin record 121. The user may view a past image and perform a simulation 132 which is performed in the future. The user can access the reporting device to get the report.

In Fig. 14, a summary screen of the skin care system is shown. Advise on a full analysis over a period of time, that is, current measurements, progress towards reaching a skin care target, product appraisal, emotion of prescription 118, continuation, modification, or termination of prescription 118 or product use. Etc. may be displayed. The user can view the step-by-step analysis or get the full report. At certain intervals (eg, at the end of the recommended prescription 118), the report may indicate how the user's skin condition 158 has changed over time, whether the user's skin is healthier than when the prescription 118 was started, It may also include information such as whether the prescription 118 has achieved the initial goal, the response to the effect of the prescription 118 / product. For a given current skin condition 158, a new product or prescription 118 may be recommended. For example, the system may recommend certain components to look for to increase the glossiness of the user's skin for a given current skin condition 158. Reports can be provided on-screen, in print, and personalized. Reports can be shared with practitioners in charge of ongoing treatment and consultation.

In Figure 17, the elasticity summary page 1700 of the skin care system is shown. Stepwise analysis of each indicator may be performed. For example, a stepwise analysis of the elasticity measure is shown in FIG. 17. Summary page 1700 may show all data captured over a certain interval for each indicator in separate summary pages 1700, such as using a bar graph. While Figure 17 shows a summary page on resilience, it should be understood that the summary page can summarize data related to any and all issues. Progress that meets the skin care target can be indicated by data and its analysis or by user input. Emotions of the user's product or prescription 118 may be performed when meeting skin care goals. Products or prescriptions 118 may be displayed that enable to meet future needs. The system can also display products or prescriptions 118 that other users use when meeting the mentioned skin care goals.

In one embodiment, the data obtained at one time point or during certain time intervals may be shared with practitioners, other users of the skin care system, and the like. In one embodiment, the data may be shared as a data object with users of the skin care system's online platform 120 or mobile communication platform 124, with users posted to the blog, with users emailed to third parties, and the like. Can be. In some embodiments, the data may be data objects that can be dragged and dropped. For example, the wrinkle trend analysis 1502 shown in FIG. 15 may be discussed with users as shown in FIG. 69, as shown in FIG. 69, or the content that the user wishes to discuss as shown in FIG. Share with friends who have been posted on blogs or forums.

In one embodiment, a system that provides recommendations for skin care based on skin condition 158, skin care targets, and environmental factors affecting skin includes an online platform 120, a mobile communication platform 124, Interact with tools and algorithms 150, such as in a social network interface. Thus, product and prescription recommendations can be received and the effectiveness of the product and prescription 118 can be tracked. The system connects geographically separated consumers, producers, product information, professionals, service providers, and people who provide personalized emotions related to the questions and concerns of consumers' skin, hair, and nails in the areas of beauty and healthcare. May be an online or mobile communication platform (120, 124). The user interface 102 can reside on an online platform 120, a mobile communication platform 124, or a social network interface. In some embodiments, algorithms 150 operating on the online platform 120 may receive skin care emotions without using images or data from the imaging device 108. That is, the user does not necessarily have to use the data from the imaging device 108 to participate in the online platform 120. The online platform 120 may be a standalone skin health emotion and skin care recommendation tool. However, in many embodiments, the online platform 120 may use image data to provide skin health emotions and skin care recommendations. User interface 102 may interface with online platform 120. For example, a user monitors skin health by accessing an online platform 120 of a system that performs analysis, monitoring, and recommendation of skin health, and the imaging device 108 or other device 109 or monitor 182. Download, process, analyze, track, and store data from, receive product and / or prescription recommendations from analysis / API 154 or from peers, and associate skin condition 158 with prescription 118 Compare with phosphorus, receive product information 190, and purchase a product; Add recommendations to skin care shelf 114; Configure skin care shelf 114 with prescription 118, grade, expiration date, price, skin care goal, time of day, frequency, friend, etc .; Identify community ratings, ratings, and comments on products / prescriptions on skin care shelf 114; Rating and rating products; Leave comments on products, prescriptions, comparable products and / or prescriptions, receive notifications of new products or product recalls, receive daily reports 134, interact with social networks 188, and more. Can be done. The user interface 102 allows the user to conveniently acquire and submit images, to enter data, to track histories, to obtain recommendations and analyzes, and to make the user's skin / hair, and / or nail care / The purchase may be made in connection with cosmetic or medical problems. The user interface 102 resides on the online platform 120 and guides the user while acting as a data repository for preserving skin records 121 and history tracking tools. And it can help the user to logically organize information related to the user's situation.

In one embodiment, the user interface may include a skin care shelf 114. Skin care shelf 114 may allow a user to configure their products and prescriptions 118 in a logical manner based on the user's specific skin features 130 / skin condition 158. The user can configure the skin care shelf 114 according to the usage plan (e.g., morning, afternoon, night, etc.) and the intention (e.g., work, entertainment, etc.) and skin care goals (e.g., moisture, radiance, protection, etc.). have. This skin care shelf 114 may include a number of “pages” that display recommendations by various people (eg, physicians, dermatologists, beauticians, spa specialists, entire users, professionals, people most similar to users, etc.). Can be. The skin care shelf 114 may place products, prescriptions 118 and / or information 190, 192 in a personal manner. In addition to automatically collected recommendations, users can drag and drop products (or select and add products) as they do when surfing the web and find new products. It may include a means capable of. For example, the plug-in 194 can be used to allow a user to capture information anywhere on the Internet. For example, a user may find a transformed article viewed in a beauty magazine to access a web page and may wish to include the product on his skin care shelf 114 and / or shopping cart 113. The user clicks on the skin care product name and drags it to at least one of the skin care shelf 114 and the shopping cart 113 to obtain additional product information 190, to include them in his prescription 118, Purchase, sample request and so on. Skin care shelf 114 may be an application that can be installed independently on social networking sites and other personal homepages and / or toolbars. Skin care shelf 114 may also display the purchase date, purchase history, purchase expiration date notices, and other usage updates. In one embodiment, purchases made outside of the website may be automatically added to the user's shelf 114, alternatively the user may manually enter in offline purchases.

In one embodiment, user interface 102 may interface with mobile communication platform 124. The user interface 102 may support plug and play for various mobile devices 184 such as mobile phones, laptops, digital cameras, medical devices, and the like. For example, the mobile phone may be installed or integrated to acquire skin images, input / capture data, wirelessly or cabled to the user interface 102 and the web to perform data transmission constantly. A mobile device can provide a variety of sources (e.g., video from a particular place, product video or bar code to get a response to a product, best price, nearest sales place, coupons, etc.) For example, it can be used to acquire images and data from the beach to measure the sun protection effect. The user can also share data with other users and / or ask questions about the product immediately. The mobile device may include an internal optical system that can be charged internally, or an optical system that is independently attached to use battery power, and a light source that uses an internal communication device to acquire and submit an image.

In FIG. 18, a user interface for the online platform 120 may be shown in map form. The home page may have a different theme and feel depending on the user profile, user preferences, or other criteria. For example, you can have fun, serious, medical, or other themes. Through the user interface, the user can review products, write articles, report, review reports, blog reviews by product and skin type, and visit people's beauty shelf 114. Information can be freely registered, but some are free and some can only be obtained. All products and pages can be linked through the cosmetic shelf 114.

For example, FIG. 19 shows a review page of the user interface of the skin care system. The horizontal menus at the top of the user interface allow the user to access reviews, experiences, recommendations, information about me, and checkouts. The user interface may display a user profile (eg, age, gender, location, skin type, skin color, skin target, picture, etc.). The user interface may also indicate what products or prescriptions 118 the user may be using, as well as reviews, ratings, comments, and the like, associated with the user. Other users with access to the user profile may comment on the prescription or product they are using, rate the product or prescription 118, recommend other products or prescriptions, etc. You can do The user interface may provide a tool to help the user select a product or prescription 118. For example, the tool can be a questionnaire form or a user-looking wizard that can describe their skin. The user may provide age, gender, skin type (oily, sensitive), skin color, target, current brand or product, current prescription 118. In some embodiments, the skin type and / or skin color may be detected automatically as long as the user interface is interfaced with the imaging device 108. The user can also access the cosmetic shelf 114 via the user interface.

20 shows a review page of the user interface of the skin care system. The review page here is presented in a different layout than that briefly shown in FIG.

21 shows an experience page of the user interface of the skin care system. The experience page may allow the user to provide a detailed report of the experience with the product or prescription 118. For example, a user may post a question about the effect of a product or prescription 118, such as by asking a question. For example, the question is, how effective is it? How is it feeling? What is the scent? How much is it absorbed? Etc. can be mentioned. This experience page allows the user to update the age, gender, nickname, location, photo, skin type, skin color, target, etc. of the user profile. Users can send their experiences and general questions to other users via email, MMS, SMS, phone numbers, mobile devices, social networks, and so on.

22 shows a recommendation page of the user interface of the skin care system. For a given goal, various recommendation products or prescriptions 118 may be displayed on this recommendation page that may be effective in meeting this goal. The brand and the product or prescription 118 may be displayed with a rating received from the user community, a user's comment, an indication that the user believes that the product or prescription 118 that is currently being used may be even better. If the user believes that the product or prescription 118 seems to be better than the user currently uses, the product or prescription 118 can be stored on the cosmetic shelf 114 for future consideration.

23 shows the "Information for Me" page of the user interface of the skin care system. An “person like me” algorithm 150 may be used to align the user community of the skin care system. Given a user profile form, the algorithm 150 may determine who other users are similar in all criteria, in custom criteria, in combination of skin color and skin type, and the like. Once algorithm 150 finds a community of users most similar to the user, the user can view data for this community. For example, a user may find out which product is best suited overall for the community group for a particular issue, for a particular time of day, for a particular season. The Info page for me can also display the weather for a given place, the UV index given to this place / weather / environment, and specific tips. The information page for me can also notify the user when a new product is available. The user can sort the products according to the effect.

24 shows an example of a beauty shelf 114 of the user interface of the skin care system. The product or prescription 118 used by the user may be classified into the use time of a day, a specific effect, a price, an expiration date, and the like. Pop-up details about the product or prescription (118) (e.g., effects, ingredients, recommendations for use, expiration date, additional purchase links, blog links to the product or prescription (118), write a review or read reviews link, manufacturer site link, In-store coupon links, etc.).

25 shows another embodiment of a cosmetic shelf 114 of the user interface of the skin care system, and FIG. 26 shows another aspect of a cosmetic shelf 114 of the user interface of the skin care system. In this example, friends may comment on a product or prescription 118 and may recommend an alternative product or prescription 118. The user can also receive price notifications, new product launch notifications, new comment notifications, and the like.

27 shows a registration page of the user interface of the skin care system. Here, the user can enter information, set a goal, enter a security code, enter skin problems, color, and / or type, and register a sample. In addition, the user may indicate that he wants to add a feed from a skin care device to an RSS feed, that he or she wants to add an application from a skin care system to a social network site, and the like. The user may have the option of subscribing to notifications and notification services for samples and products.

28 illustrates another embodiment of the recommendation page of the user interface of the skin care system. This page can show people in a user category (eg, number of people with the same gender, same age group, similar skin type, similar interest, etc.). For each goal described, the most popular, most worded, reviewed, rated, blogged, etc. may be recommended.

As shown in FIG. 64, the user interface may include a friend toolbar. The Friend Toolbar can, for example, use a plug-in to float on an existing website or on another website. Friends may upload an image, which may be displayed on friend toolbar 6402. Part of the toolbar 6402 may include a home key 6404 to reduce the size of the entire toolbar. If set to notify a friend, for example, when a new product is added to the beauty shelf 114 or a new review is made, the notification indicator 6410 may pop up next to the friend image in the toolbar 6402. Bottom bar 6412 can be used to mix friends or access other options related to toolbar 6402. In FIG. 65, the toolbar 6402 may automatically scroll when the user scrolls through the web page being viewed. In FIG. 66, an object may be shared with friends on friend toolbar 6402 using drag and drop function 6602. For example, when posting a blog as shown in FIG. 66, blog content may be shared by dragging and dropping a blog title onto a friend's video. Similarly, the product can also be dragged onto the friend's image (6702) to recommend the product to the friend (see FIG. 67). Friend images may be rolled over so that additional information about the friend (eg, user profile, beauty shelf 114, reviews, blogs, etc.) may be shown in a pop-up format, in a dialog box form, or in another display manner.

29 illustrates a content map of a mobile communication user interface of a skin care system implemented in the mobile communication platform 124. This content map shows an example of content that can be accessed from the home page of the mobile communication platform 124. For example, a product may be scanned, searched for and retrieved from a list using the Internet on a mobile device starting from the home page. For example, you can scan a barcode for a product and send prices, reviews, ratings, and so on for the product. The user can be helped to find something (item for himself, gift for a friend, etc.). You can search for products by goal, problem, skin type, skin color, and more. Mobile skin care systems can deliver product listings (eg Top 10 products) and information about products (eg, ratings, impact on goals, safety, reviews, etc.). A user may use the Sun check application to receive ultraviolet information and advice based on location and on images captured by the imaging device 108 (described above) implemented in the mobile device.

The message flow "how good is this product" is shown in FIG. In this example, the barcode may be scanned to obtain product information, the barcode number may be entered by hand, or the product may be selected from the list. The system can convey product information (e.g., product name, rating, composition, overall rating, rating for a specific issue, a friend's rating, price, where to find it, etc.). If implemented in a mobile device, the purchase procedure may begin at mobile communication platform 124.

31 is "What to look for?" This message flow can be initiated by giving the user the option to indicate whether the retrieved item is a gift for the user, whether to update the selection list, and the like. In the case of a gift, you can select a recipient from the list that is stored and if you are a new recipient, you can write it in. You can also indicate what the event is. By entering the payee, event, and other details, the product may be recommended, along with the product, price, location, purchase option by the mobile communication platform 124. When the user finds something, the user can set a purpose, for example using a drop down menu, and receive a list of recommended products. Once a product is selected, the user may request to place the product in a store or initiate a purchase with the mobile platform 124.

32 shows the solar confirmation message flow. The initial message may include the user's location, weather, UV index, degree of sun impact, maximum exposure time and time timer information being exposed to the sun. Advice can be generated based on information such as the level of sun protection factor to be applied and the recommended maximum exposure time.

33 shows a notification message flow. The user links with another user on the mobile communication platform 124 to notify the user when another user requests a review or product rating. The user may respond to this via reviews, ratings, chats, SMS, MMS, phone numbers, voicemails, and the like.

34 shows an optional message flow. The option may be selected on the homepage 3404 of the mobile communication platform 124. Option 3404 may be a friend list, a selection list, a notification, an address / location, and the like. For example, a friend list 3408 can be accessed to select and select friends to join and be notified of. The friend list can indicate whether a friend is online. In order to inform the user when his friend buys a new item, a notification 3410 may be set in the mobile communication platform 124 to inform the user when a suitable new product is available for sale. The setting for address / location / payment may allow the user to start a purchase from the mobile communication platform 124.

The method and system of the present invention may be implemented in part or in whole through a computer that executes computer software, program code, and / or processor instructions. The processor may be part of a server, client, network infrastructure, mobile computing platform, fixed computing platform, or other computing platform. The processor may be any of an electronic computing or processing device capable of executing program instructions, code, binary instructions, and the like. A processor may be a signal processor, digital processor, embedded processor, microprocessor or other variant (eg, a coprocessor (arithmetic coprocessor, graphics coprocessor, communication) that directly or indirectly aids in the execution of stored program code or program instructions. Coprocessors, etc.) In addition, a processor may execute multiple programs, thread codes, etc. Several threads may be executed concurrently to improve the performance of the processor and to allow simultaneous operation of an application. As a method of implementing the invention, embodiments, methods, program code, program instructions, etc. of the invention may be implemented in one or more threads, which may also give rise to other threads that may be given priority to them. And the processor program code The threads may execute these threads based on priority or other manner by an instruction of A. The processor may include a memory for storing methods, code, instructions, and programs, as described herein and elsewhere. As described herein and elsewhere, a recording medium capable of storing a method, code, or instructions can be accessed via an interface: a method, program, code, program instruction, or the like, executed by an electronic computing or processing device. One or more CD-ROMs, DVDs, memories, hard disks, flash drives, RAMs, ROMs, caches, etc. may be used as the recording medium associated with the processor for storing the instructions in the format, but the present invention is not limited thereto.

The processor may include one or more cores that may improve the speed and performance of the multiprocessor. In embodiments, a processor may be a dual core processor, quad core processor, other chip level multiprocessor, etc., made by combining one or more individual cores (called dies).

The methods and systems of the present invention may be implemented in part or in whole through a machine running computer software on a server, client, firewall, gateway, hub, router, or other computer and / or networking hardware. The software program may be associated with a server that may include a file server, a print server, a domain server, an internet server, an intranet server, and other variations (eg, secondary server, host server, distributed server, etc.). The server may include one or more memories, a processor, a computer readable medium, a recording medium, a port (physical or virtual), a communication device, and the like, which may access other servers, clients, machines, devices through wired, wireless, and the like. It may include an interface. The methods, programs, and codes described herein and elsewhere may be executed on a server. In addition, other devices required for the execution of methods such as those described herein may be considered as part of the infrastructure associated with the server.

The server may provide an interface to other devices such as, but not limited to, clients, other servers, printers, database servers, print servers, file servers, communication servers, distributed servers, and the like. In addition, this combination and / or connection allows for remote execution over a network. Networking some or all of these devices may enable parallel processing of programs or methods at one or more locations without departing from the scope of the present invention. In addition, any of the devices attached to the server via the interface may include at least one recording medium that stores methods, programs, code, and / or instructions. Program instructions to be executed on other devices may be provided by a central repository. In such embodiments, the remote repository may serve as a recording medium for program code, instructions, and programs.

The software program may be associated with a client, which may include file clients, print clients, domain clients, Internet clients, intranet clients, and other variations (eg, secondary clients, host clients, distributed clients, etc.). A client may be one or more memories, processors, computer readable media, recording media, ports (physical or virtual), communication devices, and interfaces that may access other clients, servers, machines, devices, such as through wired or wireless. It may include. The methods, programs, and codes described herein and elsewhere may be executed on the client. In addition, other devices required for the execution of methods such as those described herein may be considered as part of the infrastructure associated with the client.

The client may provide an interface to other devices such as, but not limited to, servers, other clients, printers, database clients, print clients, file clients, communication clients, distributed clients, and the like. In addition, this combination and / or connection allows for remote execution over a network. Networking some or all of these devices may enable parallel processing of programs or methods at one or more locations without departing from the scope of the present invention. In addition, any of the devices attached to the client via an interface may include at least one recording medium that stores methods, programs, code, and / or instructions. Program instructions to be executed on other devices may be provided by a central repository. In such embodiments, the remote repository may serve as a recording medium for program code, instructions, and programs.

The method and system of the present invention may be implemented in part or in whole through a network infrastructure. The network infrastructure may include such elements as electronic computing devices, servers, routers, hubs, firewalls, clients, personal computers, communication devices, routing devices, and other active and passive devices, methods and / or parts known in the art. . Electronic and / or non-electronic computing devices related to the network infrastructure may include, among other things, recording media such as flash memory, buffers, stacks, RAM, ROM, and the like. The methods, programs, code described herein and elsewhere may be executed by one or more network infrastructure elements.

The methods, program code, and instructions described herein and elsewhere may be implemented on a cellular network having multiple cells. The cellular network may be either a frequency division multiple access (FDMA) network or a code division multiple access (TDMA) network. Cellular networks may include mobile devices, cell sites, base stations, repeaters (repeaters), antennas, towers, and the like. The cell network may be GSM, GPRS, 3G, EVDO, mesh, or other network formats.

The methods, program codes, instructions described herein and elsewhere may be implemented on or through a mobile device. Mobile devices may include navigation devices, cellular phones, mobile phones, personal digital assistants (PDAs), laptops, palmtops, netbooks, pagers, e-book readers, music players, and the like. Such devices may include, among other things, recording media such as flash memory, buffers, RAM, ROM, and one or more electronic computing devices. The electronic computing device associated with the mobile device may be instructed to execute the program code, method, and instructions stored therein. On the other hand, the mobile device may be configured to execute a command in cooperation with another device. The mobile device can communicate with a base station that is configured to interface with a server to execute program code. Mobile devices can communicate on p-t-p networks, mesh networks, and other communications networks. The program code may be stored in a recording medium associated with the server, and may be executed by an electronic computing device implemented in the server. The base station may include an electronic computing device and a recording medium. The recording device may store program codes and instructions executed by the electronic computing device associated with the base station.

Computer software, program code, and / or instructions may be stored and accessed on a machine-readable medium, which may include the following. Computer components, devices, and recording media for storing digital data used for electronic calculations for a period of time; Semiconductor recording elements such as random access memory (RAM); Magnetic recording device types such as optical disks, hard disks, magnetic tapes, magnetic drums and cards; Processor registers, cache memory, volatile memory, nonvolatile memory; Optical recording devices such as CD and DVD; Removable media such as flash memory (eg, USB stick or key), floppy disk, magnetic tape, paper tape, punch card, standalone RAM disk, zip driver, removable mass storage, offline, and the like; Other computer memory (dynamic drive (dynamic) memory, static drive (static) memory, read / write holder, changeable recording device, ROM, RAM, sequential access memory, locable memory, file assignable memory, content assignable) Memory, network accessory logger, storage network, bar code, magnetic ink etc.

The methods and systems of the present invention may translate the state of physical and / or intangible items to one another. The methods and systems of the present invention may also convert states of data representing physical and / or intangible items to one another.

Elements (flow diagrams, block diagrams, drawings, etc.) described and illustrated in the present invention only suggest logical boundaries between the components. According to the practice of software or hardware engineering, the components and functions shown are program instructions stored as a single software structure as an independent software module or a module employing external routines, codes, services, etc., or a combination thereof. All of the implementations may be included within the scope of the present invention as it may be implemented on a machine via a computer executable medium having a processor capable of executing them. Examples of such machines include personal digital assistants (PDAs), laptops, personal computers, mobile phones, other portable electronic computing devices, medical equipment, wired and wireless communications devices, transducers, chips, calculators, satellites, tablet PCs, and e-books. , Gadgets, electronic devices, artificial intelligence devices, electronic computing devices, networking equipment, servers, routers, and the like. In addition, the components or other logical parts shown in the flowcharts and block diagrams may be implemented in a machine capable of executing program instructions. In addition, while the above figures and descriptions have been submitted in terms of the functional aspects of the present invention, the specific limitations to which software for implementing such functional aspects should be hindered by the description herein are provided unless expressly stated otherwise or otherwise clear in context. There can be no. Likewise, it will be appreciated that the various steps described above may be altered and that the order of steps may be applied to a particular application of the techniques of the present invention. All such changes and modifications are intended to fall within the scope of the present invention. Thus, illustrations and / or descriptions of the order of the various steps should not be understood as being a specific order for the execution of these steps, unless necessary for a particular application or explicitly stated or contextually clear.

The methods and / or processes described above and steps thereof may be realized by hardware, software, or any combination of hardware and software suitable for a particular application. The hardware may include a general purpose computer and / or a dedicated electronic computing device or a specific form or part of a specific electronic computing device or a specific electronic computing device. Processes may be realized in one or more microprocessors, microcontrollers, embedded microcontrollers, programmable digital signal processors or other programmable devices with internal and / or external memory. Processes may also be implemented through (or instead of) application specific integrated circuits (ASICs), programmable gate arrays (PGAs), programmable logic arrays (PALs), other devices capable of processing electronic signals, or a combination of these devices. Can be. It will also be appreciated that one or more processes may be implemented as computer executed code that may be executed on a machine readable medium.

Code executed by a computer may be stored, compiled, or translated to operate on one or more of the above-described devices and processors, a processor structure, or a combination of other hardware and software, or a heterogeneous combination of other machines capable of executing program instructions. You can write using any structured programming language (such as C), object-oriented programming language (such as C ++), or any other high-level or low-level programming language (assembly language, hardware description language, database programming language, and technique). Can be.

Thus, in one form, each of the methods and combinations thereof described above may be implemented in computer executable code that executes each step in one or more electronic computing devices. In another aspect, the method may be implemented in systems implementing each of the steps to be distributed among the devices in a variety of ways, or all the functions may be integrated in a dedicated standalone device or hardware. In another form, the means for executing the steps related to the process described above may include any of the hardware and / or software described above. All combinations and combinations of the above are intended to fall within the scope of the present invention.

Embodiments may also be embodied on a computer readable recording medium in the form of a computer program product. The computer-readable program instructions (for example, computer software) are implemented on this recording medium. Some embodiments may be implemented as a form of computer software running on the web. The computer-readable recording medium includes a hard disk, a CD-ROM, an optical recording device, a magnetic recording device, and the like, and any appropriate one can be used.

It will be appreciated that each block of the block diagram and flowchart, and combinations of blocks in the block diagram and flowchart, can be implemented by computer program instructions. These computer program instructions are loaded into a general purpose computer, special purpose computer, or other programmable data processing device that manufactures the machine, thereby causing instructions to be executed on the computer or other programmable data processing device to block each block in the flowchart or block diagram. It is possible to create means for realizing the functions specified in.

These computer program instructions can also be stored in a computer readable memory. These memories instruct a computer or other programmable data processing unit to perform a particular function, so that instructions stored in a computer readable memory can implement instructions that implement the functions specified in each block of the flowchart or block diagram. It is to produce a manufactured article containing. These computer program instructions may also be loaded into a computer or other programmable data processing device. This allows a series of operating steps to be performed on these computers or other programmable data processing devices to produce a computer-implemented process. Thus, instructions executed on a computer or other programmable data processing apparatus provide steps for realizing the functions specified in the blocks in the flowchart or block diagram.

Accordingly, the blocks in the block diagrams and flowcharts support a combination of means for performing a designated function, a combination of steps for performing a designated function, a program instruction means for performing a designated function, and the like. It is further noted that each block in the block diagram and flow chart, and combinations of blocks in the block diagram and flow chart, can be realized by a special-purpose hardware-based computer system that performs specified functions or steps, or a combination of special-purpose hardware and computer instructions. You will understand.

While the invention has been described and illustrated with respect to preferred embodiments, various modifications and improvements will be apparent to those skilled in the art. Therefore, the spirit and scope of the present invention should not be limited to the above-described embodiments, but should be construed to the widest scope as permitted by law.

All materials referenced in the specification are incorporated herein by reference.

1000: Homepage 1100: Welcome Page
1200: Question Page 1300: Skin Image Capture Page
1400: Analysis Page 4700: Skin Care Device
4800: cane type device 4900: skin care device
5000: Wearable Skin Care Device
5800: Process flow diagram for determining skin type
6300: process flow chart for determining skin type

Claims (27)

A method of estimating skin type and skin characteristics to generate a unique spectral signal,
Convolving data for polarized light or white light reflected and / or re-emitted from the first image incident and captured by the diffuse white light;
Convolving data for polarized light reflected and / or re-radiated from the second image incident and captured by polarized light;
Comparing extreme positions of at least two unique convolutions generated by convolution of data from the first image and the second image; And
Intrinsic spectral signal comprising determining the distance between the minimum intensity and maximum intensity of convoluted (red spectral diagram)-(blue spectral diagram) from at least two inherent convolutions to produce a numerical output of skin type How to estimate skin type and skin characteristics to produce it. The method of claim 1,
Physiological white light comprises three spectral intervals comprising a width less than 100 nanometers. The method of claim 2,
Wherein said three spectral spacings relate to red, green, and blue (RGB). The method of claim 3, wherein
Wherein said three spectral spacings give a natural white light feel to the human eye to estimate skin type and skin characteristics to produce a unique spectral signal. The method of claim 1,
Comparing the extreme positions of the at least two inherent convolutions comprises comparing component (RB) (WP) for reflected and / or re-radiated polarized light and component (RB) W for white light. A method of estimating skin type and skin characteristics to produce a characteristic spectral signal characterized by The method of claim 5, wherein
The two inherent convolutions for the white light and polarization are white red component (WR), white blue component (WB), reflected and / or re-radiated polarized blue component (PB) and reflected and / or re-radiated polarized red component (PR) further comprising estimating skin type and skin properties to generate a unique spectral signal. The method according to claim 6,
Wherein said two inherent convolutions are based on a numerical difference that correlates to a medical standard. The method of claim 1,
And further comprising a spectral convolution technique for determining various combinations of subtracting the blue spectrum from the red spectrum contained in the white and polarized white light, wherein the spectral spacing is indicated on the wavelength axis with a scale spacing of 100 to 300 nanometers. A method of estimating skin type and skin properties to generate a unique spectral signal. A machine-readable medium having program instructions executable by a processing unit,
The program command may include: capturing an image of a material by irradiating white light without an incident angle (an incidence incident white light), and capturing an image of the material by irradiating an incident angle of white light (angled incident white light);
Generating a histogram of the red and blue channels normalized to the reflected and / or re-radiated light for each image;
Correlating histograms of the normalized red and blue channels to a wavelength axis scale to obtain a spectral plot of the red and blue channels; And
To generate a red normalized complex color channel spectral diagram and a blue normalized complex color channel spectral diagram, a spectral diagram for the angled incident light is subtracted from the spectral diagram for the angled incident light for each color channel, and a spectral signal for the material is generated. And combining the red and blue channel spectral diagrams by subtracting the normalized composite blue channel spectral plot from the normalized composite red channel spectral plot. The method of claim 9,
And subtracting the normalized blue channel spectral plot from the normalized composite blue channel spectral plot before generating a spectral signal for the material. The method of claim 9,
And subtracting the normalized red channel spectral plot from the normalized composite red channel spectral plot before generating a spectral signal for the substance. The method of claim 9,
And the light source is positioned to irradiate light at a selected angle alpha. The method of claim 9,
A machine-readable medium characterized by changing the measurement depth of a substance by changing alpha. The method of claim 9,
The unit scale on the spectral signal is a machine-readable medium, characterized in that the wavelength difference. The method of claim 9,
And the substance is inorganic. The method of claim 9,
And the material is an organic material. The method of claim 9,
A spectral signal is analyzed for at least one of peak number and peak number, peak amplitude and shape, intermediate structure and pattern. The method of claim 9,
A spectral signal is a machine-readable medium characterized by analyzing the synthesis, type, purity, and strength of a metal. The method of claim 9,
Spectral signals are analyzed for water quality, water synthesis, and purity. The method of claim 9,
The component of the spectral signal is displayed and tracked over time to track changes in material properties. The method of claim 9,
Spectral signals are analyzed to measure, track, or monitor skin condition. The method of claim 9,
Spectral signals are input to the recommendation engine to provide follow-up and changes to the type of prescription. The method of claim 9,
A machine-readable medium, characterized in that when convolving a complex spectral diagram to obtain a spectral signal, the position of the ideal blue wavelength in the Maxwell color triangle is aligned with the position of the ideal red wavelength in the Maxwell color triangle. The method of claim 9,
A spectral signal is calculated for incident light and subtracted from a spectral signal generated from reflected and / or re-radiated light. The method of claim 24,
Machine-readable medium, characterized in that only polarized components are used when the spectral signal for incident light is subtracted. The method of claim 24,
Machine-readable medium, characterized in that only white components are used when the spectral signal for incident light is subtracted. The method of claim 24,
Machine-readable medium, characterized in that both polarized and non-polarized components are used when subtracting from the spectral signal for incident light.

Images