KR20080058337A - System and method for medical monitoring and treatment through comsmetic monitoring and treatment - Google Patents

Abstract

A system and method that scans areas of a human body to identify unattractive characteristics and make cosmetic enhancements is modified for medical monitoring and optionally for treatment. A 3-D model of the exterior surface of the human body is created, and the scanned data is analyzed by characteristics of reflectance and surface topology to identify unhealthy characteristics. Because people will use a cosmetics system widely and frequently, base lines of patients' conditions can be created through frequent monitoring over a long time period, so that potentially dangerous changes from the base line can identified quickly and reported on. When appropriate, precise applications of medications to treat affected areas may be made automatically. Controlled and precisely directed dosages of medications may be applied to reduce the risk of undesirable side effects. Medicines may also be applied over a large area of skin and during a long period of time to achieve desired treatments.

Description

SYSTEM AND METHOD FOR MEDICAL MONITORING AND TREATMENT THROUGH COMSMETIC MONITORING AND TREATMENT}

The present invention claims the benefit of US Provisional Application No. 60 / 708,118, filed August 12, 2005 by the applicant.

The present invention relates to monitoring the human body to detect properties that warrant prophylactic or curative care, and in particular an automated system for application in the treatment and medical monitoring of areas of the skin. And methods.

Monitoring the outer surface of the human body is a well-established method for detecting an increased risk of disease or condition indicating disease. For example, doctors detect melanoma and then consult the patient to dictate the course of treatment for the disease. In the same way, doctors may find that the patient has sun damaged skin and instruct the patient not to be exposed to excessive sun in order to prevent further development of melanoma or other skin cancers. In addition, doctors can examine the surface local anatomy of a woman's skin and discover the high likelihood that a woman will potentially have breast cancer, in order to direct further examination and appropriate treatment.

Medical examination can be performed visually or through many kinds of medical equipment. In some cases, visual inspection is more efficient than with an instrument, in which the human eye has both a reflectance such as color and surface local anatomy such as, for example, bumps and depressions. You can see it, but not mechanical instruments. This ability sometimes allows the eye to identify medical problems that the instrument cannot miss or interpret. For example, many automated systems for medical monitoring lack the ability to analyze surface local anatomy.

With regular examinations, a baseline of the physical characteristics of the patient can be generated, so that variations from this baseline can be detected. One advantage of monitoring patients in this way is that rapid detection and treatment of diseases and potentially dangerous conditions increases the success rate of treatment. For example, daily detailed examination of the patient's skin for signs of skin cancer can significantly increase the ability to prevent or overcome skin cancer. In addition, the detection of white spots in people with dark skin, such as many African Americans, can indicate internal cancer. Regular examination of the skin can help to find and successfully treat acne, blisters, bruises, wounds, jaundice, varicose veins and other diseases and health problems including infections.

However, the high cost of manual examination by a physician or inspector caused by expensive medical equipment typically limits the frequency of patient monitoring. Daily monitoring of patients is usually too expensive to carry out except when serious illnesses have already occurred and the patient is in hospital treatment. General medical practitioners usually recommend that their patients undergo a general examination once a year or even slightly longer. Experts will also see sparse patients, usually once a year or every six months or every three months. Patients are encouraged to perform self-diagnosis more regularly, but they often lack the expertise and training to successfully detect a medical condition. As a result, many diseases remain undetected until they are not properly treated.

Accordingly, there is a need for automated systems and methods that provide periodic medical monitoring of the outer surface of the human body for reflective properties and surface local anatomy, identify and report medical problems, and in one embodiment treat these problems as appropriate. do.

As used herein, "reflectivity modifier" or "RAM" is referred to any compound useful for modifying the reflectivity of other materials, and is described in more detail below. Some embodiments of RMA include links, dyes, pigments, bleaches, chemically modified drugs and other materials that can alter the reflectance and other characteristics of human skin. For the sake of brevity, the terms "dye" and "transparent dyes" are used herein to refer to any RMA.

These and other needs are addressed by the present invention. The following description illustrates the invention by way of examples, which are not intended to limit the invention.

Another aspect of the invention is to determine the visual properties of the skin area by electrically scanning the area and analyzing the scanned data in the computational environment.

In one embodiment, scanning provides reflection data for the skin. The data is used to perform feature identification and monitor the change in reflectance over time.

In one embodiment, scanning provides both reflection data and surface profile data. The data is used to perform feature identification and monitor changes in reflectance or shape over time.

Another aspect of the invention is to create a map of the area of the skin and use the map later to determine the location of the monitoring device relative to the skin. The map can also be used to compare images from the first time and the second time to detect changes in reflectance or shape.

In this patent specification, "inkjet technology" is generally referred to as "drop control" technology, whereby each individual droplet of material applied is known as known to those skilled in the art. It can be controlled by an applicator. A particularly useful technique for the present invention is to use a "drop on demand" technique, a subset of the drop control technique. In this specification, an "inkjet printer" is used to represent any form of inkjet technology for simplicity of representation.

Another aspect of the invention is the precise application of one or more medicinal agents to the skin in response to the local reflexive properties of the skin.

The term "medicament" is used to refer broadly to any substance or compound that is beneficial to the area of skin. The medicament may be a pharmaceutical compound, a drug, a natural herb, a humectant or other substance that benefits the skin.

These and other aspects, features, and advantages are achieved in accordance with the systems and methods of the present invention. In accordance with the present invention, computer-controlled systems typically determine the properties of the human skin region. The identified properties may be related to reflectance and may be referred to as features such as irregular and bright and dark spots, blotch, wounds, warts and bruises. The identified attributes may also be related to the surface local anatomy of the skin, such as depth, to more accurately improve surface irregularities such as bumps or wrinkles. The medicament may be applied in accordance with the identified patterns, such as adding red to the red area, or in accordance with the identified patterns, such as green or blue in the red area, according to an idealized model of attraction. Can be.

One aspect of the present invention is to account for and analyze data at different wavelengths (colors) to provide a basis for a detailed analysis of skin features. Some skin features can be identified from the features that the features exhibit at different wavelengths.

The application of medicament at the pixel level allows for very high accuracy than using conventional methods, so fewer applied materials are used. In some cases, delivery of such precise medications to a particular area enhances the effectiveness of the medication without the side effects associated with the systemic application of the medication. For example, acne medications can be applied more effectively to the skin area than to taking medications.

In one embodiment of the invention, an application device comprising a scanner and an inkjet printer makes a single pass over an area of the skin. It scans the skin, identifies the problem, calculates the amount and application of the medication, and quickly applies the medication onto the skin.

In another embodiment, the application device creates a first map of the features of the skin at a first time and identifies interesting features. It then creates a second map of the skin's features at the second time and identifies interesting features. Two maps and interesting features are compared to monitor changes in the features.

In this embodiment, detailed scanning is performed on areas of the human skin such as the face, legs or arms. The scan is obtained by the intended flashing of multiple light sources arranged in a known configuration and by scanning a small area of the skin as the light sources are turned on and off. By comparing the records from different light sources, both the surface profile and the reflectance of the skin can be determined.

The data from the scan includes the reflective properties of the skin. These properties can be used to generate detailed maps of the skin, including both reflectance and skin surface morphology. The detailed map can be used to develop an accurate plan for selectively applying the medicament.

One aspect of the present invention is to provide an automated system and method for providing periodic medical monitoring of an external surface of a human body for reflectance properties and surface local anatomy.

Another aspect of the present invention is to provide an automated system and method for identifying medical problems of an external or subsurface of a human body through monitoring.

Another aspect of the present invention is to provide an automated system and method for reporting medical problems of an external or subsurface of a human body through monitoring.

Another aspect of the present invention is to provide an automated system and method for applying a drug to problems identified on the outer surface of a human body at a timely time.

These and other aspects of the invention will be readily apparent upon review of the following description and the associated drawings. In accordance with one embodiment of the present invention, systems and methods for scanning areas of the human body to identify unattractive traits and make cosmetic enhancements are calibrated for medical monitoring and optionally treatment. A 3-D model of the outer surface of the human body is generated and the scanned data is analyzed by properties of reflectance and surface local anatomy to identify untouched properties. Because people will use cosmetic systems widely and frequently, baselines for the patient's condition can be generated through long-term periodic monitoring, so that changes from potentially dangerous baselines can be quickly identified and reported. At appropriate times, appropriate application of the drug to treat the affected areas can be made automatically. A controlled and correctly indicated dose of drug may be applied to reduce the risk of undesirable side effects. The drugs can also be applied over a large area of the skin and for a long time to achieve the desired treatment.

The following embodiments of the invention are described by way of example only with reference to the following accompanying drawings.

1 is a block diagram illustrating an operating environment in which embodiments of the present invention can be used to apply RMAs on the skin.

2 is a block diagram illustrating an operating environment in which embodiments of the present invention can be used to apply RMAs on the skin via communication on a network.

3 is a block diagram illustrating an operating environment in which embodiments of the present invention may be used to apply RMAs on the skin via communication on a portable application device and a network.

4 is a block diagram showing the use of magenta, yellow and cyan RMAs.

5 is a block diagram illustrating an operating environment in which embodiments of the present invention can be utilized through a self-contained portable application device to apply ink onto the skin.

6 is a flowchart illustrating a process for using an application system.

7 is a flowchart illustrating a process for setting up an application system.

8 is a flowchart illustrating a process for programming an application algorithm in one embodiment for printing on the skin.

9 is a flowchart illustrating a process for creating a printable enhancement image.

10 is a diagram illustrating a method of mapping a 3-D object to a 2-D surface in a computer model.

11 is a flowchart illustrating a process of forming the principle of attraction.

12 is a block diagram showing illumination from above the area where the surface texture changes.

FIG. 13 is a diagram showing a characteristic or characteristic of a 3-D human face. FIG.

14 is a perspective view illustrating features on a 2-D map of a human face.

15 is a perspective view illustrating a characteristic or characteristic on a 2-D map of a human face.

16A-E are charts of printable enhancement images, illuminance, and reflectance along line A-A 'of the 2-D map of the human face of FIG. 14.

17 is a diagram of a 3-D human face that has been enhanced through printing of RMAs according to a printable enhancement image.

FIG. 18 is a diagram illustrating the characteristics of a 3-D human leg and printable enhancement image with a corresponding reflectance per spectrum based on the 2-D map.

19 is a diagram of a 3-D human leg that has been enhanced through the printing of RMAs according to a printable enhancement image.

20A-B are diagrams illustrating the characteristics of 3-D human chests with corresponding reflectances per spectrum based on 2-D maps.

21 is a diagram illustrating the steps of scanning and performing multiple passes of applications.

22A-C are diagrams illustrating the effects of RMAs applied to enhance the appearance of freckles associated with age.

23 is a generalized graph of visual benefit versus resolution.

24 is a flowchart showing general steps used by the present invention.

25 is a generalized graph of patterns of unattractive features of RGB bands.

26 is a block diagram showing a spacer cup on a sensor.

FIG. 27 is a block diagram illustrating an operating environment in which embodiments of the present invention may be used to authorize RMAs on the skin via communication on an application device including a boot and a network.

28 is a generalized graph of weaker intermediate frequencies and stronger intermediate frequencies.

FIG. 29 is a block diagram illustrating an operating environment in which embodiments of the present invention may be used to apply RMAs on the skin via communication on a blotter application device and a network.

30 is a block diagram illustrating an operating environment in which embodiments of the present invention can be used to apply RMAs on the skin via communication on a network and a portable application device having a curved surface.

31 is a flowchart for adjusting pixel-level mapping of skin.

32 is a flowchart for coordinating pixel-level application of RMAs.

33 is a flowchart showing a process for using enhancement techniques.

34 is a flowchart showing a process for determining a target depth of a scanned area.

35 is a flowchart showing a process for determining a target illuminance of a scanned area.

36 is a block diagram showing an application device including a booth.

37 is a schematic of a simple skin smoothing example.

38 is a schematic diagram of an example of multiple pass smoothing.

39 is a schematic diagram of an example face map.

40A-B are sample layouts for sensors and LEDs for obtaining reflectance and skin orientation data.

41 is a schematic diagram for feature recognition.

42 is a schematic diagram of an example for feature recognition.

43 is a schematic diagram of an artistic method for applying RMAs.

44 is one embodiment of a rotary printer for a blotter application device.

45 is an embodiment of a text image showing apparent depth.

46 is a flowchart showing a calibration process.

47A is a side view of one embodiment of a portable device for marks of the skin.

FIG. 47B is a front view of the device of FIG. 47A.

FIG. 47C is a top sectional view along section AA ′ of FIG. 47B.

48 is a flow chart showing a process for medical monitoring and selective treatment.

49 is a flowchart illustrating a process for identifying medical problems.

50 is a bar graph showing the number of samples collected for medical monitoring of an individual for one year by different data collection methods.

51 is a block diagram illustrating an operating system and showing elements for the present invention.

FIG. 52 is a block diagram showing the use of a second ink jet printer head and a second reservoir holding a medical compound for medical application of a cosmetic system.

Detailed Description of the Examples-providing a cosmetic system for applying a reflectance modifier and using the cosmetic system for medical monitoring

The details of the following description are provided to clarify the invention. However, it will be apparent to one skilled in the art that the concept of the present invention is not limited to these specific details. Commonly known elements are also shown in block diagrams as examples for the sake of clarity of description, and are not intended to limit the invention. In addition, the order of processes, numbered order, and labels thereof are indicated for the sake of clarity of description and are not intended to limit the invention.

This example discloses a cosmetic method for improving the visual appeal of human skin regions as disclosed in a patent application that is co-pending by the applicant. As described in more detail below, in one embodiment of the invention the cosmetic system is configured for use in medical monitoring of the skin. One advantage is to provide periodic monitoring of the skin during cosmetic sessions without additional effort. In another embodiment, the application techniques disclosed for multiple scanning, mapping, and cosmetic systems are applied for medical monitoring devices.

This embodiment discloses a method for enhancing the visual appeal of human skin regions. As shown in FIG. 24, the method includes the following general steps.

Step 900-allocating an area of the skin to a plurality of frexels;

Step 910-measuring at least one optical property of each of the plurality of precells;

Step 920-determining from the optical properties of the prexels at least one measured skin characteristic that affects visual appeal;

Step 930-determining the desired state of the skin characteristic; And

Step 940—applying at least one reflectance modifier to the specific precells to correct the measured skin properties to approach the desired state of the skin properties. This step may be corrected for applying one or more agents in the present invention.

Multiple skin areas With precsels  Assignment Step

In this patent specification, the term "prexel" is defined as a small pixelated area of skin. In the present patent application, the term "skin" is not only referred to as the skin on the surface of the human body, but also broadly referred to any human feature, such as nails and hair, that can be improved on the surface. have. Frexels may correspond to small portions of freckles or other skin features, or it may correspond to areas of the skin that do not have special features. Prexel thus refers to the skin rather than an independent conditioning system.

The term prexel is used to suggest that what is measured is on the 3-D surface rather than the flat surface. The area of the skin consists of a number of frucsels. For example, if a resolution of 300 dpi (11.8 ports per mm or “dpmm”) is used, Frexel can have a width and height (0.085 mm) of about 1/300 of an inch, roughly 90,000 pixels per square inch. Rexel is present (140 precsels per square mm). The surface of the human body can have millions of frucsels.

By assigning skin to frucsels, the present invention can achieve the application and scanning of RMAs for further enhancement of the higher visual capabilities of humans to analyze detailed parts.

23 is a generalized graph of the relative visual advantages of 450 dpi versus 452 dip resolution. Target resolutions ranging from 50 to 300 dpi (2-11.8 dpmm) offer better resolution than current cosmetic technologies, as well as the benefits of adjusting in response to actual and desired skin properties, as well as the added benefits of automated applications. do. Prior art for makeup using brushes, tubes and fingers has very poor resolution. For example, a fine brush has a resolution of about 20 dpi (0.8 dpmm).

Plural Frexels  Measuring each of the at least one optical property

scanning

As shown in FIG. 1, in one embodiment, an application device including a scanner 220 may allow the scanner 220 to electrically record data for one optical property of each of a plurality of prexels, such as reflectance. So that it is moved across the area 302 of the skin. For example, region 302 of the skin may be a face.

Scanning can acquire images under various frequencies to obtain useful data. For example, it may acquire data on reflectance in a particular color, for example red, to help determine a particular characteristic of the skin for improvement. Scanning can also provide data to determine other characteristics of the skin, such as surface local anatomy, based on the angle of reflection from multiple light sources.

In one embodiment, a two dimensional array is used for scanning. In other embodiments, a line array can be used.

Alarm sound

In one embodiment, one or more alarm means, such as sound, light or vibration, may be used to indicate when sufficient scanning has been achieved.

Sensors

In one embodiment, the scanner 220 includes four LED light sources and a sensor arranged in a known configuration within the housing. LED light sources are typically turned on and off each in a manner that allows sensing of at least one optical characteristic for each light source. In one embodiment, 120 captures per second are made in such a way that 30 captures are taken from each light, providing a lot of data about the skin quickly. The data can then be used to determine both reflectance properties and skin surface profiles at various wavelengths. In one embodiment, the captured images can be averaged for efficiency.

In one embodiment, the sensor includes shading patterns on the LEDs that are useful for determining the relative position of the sensor.

In one embodiment, a monochromatic sensor with a Bayer array can be used. Other arrangements of sensors and LEDs can be used.

Scanned  Steps to analyze your data

The scanned data includes information about:

Reflectance from the skin

Skin location and skin characteristics with respect to the sensor

In one embodiment, application algorithm 230 embeds the stored data into spatial frequency bands and determines them to determine the dimensions of the landscape of area 302 of the skin and the dimensions that require application of RMAs 264. Use pattern recognition to analyze The process used to determine these dimensions will be described in detail below.

Application algorithm 230 uses its analysis to create an application map 232 of the area 302 of the skin in software, which is stored in storage 250 for potential future use.

Optical properties

Reflectance, a measure of the reflex of the skin, is independent of its roughness. Illuminance is a measure of how much light reaches the skin. Optical readings are independent of surface anatomical structure readings.

In one embodiment, certain optical properties, such as the amount of reflectance of each prexel, can be determined directly from the scanned data. In another embodiment, the scanned data is translated into at least one spatial frequency band for analysis. In yet another embodiment, the scanned data can be translated into multiple spatial frequency bands, such as red, green and blue (RGB) bands.

16A-E illustrate the pattern of the 2-D face 232 shown in FIG. 14 after the data has been sandwiched into single spatial frequency bands to determine the properties of roughness 352 and albedo 348.

Albedo

Albedo is a percentage of the reflectance of incident light from the surface of an object. In the case of electronic scanning, albedo is the RBG value of the scanned area of the skin. In this patent application, the term "actual albedo" refers to the albedo observed prior to correction, and "target albedo" refers to the desired reflectivity of the skin region to enhance the presentation of the skin region. In one embodiment, the target albedo is determined from one or more correction methods, including general smoothing, in particular feature enhancement and artistic methods.

The upper band of FIG. 16 represents the actual "albedo" along line A-A 'of the 2-D surface map 232 of FIG. The rise in the actual albedo graph represents bright spots 408. Deep and sharp descents in the graph indicate wound-like nonuniformity 412. Irregular sections represent freckles 410

Roughness

Illuminance is incident light reaching the unit area of the surface of the object and is a function of the angle of incident light with respect to the surface.

The spatial frequency bands also graphically represent the shaded 352 or actual illuminance shown in FIG. 16 of the 2-D surface map 232 shown in FIG. 14.

Reflectance and roughness data and calculations

In one embodiment, the Fraxel data obtained from the scanning of the skin region may be represented as follows.

((x _s , y _s , z _s , α _s , β _s , γ _s ),

(x _f , y _f , z _f , α _f , β _f , γ _f ),

{(refl) _A , (refl) _N , (refl) _S , (refl) _E , (refl) _W }] _i

The terms {(refl) _A , (refl) _N , (refl) _S , (refl) _E , (refl) _W } refer to Frexel (i) under ambient brightness conditions, and for ease of discussion. Represents the reflection data for each of four light sources, such as LEDs, arbitrarily displayed north-south. Other numbers of light sources, such as three light sources, may be used, but are mathematically simple when using four light sources. (refl) represents one or more data points for reflectance measurements. Reflectance measurements for wavelengths are a product of constants, roughness, and albedo over wavelengths:

Reflectance = k * roughness * albedo

E.g:

Reflectance (red) = k (red) * roughness (red) * albedo (red)

The constant depends on a number of factors, including the speed of the lens, the sensitivity of the camera or sensor, the transmission characteristics of the color filter, the gain of the analog amplifier, the digital gain applied by software, and other factors. The constant k will usually be measured and corrected as the camera's calibration constant, and the camera's calibration corrects for these effects. The value of the constant can typically be determined during calibration when the illuminance from the LEDs is considered to be fixed and the albedo is calculated based on that assumption.

Reflectance is not perfect but is a measure of what comes from the camera. Sensors are typically cameras without amplifiers, digital transducers or lens housings. In one embodiment, it is a solid state MOS sensor with a sensorton lens and associated electronic equipment.

Prexel data may be processed to determine illuminance and reflectance for each light source, and such information may be used to determine reflectance and surface profile.

In one embodiment, the reflectance is the average or median of all measurements. The illuminance can be determined from the known brightness of light sources such as LEDs. Illuminance is the product of the brightness of a known light and the cosine of the angle of incident light with respect to the normal.

One problem with obtaining reflectance data is that glare may appear at some angles and accurate readings may not be obtained. In one embodiment, glare or gloss can be removed using a polarizing material to provide cross polarization of the LEDs. In other embodiments, the sensor may be intentionally positioned at a relatively large angle, such as 60 degrees, to eliminate glare.

Steps to determine location

For sensors or coordinate systems Frexel  Positioning

The term (x _s , y _s , z _s , α _s , β _s , γ _s ) can represent the distance of the flexel (i) from the sensor, or can be the complete position and orientation of the flexel relative to the reference coordinate system. have. In one embodiment, the determination of the distance from the prexel to the scanner can be made in two steps. The first step may be an approximate mathematical-based measurement, such as a constant height of the sensor from the skin. The second step may be an optical first guided measurement to provide artistic adjustment. In one embodiment, the fine adjustment is calculated by measuring the angle from the surface. In another embodiment, fine adjustment can be made by using two light sources to emit two reference points or gratings for detection by the sensor.

Mechanical approximation

In one embodiment, the sensor may be attached to the helmet or fixed booth in such a way that the sensor position may be determined relative to the helmet or booth.

In another embodiment shown in FIG. 26, the sensor 278 may include a cup 280 such that the sensor 278 maintains an average height from the skin.

In another embodiment, the sensor can start from a known position and track the movement of the cup to estimate the position of the cup. The sensor may measure an angle to the probe itself to determine the shape of the surface feature with respect to the constantly changing plane of the probe.

The gimbal can be used to provide a reference in space. Tracking can be used to follow a hand scanner or hand position in space. The gimbal arrangement can provide constant feedback in a manner similar to GPS mapping or stereo-mapping for satellites such as pesticide spraying.

Optical fine adjustment

For finer alignment, optical means can be used. For example, the first derivative of the z component of the skin can be obtained from the shade through multiple light and shade from the probes. The first derivative can provide a measure of the angle of the surface.

In one embodiment, the third light sources emit different patterns. Color and shading provide data for determining surface relief so that a shaded relief map can be obtained from the LEDs.

Frexel  Orientation

By determining the inclination of the prexel with respect to the two orthogonal axes, the orientation of the prexel can be determined. The orientation of the prexel and its neighbors represents the actual local surface texture of the skin. One aspect of the present invention is the ability to measure and compensate for both local reflection characteristics and local surface textures.

In this embodiment, there are four light sources appearing east, west, south and north. The sensor acquires data when each light source is on and other light sources are off. The sensor can also obtain data about ambient lighting with four light sources, none of which are on.

The slope of the prexel can be determined by comparing the measured values of south and north. The difference in these measurements is related to the inclination of the flexel along the east-west axis. The difference between the east and west measurements is related to the slope of the prexel along the north-south axis.

In general, it is essential to perform gamma correction by transforming data into linear space. Gamma correction is approximated by taking the square root of the data output by a conventional gamma 2 camera.

Light sources

40A-B show a configuration of light sources that can be used with one embodiment of the present invention. In this embodiment, a set of four light sources, LED _N , LED _S , LED _E and LED _W , is used. The light sources are arranged in a diamond structure in which the sensor is located in the center of the LED layout. This structure simplifies the mathematical analysis for calculating the surface profile.

Medium illumination

In one embodiment, it is useful to use the concept of intermediate lighting. Medium illumination is the average angle and diffusion of light reaching a particular surface. This defines how surface irregularities typically exhibit contrast. For example, the intermediate illumination for the entire body is above the head, and typically the orientation to the head is vertical; Thus, the bumps of the cheeks are typically shaded at the bottom. In beach children, these bumps will typically be less sunburned because the average light comes from above the "head" throughout the day, integrating the sun's angle with the body's angle to give average or medium illumination. Sometimes light is excluded from the mean. One example is to illuminate the face from below. However, this is an exception that often proves bizarre, sometimes ugly, and has rules. By correcting the defects for the intermediate illumination, the best correction for the mean is performed.

Medium illumination is the interaction of the medium light direction with respect to gravity and the medium orientation of a particular prexel of the skin with respect to gravity. One method for obtaining the angle of the skin is to use multiple diffuse or vertical light sources in a configuration that may include a mirror. The lights flash repeatedly as flash lights so that hundreds of images can occupy a small area, and the data can be averaged. From the angle of the skin relative to the "up" it can be calculated how much light reaches the skin under the angular mid-light of the skin relative to the "up".

A reasonable approximation to the intermediate illumination can be made by turning on all the light sources and simultaneously adding images made by the individual light sources. In one embodiment, the intermediate illumination diffuses because the light and probes are perpendicular to the skin.

Improvements in this technique will compensate for counterproductive effects on the skin. For example, multiple images with four light sources can be used from the light sources and averaged. For example, the mean may be a median. One advantage of the median is that if specular reflection is caught by a few light sources it will be filtered by the median. The median will also filter out the shades observed from the few light source images. This is important because the body of the person exhibits complex surfaces, ie it will glow when the nose is illuminated.

One way of generating diffuse light is to introduce light from multiple light sources at many angles. Another way to produce diffuse light is to reflect it from the scanner housing. Another option is to polarize the light.

Frexel  Of data representation Example

One embodiment of the data representation for Frexels is shown as follows:

((x _s , y _s , z _s , α _s , β _s , γ _s ),

(x _f , y _f , z _f , α _f , β _f , γ _f ),

{(refl) _A , (refl) _N , (refl) _S , (refl) _E , (refl) _W }] _i

In this embodiment, (x _s , y _s , z _s , α _s , β _s , γ _s ) and (x _f , y _f , z _f , α _f , β _f , γ _f ) are Indicate the angular orientation and position of the lexels and scanner sensors.

compression

In some embodiments, the efficiency of data processing can be enhanced by various compression methods such as JPEG.

Skin Frexel  location

Characteristic Mapping  through

Computer mapping for feature recognition known to those skilled in the art in areas such as computer games can be used to track the position of the probe on skin area 302 and determine appropriate improvements to particular features.

For example, such computer mapping allows for the identification of features such as cheekbones, nose and ears so that the probe can potentially orient its position in relation to a particular fraxel in multiple passes over the skin area.

In addition, the identification of features such as cheekbones allows for the determination of appropriate improvement. For example, a red reflectance modifier can be added to the center of the cheekbones to add color to the face. Dark reflectance modifiers may be applied beneath the cheekbones to make the cheekbones appear more prominent.

Skeleton model

In one embodiment, a map is made around the skeleton model such that the skeleton joints are the reference points. In this embodiment, the joints are positioned, a stick figure is constructed, and a 3-D mesh is made around the stick figure. The map is associated with a predetermined model of the human skeleton structure in memory of the computing environment.

Manikin model

In one embodiment, the map is related to a predetermined model of the human body.

Dynamic model

In one embodiment, the map is associated with the movement of the skin over a predetermined model, such as a skeleton model or anatomical model.

Chemical Marker  through

In other embodiments, chemical markers may be applied to the area of the skin during scanning to help generate the map and then to enable tracking of the map with the area 302 of the skin. For example, ultraviolet markers such as dots that are visible to the naked eye under ultraviolet light but not visible under normal illumination may be used.

Single pass or multiple pass

In various embodiments, scanning and correction can be accomplished in single or multiple passes. For example, it may be performed to be acquinted in the subject, and a second or subsequent pass may be performed to obtain additional data. Multiple passes of different orientations in the same area provide an opportunity to compensate for the effects of skin hair by viewing the skin at different angles.

Single pass

In one embodiment of the invention, an application device comprising a scanner and an inkjet printer makes a single pass on an area of the skin. It scans the skin, identifies unattractive traits, calculates enhancements to make the skin more attractive, and quickly applies RMAs on the skin to achieve these enhancements.

Multiple pass

In a further embodiment, the application device makes multiple passes over the skin each time enhancing the application of the RMAs to scanning and the desired enhancement or enhancements.

Of tracking process Example

In one embodiment of the tracking process, the rough position is first determined and then the correct position is determined. In a first approach, an approximate estimate of the position may be maintained from a known starting point through the use of gimbals proximate the probe to calculate the distance and direction traveled. In another approach, the approximate location can be determined from mechanical probes or gauges. In another approach, the approximate location can be estimated mathematically by using the first derivative of the shaded data.

Once the approximate location is known, a more accurate location can be determined from the analysis of the Frexel orientation from the shaded data. This is the same as the pilot that determines the position by first knowing the approximate position and then placing an area feature that provides a more accurate position.

Tracking over time

One advantage of generating maps is that a change in reflectance or surface profile can be determined by comparing the image from the first time and the image from the second time. These changes may indicate changes in the individual's health and may indicate areas that require "touch-up" of RMAs.

Frexels  Determining at least one measured skin characteristic from optical properties that affects visual appeal

Pattern recognition may be used to identify features of the area 302 of the scanned skin.

Feature identification

Reflectance and Local Anatomy

Feature identification may be based on patterns of scanned data and may have to be done with both surface local anatomy and reflectance patterns of the skin region. Mathematical pattern analysis of this data allows the identification of certain unattractive features that may benefit from enhancement techniques. As described below, such features can be characterized by age-related and damage-related patterns, which are typically irregularly or asymmetrically compared to the more regular and symmetric gene-based patterns of younger skin.

Eye perception of depth

At short distances, the human eye perceives depth by stereoscopy. In the normal human interaction range of a few feet, the eye perceives the depth of the human skin based on the reflectance of the skin. Differences in shading between adjacent areas of the skin are perceived as skin texture indicating depth or elevation from the surface of the skin. As an example of this perception, FIG. 45 shows the text character “RICK” generated in Photoshop ™. From the original image of the flat characters, the software created a distinct shade. The human eye interprets the difference in reflectance by assuming that the light source is located at the top left and the text has a raised profile to produce shadows.

This perception of depth from the difference in reflectance is also important for the perception of human beauty. The eye interprets the difference in skin shade as a surface texture. Such perception of texture can be altered by changing the reflectance of the skin. For example, in a character embodiment, the perception of the raised character can be changed dramatically by reducing the shading around the character.

The eye perceives the color of the skin and translates the color information into perception of depth. One aspect of the present invention is to selectively change the reflectance of a portion of the skin to change the perception of this depth. Such alterations, such as bumps in the skin, can be made in relatively small portions; Or alterations, such as using conventional cosmetics, such as intentionally darkening the area around the eye or cheek, can be made on a larger area.

Of unattractive features Examples

Some examples of unattractive features on the skin that can be identified from the scanned data are as follows.

Rashes,

Blotch / sun damage,

Bruise,

Bumps,

Cellulite,

Light spots,

Pitting,

· Wound,

Damaged freckles and

· wrinkle.

Other unattractive features that can be further identified include artistic patterns that are added to the skin, such as body painting and tattoos that fade over time, or distorted by changes in the skin's own pattern, such as sagging or wrinkles. There is a relationship. These features can be identified and then refreshed through the application of RMAs to refresh or enhance their appearance.

Techniques for Identifying Unattractive Features

Patterns for Age-Related Freckles in a Single Spectrum Band

For example, the natural freckles are about 2 mm long, have sharp edges, and have a pattern 442 shown in FIG. 22B. Age-related freckles, for example caused by sunlight damage, have a pattern 446 shown in FIG. 22A.

As described above, any freckles 440 associated with age that appear to elderly people, for example caused by sunlight damage, may be identified by its characteristic pattern in a single spectral band as shown in FIG. 22. Can be. When the scanned data of any freckles 440 is embedded in the spectral bands, it shows a bumpy and irregular pattern.

Patterns in Multispectral Bands

By intruding the scanned image into a multispectral banded like RGB bands, patterns with unattractive features can be identified very clearly. For example, FIG. 25 is a generalized graph of the pattern of unattractive features in RGV bands for a region of young skin showing the following empirically observed general patterns.

Wound (460)

Freckles from Sun Damage (468)

Varicose veins (476)

New, Blue Yoke (484)

Old, Yellow Bruise (492)

The set of RGB patterns for each of these unattractive features is clearly distinguished and therefore detectable through feature recognition. For example, wound 460 shows patterns in the higher frequency range in all three bands 462, 464, and 466, different from other features. The freckles 468 are deeply dipped at lower frequencies in the blue band 474 than the blue-band patterns for varicose vein 482, blue bruise 490, and yellow bruise 49. Blue bruise 484 has a larger dip in red pattern 486 and green pattern 48 than yellow bruise pattern 494 and green pattern 96. The yellow bruise blue pattern 498 deepens deeper than the blue bruise blue pattern 490.

Mapping  Advanced feature identification

Mapping based on feature identification can add significantly increased enhancement capabilities to mapping based on reflectance and surface local anatomy.

· Maintenance of registration on the entire skin surface

Translate 3-D to brightness / dark, including brightness / dark properties, using intermediate lighting for printing against aesthetic boost or for aesthetic boost

Means of compensation for special conditions

Reward for hair

In one embodiment, the presence of hair can be compensated for by taking an image in multiple passes while attempting to orient the hair in various directions. The orientation can be achieved by a comb shaped device associated with the scanner. In other embodiments, a stable charge can be used to cause an increase in hair on the skin.

Determination of the desired condition of the characteristics of the skin

The principle of attraction

The present invention utilizes the general principle 500 of attraction, such as the examples shown in FIG. These principles are based on the observation of the attributes that many consider attractive, and thus indicate the tendency of human behavior.

Means for determining the desired state of skin characteristics

Approaches for correction include pure mathematical and artificial intelligence techniques. In contrast, artistic approaches are more intuitive and less quantitative.

Mathematical

Artificial intelligence

Artistic

Mathematical means

Mathematical techniques include filtering to remove some of the intermediate frequencies and to remove some of the asymmetric low frequencies. Another embodiment of pure mathematical techniques is to print in contrast to the image to make the skin look more uniform. This treatment can be varied by spatial frequency, and it is usually desirable to have uniformity at intermediate frequencies. Low frequency correction can be more artificial or artistic based on correction over a large area of the skin.

In one embodiment, the low-pass filter may be performed at a wavelength in a desired range. In one embodiment, the 2/1 inch to 1 inch wavelength is filtered to remove some of the intermediate frequencies. As shown in FIG. 28, the weaker intermediate frequencies 390 show a less pronounced swing between the bright and dark spots than the stronger intermediate frequencies 392. In one embodiment, weak intermediate frequency components are removed to smooth the image.

low Derivation of the pass filter

In one embodiment, the low-pass filter may be performed such that the color value for the prexel is replaced by the average color value of its neighbors.

Artificial intelligence

Artificial intelligence techniques include skilled systems for the selection of methods for detecting and correcting specific skin features. In one embodiment, skin features are associated with a registry or a map to identify feature locations. The registry allows for the enhancement of blurred or distorted body painting and tattoos.

Feature Library

Another aspect of artificial intelligence technology is the use of feature libraries for feature identification and comparison of idealized features with real features.

Artistic means

Computer control

In one embodiment, the human observer can optionally use means such as a computer screen, keyboard and mouse to further correct the perceived depth of the scanned area to achieve an aesthetic improvement. The makeup artist or the customer may interact with the computer screen through controls to experiment with the enhancements before makeup.

The "cosmetic markup language" provides general instructions for darkening or brightening varicose veins of the upper surface of the ridge to the left side of the nose. Cosmetic markup language simplifies the calibration process.

Working with Multispectral Bands

In one embodiment, effective techniques may be used to enhance the identified patterns in multispectral bands, such as RGB bands. For example, as described above, FIG. 25 shows RGB for wounds 460, age related freckles 468, varicose veins 476, blue bruises 484, and yellow bruises 492 in young skin. Show the pattern. The following techniques are effective when the skin is darkening at intermediate frequencies as a whole to smooth the skin as described above.

Wound

To enhance the wound 460, magenta and yellow and fewer cyan RMAs can be applied to the wound. This adds red to make the wound 460 look pale.

varicose veins

To enhance varicose veins 476, less darkening RMAs may be added to the area around varicose veins 476.

Age-related Freckles

In order to improve age-related freckles 468, less darkening RMAs may be added to the area of freckles 468.

Blue bruise

To improve the blue bruise, less cyan RMA can be added during the normal darkening step.

Yellow bruise

To improve the yellow bruise, less yellow RMA may be added during the normal darkening step.

At least one reflectance Modifier  Authorizing step

reflectivity Of modifiers (RMAs)  type

The present invention can use a variety of reflectance modifiers (RMA), including the following.

Analine

Food coloring

UV

Transparent dyes

Transparent inks

Pigment

Oxidizer

Tanning agent

Bleach

Chemical modifier

For example, dyes do not reflect light, but act primarily by changing skin reflectance and absorbing light.

In one embodiment, RMAs can have a time delay so that their application does not have an immediate effect but takes effect later through a triggering agent. For example, RMAs may include one or more photosensitive materials that may be selectively exposed by modulated beams of ultraviolet light or other light or other forms of light and later developed by a chemical applied uniformly on the surface. Can be. For example, photosensitizers of light based materials may be used, among which silver based halides are an excellent embodiment.

Multiple passes

In one embodiment, the RMAs can be applied to the skin by scanning and printing almost simultaneously and making multiple passes on the skin. Many advantages result from using multipass applications. Micro registration problems can be reduced because multiple passes allow for blurring or blurring of the image as is known in the art. For example, multipass applications are useful for smoothing the effects of hair on the skin.

In addition, multiple pass applications of RMAs allow time for the skin to homogenize the RMAs, which is important because some types of skin will absorb better than other types of skin.

The process of a multipass application is to make a partial application of the RMAs and then rescan the area of the skin receiving the partial application. Additional applications of RMAs can be made, and other multipass scanning and applications can be made to approach aesthetic goals.

Drop (drop) control application technologies

The materials can be applied to "flow control" devices. Such flow control devices can typically be characterized as "drop control techniques" or "non-drop control techniques" in which individual droplets of material are controlled.

Spray devices and electrostatic spray devices are non-drop control techniques in which small droplets are produced and controlled solely. Often in spray devices, the lack of individual droplets or “randomness” is desirable to create a smooth application on a relatively large area. In contrast, it is desirable in the present invention to provide very specific control of the amount and placement of RMAs.

Examples of drop control include "fine flow control" and "inkjet techniques" where the flow of material is precisely controlled to deliver small droplets as desired. Conventional inkjet techniques include providing a continuous flow of filled droplets to past electrostatic current transformer plates in which the plates are alternately filled to allow small droplets to pass or deflect into a gutter. This technology is the first design principle for inkjet printers.

Other inkjet techniques include "drop on demand" such as thermal devices provided by Hewlett Packard and piezoelectric devices such as those provided by Epson and other printer manufacturers. In one embodiment of the present invention, the drop on demand technique is combined with filling small droplets.

Another embodiment of the present invention is to use conventional inkjet technology in a manner that carries small droplets filled in the scanned directional beam. Modern inkjet printers are optimized for printing on flat surfaces over limited distances. The present invention prints on the skin, which is a surface made of certain dimensions, and often requires a larger ejection distance for small droplets. This larger ejection distance can be facilitated with a desired smaller droplet than is possible with a small droplet filled.

In another embodiment of the present invention, a non-ink jet drop control technique such as a fine flow control technique is used.

As mentioned above, in this patent specification, "inkjet printer" refers to any form of inkjet technology for the sake of brevity of description.

A particularly useful technique for the present invention is to use a "drop on demand" technique, which is a subset of the drop control technique, which electrostatically fills small droplets. One of the advantages of applying filled droplets is that the applicator can be positioned further away from the skin than would otherwise be possible while maintaining accuracy. Another advantage is that since the hair is not grounded, the hair can be charged to the same level as the filled droplets, so that it does not interfere with the application to the skin. For example, drop-on techniques can be used to apply a single drop of white pigment to a point of the face with pixel-level accuracy.

In one embodiment, an inkjet printer can be used to apply RMAs on the surface of the skin and print at a resolution of 300 dpi (11.8 dpmm).

In one embodiment, an inkjet printer may have multiple printer heads to speed up an application. It can also cross the body by robotics.

It is desirable to control the application of the RMAs to the desired spray range. In one embodiment, the inkjet printer has a preferred spray distance of about 1/8 inch (3.2 mm). Various techniques can be used to guide the printer element onto the surface of the skin to maintain a desired spray distance, such as a cup, as shown in FIG.

In one embodiment, the head of the inkjet printer may include a comb to keep the hair of the skin in an orderly fixed pattern and to make the hair look good.

Example  Detailed description- Mapping -base monitoring

Example  Of the skin Map  produce

This embodiment describes one method for generating a map of the skin, analyzing the map to make a correction plan, and executing the correction plan. In this embodiment, the calibration plan typically refers to one or more applications of at least one medicament. In other embodiments, the plan includes monitoring the area of the skin more closely, without the application of the medicament.

Step 1-skin scan and skin Map  produce

In this embodiment, a map of the skin is generated from the data collected by initially scanning the skin.

In this embodiment, the general process of generating a map of the skin involves acquiring data by scanning frescels and then processing the data to generate a map. In this embodiment, the process includes determining positions of the prexel and scanning device with respect to the reference coordinate system, determining the reflection characteristics of the prexel at multiple wavelengths, and determining the inclination or orientation of the prexel with respect to the coordinate system. It includes a step. Information about the flexel and its neighbors is then processed to perform fine adjustment of the position of the flexel relative to a part of the body, such as the face, so that a map can be generated. Such fine adjustment includes referencing the prexel for the face, such as referring to the prexel associated with the recognized facial feature.

a. Data representation

One embodiment of a data representation for a prexel appears as follows:

((x _s , y _s , z _s , α _s , β _s , γ _s ),

(x _f , y _f , z _f , α _f , β _f , γ _f ),

{(refl) _A , (refl) _N , (refl) _S , (refl) _E , (refl) _W }] _i

In this embodiment, (x _s , y _s , z _s , α _s , β _s , γ _s ) and (x _f , y _f , z _f , α _f , β _f , γ _f ) are Indicate the angular orientation and position of the lexels and scanner sensors.

b. Associated with sensors or coordinate systems Frexel  location

The data elements x _f , y _f , z _f , α _f , β _f , γ _f can represent the position of the prexel from the sensor, or can be the complete position and orientation of the prexel relative to the reference coordinate system. In one embodiment, the determination of the distance from the prexel to the scanner can be made in two steps. The first step may be an approximate mechanical based measurement, such as a constant height of the sensor from the skin. The second step may be an optical first guided measurement to provide fine tuning. In one embodiment, fine adjustment is calculated by measuring the angle from the surface. In another embodiment, fine adjustment can be made by using two light sources to emit two reference points or gratings for detection by the sensor.

c. Reflectance and lighting data and calculation

The data elements {(refl) _A , (refl) _N , (refl) _S , (refl) _E , (refl) _W } refer to the Frexel (i) under ambient brightness conditions, and for ease of discussion. Represents the reflection data for each of the four light sources, such as LEDs, arbitrarily displayed as west-south-north. Other numbers of light sources, such as three light sources, can be used, but are mathematically simple when using four light sources. (refl) represents one or more data points for reflectance measurements.

Prexel data can be processed to determine reflectance and illuminance for each of the light sources, and such information can be used to determine reflectance and surface profile.

In one embodiment, the reflectance is the average or median of all measurements. The illuminance can be determined from the known brightness of light sources such as LEDs.

d. Frexel  Orientation

By determining the inclination of the prexel with respect to the two vertical axes, the orientation of the prexel can be determined. The orientation of Frexel and its neighbors represents the actual local surface texture of the skin. One aspect of the present invention is the ability to measure and compensate for both local reflection characteristics and local surface textures.

In this embodiment, there are four light sources designated east, west, north and south. The sensor acquires data when one light source is on for each light source and the other light sources are off. The sensor can also obtain data about ambient brightness when none of the four light sources are on. The slope of the prexel can be determined by comparing the north-south measurements. The difference between these measurements is related to the inclination of the flexel along the north-south axis. The difference between east and west measurements is related to the inclination of the flexel along the east-west axis.

e. Data representation of derived values

The idealized data representation for the data from the plexels is shown below. Various compression methods can be used to reduce data storage requirements. In this embodiment, each data element is shown in a complete set to demonstrate methods of data registration and map generation.

Frexel data [(x, y, z)

NS slope,

Ew slope,

(R, G, B visual color albedo)

Acquisition time] _i

(x, y, z) represents the position of the prexel relative to the coordinate system. NS slope represents the slope of the prexel relative to the EW axis. EW slope represents the slope of the prexel relative to the NS axis.

(R, G, B visual color albedo) represents the measured reflectance of Frexel in the red, green and blue spectra. One aspect of the invention is that data can be obtained for multiple wavelengths, and different wavelength data is useful for identifying skin features.

The human eye sees both reflectance and local anatomy. In one embodiment of the invention, data is obtained for both reflectance and local anatomy.

Step 2- Frexels  Registration of groups

The second step is to sense data from the plurality of precells. This part of the embodiment is similar to the problem of mapping the surface of the earth from satellite or aerial photography. In the case of aerial photographs, a large number of photographs are scaled, rotated and / or translated slightly to ensure that the images overlap properly to reflect the actual earth's surface. The map can then be created from the appropriately nested images.

In this embodiment, one factor that causes complexity is that it is essential that the data is captured at slightly different acquisition times to compensate for skin movement and minor errors at the calculated location.

This aspect of movement is similar to modeling in game applications. In the game, the model of the body includes a model of the skeleton so that the body can be associated with the skeleton. The movement can first be applied to the skeleton, and then the position of the body can be calculated from knowing the position of the skeleton and knowing the relationship between the skeleton and the body. In the present invention, the problem is rather than the shape of the body being judged, and the correction for movement during the measurement is preferred.

a. Mapping Fraxels to Maps

In this embodiment, it is desirable to associate a prexel or group of prexels with a location on the map. For example, Frexels can be part of a face, and the map is an idealized map of the face.

In the case of a face, the model can be fixed in an expressionless pose and lift the face straight up.

In one embodiment, the determination of the desired amount of each of the plurality of dyes to be applied is made by:

Generating a map of the skin at a first time; And

Analyzing the map to create a calibration plan

The calibration plan is then executed at a second time by making multiple passes over the skin with a device comprising a scanner and a dye applicator. The scanner is used to determine the location of the applicator and to determine how much additional dye is required for the location in each pass.

Example  Detailed description of the method Examples

To illustrate embodiments of the present invention, examples of enhancement processes for the following areas of human skin are given below:

· Face

· Bridge

· chest

Steps to Enhance Your Face

Unattractive and desirable properties of the face

13 shows a human face 235 with certain characteristics.

Bright spots (408)

Freckles (410)

Inhomogeneities such as wounds (412)

FIG. 14 shows a 2-D surface map 232 of the face shown in FIG. 13, which is used by the present invention and results from the scanning process disclosed above. This 2-D surface map 232 of FIG. 14 continues to maintain the above listed properties, which can be identified by the following pattern recognition:

Bright spots (408)

Freckles (410)

Inhomogeneities such as wounds (412)

Note that the 2-D surface map 232 typically includes an indication of depth in order to capture the shape of the face.

In order to enhance such a face 235 shown in FIG. 13 in accordance with the principles of attraction given above, it may be desirable to reduce or eliminate undesirable characteristics such as bright spots 408 and non-uniformity 412 from the field of view. have. At the same time, it may be desirable to continue to maintain or even enhance the appearance of a characteristic such as freckles 410, which may be characteristic of skin that looks young. Unlike conventional cosmetic technologies, where makeup tends to cover both undesirable and desirable features, the present invention can distinguish the two characteristics and process them appropriately.

Scanned  Embedding an image into spatial frequency bands

As disclosed above and shown in step 6060 of FIG. 31, the application algorithm 230 embeds the scanned image into spatial frequency bands to allow identification of characteristics in one embodiment.

16A-E illustrate the pattern of the 2-D face 232 shown in FIG. 14 after data has been embedded into spatial frequency bands.

Albedo

The upper band of FIG. 16 represents the actual “albedo” of the 2-D surface map 232. The rise in the actual albedo graph is associated with the bright spot 408. Deep and sharp descents in the graph are associated with inhomogeneities 412 such as wounds. Irregular sections are associated with freckles 410.

Illumination (shading)

The spatial frequency bands also graph the actual roughness (shading) of the 2-D surface map 232.

Feature recognition

15 shows that pattern recognition may also be related to the characteristics of the scanned 2-D surface map 232 as follows.

Hair (422)

Eyebrows (424)

Eye (426)

Cheekbone (420)

Nose (430)

Mouth (432)

Jaw (434)

By identifying such features, application algorithm 230 may determine whether to enhance such features. For example, printing the RMAs 264 on the eye 426 is typically undesirable. Thus, application algorithm 230 may remove the area representing eye 426 from considerations for improvement.

Tracking

The application algorithm 230 may also use pattern recognition to track the location of the application device 246, such as shown in FIG. 3, on the area 302 of the skin.

As mentioned above, chemical markers can be applied alternately to the skin area during scanning to help generate the map, and then to track the map to the area 302 of the skin. For example, ultraviolet markers can be used.

Comparing features to idealized features

The application algorithm 230 may compare the physical features mapped with the idealized features of the feature library 274 shown in FIG. 2 and use the comparison to correct the features. In the present invention, this comparison may be a scanned skin feature compared to images from a medical database to aid in diagnosis.

Thus, the application algorithm 230 may apply comprehensive guidelines of the scanned feature established in the feature library 274 shown in FIG.

Steps to determine actual depth

Scanning an area 302 of the skin provides the actual depth.

Steps to determine target depth

In one embodiment, the target depth may be a low spatial frequency of only the actual depth. However, aesthetic values can indicate additional engraving steps through additional mathematical or manual input. The target depth accommodates the effect of illuminance on the perceived depth or texture and is related to the angle and amount of incident light.

low Performing a Pass Filter

In one embodiment, the low-pass filter may be performed at 1/2 inch to 1 inch (12.7 to 25.4 mm) wavelengths to determine the target depth to achieve smoothing.

Steps to determine actual illuminance

Both the actual depth and the target depth are translated into the surface angle of the depth as the first derivative or slope. The surface angle is then translated into the roughness of the surface, as can be seen in 3-D modeling in applications such as game or animated graphics. Typically the estimated illuminance angle and diffusion is the average light reaching the human skin.

Step to determine target illuminance

The reflectance can again be simply algorithmically derived as a low-pass version of the actual reflectance. However, additional aesthetic attributes can be added via mathematical or manual input.

real Albedo  Judgment Step

The actual albedo is determined by the sensor of the application device as disclosed above.

goal Albedo  Judgment Step

The target albedo is determined by the principle of correction disclosed above.

In this embodiment, generalized smoothing is performed, and specific feature correction is performed. For example, the bright spots will darken, the freckles will remain as sharp as possible, and the wound will be at least partly camouflaged by a general darkening step on the skin or by specifically darkening a bright area on the top of the wound. will be.

The target albedo is the desired perceived reflectance after calculating the smoothing and feature correction.

In other embodiments, the target albedo may further include an artistic method, such as darkening a portion of the face with respect to the other.

Steps to apply aesthetic goals

In one embodiment, human observers and medical professionals can optionally use means such as computer screens, keyboards, and mice to further correct the actual depth of the scanned area to achieve an aesthetic improvement.

Improved appearance of the face

FIG. 17 shows an example of improvement through application of RMAs to the appearance of face 235 drawn in FIG. 13. The bright spots 408 and non-uniformity 412 shown in FIG. 13 have been removed in FIG. 17. However, freckles 410 remain in FIG. 17 in a variety of attractive patterns.

Single pass or multi-pass systems

Single-pass

With sufficient computational power, the application device 246 will only need to make one pass over the area 302 of the skin in order to scan the data and apply the RMAs 264.

Multi-pass

In one embodiment, the user moves the application device 46 multiple times on the area 302 of the skin. The application system then continues to scan, generates a new 2-D surface map 23 after each pass, identifies a landscape of the area 302 of the skin and has a new with each pass. Continue using 2-D surface maps 233 to calculate printable enhancement images 234, with only a portion of the drug or RMAs 264 on each pass, for example 10% -20% RMAs 264 are applied. The use of multiple passes thus allows application system 200 to partially allow RMAs 264, view the result of the application, and allow other partial applications for further enhancement. Continuation of these passes can ensure increased accuracy in the desired result. Application of RMAs 264 in multiple passes also reduces the possibility of streaking and allows drying of RMAs 264 between applications for better effect.

21 shows how many passes can be used to apply a printable enhancement image 234 (exact target) to the unprinted surface 366.

Overlapping regions

In some embodiments of the invention, it is desirable to make multiple passes of the applicator over the area. In the general case, as the applicator crosses into the area of the subsequent pass, some prexels will be shown for the first time, other prexels will have the previous first pass, and other prexels will have the previous two passes. And the like will continue. It is desirable to keep track of how often each prexel is crossing so that this information can be included in the control algorithm for applying the desired amount of RMA.

For example, it may be desirable to calibrate 50% of the target deposition of drug or RMAs on the first pass. Note that in the observation phase of the second pass, the application may generate more than 50% or less of the desired correction. This is shown to be 60%, assuming that only $ 40 remains uncorrected, it is now known that this part of the skin responds with a 6/5 stronger response to the RMA. Thus, by calculation only an RMA of 5/6 × 4/5 = 2/3 would be required on the second pass to achieve the desired effect. Assuming that instead of an algorithm chooses to deposit less than this on the second pass, the third pass then performs a final calculation of final observation and efficiency and a final deposition to accurately titrate to the desired effect by feedback.

Multiple passes may have a sequential scanning order; Thus, the upper side of the probe can always recognize the lively skin, the middle side processes the intermediate pass, and the lower side processes the strip of skin for the final pass. More practical systems allow for random movement, similar to the movement of an electric shaver, in which case the software tracks the number of times the skin's prexels have been operated. Sonic or tactile feedback may indicate completion for each prexel, and similarly electric shaving changes the sound as the completion of the effect under each pass.

Since it is generally impractical to meet an edge from the previous application pass, it is also desirable that the end portion of the applicator generally weaker the application of the RMA than in the middle of the pass. For example, if the applicator has been moved from left to right on this page, less RMA is then applied by the upper and lower portions of the printhead than calculated, to provide better overlap of passes. There will be an opportunity to print additional RMAs to these areas on subsequent passes. It is also desirable to make each pass in a different orientation to the skin and not repeat the same path to randomize measurement or deposition variations because of the distortion of the skin due to hair, skin texture and pulling. For example, if the first pass is made from left to right, the second pass may be slightly inclined clockwise and the third pass may be slightly counterclockwise.

Summary of Improvement Process

46 shows the general process of one embodiment of the present invention for visually enhancing an object, such as an area of the skin including a human face in one embodiment. "Seeing eye 380" represents scanned data around an area 302 of the skin. From an optical point of view, this data includes:

Albedo (G1)-the degree of reflectance from the surface of the area 302 of the skin

Roughness (G3)-degree of roughness (G3) of the area 302 of the skin

Depth (G5)-distance from the scanner or other reference point to the part of the skin being measured

"Tilt" or orientation of the part of the skin being measured. When combined with information from skin regions adjacent to each other, this orientation accounts for the surface profile of the skin.

"Seeing 382" represents an improvement that makes "what the eye sees 380" more attractive. These improvements, which can be calculated mathematically and selectively through manual visual correction, include the following.

Target albedo (G2)-more attractive degree of reflectance from the surface of the area 302 of the skin

Target roughness (G4)-more attractive degree of roughness (G3) of the area 302 of the skin

Target Depth G6-desired perceived distance from the scanner or other reference point to the portion of skin being measured. Note: In one embodiment, the correction to be applied is a mixture of clear dyes such that the blend and amount of dye is judged in response to the perceived reflectance of the local area of the skin-it is associated with both the skin surface profile and the actual reflectance. The correction thus applies the desired RMA to compensate for the actual reflectance and applies shading to hide or enhance the surface features.

In one embodiment, the mathematical calculations for generating target albedo G2, target roughness G4 and depth G6 may be performed with specific effects through intermediate frequency filtering.

By calculating the "things to see 382" in accordance with the principles of attraction given above, a printable enhancement image 234 may be generated for printing on the skin area 302 to make it more attractive. Can be.

Steps in the Enhancement Process

Figure 33 shows the steps of the process for achieving the enhancement techniques of the present invention in one embodiment:

Step 7100 of FIG. 33—using pattern recognition to map the physical features of the scanned area.

Step 7200 of FIG. 33-determining the actual depth of the scanned area

Step 7300 of FIG. 33-determining the target depth of the scanned area

Step 7400 of FIG. 33-determining the actual roughness of the scanned area

Step 7500 of FIG. 33-determining the target illuminance of the scanned area

Step 7600 of FIG. 33-determining the actual albedo of the scanned area

Step 7700 of FIG. 33-determining the target albedo of the scanned area

FIG. 34 shows steps of a process to achieve step 7300 of FIG. 33.

Step 7310 of FIG. 34—Perform a low-pass filter.

Step 7320 of FIG. 34-compares the mapped physical features with the idealized features of feature library 274.

Step 7330 of FIG. 34—Use pattern recognition to keep desirable characteristics.

Step 7340 of FIG. 34-Apply the aesthetic goal.

FIG. 35 shows the steps of a process to achieve step 7500 of FIG. 33.

Step 7510 of FIG. 35-performs derivation of a low-pass filter.

Step 7520 of FIG. 35-Apply the aesthetic goal.

Steps to improve legs

Undesirable Charms and Desirable Charms of 2-D Legs

18 shows a diagram of a human leg 237 having the following undesirable and preferred charms.

Cellulite 414

Natural Color Difference (416)

Varicose veins (418)

Black Mushroom (420)

Spectral bands for these characteristics are also shown, including the spectral band for printable enhancement image 234 that can be used to print the enhancement on leg 237. To simplify the description, a 2-D skin map is drawn as a 1-D graph with dashed lines across the surface of the skin.

The actual depth along these lines is plotted. In addition, a target depth is obtained. The target depth may be the low spatial frequency of the actual depth only. Aesthetic values, however, often dictate additional sculpting as is known in the cosmetics industry.

The actual depth and the target depth are translated into the surface angle, or slope, as the second derivative of the depth. Surface angles are then translated into surface roughness, as can be seen in 3-D modeling of applications such as game or animation graphs. Typically the estimated illuminance angle and diffusion is intermediate light reaching the human skin.

Printing on the skin has a negative effect on surface depth. However, visual illusion of depth is obtained by printing of the shadows. Cerulite is not actually steeoptically perceived at distances of approximately 6 inches or more. The human eye perceives cellulite mainly by shading.

Note how tanning colors against the intermediate roughness that reaches the skin, and therefore against the intermediate shades, thus making the tanned human body look smoother and more attractive. Rubbing the tanning agent does not have this property, which is sensitive to the skin angle to light, and thus does not provide the same appeal.

Examples for the legs further disclose pigmentation and varicose veins. The target reflectance can simply be derived again algorithmically as a low-pass version of the actual reflectance; However, while excluding mushrooms, aesthetic properties, such as freckles, can be added that are currently aligned with pigmentation. It may also include other selected features, such as a dwelling darkening patella.

It should be understood that the target reflectance curve and the actual reflectance curve can represent each color individually. For example, varicose veins may be blue or red, while pigmentation may be orange. Each color is thus independently corrected using colored inks such as process colors cyan, magenta and yellow.

The perceived light visualized from the leg by the human observer is illuminance * reflectivity (albedo). It is actually the actual illuminance * actual reflectance, but preferably it is the target illuminance * target reflectance. Thus, in order to get to the target in practice, overlapping (or staining) of images must be deposited on the skin. In other words,

Translated Target Angle * Target Reflectance

Translated Real Angle * Real Reflectance

Where the "translated target angle" is the target angle translated into the standard illuminance estimated to be medium illuminance; And "translated actual angle" is the actual angle translated into the standard illuminance, which is assumed to be intermediate illuminance. This provides the target correction shown as printable enhancement image 23. Individual target corrections can be derived for each color, typically red, green and blue, for printing in the order of cyan, magenta and yellow.

The dyes cause a problem that it is generally only practical to darken the skin. (In other embodiments, it is possible to selectively use a limited amount of whitening dyes or bleach to brighten areas.) Thus, for convenience, the target paint is shifted (dotted lines) to allow more skin to be correctable. This corresponds to selecting a lower target reflectance for a more tanned look.

Some details, such as blue varicose veins on the legs, may be outside the correction range using a suitable offset. These details can be corrected by depositing a small area of bright pigment rather than printing with dyes to provide the correct color. Alternatively, the far end points can be left uncorrected. If the adjacent skin becomes somewhat dark, the relative error of the uncorrected points is still less pronounced.

19 shows a view of the human leg 238 after being improved through the present invention. The following undesirable characteristics shown in FIG. 18 can be reduced from the field of view:

Cellulite 414

Varicose veins (418)

Black Mushroom (420)

However, desirable natural color differences 416 are maintained that serve to make the 3-D quality of the patella visible.

Steps to improve breasts

20 illustrates one embodiment for changing perception of the chest 239 from the actual 3D surface 342 under the intermediate roughness 340 to the aesthetic goal 344 by determining the difference 346. . Roughly applying the RMAs to this car will change the perceived appearance of the chest.

Single pass Smoothing Example

37 shows a simple smoothing embodiment for the skin. Skin regions, such as skin on the arm, are divided into a plurality of frucsels in step 900. In step 910, at least one optical property of the precsels is determined. Optical properties are shown as R _i . There is a look up table that provides a large amount of reflectance modifier to apply for each area of visual properties. In step 930, the amount of RMA applied is determined from this lookup table. A preferred amount of RMA is applied in step 940 to change the appearance of the skin region. This single pass embodiment does not require mapping of the skin.

Multiple pass Smoothing Example

38 shows multiple passes smoothing of the skin. In this figure, the preferred reflectance R _d is approached by a series of applications of reflective modifiers. The actual initial reflectance is determined at step 900 as R _a , which value provides a first amount of RMA to be applied to the first pass, which is Q ₁ . The application of the first amount Q ₁ of RMA changes the reflectance from R _a to R _i . In the second pass, R _i is used in the look up table to determine the second amount Q ₂ of the RMA to be applied. When the second amount is applied, the reflectance is changed to R ₂ . In a third pass, R ₂ is used to determine the third amount Q ₃ of the RMA. The resulting reflectance R3 approaches the desired reflectance. The number of passes is not limited to three, but may be more or less than that.

Face map Example

39 shows a face map embodiment. In the present embodiment, the skin of the face is assigned to a plurality of fraxels as before. The optical attribute is measured in step 910 as before except that the flexel position is determined, specified and recorded such that the position data for the individual precsels is present. Data for the individual prexels includes sensor position, prexel location and one or more optical attributes. Optical properties may be used to determine the orientation, reflectance and position of the prexel at step 920. Each prexel then has initial properties such as the actual reflectance. Frexel also has desirable final properties such as the desired reflectance and the amount of RMa to be applied in one or more passes. The amount of RMA is determined at step 940. Preferred reflectance is determined from enhancement methods such as smoothing, filtering of the intermediate frequency characteristics of the skin, feature recognition and feature enhancement and general artistic proposal. The preferred amount of RMA is determined from the difference between the desired reflectance and the actual reflectance.

LED array

40A is a schematic diagram of a sensor and LED arrangement. In this embodiment, the sensor is located along the axis of four LEDs designated east, west, south and north.

40B is a cross-sectional view showing that the LEDs are typically oriented to a point of the skin under the sensor. Typically LEDs and sensors are provided in the housing, the housing having reflective properties to provide more diffuse or indirect light to the prexel in some applications. In other applications it is desirable to orient the light directly in the prexel to determine the tilt of the prexel.

The depth can be determined by the shaded parallax grating projected by the LEDs from different angles. In other embodiments, two cameras may be used in the stereoscopic approach.

Feature recognition

41 shows a simple feature recognition approach. A fraxel map for a particular prexel “m” and the surrounding prexels is shown. Data for each prexel typically includes the time, location, reflectance and orientation of the prexel. The information may appear graphically as evidenced in the reflectance features of the figure. In step 910, the skin is scanned to measure optical properties. In step 920, visual characteristics, such as reflectance, are determined from the scan. In step 921, a face map is generated to provide the actual visual characteristics as perceived by the viewer. In step 922, Frexel data is reviewed to identify local features and parameters for the particular subject. One embodiment of the parameters is a range of readings of the subject, which can be used in normalization or other data manipulation. In step 924, enhancement methods are applied. In step 925, an enhancement map is provided. The enhancement map includes the amount of RMA to apply to the characteristic prexel to change its visual characteristics.

42 shows a plexel map for a portion of the face. This figure shows properties such as acne, frescels, bright spots and wounds. Each of those properties is shown in an extended position with multiple precells in the figure. These areas can be mathematically represented and detected from known properties of various skin features, and can be performed automatically with mathematical analysis.

Artistic method

43 illustrates one embodiment of a simple artistic method. When a Frexel map of a face is generated, a variety of shading methods or a wide range of overall methods for appearance can be provided.

Example  Detailed Description-System

Working environment for cosmetics

1 illustrates one embodiment of the invention used to apply RMAs 264 to a region 302 of the skin. Set up an application system 200 that includes the following elements, which are described in more detail below:

· Computing environment 100—for example, a personal computer, server or portable computing device

Scanner 220-electronically scans data regarding attributes of area 302 of the skin.

Application means 240-a printer that can be used to apply RMAs 264 such as, for example, ink.

Computation environment 200 further includes:

Application algorithm 230

Storage device 250-may be a nonvolatile data storage device.

Application map 232-generated by application algorithm 230 to provide instructions for the application on the area 302 of the skin

Printable Enhancement Image 234-a set of instructions for applications on the area 302 of the skin.

Loosely Combined  system

In one embodiment, elements of the application system 200 may be connected via links 142 and 144 that include individual units and may include internal connections. For example, FIG. 2 illustrates one embodiment of loosely connected elements for applications on an area 302 of the skin. Scanner 220, printer 241, and computing environment 100 communicate over network 130 and links 142, 144, and 146. Network 130 may include the Internet, a private local area network (LAN), a wireless network, a Transmission Control Protocol / Internet Protocol (TCP / IP) network, or other communication system, and may include multiple elements such as gateways, routers, and switches. Can include them. The links 142, 144, and 146 may be compatible with the technology used for the network 130.

Feature library 274 can be used to store human traits, such as eye, nose and mouth characteristics, for use by pattern recognition. Feature library 274 can also be used to store idealized patterns for human features that can be used to make real features appear more attractive. For example, an idealized pattern on human lips can be used to make the actual lips look plumper and red. For the application map 232 shown in FIG. 1, the 2-D surface map 233 shown in FIG. 2 is used. 2-D surface maps typically include an indication of depth to capture the shape of the face.

In addition, mechanical or electronic registration means 270 are used to track the position of scanner 220 and printer 241 relative to area 302 of the skin.

Connected to a computer Combined  Printers and scanners

3 shows one embodiment where the application device 246 includes a scanner 220 and an inkjet printer 242 to apply RMAs from the reservoir 262 to the area 302 of the skin. The application device 246 also communicates via the network 130.

reflectivity Modifier

4 illustrates one embodiment in which the RMAs 264 may include scarlet 265, yellow 266, and cyan 267 RMAs. In other embodiments, RMAs 264 may additionally include black or brown and white.

Application device

Application device 246 includes a handheld inkjet printer 242 and handheld scanner 220 shown in FIG. In this embodiment, the device has height-determining means such as a tip or cup to secure the device to a uniform height of 1/8 to 1/4 inch (3.2 to 6.4 mm) from the skin. The improvement of the probe must be accurate to within a few millimeters. The device uses mirrors or two cameras. It typically allows ten passes to cover 150 square inches (1000 square centimeters) of the face, and the time required to complete the process is comparable to the time required for electric shaving. The device is less than 2 inches (50 mm) long.

Handheld scanner

In one embodiment, the handheld scanner 220 includes an array of areas that lightly touches the surface of the area 302 of the skin to be scanned. In another embodiment, the portable scanner is moved without touching the skin near the skin being scanned. During scanning, the sensor's white LED light source flashes light to apply standard light, defined as light from above, to the area 302 of the skin. The measurement occurs when the LED is on and off, and the difference between the two measurements is subtracted to determine the contribution of the light source.

Inkjet  printer

In one embodiment, the inkjet printer 242 includes an inkjet printer with .001 inch resolution and a reservoir 262 that can secure the RMAs 264. In one embodiment, the RMAs 264 include transparent dyes, while in other embodiments ink or other useful chemicals. In one embodiment, FDA-approved RMAs are used. As shown in FIG. 4, the RMAs 264 may include medication for the following colors: magenta 265, yellow 266 and cyan 267. RMAs may include additional colors such as black, brown and white. These colors allow inkjet printer 242 to generate any color on the human skin area.

Means of registration

As mentioned above, mechanical or electronic registration means 270 is used to track the position of scanner 220 and printer 241 relative to area 302 of the skin. In one embodiment, the registration means 270 may include an accelerometer for measuring acceleration and inclination, and a gimbal for measuring rotation and controlling rotation of the three-dimensional object, and may be further included in the application device 246. These devices assist in movement and placement control and help maintain an accurate reflection angle for the application device 246.

In another embodiment, the registration means may comprise a global positioning system (GPS) which is used locally via high frequency radiation.

In yet another embodiment, the registration means may comprise a set of small flat-ended pins which are slightly pressed against the surface of the skin. For example, the pins may be pressed against the skin to make a mask of the face. The movement of the pins in the frame can be mechanically tracked to provide 3-D coordinates.

Portable applications device

As shown in FIG. 5, another embodiment of the present invention is a portable application device 260 that includes multiple elements for applying material onto the skin, which does not require an external network. One embodiment of portable application device 260 uses inkjet printer 242 to apply ink 248 to area 302 of the skin.

Portable application with curved surfaces device

One aspect of the invention is to acquire and process image data of the human skin. In one embodiment, the first step is used to generate a map of a portion of the body, and the map is used to create a specific scheme for selectively applying dyes later. One embodiment of the present invention is to use a portable scanning device to obtain data to generate a map; The use of a portable scanning device in conjunction with a portable printing device to selectively apply dyes to areas of the skin. 30 illustrates an embodiment of the present invention that may be used to apply a substance on the skin via communication on a portable application device having a curved surface and on a network.

Mask or helmet

The curved surface may include, for example, an application device (scanner / printer) surrounding the face and a mask or helmet into which a human face may be inserted. The use of such curved surfaces requires feature recognition through artificial intelligence and mapping so that the application device can calculate distance from the skin and location on the face.

One advantage of the curved device is that it does not require user action or tanning. Another advantage is that no application device remains on the skin and does not touch damp RMAs.

booth

Another embodiment of the invention is to use a booth or workstation to scan an area of the skin, such as the face or the whole body.

27 shows one embodiment of an application device 246 including a booth. In this case, as shown in FIG. 36, the area of skin 302 includes everyone entering the application device 246 through the door 282. Such a person would undress and lie down or stand for RMA's application, just as in a tanning booth. Scanner / applicator 284 comprising scanner 220, reservoir 262 and inkjet printer 242 with RMAs 264 and registration means 270 collects data, analyzes the data, It will move on the individual's body to improve by authorization.

In other embodiments, the booth may comprise a two part cylinder that encloses part or all of the individual, such as the face.

Blotter (blotter)

29 shows one embodiment with an application device that includes a blotter. The blotter includes a cup 280 to maintain a roughly suitable distance from the area 302 of the skin, as described above. Instead of moving the blotter application device 246 to a single pass or multiple passes on the enter area 302 of the skin, the user places the blotter application device 246 on a small area of the skin and briefly Fixed therein to achieve application, analysis and scanning of RMAs in a small area of the skin, and then move the blotter application device 246 to the next small area.

For the blotter application device 246, mechanical means will move the printer 24 over the area 302 of the skin for the application of the RMAs 264. For example, FIG. 44 shows an inverted view of an application device 246 that includes a blotter. In one embodiment, the blotter application device 246 is a rotating inkjet printer 294 that moves around a central axis on the application device 246, such as four LEDs 290, two cameras 292, and a clock hand. It includes. The rotary inkjet printer 294 prints the RMAs through the area of the blotter application device 246 except for the area of the central axis, which can be printed by moving the blotter to the overlap area for second printing.

Light sources

40A-B are sample layouts for LEDs and sensors for obtaining reflectance and skin orientation data.

In one embodiment, a set of four light sources is used so that the light sources are located at the corners of the diamond, where the sensor is located in the center of the diamond layout. This configuration simplifies the mathematical analysis for calculating the surface profile.

In one embodiment, it is useful to use medium roughness. To this end, multiple diffuse or vertical light sources can be used in a configuration that can include a mirror. The lights can be repeated and repeated as flash lights to flash the light, so that hundreds of images that can be generated in a small area can be averaged for efficiency.

For cosmetics Application  Process for using the system

6 shows a process for using the application system 200 in one embodiment. This process includes the following high-level steps, which will be described in more detail below:

Step 1000 of FIG. 6-scanning the area 302 of the skin to determine attributes and placing RMAs 264 in the area 302 of the skin of the register that matches or opposes the determined attributes. Setting up an application system 200 based on the step of authorizing.

Step 2000 of FIG. 6-scanning the area 302 of the skin

Step 3000 of FIG. 6-analyzing the scanned data with the application algorithm 230

Step 4000 of FIG. 6-analyzing the scanned data with the application algorithm 230

Step 5000 of FIG. 6-generating the printable enhancement image 234 with the application algorithm 230

Step 5200 of Figure 6-optionally repeating steps 2000-5000.

Steps to Set Up an Application System

FIG. 7 shows a process for setting up 1000 the application system 200 shown in FIG. 6 in one embodiment. The process includes the following steps to be described below:

Step 1010 of FIG. 7 providing the application algorithm 230

Step 1020 of FIG. 7-providing an application algorithm 230 on the computing environment 100

Step 1030 of FIG. 7-providing storage 250 on the computing environment

Step 1040 of FIG. 7-incorporating the scanning means 220 on the area 302 of the skin.

Step 1050 of FIG. 7-incorporating the application 240 means of the RMAs 264

Providing an Application Algorithm

One or more programmers in one embodiment create an application algorithm 230 that controls the processes and elements of the present invention as outlined in FIG. 6 and described above. After the application algorithm 230 is generated, it can be used on at least one computing environment 100 as shown in FIG. 1 and can be integrated with other elements of the application system 200. For example, in one embodiment application algorithm 230 may be loaded on computing environment 100 that includes a server. The computing environment 100 may include a nonvolatile memory device 250 capable of storing data, such as data scanned from the scanner 220.

In various embodiments, the application algorithm can include default methods that can be based on feature recognition, feature-based lookup design, or general artistic purpose.

As shown in FIG. 8, the general functions to be achieved by the application algorithm 230 in one embodiment are as follows.

Coordinate pixel-level mapping of the skin by scanning

Providing a specific recognition or accepting a manual selection of image enhancement methods

Generating a printable enhancement image 234

Adjusting the pixel-level application of the material to achieve the determined improvements

Pixel-level of the skin by scanning Mapping  Step to adjust

The main function of the application algorithm 230 is to analyze the data scanned around the region of the first example of the substance 300, and a 3-D application of the attributes of the region 200 in which the second example of the substance 300 will be useful. To create a map 232. The main part of this function is whether the application algorithm 230 is at each scanned point whether the application of the second example of the substance is in a register that matches an attribute of the region of the second example of the substance or in a register against such attributes. To judge. This determination is based on the instructions of the algorithm as to what is useful and beneficial for the area of the first example of material 300.

31 shows the following steps involved in adjusting scanning:

Step 602 of FIG. 31-initiating scanning by scanner 220.

When the application device 246 is turned on and moves over the area 302 of the skin, the scanner 220 starts scanning.

Step 604 of FIG. 31-sending the scanned data to the computing environment 100.

The application device 246 sends the scanned data on the link 144, the network 130, and the link 142 to the computing environment 100.

Step 606 of FIG. 31-storing the scanned data in the storage device 250.

Step 608 of FIG. 31-embedding the scanned data into spatial frequency bands

Printable  Steps to Generate an Enhancement Image

The purpose of the cosmetic embodiment of the present invention is to understand and use the characteristics of the human visual system to enable the observer to perceive a person younger than the actual age. This can be considered in the form of camouflage performed at the pixel level. Note that in order to achieve this object it is important that the techniques of the present invention do not erase all the details in the area of the affected skin, but keep the remarkable desirable details that make the area of the skin look real. To accomplish this goal, the present invention uses the sophisticated techniques described below to generate a printable enhancement image 234 for proper application of the RMAs 264.

9 shows a process for creating a printable enhancement image 234 in one embodiment.

9605-Converting the 3-D scan to a 2-D surface map 233 in the computer model.

10 shows one embodiment of how a 3-D human face 235 maps to a 2-D surface map of the face 233 through known techniques used in computer modeling and gaming. For this 2-D mapping, all small (limited) surfaces are flat, creating a razor model for the "base."

9605-using pattern recognition to identify the specified features 310 of the 2-D surface map 233. For example, pattern recognition can be used to identify the eye.

Step 6603 of FIG. 9-using the identified features 310 to further identify portions of the skin 320 that will not be enhanced.

For example, it would be desirable to specify that the eye does not potentially improve by irritating the RMAs.

Step 6056 of FIG. 9-Eliminate parts that do not improve from the calculation.

For example, the eye can be removed from the calculation.

Step 6058 of FIG. 9-using enhancement techniques 600 on correctable features 330 to achieve an aesthetic purpose.

Enhancement techniques utilized in the present invention are described in detail below.

Adjusting the pixel-level application of the reflectance modifier to achieve the determined improvement.

As shown in FIG. 32, adjusting the pixel-level application of the RMAs 264 to achieve the determined improvement may be accomplished through the following steps:

Step 6060 of FIG. 32—Send printable enhancement image 234 to application device 246.

Step 6070 of FIG. 32-using the inkjet printer 242 to apply the RMAs 264 to print the printable enhancement image 234.

Enhancement behavior

Operation of the present invention may be shown in connection with the computing environment and application device 246 shown in FIG.

scanning

The user moves the application device 246 over the area 302 of the skin so that the scanner 220 can record the data. For example, the area 302 of the skin may be the face of the user. The scanner 220 transmits the scanned data through the network 130 to the computing environment 100 in which data is stored in the storage device 250.

In one embodiment, the user may be asked to use the tapping or blotting movement of the probe rather than making smooth passes as if moving the electric shaver on the face. This movement reduces staining in the application of RMAs.

In one embodiment, the user may be asked to estimate the neutral floating position in order to represent the neutral model. For example, for use with a face, the user may be asked to stop with his eyes closed and no expression. For use with the telegraph, the user may be asked to stand still at a particular location in the booth.

Scanned  Steps to analyze your data

The application algorithm 230 embeds the stored data into spatial frequency bands and analyzes the stored data to determine the dimensions of the landscape of the skin region 302 and the dimensions that request the application of the RMAs 264. Use awareness.

The application algorithm 230 uses its analysis to create a 2-D surface map 233 of the area 302 of the skin in software, which is stored in the memory 250 for potential later use. .

Printable  Steps to Generate an Enhancement Image

The application algorithm 230 also generates a printable enhancement image 234 based on the 2-D surface map 233.

Alternatively, note that the printable enhancement image 234 can be manually created by an operator who displays the map on the computer screen and uses the controls for the desired adjustment.

Improve Printing  step

Application algorithm 230 is printable via network 130 to application device 246 causing inkjet printer 242 to apply RMAs 264 from reservoir 262 to area 302 of the skin. Send enhancement image 234. Inkjet printer 242 applies different amounts and blends of RMAs 264 at the pixel level to produce desirable results in different parts of the area 302 of the skin that make the application very accurate.

In various embodiments, the scanning and printing components can be provided in a portable fixture or booth system.

Of small devices Example

In a small appliance system, the device may be the size of an electric razor or powder puff, leaving stains or moving on the skin. The device can be used in single pass mode to provide general smoothing of skin appearance, or in multiple pass mode where multiple passes on each skin area are used to provide a relatively small correction on each pass. have. The system may include feedback means such as a tone to indicate that the operation has been completed.

Of handheld device scanners that touch the skin Example

26 shows a handheld device scanner. In this embodiment, the scanner housing is held at an approximately known distance and orientation relative to the skin or application device such as a printer head by touching the skin.

Face modelling  And Printing  Helmet guide for Example

Helmet mode is one embodiment of a fixture system in which the scanning and application device has a limited travel path. The fixed system can include coordinate reference points, a guide strip, and a movable probe.

Application Example  -Face makeup

For example, a user may move the application device 246 over his face, such that the RMAs 264 are applied in the form of makeup to enhance the attractiveness of the face. These RMAs continue to maintain desirable details such as beauty moles, add red color to the cheeks, conceal skin cuts and blemishes, and enhance skin tone while greatly enhancing the attractiveness of the skin to the human eye. Transparent dyes, or inks or pigments, to even out. Typically, in one embodiment the user will close eyes and mouth to prevent exposure to the RMAs 264. In another embodiment, the system will use feature identification to recognize sensitive areas, such as the eye, and to prevent applying RMAs 264 to those sensitive areas.

Minor modifications ( touchup )

Once the 2-D surface map 233 and printable enhancement image 234 for the face have been stored, they are displayed on the face with the RMAs (eg, the application device 246) for quick correction with, for example, daily cosmetics. 264 may be used repeatedly to quickly apply.

Note that the printable enhancement image 234 can be stored in a register in accordance with or against attributes of the area of the face. For example, bright areas of skin may be left relatively bright or dark depending on the desired effect calculated by the application algorithm 230.

Tanning By imitating  Steps to disguise the bumps

The present invention can identify a very small area 400, for example, with a surface texture deviation that represents a small ridge shown in FIG. Because it accommodates more illumination by the surface angle to the light source, it applies ink or dye to the apparently brighter portion 404 of the ridge 400 and draws the shaded apparently darker portion 406 below the ridge. It can not be darkened. This reduces the contrast of light and dark associated with the dimensions of the ridges, making the skin look smoother.

Detailed Description of the Examples-Small Device Trace Applicator

47A is a side view of one embodiment of a small instrument device for skin traces such as blotch, small wounds and varicose veins. FIG. 47B is a front view of the device of FIG. 47A, and FIG. 47C is a top cross sectional view along section AA ′ of FIG. 47B.

The trail applicator device 550 includes a housing 553 that provides an upper handle portion and a lower skin application portion. In this embodiment, the device is about one and one-half to two inches (38-50 mm) wide and about 4-5 inches (100-127 mm) long. In this embodiment, the opening of the base 554 of the housing is about 1/2 to 3/4 inch squared (12.7-19.2 mm squared).

At least one light source is used. In this embodiment, four light sources are located adjacent to the four corners of the square tube. The light sources are typically white light LEDs or a combination of LEDs such as red, green and blue to form white light, but the light sources can also be varying wavelengths to provide additional data for trace recognition. In some cases, a single light source can be used. Advantages of using individual wavelength light sources include great sensitivity, good color accuracy and high resolution. However, in the booth and mobile handheld device embodiments disclosed above, these advantages cannot overcome the time and practical difficulties required to address four different lighting conditions for each set of precells. Most cameras can provide excellent color images from a white light source.

However, in this embodiment, the camera is not moved, and it is more practical to obtain an image from each of the plurality of colors of the light sources and from the white light generated when all the light sources are on. Thus, some embodiments of the present applicator include light sources of different wavelengths, providing additional image data and better white light at multiple wavelengths to support more sophisticated feature recognition.

In general, the light source or light sources in this embodiment and other embodiments may be of various wavelengths including visible light, infrared light and ultraviolet light. Infrared wavelengths provide good penetration of the skin to support feature recognition.

The lower part of the tube preferably has a reflective surface, such as polished and fine haired aluminum or steel, so that the light sources reflect off the housing wall and provide uniform illumination to the exposed skin area. These reflective surfaces are similar to optical fibers. Camera 552 captures an image of the exposed area as described below. The print head 560 is moved above the opening to print the desired correction for the area, and in particular for the trace. Other components of the housing include at least one RMA cartridge 564 and electronics such as a battery 566 and a circuit board 562. The term RMA is used herein in the general sense, and the cartridge or cartridges may include pigments or other drugs.

In operation, at step 7900 the device is positioned over an area of skin having a trace that the user wishes to disguise. The device is held in place for a predetermined time period or until completion of a unit signal such as status light or audible tone. The user then presses the switch on the housing (not shown), and the unit typically performs the following actions:

In response to the user pressing the switch on the housing at step 7910, the unit completes the following steps.

At step 7920, the camera captures the first image at ambient brightness with the camera of the area of skin exposed by the base opening. Even when the unit is pressed against the skin, some light travels through the skin and partially illuminates the area.

In step 7930, the light sources are turned on.

At step 7940, the camera captures a second image with the camera while the light sources are on.

At step 7950, the unit analyzes the images, which may include the following steps. Subtracting the first image from the second image at step 7172; Identifying a trace at step 7944; And determining the desired corrected reflectance for the trail and adjacent skin at step 7768.

In step 7960, the desired amount of RMA to be printed on the trail is determined to achieve the desired correction. Generally opaque and white RMAs will typically be used to disguise the small traces of this example. The material will be similar to a conventional makeup base, but will be lighter or whiter than the makeup base. In one embodiment, the RMA is pure white or one wavelength white such as soft pink. The RMA is preferably lighter than the skin so that a small amount can be used on the traces in a manner that harmonizes around the skin.

In step 7970, a correction is printed in one or more print head passes. The printing method of one embodiment includes printing a portion of the desired correction of the first pass in step 7772; Taking an image of an area of the skin after printing the first portion in step 7748; Analyzing the image at step 7768; Adjusting an amount to be printed in the second pass according to image analysis in step 7798; And printing at least some of the correction amounts remaining in the second pass in step 779. Additional passes may be performed as needed. In this embodiment a "pass" refers to a print head that is moving over the skin area. All other components and the housing remain stationary. The second pass provides an opportunity to compare the actual correction with the expected correction and compensate for the difference. For example, if less corrections are printed than the desired corrections, the unit may print more than the calculated amount remaining in the second pass; If more corrections are printed than the desired correction, then the unit will print less than the calculated amount remaining in the second pass.

Detailed Description of the Examples-Specialized Skin Area Applicator

In this embodiment, the unit is provided for printing specialized areas of the skin, such as around the lips or eyes. The unit is provided as a booth-type fixture but is preferably portable such as a small appliance device. The device may include a portable support, such as a jaw, to provide stability and alignment.

In one embodiment, for the lips and nearby skin areas, a device similar to the small instrument trace applicator of the disclosed embodiment can be used. The unit typically has multiple cars for the trail applicator. In this embodiment, the unit is typically larger than the mark applicator, and the openings may be elliptic-like shapes that more closely match the skin region. Since the skin region can have a significant curvature, the print head can typically have a z-axis characteristic that will be moved closer to the skin and also as it will be moved from the skin as the head is moved over the area.

Multiple light sources as disclosed in this embodiment are effective to provide a "shading" analysis of the Frexel orientation on small areas. Since areas such as the lips have larger shape features as well as local features, it is desirable to supplement the shading analysis with stereoscopic methods. For example, the use of two cameras allows for comparison of images to develop local shadow analysis as well as stereoscopic image analysis of regions. The two approaches are therefore complementary.

In this embodiment, the device is located on the lip, or in the case of the booth device, and the lip is located in the booth. Images are taken by a pair of cameras with multiple light sources under various lighting conditions. Image data from one or two cameras can be used to determine the prexel orientation as disclosed above. Image data from two cameras can also be used to develop stereoscopic image analysis.

The analysis is used to develop a calibration plan. The calibration plan is executed by moving the print head over the area-preferably in multiple passes-to apply one or more RMAs. In this embodiment, the print head has z-axis control so that the head is close to the lips or may additionally come from the lips as needed.

Alternative Examples

Other hardware and software

It will be apparent to those skilled in the art that different embodiments of the present invention may utilize a wide variety of possible hardware and software techniques. For example, communication between a web service provider and a client business computer may be via any number of links, including wired, wireless, infrared or wireless, and other communication networks in addition to those disclosed above, including any that do not yet exist. Can occur through

In addition, the term computer is used herein in a broad sense, including personal computers, laptops, computer-capable telephones, personal digital assistants (PDAs), and servers, in which software functions and memories are divided among the servers. It should be appreciated that it may include multiple servers with devices. Various operating systems, compatible email services, web browsers and other communication systems can be used to transfer messages between client applications and web services.

Detailed Description of the Examples-Determining Reflectance and Local Anatomy of the Skin Region for Medical Monitoring

In this embodiment, devices and techniques for the above-described analysis for image acquisition and cosmetic embodiments are provided to provide one or more images for medical analysis. Such techniques include providing multiple light sources to allow fine shading analysis to evaluate fine details of skin form; Providing two or more cameras to allow stereoscopic image analysis of skin regions that provide both stereoscopic image analysis and shadowing; Developing a map of the skin area and comparing the map or feature with the library to aid analysis; And comparing the maps obtained at different times to determine and record changes over time.

Such techniques include full body booths; Partial booths for areas of the skin such as face, arms, legs, torso or the like; A miniature scanning device moving over the skin; Or in a variety of housings, including smaller, compact devices positioned in a fixed manner on certain skin traces such as warts, and the housing is not limited thereto.

Detailed Description of the Embodiments-Selectively Applying a Drug

In this embodiment, the devices and techniques for image acquisition and analysis further comprise at least one print head or other drop control device for applying one or more medications in response to the analysis.

Such techniques may be provided in the full range of housings as disclosed above.

Detailed Description of the Embodiments-Configuring the Cosmetic System for Medical Monitoring or Selective Drug Application

In one embodiment, the monitoring of the skin area is provided in the routine routine use course of the cosmetic device as disclosed above.

In another embodiment, monitoring of the skin area is provided complementary to routine routine use courses of cosmetic devices as disclosed above.

In another embodiment, the disclosed cosmetic device is configured to apply one or more medications on the skin area and in one or more passes in one or more treatment sessions. One or more additional application heads and reservoirs may be provided for the medication.

The present application is used for medical monitoring and selective application of drugs and other compounds that are beneficial to the health systems and methods described by the cross-referenced patent applications above.

In accordance with the present invention, the data collected by the cosmetic systems and methods of cross-referenced applications are repurposed for medical purposes. Such a process may provide periodic monitoring of all or part of the outer surface of the human body for early detection and treatment of medical problems. For example, daily monitoring according to the present invention to track all skin damage in the precancerous range will allow such damage to be treated early, making untreated skin cancers of the past. For other embodiments. Such daily monitoring can provide teenagers with early diagnosis of the consequences of various behaviors such as acne resulting from inadequate skin care and ingesting unhealthy foods in a manner similar to biocontrol.

In addition, a system of cross-referenced applications may be used for the application of a medicament.

process

In one embodiment, the present invention uses the following process shown in FIG.

Step 8000 of FIG. 48-collecting the scanned data via the scanning device

Step 8100 of FIG. 48-defining the baseline

Step 8200 of FIG. 48-identifying a medical problem

Step 8300 of FIG. 48-reporting on a medical problem

Step 8400 of FIG. 48-selectively applying drug when appropriate

Step 8000 of FIG. 48-Scanning Device  through Scanned  Steps to Collect Data

Any scanning device known in the art can be used. In one embodiment, the scanning device may comprise a computer-controlled cosmetic system described by the cross-referenced patent application, which may be a systemic system. At any time when an individual uses a cosmetic system, the scanned data for all or part of the outer surface of the body is collected and quantified. The cosmetic system embeds the data into one or more spectral bands, where the reflectance and surface local anatomy data can be analyzed to identify medically relevant patterns and change them to previously identified properties.

Many people use cosmetics every day or several times a day. Since the use of cosmetics occurs much more frequently than the conventional use of medical examinations, more data can be collected for an individual more often and more consistently than is possible through conventional techniques.

50 is a bar graph showing the number of samples collected for medical monitoring of an individual for one year by different data collection methods.

Method A represents a test done once a year by a general practitioner.

Method B represents testing done every six months by a medical professional.

Method C represents testing performed every three months by the expert.

Method D represents data collected during one makeup each week.

Method E represents the data collected when makeup was made twice a week.

Method F shows a very large amount of data that can be collected when makeup is made daily.

As shown in FIG. 50, a woman wearing mail makeup through the present invention will collect 365 times more medical information from a very large number of statistically significant samples than through a medical examination once a year. The woman can also collect medical data 365 times more often, which can greatly help early detection of medical problems.

More frequent monitoring can have many medical advantages. It can lead to early detection of medical problems. It can be used to generate better baselines for various physical states of humans compared to rare monitoring and create a history of these states over the life of each individual. Many changes to the physical state are common. For example, after exercise, muscles bulge, and mosquito bites cause bumps on the skin of a person. But prolonged bumps in the same place can be medically important.

Step 8100 of FIG. 48-defining the baseline

The systems and methods of the cited cross-reference application cited above generate a 3-D model of the scanned outer surface of all or part of the human body. The present invention uses feature recognition software to analyze the scanned data appearing in the 3-D model and establish a medical baseline of an individual's physical characteristics as shown in reflectance data and surface local anatomy data.

For example, the reflectance data can show medically appropriate color and other features of the area of the skin. Bright areas of the skin can represent relatively healthy areas. Darker areas may exhibit warts and freckles. Very bright areas can indicate wounds. Redness of the cheeks can indicate a healthy color.

Surface local anatomy data can show the relative depth of the region. For example, smooth areas of the skin can be identified as well as protrusions such as bumps and the skin. Recesses such as pores and wrinkles can also be identified.

As a result, a baseline of the scanned area can be generated and appear in a 3-D map showing the medically appropriate state.

Step 8200 of FIG. 48-Identifying a medical problem

Feature recognition software can identify medical problems in a variety of ways, as shown in FIG. 2.

Step 8210 of FIG. 48-Analyzing Baseline 3-D Image

Feature recognition software can potentially identify existing medical problems in baseline 3-D images such as acne, bruising, tumors and melanoma by characteristic patterns of reflectance and surface local anatomy. When medical problems are identified, the present invention reports the problems as described below, so that the problems can be treated. For example, changes showing that areas of the skin become concave over time may indicate structural deterioration as a result of malignant cells. If such changes are identified, the identified changes are reported. Buffiness or depression in large areas of the skin can indicate cancer, atrophy, water and other deeply located pathologies.

Step 8220 of FIG. 48-Identifying a change to the baseline

Whenever additional scanned data about an individual is collected via the cosmetic system, the present invention uses feature recognition software to track changes to the medical baseline that indicate changes in physical properties. This can provide data on periodic phases of medically relevant conditions and on what changes occur periodically for a particular individual.

For example, the reflectance data can show medically relevant changes in color and other features of the area of the skin. Sudden blue areas can indicate bruising. Sudden red areas can indicate acne or sunburn. Changes in the color and pattern of the warts can indicate cancer. It may be medically relevant to determining whether such a change has previously occurred in an individual.

Regarding surface local anatomy data, for example, swelling in previously smooth skin areas may indicate cancer, ridges may indicate bruising and new wounds, and depression of the skin may indicate internal disease.

Step 8230 of FIG. 48-Analyzing the change to identify medical problems

The identified changes are further analyzed by comparing the data in the software library showing the characteristics of the medical problems as expressed in the pattern of surface local anatomy and reflectivity, for example via Bayesien likelihood equation.

Of unhealthy traits Examples

The following list shows some embodiments of unhealthy characteristics of the outer surface of the human body that the present invention identifies.

acne

Analysis of Reflectance Data: Pigments can identify the reddish rash of acne typically caused by viruses. Blackheads may appear. White pus may come out.

Analysis of surface local anatomy data: Changes in shape can identify swelling of acne wounds.

Breast cancer

Analysis of Reflectance Data: Surfaces can identify rapid changes in vascularization of cancer. Changes in the vascular pattern through thicker veins or skin are suspicious because their early stage cancer cells pull blood to feed themselves. Sudden reddening of the chest may further indicate a condition as the condition is conditioned by measurements elsewhere in the body indicating exposure to the sun, especially when the redness is speckled.

Analysis of Surface Local Anatomy Data: Thicker veins can create bulging areas on the surface of the skin. Later, the cancer can destroy the surrounding tissue, so the affected area appears to contract or dent. In general, thickening and changes in the shape of lumps or chests may indicate cancer.

jaundice

Analysis of Reflectance Data: Rapid color change to yellow can indicate liver failure.

Melanoma

Analysis of Reflectance Data: Known ABCD Patterns Indicate Melanoma:

Asymmetry-the two halves of the skin spots are not similar to each other.

Borderline-The borderline of the spot is irregular scalloped or incompletely formed.

Color-The color of the spot changes from one area to another. The shades of color are tan, brown, black and sometimes white, red or blue.

Diameter-the diameter of the spot is greater than 6 mm.

Analysis of surface local anatomy data: bumps, irregular growth changes

varicose veins

Analysis of Reflectance Data: Reflectance changes to blue can characterize varicose veins.

Analysis of superficial local anatomical data: swelling and enlargement can also characterize varicose veins.

Step 8300 of FIG. 48-Report on Medical Problems

The present invention identifies patterns that potentially represent medical problems during the generation of an initial 3-D map of medically relevant patterns or during subsequent comparison of changes to the baseline 3-D map. After identifying medical problems, the present invention reports on them. The reporting means may have different forms known or unknown in different embodiments. For example, in different embodiments the reporting means may be a printer, computer display or email.

51 illustrates a computing environment 700 loosely connected via a network 730 to a handheld scanner and inkjet printer 842, in which the present invention represents the elements of the aforementioned cross-reference application for scanning of the area 902 of the skin. One embodiment is shown. The computing environment 700 is directly connected to the printer 710 and the display 720, and is also connected to the legislator via the network 730.

Computing environment 700 may communicate with handheld scanner and inkjet printer 842 and lawmaker 910 via network 730 and links 742, 744, and 746.

Network 730 may include the Internet, a personal LAN, a wireless network, a TCP / IP network, or other communication system, and may include multiple elements such as gateways, routers, and switches. The links 742, 744, and 746 are compatible with the technology used for the network 730.

After identifying medical problems, the present invention uses software 740 on computing environment 700 to report such problems in accordance with the parameters of software 730 identified by the user. For example, the user may specify that it is displayed on the display 720, printed on the printer 710, or sent to the member 910 by email for review.

Step 8400 of Figure 48-selectively applying drugs at the appropriate time

Authorization of the drug

In one embodiment, the present invention can apply the appropriate compound to the medical problems identified at the appropriate time. This can even be done without asking the patient for any action. For example, one embodiment may automatically apply sunblock to areas of the skin that are periodically sunburned. Other embodiments may automatically apply acne medication to acne and apply antiseptic ointment to the wound at an early stage of the development of acne. Another embodiment may apply live skin cells or other substitute material to the burnt area of the patient's skin with high precision.

For some conditions, such as acne, the drug can be applied very precisely at the pixel level only to areas affected by disease or medical problems. This typically allows for stronger and more effective dosages of drugs to be used more than would be possible through standard broadcast topical application as well as applications in the early stages of medical conditions due to early detection. Standard acne medications would be harmful if used in dense amounts over a large area of skin. However, with the present invention the acne medication is very small but can be clearly applied to the pores of the acne jerky in dense doses administered periodically, such as during daily makeup sessions. To illustrate other embodiments, the present invention may apply a medical compound directly to the pores bited by mosquitoes to calm itching and reduce swelling and redness.

The ability for correct application of drugs allows their modified application. For example, sun blocks may be selectively applied so that unturned surfaces that receive more light, such as backs or hands, or are exposed to the sun more frequently and age faster, may be protected more strongly. When used cosmetically, the area of skin to be tanned can be corrected to the prexel level by sunscreen applications. For example, applying more sunscreen to a pigmented area, such as damaged skin, may cause the area to be brighter than the surrounding area with less sunscreen. The sunburned areas can be similarly prevented for aesthetic purposes and can be a supplement to the application of transparent cosmetics.

In addition, medical compounds can be used by themselves for cosmetic purposes. For example, white sunblock ointment can be used to make dark spots unattractive on the skin, making the skin more attractive.

system

In order to apply pharmaceutical and medically beneficial compounds, the invention may in one embodiment use the system provided by the cross-reference application mentioned above. However, corrections can be made to the system for medical applications of the present invention.

As shown in FIG. 52, for example, a second reservoir 870 and inkjet printer head 922 for medical compounds may be added to the printer head 920 and reservoir 862 of a cross-referenced application. . The second reservoir may also store a number of unity, such as, for example, acne medication and sun block 872.

The use of different reservoirs, including those for RMAs 864 and 870 for medical compounds 872 and 874, may help prevent accidental applications or mixing of medical compounds or ink. Can be. The use of the second printer head 922 achieves the same purpose and further allows the use of the second printer head 922 having a configuration suitable for the application of medical compounds.

Claims (20)

A method for monitoring human skin areas, Allocating the skin region to a plurality of fraxels; Measuring reflection characteristics of each of the plurality of precells; Determining the shape of the skin from the reflection characteristics of each of the plurality of precells; Analyzing the skin according to the reflection characteristics and the shape Including, human skin area monitoring method. The method of claim 1, Allocating the skin region to a plurality of fraxels, Measuring the reflection characteristics of each of the plurality of precells, and Determining the shape of the skin from the reflection characteristics of each of the plurality of precells A method of monitoring a human skin area further comprising using a cosmetic strengthening system to perform the step. The method of claim 1, Applying prophylactic or therapeutic medical compounds to specific prexels to address medical problems. The method of claim 1, Analyzing the skin according to the reflection characteristics and the shape. Defining a baseline of medically relevant attributes from the scanned data, and Identifying attributes that warrant prophylactic or therapeutic medical treatment or treatment Using feature recognition software; And Reporting on attributes that warrant prophylactic or therapeutic medical treatment or treatment Human skin area monitoring method further comprising. The method of claim 1, Using feature recognition software to identify attributes that warrant prophylactic or therapeutic medical treatment or treatment, Analyzing the baseline; Identifying a change to the baseline that appears in subsequent scanned data; And Analyzing the changes to identify medical problems Human skin area monitoring method comprising a. The method of claim 1, Measuring the reflection characteristics of each of the plurality of precells, Providing a plurality of light sources to be controlled to be on or off; Generating a plurality of illumination states, each said illumination state comprising selecting an on or off state for each of said light sources; Scanning the skin region to obtain image data while repeating the plurality of lighting conditions; And Determining reflectances of the plurality of prexels from the image data Human skin area monitoring method further comprising. The method of claim 6, And determining the position of the prexel being scanned. The method of claim 6, Determining the inclination of the prexel relative to the reference plane from the image data. The method of claim 8, And determining the local skin shape from the inclination of the prexel and the inclination of other prexels adjacent to the prexel. The method of claim 1, Analyzing the skin in accordance with the reflection characteristics and shape further comprises establishing a first map of the skin region such that the map includes reflectance and location of each of the plurality of prexels at a first time. Human skin area monitoring method. The method of claim 10, Establishing a second map of the skin region such that the map includes reflectance and location of each of the plurality of prexels at a second time; And Comparing the first map and the second map Human skin area monitoring method further comprising. A device for monitoring a human skin area, housing; At least one light source that can be turned on and off; At least one image receiving element; And Computing device capable of analyzing data from the image receiving element to determine tilt and reflectance of a particular prexel Including, human skin area monitoring device. The method of claim 12, A first prophylactic or therapeutic medical compound reservoir; And First prophylactic or therapeutic medical compound application device Human skin area monitoring device further comprising. The method of claim 12, The first prophylactic or therapeutic medical compound application device further comprises a drop control device. The method of claim 12, The first prophylactic or therapeutic medical compound application device further comprises at least one inkjet print head. The method of claim 12, And wherein the light source is a plurality of light emitting diodes, the first light emitting diode having a first wavelength of light emission and the second light emitting diode having a second wavelength of light emission. The method of claim 13, And a second reflectance modifier reservoir. The method of claim 12, And said housing is a booth. The method of claim 12, And the housing is a small device so that the device can be manually moved along the area of the skin. The method of claim 12, And the housing is a compact device such that the device can be manually positioned over the skin traces.

Images