WO2022245784A1 - Remodelage de la peau en utilisant des matériaux photosensibles - Google Patents

Remodelage de la peau en utilisant des matériaux photosensibles Download PDF

Info

Publication number
WO2022245784A1
WO2022245784A1 PCT/US2022/029577 US2022029577W WO2022245784A1 WO 2022245784 A1 WO2022245784 A1 WO 2022245784A1 US 2022029577 W US2022029577 W US 2022029577W WO 2022245784 A1 WO2022245784 A1 WO 2022245784A1
Authority
WO
WIPO (PCT)
Prior art keywords
treatment
skin
photo
region
responsive material
Prior art date
Application number
PCT/US2022/029577
Other languages
English (en)
Inventor
David B. Kosecoff
Original Assignee
L'oreal
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/324,581 external-priority patent/US20220370822A1/en
Priority claimed from FR2109179A external-priority patent/FR3126317A1/fr
Application filed by L'oreal filed Critical L'oreal
Publication of WO2022245784A1 publication Critical patent/WO2022245784A1/fr

Links

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00—Radiation therapy
    • A61N5/06—Radiation therapy using light
    • A61N5/0613—Apparatus adapted for a specific treatment
    • A61N5/0616—Skin treatment other than tanning
    • A—HUMAN NECESSITIES
    • A47—FURNITURE; DOMESTIC ARTICLES OR APPLIANCES; COFFEE MILLS; SPICE MILLS; SUCTION CLEANERS IN GENERAL
    • A47G—HOUSEHOLD OR TABLE EQUIPMENT
    • A47G1/00—Mirrors; Picture frames or the like, e.g. provided with heating, lighting or ventilating means
    • A47G1/02—Mirrors used as equipment
    • A—HUMAN NECESSITIES
    • A45—HAND OR TRAVELLING ARTICLES
    • A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • A45D2044/007—Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B18/00—Surgical instruments, devices or methods for transferring non-mechanical forms of energy to or from the body
    • A61B2018/00636—Sensing and controlling the application of energy
    • A61B2018/00904—Automatic detection of target tissue
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00—Radiation therapy
    • A61N5/06—Radiation therapy using light
    • A61N2005/0626—Monitoring, verifying, controlling systems and methods
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00—Radiation therapy
    • A61N5/06—Radiation therapy using light
    • A61N2005/0635—Radiation therapy using light characterised by the body area to be irradiated
    • A61N2005/0642—Irradiating part of the body at a certain distance
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61N—ELECTROTHERAPY; MAGNETOTHERAPY; RADIATION THERAPY; ULTRASOUND THERAPY
    • A61N5/00—Radiation therapy
    • A61N5/06—Radiation therapy using light
    • A61N5/0613—Apparatus adapted for a specific treatment
    • A61N5/062—Photodynamic therapy, i.e. excitation of an agent

Definitions

  • a method of contouring skin includes identifying a region of skin corresponding to a contouring treatment of the skin.
  • the region of skin may be provided with a photo-responsive material overlying a portion of the region of the skin.
  • the method may include identifying one or more treatment regions overlapping the photo- responsive material.
  • the treatment regions may be identified at least in part to apply the contouring treatment.
  • the method may include determining an irradiation profile for each of the one or more treatment regions to contour each respective treatment region as part of applying the contouring treatment.
  • the method may also include irradiating the photo- responsive material at the one or more treatment regions in accordance with the respective irradiation profiles. Irradiating the photo-responsive material may induce a localized change in shape of the photo-responsive material in the respective treatment regions.
  • the region of skin may be coextensive with lines or wrinkles of the skin.
  • the contouring treatment may include expanding or contracting the skin within or around the region of skin.
  • the irradiation profile may define a volumetric pattern within the treatment region.
  • the localized change in shape may define a contraction or an expansion of one or more outer layers of the first region of skin.
  • the photo-responsive material may be characterized by a physical contraction in response to illumination at a characteristic wavelength.
  • the photo-responsive material may be characterized by a physical expansion in response to illumination at a characteristic wavelength.
  • the photo-responsive material may include two constituent materials.
  • the photo-responsive material may expand in response to exposure at a first characteristic wavelength.
  • the photo-responsive material may contract in response to exposure at a second characteristic wavelength.
  • the photo-responsive material may be or include a hydrogel monomer that forms a crosslinked hydrogel when under illumination at a characteristic wavelength.
  • the hydrogel monomer may be or include gelatin methacryloyl (Gel-MA), hydroxyethylmethacrylate (HEMA), or ethylene glycol diacrylate (EGDA).
  • the irradiation profile for a treatment region of the one or more treatment regions may define a pattern. The pattern may induce an anisotropic contraction or an anisotropic expansion of the first region of skin.
  • the method may further include receiving a numerical representation of a contouring treatment design and modifying the contouring treatment design to reflect the location and the type of the feature of the skin.
  • the feature of the skin may include a wrinkle, a fine line, a scar, a blemish, or a region of loose skin.
  • a non-transitory computer-readable memory stores instructions that, when executed by one or more processors of a computer system, cause the computer system to implement operations of the above method or its variations.
  • systems for applying a contouring treatment to a target body surface include an illumination source, physically coupled to a visible light mirror having a first portion being at least partially transparent to visible light, the illumination source configured to emit one or more discrete electromagnetic stimuli of character and for a duration sufficient to induce a localized change in a photo-responsive material disposed on a surface of a biological subject, wherein each discrete electromagnetic stimulus has a discrete peak emission wavelength.
  • the systems may include a camera, optically coupled with the visible light mirror to receive visible light via the first portion.
  • the systems may also include a controller operably coupled to the illumination source and the camera and including computational circuitry configured to initiate irradiation of the photo-responsive material disposed on the surface of the biological subject in accordance with a respective irradiation profile so as to induce a localized change in shape or state of the photo-responsive material.
  • a system includes means for determining an irradiation profile for each of the one or more treatment regions to contour each respective treatment region as part of applying the contouring treatment.
  • the system may also include means for creating structures on a surface of a biological subject by inducing a localized change in a photo- responsive material.
  • FIG. l is a schematic illustration of an embodiment of a system incorporating sensors and an illumination source for application of cosmetic designs, in accordance with various embodiments.
  • FIG. 2A is a schematic illustration of a numerical representation of a contouring treatment as a polygonal mesh including a tensor of treatment data in a face-on direction and a low-angle direction, in accordance with various embodiments.
  • FIG. 2B is a schematic illustration of a 3-dimensional model projection of the contouring treatment onto a face mapping, in accordance with various embodiments.
  • FIG. 3 is a schematic illustration of an example surface contouring treatment using photo-responsive materials, in accordance with various embodiments.
  • FIG. 4 is a schematic illustration of an example volumetric contouring treatment using photo-responsive materials, in accordance with various embodiments.
  • FIG. 5 is a schematic illustration of an example surface treatment for cosmetic contouring using photo-responsive materials, in accordance with various embodiments.
  • FIG. 6A is a schematic illustration of an example isotropic contouring treatment, in accordance with various embodiments.
  • FIG. 6B is a schematic illustration of an example anisotropic contouring treatment, in accordance with various embodiments.
  • FIG. 7 is a flowchart that illustrates an example method for applying a contouring treatment, in accordance with various embodiments.
  • FIG. 8 is a block diagram that illustrates aspects of an illustrative computing device appropriate for use as a computing device of the present disclosure.
  • cosmetic contouring treatments include both pushing apart (expanding) the skin and pulling in (contracting the skin).
  • contouring solutions typically involve harsh chemical treatments, such as acid peels, surgical intervention, or subcutaneous injection of cytotoxic compounds.
  • Systems, methods, and photo-responsive materials are described for applying contouring treatments on a body surface, such as a subject's face or other region of interest, using one or more illumination sources.
  • Described embodiments use photo-responsive materials exhibiting shape-change, contraction, or expansion to apply one or more contouring treatments mapped to the body surface using a projection of a cosmetic treatment design onto a 3D mapping of the body surface.
  • Described embodiments are useful in many contexts, including cosmetics or body art applications, skin feature mapping or monitoring, dermatological diagnosis or treatments, or telehealth applications. In the context of such applications, described embodiments provide precision and greater ease of use over complex manual routines and improve accessibility of at-home cosmetic treatment without a clinic visit.
  • a transparent skincare deposit can be used to keep the natural color of the skin, or on the contrary, an opaque pigmented make-up deposit can be used to homogeneously conceal skin imperfections with a change in color. Translucence can achieve no color change while diffusing the natural “background” colors.
  • Digital light processing (DLP)-based bioprinting technologies can use Near Infrared (NIR) light to 3D photopolymerize a material (eg a hydrogel monomer), both in vivo and in vitro. If the material is properly translucent in its polymerized state, it can be used to more seamlessly (less disruptively) fill gaps created by crater acne, wrinkles, and lip contours in terms of color distribution. By controlling the 3D shape of the deposit and matching its contours with the surrounding surfaces, the material can be even more seamlessly (less disruptively) integrated, avoiding excess fill (bumps) or underfill (recesses).
  • a biocompatible hydrogel monomer or other polymer precursor can be applied to the body surface and/or absorbed sub-cutaneously.
  • the material might have properties such that when cured it will physically contract and/or expand, creating a tighter bond between various anchored coordinates. In this way, the skin can be temporarily tightened, lifted, or tucked without the use of surgical equipment or aggressive procedures and/or externally visible scaffolding.
  • the biocompatible material can be photopolymerized or otherwise modified using exposure to one or more illumination sources to a desired shape across various depths on and through the skin, and may be actuated/modulated/addressed by one or more wavelengths, as part of applying the cosmetic treatment design to the body surface.
  • Sensors suitable for use in described embodiments include 2-dimensional (2D) or 3- dimensional (3D) cameras, proximity sensors, or other integrated or peripheral cameras or sensors.
  • Depth sensors are used in some embodiments to obtain 3D information about surfaces and include a range of possible hardware suitable for this purpose, including RGB or infrared stereoscopic cameras, laser or infrared LiDAR sensors, and dot projectors.
  • 3D scans enable improved measurement of actual dimensions of a body surface and allow depth sensing, which can help to determine, for example, how far the body surface is from the camera, or detailed information about particular skin features, such as wrinkles.
  • Reference points obtained through high-quality 3D scanning in accordance with described embodiments provides greater accuracy for determining location than traditional reference points obtained with 2D imaging, such as eyes, lips, noses, or other prominent facial features, and are particularly helpful where the region of interest is occluded.
  • systems for applying a contouring treatment to a target body surface include an illumination source, physically coupled to a visible light mirror having a first portion being at least partially transparent to visible light, the illumination source configured to emit one or more discrete electromagnetic stimuli of a character and for a duration sufficient to induce a localized change in a photo-responsive material disposed on a surface of a biological subject, wherein each discrete electromagnetic stimulus has a discrete peak emission wavelength.
  • discrete electromagnetic stimuli is used in reference to energy emitted from a source, including, but not limited to, photons, radio waves, microwaves, x-rays, or ions.
  • description of discrete electromagnetic stimuli focuses on photons in the ultraviolet, visible, near infrared, and infrared ranges, produced by one or more illumination sources.
  • biological subject is used in reference to a tissue or other surface associated with a living organism, including, but not limited to skin, hair, keratin (e.g., nails), or internal organ tissues of human or non-human organisms.
  • description of biological subjects focuses on one or more target body surfaces, such as the face, hands, or other skin surfaces.
  • peak emission wavelength is used in reference to an energy (e.g., as described in terms of wavelength, wavenumber, electron-volts, etc.) at which a local and/or global maximum in emission intensity is observed, which may be described by an emission intensity distribution as a function of energy.
  • peak emission wavelength refers to an example of a central wavelength, describing an illumination source from which the output emission distribution is centered or otherwise distributed around the peak emission wavelength.
  • the systems may include a camera, optically coupled with the visible light mirror to receive visible light via the first portion.
  • the systems may also include a controller operably coupled to the illumination source and the camera and including computational circuitry configured to initiate irradiation of the photo-responsive material disposed on the surface of the biological subject in accordance with a respective irradiation profile so as to induce a localized change in shape or state of the photo-responsive material.
  • computational circuitry is used in reference to operational components of a computer system, including but not limited to volatile and/or nonvolatile memory devices, data transmission subsystems (e.g., bus), and/or software and/or firmware provided to implement contouring treatments using photo-responsive materials.
  • the term "controller” is used in reference to operational electronic components configured to control active components of systems described herein, in accordance with electronic instructions from the computer system (e.g., processor(s) and computational circuitry).
  • systems are described in terms of a means for determining an irradiation profile for each of the one or more treatment regions to contour each respective treatment region as part of applying the contouring treatment.
  • the term "means” is used in reference to the systems described in the forthcoming paragraphs, such as the computational circuitry described above as well as systems and components for defining surface mappings of biological subjects.
  • the system may also include means for creating structures on a surface of a biological subject by inducing a localized change in a photo- responsive material.
  • the means may be understood to describe sources and control systems for generating discrete electromagnetic stimuli, such as illumination sources, directed toward a biological subject.
  • the systems described expose the surface with multiple actuating wavelengths in accordance with the treatment design as mapped onto the 3D information collected by the sensors.
  • the photo-responsive material, applied to a region of the body surface can be made to apply one or more contouring morphology changes as described by the cosmetic treatment design accurately and precisely by illumination with the actuating wavelengths rather than manual application of force to the skin.
  • the materials, systems, and methods described also provide improved accessibility to users with limited mobility or dexterity, for whom cosmetic treatments, such as precise application of cosmetic creams, may otherwise involve assistance by another person.
  • FIG. 1 is a schematic illustration of an example system 100 incorporating sensors and an illumination source for application of cosmetic designs, according to various embodiments. While the embodiments of the photo-responsive material described in reference to the forthcoming figures are illustrated in the context of example system 100, alternative approaches are also contemplated. The system 100 is not intended as the sole system for use with the photo-responsive materials described below.
  • one or more cameras 150 of a client computing device 104 includes one or more cameras and captures images of a subject's face 102.
  • the client computing device 104 is a purpose-built mobile computing device including a visible light mirror 106, one or more illumination sources 108, and one or more user interface elements 110 to prompt the subject with visual and/or auditory prompts.
  • the interface elements 110 may be or include a display electronically coupled with the computer system to generate a visual prompt (e.g., “please face forward”) either in a peripheral physically coupled with the mirror 106.
  • the client computing device 104 may be electronically coupled with an acoustic speaker to generate an auditory prompt.
  • the mirror 106 may include one or more portions 112 characterized by unidirectional transparency, for example, in ultraviolet, visible, and/or infrared spectral ranges.
  • the camera(s) 150 may be optically coupled with the visible light mirror 106 to receive visible light via a first portion 112-1, and the illumination source(s) 108 may be optically coupled with the visible light mirror 106 and configured to emit a plurality of discrete wavelength channels via a second portion 112-2 of the mirror 106.
  • the mirror 106 may appear uniform, and the system 100 may appear aesthetically as an ordinary cosmetic mirror without outward indication that the system 100 incorporates electronics, cameras 150, or illumination sources 108.
  • the components of the client computing device 104 may be integrated into a housing 114 that appears similar to a consumer cosmetic mirror rather than an electronics system.
  • the housing 114 may conceal power sources, heat management systems, and other components.
  • the client computing device 104 is illustrated in a particular configuration (e.g., as a countertop mirror or vanity mirror), additional and/or alternative form factors are contemplated.
  • the system 100 may include a smartphone or tablet computer in communication with the client computing device 104, such that one or more computer- executable operations are undertaken by the smartphone or tablet computer rather than by the client computing device 104.
  • the client computing device 104 may be or include smaller housings 114, including, but not limited to, a cosmetics compact or an electronic peripheral configured to electronically couple with a smartphone or tablet computer that includes the camera 150, the illumination source 108, or both.
  • the mirror 106 can be or include a full-size wall mirror, such that the client computing device 104, the camera(s) 150 and the illumination source(s) 108 may be positioned behind the mirror 106 and the one or more portions 112 may be located relative to the camera(s) 150 and the illumination source(s) 108.
  • the system 100 may be installed as a fixture, rather than as a portable system and a single mirror 106 may be configured to conceal multiple client computing devices 104, multiple cameras 150, and multiple illumination sources 108, corresponding to a number of “treatment stations,” as in an aesthetic clinic.
  • the illumination source 108 may include one or more optics configured to form a beam and to scan the beam.
  • the optics may include lenses or mirrors internal to the housing 114 that may be actuated or otherwise controlled to direct a beam from the illumination source(s) 108 to the subject's face 102.
  • the illumination source 108 may be or include one or more laser sources corresponding to the plurality of discrete wavelength channels.
  • the illumination source 108 includes multiple light-emitting diodes corresponding to the plurality of discrete wavelength channels.
  • the illumination source may be or include a continuous source (e.g., a tungsten halide or broad- spectrum source) and a plurality of bandpass fdters to generate the discrete wavelength channels used by the system 100 to apply a cosmetic design.
  • Addressable arrays of illumination data may be implemented by DLP techniques.
  • the client computing device 104 may be in electronic communication with additional systems via a network or over near-field communication protocols (e.g., wifi, bluetooth, etc.).
  • the client computing device 104 may pair with a mobile electronic device, such as a smart phone or tablet, from which the client computing device 104 may receive an identifier of a treatment design.
  • the client computing device 104 may communicate with a server, storing numerical representations of designs, and may access the design from the server.
  • the server may be a remote server or may be a local server, where the terms “remote” and “local” are used both to refer to physical proximity to the system 100 and to denote whether the client computing device 104 and the server are configured to communicate over a public network, such as the internet, or a distributed network system (e.g., a cloud system).
  • the client computing device 104 may store design data locally for a number of cosmetic designs, for example, using a non-transitory computer readable storage medium (e.g., SSD flash memory, hard disk drives, etc.).
  • a non-transitory computer readable storage medium e.g., SSD flash memory, hard disk drives, etc.
  • the client computing device 104 may receive newly released cosmetic treatment design data and associated metadata from the server, such as identifier information and interface data (e.g., images representing the cosmetic design on a model), which may be provided via the interface elements 110 or via the mobile electronic device.
  • the system may be configured to operate with intermittent or no network connectivity.
  • the camera 150 acts as a far-field camera positioned and configured to capture video or still images of subject's face 102, as well a region of interest 120 of the subject's face 102, such that the region of interest 120 is within the field of view 152 of the camera(s) 150.
  • the region of interest 120 is shown as a portion of the left cheek of the subject's face 102, but the region of interest 120 may cover a larger portion of the subject's face 102, such as the entirety of the subject's face 102.
  • the camera unit 150 includes more than one camera, such as for stereoscopic image or video capture and/or depth sensing.
  • the camera unit 150 also includes one or more sensors other than cameras (e.g., aLiDAR sensor or infrared dot projector for depth sensing, a proximity sensor for proximity detection, etc.).
  • sensors other than cameras e.g., aLiDAR sensor or infrared dot projector for depth sensing, a proximity sensor for proximity detection, etc.
  • an infrared dot projector projects infrared dots onto a surface, and reflections from the surface are measured by an infrared camera to determine the distance each dot is from the projector system.
  • these depth measurements can be mapped onto a captured 3D image. This approach is used in some embodiments to generate a 3D model of a body surface, and for real-time tracking of additional features to be used for mapping a cosmetic treatment design onto the subject's face 102 or other body parts.
  • FIG. 2A is a schematic illustration of a numerical representation of a contouring treatment 200 as a polygonal mesh including a tensor of treatment data for surface and volumetric treatments, in accordance with various embodiments.
  • the treatment design 200 represents an exemplary visualization of a cosmetic treatment design, including multiple polygons 202, where each polygon 202 represents a unit of the numerical representation, akin to a pixel in a digital image.
  • the system implementing the processes described herein e.g., system 100 of FIG. 1
  • the polygons 202 may be or include triangles or other shapes that provide greater flexibility for projection and surface mapping relative to square or rectangular pixels.
  • a first polygon 202-1 of the treatment design 200 may include multiple types of treatment data corresponding to different layers of the cosmetic treatment design 200.
  • the design data for the first polygon 202-1 may include, but is not limited to, a surface treatment tuple and a volumetric treatment tuple, indicating two different treatments to be generated by the system 100 at different regions of the skin.
  • Each tuple may include treatment level information corresponding to the photo-responsive materials incorporated into a photo- responsive formulation.
  • the photo-responsive formulation may include one, two, three, four, five, or more different photo-responsive materials.
  • one or more of the materials may expand under illumination at a characteristic wavelength, while others may contract, harden, or change color in response to illumination at a respective characteristic wavelength.
  • the treatment design 200 may be applied a target body surface of the user.
  • treatments may be designed to provide isotropic and/or anisotropic contouring on the surface of a user's skin, as a volumetric contouring treatment, and/or to reduce the visual appearance of skin features including, but not limited to, acne, acne scars, scars, wrinkles, or lines.
  • each polygon 202 is illustrated as having a uniform characteristic size, it is to be understood that the polygons are representative of a tensor of contouring information that is referenced by cell entries in i-j space, rather than in cartesian coordinates.
  • the first polygon 202-1 may be larger or smaller than neighboring polygons 202 when projected into a physical dimension, such as when applied to a facial mapping of a user for application of the design 200 (e.g., region of interest 120 of the subject's face 102 of FIG. 1).
  • FIG. 2B is a schematic illustration of an example 3-dimensional projection 210 of the treatment design 200 onto a face mapping collected using the system of FIG. 1, according to various embodiments.
  • the system 100 is configured to receive the treatment design 200 and to generate an exposure pattern.
  • the treatment design 200 may be projected onto a 3D mapping of the portion of the user's body (e.g., subject's face 102 of FIG. 1),
  • the 3D model includes several reference points 212 in the form of corresponding triangles of a mesh structure, although other polygon shapes are also contemplated.
  • Generating the 3D projection 210 may include multiple computational operations to generate a numerical representation of a portion of a face of the user using the camera (e.g., a facial mapping).
  • the camera may be or include multiple image sensors configured to capture stereoscopic images.
  • the numerical representation of the portion of the face may be or include a tensor of position information defining a surface of the target body surface (e.g., in the region of interest 120 of FIG. 1).
  • Examples of computational techniques include edge-detection, feature or point detection and tracking, and/or point-cloud methods.
  • the system 100 may be configured with a time-of-flight camera, with LiDAR systems, or with stereoscopic cameras, such that the facial mapping may represent a surface generated by contours connecting points and/or features.
  • the system 100 may include an implementation of machine learning, such as a face detection/mapping module that may be trained to predict the facial mapping based on a subset of features and/or points measured by the camera. In this way, the system 100 may be configured to reduce the number of measurements used to generate the mapping, which may improve system performance, for example, by reducing the length of time used to capture images of the user's face.
  • a light sensor mounted on the client computing device 104 can be used to measure current lighting conditions relative to a baseline lighting condition. If the environment is too bright or too dark, the client computing device 104 may generate a prompt to increase illumination and/or may activate an illumination source (e.g., illumination source 108 of FIG. 1) that may or may not be visible to the subject (e.g., an infrared source to provide invisible illumination). In some embodiments, the client computing device 104 may provide feedback to a user (e.g., via synthesized voice cues or visual indications) to adjust the lighting conditions for better results.
  • an illumination source e.g., illumination source 108 of FIG. 1
  • the client computing device 104 may provide feedback to a user (e.g., via synthesized voice cues or visual indications) to adjust the lighting conditions for better results.
  • the system may generate feedback to instruct the user to reposition relative to the camera(s) (e.g., generating a prompt to reposition the user's face from a face-on to a side-on position).
  • feedback to instruct the user to reposition relative to the camera(s) (e.g., generating a prompt to reposition the user's face from a face-on to a side-on position).
  • described embodiments are capable of implementation in many possible ways to determine matches between captured image data and texture data in a 3D model, including matching detected edges or contours, color/pixel values, depth information, or the like in different combinations, and at particular threshold levels of confidence, any of which may be adjusted based on lighting conditions, user preferences, system design constraints, or other factors.
  • the projection 210 may be generated by various means to reduce artifacts of the projection onto the face.
  • the polygons into which the design 200 is divided may be heterogeneously scaled, skewed, or otherwise modified when generating the projection 210, as illustrated.
  • the treatment design 200 may include each polygon with a uniform size
  • the projection 210 may include many different sizes for the polygons 212.
  • resizing may correspond to the contours of the facial mapping, where regions of high dynamic range correspond to smaller polygons 212 and regions of low dynamic range correspond to larger polygons 212.
  • the projection 210 may be resized in accordance with information density.
  • information-dense regions of the design 200 may include relatively high numbers of polygons 202, compared to regions that include relatively sparse design information.
  • more polygons may be used to describe the regions around facial features, such as eyes, nose, mouth, or eyebrows, in contrast to regions of the cheeks, jaw, forehead, etc.
  • the exposure data illustrated in FIG. 2B may be generated by taking into account the intensity values of each material channel included in the design 200, as well as exposure kinetics data for the photo-responsive materials.
  • treatment values for a first polygon 212-1 may be effected by exposing the first polygon to the multiple distinct wavelength channels (e.g., li-4) for different durations corresponding to the characteristic chemical kinetics of the different materials.
  • a “wipe” operation may be implemented by exposing the photo- responsive materials to a neutralization or breakdown-wavelength.
  • photo-responsive materials undergo irreversible polymerization, isomerization, or shape- change transformations under illumination at one or more of the distinct wavelength channels.
  • the cosmetic treatment may be temporary, with little to no deleterious effect on the skin.
  • the treatment design 200 may be adapted using data collected during facial mapping operations to determine cosmetic treatments targeting one or more regions of skin of the user (e g., region of interest 120 of FIG. 1). In this way, using depth information, edges, and/or other features, the treatment design 200 may incorporate specific features and configurations of illumination.
  • a template treatment design may be received by the system implementing contouring treatments, and may be adjusted to include treatment information addressing loose skin or wrinkles, and/or acne scars, detected during face mapping.
  • the projection of the treatment design 200 onto the face mapping 210 may include adaptive mesh sizing and treatment levels, corresponding to identification of features and/or treatment regions.
  • the features and/or treatment regions may be manually indicated, for example, by using a visibly-transparent fluorescent marker or other indicator that can be detected by optical sensors (e.g., UY absorbing ink, IR absorbing ink, etc), which can be used to indicate a specific treatment location, for example, by associating a specific indicator with a specific treatment.
  • a UV-visible-NIR-IR image sensor system e.g., camera(s) 150 of FIG. 1
  • a first indicator is associated with expansion treatment and a second indicator is associated with contraction treatment.
  • FIG. 3 is a schematic illustration of an example surface contouring treatment 300 using photo-responsive materials, in accordance with various embodiments.
  • the individual operations of the example treatment 300 may be implemented by the system 100 of FIG. 1.
  • the example treatment 300 is described as part of an example flow implemented by a computer system and a computer-controlled illumination system (e.g., client computing device 104 of FIG. 1).
  • the example treatment 300 may be stored as computer-executable instructions on a computer-readable memory that, when executed by one or more processors of the computer-controlled illumination system, may implement the operations of the flow illustrated in FIG. 3. It is understood that other systems and methods are contemplated, of which FIG. 3 describes but one example.
  • a region of skin 320 is identified as part of implementing a cosmetic treatment design.
  • a cosmetic treatment design may be or include a general cosmetic treatment based on a template. For example, aggregate data for images matched to a user's age, ethnicity, sex, or the like, may be used to identify and/or receive cosmetic treatment design templates, from which a system may include specific treatments based on facial mapping of the user.
  • the example treatment 300 may begin directly with mapping the face of the user, rather than working from a template.
  • initializing treatment with operation 301 directly may facilitate spot treatments and may reduce the time and computational resources involved in applying surface contouring treatments.
  • the example surface contouring treatment 300 may include identifying multiple regions of skin including the region of skin 320.
  • treatment may include applying symmetric effects to opposing sides of a face (e.g., subject's face 102 of FIG. 1).
  • the example cosmetic treatment 300 may include, at operation 301, identifying more than one region of skin to apply contouring treatments.
  • contouring may be kept within the outer layers 321 of the skin 320, including but not limited to the epidermis, such that topical application of a photo- responsive material 323 may be used to apply the treatment, without involving subcutaneous injection or other invasive techniques.
  • the example cosmetic treatment 300 may optionally include providing the photo-responsive material 323 to the surface of the skin 320 at operation 303.
  • Providing may include applying the material manually or using other approaches, including but not limited to applying a mask, spray, or other application technique.
  • the photo-responsive material 323 may be provided at the the region of skin 320 and to areas around the region of skin 320, such as one or more peripheral regions 325 contiguous with or near the region of skin 320.
  • the term “near” includes peripheral regions 325 that are not contiguous with the region of skin 320, but nonetheless are positioned such that contraction and/or expansion of the the outer layers 321 of the skin 320 in the peripheral regions 325 affects the cosmetic treatment within the region of skin 320.
  • the example cosmetic treatment 300 includes identifying one or more treatment regions 327.
  • the one or more treatment regions 327 may include a peripheral or anchoring treatment region 329, illustrated as extending from the region of skin 320 into the peripheral region 325.
  • the treatments regions 327 and the peripheral treatment regions 329 are illustrated as a cosmetic treatment to smooth and/or contour lines or wrinkles in the outer layers 321 of the region of skin 320, illustrated in cross section.
  • Other embodiments are contemplated, such as redistributing loose skin, tightening skin, reducing the appearance of scars, among other treatments currently addressed by surgical treatments or other interventions, such as botulinum toxin injections.
  • the treatment regions 327 correspond to one or more types of shape, morphology, and/or chemical modification of the photo-responsive material 323, as described in reference to FIG. 2A and FIG. 2B.
  • identification of the treatment regions 327 may include projecting a treatment design (e g., treatment 200 of FIG. 2A) onto a mapping of a target body surface (e.g., projection 210 of FIG. 2B).
  • Identification of the treatment regions 327 may also include detecting one or more features on the target body surface and modifying the treatment design onto a mapping of the target body surface.
  • identification of the treatment regions 327 may include directly mapping the target body surface, classifying features detected on the target body surface, and identifying the treatment regions 327 using the classification.
  • classification may include using a machine-learning model trained to classify images or other surface data (e.g., stereoscopic, multispectral and/or surface mapping data) into one or more of a number of possible feature classes.
  • the training may include unsupervised learning processes, whereby the classifier is provided with a training set of images of the relevant modality, such that it optimizes an objective function (e.g., nearest neighbor, Euclidean distance, etc.) and is thereby configured to classify skin features with confidence.
  • feature detection may be provided to the user via a display element (e.g., interface elements 110 of FIG. 1) to confirm and/or provide a classification of the feature.
  • the display may highlight features and, corresponding to the type of photo-responsive material 323 applied, may receive feedback from the user identifying the type of treatment to be applied to each respective feature.
  • the system determines an exposure pattern to effectuate the treatment at the treatment regions 327 and 329.
  • the exposure pattern may be or include a tensor of exposure data describing one or more types of treatments (surface, volumetric, aesthetic, etc.).
  • the exposure pattern may include timing and spatial information for one or more photo-responsive materials.
  • the photo-responsive material 323 may be or include one or more constituent materials that expand when exposed to a first characteristic wavelength and contract when exposed to a second characteristic wavelength.
  • the expansion and contraction may be characterized by differing kinetic parameters (e.g., polymerization rate) and/or the treatment regions 327 may be of differing sizes, such that the exposure pattern may include spatial localization and timing information relating to one or more illumination sources (e.g., illumination sources 108 of FIG. 1).
  • the expansion treatments may be effected by a first illumination source 330, while the contraction treatments may be effected by a second illumination source 331, according to the exposure patterns for each respective treatment region 327 of the region of skin 320.
  • example treatment 300 is not a limiting example, In some embodiments, contraction and expansion is applied in different manners, or may be applied alone.
  • a treatment may include contraction, as well as other types of shape, morphology, or chemical change may be applied.
  • the photo- responsive material 323, when cured, may adhere to the region of skin 320 and/or the peripheral region 325. Even so, after curing, the photo-responsive material 323 may remain soft and flexible.
  • the region of skin 320 is exposed to the first illumination source 330 and/or the second illumination source 331 at the treatment regions 327, as part of effecting the example treatment 300.
  • the exposure may be such that the photo-responsive material 323 may undergo a chemical change, such as a photo-initiated polymerization or a cross-linking reaction to form a treated material 333.
  • the photo- responsive material 323 may be or include a hydrogel monomer that forms a crosslinked hydrogel in response to irradiation from the illumination sources 330 and/or 331.
  • the hydrogel monomer may be or include, but is not limited to, gelatin methacryloyl (Gel-MA), hydroxyethylmethacrylate (HEMA), ethylene glycol diacrylate (EGDA).
  • the photo-responsive material 323 may also include a synthetic polymer.
  • the photo-responsive material 323 may include a stiffener, including, but not limited to calcium carbonate.
  • the photo-responsive material 323 may further include a photo-initiator.
  • the photoinitiator may be characterized by two-photon absorption in the near-infrared (NIR) spectral range, defined from about 780 nm to about 900 nm, such that the illumination sources 330-331 may be or include NIR sources.
  • the photoinitiator may be or include upconversion nanoparticles, including, but not limited to titanium oxide nanoparticles.
  • the photoinitiator may be or include one or more water-soluble, biodegradable, and/or cytocompatible photoinitiators, such as 2,2'-Azobis[2-methyl-A f -(2- hydroxyethyl)propionamide] (CAS Number: 61551-69-7), Lithium phenyl-2, 4,6- trimethylbenzoylphosphinate (CAS Number 85073-19-4), or Eosin-Y.
  • the photoinitiator may be or include a combination of eosin Y, triethanolamine, and 1-vinyl- 2-pyrrolidinone.
  • the change in morphology induced at operation 309 may differ between different treatment regions 327, corresponding to different illumination sources 330 being applied at different locations and/or for different exposure times.
  • a first treated material 333-1 may apply a different force ( j ⁇ ) to the outer layers 321 of the skin 320 than a second treated material 333-2, in terms of magnitude, direction, and/or type.
  • the first treated material 333-1 and the second treated material 333-2 may apply an expansion force
  • a third treated material 333-3 e.g., exposed to a different characteristic wavelength or a different illumination source
  • the magnitude of the forces applied by the first treated material 333-1 and the second treated material 333-2 may differ.
  • exposure at operation 309 to irradiation from the illumination sources may induce different cosmetic treatments, at different positions, using the photo-responsive material 323.
  • the photo-responsive material may be applied uniformly to the region of skin 320, with the resulting treatment being modulated by the illumination sources 330.
  • the example treatment 300 may optionally include removing residual photo-responsive material 323 at operation 311. Removing residual material may also include removing excess treated material 333. The force applied to the region of skin 320 by the treated material may effect a visual reduction of the appearance of lines, wrinkles, loose skin, or other features, consistent with a contouring treatment. Where the photo-responsive material 323 is water-soluble, the treated material 333 may be water resistant. In this way, removal of residual material may include techniques available without specialized equipment or training, such as rinsing the region of skin 320.
  • FIG. 4 is a schematic illustration of an example volumetric contouring treatment 400 using photo-responsive materials, in accordance with various embodiments.
  • the example volumetric contouring treatment 400 illustrated in FIG. 4 includes forming a scaffold beneath the surface of a region of skin 420, such that the outer layers 421 of the region of skin 420 may be reshaped by modifying a photo-responsive material 423 that may be or include, but is not limited to, the photo-responsive materials described in reference to example surface contouring treatment 300 of FIG. 3.
  • the individual operations of the example treatment 400 may be implemented by the system 100 of FIG. 1.
  • the example treatment 400 is described as part of an example flow implemented by a computer system and a computer-controlled illumination system (e.g., client computing device 104 of FIG. 1).
  • the example treatment 400 may be stored as computer-executable instructions on a computer-readable memory that, when executed by one or more processors of the computer-controlled illumination system, may implement the operations of the flow illustrated in FIG. 4. It is understood that other systems and methods are contemplated, of which FIG.4 describes but one example.
  • the example treatment 400 includes identifying the region of skin 420 on which to apply the volumetric contouring treatment.
  • Volumetric contouring in this context, may describe expansion and/or contraction of the outer layers 421 of the region of skin 420, for example, to reduce the visual appearance of wrinkles, lines, scars, loose skin, or thin skin.
  • Identification of the region of skin 420 may include applications of digital image processing including, but not limited to, feature identification and tracking, vSLAM, edge- detection, keypoint detection, or the like. Additionally or alternatively, identification may include classification of features by trained machine-learning models, as described in more detail in reference to FIGS. 2A-3.
  • the example treatment 400 may optionally include providing the photo-responsive material 423 to the region of skin 420 and/or a peripheral region 425.
  • Providing the photo- responsive material 423 may include applying the photo-responsive material 423 coextensive with the region of skin 420.
  • the example treatment 400 may include applying the photo-responsive material 423 over the entire target body surface (e.g., subject's face 102 of FIG. 1).
  • operation 403 may include applying the photo-responsive material 423 to the entire area around the eyes or the mouth, respectively. In this way, the entire region of skin 420 may be provided with photo-responsive material 423, as well as the peripheral region 425.
  • the photo-responsive material 423 is absorbed at least partially into the outer layers 421 of the region of skin 420. In this way, the photo-responsive material 423 may be present beneath the surface of the region of skin 420, and may be targeted for shape or morphology modification as part of the example treatment 400.
  • the photo-responsive material 423 may be or include a biocompatible and non-cytotoxic hydrogel monomer (e.g., GEL-MA) as described in reference to FIG. 3.
  • the photo-responsive material 423 may also include photo-initiator materials, such as upconversion nanoparticles, allowing the photo- responsive material 423 to be polymerized by a characteristic wavelength to which the outer layers 421 of the region of skin 420 and/or the peripheral region are transparent or translucent.
  • the characteristic wavelength may be or include wavelengths in the visible, near- infrared, or infrared energy ranges, where the outer layers 421 are at least partially transparent.
  • the example treatment 400 includes identifying treatment volumes 427, where one or more illumination sources (e.g., illumination sources 108 of FIG. 1) may be directed to the treatment volumes 427 to implement the example treatment 400.
  • the treatment volumes 427 may be identified in reference to a treatment design that has been mapped onto the region of skin 420 (e.g., projection 210 of FIG. 2B), as described in more detail in reference to FIG. 2B, such that the treatment volumes 427 may overlap with the region of skin 420 and the peripheral region 425, respectively.
  • the treatment volumes 427 may be or include regions internal to the outer layers 421 of the region of skin 420 and the peripheral region 425.
  • the treatment volumes 427 may be differentiated, for example, by corresponding to different treatments, different illumination sources, different morphology changes, or the like.
  • the treatment volume 427 internal to the region of skin 420 may correspond to an expansion treatment
  • the treatment volume 427 at least partially internal to the peripheral region 425 may correspond to a contraction treatment.
  • the combined effect of expansion and/or contraction treatments may be implemented at one or more treatment volumes 427 on a target body surface.
  • the example treatment 400 fdls loose skin in the region of skin 420, and tightens skin in the peripheral region 425. In this way, skin is spread and tightened in an approach that reduces the visible appearance of loose skin while also maintaining a natural aesthetic that is challenging for more invasive techniques, such as surgery or botulinum toxin injections.
  • the example treatment 400 includes determining irradiation profiles for the treatment volume(s) 427.
  • the photo-responsive material 423 may be characterized by different dynamics for different types of transformations. For example, expansion may occur faster than contraction in response to exposure to illumination sources at the respective characteristic wavelengths. In this way, both characteristic wavelength, intensity, and exposure duration may be determined as a function of position for the treatment volumes 427.
  • the irradiation profiles include depth information (e.g., positional dependency along a Z-axis, as opposed to a surface defined in two dimensions aligning with the surface of the region of skin 420), such that the irradiation profiles include graduated exposure in three- dimensional space (e.g., volumetric exposure).
  • the irradiation profile is determined for isotropic expansion and/or contraction at the respective treatment volume 427.
  • the irradiation profiles may include patterning and/or meta- patterning information, such that the effect of exposure in accordance with the irradiation profile includes anisotropic expansion or contraction.
  • the irradiation profiles are determined such that portions of a particular treatment volume 427 expand, while other portions of the particular treatment volume 427 contract.
  • isotropic and/or anisotropic expansion or contraction permits different features to be addressed, such as fine lines, crow's feet, loose skin, cellulite, or the like, without surgical intervention or sub-cutaneous injection.
  • the example treatment 400 optionally includes removing residual photo-responsive material 423 from the surface of the region of skin 420 and/or the peripheral region 425, at operation 409.
  • illumination is targeted beneath the surface of the region of skin 420 and/or the peripheral region 425
  • differential absorption at the surface may affect or interfere with the intended treatment effect.
  • removing the residual photo-responsive material 423 may improve the fidelity, efficacy, and/or performance of the example treatment 400.
  • the photo-responsive material 423 may be water-soluble (e.g., a hydrogel monomer)
  • operation 409 may include removing by rinsing or absorbing the residual photo-responsive material 423 with an absorbent material.
  • one or more illumination sources 429 may be applied to expose the photo-responsive material 423 in the treatment volumes 427, in accordance with the irradiation profiles.
  • three- dimensional exposure is effected by combining two or more focused beams.
  • a first illumination source 429-1 and a second illumination source 429-2 may be trained on the treatment volume 427, as an approach to control the fluence at a given point in the treatment volume 427 as a function of time.
  • exposure control may be afforded by limiting the fluence of the first illumination source 429- 1 and/or the second illumination source 429-2 below a threshold, above which the photo-responsive material 423 is activated and transforms into a first scaffold 431 (e.g., a crosslinked hydrogel).
  • a threshold e.g., a crosslinked hydrogel
  • the net effect of the twin illumination sources is to activate the photo-responsive material 423 at precise positions described in the irradiation profile, in three-dimensions. While the illustration provided in FIG. 4 includes two illumination sources, it is understood that more than two illumination sources may be applied as part of the example treatment 400.
  • dynamic optics may be implemented to provide three- dimensional control of exposure, in accordance with the irradiation profiles. For example, by adaptively focusing a third illumination source 429-3, a focal point may be modulated in three- dimensional space within the photo-responsive material 423, such that the energy density at the focal point activates the transformation into a second scaffold 433.
  • the first illumination source 429-1, the second illumination source 429-2, and the third illumination source 429-3 may be generated by the same source, and may be characterized by the same central wavelength and fluence.
  • the third illumination source 429-3 may be characterized by a different set of parameters than the first illumination source 429-1 and the second illumination source 429-2.
  • the first scaffold 431 may apply an expansion force ( p ) to the outer layers421 of the skin 420, while the second scaffold 433 may apply a contraction force to the outer layers 421 of the skin 420.
  • the forces described in the context of the example treatment 400 are non-limiting, and it is understood that a combination of expansion and contraction forces may be applied to impart a net effect on the region of skin 420 as part of effecting the contouring treatment.
  • FIG. 5 is a schematic illustration of an example surface treatment 500 for cosmetic contouring using photo-responsive materials, in accordance with various embodiments.
  • the example surface treatment 500 includes identifying a region of skin 520 that expresses a feature 521 addressed by a particular cosmetic treatment, additionally and/or alternatively to the surface and volumetric treatments described in reference to FIGs. 3- 4.
  • the feature 521 may be or include cosmetic or aesthetic aspects of the skin that are visible on the surface of the region of skin 520 and/or extend into the outer layers 523 of the region of skin.
  • the feature 521 may include, but is not limited to, acne scars, acne blemishes, moles, skin tags, warts, wart scars, biopsy scars, or other lines, scars, or blemishes.
  • the individual operations of the example treatment 500 may be implemented by the system 100 of FIG. 1.
  • the example treatment 500 is described as part of an example flow implemented by a computer system and a computer-controlled illumination system (e.g., client computing device 104 of FIG. 1).
  • the example treatment 500 may be stored as computer-executable instructions on a computer-readable memory that, when executed by one or more processors of the computer-controlled illumination system, may implement the operations of the flow illustrated in FIG. 5. It is understood that other systems and methods are contemplated, of which FIG. 5 describes but one example.
  • the region of skin 520 is identified, based on detection or recognition of the feature 521.
  • the feature 521 may be detected by digital image processing of images collected by one or more image sensors (e.g., camera(s) 150 of FIG. 1).
  • the feature 521 is manually indicated by marking the feature 521 with an invisible indicator, such as a UV or IR absorbing ink.
  • detection of the feature 521 may be automatic (e.g., without human intervention) where the example treatment 500 is implemented by an automated or partly automated system. Similarly, recognition by the system may follow indication of the feature
  • the example treatment 500 may optionally include providing a photo-responsive material 525 to the region of skin 520 in the area of the feature 521, at operation 503.
  • the photo-responsive material 525 may be applied to inner surfaces and/or volumes, for example, as illustrated in FIG. 5.
  • the photo-responsive material 525 may be or include a biodegradable, water soluble, and/or non-cytotoxic material that is characterized by a transformation from a liquid or gel into a flexible and/or soft semi-solid material upon exposure to an illumination source at a characteristic wavelength.
  • the photo- responsive material may be or include a hydrogel monomer (e.g., GelMA) as described in reference to FIG. 3.
  • the photo-responsive material 525 may include a pigment or a dye, selected to reduce the visual appearance of the feature 521 relative to the region of skin 520 surrounding it.
  • the photo-responsive material 525 may include a suspension of metal or ceramic particles, acting as a dispersive medium when exposed to ambient conditions. In this way, the dispersive medium may cloak the inner surfaces of the feature 521 by partially reflecting ambient light from the surface of the photo-responsive material 525.
  • the photo- responsive material 525 may be substantially transparent to photons having energy in the visible range from about 380 nm to about 750 nm. In this context, “substantially transparent” refers to an aesthetic evaluation of the photo-responsive material 525, such that a viewer would not observe the material under ambient conditions, rather than a quantitative measurement of absorption at any particular wavelength.
  • the feature 521 may be associated with biological and/or physiological phenomena that benefit from sustained application of an active ingredient.
  • the feature 521 may be an acne blemish, a hive, an eczema blister, a wart, or other feature that includes an acidic bacterial or viral infection or otherwise causes discomfort.
  • the photo-responsive material 525 may include an active ingredient to reduce the effect, duration, or discomfort of the feature 521.
  • the photo-responsive material 525 may include an anti-pruritic compound.
  • the photo- responsive material 525 may include an anesthetic and/or an antiseptic material.
  • the active ingredient may be soluble in the photo-responsive material 525 and stable under illumination at the characteristic wavelength(s) during the example treatment 500, such that the active ingredient may diffuse into the feature 521 over time, following the example treatment 500.
  • a treatment region 527 is identified corresponding to the feature 521.
  • identifying the treatment region may include modifying a treatment design (e.g., treatment design 200 of FIG. 2A) with information describing the surface topography of the feature 521, as part of projecting the treatment design on to a mapping of the surface of the region of skin 520.
  • a broader contouring treatment e.g., example treatment 300 of FIG. 3 and/or example treatment 400 of FIG. 4
  • a specific indicator material may be applied to facilitate the identification of the treatment region 527.
  • the indicator material and the photo-responsive material 525 are the same material.
  • depth measurements and mapping of the surface of the region of skin 520 may be used to refine the projection guiding the broader contouring treatments, and may apply a different treatment to the treatment region 527 than what may be applied to other regions on the target body surface (e.g., subject's face 102 of FIG. 1).
  • one or more irradiation profiles are determined, in accordance with the treatment design.
  • the irradiation profiles may include surface treatment information and volumetric treatment information, as described in reference to FIG. 2B, to induce different transformations on the outer surface(s) of the feature 521 relative to the internal surface(s) of the feature 521.
  • the treatment region 527 describes the inner volume of the feature 521, but the irradiation profile may also include the surfaces of the feature 521 external to the treatment region 527. In this way, different cosmetic and/or aesthetic effects may be imparted to the different surfaces of the feature 521.
  • the irradiation profiles may be or include tensors of wavelength, intensity, and/or duration information for one or more illumination sources 529 to effect the example treatment 500.
  • the illumination source 529 provides energy at the characteristic wavelength such that the photo-responsive material 525 is transformed into a first semi-solid material 531 external to the feature 521 and/or a second semi-solid material 533 internal, coextensive, and/or overlying the feature 521.
  • the example treatment 500 may generate the second semi-solid material 533, such that the second semi-solid material 533 acts as an edge-diffuser and/or a background diffuser of visible wavelengths.
  • the second semi-solid material 533 may define a convex surface at or near the surface of the feature 521. In this way, the surfaces of the feature 521 may collect light and may appear lighter.
  • photo-responsive material is cross-linked by exposure to the illumination source 529 to form a cross-linked hydrogel that applies an isotropic or anisotropic force to the feature 521.
  • the second semi-solid material 533 may shrink the physical size of the feature 521, for example, by contracting the internal volume of the feature 521, or by expanding the feature and thereby reducing its visual prominence.
  • the first semi-solid material 531 is characterized by different optical properties from the second semi-solid material 533.
  • the second semi-solid material 533 may be an edge and/or background diffuser
  • the first semi-solid material may be a diffuse reflector, for example, by inclusion of a dye or pigment that concentrates under contraction of the first semi-solid material 531.
  • FIGs. 6A-6B describe isotropic and anisotropic contouring applied as part of a contouring treatment, through patterned exposure of photo-responsive materials as defined by irradiation profiles, as described in more detail in reference to FIGs. 2-5. While the description focuses on surface treatments, as described in reference to FIG. 3, it is understood that patterning is also contemplated in three-dimensional irradiation profiles in the context of volumetric contouring treatment, as described in reference to FIG. 4.
  • FIG. 6A is a schematic illustration of an example isotropic contouring treatment 600, in accordance with various embodiments.
  • a region of skin 601 e.g., region of skin 320 of FIG. 3
  • one or more photo- responsive materials 603 e.g., photo-responsive material 323 of FIG. 3, photo-responsive material 423 of FIG. 4, or photo-responsive material 525 of FIG. 5
  • the photo-responsive material 603 may be coextensive with the region of skin 601, or may at least partially overlie the region of skin 601.
  • a treatment region 605 e.g., treatment region 327 of FIG.
  • the photo- responsive material 603 may be defined as substantially symmetrical, for example, ellipsoidal, circular, or oblong.
  • an illumination source e.g., illumination source 108 of FIG. 1
  • the photo- responsive material 603 may polymerize or otherwise change shape, such that an isotropic force ( f) is applied to the region of skin 601.
  • the force may be isotropic contraction or expansion, as defined by the irradiation profile for the example isotropic contouring treatment 600.
  • isotropic contraction force may be suitable for tightening loose skin, for reducing the appearance of surface features, or other cosmetic contouring.
  • isotropic force may be applied at small scale, for example, by focusing the illumination source down to a point.
  • the treatment region 605 can be sized to impart the isotropic force on multiple scales.
  • a large spot size may impart isotropic contraction on a region of a user's face, while a small spot size may be applied to regions of skin 601 that are feature-dense, such as around the eyes and/or mouth.
  • the illumination source may be or include a laser source, such that the spot size is on the order of micrometers to millimeters.
  • a treatment region defining a circular area of the region of skin 601 with a diameter of 1 cm may be defined by rastering and/or scanning the laser over the region of skin 601.
  • the illumination source may be a projector or other wide-beam source (e.g., a lamp) that is reflected or transmitted via an addressable array of filters forming a pixel map.
  • the minimum size of the treatment region 605 is the size of a single pixel, as transformed by projection optics onto the surface of the region of skin 601.
  • the shape of the treatment region 605 may be exposed by scanning and/or rastering a small spot size (e.g., a narrow beam source) or by projecting an image onto the region of skin 601.
  • FIG. 6B is a schematic illustration of an example anisotropic contouring treatment 650, in accordance with various embodiments.
  • scanning and/or rastering a beam, or projecting an image, as described in reference to FIG. 6A provides the capability to form a patterned treatment region 607, such that an anisotropic force is applied upon exposure to the illumination source.
  • a patterned treatment region 607 such that an anisotropic force is applied upon exposure to the illumination source.
  • the photo-responsive material 603 for example, through use of a stencil, resolution and complexity of patterning is improved through patterned exposure (e.g., as when exposure is computer-controlled).
  • the region of skin 601 includes loose skin that expresses parallel lines or wrinkles.
  • a pattern 611 may be defined such that, when the photo-responsive material 603 is exposed to an illumination source that induces a shape change 613, an anisotropic contraction force is applied.
  • the pattern 611 is intended as an illustrative example, and it is understood that other patterns are contemplated.
  • patterns 611 may combine expansion and contraction of the photo-responsive material 603 as an approach to forming net forces that are spatially dependent, and may be addressed to regions of skin that include multiple features or may otherwise benefit from more than one contouring treatment.
  • anisotropic force application may permit areas of the region of skin 601 to be anchored in place, permitting isotropic treatments applied elsewhere in the region of skin 601 to apply a desired aesthetic effect.
  • anchoring skin near the temples of the face may permit isotropic contraction nearer the eyes to impart an appearance of lifting the skin on the face toward the temples.
  • patterning photo-the responsive materials 603 beneath the surface of the region of skin 601 may permit non-uniformity in the skin surface to be treated with precision, rather than by distribution of isotropic force.
  • anistropic contraction may be applied to form dimples or isotropic expansion may be applied to reduce the appearance of dimples (e.g., in cases of severe cellulite).
  • the example isotropic contouring treatment 600 and the example anisotropic contouring treatment 650 may be applied, alone or in combination, to provide a contouring treatment to a target body surface.
  • precision and accuracy are provided by automated treatment systems (e.g., client computing device 104 of FIG. 1), configured to implement the example treatments described above in reference to FIGs. 3-6B.
  • FIG. 7 is a flowchart that illustrates an example method 700 for applying a contouring treatment, in accordance with various embodiments.
  • the example method 700 may be performed by a computer system including one or more computing devices, such as client computing device 104 of FIG. 1.
  • the example method 700 may be stored as computer- executable instructions on a computer-readable memory device. In this way, the computer system may implement the operations of example method 700 as part of executing the instructions.
  • the computer system receives a numerical representation of a cosmetic contouring treatment design.
  • the numerical representation of the contouring treatment design includes a tensor of contouring information for one or more photo-responsive materials.
  • the photo-responsive materials correspond to a contouring formulation (e.g., photo- responsive material 323 of FIG. 3, photo-responsive material 423 of FIG. 4, or photo- responsive material 525 of FIG. 5) including a mixture of water-soluble, biodegradable, non- cytotoxic components that change shape, expand, and/or contract when exposed to an illumination source at a characteristic wavelength.
  • the computer system may receive the numerical representation of the contouring treatment (e.g., contouring treatment 200 of FIG.
  • the numerical representation of the contouring treatment may be associated with a unique design identifier and may be retrieved from a data store, such that the tensor of contouring information may be requested and/or retrieved by the computer system in response to receiving the unique design identifier.
  • the computer system detects, using a camera in electronic communication with the computer system, a user of the system facing a visible light mirror (e.g., mirror 106 of FIG. 1).
  • the camera is in optical communication with the visible light mirror via a partially transparent portion of the visible light mirror (e.g., first portion 112-1 of FIG. 1).
  • detecting the user may include multiple operations included as part of face-detection and recognition routines.
  • the computer system may store feature data for a number of faces, such that the computer system is able to detect and identify the face present in the field of view of the camera (e.g., field of view 152 of FIG. 1).
  • Such identification may benefit the system by reducing the resource demand associated with generating face mappings and projections. For example, by storing depth and image data, the computer system may rely on periodic re-initialization for 3D mapping operations, rather than continuous mapping, which may be more computationally intensive.
  • the method 700 may optionally include generating, by the computer system, a prompt for the user to apply the mixture of photo-responsive materials at operation 706.
  • prompting the user to apply the photo-responsive materials may serve as one of a number of visual/auditory guides or prompts provided to the user. Such prompts may facilitate the application of contouring treatment, for example, where the client computing device is not equipped with a sensor to detect the presence of the photo-responsive material.
  • the photo-responsive material includes a constituent compound or that is detectable optically.
  • the photo-responsive material may include a compound that absorbs a characteristic wavelength for which the computer system is provided with a source that is typically reflected by human skin.
  • the matrix may include a material that reflects or fluoresces under a characteristic wavelength of illumination. In this way, the optional operation 706 may be triggered in response to the computer system determining that the user has not applied the photo-responsive material.
  • the computer system generates, using the camera, a numerical representation of a portion of a target body surface of the user (e.g., region of interest 120 of subject's face 102 of FIG. 1).
  • the numerical representation of the target body surface includes a tensor of position information defining the surface.
  • the tensor of position information is described in other terms as a face-mapping or a 3D mapping.
  • the computer system may implement various techniques to collect and generate depth data describing the surface to which the contouring treatment will be applied.
  • the computer system may incorporate or be electronically coupled with sensors including, but not limited to, time-of- flight cameras, stereoscopic cameras, LiDAR sensors, or point-tracking systems, to generate the numerical representation of the target body surface.
  • the numerical representation of the surface may be stored in memory of the computer system and/or in a separate data store for use in generating projections of the cosmetic design onto the 3D mapping.
  • the computer system defines one or more exposure patterns for the surface, at least in part by projecting the tensor of contouring information onto the tensor of position information.
  • the exposure patterns may include data for a set of characteristic wavelengths generated by the illumination sources incorporated or in electronic communication with the computer system.
  • an exposure pattern may include spatially localized emission levels and durations for each cell in a map of polygons (e.g., polygons 212 of FIG. 2B) corresponding to a position on the face.
  • the computer system may generate an exposure sequence, in terms of drive instructions for the sources, to apply the cosmetic design to the specific surface of the user.
  • the computer system uses an illumination source (e.g., illumination source 108 of FIG. 1) in electronic communication with the computer system, the computer system exposes a portion of the user's skin (e.g., region of interest 120 of FIG. 1) with one or more discrete wavelength channels.
  • the exposure is effected in accordance with the exposure pattern.
  • the illumination source is physically coupled with the visible light mirror and configured to emit the discrete wavelength channels.
  • the illumination source is optically coupled with the mirror via a unidirectional transparent portion (e.g., second portion 112-2 of FIG. 1), such that the illumination source emits the plurality of discrete wavelength channels through the mirror via the unidirectional transparent portion.
  • the sources can be steered by the computer system as part of processing the exposure pattern into drive instructions for the sources.
  • the sources may include beam steering optics that rely on electronic actuation or dynamic lensing/optics to direct the source beam toward a specific position on a user's face.
  • the sources are configured to emit a field of light covering the entire surface, but with variable wavelength content at each of a number of pixels, reproducing the projected design, as described in more detail in reference to FIG. 2B.
  • the sources may include dynamic filters, such as programmable diffraction grating arrays or programmable filter arrays, as in digital light projection.
  • the method 700 may optionally include operation 714, whereby the computer system generates a second prompt for the user to reposition relative to the cameras (e.g., reposition from a face-on posture to a semi-profile posture), such that the illumination sources may be aligned with a different portion of the face. Multiple angles of exposure may permit the system to form more precise patterns or to control exposure in feature-dense regions of skin.
  • the method 700 may optionally include operation 716, whereby the computer system exposes the target body surface according to a second exposure pattern.
  • the second exposure pattern may include low-angle illumination, as part of applying surface exposure without penetrating into the outer layers of skin (e.g., outer layers 321 of FIG. 3).
  • operation 716 may include face-on illumination of a second portion of the target body surface, such that a different region may express a different contouring effect according to the contouring treatment design received at operation 702.
  • FIG. 8 is a block diagram that illustrates aspects of an example computing device 800, in accordance with various embodiments.
  • the exemplary computing device 800 describes various elements that are common to many different types of computing devices. While FIG. 8 is described with reference to a computing device that is implemented as a device on a network, the description below is applicable to servers, personal computers, mobile phones, smart phones, tablet computers, embedded computing devices, and other devices that may be used to implement portions of embodiments of the present disclosure. Moreover, those of ordinary skill in the art and others will recognize that the computing device 800 may be any one of any number of currently available or yet to be developed devices.
  • the computing device 800 includes at least one processor 802 and a system memory 804 connected by a communication bus 806.
  • the system memory 804 may be volatile or nonvolatile memory, such as read only memory (“ROM”), random access memory (“RAM”), EEPROM, flash memory, or similar memory technology.
  • ROM read only memory
  • RAM random access memory
  • EEPROM electrically erasable programmable read-only memory
  • flash memory or similar memory technology.
  • system memory 804 typically stores data and/or program modules that are immediately accessible to and/or currently being operated on by the processor 802.
  • the processor 802 may serve as a computational center of the computing device 800 by supporting the execution of instructions.
  • the computing device 800 may include a network interface 810 comprising one or more components for communicating with other devices over a network.
  • Embodiments of the present disclosure may access basic services that utilize the network interface 810 to perform communications using common network protocols.
  • the network interface 810 may also include a wireless network interface configured to communicate via one or more wireless communication protocols, such as WiFi, 2G, 3G, LTE, WiMAX, Bluetooth, Bluetooth low energy, and/or the like.
  • the network interface 810 illustrated in FIG. 8 may represent one or more wireless interfaces or physical communication interfaces described and illustrated above with respect to particular components of the system 100.
  • the computing device 800 also includes a storage medium 808.
  • services may be accessed using a computing device that does not include means for persisting data to a local storage medium. Therefore, the storage medium 808 depicted in FIG. 8 is represented with a dashed line to indicate that the storage medium 808 is optional.
  • the storage medium 808 may be volatile or nonvolatile, removable or nonremovable, implemented using any technology capable of storing information including, but not limited to, a hard disk drive, solid state drive, CD ROM, DVD, or other disk storage, magnetic cassettes, magnetic tape, magnetic disk storage, and/or the like.
  • the term “computer-readable medium” includes volatile and non-volatile and removable and non-removable media implemented in any method or technology capable of storing information, such as computer readable instructions, data structures, program modules, or other data.
  • the system memory 804 and storage medium 808 depicted in FIG. 8 are merely examples of computer-readable media.
  • Suitable implementations of computing devices that include a processor 802, system memory 804, communication bus 806, storage medium 808, and network interface 810 are known and commercially available. For ease of illustration and because it is not important for an understanding of the claimed subject matter, FIG. 8 does not show some of the typical components of many computing devices.
  • the computing device 800 may include input devices, such as a keyboard, keypad, mouse, microphone, touch input device, touch screen, and/or the like. Such input devices may be coupled to the computing device 800 by wired or wireless connections including RF, infrared, serial, parallel, Bluetooth, Bluetooth low energy, USB, or other suitable connections protocols using wireless or physical connections. Similarly, the computing device 800 may also include output devices such as a display, speakers, printer, etc. Since these devices are well known in the art, they are not illustrated or described further herein.

Landscapes

  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Pathology (AREA)
  • Biophysics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

L'invention concerne des procédés, des systèmes et des dispositifs pour un traitement de remodelage photosensible intégré. Les procédés comprennent l'identification d'une région de la peau correspondant à un traitement de remodelage de la peau. La région de la peau peut être pourvue d'un matériau photosensible qui recouvre une portion de la région de la peau. Les procédés peuvent comprendre l'identification d'une ou de plusieurs régions de traitement qui recouvrent le matériau photosensible. Les régions de traitement peuvent être identifiées au moins en partie pour appliquer le traitement de remodelage. Les procédés peuvent comprendre la détermination d'un profil d'irradiation pour chacune desdites régions de traitement pour le remodelage de chaque région de traitement respective en tant que partie d'application du traitement de remodelage. Les procédés peuvent également comprendre l'irradiation du matériau photosensible au niveau desdites régions de traitement conformément aux profils d'irradiation respectifs. L'irradiation du matériau photosensible peut induire un changement localisé de la forme du matériau photosensible dans les régions de traitement respectives.
PCT/US2022/029577 2021-05-19 2022-05-17 Remodelage de la peau en utilisant des matériaux photosensibles WO2022245784A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US17/324,581 2021-05-19
US17/324,581 US20220370822A1 (en) 2021-05-19 2021-05-19 Skin contouring using photo-responsive materials
FRFR2109179 2021-09-02
FR2109179A FR3126317A1 (fr) 2021-09-02 2021-09-02 MODELAGE DE LA PEAU À L'AIDE DE MATéRIAUX PHOTO-RÉACTIFS

Publications (1)

Publication Number Publication Date
WO2022245784A1 true WO2022245784A1 (fr) 2022-11-24

Family

ID=82546953

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2022/029577 WO2022245784A1 (fr) 2021-05-19 2022-05-17 Remodelage de la peau en utilisant des matériaux photosensibles

Country Status (1)

Country Link
WO (1) WO2022245784A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2612294A (en) * 2021-09-21 2023-05-03 L & Co Trading Ltd Mirror unit

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016041067A1 (fr) * 2014-09-15 2016-03-24 Klox Technologies Inc. Matrices polymères émissives
US20160184212A1 (en) * 2014-12-24 2016-06-30 L'oreal Photo-activated hydrogels
KR101900450B1 (ko) * 2018-05-15 2018-09-19 주식회사 필리 스마트폰 어플 연동 탁상용 엘이디 거울
US20190030359A1 (en) * 2018-10-02 2019-01-31 ShenZhen Kaiyan Medical Equipment Co, LTD System and method for providing light therapy to a user body
EP3586926A1 (fr) * 2018-06-28 2020-01-01 Johnson & Johnson Consumer Inc. Compositions et procédés pour traiter des pathologies de la peau à l'aide de la lumière et de chlorhydrate de glucosamine
KR20200098926A (ko) * 2019-02-13 2020-08-21 (주)인트인 스마트 미러, 사용자 단말을 포함하는 피부 관리 시스템 및 방법
US20200375526A1 (en) * 2019-05-31 2020-12-03 Samsung Electronics Co., Ltd. Electronic device for controlling skin-care device and method of operating the same
KR102193581B1 (ko) * 2020-02-11 2020-12-23 아이콘에이아이 주식회사 디스플레이를 구비하고 보이스 어시스턴트와 연동하는 스마트 메이크업 미러 디바이스
CN112273839A (zh) * 2020-11-14 2021-01-29 广州汉宋电子科技有限公司 一种具有美白肌肤灯光的美妆镜

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016041067A1 (fr) * 2014-09-15 2016-03-24 Klox Technologies Inc. Matrices polymères émissives
US20160184212A1 (en) * 2014-12-24 2016-06-30 L'oreal Photo-activated hydrogels
KR101900450B1 (ko) * 2018-05-15 2018-09-19 주식회사 필리 스마트폰 어플 연동 탁상용 엘이디 거울
EP3586926A1 (fr) * 2018-06-28 2020-01-01 Johnson & Johnson Consumer Inc. Compositions et procédés pour traiter des pathologies de la peau à l'aide de la lumière et de chlorhydrate de glucosamine
US20190030359A1 (en) * 2018-10-02 2019-01-31 ShenZhen Kaiyan Medical Equipment Co, LTD System and method for providing light therapy to a user body
KR20200098926A (ko) * 2019-02-13 2020-08-21 (주)인트인 스마트 미러, 사용자 단말을 포함하는 피부 관리 시스템 및 방법
US20200375526A1 (en) * 2019-05-31 2020-12-03 Samsung Electronics Co., Ltd. Electronic device for controlling skin-care device and method of operating the same
KR102193581B1 (ko) * 2020-02-11 2020-12-23 아이콘에이아이 주식회사 디스플레이를 구비하고 보이스 어시스턴트와 연동하는 스마트 메이크업 미러 디바이스
CN112273839A (zh) * 2020-11-14 2021-01-29 广州汉宋电子科技有限公司 一种具有美白肌肤灯光的美妆镜

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2612294A (en) * 2021-09-21 2023-05-03 L & Co Trading Ltd Mirror unit

Similar Documents

Publication Publication Date Title
US20110218428A1 (en) System and Method for Three Dimensional Medical Imaging with Structured Light
JP5400187B2 (ja) しわのエイジング及びディエイジングの現実的シミュレーションの方法及び装置
JP5197588B2 (ja) 皮膚の処理のためのデバイス及び方法、並びに当該デバイスの使用
JP5039700B2 (ja) 美容モニタリングおよび処置を介した医学的モニタリングおよび処置のシステム
Flores et al. Intraoperative imaging during Mohs surgery with reflectance confocal microscopy: initial clinical experience
CN107160865B (zh) 图像处理装置、印刷装置及图像处理方法
CN111524080A (zh) 脸部皮肤特征的识别方法、终端及计算机设备
CN107125904B (zh) 图像处理装置以及图像处理方法
CN104969543A (zh) 电子镜装置
Chang et al. Automatic facial skin defect detection system
CN109272579B (zh) 基于三维模型的美妆方法、装置、电子设备和存储介质
WO2022245784A1 (fr) Remodelage de la peau en utilisant des matériaux photosensibles
JP2017009598A (ja) 美容施術効果の解析方法
TW201828861A (zh) 塗布控制裝置、塗布控制方法、程式及記錄媒體
JP2018106720A (ja) 画像処理装置及びその方法
Spyridonos et al. Automatic discrimination of actinic keratoses from clinical photographs
US11857153B2 (en) Systems and methods for multi-modal sensing of depth in vision systems for automated surgical robots
US20220370822A1 (en) Skin contouring using photo-responsive materials
KR102495889B1 (ko) 반자동 라벨링에 따라 학습된 딥러닝 기반 주름 검출 모델을 이용하여 얼굴 주름을 검출하기 위한 방법 및 장치
KR102093666B1 (ko) 발광 밀러를 이용한 피부분석에 의한 스킨케어와 색조화장 정보제공 방법 및 시스템
US20230101494A1 (en) Hair contouring treatments using photoresponsive hydrogels
Manit et al. Deep convolutional neural network approach for forehead tissue thickness estimation
KR101710152B1 (ko) 피부 구조 측정 장치
US20180192937A1 (en) Apparatus and method for detection, quantification and classification of epidermal lesions
WO2023056375A1 (fr) Traitements d'effet de contour des cheveux utilisant des hydrogels photosensibles

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22741595

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22741595

Country of ref document: EP

Kind code of ref document: A1