FR3122071A1 - REMOTE BEAUTY CONSULTATION SYSTEM - Google Patents

Abstract

REMOTE BEAUTY CONSULTATION SYSTEM A system is provided which includes a counseling device; a user device; and a dispensing device. The counseling device and the user device are configured to perform a communication session with each other that includes transmitting, from the user device to the counseling device, information that includes a desired cosmetic product and related information to a user of the user device; analysis, by the advising device, of information received from the user device; and generating and transmitting a recommended cosmetic formula to the user device. The user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product. Figure for the abstract: none.

Description

REMOTE BEAUTY CONSULTATION SYSTEM

CONTEXT

Domain

The present disclosure relates generally to a system, apparatus, and method for determining a combination of cosmetic materials that may be mixed and dispensed for a particular user.

ABSTRACT

In one embodiment, a system is provided that includes an advisory device; a user device; and a delivery device, wherein the counseling device and the user device are configured to perform a communication session with each other that includes: transmitting, from the user device to the counseling device, information that includes a desired cosmetic product and information relating to a user of the user device; the analysis, by the advice device, of the information received from the user device; and generating and transmitting a recommended cosmetic formula to the user device, and wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product.

In one embodiment, the dispensing device includes a plurality of cartridges that each contain a cosmetic material and the dispensing device is configured to dispense a specified amount of the cosmetic material from the plurality of cartridges into a receiving area, and the formula recommended cosmetic is generated based on the cosmetic material in each of the cartridges in the dispensing device.

In one embodiment, the communication session is a video conference between the user and a beauty consultant who operates the consultant device.

In one embodiment, the information relating to the user is at least one of diagnostic data, biological data, environmental data, and social media activity data relating to the user.

In one embodiment, the diagnostic data is user image data captured by a camera of the user device.

In one embodiment, the advisory device or the user device is configured to convert the user's image data into three-dimensional data and perform a surface analysis of a part of the user's body based on the three-dimensional data.

In one embodiment, the advisor device is configured to determine target regions of the user's body part to be treated with the desired cosmetic product based on the surface analysis, and to generate the cosmetic formula recommended based on the target regions determined.

In one embodiment, the desired cosmetic product is one of a skin care product, a hair care product and a nail coloring product.

In one embodiment, a method is provided that is implemented by a system that includes an advisor; a user device; and a delivery device, wherein the counseling device and the user device are configured to perform a communication session with each other, the method comprising: transmitting, from the user device to the counseling device, information which include a desired cosmetic product and information relating to a user of the user device; the analysis, by the advice device, of the information received from the user device; and generating and transmitting a recommended cosmetic formula to the user device, and wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product.

The patent or application file contains at least one drawing executed in color. A fuller appreciation of the disclosure and many of the benefits associated therewith will be readily obtained as it becomes better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings in which:

The is an overall perspective view of a cosmetic product dispensing device, or of a cosmetic product dispenser, according to one example;

The is a perspective view of a distributor body, according to an example;

The is a perspective view of the cosmetic product dispenser with the dispenser body removed, according to an example;

The is a perspective view of internal components of the cosmetic product dispenser, according to an example;

The is a perspective view of internal components of the cosmetic product dispenser, according to an example;

The is a perspective view of a cartridge, according to an example;

The is a perspective view of an example cartridge sprocket;

The is a perspective view of a bottom plate, according to an example;

The is a perspective view of the lower plate, seen from below, according to an example;

The is a perspective view of a base, according to an example;

The is an exploded perspective view of a box, arranged above a manifold, according to one example;

The is a perspective view of the case in an open position, according to an example;

The is a diagram depicting an exemplary primary process sequence of a cosmetic formulation method 900, according to an example;

[Fig 111] The is a process diagram representing an example of a method for detecting cosmetic material in the cosmetic product dispenser, according to one example;

The and 12B are process diagrams showing examples of a method for selecting a cosmetic formulation, according to one example;

The is a process diagram representing an example of a method of dispensing cosmetic material in the cosmetic product dispenser, according to an example

The is a diagram representing an example of a connected cosmetic product dispensing system, according to one example; and

The is a diagram representing an example of a circuit assembly of the control device and the cosmetic product dispenser, according to an example.

The shows components of an ecosystem that uses the cosmetic product dispenser to prepare personalized doses for a user.

The shows an ecosystem that is based on offering a trendy lipstick color to a user.

The shows an example workflow in the ecosystem for dispensing a custom shade of lipstick from an app perspective.

The shows an additional flowchart of how smartphone app algorithms in the lipstick ecosystem can allow a user to see a lipstick shade on the user's selfie.

The further illustrates how the specific set of cartridges can result in different universes of shades to be presented to the user.

The shows how a "match my look" mode can operate on the app in the lipstick ecosystem.

The shows details of how the lipstick recommendation engine works based on the user's outfit selfie.

The shows an ecosystem that is grounded in providing the user with a skincare formulation that is most effective for the user.

The shows an example workflow in the ecosystem to deliver a personalized skincare formulation from an app perspective.

The shows an example of how a combination of different environmental factors determined to be present for a user can lead to different dosage amounts from three different cartridges.

The shows an ecosystem that is used to distribute a personalized foundation for a user.

The shows an example workflow in the ecosystem for dispensing custom foundation from an app perspective.

The provides details of a method of making a diagnosis of skin tone.

The and 22D show details of how deep learning is used to estimate skin tone in an image.

The shows a structure of a cartridge that bears an NFC tag.

The shows a data format of the data stored on the NFC tag on the cartridge.

The shows a table that includes descriptions of the various fields contained in the NFC tag data format.

The shows a structure of the dispensing device which is equipped for an intelligent switchable cartridge system.

The shows the establishment of a link between the distribution device and a user's smartphone device.

The shows a consumer app state machine that demonstrates a process from an app perspective of priming cartridges prior to any use of the dispensing device.

The shows a method of handling a faulty cartridge NFC tag in the scenario mentioned above.

The shows a side view of a dispensing device that includes a retractable plate.

The and 31B show different states of the retractable plate when it is at different heights.

The shows a reservoir of cleaning formula disposed between the body of the dispensing device and the retractable plate.

The shows another use of the retractable plate described above to provide a method of rinsing cartridges to remove any remaining ingredients or residue.

The , 34B and 34C show an intelligent custom compartmentalized system for use with the distribution system.

The and 34E illustrate mechanisms for allowing detection of a position of the tray and compartments to be sent to a user's mobile device.

The and 35B show a method for the user to provide a final personalized beauty supplement to any of the compartments in the disclosed tray.

The shows a system that allows a user to send a dispensing formula to the disclosed dispensing device based on the results of a digital beauty consultation with a beauty consultant (CB).

The shows a flow of operations in a beauty consultation session between consumer and CB.

The shows an example of all types of consumer data that may be collected during the consultation session.

The shows a different example of a consultation session, where the consumer is interested in a hair care product.

The shows another example of a consultation session, where the consumer is interested in a nail gel product to be dispensed from a dispensing device.

The shows an example of the types of dispensing device settings that can be determined during the remote viewing illustrated on the , 39 and 40.

DETAILED DESCRIPTION OF EMBODIMENTS

In the drawings, like reference numerals denote the same or corresponding parts throughout the several views. Further, as used herein, the words "one", "an", and others generally have the meaning of "one or more", unless otherwise specified.

Referring now to the drawings, like reference numerals denote the same or corresponding parts throughout the several views.

The selection of cosmetic formulations, and constituent cosmetic materials for formulating cosmetic formulations, is a routine activity often relying on subjective decision-making and manual intervention. There is a wide variety of cosmetic materials available, and countless combinations and permutations of cosmetic formulations possible.

On every occasion that cosmetic formulations are used, subjective decisions are often made by an end user of cosmetic products to produce satisfactory cosmetic formulations. Results are usually the result of experimentation, perhaps requiring multiple iterations to produce a satisfactory result. In part due to limited knowledge of specific traits of base cosmetic materials and the necessary proportions, the resulting cosmetic formulations may lack precision. The production repeatability of a specific cosmetic formulation is thus difficult to achieve. The embodiments below address these problems in the conventional art.

Specifically, the description below relates to an eco-system for delivering skin care and manufacturing formula customization system for home use that is based on a specialized dispensing device that allows ingredients for a cosmetic product to be instantly blended into a user's preferred end result and then easily transported for portability.

The system shown below is a first-of-its-kind, AI-powered 3-in-1 device for personalized skin care, foundation and liquid lipstick at home. The device and its corresponding app evaluate users' individual skin and local environmental data to create and deliver personalized, on-the-spot skin care and cosmetic formulas that are enhanced by increased levels of personalization during time.

The overall ecosystem features a motorized system of cartridges, enabled by artificial intelligence, as described above, which creates personalized formulas of skin care and cosmetic products in four steps. The device creates personalized skin serums through the following process:

1. Personal skin analysis: The user takes a photo with a smartphone camera and opens an app on the smartphone. The app uses artificial intelligence to analyze the user's overall skin condition, assessing deep wrinkles, fine lines, blackheads, lack of firmness, visible pores and lack of radiance.
2. Environmental Assessment: The app (and/or a separate cloud platform) assesses local environmental conditions that may influence the condition of the user's skin, including weather, temperature, humidity, UV index , air quality and pollen.
3. Product Preference: The user then enters their specific skincare concerns such as fine lines, wrinkles, blackheads, rough skin texture and dullness into the app.
4. Custom Formulation and Dispensing: A custom blend of high-performance skincare is then dispensed in a single, calibrated dose at the top of the device.

The motor system, located at the top of the device, moves and compresses formula from the cartridges at the base of the machine in an upward motion to the dispensing tray above for clean application.

With regular use, the AI platform can assess the appearance of a user's skin over time, helping users identify what works, and benchmarking future formulas. The AI-powered system can optimize the effectiveness of personalized formulas. By regularly taking photos, users allow the intelligent system to recognize the effects of the formulas, and adjust the dosage of active ingredients accordingly. That said, the user can ignore the system's recommendations if they are looking for, for example, an additional moisturizer.

The skin care system contains active ingredients including AHAs, vitamins C and E, hyaluronic acid, ferulic acid, retinol, cucumber, thyme and blackberry.

Cosmetic product offerings, for foundation and liquid lipstick, will have the ability to incorporate real-time trending information and color matching technology into its personalized product offerings as described below. below.

• Using the lipstick system, consumers will be able to create liquid lipstick based on their personal skin tone and preferences. The system can match the hue to the user's clothing or accessories, or it can even opt to create a particular color that's trending on social media. The device will have three cartridges; collectively, these cartridges will have the ability to create hundreds of shades.
• The foundation system described below will contain three cartridges, ranging from pale to intense tones. Knowing that a foundation is never omnivalent, a selection of these color trios can be offered to match the widest variety of shades. Using a shade matching tool, the three cartridges will dispense varying levels of color to create custom shades. The device has the ability to create hundreds of custom shades. The device will create a single dose of color, but users can easily double or triple the amount with an additional touch control.

There are three dosage settings for the system described here. There will be a standard size dose (0.7 grams; roughly the size of a pistachio) that users can double or triple with an additional touch control.

The device has a detachable case fitted with a mirror allowing you to take a calibrated dose of product with you.

From opening the app and taking a picture of a face to dispensing the product, the user experience with the current system takes about three minutes.

[DISTRIBUTION DEVICE]

The is an overall perspective view of a cosmetic product dispensing device 100, or of a cosmetic product dispenser, according to one example. The visible portion of the cosmetic product dispenser 100 includes a base 102 connected to a power cord 104. The base 102 provides support for the dispenser body 106. A housing 108 is disposed above the dispenser body 106, a switch button 110 may be disposed partly inside the dispenser body 106 such that the dispenser body 106 controls the positioning of the switch button 110, and an indicator light and button 122 may be disposed partly inside of the dispenser body 106 such that the dispenser body 106 constrains the positioning of the light and button 122. The light and button 122 may be a mechanical or capacitive touch button.

The is a perspective view of the dispenser body 106, according to an example. Dispenser body 106 is a hollow, thin-walled container that serves as a cover for many of the components of cosmetic product dispenser 100. In this example, dispenser body 106 has a first end at the top having an approximately square cross-section with rounded corners, while a second end at the bottom has a circular cross-section. Dispenser body 106 may provide a base for housing 108, or other components that serve as a base for housing 108. Dispenser body 106 may also include a mounting point for switch button 110 and a mounting point for the light and lighted button 122.

The is a perspective view of the cosmetic product dispenser 100 with the dispenser body 106 removed, according to an example. Switch button 110, light and button light 122, controller 150, bottom plate 166, inductive plate 176, and gear housing 170 are visible in this view, as is bottom body section 154. a middle body section 155 and an upper body section 156. The switch button 110 is electrically connected to the controller 150.

Controller 150 includes circuitry for distributing power received through power cord 104, controlling one or more motors 112 to dispense cosmetic material, detecting readings from an optical encoder 192, charging a or several batteries 126, operate any indicator such as the light and button 122, the bells or other audiovisual signals, the sensors such as for detecting the availability status, the type and quantity of cosmetic material, and communicate wirelessly with external devices, including circuitry to send and receive signals and data, such as through smart phones and other wireless devices, using a variety of communication protocols, such as radio frequency (RF) , Bluetooth, Wi-Fi or Cellular.

The inductive plate 176 carries the lower plate 166, apart from the base 102 and the power cord 104, the rest of the cosmetic dispenser 100 is disposed above the lower plate 166. The gear box 170 is disposed above the internal components of the cosmetic product dispenser 100 which are described in more detail by FIG. 4 at the , is connected to them, and provides support for them. Further, gear housing 170 includes a plurality of gear housing cartridge holes 178, one for each cartridge 114 in cosmetic dispenser 100. A nozzle 160 of each cartridge 114 is disposed within one of the gearbox cartridge holes 178. Various additional substructures and covers may be disposed between the internal components of the cosmetic dispenser 100 and the dispenser body 106.

For example, upper body section 156 is disposed above center body section 155, and lower body section 154 is disposed below center body section 155. When connected, the dispenser body 106 attaches to the exterior of at least one of lower body section 154, middle body section 155, and upper body section 156. Bottom plate 166 is disposed below lower body 154 and is connected thereto.

The and are perspective views of internal components of the cosmetic product dispenser 100, according to one example. The inner assembly includes a plurality of distributor assemblies 120, disposed above bottom plate 166 and inductive plate 176. Each distributor assembly 120 includes cartridge 114, cartridge gear 116, motor 112 , motor gear 124, ejector 140, ejector split ring 190, ejector spring 142, ejector spring pin 144, detent plunger 146, and detent spring 152. 150 controls the operation of each of the dispensing assemblies 120. The cosmetic product dispenser 100 includes at least one dispensing assembly 120. The examples described herein contain three dispensing assemblies 120, although those skilled in the art will recognize that A cosmetic dispenser 100 can have any number of dispenser assemblies 120.

Further, a plurality of batteries 126 within the cosmetic product dispenser 100 are electrically connected to the plurality of dispensing assemblies 120 to provide electrical power for the operation of the controller 150, the timing assembly 120, motor 112, and various indicators, such as light and button light 122 (described in more detail on ), ringtones, and other audiovisual signals.

The controller 150 and a connected device 300 (shown in the ) allow a user to operate the cosmetic dispenser 100 wirelessly. Cosmetic material formulation and recipe commands to controller 150 may be received from connected device 300, such as a smart phone, tablet, or personal computer, configured to communicate with cosmetic product dispenser 100 In addition, the dispensing of cosmetic material can also be triggered by the user by touching the indicator and light button 122 on the cosmetic product dispenser 100.

Cartridge 114 also has a cartridge lug 162 disposed on or near nozzle 160, is connected near a first end to cartridge sprocket 116, is connected near a second end to bottom plate 166, with a motor gear 124 connected to motor 112, and motor gear 124 drive-connected to cartridge gear 116. Cartridge 114 and cartridge gear 116 are held in position by gear housing 170 (shown on the ). Cartridge 114 may be disposed within cosmetic dispenser 100, and held in place by ejector 140 connected to ejector spring 142, ejector spring pin 144 connected at a first end to the ejector spring 142 and rigidly connected at a second end to an interior surface of at least one of the distributor body 106, the lower body section 154, the middle body section 155, upper body section 156, and other internal structure. Dispenser assembly 120 further includes split ejector ring 190 (shown in ) to guide the movement of the ejector 140 within the cosmetic dispenser 100 during insertion and removal of the cartridge 114, with the split ejector ring 190 disposed against the interior surface of at least l one of the distributor body 106, the lower body section 154, the middle body section 155 and the upper body section 156 to provide a guide for the movement of the ejector 140.

Additionally, a trigger plunger 146 may be disposed substantially perpendicular to a longitudinal axis of the cartridge 114 and connected near the second end of the cartridge 114, providing lateral pressure to a circumferential groove 134 of the cartridge 114, holding the cartridge 114 in place along the vertical Y-axis, countering an opposing force applied by tension on cartridge 114 by ejector 140, ejector spring 142, and ejector spring pin 144. The ejector 140 is disposed inside cosmetic dispenser 100 and can move substantially parallel to cartridge 114, and is connected to ejector spring 142 which is further connected to ejector spring pin 144. While the cartridge 114 is inserted into the cosmetic product dispenser 100, an edge of the ejector 140 comes into contact with an edge near the first end of the cartridge 114. The ejector 140 applies pressure to cartridge 114 as ejector spring 142 stretches with increasing distance between stationary ejector spring pin 144 and ejector 140, as ejector 140 moves with cartridge 114 further into the cosmetic dispenser 100. Once the cartridge 114 is inserted to the point that a first end of the trigger plunger 146 comes into contact with the circumferential groove 134 of the cartridge 114, the movement of the cartridge 114 along the Y axis is restricted, holding the cartridge 114 in place.

The trigger plunger 146 is a mechanism for holding the cartridge 114 in place. The trigger plunger 146 moves along an axis substantially perpendicular to that of the major axis of the cartridge 114. A first end of the trigger plunger 146 is arranged to come into contact with the cartridge 114. A second end is connected to a first end of a detent spring 152, the second end of the detent spring 152 in contact with an interior surface of at least one of the distributor body 106, the lower body section 154, the central section body 155, upper body section 156, or other internal structure. Insertion of cartridge 114 into cosmetic dispenser 100 moves trigger plunger 146 against trigger spring 152, compressing trigger spring 152. Since the contour of cartridge 114 varies along the length of cartridge 114, the trigger plunger 146, and the trigger spring 152 are moved by varying amounts depending on the position of the cartridge 114 relative to the cosmetic product dispenser 100. At a time when the trigger plunger 146 comes into contact with the circumferential groove 134 of the cartridge 114, the first end of the detent plunger 146 is able to lock the cartridge 114 in place due to the pressure of the detent spring 152 and the geometric relationship between the detent plunger 146 and the circumferential groove 134 .

Further, the cartridge 114 is inserted into the cosmetic dispenser 100 through a cartridge through-hole 172 of the bottom plate 166. The cartridge through-hole 172 has a base lug cutout 165 ( ) shaped to mate with base spigot 164 such that while base spigot 164 and base spigot cutout 165 come into contact, cartridge 114 cannot rotate relative to bottom plate 166 Cartridge 114 is also shaped to fit into bottom plate 166 and cartridge sprocket 116 in a specific orientation. In the position where cartridge 114 is fully inserted into cosmetic dispenser 100 and locked in place by detent plunger 146, cartridge 114 is seated against cartridge sprocket 116. Additionally, cartridge sprocket 116 has a collar portion 168 which is rotatably connected to the gear housing 170, restricting the movement of the cartridge sprocket 116 such that the cartridge sprocket 116 may rotate about a longitudinal axis but may not move axially or otherwise, and supporting the position of each of cartridge gears 116 and motor gears 124. Similarly, motor gear 124 has a motor gear collar portion 169 which is connected in rotation at gear housing 170, restricting movement of motor gear 124 such that motor gear 124 can rotate about a longitudinal axis but may not move. axially or otherwise, preserving the relationship between cartridge sprocket 116 and motor sprocket 124 such that rotary motion of motor sprocket 124 results in rotary motion of cartridge sprocket 116 at a fixed report.

Motor gear 124 may be a spur gear that includes a lug cutout 163 ( ) which fits cartridge lug 162 of cartridge 114, as described by .

The is a perspective view of the cartridge 114, according to an example. Cartridge 114 has a round cylindrical body and a nozzle 160 at one end. The nozzle 160 is further disposed near a cartridge lug 162. The cartridge lug 162 fits inside the opening of the cartridge sprocket 116, matches the shape of the cartridge cutout. lug 163 of the cartridge sprocket 116, and locks rotational movement of the portion near a first end of the cartridge 114 with that of the cartridge sprocket 116. While the cartridge sprocket 116 is driven by motor gear 124 and motor 112. A second end of cartridge 114 includes base spigot 164. Base spigot 164 fits within base spigot cutout 165 of plate 166, secures the second end of the cartridge 114 to the bottom plate 166, and prevents rotational movement of the second end of the cartridge 114 relative to the bottom plate 166. Since the first end of the cartridge 114 is secured to the cartridge gear wheel movement 116, actuation of motor 112 rotates motor gear 124 and drives cartridge gear 116, thereby opening and closing nozzle 160 of cartridge 114. relation to the other.

Cartridge 114 contains and dispenses an amount of cosmetic material into housing 108 as needed (described in more detail by FIG. 9). Cartridge 114 dispenses cosmetic material by rotation of cartridge sprocket 116 while cartridge 114 remains in place substantially vertically along the Y axis. Cartridge sprocket 116 is driven by motor sprocket 124 which is rotated by rotation of motor 112. The amount of rotation of motor 112 is controlled by controller 150.

A quantity of cosmetic material is released from the cartridge 114 through the nozzle 160 by a first rotational movement of the first end relative to the second end of the cartridge 114. The rotational movement of the first end of the cartridge 114 in a second direction, opposite to the first rotational movement, can close the nozzle 160 of the cartridge 114.

Cartridge gear wheel 116 actuates nozzle 160 of cartridge 114 which is attached to cartridge lead screw 202 hollow within cartridge 114. Rotation of cartridge lead screw 202 proportionally moves cartridge plunger 200 which forces a quantity of cosmetic material through the cartridge lead screw 202 and out of the nozzle 160 of the cartridge 114. The quantity of cosmetic material released during an opening and closing operation of the nozzle 160 is a function of the movement of the cartridge lead screw 202, which is dependent on the rotational movement of the cartridge gear 116. The rotation of the motor 112 rotates the respective motor gear 124 and the cartridge gear 116. The controller 150 detects the relative movement of the cartridge sprocket 116 using the optical encoder 192 to count a number of cartridge sprocket slots 148 which pass the optical encoder 192 while the wheel cartridge gear 116 rotates, and the direction of rotation of the cartridge gear 116. A unit of measurement specific to the cosmetic material is a dose unit 118.

In one example, the pitch of cartridge lead screw 202 is approximately 1 mm, with one full rotation of cartridge lead screw 202 dispensing approximately 1 ml of cosmetic material from cartridge 114.

In another example, due to the shape of cartridge lug 162 of cartridge 114, circumferential groove 134 may be a notch or groove around a portion of the circumference of cartridge 114, rather than s fully extend around the perimeter of cartridge 114 to secure cartridge 114 to trigger plunger 146 in substantially the same manner.

The is a perspective view of the cartridge sprocket 116, according to one example. Cartridge sprocket 116 may be a spur gear which includes a lug cutout 163 which matches the shape of cartridge stub 162 of cartridge 114. Cartridge sprocket 116 may further have a collar 168 which rotatably connects to an interior surface of gear housing 170 to align and support the position of cartridge gear 116 and corresponding motor gear 124. Cartridge sprocket 116 may have a plurality of cartridge sprocket slots 148 for use with optical encoder 192 to sense the angular position of cartridge sprocket 116 and cartridge lead screw 202.

The is a perspective view of the bottom plate 166, according to an example. The bottom plate 166 is connected to the dispenser body 106 and/or the bottom body section 154, constrains the plurality of cartridges 114 disposed within the cosmetic product dispenser 100, and connects the cosmetic product dispenser 100 to the inductive plate 176 arranged below the lower plate 166.

The bottom plate 166 has a plurality of cartridge through-holes 172 to allow insertion, removal, and securing of the plurality of cartridges 114. Each cartridge through-hole 172 includes a base lug cutout 165, and the shape of the base lug cutout 165 corresponds to the shape of the base lug 164 of each cartridge 114 to prevent rotational movement of the second end of the cartridge 114, the portion in contact with the bottom plate 166, when the cartridge 114 is installed in the cosmetic product dispenser 100.

Additionally, bottom plate 166 has contact pins 174 (shown in ) which come into contact with the inductive plate, supplying electricity to the lower plate 166, allowing the cosmetic product dispenser 100 to charge the plurality of batteries 126 by contact or induction.

The is a perspective view of the bottom plate 166, seen from below, according to an example. The bottom plate 166 includes three cartridge through-holes 172 disposed within the plate, and contact pins 174. When the bottom plate 166 is disposed within the cosmetic dispenser and on the base 102, the contact pins 174 can conduct electricity from base 102 to bottom plate 166. Bottom plate 166 can then inductively charge the plurality of batteries 126 disposed above bottom plate 166.

The is a perspective view of the base 102, according to an example. A power cord 104 is connected at a first end to base 102. Power cord 104 is connected at a second end to a power source (not shown), providing power. energy for the operation of the cosmetic dispenser 100 and for charging the plurality of batteries 126. The base 102 includes a base indentation 128 for positioning the inductive plate 176 and other portions of the cosmetic dispenser 100. The indentation base unit 128 may have the ability to inductively charge the plurality of batteries 126 using power supplied by the power cord 104. In addition, it may also charge the cosmetic dispenser 100 through contact pins 174 disposed within bottom plate 166 when bottom plate 166 is disposed within base indentation 128.

The is an exploded perspective view of the housing 108, arranged above a manifold 130, according to one example. Housing 108 includes a top cover 180, a housing base 182, and a bottom cover 184. The top cover 180 is disposed above the housing base 182, which is disposed above or inside the cover. 184. Top cover 180 is secured to housing base 182 by magnets, as described in more detail by . Housing base 182 includes a plurality of housing base through-holes 138. In this example, there is one housing base through-hole 138 for each cartridge 114 in cosmetic dispenser 100. Bottom cover 184, having a plurality of bottom cover through-holes 136, is disposed below the housing base 182. In this example there is one bottom cover through-hole 136 for each cartridge 114 in the cosmetic dispenser 100, and the bottom cover 184 is arranged such that each bottom cover through hole 136 matches and is connected to a case base through hole 138 of the case base 182.

Housing 108 is connected to manifold 130, manifold 130 connected to and disposed above gear housing 170, further disposed within dispenser body 106 of cosmetics dispenser 100, and the housing 108 is disposed above both manifold 130 and dispenser body 106. Manifold 130 includes a manifold through-hole 132 for each cartridge 114 in cosmetic dispenser 100, and manifold 130 is disposed so each manifold through-hole 132 corresponds to and is connected to a housing base through-hole 136 of the bottom cover 184. Further, each manifold through-hole 132 of the manifold 130 corresponds to a gearbox cartridge hole 178 of the gear housing 170 and is disposed above it, providing a passage through which cosmetic material can be dispensed from the nozzle 160 of each cartridge 114 through the e manifold 130, the bottom cover 184, and in the housing base 182.

Housing 108 may be shaped such that there is only one orientation through which housing 108 may connect to cosmetic dispenser 100. In another example, the shape of housing 108 may connect to housing 108 in more than one orientation.

Additionally, cosmetic material dispensed into housing 108 can be prevented from escaping through the use of a one-way duckbill valve 194 (not shown) disposed within each of the base through-holes of housing 136 into bottom cover 184 of housing 108.

The is a perspective view of housing 108 in an open position, according to one example. Housing 108 includes a top cover 180, a housing base 182, a bottom cover 184, a plurality of hinge magnets 186a, 186b, 186c and 186d, a plurality of cover magnets 188a, 188b, 188c and 188d, and a plurality of mounting magnets 196a, 196b and 196c.

In one example, the housing base 182, the plurality of mounting magnets 196a-196c, a first half of the plurality of cover magnets 188b and 188d, and a first half of the plurality of hinge magnets 186b and 186d, are disposed within bottom cover 184, with housing base 182 disposed above. The plurality of mounting magnets 196a-196c are arranged to magnetically connect the housing 108 to the cosmetic product dispensing device 100, for example by connection to the collector 130 ( ). Collector 130, or portions of the surface of collector 130, may be formed of a ferrous material or contain corresponding magnets for magnetic attachment to the plurality of mounting magnets 196a-196c.

A second half of the plurality of cover magnets 188a and 188c are disposed inside one side of the top cover 180, and a second half of the plurality of hinge magnets 186a and 186c are disposed inside on one side of top cover 180. Hinge magnets 186b and 186d are disposed within one side of bottom cover 184 such that they can contact corresponding hinge magnets 186a and 186c in at least two planes, depending on a relative position between top cover 180 and bottom cover 184. Hinge magnets 186a and 186b have opposite magnetic polarity, as do respective pairs of hinge magnets 186c and 186d, cover magnets 188a and 188b, and cover magnets 188c and 188d.

The plurality of 196 and the plurality of cover magnets 188a-188d may be arranged such that the plurality of bottom cover through-holes 138 disposed in the housing base 182 are unobstructed to allow cosmetic material to flow from each of the cartridges 114 in the housing 108 as the cosmetic material is dispensed.

In a case where housing 108 is in an open position, top cover 180 and bottom cover 184 are positioned approximately in perpendicular planes, hinge magnets 186a and 186c magnetically connected to hinge magnets 186b and 186d, respectively. The magnetic force between each pair of hinge magnets 186a and 186b and hinge magnets 186c and 186d is sufficient to hold top cover 180 in position relative to bottom cover 184.

In a case where housing 108 is in a closed position, top cover 180 and bottom cover 184 are positioned approximately in parallel planes, hinge magnets 186a and 186c magnetically connected to hinge magnets 186b and 186d, respectively, and the cover magnets 188a and 188c are arranged in corresponding positions, and magnetically connected to the cover magnets 188b and 188d, respectively, the magnetic connection between the pairs of hinge magnets 186a and 186b and hinge magnets 186c and 186d, and between pair of cover magnets 188a and 188b, and pair of cover magnets 188c and 188d, sufficient to keep top cover 180 connected to bottom cover 184 in a closed position.

Since top cover 180 is magnetically connected to bottom cover 184, top cover 180 can be completely disconnected from bottom cover 184. Further, it can also be able to connect to bottom cover 184 in a closed position in more than one way. orientation about the x-z plane, depending on the arrangement of the plurality of hinge magnets 186a-186d and cover magnets 188a-188d inside the top cover 180 and the bottom cover 184. Further, the top cover 180 may be pivotable around bottom cover 184, or vice versa, opening or closing around more than one axis, such as around the x-axis or the z-axis.

Alternatively, the plurality of mounting magnets 196a-196c may be substituted by a mounting magnet 196 of sufficient strength to secure the housing 108 to the cosmetic product dispensing device 100.

Alternatively, the plurality of hinge magnets 186a-186d may be substituted with one hinge magnet 186a of sufficient strength in top cover 180 and one hinge magnet 186b of sufficient strength in bottom cover 184 to secure one side of the top cover 180 to bottom cover 184 with housing 108 in an open or closed position.

Alternatively, the plurality of cover magnets 188a-188d may be substituted with a cover magnet 188a of sufficient strength in top cover 180 and a cover magnet 188b of sufficient strength in bottom cover 184 to secure one side of the top cover 180 to bottom cover 184 with housing 108 in a closed position.

The is a diagram depicting an exemplary primary process sequence of a cosmetic formulation method 900, according to an example. The examples provided here each have three cartridges, although the same method could be used by a cosmetic product dispenser 100 equipped with any number of cartridges 114. The cosmetic formulation method 900 includes a detection method S920, a method of S940 selection and an S960 distribution method. An additional S980 mixing process can be performed by a user. The detection methods S920, the selection method S940 and the dispensing method S960 are performed by the cosmetic device 100 based on commands received from the controller 150, the controller 150 sending data to the user and receiving input therefrom through the smart device 300 or through indicators on the cosmetic device 100 itself, as described in and FIG. 4.

The is a process diagram representing an example of a method for detecting cosmetic material in the cosmetic product dispenser 100, according to an example. S920 represents a method for detecting a cosmetic material. Method S920 may include at least one of the steps of step 921 detecting removal and installation of a cartridge 114, step 922 detecting at least one hardware feature of the cartridge 114, step 923 for detecting an amount of cosmetic material in the cartridge 114, and an optional step 924 for calculating an estimated depletion of the cartridge(s) after a future administration operation has been performed.

The optional step 923 of detecting an amount of material in each of a plurality of cartridges 114 may include, for example, step 923a detecting an amount of material from a cartridge A, step 923b detecting an amount of material from a cartridge B, and step 923c sensing an amount of material from a cartridge C, for example based on a total net displacement (rotation) of the cartridge sprocket 116 sensed by the optical encoder 192 since installation of each 114 cartridge.

The optional step 924 of detecting at least one hardware characteristic in each of a plurality of cartridges 114 may include, for example, step 924a detecting at least one hardware characteristic of a cartridge A, step 924b detecting at least one hardware feature of a cartridge B, and step 924c detecting at least one hardware feature of a cartridge C. The hardware features may include at least one of color, texture, gloss, moisture, nutrient content and chemical formulation. This detection can be accomplished based on a near-field sensor disposed in dispenser 100 that detects a radio frequency identification tag on the cartridge that stores information about the contents of the cartridge according to methods well understood in the art. art. Alternative methods of detection may be used such as bar code detection of a bar code printed on the cartridge, or detection using methods well understood in the art. The step of detecting the at least one material characteristic in each of the cartridges can be performed before the optional step of detecting the quantity of cosmetic material in each cartridge.

Additionally, method S920 may include an optional step 926 to report information that may be derived from historical usage data, from the user or from aggregated user groups, such as which cartridge 114 is inside the dispenser of 100 cosmetics should run out of cosmetics first and when.

The is a flow diagram showing an example of an S940 method for selecting a cosmetic formulation, according to an example. S940 includes a method for selecting a cosmetic formulation. Method S940 includes steps of identifying possible cosmetic formulation combinations based on the type and amounts of cosmetic materials present within cosmetic dispenser 100, as determined by detection method S920.

A step 942d may be based on a user selection from a set of cosmetic formulations that are possible for the types and amounts of cosmetic material present inside the cosmetic product dispenser 100, or a step 942c allows the user to choose from a larger set of cosmetic materials inventory 204 that is possible for the types and amounts of cosmetic materials that cosmetic product dispenser 100 is capable of using.

In another example, a method step 943 S940 includes letting a user choose a desired dose unit 118. Varying the unit dose 118 may change the set of cosmetic formulations available from within the cosmetic dispenser 100 if a greater amount of one or more cosmetic materials than is available to dispense a specific amount of 118 unit dose for a specific cosmetic formulation is needed.

For example, if cartridge A contains yellow cosmetic material, cartridge B contains red cosmetic material, and cartridge C contains green cosmetic material, and there is only one unit dose 118 of cartridge A remaining , the user would not be able to choose to dispense any combination of dose units 118 and a cosmetic formulation that requires more than one dose unit 118 of yellow cosmetic material.

Further, the method S940 may include a step 942a for the user to select a cosmetic formulation based on a photo match, a step 942b for the user to select a cosmetic formulation based on recommendations, or selects a cosmetic formulation based on another process. U.S. patent number 8,634,640 describes a method for selecting a color from an image or photograph in a camera or electronic device, and using color reference data to substantially match the color. .

In another embodiment, a skin diagnosis (sometimes referred to herein as a skin profile) may be performed to provide a recommended plurality of predetermined colors for the user to make a selection based on a feature analysis. of the user's skin. Skin diagnosis determines an appropriate color for the user based on an imaging operation performed on the user's face. Examples of known skin diagnostic tools in the art are: Lancome Diagnos ABS, HR Skinscope, Biotherm Bluesmart, Kiehl's Skinprofiler V.0, CA Dermanalyzer, and the Vichy Vichyconsult.

For cosmetic formulations that are possible but not available based on the results of detection method S920, cosmetic product dispenser 100 may communicate to the user which cosmetic materials are needed to dispense such cosmetic formulations.

In one example, in step 944 the user selects a unit dose 118 of a cosmetic formulation that is currently unavailable. Step 944 may determine what cosmetic materials, such as what type of cartridges 114, are needed to mix and dispense the selected cosmetic formulation.

In another example, step 944 may determine which additional cosmetic formulations may become available if a specific cartridge 114 is replaced with a full but otherwise identical cartridge 114.

In another example, step 944 may determine which additional cosmetic formulations may become available if a cartridge 114 is replaced with another cartridge 114 containing a different cosmetic material.

Step 945 determines whether to proceed to step 947 to prompt the user to confirm and proceed to dispensing a cosmetic formulation or to proceed to step 946 to report which cartridge(s) 114 are needed to dispense the desired cosmetic formulation, based on the result of step 944.

The shows an optional process S940b which is performed by dispensing device 100 alone after a cosmetic formulation has previously been received and is currently stored on dispensing device 100 in a step 948. The remaining steps 943 through 947 of S940b are identical to those of S940 described by the . The process of can be made without an existing connection being established between the dispenser 100 and the device 300.

The is a flow diagram showing an example of a method S960 for dispensing cosmetic material in a cosmetic product dispenser 100, according to an example. Step 961 represents a step for dispensing at least one unit dose of a cosmetic formulation. Method S960 includes steps 962a through 962c of ejecting a demanded amount of cosmetic material from at least one cartridge 114 to produce a cosmetic formulation selected by the user in method S940, such that the formulation cosmetic can be applied, transported in a container, or is available to the user. The method S960 includes the optional steps 963a to 963c of detecting the remaining quantity of cosmetic material in each of the cartridges and the optional step 964 of recording the results in a memory of the dispensing apparatus.

After the S960 dispensing process is complete, the user can perform the S980 process of mixing the released cosmetic material manually, producing the requested cosmetic formulation.

The is a diagram representing an example of a connected cosmetic product dispensing system, according to an example. A system 400, which implements the cosmetic product dispenser 100 described above, includes at least the cosmetic product dispenser 100 and a connected device 300. Optionally, the system can further include one or more external servers 410 which are implemented as part of a cloud computing environment. Additionally, the system may optionally include a cosmetic material inventory 204 which is a possible cosmetic material inventory that can be inserted into the cosmetic device 100.

The connected device 300 can be a personal computer (PC), a laptop computer, a PDA (Personal Digital Assistants), a smartphone, a tablet-type device, an UMPC (Ultra Mobile Personal Computer), a netbook, or a computer notepad type staff. In the examples below, the connected device 300 is assumed to be a tablet type device, such as an Apple iPad.

Connected device 300 is capable of wireless communication with cosmetic dispenser 100 by means of wireless communication interface circuitry 774 on cosmetic dispenser 100. However, connected device 300 is also capable of presenting a wired connection to the cosmetic product dispenser 100 by means of a USB interface 776 on the device 100. In addition, each device, including the cosmetic product dispenser 100, can communicate with the others and with one another. or more external devices through an Internet connection through an 802.11 wireless connection to a wireless Internet access point, or a physical connection to the Internet access point, such as through the through an Ethernet interface. Each connected device 300 is capable of performing wireless communication with other devices, such as through a Bluetooth connection or other wireless means as well.

Connected device 300 is configured to receive information from a user for use in generating a cosmetic formulation that will be used by cosmetic dispenser 100 to dispense cosmetic material into housing 108.

The is a block diagram showing a set of circuits of the control device 150 and the cosmetic product dispenser 100, according to an example. A central processing unit (CPU) 710 provides primary control over the separate circuitry components included in the apparatus, such as a dispenser control circuitry 740 (which may include a control for motors 112, circuitry for optical encoder 192, and inductive sensor circuitry). CPU 710 can also control an optional 772 input/output device (such as a keyboard or mouse), 780 memory, 774 wireless communication interface circuitry, 776 universal serial bus (USB), a 778 LED driver, and a 780 display module. The 778 LED driver controls the pulse of one or more 122 indicator lights.

In one embodiment, the circuitry includes, among other things, one or more computing devices such as a processor (e.g., microprocessor, quantum processor, qubit processor, etc.), CPU processor (CPU), digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), or the like, or any combination thereof, and may include discrete electronic digital or analog circuit elements or components, or combinations thereof.

In one embodiment, a module includes one or more ASICs having a plurality of predefined logic components.

In one embodiment, a module includes one or more FPGAs, each including a plurality of programmable logic components.

In one embodiment, the circuitry includes one or more operably coupled (eg, communicatively coupled, electromagnetic, magnetic, ultrasonic, optical, inductive, electrical, capacitive, wireless, or other) components each other.

In one embodiment, the circuitry includes one or more remotely located components.

In one embodiment, the remotely located components are operatively coupled, for example, through wireless communication, such as with a connected device 300.

In one embodiment, the remotely located components are operatively coupled, for example, through one or more communication modules, receivers, transmitters, transceivers, or the like.

In one embodiment, any of the CPU 710 or other components shown in the can be substituted by other circuit assembly elements. Examples of circuitry include memory that, for example, stores instructions or information. Non-limiting examples of memory include volatile memory (eg, random access memory (RAM), dynamic random access memory (DRAM), or the like), non-volatile memory (eg, read only memory (ROM), electrically erasable and programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM), or the like), persistent memory, or the like. Additional non-limiting examples of memory include reprogrammable read only memory (EPROM), flash memory, or the like.

In one embodiment, the memory is coupled to, for example, one or more computing devices by one or more instructions, information, or power buses.

In one embodiment, the circuitry includes one or more computer-readable media players, docking interfaces, universal serial bus (USB) ports, memory card ports, or the like, and one or more input/output such as, for example, a graphical user interface, display device, keyboard, remote control, trackball, joystick, touchscreen, mouse, switch, rotator, or the like, and any other peripheral device.

In one embodiment, a module includes one or more user input/output components that are operatively coupled to at least one computing device configured to control (electrical, electromechanical, software-implemented, implemented by firmware, or other control, or combinations thereof) at least one parameter associated with, for example, determining one or more tissue thermal properties responsive to sensed shifts in switching voltage .

In one embodiment, the circuitry includes a computer-readable media reader or memory bank that is configured to accept a medium carrying a signal (e.g., computer-readable memory medium, readable recording medium by computer, or otherwise).

In one embodiment, a program for causing a system to perform any of the methods disclosed may be stored on, for example, a computer-readable recording medium, signal-carrying medium, or the like. Non-limiting examples of media carrying signals include recordable type media such as magnetic tape, floppy disk, hard disk drive, compact disc (CD), digital versatile disc (DVD), Blu-ray Disc ray, digital recording tape, computer memory, or the like, and a transmission type medium such as a digital or analog communication medium (e.g., fiber optic cable, data guide waves, a wired telecommunications link, a wireless telecommunications link (e.g., receiver, transmitter, transceiver, transmission logic, reception logic, etc.) Additional non-limiting examples of media carrying signals include, but are not limited to, DVD-ROM, DVD-RAM, DVD+RW, DVD-RW, DVD-R, DVD+R, CD-ROM, Super Audio CD, CD-R, CD+R, CD+RW, CD-RW, Video CDs, Super Video CDs, Flash Memory, Tape, Disc magneto-optical, MINIDISC, non-volatile memory card, EEPROM, optical disc, optical storage, RAM, ROM, system memory, web server, or other.

In one embodiment, the circuitry includes acoustic transducers, electroacoustic transducers, electrochemical transducers, electromagnetic transducers, electromechanical transducers, electrostatic transducers, photoelectric transducers, radio-acoustic transducers, thermoelectric transducers or ultrasonic transducers.

In one embodiment, the circuitry includes electrical circuitry operatively coupled to a transducer (e.g., actuator, motor, piezoelectric crystal, micro electromechanical system (MEMS), etc.).

In one embodiment, the circuitry includes an electrical circuitry comprising at least one discrete electrical circuit, an electrical circuitry comprising at least one integrated circuit, or an electrical circuitry comprising at least one integrated circuit with specific application.

In one embodiment, the circuitry includes electrical circuitry forming a general purpose computing device configured by a computer program (e.g., a general purpose computer configured by a computer program that at least partially performs methods and/or devices described herein, or a microprocessor configured by a computer program that at least partially implements methods and/or devices described herein), electrical circuitry forming a memory device (e.g., forms of memory (e.g. ., live, flash, dead, etc.)), an assembly of electrical circuits forming a communications device (e.g., modem, communications switch, optical-electrical equipment, etc.), and/or any non-electrical analogues thereof, such as optical or other analogues.

[PERSONALIZED COSMETICS ECOSYSTEM]

The shows the components of the 1600 ecosystem that are common to each product type. The ecosystem includes the distributor 1610, a user smartphone device 1620, and a cloud platform 1630. The smartphone is shown to include two building blocks of the smartphone application ("app") setting 1621 and of 1622 use of the smart phone application. Setup 1621 of the smartphone application will be described in detail below with respect to the various customization examples and involves establishing initial setup information to configure a user profile of the user. The configuration information can then be used when the smart phone application is used and it can also be sent to the cloud platform 1630 for use in sending a selection of relevant paces to the user.

Use of the smart phone application itself actually involves the user making selections that lead to the determination of a color, and performing interactive communication with the distributor, such as sending the recipe to the dispenser and tracking the status of the dispenser (such as inventory and remaining volume of cartridges in the dispenser). The smart phone application also realizes interactive communication with the cloud platform. For example, the smart phone application may receive the selection of relevant gaits described above, and it may also provide direct user feedback from the user on the gaits that the cloud platform has sent previously and can notify the cloud platform of the colors and recipes actually selected by the user and distributed by the distributor. Such feedback can provide a form of machine learning to the cloud platform and improve the algorithms used by the cloud platform.

[PERSONALIZED LIPSTICK ECOSYSTEM]

The shows the ecosystem (1700) described above which is based on proposing a trendy color of lipstick to the consumer after analyzing trends on social media by combining favorite tastes in terms of colors, geographical location , favorite influencers, past picks and more. It gives the opportunity to the consumer to choose a color based on a look, to try it virtually and to adjust it if necessary to finally produce the formula on the spot with a connected distributor. It is also possible to suggest a color based on the user's outfit scanned with a selfie. Consumers can save their favorite colors and share them with their virtual community.

The shows that a user's smart phone ultimately provides a recipe to the dispensing device via a smart phone application ("app"). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (use) of the smartphone app, the app needs to be set up (1710) with setting information to configure a user profile. App settings can be based on the following configuration entries.

• Questionnaire during onboarding (such as favorite color)
• Social media credentials (such as Instagram, Twitter, Facebook)
• Favorite influencers to follow color
• Geographical location based on local mode
• Environmental data (UV index, pollution, humidity, pollen)

Settings inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which may be an external server device that is connected via the Internet.

Actual use of the smartphone app (1720) includes selecting a mode for lipstick selection. In this example, the modes include a mode for selecting a social media trending recommendation by algorithms that run in the cloud platform (discussed in greater detail later). Another mode allows the user to create their own lipstick color using a wide variety of color options.

Another mode can allow the user to match a lipstick color to their “look” based on a selfie. In this example, the tint and finish selection on the featured image is retrieved. User can virtually try on the lipstick in real time, user can adjust the presented color. When the user is satisfied with the color, the user can touch a button displayed on the app to dispense the formula and an internal neural network will break down the requested color into different color cartridge doses. After the recipe is sent to the dispenser and the lipstick shade is dispensed, the user can apply the lipstick.

After using the lipstick, the user can use the app to provide feedback on whether he/she likes the rendering or not. The user can also save her favorite look and color for later reuse, and the user can share the look and color on the web through a social media platform.

The cloud platform implements functions shown in 1730, such as a remote algorithm workflow and an improvement process.

In the workflow performed by the cloud platform, personal social media network accounts (influencers, trending looks) can be harvested to search for data related to lipstick colors. The cloud platform can perform an analysis of one or more collected images to extract an average makeup color (lip color, foundation color, hair color) using a deep learning algorithm to segment makeup finishes for lips. For example, the cloud platform can accomplish this by first detecting the lips on a plurality of images using a technique known in the art (such as that described in U.S. Patent No. 5,805,745). The cloud platform can then perform comparisons of an extracted color with the colors most liked by one or more communities of users while also taking into account the user's parameterization inputs received from the smartphone device of the user. Taking into account all the data collected, the final step is for the cloud platform to send the user the results of the analysis in the form of the selection of relevant gaits noted above.

In the improvement process carried out by the cloud platform and the smartphone app, the user can save her favorite paces and "like" the popular color to enrich the harvesting algorithms for a relevant recommendation at a later time. The cloud platform can further aggregate feedback from all users, and the platform can send new users the most trending area by location.

The vending machine operations in block 1740 are already described in detail above, but are summarized as follows. The dispenser receives a command to dispense a certain proportion of each cartridge. The dispenser dispenses on the top and the user can mix it to get the desired color. The dispenser sends the inventory containing the remaining formula back to the consumer's app to ensure that only colors that can be dispensed are available in the UI when the user makes a selection.

The shows an example workflow in the ecosystem described above for dispensing a custom shade of lipstick from an app perspective. In step 1810, the user may select a "mode" as discussed above, which may be a mode for selecting a social media trending recommendation by the algorithms that are running in the cloud; allow the user to create their own lipstick color using a wide variety of color options; or allow the user to match a lipstick color to their “look” based on a selfie.

Step 1820 shows an example display when the mode is chosen to select a trending look powered by an artificial intelligence algorithm of the cloud platform. Step 1820 also shows that a menu is provided at the bottom of the interface to allow the user to switch between the modes described above.

Step 1830 shows an example display when the user has selected a potential hue and is allowed to adjust the hue using an appropriate adjustment mechanism such as a color palette or slide show. The hue can be shown on the user's selfie.

Step 1840 shows that after a color is finally selected by the user, the color is broken down into a combination of the available colors contained in the dispensing device cartridges, and then the recipe is transmitted to the dispensing device for be distributed.

The shows an additional flowchart of how smartphone app algorithms in the lipstick ecosystem can allow a user to see a lipstick shade on the user's selfie. A recipe prediction module 1860 ("Module 2") may receive as inputs the dispensing capacity of the device, which is the set of three cartridges of lipstick ingredients currently inside the dispensing device. distribution. Another input can be the mass tone color of dilution mixtures, which represent the actual color values that can be produced by the ingredients in the cartridge. The output of Module 2 is a list of recipes (actual dispensed quantities from each cartridge) and a corresponding predicted RGB color of the mass tone resulting from each recipe. Module 1 (1870) can then project how the lipstick will actually look on their lips based on the RGB color of the mass tone in a recipe and the color of the user's lips ( lip tint), which results in a list of recipes and a corresponding RGB color applied. The relationship between the mass tone color and the applied color based on the skin tone of the user's lips can be predetermined and stored in advance. Thus, what can be presented to the user on the display device is a palette based on an RGB color universe as shown in 1890.

The further illustrates how the specific set of cartridges can result in different universes of shades to be presented to the user.

The shows how the "match my look" mode can operate on the app in the lipstick ecosystem. At stage 1881, a user can enter a selfie that includes the user's outfit. A recommendation can be generated in different ways based on recognition of the colors and/or the type of outfit in the image. For example, an early approach ("Approach 1") in 1882 may use the 7 Rules of Color Science and Harmony to target the formation of a certain type of relationship between lipstick shade and colors outfit based on relationships on a color wheel as illustrated in Approach 1. Alternatively, at the 1883 stage, a predetermined palette may be presented based on a makeup artist's recommendation in view of the season's style of the outfit in combination with the color of the outfit.

The shows more details on how the lipstick recommendation engine works based on the user's outfit selfie. At stage 1891, probes can be set by the user at different points on the outfit, where a single probe can have priority. At the 1892 stage, a different color palette can be assigned to each probe based on the makeup artist's recommendation palettes, or it can be based on a predetermined color wheel relationship as shown in the . As seen in stage 1893, the output can recommend colors based on the set of cartridges installed in the dispensing device, and based on the number and priority of probes the user has decided to use . If desired, the user can also swipe to cycle through options that would be available in other color wheels if other cartridge sets were used. This may prompt the user to purchase a new set of cartridges.

[PERSONALIZED SKIN CARE ECOSYSTEM]

The shows the ecosystem (1900) described above which is based on proposing a skincare formulation to the user which is most effective for the user based on the geographical location of the user , environmental factor, cumulative UV exposure and a signed clinical diagnosis assessed by a smart phone or dermatologist. The system adjusts the proportion of active substances to obtain the most effective recipe on a daily basis. The user can save his favorite colors among all and share them with his virtual community.

The shows that a user's smart phone ultimately provides a recipe to the dispensing device via a smart phone application ("app"). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (use) of the smartphone app, the app needs to be set up (1910) with setting information to configure a user profile. App settings can be based on the following configuration entries.

• Questionnaire during onboarding (such as favorite color)
• Skin care analysis by a dermatologist or by artificial intelligence algorithms with a selfie
• Geographic location based on smart phone location detection function
• Environmental data (UV index, pollution, humidity, pollen)

Settings inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which may be an external server device that is connected via the Internet.

Actual use of the smart phone app (1920s) includes collecting environmental data based on geographic location and combining it with smart phone diagnostics evaluating clinical signs (wrinkles, blackheads, firmness, pores, fine lines, dullness).

The user can also collect data from a UV sensor, such as a wearable UV sensor as described in U.S. Patent No. 10,060,787, which will actually give an accurate measurement of the cumulative UV exposure received. Based on the historical data of skin assessment and environmental factor, the app will work out the perfect formulation to fight the signs of aging in your skin and protect it from the environment. When the user is satisfied with the formulation, the user can touch a button displayed on the app to dispense the formulation and an internal neural network will break down the requested formulation into ingredients from different cartridges. After the recipe is sent to the dispenser and the formulation is dispensed, the user can apply the formulation. The user can provide feedback on their favorite formulations for a specific period of time.

The cloud platform implements functions shown in 1930, such as a remote algorithm workflow and an improvement process. In the workflow performed by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the app user to adjust the recipe. For example, there is a known correlation between environmental conditions and skin aging (see “ Assessing the impact of an aerial chronic urban pollution (UP) on some facial signs of differently - aged Chinese men ” at www. researchgate.net, and “ The skin aging exposome ” at www.jdsjournal.com). Additionally, by giving an input of the user's geographic location, which can provide a determination of air quality using a tool such as Breezometer ^TM and a prediction of local UV Index (or exposure to UV can be obtained based on a UV sensor described above), the cloud platform can adjust the recipe to address environmental factors such as UV exposure and air quality. For example, the below shows sample combinations of environmental factors and how they correlate with the ingredients in the cartridges.

In the improvement process carried out by the cloud platform and the smartphone app, the user can save his favorite recipes which are the most effective over time or the best feeling on the skin. The user can also share his recipes with the community.

The cloud platform can further aggregate feedback from all users, and the platform can send new users the area of trending formulations by location.

Distributor operations in block 1940 are already described in detail above, but are summarized as follows. The dispenser receives a command to dispense a certain proportion of each cartridge. The dispenser dispenses on the top and the user can mix it to get the desired color. The dispenser sends the inventory containing the remaining formula back to the consumer's app to ensure that only ingredients that can be dispensed are available in the UI when the user makes a selection.

The shows an example workflow in the ecosystem described above for delivering a personalized skincare formulation from an app perspective. In step 2010, the user can perform a skin care diagnosis as discussed above, which can be done by taking a 360° selfie, or a series of photos from different angles using the functionality smart phone camera icon. In step 2020, the app performs an analysis of the user's skin to detect skin traits, such as blackheads, wrinkles, firmness, pores, fine lines, dullness, etc A method for performing deep learning for training and performing this type of detection is discussed in greater detail below. Known alternative methods can also be used, such as those described in US Patents Nos. 10,325,146 and 9,760,935.

Step 2030 shows the analysis results for another of the skin traits that are analyzed. The results can be shown in the form of a score, which can be relative to people in the user's age range. For example, each of the skin traits can be presented on a five-point scale, and traits that represent a score worse than an average score can be highlighted as a priority for the user, while traits that are better than the average can be presented as a strength.

Step 2040 shows that the app can present a recommended skincare formulation (“blend”) that addresses the user's priority skincare concerns while taking into account current environmental conditions. After the formulation is finally selected by the user, the formulation is broken down into a combination of the available colors contained in the dispensing device cartridges, and then the recipe is transmitted to the dispensing device for dispensing at step 2050.

The shows an example of how a combination of different environmental factors determined to be present for a user can lead to different dosage amounts from three different cartridges. In this example, the cartridges include ingredients focused on deep damage recovery, cell renewal, and protection against daily skin aggressors respectively (which may include an SPF ingredient and a pollution protection ingredient). In this example, a fixed dose of cartridge 1 can still be used to achieve efficacy, while the proportions of the remaining cartridges vary based on the levels of UV or pollution that are present.

[PERSONALIZED FOUNDATION ECOSYSTEM]

The shows a 2100 ecosystem which is used to dispense a personalized foundation for the user. The Eco-System 2100 uses a deep learning algorithm to measure the user's skin tone with a smart phone. Combined with environmental information or makeup tutorials, the system can adjust throughout the year to always provide the consumer with the best foundation color that matches your tan level/skin tone variation. Based on weather forecast and UV exposure, the device may also increase skin care active substances or SPF.

The shows that a user's smart phone ultimately provides a recipe to the dispensing device via a smart phone application ("app"). The smartphone app interacts with both the connected dispenser and a cloud platform. Before a user performs normal operations (use) of the smartphone app, the app needs to be set up (2110) with setting information to configure a user profile. App settings can be based on the following configuration entries.

• Questionnaire during onboarding (such as favorite color)
• User skin tone detection with 360° video and skin tone algorithm
• Geographic location based on smart phone location detection function
• Environmental data (UV index, pollution, humidity, pollen)

Settings inputs are used during regular use of the app on the smartphone, but they are also transmitted to a cloud platform, which may be an external server device that is connected via the Internet.

Actual use of the smartphone app (2120) includes collecting environmental data based on geographic location and combining it with a smartphone diagnostic assessing the user's skin tone. While methods of determining a user's skin tone to match a foundation are known in the art, a method below relating to a deep learning method will be discussed in detail. Depending on the user's skin condition, the app can determine to fuse active skin care substances with the foundation as an SPF when the environmental conditions are not optimal. The app makes a determination based on the time of year and the person's tan level to slightly adjust the color of the foundation to follow the evolution of the complexion. When the color does not perfect the matching process, the user can send feedback to the cloud to improve the algorithms remotely. In some cases, the user may wish to use the device to adjust the base color to achieve a specific makeup strategy by layering different colors.

The cloud platform implements functions shown in 2130, such as a remote algorithm workflow and an improvement process. In the workflow performed by the cloud platform, based on environmental forecasts on UV, pollen, pollution, temperature, specific notifications are sent to the app user to adjust the recipe by adding a SPF. The cloud platform can modify the master skin tone formula for the user that is sent when the consumer's tan level is different from the initial diagnosis.

In the improvement process carried out by the cloud platform and the smartphone app, the user can save his favorite recipes which are the most effective over time or the best feeling on the skin. The user can also share his recipes with the community. The cloud platform can further aggregate feedback from all users, and the platform can send new users the area of trending formulations by location.

The vending machine operations in block 2140 are already described in detail above, but are summarized as follows. The dispenser receives a command to dispense a certain proportion of each cartridge. The dispenser dispenses on the top and the user can mix it to get the desired color. The dispenser sends the inventory containing the remaining formula back to the consumer's app to ensure that only ingredients that can be dispensed are available in the UI when the user makes a selection.

The shows an example workflow in the ecosystem described above for dispensing custom foundation from an app perspective. In step 2210, the user can perform a skin tone diagnosis as discussed above, which can be performed by taking a 360° selfie, or a series of photos from different angles using the camera functionality smart phone photo. In step 2220, the app performs an analysis of the user's skin to detect skin tone and tint.

In step 2230, the app may present a recommended foundation ("blend") that matches the user's skin tone while taking into account current environmental conditions. After the foundation is finally selected by the user, the foundation is broken down into a combination of the available ingredients contained in the cartridges of the dispensing device, and then the recipe is transmitted to the dispensing device to be dispensed to the user. step 2240.

The provides more details on how to perform the skin tone diagnosis described above. In step 2211, the user videotapes himself until face detection is reached by the smartphone app. In step 2212, face detection is performed according to known methods. If no face is detected, an error message is displayed to the user, and he can ask to change an angle or a position of the camera relative to the user until a detection face is affected. Once face detection is performed, pre-processing is performed on 10 frames of video data, where a normalization process and a zoom process is performed to assess specific features on the user's face. Normalization is a process to align all frames to the same resolution, orientation, width, lighting etc. The normalization is intended to make the frames comparable to each other and to ensure that the main algorithm will operate within the validated operating condition/range and avoid any outliers in the data point. A complexion prediction model is then executed in step 2213 based on a median value of complexion detected in the 10 frames used for the prediction. Additionally, a prediction noise assessment is performed using a median approach to filter/averaging the noise. If the noise prediction is low, an LAB value of the skin tone is used to determine the mixture used to generate the foundation at the dispensing device. However, if the noise level is high, then a protection backup questionnaire is triggered at step 2214, which asks for a previous foundation that the user has used. Then the color of the previous foundation is matched against a stored LAB value which is used to determine the mixture used to generate the foundation at the dispensing device.

The -D show additional details about how deep learning is done to get the smartphone app (or cloud platform) to estimate skin tone in an image. The same method can also be used to cause a device to estimate a skin care condition on an image. On the , training is performed for the deep learning model. Inputs are provided at stage 2221, where images (which could be selfies as a 360° video or selfies as a photograph) are entered along with metadata associated with the input image and external metadata. Metadata associated with the image can include a date and time (and/or season) along with an optional GPS location and whether the photograph is taken indoors or outdoors. External metadata can be historical climate data. Pre-processing is performed on images entered at stage 2222, which may include face detection, centering and scaling, face recognition (depending on bank availability), and image correction. lighting conditions. At stage 2223, the deep learning model performs image-based learning by learning features for skin tone estimation. The deep learning model can also perform frame selection to determine the scalar weight of the importance of selected frames based on a group of images from the same user. The output of the deep learning model (2224) provides a weighted average of the skin colors from the selected frames and the weights of the frame selection and post-processing. To adjust the accuracy of the model, a measured skin color is input to the system for the real user on the images to train the deep learning model.

The shows the use of the deep learning model after learning has reached an adequate level. This is referred to as "inference time" since skin tone (or skin condition) will be inferred from images without being able to measure the truth of the user's actual skin. . It can be seen that the stages on the are the same except that there is no measurement of the user's skin color at the end stage.

[INTELLIGENT SWAP CARTRIDGE SYSTEM]

The dispensing device described above enables consumable cartridges to be swapped in an intelligent and efficient manner. The cartridges (consumables) used in the dispensing device described above are preferably managed in sets (such as sets of three cartridges). For example, there may be separate sets of cartridges for each of the lipstick, skin care and foundation applications described above. In the system, consumable assemblies are equipped with a smart chip or an electronic device configured to perform data storage and transmission/reception (such as NFC, RFID, or a contact chip). In the following description an NFC (near field communication) tag will be mentioned, but the claims are not limited to this example. Each cartridge has different cosmetic attributes and a unique formula ID that can identify attributes such as shade/finish, texture, and skin/hair benefits. Attributes are stored on the IC at production time and signed using an asymmetric cryptographic algorithm.

As will be discussed in detail below, the NFC tag applied to the cartridges provides color universe management for the user, use cases across multiple devices, and traceability. The label will have two memory areas: an area for production data (encoded during the filling process); and a usage area where the device will code usage and track quantities. In addition, the following security mechanism has been implemented: (i) ensuring that production data is not modified: sector editing is protected by a password (secret password); (ii) ensure the non-duplication of cartridge data in the event of misappropriation: addition of a signature mechanism using a UIID (unique identifier of the label, of the encoded data, of the secret key of the manufacture ). The app using the device to read the cartridge will then verify that the signature is from the manufacturing entity before allowing a dispense.

The shows a structure of the cartridge 2300, which is similar to the cartridge described above, but further includes a region 2310, which is an area where metallization is not permitted, and an NFC (smart chip) tag 2320 which is glued to the bottom of the cartridge in such a way that it is flat and without edges.

The shows a data format of the data stored on the NFC tag on the cartridge. The "DEC" column designates an "offset", which are the coordinates of the data encoded in the hexadecimal system. The "Page" represents blocks of consecutive data arrays since the system can only fully read/write one page at a time. It can be seen that the format includes a tag identifier (Tag ID) and several domains. The data size for the data included on the NFC tag is 56 bytes in this non-limiting example, but it can also be larger or smaller. The data format shows that there are information areas focused on production information and other areas focused on usage tracking.

The shows a table that includes self-explanatory descriptions of the various fields contained in the NFC tag data format. Also, "base type" means the data type: for example: u8 means an 8-bit unsigned integer. "Ule16" means a 16-bit unsigned integer. "Length" and "page" are the required coordinates and allocation in the memory page of the NFC tag. For example "u8" is an unsigned integer number which is encoded on 8 bits, which will require an 8 bit memory space at the location of page 0.

The shows a structure of the dispensing device 2600 which is equipped for the intelligent swappable cartridge system. It can be seen that the dispensing device 2600 includes a touch/Hall effect sensor 2610 which detects and counts a lid open/close cycle to trigger consumable read and change detection operations. The device further includes a communication interface 2620, which in this case is a specific NFC antenna, for each cartridge channel that can read and write information to the cartridge's NFC tag each time it is dispensed.

The shows the establishment of a link between the distribution device 2600 and the user's smartphone device 2710. The various triggers for initiating communication between the distribution device and the smartphone may include a connection being established between the devices (such as Bluetooth pairing), with the lid of the dispensing device open, a dispensing command from the smartphone app (such as one of the apps described above), or a dispensing command entered directly on the dispensing device. In response to the trigger, the handshake includes in step 1 reading a consumables status of the cartridges stored on the dispensing device and sending the status to the smart phone. At the same time, the user's experience is updated and sent to the smart phone. "User experience" refers to a context of the device with respect to the user viewing a specific interface that displays a pop-up window to the user when the lid is open, the cartridge is empty, or the color wheel features the correct color available. In step 2, the smartphone may transmit or adjust a dispensing command to the dispensing device. In step 3, the dispensing device can transmit the actual dispensing feedback to the smart phone. In step 4, the smart phone can transmit an instruction to update the NFC tags on the cartridges when a dispensing session is complete.

The shows a consumer app state machine that demonstrates a process from an app perspective of priming cartridges prior to any use of the dispensing device. In an initial priming step 2810, a certain amount of formula may be dispensed in a predetermined sequence and/or simultaneously from each of the cartridges to verify that dispensing can be accomplished from each cartridge. In an additional priming step 2820, the user can click on a displayed color to order individual dispensing on demand. This can be done to ensure that the correct color is detected in the correct channel within the device so that recipes can be automatically assigned to the correct channel. Step 2830 shows a display, when priming is complete, of the status of the cartridges in the dispensing device.

Accordingly, the priming process can detect when a new cartridge has been installed and allows proper engagement with the plunger of the dispensing device and the formula contained in the cartridge so that a proper dose can be dispensed when an actual mix is created.

Additionally, by detecting the exact cartridges that are installed, the set of cartridges (such as the set of three cartridges) can be determined, and the color attributes (or skincare attributes) that are possible with the current set are automatically updated on the app.

In addition, the app can perform consumable management by suggesting or automatically performing hose cleaning when a cartridge is changed. The app can further adapt the formula universe in the user interface function depending on the type of cartridge set installed.

Additionally, the app's state machine may detect inconsistent sets or missing cartridges. She can offer to buy a missing set to achieve a result. It can automatically detect the expiration dates of any cartridges. Additionally, since security information is stored on the cartridge, it enables natively multi-user and multi-device functionality since each separate user smartphone will detect the information on the cartridge independently.

During boot, cartridges can also be authenticated. A 32-bit hash code is generated at production time using a manufacturer's secret key and the code is encoded on the cartridge's NFC tag. The smartphone includes a hard-coded secret key, which can be included in a software development kit (SDK), to verify the hash code when reading data from the NFC tag transmitted from the device of distribution. The smart phone can also be hardcoded with the secret key if possible. A Unique Item Identification (UIID) tag can also be physically added to the cartridge or NFC tag (such as a barcode) and read by the dispensing device. If the cartridge authentication process fails, the dispensing device can forward the notification to the smart phone.

In some rare cases, the user may encounter a cartridge where the NFC tag is not read by the machine (coding error, tag destruction, device out of range, other fault). In this case the user must still be able to dispense the formula and use his device as normally as possible. To ensure this tolerant default mode, a recovery cartridge mode requiring the user to enter cartridge information will continue operation. The SDK-based application will then create a virtual cartridge to continue the algorithm for distribution. This auto-triggered recovery mode will be turned off the moment a new cartridge is inserted or the NFC is back in range.

The shows a method of handling a faulty cartridge NFC tag in the scenario mentioned above. If there is an error in the NFC tag read data, the method is started at step 2910 where the SDK installed on the smart phone activates a recovery mode for a particular channel in the dispensing device. At step 2911, the SDK attempts to write a new production sequence (by transmission to the tag through the dispensing device) to the tag based on the last read value. At step 2912a, if the tag is written successfully, the process ends. However, at step 2912b, if the label fails to be rewritten, the method proceeds to step 2940. At step 2913, the app displays a message asking the user to verify that a cartridge is into a suitable channel and the dispensing device automatically opens the lid at step 2914. In other words, if the problem was that no cartridge was inserted, then this step will remedy that possibility. At step 2915, the user confirms that a cartridge is in the channel. If a read is still not possible, at step 2916 the user is prompted to select a cartridge color corresponding to a thumbnail on the cartridge. At step 2917, the user is prompted to enter the lot ID and serial number of the cartridge, and asked to verify that the cartridge is brand new. At step 2918, the SDK creates a virtual cartridge for the channel number. Dispensing operations can continue based on the virtual cartridge being used as a proxy to properly read the NFC tag on the real cartridge. At step 2919, the virtual cartridge will be terminated if the cartridge suddenly becomes readable for a predetermined number of dispensing operations in a row, or if the entire set of cartridges is changed.

[Dispensing and self-cleaning system]

Since the system described above includes swappable cartridges of many different types, a special cleaning mechanism that integrates with the easy-to-remove housing structure has been developed to provide unique cleaning functionality to enhance the experience. of the user.

The shows a simplified side view of one embodiment of dispensing device 3000 showing that the dispensing device includes a retractable plate 3010 with holes 3020 to accommodate the dispensing ends of cartridges 3030. The device includes a spring 3040 such that, when the spring is not compressed, the retractable plate is in the "stable upright position" and the cartridge nozzles are hidden. The stable vertical position hides the tip of the nozzle and also reduces the entry of dust or contamination into the nozzle.

It can be seen that the retractable plate includes a side surface that is bent approximately 90 degrees toward the top surface, which allows the plate to move down into a sliding groove 3050 of the dispensing device body.

The shows that when a downward force is applied to the retractable plate, the spring is compressed and the retractable plate is in the "down position".

The then shows that when the 3110 easy-to-remove housing/cup is placed on top of the retractable plate, the "down position" allows the cartridge nozzles to be flush with the 3120 dispensing surface of the housing/cup such that the dispensed 3130 formula is dispensed smoothly over the dispensing surface.

With the above retractable plate mechanism in place, the method of cleaning the surface of the case will be described with reference to the .

The shows that a reservoir of cleaning formula 3250 is disposed between the body of the dispensing device and the retractable plate. In the "stable down position" at stage 3210, the dispensing end of the cleaning reservoir is under an opening in the retractable plate. When additional force is applied to the retractable plate at stage 3220, the dispensing end of the cleaning reservoir becomes flush with the surface of the housing and compression on the reservoir causes the cleaning formula to be dispensed onto the surface of the housing as shown in stage 3230.

Examples of the cleaning formula include soap, alcohol, or other known cleaning solutions.

Each position described above can be reached by manual force provided by the user. Alternatively, each position may be achieved by electromechanical means such as a motorized actuator device as understood in the art. The cleaning formula can be manually wiped off, spread and/or brushed on and removed by the user.

The shows another use of the retractable plate described above to provide a method of rinsing cartridges to remove any remaining ingredients or residue (indicated by 3350 at stage 3310). At stage 3310, the dispensing device is shown in the stable down position. At stage 3320, when the case is pushed down, the downward movement can be translated into an activation of the cartridge plunger. This can allow the user to use/flush the last remaining ingredients in the cartridges if desired.

[INTELLIGENT CUSTOM COMPARTMENTED SYSTEM]

The -C show an intelligent custom compartmentalized system for use with the distribution system described above. As described above, the dispensing device in the above embodiments dispenses a cosmetic formula to a topside housing with 3 (in the current examples) or more cartridge outlets. The housing may be detachable or non-detachable. In the following embodiments, a dispensing surface (tray) that includes partitioned compartments within the housing may be either built into the housing or removable (to be placed by the user on the housing aligned with the outlets cartridge).

When the tray is removable, this allows the user to choose or selectively customize the compartment (such as choosing the number of partitions and exits per partition). Different compartments are possible based on the product category: skin care, foundation, lipstick, eye shadow, etc. Different compartments are possible for the same product category: i.e. skincare (different compartment for specific areas on the face), foundation (different compartment for highlighting & contouring).

In one embodiment, the tray is circular and can be rotated to allow different combinations of product in a compartment without swapping cartridges in the dispensing device. Compartment tray type is saved in the associated mobile app for appropriate personalized recommendations based on the chosen compartment.

The and 34E illustrate a mechanism for allowing detection of a position of the tray and compartments to be sent to a user's mobile device. The shows an embodiment of the tray that includes an embedded NFC 3411 tag at a predetermined position inside the tray or on the underside of the tray. When the tray is placed on the dispensing device, these partitions 3412 create compartments surrounding the outlets 3413 on the dispensing device in a particular way. An NFC reader in the dispensing device can detect the NFC tag to retrieve information indicating what type of tray is in the user device (such as two-compartment, three-compartment, etc.). The exact position of the NFC tag or other embedded object in the tray can be detected to determine the exact position of the compartments relative to the outlets. This may be based on a flight time between the NFC reader and the NFC tag, or it may be based on the weight of the NFC tag or one or more other objects embedded in the tray that can be detected using one or more Hall effect sensors. Magnetic sensors incorporated into the 3413 partitions themselves can also be used to detect the exact position of the platter. With the platter type and platter position information detected as described above, the information can be transmitted to the user's mobile device. With the additional information of the exact cartridges in the dispensing device also being transmitted to the user's mobile device, the user's mobile application can provide cosmetic formula instructions to the dispensing device based on the status current of the distribution device.

In a variant of the embodiment of the tray illustrated in the , the shows a method of detecting a tray type and/or tray position without using an NFC tag or other objects. The tray may have a visible 3421 code (such as a QR code shown in the example in the ). The code is provided at a predetermined position on the board. The user can then take a photo of the tray, and the mobile app on the user's smart phone can detect the QR code and the position of the QR code on the image. The information in the QR code itself can be used to indicate what type of tray is being used (such as two-compartment, three-compartment, etc.). At the same time, the position of the QR code can indicate the rotation of the platter relative to the outputs. As in the above example of the , with the information obtained from the QR code, the user's mobile application can provide cosmetic formula instructions to the dispensing device based on the current status of the dispensing device.

Fig. 35 shows a method for the user to provide a final personalized beauty supplement to any of the compartments in the tray described above. Adding a personalized beauty supplement provides benefits that cannot be achieved with the dispensing operation described above alone, such as providing coverage of a shade that antagonizes visibility. of pearls. For example, with matte make-up architectures, the visibility of pearls is masked by pigments. This beauty supplement technique provides optical benefit with increased visibility of the pearl effect on the surface without viscosity instability or incompatibility issues. A high concentration of beads or the use of large particle size beads is not possible in a traditional formulation because it will lead to chaffing, sedimentation and stability issues. Customization of the final makeup product can be based on another desired texture/finish/effect as well.

The shows that following the distribution operation in step 3501, in step 3502 a final beauty supplement of pearls, sparkling powder, stars etc. can be added to personalize the make-up dispensed in the case. Alternatively or additionally, a texture modifier may be added in step 3502 to alter the final texture/finish of the makeup dispensed into the case (i.e. change a matte lipstick to a glossy lipstick , change a matte foundation to a shimmer foundation). In step 3503, the beauty supplement can be mixed with the dispensed formula using an applicator.

As shown on the , to facilitate the addition of the beauty supplement when the tray is compartmentalized as illustrated on the above, a lid 3510 can be provided that conforms to the shape of a particular compartment so that beauty supplements are not inadvertently applied to the wrong compartment in step 3502 described above.

[REMOTE CONSULTATION]

The shows a 3600 system that allows a user to send a dispensing formula to the dispensing device described above based on the results of a digital beauty consultation with a beauty consultant (CB). The system includes a CB device 3610 that performs communication with a consumer (or "user") device 3620. Both devices are represented by a smart phone device, but could be any type of computing device such as a personal computer , laptop, tablet, or other.

Communication between the CB 3610 device and the consumer 3620 device can be in the form of a call, a chat session, or a video conference.

CB device 3610 executes remote application 3611 without performing communication with consumer device 3620. Remote application 3611 performs functions relating to collecting and displaying consumer data for the CB and receiving consumer recommendations. inputs and settings from the CB.

The consumer device 3620 executes an application of a user interface (App UI) 3621 which allows the consumer to initiate communication with the CB, receive inputs to form the consumer data, and perform communication with the dispensing device 3630.

Dispenser 3630 is configured to dispense a cosmetic formula based on instructions received from consumer device 3620.

The dispensing device can be used for a variety of cosmetic applications already discussed above. Additional dispensing operations can be performed relating to the dispensing of nail polish directly onto the user's fingernails with an ultraviolet (UV) lamp provided to accelerate nail polish drying. Other types of cosmetic formulations can be provided, such as liquid eye shadow; dry cosmetics; and hair, skin, body and sun care products. This list is not limited, and makeups from all categories can be used in the system described above.

The shows a flow of operations in a beauty consultation session between consumer and CB. In step 1, the consumer logs into the CB based on a request sent from consumer device 3602. The request may be coupled to information entered from the user about the type of cosmetic formulation that the consumer is using. user searches. The request may be directed to a server (not shown) which may determine an available CB in the system, and then notify CB device 3601 of a pending lookup request from a consumer. The appropriate CB for query notification can be predetermined based on the CB's area of expertise and the type of cosmetic formulation the user is looking for. A plurality of CBs can be notified of the request simultaneously, and the first CB to accept the request can be used to determine which CB to use in the lookup. Alternatively, the consumer can select a specific CB from the 3621 App.

In step 2, consumer data is collected. The shows an example of all types of consumer data that may be collected during the consultation session. It can be seen that there can be four types of data that are collected: diagnostic data; biological data/ environmental data/ and social media sharing data.

Diagnostic data may be data collected based on images taken with the consumer device's camera (to be discussed in greater detail later), or it may be direct answers to questions from the CB. Questions can include a quiz, user prioritization, or they can include status questions, such as hormone cycle, allergies, medical issues, or others.

Biological data may be actual biological samples provided by the user, or described by the user, such as protein samples; microbiome samples; samples of hair, skin, nails; and sebum, dandruff and sweat samples. Biological samples can be collected, for example, using specific adhesive strips that collect stratum corneum cells from the skin/scalp to extract and analyze proteins (Elisa method). Microbiome samples can be collected, for example, by using specific absorbent papers/cotton swabs placed on the surface of the user's skin for several seconds to collect sebum, sweat, hydrolipidic film. Hair samples can be collected as a strand of hair which is cut by the user or a few hairs including the bulb which are pulled by the user. Nail samples can be cut by the user. These samples can be collected using sampling kits sent to the user's home and returned for analysis to a mandated laboratory. Data results from the analysis are stored using a Unique Identifier (UI) and transmitted to remote servers.

Environmental data may include information specific to an area or user habits. Such data may include indoor/outdoor pollution information; water quality; screen time; and commuting habits (such as car, bicycle or motorbike use). This information may be collected based on publicly available questions or information.

Social media sharing data may be obtained from monitoring consumer interests on social media platforms. This data may include lifestyle, travel, diet, and interests in certain activities. This data can be obtained from the remote application of the CB 3611, or from an external server, after receiving inputs from the user on Internet links to their social network platforms.

To return to the , steps 2-4 show an example of a consultation session that includes collecting diagnostic data using a smart phone camera when the consumer searches for a facial skin care formulation. In step 2, a "selfie" image or video of the user is captured at the consumer device. In step 3, a 3D conversion is performed on the selfie image or video to obtain a 3D replica of the consumer's face and features. If available, 3D information can be obtained using a time-of-flight or LIDAR sensor. In step 4, a surface analysis is performed on the 3D image to detect features on the face, such as wrinkles, acne, blackheads, or others. Based on this analysis, initial diagnostic outputs for the issues determined to need to be addressed can be generated. In step 5, a face map can be generated that cuts into sections the user's 3D image, and treatment targets can be determined at this time. These treatment targets can be determined automatically or highlighted manually by the CB. Depending on the location and nature of the treatment targets, different cosmetic formulations (recipes) can be determined and displayed to the user in step 6. The face map can include a color legend below the face map. face which indicates which recipe is used on a region which appears in a particular color on the face map.

Based on the possibility that a plural amount of treatments can be used based on the user's skin conditions, different types of skin care ingredients can be dispensed into different compartments of a removable housing device as described above.

The shows a different example of a consultation session, where the consumer is interested in a hair care product. Following the connection to a CB in Step 1, Steps 2 and 3 are similar to Steps 2 to 5 of the described above. However, instead of a 3D surface analysis of the face, the 3D surface analysis is performed on the user's hair. Although not shown, following the surface analysis, a hair map can be generated based on sectioning similar to Step 5 of the , and treatment targets can be determined. As a final output, as well as in Stage 6 of the , different cosmetic formulations (recipes) for the user's hair can be determined and displayed to the user.

The shows yet another example of a consultation session, where the consumer is interested in a nail gel product to be dispensed from a dispensing device. The type of dispensing device shown in the allows a user to insert their finger into the dispensing device, where a nail gel is dispensed onto a fingernail of the user's hand and a UV lamp is used to cure the nail gel. Following the connection to the CB in Step 1, Step 2 is similar to Step 2 of the described above. However, instead of a 3D surface analysis of the face, in Step 3 consumer data is analyzed to determine a shape, surface and color of the user's nails. Based on user preferences, a color palette may be displayed to the user in step 4 along with a product type from which the user may choose. In step 5, program settings for the dispensing device are determined prior to a dispensing operation.

The shows an example of the types of dispensing device settings that can be determined during the remote viewing illustrated on the , 39 and 40. For a dispensing formula, a plurality of viscosity types can be determined for a liquid, gel, cream, balm or wax. Formulas for all routine steps can be determined for formulas relating to hair care, nail colors (gel and conventional nail polish), liquid eye shadow, skin care, body or sun care. Different types of formulation possibilities can be determined which include oxidation sensitive cosmetics, fresh cosmetics or dry cosmetics. Steps to achieve precise volume are determined, which include dispensing the correct volume/area, dispensing in the correct order of application, and dispensing at the correct speed for a more aesthetic result.

Additional features can be determined during the consultation, such as settings for a UV lamp as noted in the nail gel example described above. The self-cleaning and priming stages described above can also be determined.

Thus, the foregoing discussion merely discloses and describes exemplary embodiments of the present invention. As will be understood by those skilled in the art, the present invention can be embodied in other specific forms without departing from the spirit or the essential characteristics thereof. Accordingly, the disclosure of the present invention is intended to be illustrative, but not limiting of the scope of the invention, as well as the other claims. The disclosure, including any readily discernible variation of the teachings herein, defines, in part, the scope of the terminology of the preceding claims in such a manner that no subject matter of the invention is dedicated to the public.

Claims (9)

System, comprising:
an advisory device;
a user device; and
a dispensing device;
wherein the advisor device and the user device are configured to perform a communication session with each other that includes:
transmitting, from the user device to the advising device, information that includes a desired cosmetic product and information relating to a user of the user device;
analyzing, by the advice device, the information received from the user device; and
generating and transmitting a recommended cosmetic formula to the user device; and
wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product. A system according to claim 1, wherein the dispensing device includes a plurality of cartridges each containing a cosmetic material and the dispensing device is configured to dispense a specified amount of the cosmetic material from the plurality of cartridges into a receiving area, and the recommended cosmetic formula is generated based on the cosmetic material in each of the cartridges in the dispensing device. A system according to claim 1, wherein the communication session is a video conference between the user and a beauty consultant who operates the consultant device. The system of claim 1, wherein the information relating to the user is at least one of diagnostic data, biological data, environmental data, and social media activity data relating to the user. A system according to claim 4, wherein the diagnostic data is user image data captured by a camera of the user device. A system according to claim 5, wherein the advising device or the user device is configured to convert the user's image data into three-dimensional data and perform a surface analysis of a part of the user's body on the three-dimensional database. A system according to claim 6, wherein the advising device is configured to determine target regions of the user's body part to be treated with the desired cosmetic product based on the surface analysis, and to generate the recommended cosmetic formula based on determined target regions. A system according to claim 1, wherein the desired cosmetic product is one of a skin care product, a hair care product and a nail coloring product. A method implemented by a system that includes an advisory device; a user device; and a distribution device, wherein the counseling device and the user device are configured to perform a communication session with each other, the method comprising:
transmitting, from the user device to the advising device, information that includes a desired cosmetic product and information relating to a user of the user device;
analyzing, by the advice device, the information received from the user device; and
generating and transmitting a recommended cosmetic formula to the user device, and
wherein the user device is configured to transmit the recommended cosmetic formula to the dispensing device to dispense the desired cosmetic product.