KR20220108159A - Lipstick bulk tone and application evaluation system and method - Google Patents

Abstract

A method of predicting an applied lipstick color includes extracting reference tone information from one or more digital images of a plurality of liptone cards, each liptone card comprising a plurality of liptone swatches, a white swatch, and a black swatch; extracting applied color tone information from one or more digital images of a plurality of liptone cards coated with lipstick; and generating a predicted applied lipstick color based on the extracted applied hue information and one or more inputs indicative of lipstick selection. Further, the method of predicting the final hue, tint, tone, or shade of a lipstick product for a user is one indicative of an applied lipstick tint, tint, tone, or shade predicted based on receipt of user lip-tint information and lipstick product selection. generating the above instance in a graphical user interface; and generating in the graphical user interface one or more instances of lipstick products predicted to result in a tint, tint, tone, or shade for the user based on the received user lip-tint information and the desired coated lip-tint. do.

Description

Lipstick bulk tone and application evaluation system and method

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is based on and claims priority to U.S. Provisional Application No. 62/968,869, filed on January 31, 2020, the disclosure of which is incorporated herein by reference in its entirety. This application is also based on and claims priority to U.S. Provisional Application No. 62/968,875, filed on January 31, 2020, the disclosure of which is incorporated herein by reference in its entirety. This application is also based on and claims priority to French Patent Application No. FR2003394, filed 6 April 2020, the disclosure of which is incorporated herein by reference in its entirety. This application is also based on and claims priority to French Patent Application No. FR2004503, filed on May 6, 2020, the disclosure of which is hereby incorporated by reference in its entirety.

A user's liptone may be one of the possible liptone spectrums, which makes it difficult to predict the final shade of the applied lipstick. Choosing the desired lipstick shade can be a difficult decision for the user, which becomes more serious when the final shade of the lipstick changes after application to the user's lips. Therefore, the user's lip tone and type of lipstick are factors contributing to the accurate prediction. This can be further skewed based on other aspects of the user's regimen, including applying different treatments to the lips before and after applying lipstick, such as a lip balm, lip gloss or lip liner. In addition, the pressure of applying the lipstick to the user's lips can also affect the final coverage and color tone. Therefore, a better method and system for predicting the final shade of an applied lip cosmetic is desired.

The “background” description provided herein is intended to generally present the context of the present disclosure. The scope of the presently named inventors' work, as well as the scope set forth in this background section, as well as aspects of the description that may not otherwise qualify as prior art at the time of filing, are not expressly or impliedly admitted as prior art to the present invention.

The present invention provides a method for predicting an applied lipstick color, comprising: extracting reference tone information from one or more digital images of a plurality of liptone cards, each liptone card comprising a plurality of liptone swatches, a white swatch, and a black swatch; extracting applied color tone information from one or more digital images of a plurality of liptone cards coated with lipstick; and generating a predicted applied lipstick color based on the extracted applied hue information and one or more inputs indicative of lipstick selection.

The present invention further provides a method of predicting the final hue, tint, tone or shade of a lipstick product for a user, wherein the prediction is performed based on the user's lip tone information reception and lipstick product selection. creating on the graphical user interface one or more instances indicative of an applied lipstick tint, tint, tone, or shade; and generating on the graphical user interface one or more instances of the lipstick product that are predicted to result in a tint, tint, tone, or shade for the user based on the received user lip tint information and the desired coated lip tint. It relates to a method comprising

The foregoing paragraph has been provided as a general introduction and is not intended to limit the scope of the following claims. Aspects described with additional advantages will be best understood with reference to the following detailed description taken in conjunction with the accompanying drawings.

A more complete understanding of the present invention and the many advantages attendant thereto will be readily obtained as better understood by reference to the following detailed description when considered in conjunction with the accompanying drawings, wherein:
1A depicts a reflectometry graph, in accordance with an exemplary embodiment of the present invention.
1B illustrates a Lipton card and a primary application card, in accordance with an exemplary embodiment of the present invention.
2A illustrates an additional lipstick applied to an additional lipton card, according to an embodiment of the present invention.
2B shows a graph of saturation and brightness, in accordance with an embodiment of the present invention.
3-9 show an overview of features of an embodiment for determining a user's liptone.

1A depicts a reflectometry graph, in accordance with an exemplary embodiment of the present invention. The graph relates the material reflectance on the y-axis as a function of the detected wavelength on the x-axis. Any peak(s) represented by a trace in the graph refers to the hue primarily reflected by the material. For spectra detected in the visible range, such as between 350 nm and 800 nm, the peak is correlated with the color of the material. For example, a peak at about 400 nm describes a blue material. For example, a peak at about 700 nm describes a red material. In particular, constructive interference can be observed in reflectance measurements if the peak intensity increases for additional layers of added material (the material transmits light), as well as for secondary peaks appearing at multiple peak wavelengths. have. For example, a secondary peak for 400 nm blue light appears at 800 nm. The reflectivity of a material is described as specular reflection or diffusion based on the smoothness of the material's surface. In particular, these optical properties affect the appearance and design of the lipstick, and ultimately the application of the lipstick by the user.

1B shows a Lipton card 105 and a first application card 105a, in accordance with an exemplary embodiment of the present invention. In one embodiment, the liptone card 105 includes a black swatch 110 , a white swatch 115 , and at least one liptone swatch 120 . At least one liptone swatch 120 is an area on the liptone card 105 representing the user's liptone. These may vary and may be selected based on liptons measured from the user or predicted through emulation software and reproduced on the lipton card 105 . For example, at least one liptone swatch 120 is printed on the lipton card 105 . Similarly, black swatch 110 and white swatch 115 are regions on lipton card 105 that exhibit black and white tints, respectively. Black swatch 110 and white swatch 115 provide a reference point against which at least one Lipton swatch 120 is compared. The black swatch 110 has an RGB value representing a black tint, for example (0, 0, 0), and the white swatch 115 has an RGB value representing a white tint, for example (255, 255, 255). have An uncoated reflectance spectrum is determined for each of the at least one lipstick swatches 120 . For example, an optical spectrometer configured to scan through the visible range may be used. Additionally, an optical image is acquired for each of at least one lipton swatch 120 . For example, a camera that includes an optical sensor is used to capture an image.

In one embodiment, a first lipstick 125 is applied to each of a black swatch 110 , a white swatch 115 , and at least one liptone swatch 120 , such that a first coated black swatch 110a, a first A first application card 105a is produced comprising a coated white swatch 115a and a first at least one coated Lipton swatch 120a. For example, the hue of the first lipstick 125 is substantially fuchsia. As shown in FIG. 1B , the liptone card 105 includes six at least one liptone swatch 120 going from a lighter one near the white swatch 115 to a darker one near the black swatch 110 . . Incidentally, the six first at least one coated liptone swatches 120a coated with the first lipstick 125a are likewise formed from a lighter one near the first coated white swatch 115a to a first coated black swatch ( 110a) proceed to the darker one in the vicinity. The first coated white swatch 115a and the first coated black swatch 110a are also coated by the first lipstick 125a, so that the first coated white swatch 115a is the best for the first lipstick 125a. It may exhibit a light tint, and the first coated black swatch 110a may exhibit the darkest shade to the first lipstick 125a. The first at least one coated liptone swatch 120a may exhibit various shifts in hue due to the contribution of the underlying lipton hue.

In one embodiment, the coated reflectivity is determined for each of a first coated black swatch 110a , a first coated white swatch 115a , and a first at least one coated lipton swatch 120a . For example, an optical spectrometer is used. Images are also obtained using, for example, an optical camera. The shift of the reflectance spectrum from uncoated reflectance to coated reflectivity is determined for each specimen. The change in the reflection spectrum from the white swatch 115 to the first coated white swatch 115a accounts for the shift in hue without any additional contribution from the user's liptone while accounting for maximum brightness and maximum saturation. Similarly, the change in the reflection spectrum from the black swatch 110 to the first coated black swatch 110a accounts for the shift in hue without any additional contribution from the user's liptone, while accounting for minimum brightness and minimum saturation. In particular, the change in the reflection spectrum for each of the corresponding first at least one coated liptone swatches 120a from each of the at least one liptone swatches 120 is from the white swatches 115 to the first coated white swatches; and compared to both the change in the reflection spectrum from the black swatch 110 to the first coated black swatch 110a to determine the shift in hue due to the user's liptone contribution. Through the same measures, a change in brightness and saturation is also determined for each of the corresponding first at least one coated liptone swatch 120a. Here, saturation represents the chromatic intensity of an object's hue or the perceived amount of difference from gray of the same brightness, whereas brightness describes the perceived luminance of an object's hue as compared to a perfectly white object.

In one embodiment, an image library of a first application card 105a comprising an extensive first at least one coated liptone swatch 120a is created for the first lipstick 125a and stored in memory storage. Hue, saturation and brightness are also determined for each of the first at least one coated lipton swatch 120a in the library, and a respective spectrum for each is stored in a memory store.

2A shows an additional lipstick applied to an additional lipton card 105, in accordance with an embodiment of the present invention. In one embodiment, a second lipstick 125b and a third lipstick 125 are applied to the lipton card 105 to produce a second application card 105b and a third application card 105c, respectively. The color tone of the second lipstick 125b is, for example, substantially scarlet, and the color tone of the third lipstick 125c is, for example, substantially orange. A second lipstick 125b is applied to each of the black swatch 110 , the white swatch 115 , and the at least one liptone swatch 120 , such that the second coated black swatch 110b, the second coated white swatch 115b ) and a second at least one coated lipton swatch 120b. A third lipstick 125b is applied to each of the black swatch 110 , the white swatch 115 , and the at least one liptone swatch 120 to form a third coated black swatch 110c , a third coated white swatch 115c . ), and a third application card 105c comprising a third at least one coated lipton swatch 120c. Similarly, a second application card 105b is created comprising a second, at least one coated liptone swatch 120b, extensive for a second lipstick 125b, and a third, extensive, for a third lipstick 125c. A third application card 105c containing at least one coated Lipton swatch 120c of In addition, the corresponding reflection spectra, saturation, and brightness are also determined and stored in memory storage.

2B shows a graph for saturation and brightness, in accordance with an embodiment of the present invention. In one embodiment, for the first lipstick 125a , the second lipstick 125b , and the third lipstick 125c describe the saturation (y-axis) as a function of brightness (x-axis) for each of the swatches. A trace is created. Although only six liptones for each lipstick are plotted in the graph of FIG. 2B , it will be appreciated that the data for each trace becomes more granular as more at least one liptone swatch 120 is coated and measured for each lipstick. .

Advantageously, the library can be used to predict the shade of lipstick applied to the user's lips. In one embodiment, the lipstick is a first lipstick 125a and the user's liptone matches one of the at least one liptone swatch 120 . For example, the hue of the user's liptone is within a predetermined deviation threshold of the hue of one of the at least one liptone swatches 120 . Accordingly, the corresponding reflectance measurement of the first coated at least one liptone swatch 120a for the first lipstick 125a is the applied second on the at least one liptone swatch 120 that most closely matches the user's liptone. 1 The color tone of the lipstick 125a will be described.

In one embodiment, the user's lipton does not match one of the at least one lipton swatches 120 in the library. That is, the hue of the user's liptone is outside a predetermined deviation threshold of the hue of one of the at least one liptone swatches 120 . Here, interpolation is performed between two of the at least one liptone swatches 120 that most closely match the user's liptone, yielding an interpolated liptone swatch that more closely matches the user's liptone. Also, interpolation is performed between the two corresponding reflectivity measurements for two of the at least one liptone swatch 120 (the one that most closely matches the user's liptone), so that the first lipstick 125a applied Produces an interpolated hue. It will be appreciated that other targeted data in the library can be interpolated, such as saturation and brightness. Due to the diversity of users, if the library is expanded by collecting data on numerous lip tones, it is possible to improve the accuracy of predicting the hue, saturation, and brightness of the lipstick after application to the user's lips.

In one embodiment, a library may be sorted into a single lipton that matches a user's lipton. Accordingly, all lipsticks applied to the at least one liptone swatch 120 matching the user's liptone are sorted. The user can then select the desired appearance (tint) for the applied lipstick from the library and perform the decision of which lipstick to apply.

In one embodiment, the library does not contain liptons that match the user. That is, the hue of the user's liptone is outside a predetermined deviation threshold for the hue of one of the at least one liptone swatches 120 . Again, interpolation is performed between two of the at least one lipton swatches 120 that most closely match the user's liptone swatches to yield an interpolated lipton swatch. For example, the user's liptone most closely matches the first at least one liptone swatch 1201 and the second at least one liptone swatch 1201 . Interpolation is performed between the two corresponding reflectance measurements for all lipsticks applied to this first at least one liptone swatch 1201 and the second at least one liptone swatch 1201 so that the lipstick applied from the interpolated liptone swatches. All final shades are predicted. For example, an interpolation of reflectance measurements for a first first at least one coated lipton swatch 120a1 and a second first at least one coated lipton swatch 120a2 is performed so that the interpolated lipton swatch is imaged. The color tone of the first lipstick 125a coated thereon is predicted. Similarly, an interpolation of reflectance measurements for a first second at least one coated lipton swatch 120b1 and a second second at least one coated lipton swatch 120b2 is performed, so that on the interpolated lipton swatch The color tone of the second lipstick 125b coated thereon is predicted. The same interpolation is performed for the third lipstick 125c and all other lipsticks in the library. The predicted coating hues of all lipsticks on the interpolated liptone swatch can be filtered to yield a predicted coating hue that falls within a predetermined deviation threshold of the appearance (hue) for the applied lipstick desired by the user, the predetermined deviation threshold Recommendations are made for lipsticks corresponding to the predicted coating shades in There may not be a lipstick that yields the exact look the user wants, but a plurality of options that closely match the desired look (hue) may be recommended to the user. For example, the user may select one of the recommended lipsticks, and a secondary recommendation may be made for a product that brightens the tint or darkens the shade of the recommended lipstick. For example, recommendations are made for two or more lipsticks to blend the coatings to achieve the desired appearance (tint).

In one embodiment, the user selects a desired look (tint) for an applied lipstick from the library, but does not match any item in the library. In this embodiment, the user's liptone matches one of the at least one liptone swatches 120 . Interpolation is performed between all lipsticks coated on at least one matching liptone swatch 120 to determine at least two lipsticks that match the desired appearance (tint) when coated on matching user's liptones. Here, a primary recommendation is made for a lipstick that yields a slightly darker shade when coated on at least one liptone swatch 120 matching the user's liptone, and a secondary recommendation is made for a lipstick that yields a slightly lighter shade. recommendation is made

In one embodiment, the liptone card 105 includes additional swatches that differ in hue, saturation, and brightness of the coated lipstick. For example, the liptone card 105 includes an additional at least one liptone swatch 120 to which a lip balm is applied prior to coating with the lipstick. For example, the liptone card 105 may include, after coating with a lipstick, an additional at least one liptone swatch 120 for an additional coating of a second material, such as a lip gloss, lip cream, moisturizer, or any other topcoat. do. For example, the liptone card 105 includes an additional at least one liptone swatch 120 for coating with other types of lipsticks, such as matte lipsticks, glossy lipsticks, lip tints, metallic lipsticks, and the like. For example, the lipton card 105 includes additional at least one liptone swatch 120 for coating with lipstick at various application pressures, such as light pressure, moderate pressure and firm pressure. Thus, for any one of the at least one liptone swatch 120, numerous appearances for many lipsticks of the same shade can be cataloged and used to improve the user's lipstick selection accuracy and experience.

In one embodiment, the liptone card 105 comprises artificial lips, for example, instead of at least one liptone swatch 120 being printed on the lipton card 105 . Each artificial lip is colored according to the various user lip tones and is advantageously textured to resemble the texture of a real human lip which affects the final appearance of the applied lipstick. For example, artificial lips are acellular, non-immunogenic, molded collagen grown from dermal keratinocytes grown on a scaffold such as a skin equivalent.

The artificial lips are then coated with a number of the coatings described above. For example, lip balm is applied first, then glossy lipstick, then lip gloss. As each coating is applied and stored in memory as part of a library, reflectivity measurements and optical images can be obtained for each step. In particular, the reflectivity measured on the artificial lips provides a greater diffuse reflection and realistic application environment compared to the flat specimen.

3-8 illustrate a model for (1) providing lipstick formulation guidelines for coverage, (2) evaluating current lipstick application protocols, and (3) predicting lipstick application from lipstick bulk tones to different lip tones. Illustrated further details of features to create.

The description set forth above in connection with the appended drawings is intended as a description of various embodiments of the disclosed subject matter and is not necessarily intended to represent the only embodiment(s). In certain instances, the detailed description includes specific details for the purpose of providing an understanding of the disclosed subject matter. It will be apparent, however, to one skilled in the art that the embodiments may be practiced without these specific details. In some instances, well-known structures and components may be shown in block diagram form in order not to obscure the concepts of disclosed subject matter.

Reference throughout the specification to “one embodiment” or “an embodiment” indicates that a particular feature, structure, characteristic, operation, or function described in connection with the embodiment is included in at least one embodiment of the disclosed subject matter. means that Thus, any appearances of the phrases "in one embodiment" or "in one embodiment" herein are not necessarily referring to the same embodiment. Moreover, a particular feature, structure, characteristic, operation, or function may be combined in any suitable manner in one or more embodiments. In addition, embodiments of the disclosed subject matter can and are intended to cover modifications and variations of the described embodiments.

It should be noted that, as used in this specification and the appended claims, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise. That is, unless otherwise specified, words such as “a” and “an” as used herein carry the meaning of “one or more”. Also, as used herein, terms such as "upper", "lower", "front", "rear", "side", "inside", "outer", etc. are merely descriptive of a reference point and are intended to delineate aspects of the disclosed subject matter. It should be understood that this is not necessarily limiting to any particular orientation or configuration. Also, terms such as “first,” “second,” “third,” etc. merely identify one of a number of parts, components, reference points, operations and/or functions described herein, and likewise aspects of the disclosed subject matter. is not necessarily limited to any particular configuration or orientation.

A number of implementations have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. For example, desirable results may be achieved if the steps of the disclosed technology are performed in a different order, if components of the disclosed systems are combined in different ways, or if components are substituted or supplemented with other components.

The foregoing discussion is merely illustrative of exemplary embodiments of the present invention. As will be understood by those skilled in the art, the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. Accordingly, the present invention is intended to be illustrative and not to limit the spirit of the invention or the claims. This invention, including any readily recognizable variations of the teachings herein, defines, in part, the scope of the foregoing claim terms so that no inventive subject matter is publicly provided to the public.

Embodiments of the present invention may also be as set forth in the inset below.

(1) A method of predicting an applied lipstick color, comprising: extracting reference tone information from one or more digital images of a plurality of liptone cards, wherein each liptone card comprises a plurality of liptone swatches, a white swatch, and a black comprising a sample; extracting applied color tone information from one or more digital images of a plurality of liptone cards coated with lipstick; and generating a predicted applied lipstick color based on the extracted applied hue information and one or more inputs indicative of lipstick selection.

(2) The step of (1), wherein generating the predicted applied lipstick color comprises: generating the predicted applied lipstick color based on the extracted applied hue information, one or more inputs representing lipstick selection, and the user lip hue information. A method comprising steps.

(3) The method according to (1) or (2), further comprising: extracting user lip tone information from one or more digital images; and generating a predicted applied lipstick color based on the extracted applied hue information, one or more inputs indicative of lipstick selection, and the extracted user lip color information.

(4) the user according to (3), based on the extracted applied hue information, one or more input values indicating lipstick selection, and the extracted user lip hue information, a hue that is within a predetermined threshold of the lipstick selection hue for the user The method further comprising generating one or more instances of the virtual representation of the lipstick product predicted to result.

(5) Based on the extracted applied hue information, one or more input values indicative of lipstick selection, and the extracted user lip tint information, the predicted value associated with one or more input values indicative of lipstick selection for the user according to (3) The method further comprising generating one or more instances of the virtual representation of the final lipstick shade.

(6) The method of any one of (1) to (5), further comprising determining a hue of one or more input values indicative of lipstick selection.

(7) The method according to any one of (1) to (6), further comprising determining a lipstick having a hue that is within a predetermined threshold of hues of the one or more inputs indicative of lipstick selection.

(8) The method of (3), further comprising determining a first liptone swatch from among the plurality of liptone swatches having a tint that is within a predetermined threshold of the user's lip tint.

(9) The method of (7), further comprising determining a recommended lipstick based on an applied lipstick color corresponding to the lipstick.

(10) The product according to any one of (1) to (9), wherein one or more predicted applied lipstick color information of the product based on the lipstick selection, and a hue that is within a predetermined threshold of a product having the hue of the lipstick selection, The method further comprising the step of sending lipstick product recommendation information regarding the product expected to result in the user.

(11) A method of predicting the final hue, tint, tone or shade of a lipstick product for a user, wherein the method is indicative of an applied lipstick tint, tint, tone, or shade predicted based on receipt of user lip-tint information and lipstick product selection. creating one or more instances in a graphical user interface; and generating, in the graphical user interface, one or more instances of lipstick products predicted to result in a tint, tint, tone, or shade for the user based on receiving the user lip-tint information and a desired coated lip-tint. how it is.

(12) The step of (11), wherein generating on the graphical user interface one or more instances representing an applied lipstick tint, tint, tone, or shade predicted based on receiving the user lip-tone information and selecting a lipstick product comprises: A method, comprising: receiving one or more inputs indicative of a lipstick product selection; and generating lipstick tint, tint, tone, or shade information based on extracting user lip-tone information from the one or more digital images.

(13) The graphical user interface of (11) or (12), wherein one or more instances representing an applied lipstick tint, tint, tone, or shade predicted based on user lip-tint information and lipstick product selection are generated on the graphical user interface. and extracting applied tonal information generated from one or more digital images of a plurality of liptone cards coated with lipstick, each liptone card comprising at least one liptone swatch, a white swatch, and a black swatch. In, way.

(14) The user according to any one of (11) to (13), which is predicted to result in a tint, tint, tone, or shade for the user based on the received user lip-tint information and the desired coated lip-tint. Creating one or more instances for a lipstick product on a graphical user interface comprises receiving a desired coated lip-tint, extracting user lip-tinting information from the one or more digital images, and a plurality of coated lip-tints with the lipstick. generating a predicted final lipstick tint based on extracting applied tint, tint, tone, or shade information from one or more digital images of the liptone card, wherein each liptone card comprises at least one liptone swatch, a white swatch, and A method comprising a black swatch.

(15) The tint, tint, tone, or tint for the user according to any one of (11) to (14), wherein the user receives lip-tint information and is within a predetermined threshold of lipstick product selection, or lipstick product selection tint. The method further comprising transmitting one or more predicted applied lipstick shades, tints, tones, or shades based on the lipstick product predicted to result in a shade.

(16) A method of predicting an applied lipstick color, comprising: receiving from a user a desired lip appearance having a target tint; determining the user's lip tone; determining, based on application of the lipstick applied to the plurality of liptone swatches on the liptone card, a final hue of the applied lipstick color, wherein the plurality of liptone swatches have a hue within a predetermined deviation range of the user's lip tone; determining a lipstick that correlates with a final hue that most closely matches a target hue of a desired lip appearance; and transmitting lipstick information to the user.

(17) The step of (16), wherein the step of determining a plurality of liptone swatches having a hue that is within a predetermined deviation range of the user lip tone is receiving a plurality of liptone cards, each of a plurality of liptone swatches, a white swatch , and a black swatch; determining a hue of each of the plurality of liptone swatches, the white swatch, and the black swatch; and determining a subset of the plurality of liptone swatches having hues within a predetermined threshold of user lip tones.

(18) The step of (17), wherein the step of determining a lipstick correlated with a final hue that most closely matches a target hue of a desired lip appearance comprises: applying a subset of the plurality of liptone swatches, the white swatch, and the black swatch to the lipstick. coating; determining a final hue of each of the coated subset of the plurality of liptone swatches; and determining a lipstick coated on a subset of the plurality of liptone swatches having a final hue that most closely matches a target hue of a desired lip appearance.

(19) In (18), if it is determined that the liptone card does not contain a matching liptone swatch having a tint that is within the predetermined range of the user's lip tint, determining two matching liptone swatches from the plurality of liptone swatches; determining a final shade of a plurality of lipsticks applied to a first of the two matching liptone swatches and a second of the two matching liptone swatches; interpolating a final hue of the plurality of lipsticks applied to the interpolated liptone swatch having a hue between the first of the two matching liptone swatches and the second of the two matching liptone swatches; The method further comprising determining a lipstick that correlates to an interpolated final hue that most closely matches a target hue of a desired lip appearance.

(20) The method of (19), further comprising obtaining a simulated image of the interpolated liptone swatch and a simulated image of the interpolated liptone swatch coated with the plurality of lipsticks.

(21) The method of (18), further comprising normalizing the determined final hue of each of the coated subset of the plurality of liptone swatches to the determined final hue of the black swatch coated with the lipstick and the white swatch coated with the lipstick. How to.

(22) The method of (18), further comprising obtaining an image of the user's lips and a coated subset image of the plurality of liptone swatches, wherein the hue of the user's lips is determined from the image of the user's lips, and wherein the final hue of each of the coated subsets of liptone swatches is determined from images of the coated subset of the plurality of liptone swatches.

(23) The method of (22), further comprising storing in a memory each hue, final hue, and image of the uncoated and coated subsets of the plurality of liptone swatches, the white swatches, and the black swatches. .

(24) The method of (23), wherein the step of determining the applied lipstick color is determined based on a trained neural network.

(25) The neural network according to (24), wherein the neural network is trained using the training dataset, and the input data of the training dataset are uncoated and coated subsets of the plurality of lipton swatches, the hues of each of the white swatches and the black swatches, the final tint, and an image.

(26) A method of predicting an applied lipstick color, the method comprising: receiving a lipstick selection having a tint from a user; determining the user's lip tone; determining a final color tone of the user's lips to which the lipstick selection is applied through the lip tone card to which the lipstick selection is applied; and transmitting the final tone of the user's lips to the user.

(27) The method of (26), wherein determining a final tone of the user's lips to which the lipstick selection is applied comprises: receiving a plurality of liptone cards each comprising a plurality of liptone swatches, a white swatch and a black swatch; determining a hue of each of the plurality of liptone swatches, white swatches and black swatches; and determining a matching liptone swatch having a matching hue within a predetermined threshold of the user's lip hue; and applying the lipstick selection to the matching liptone swatch.

(28) The liptone card according to (27), wherein if it is determined that the liptone card does not contain a matching liptone swatch having a tint within the predetermined range of the user's lip tint, then having a tint closest to the predetermined range of the user's lip tint determining two matching liptone swatches from the plurality of liptone swatches; A method comprising interpolating a final hue of a lipstick selection applied to an interpolated liptone swatch having a hue between the first of the two matching liptone swatches and the second of the two matching liptone swatches.

(29) The method of (28), further comprising obtaining a simulated image of the interpolated liptone swatch and a simulated image of the interpolated liptone swatch coated with the lipstick selection.

(30) The method according to any one of (27) to (29), wherein, for the determined final shade of the black swatch coated with the lipstick selection and the white swatch coated with the lipstick selection, the determined final shade of each of the plurality of liptone swatches coated is selected. A method further comprising the step of normalizing.

(31) The method according to any one of (27) to (30), further comprising obtaining an image of the user's lips and an image of the coated plurality of liptone swatches, wherein the hue of the user's lips is obtained from the image of the user's lips. and wherein a final hue of the plurality of liptone swatches each coated is determined from an image of the plurality of liptone swatches coated.

(32) The method of (31), further comprising storing the hue, final hue, and image of the plurality of liptone swatches, white swatches, and black swatches, respectively, uncoated and coated in the memory.

(33) The method of (32), wherein determining the applied lipstick color is determined based on a trained neural network.

(34) The neural network according to (33), wherein the neural network is trained using the training dataset, and the input data of the training dataset include a plurality of uncoated and coated lipton swatches, a hue of a white swatch and a black swatch, respectively, a final hue, and A method comprising an image.

Claims (15)

A method of predicting an applied lipstick color, comprising:
extracting reference tone information from one or more digital images of a plurality of liptone cards, each liptone card comprising a plurality of liptone swatches, a white swatch, and a black swatch;
extracting applied color tone information from one or more digital images of a plurality of liptone cards coated with lipstick; and
generating a predicted applied lipstick color based on the extracted applied hue information and one or more inputs indicative of lipstick selection;
How to include. 2. The method of claim 1, wherein generating the predicted applied lipstick color comprises generating a predicted applied lipstick color based on the extracted applied hue information, the one or more inputs indicative of lipstick selection, and user lip tint information. How to predict the applied lipstick color, including. The method of claim 1,
extracting user lip tone information from one or more digital images; and
generating a predicted applied lipstick color based on the extracted applied hue information, one or more inputs representing lipstick selection, and the extracted user lip hue information;
A method of predicting an applied lipstick color, further comprising: 4. The color tone for the user that is within a predetermined threshold of lipstick selection tone based on the extracted applied tone information, the one or more inputs indicating lipstick selection, and the extracted user lip tone information. A method of predicting an applied lipstick color, further comprising generating one or more instances of the virtual representation of the lipstick product predicted to result. 4. The predicted final lipstick of claim 3, wherein based on the extracted applied hue information, the one or more inputs indicative of lipstick selection, and one or more inputs indicative of lipstick selection for a user based on the extracted user lip tint information. A method of predicting an applied lipstick color, further comprising generating one or more instances of the imaginary representation of the hue. The method of claim 1 , further comprising determining a hue of one or more inputs indicative of lipstick selection. The method of claim 1 , further comprising determining a lipstick having a hue that is within a predetermined threshold of hues of one or more inputs indicative of lipstick selection. 4. The method of claim 3, further comprising determining a first liptone swatch of a plurality of liptone swatches having a tint that is within a predetermined threshold of the user's lip tone. 8. The method of claim 7, further comprising determining a recommended lipstick based on an applied lipstick color corresponding to the lipstick. The method of claim 1,
predicted applied lipstick color information of the product based on the lipstick selection; and
Lipstick product recommendation information regarding products that are predicted to result in a tint for a user that is within a predetermined threshold of a product having the tint of the lipstick selection.
A method of predicting an applied lipstick color, further comprising transmitting one or more of: A method of predicting the final hue, tint, tone or shade of a lipstick product for a user, comprising:
generating in the graphical user interface one or more instances indicative of an applied lipstick tint, tint, tone, or shade predicted based on the user's receipt of lip-tint information and lipstick product selection; and
generating in the graphical user interface one or more instances of lipstick products predicted to result in a tint, tint, tone, or shade for the user based on the received user lip-tint information and a desired applied lip-tint;
A method comprising 12. The lipstick product selection of claim 11, wherein generating on the graphical user interface one or more instances representing an applied lipstick tint, tint, tone, or shade predicted based on receiving user lip-tint information and lipstick product selection A method, comprising: receiving one or more inputs representing 12. The method of claim 11, wherein the step of generating on the graphical user interface one or more instances indicative of an applied lipstick tint, tint, tone, or shade predicted based on receiving user lip-tint information and lipstick product selection comprises: and extracting applied tonal information generated from one or more digital images of a plurality of liptone cards, wherein each liptone card comprises at least one liptone swatch, a white swatch, and a black swatch. 12. The graphic of claim 11, wherein based on the received user lip-tint information and a desired coated lip-tint, graphic one or more instances of a lipstick product predicted to result in a tint, tint, tone, or shade for the user. generating on a user interface comprises receiving the desired coated lip-tone, extracting user lip-tone information from the one or more digital images, and at least one digital image of a plurality of lip-tone cards coated with lipstick. and extracting applied tint, tint, tone, or shade information from the liptone card, wherein each liptone card comprises at least one liptone swatch, a white swatch, and a black swatch. 12. The lipstick product of claim 11, wherein the lipstick product is expected to result in a tint, tint, tone, or shade for the user that is within a predetermined threshold of user lip-tint information and lipstick product selection, or lipstick product selection, hue. to transmit one or more predicted applied lipstick shades, tints, tones, or shades.

Images