KR20230057761A - Method and system for providing customized cosmetic review providing AR lipstick function - Google Patents

Abstract

The present invention relates to a method and system for providing customized cosmetics reviews with an AR lipstick function, and more specifically, to a method and system for providing customized cosmetics reviews with an AR lipstick function, which display a skin analysis diary which analyzes a user's skin at least once on a user and recommend cosmetic review information and products from reviewers with similar characteristics to the user, provide an interface for manufacturing and selling OEM cosmetics, and provide an AR-based lipstick function.

Description

Method and system for providing customized cosmetic review providing AR lipstick function}

The present invention relates to a method and system for providing a customized cosmetic review providing an AR lipstick function, and more particularly, to display a skin analysis diary in which the user's skin is analyzed at least once to the user, and to review cosmetics by a reviewer having similar characteristics to the user. It relates to a customized cosmetic review providing method and system that provides an AR lipstick function, which recommends information and products, provides an interface for producing and selling OEM cosmetics, and provides an AR-based lipstick function.

As the economic level grows, people's interest in external factors is also increasing day by day. In particular, as the K-beauty industry has grown rapidly in the past, Korea has grown into a country with the world's fourth-largest cosmetics industry, and global luxury brands such as Chanel and Estee Lauder are paying attention to skin care as a test bed. this is increasing

On the other hand, as the skin beauty industry gradually grows, there is a recent movement to incorporate AR (Augmented Reality) technology into the skin beauty industry. Specifically, the conventional method of purchasing cosmetics was a method in which a consumer visits a store and directly tries a tester product in order to wear a product such as lipstick. This method has inherent problems in that the need for sanitary management of the tester product and the user must visit the store directly. Accordingly, an experience method is being developed that allows users to test and purchase products without visiting a store using AR (Augmented Reality) technology. Specifically, technologies are being developed to test products such as lipstick using image data taken from a user's face, or to create personalized cosmetic products by combining AI and AR technologies.

Conventional cosmetic products have different ingredients for each brand or product, so it is difficult for users to select products suitable for their skin type and condition. Accordingly, a method of analyzing skin conditions such as wrinkles, pores, acne, and oil from image data of a user's skin and recommending a product suitable for the user has been proposed.

However, this method mainly analyzes the user's skin from image data captured once, and has a problem in that it does not reflect changes in skin condition due to external factors such as exercise and rest, drinking, and eating habits from a long-term perspective. Therefore, there is a need to develop a method and system that can more accurately analyze a user's skin and recommend a suitable product by reflecting the skin condition that can change depending on the internal and external environment even though it is the same person.

Meanwhile, the conventional cosmetics industry has grown mainly led by large companies such as Amorepacific and LG Household & Health Care. Due to such an industrial structure, the conventional cosmetics industry has a problem in that each consumer has difficulty in selecting cosmetics according to his or her skin condition and preference as described above because it has a mass production system of small types. In recent years, the demand for customized cosmetics that can be produced in small quantities by directly reflecting the skin conditions and preferences of individual consumers is increasing.

As a result, there is a need for a method and system that analyzes the user's skin condition from a long-term perspective, recommends and sells customized cosmetics along with conventional cosmetic products to the user, and can try on the cosmetic product in augmented reality.

The present invention relates to a method and system for providing a customized cosmetic review providing an AR lipstick function, and more particularly, to display a skin analysis diary in which the user's skin is analyzed at least once to the user, and to review cosmetics by a reviewer having similar characteristics to the user. The purpose of this study is to provide a customized cosmetics review providing method and system that recommends information and products, provides an interface for production and sales of OEM cosmetics, provides an AR-based lipstick function, and provides an AR lipstick function.

In order to solve the above problems, in one embodiment of the present invention, as a method for providing a customized cosmetics review that provides an AR lipstick function, one or more skin photos are received from a user terminal, and the received skin photos are analyzed by machine learning. A user skin analysis step of deriving a plurality of skin characteristic parameters using the model; Based on the diary creation request received from the user terminal, creating a skin analysis diary in which the plurality of skin characteristic parameters for the received plurality of skin photos are temporally aligned, and providing the skin analysis diary to the user terminal providing a skin analysis diary; Receive interest type information and cosmetic type information of the skin characteristic parameter of interest from the user terminal, select the cosmetic review information corresponding to the cosmetic type information from among previously stored cosmetic review information, and reviewer's external skin information, skin a customized review providing step of arranging characteristic parameter information in a similar order to user information and providing the sorted cosmetics review information to the user terminal; an OEM cosmetics sales step of receiving a request for production of OEM cosmetics from the reviewer terminal and providing basic information or a sales interface on the OEM cosmetics produced by the reviewer to other users; and an AR cosmetic testing step of performing a test using augmented reality technology on the skin picture received from the user terminal.

In one embodiment of the present invention, the user's skin analysis step includes a user response result receiving step of receiving a skin test survey result and interest type information with high user interest from the user terminal; A user skin picture receiving step of receiving the skin picture of the user from the user terminal; and a skin characteristic parameter derivation step of deriving at least one skin characteristic parameter using the machine-learned analysis model from the skin photograph of the user received in the step of receiving the user's skin picture, and transmitting a skin analysis result to the user terminal. ; can be included.

In one embodiment of the present invention, the step of providing a skin analysis diary may include a timed skin information layer display step of displaying a skin information layer by time in which information summarizing the one or more skin characteristic parameters received by the user terminal by time is displayed; and a skin information summary layer display step of displaying a skin information summary layer displaying summary information of one or more skin analysis diaries received from the user terminal.

In one embodiment of the present invention, the step of providing a customized review may include a review relevance score calculation step of calculating a review relevance score based on a preset criterion for the previously stored cosmetics review information; and a cosmetic review providing step of providing the cosmetic review information and cosmetic product information to the user terminal based on the review relevance score, wherein the predetermined criteria include age, gender, number of reviewer followers, number of reviews, and skin characteristic parameters. It is determined based on the degree of similarity and a weight may be assigned to interest type information received in the user response result receiving step.

In one embodiment of the present invention, the OEM cosmetics sales step; based on the cosmetics review information of the reviewer OEM cosmetics production examination step of examining the OEM cosmetics sales conditions; and an OEM cosmetics information receiving step of receiving an intention to manufacture the OEM cosmetics and basic information of the OEM cosmetics from the reviewer who satisfies the OEM cosmetics sales conditions, wherein the basic information of the OEM cosmetics includes a product name, cosmetic ingredients, and cosmetics. Case appearance information and similar product brands may be included.

In one embodiment of the present invention, AR cosmetics testing step; test information receiving step of receiving test product information and color data from the user terminal; a lip image selection step of selecting a lip image from the skin picture; and a lip color changing step of inputting the test product information and the color data received from the user terminal into the lip image.

In order to solve the above problems, in one embodiment of the present invention, as a customized cosmetics review providing system that provides an AR lipstick function, one or more skin photos are received from a user terminal, and the received skin photos are analyzed by machine learning. A user skin analysis step of deriving a plurality of skin characteristic parameters using the model; Based on the diary creation request received from the user terminal, creating a skin analysis diary in which the plurality of skin characteristic parameters for the received plurality of skin photos are temporally aligned, and providing the skin analysis diary to the user terminal providing a skin analysis diary; Receive interest type information and cosmetic type information of the skin characteristic parameter of interest from the user terminal, select the cosmetic review information corresponding to the cosmetic type information from among previously stored cosmetic review information, and reviewer's external skin information, skin a customized review providing step of arranging characteristic parameter information in a similar order to user information and providing the sorted cosmetics review information to the user terminal; an OEM cosmetics sales step of receiving a request for production of OEM cosmetics from the reviewer terminal and providing basic information or a sales interface on the OEM cosmetics produced by the reviewer to other users; and an AR cosmetic testing step of performing a test using augmented reality technology on the skin picture received from the user terminal.

According to an embodiment of the present invention, skin analysis information may be provided to a user by analyzing skin characteristics such as wrinkles, pores, acne, and oil of each user based on image data obtained by taking a picture of the user's skin.

According to an embodiment of the present invention, skin analysis may be performed by receiving daily skin photos from the user and reflecting changes in skin condition due to external factors such as exercise and rest, drinking, and eating habits.

According to an embodiment of the present invention, it is possible to selectively show cosmetic review information of reviewers similar to the user by assigning a high review relevance score to cosmetic review information of reviewers having similar skin characteristics to the user.

According to an embodiment of the present invention, reviews of reviewers with high influence may be displayed with priority in considering age, gender, the number of followers of the reviewer, the number of reviews, and the like, in the cosmetics review information displayed to the user.

According to an embodiment of the present invention, it is possible to selectively show products with high user preference by assigning weights to skin characteristic parameters of high user interest.

According to one embodiment of the present invention, it is possible to provide an interface for receiving OEM cosmetics manufacturing intention and basic information on OEM cosmetics to highly influential reviewers, and to display information on OEM cosmetics manufactured to general users. .

According to an embodiment of the present invention, the participation in the service can be improved by providing revenue generated from OEM cosmetics to reviewers who provide review information.

According to an embodiment of the present invention, a user may test a cosmetic product including a lipstick using augmented reality technology without directly visiting a store.

1 schematically illustrates components for performing a method and system for providing a customized cosmetics review providing an AR lipstick function according to an embodiment of the present invention.
Figure 2 schematically shows the process of creating a skin analysis diary, providing a user-customized review, and performing an AR cosmetics test in a server system according to an embodiment of the present invention.
3 schematically illustrates a process of manufacturing OEM cosmetics and providing information to users in the OEM cosmetics sales step according to an embodiment of the present invention.
Figure 4 schematically shows an image displayed on the user terminal in the user skin analysis step according to an embodiment of the present invention.
5 schematically illustrates an image displayed on a user terminal in the step of providing a skin analysis diary according to an embodiment of the present invention.
6 schematically illustrates an image displayed on a user terminal in the step of providing a customized review according to an embodiment of the present invention.
7 schematically shows images displayed on a reviewer terminal and a user terminal in an OEM cosmetics sales step according to an embodiment of the present invention.
8 schematically shows an image displayed on a user terminal in an AR cosmetic testing step according to an embodiment of the present invention.

In the following, various embodiments and/or aspects are disclosed with reference now to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth in order to facilitate a general understanding of one or more aspects. However, it will also be appreciated by those skilled in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings describe in detail certain illustrative aspects of one or more aspects. However, these aspects are exemplary and some of the various methods in principle of the various aspects may be used, and the described descriptions are intended to include all such aspects and their equivalents.

Moreover, various aspects and features will be presented by a system that may include a number of devices, components and/or modules, and the like. It should also be noted that various systems may include additional devices, components and/or modules, and/or may not include all of the devices, components, modules, etc. discussed in connection with the figures. It must be understood and recognized.

"Example", "example", "aspect", "exemplary", etc., used herein should not be construed as preferring or advantageous to any aspect or design being described over other aspects or designs. . The terms '~unit', 'component', 'module', 'system', 'interface', etc. used below generally mean a computer-related entity, and for example, hardware, hardware It may mean a combination of and software, software.

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements and/or groups thereof. It should be understood that it does not.

In addition, terms including ordinal numbers, such as first and second, may be used to describe various components, but the components are not limited by the terms. These terms are only used for the purpose of distinguishing one component from another. For example, a first element may be termed a second element, and similarly, a second element may be termed a first element, without departing from the scope of the present invention. The terms and/or include any combination of a plurality of related recited items or any of a plurality of related recited items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are generally understood by those of ordinary skill in the art to which the present invention belongs. has the same meaning as Terms such as those defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in the embodiments of the present invention, an ideal or excessively formal meaning not be interpreted as

1 schematically illustrates components for performing a method and system for providing a customized cosmetics review providing an AR lipstick function according to an embodiment of the present invention.

As shown in FIG. 1, the method and system for providing a customized cosmetics review providing an AR lipstick function of the present invention is a computer installed in a user terminal 100 and a reviewer terminal 300 and capable of communicating with a service server 200. It can be implemented on the basis of a program. Preferably, the computing program may include a mobile application.

The user terminal 100 is a computing device including one or more processes and one or more memories, and can communicate with the service server 200 and display information received from the service server 200 . Specifically, the user terminal 100 may transmit image data of the user's skin to the service server 200, and may receive the user's skin analysis result, skin analysis diary, and recommended cosmetic review information and recommended cosmetic product information. . Preferably, the user terminal 100 capable of performing the customized cosmetics review information providing method according to an embodiment of the present invention is a mobile terminal or a personal computer.

In addition, the user terminal 100 may transmit product or color data to be tested for cosmetics to the service server 200 . The service server 200 may generate image data on which an AR cosmetic test is performed using a learning model on data received from the user terminal 100 and transmit the image data to the user terminal 100 .

The service server 200 is a computing device including one or more processors and one or more memories, and a program for performing the customized cosmetics review information providing method of the present invention may be installed. In addition, the service server 200 may include a separate DB for storing basic information required to perform the review information providing method. Specifically, the service server 200 may communicate with the user terminal 100 and the reviewer terminal 300 to store basic information for performing the customized cosmetics review information providing method of the present invention in a DB. The cosmetic review information and cosmetic product information pre-stored in the DB of the service server 200 include conventional cosmetic product information and OEM cosmetic product information received from the reviewer terminal 300 . Preferably, the cosmetic product information may include all information that a general user can refer to in the process of selecting a cosmetic product, such as product name, cosmetic ingredient, cosmetic case external information, and review score. In addition, the cosmetic product information may be automatically updated according to a period set by the service provider or directly updated by the service provider.

In addition, the service server 200 receives image data of the user's skin and a request for creating a diary from the user terminal 100, derives skin characteristic parameters, and provides skin analysis diary, cosmetic review information, and cosmetic product information. can do. Specifically, it is preferable that the skin characteristic parameter is an index capable of deriving skin characteristics such as wrinkles, pores, acne, and oil of each user, and the skin analysis diary is obtained by capturing the user's skin from the user terminal 100 at least once. It is preferable to generate skin analysis data reflecting the change in skin condition over time as information derived based on skin information by time and skin summary information by receiving image data. In an embodiment of the present invention, the service server 200 may request image data from the user terminal 100 every day, derive user skin characteristic parameters for each day, and display the result as an image.

In addition, the service server 200 may calculate a review suitability score based on the cosmetic review information and selectively transmit cosmetic review information having a high review suitability score to the user terminal 100 . Specifically, in the preset criteria, a high score is given to cosmetic review information of reviewers with similar age, gender, and skin characteristic parameters to the user, and a high score is given to cosmetic review information of highly influential reviewers based on the number of reviewers' followers and reviews. It is desirable to calculate the review relevance score by assigning a weight to the interest type information set by the user. In addition, the cosmetic product information is preferably provided by selectively providing cosmetic information requested by the user based on the type, capacity, review score, etc. of the product.

The service server 200 may receive cosmetics review information and OEM cosmetics basic information from the reviewer terminal 300 and store them in the DB of the service server 200 . Specifically, the service server 200 may examine OEM cosmetics sales conditions based on the cosmetics review information received from the reviewer terminal 300 . Preferably, reviewers with high influence are selected based on the number of followers, the number of reviews, the review evaluation score, etc. among the reviewers who have provided cosmetic review information, and the reviewer can receive OEM cosmetics manufacturing intention and basic information on OEM cosmetics. Basic information on OEM cosmetics received from the reviewer terminal 300 may be stored in the DB of the service server 200 as described above. Basic information on OEM cosmetics stored in the DB of the service server 200 may be included in cosmetic product information that the service server 200 transmits to the user terminal 100 .

In addition, the service server 200 may perform an AR test based on the skin picture, test product information, and color data received from the user terminal 100 . Specifically, the service server 200 may select a lip image from skin photos according to the learning model, and may perform an AR test by inputting test product information and color data to the lip image of the store.

Meanwhile, the payment server (not shown) may be included in the service server 200 or configured as a separate device independent of the service server 200 to communicate with the user terminal 100 to perform product purchase and payment.

The reviewer terminal 300 may communicate with the service server 200 to provide review information and basic information on OEM cosmetics. In addition, as described above, the reviewer terminal 300 of reviewers with high influence selected by the service server 200 receives a separate interface capable of transmitting OEM cosmetics production intention and basic information of OEM cosmetics from the service server 200. can do. Specifically, the reviewer terminal 300 may transmit basic information of OEM cosmetics including product name, cosmetic ingredients, cosmetic case appearance information, and similar product brands to the service server 200 through the interface.

Meanwhile, in another embodiment of the present invention, a computer program in which instructions for implementing the customized cosmetics review information providing method are recorded is provided in the service server 200, and the user terminal 100 and the reviewer terminal 300 ) may communicate with the service server 200 through a web browser provided in the web browser, and provide customized cosmetics review information on a web page displayed by the web browser.

Figure 2 schematically shows the process of creating a skin analysis diary, providing a user-customized review, and performing an AR cosmetics test in a server system according to an embodiment of the present invention.

As shown in FIG. 2, a method for providing a customized cosmetics review providing an AR lipstick function, receiving one or more skin photos from a user terminal, and using the received skin photos as a machine-learned analysis model to analyze a plurality of skin characteristics user skin analysis step of deriving parameters; Based on the diary creation request received from the user terminal, creating a skin analysis diary in which the plurality of skin characteristic parameters for the received plurality of skin photos are temporally aligned, and providing the skin analysis diary to the user terminal providing a skin analysis diary; Receive interest type information and cosmetic type information of the skin characteristic parameter of interest from the user terminal, select the cosmetic review information corresponding to the cosmetic type information from among previously stored cosmetic review information, and reviewer's external skin information, skin a customized review providing step of arranging characteristic parameter information in a similar order to user information and providing the sorted cosmetics review information to the user terminal; an OEM cosmetics sales step of receiving a request for production of OEM cosmetics from the reviewer terminal and providing basic information or a sales interface on the OEM cosmetics produced by the reviewer to other users; and an AR cosmetic testing step of performing a test using augmented reality technology on the skin picture received from the user terminal.

The method for providing a customized cosmetics review providing an AR lipstick function according to the present invention may perform a step (S100) of analyzing the user's skin and deriving skin characteristic parameters. Specifically, the service server 200 may receive one or more skin photos of the user's skin from the user terminal 100 and derive skin characteristic parameters based on a machine learning analysis model. The skin characteristic parameters correspond to basic information for analyzing the user's skin, such as wrinkles, pores, acne, and oil. Can be used to select review information.

In addition, the service server 200 preferably requests a skin picture of the user one or more times in order to perform the step S100 of analyzing the user's skin and deriving the skin characteristic parameters from the user terminal 100 . Specifically, the service server 200 may create a skin diary by requesting a user's skin photo from the user terminal 100 every day or at set intervals. This is to perform accurate skin analysis by reflecting changes in skin conditions caused by external factors such as exercise and rest, drinking, and eating habits.

Meanwhile, an interface provided to the user terminal 100 in step S100 in which the service server 200 analyzes the user's skin and derives skin characteristic parameters is shown in FIG. 4 . A detailed description of this will be described later.

The step of generating a skin analysis diary (S110) may be performed based on the basic information derived from the step of analyzing the user's skin and deriving the skin characteristic parameters (S100). Specifically, the skin analysis diary displays information based on the skin characteristic parameters analyzed by the machine learning model in the skin information layer (L200) and the skin information summary layer (L210) by time. Preferably, the skin analysis information derived from one or more skin photos is summarized by time and displayed in the skin information layer by time (L200), and the skin information summary layer (L210) summarizes each skin analysis information derived. Information can be displayed.

Meanwhile, the interface provided to the user terminal 100 in step S110 of generating the user's skin analysis diary by the service server 200 is shown in FIG. 5 . A detailed description of this will be described later.

The user-customized review providing step (S120) may be performed based on the basic information derived from the above-described step of analyzing the user's skin and deriving skin characteristic parameters (S100) and generating the skin analysis diary (S110). Specifically, the service server 200 transmits cosmetic review information and cosmetic product information as a customized review to the user terminal 100 in the user-customized review providing step (S120). In addition, in the user-customized review providing step (S120), a review relevance score may be calculated as a criterion for selecting the cosmetic review information and cosmetic product information. The review relevance score is a value determined by a predetermined criterion, and is calculated to give weight to skin characteristic parameters of high user interest and to preferentially provide reviews of reviewers with high similarity to the user or reviewers with high influence. Specifically, a reviewer with a high similarity to the user may be a reviewer with similar age, gender, and skin characteristic parameters to the user, and a reviewer with high influence may be a reviewer with a high number of reviewer followers and reviews.

As a result, the customized cosmetics review information providing method of the present invention can select and provide the most suitable review to the user from the cosmetics review information stored in the DB of the service server 200 . Similarly, among the cosmetic product information stored in the DB of the service server 200, product information most suitable for the user may be selected and provided. Specifically, among the cosmetic product information stored in the DB of the service server 200, the most suitable product for the user may be selected and provided based on the type, capacity, and review score of the product.

Meanwhile, the interface provided to the user terminal 100 by the service server 200 in the user-customized review providing step (S120) is shown in FIG. A detailed description of this will be described later.

Meanwhile, the user-customized review providing step (S120) may include an OEM cosmetics information providing step (S130). Cosmetic product information stored in the DB of the service server 200 and provided to the user may include OEM cosmetic information. OEM cosmetics are user-customized cosmetics, and in the present invention, may be customized products manufactured by highly influential reviewers. Specifically, the service server 200 selects reviewers with high influence among reviewers who have provided cosmetic review information, and transmits product information of OEM cosmetics produced by the basic information of OEM cosmetics provided by reviewers who have an intention to produce OEM cosmetics to the user terminal. It can be sent to (100). A detailed description of the OEM cosmetics sales step performed by the service server 200 and interfaces provided to the user terminal 100 and the reviewer terminal 300 will be described later with reference to FIG. 7 .

In the AR cosmetics test step (S140), the service server 200 may perform an AR test based on the skin picture received from the user terminal 100. Specifically, the service server 200 may receive from the user terminal 100 skin photos and product information or color data to be tested for cosmetics. The learning model included in the service server 200 may select a lip image from skin photos. Preferably, the lip image selected by the learning model in the AR cosmetics test step (S140) can be selected based on color and shape, and the cosmetic product type for which the AR test is performed is lipstick. Meanwhile, the interface provided to the user terminal 100 by the service server 200 in the AR cosmetics test step (S140) is shown in FIG. 8. A detailed description of this will be described later.

As a result, through the customized cosmetics review information providing method of the present invention, the user is provided with information on OEM cosmetics along with conventional products, increasing opportunities to select the most suitable customized cosmetics for the user, and reviewers are provided with information on OEM cosmetics. Through revenue, compensation for cosmetics review information can be obtained, and at the same time, the effect of writing high-quality cosmetics review information and increasing participation in the service can be expected. In addition, by using AR technology to perform cosmetic product tests remotely, it is possible to easily provide users with criteria for product selection.

3 schematically illustrates a process of manufacturing OEM cosmetics and providing information to users in the OEM cosmetics sales step according to an embodiment of the present invention.

As shown in Figure 3, the OEM cosmetics sales step; based on the reviewer's cosmetics review information, the OEM cosmetics production review step of examining the OEM cosmetics sales conditions; and an OEM cosmetics information receiving step of receiving an intention to manufacture the OEM cosmetics and basic information of the OEM cosmetics from the reviewer who satisfies the OEM cosmetics sales conditions, wherein the basic information of the OEM cosmetics includes a product name, cosmetic ingredients, and cosmetics. Case appearance information and similar product brands may be included.

In the OEM cosmetics production screening step (S200), the service server 200 may screen reviewers who have provided cosmetic review information based on the number of followers, the number of reviews, the review evaluation score, etc., and select reviewers with high influence. In the OEM cosmetics information receiving step (S210), the service server 200 may receive OEM cosmetics production intention and basic information of the OEM cosmetics from the selected reviewer, and store the corresponding information in the DB of the service server 200. Basic information of OEM cosmetics refers to basic information constituting a product including product name, cosmetic ingredients, cosmetic case appearance information, and similar product brands. In the OEM cosmetic information providing step (S220), the service server 200 may transmit OEM cosmetic product information together with conventional cosmetic product information to the user terminal 100. In addition, the service server 200 may provide a separate interface for product purchase along with cosmetic product information to the user terminal 100 . The user terminal 100 may purchase a product by communicating with a payment server (not shown) included in the service server 200 or provided separately. The payment server (not shown) and the user terminal 100 communicate with each other to proceed with product purchase and payment, and the interface therefor is different from the conventional payment method and interface using a computer program installed on a mobile terminal or personal computer. Since this is not the case, a detailed description thereof will be omitted.

Meanwhile, the method and system for providing a customized cosmetics review providing the AR lipstick function of the present invention are preferably implemented through a computing device including one or more processors and one or more memories as a computing program. Specifically, a computing device for implementing the present invention may be a mobile terminal or a personal computer, and a computing program may be a separate program implemented on an application or web page. 4 to 7 show screens displayed by a computing program in a computing device. Preferably, these are examples of screens displayed on the user terminal 100 and the reviewer terminal 300 in the user skin analysis step, skin analysis diary provision step, customized review provision step, and OEM cosmetics sales step. Meanwhile, other than the above examples, the login page, main page, community page, purchase page, etc. are implemented at a general level that can be implemented by a person skilled in the art, and detailed descriptions thereof will be omitted.

4 schematically shows an image displayed on the user terminal 100 in the user skin analysis step according to an embodiment of the present invention.

As shown in FIG. 4, the user's skin analysis step may include: a user response result receiving step of receiving a skin test survey result and the interest type information having a high level of user interest from the user terminal 100; a user skin picture receiving step of receiving the skin picture of the user from the user terminal 100; And skin characteristics of deriving one or more of the skin characteristic parameters using the machine-learned analysis model from the skin photograph of the user received in the receiving step of the user's skin photograph, and transmitting a skin analysis result to the user terminal 100. Parameter derivation step; may include.

4(a) shows a screen displayed on the user terminal 100 in order for the service server 200 to receive skin test survey results from the user terminal 100. As shown in (a) of FIG. 4, the skin test layer L100 is displayed on the user terminal 100 and the user responds to the skin test survey questions to determine the accuracy of the user skin analysis step performed by the service server 200. can improve Specifically, the skin test questionnaire consists of multiple items to collect basic information for diagnosing skin conditions such as sensitivity, skin tone, trouble, skin elasticity, wrinkles, pigmentation, dryness/oiliness, allergy/atopy, etc. . In addition, a survey skip layer (not shown) for skipping survey questions and an interest type information layer (not shown) through which a user can input interest type information may be included on one side of the user terminal 100 .

(b) of FIG. 4 shows a screen displayed on the user terminal 100 in order for the service server 200 to receive a skin picture of the user from the user terminal 100 . The skin photo layer L110 displays image data captured by the user terminal 100 or image data attached by the user terminal 100 . In addition, if the image data input to the skin photo layer L110 is not suitable for use in the user skin analysis step, a separate retake request layer (not shown) may be displayed to request retransmission of image data from the user terminal 100. . Specifically, the service server 200 may request retransmission of the image data from the user terminal 100 when it is difficult to perform skin analysis due to excessive contrast or inaccurate focus of the image data. The skin photo input layer L111 is an interface for a user to take a skin photo or retrieve image data stored in the user terminal 100 and send it to the service server 200 to request skin analysis.

(c) of FIG. 4 shows a screen displaying skin analysis results including skin characteristic parameters on the user terminal 100 . As described above, the service server 200 may derive a skin analysis result by using a machine-learned analysis model of the user's skin photo received in the user skin photo receiving step. The skin characteristic parameter preferably includes elements capable of analyzing skin conditions such as wrinkles, pores, acne, and oil. The skin analysis photo layer L120 displays image data used for skin analysis in the user skin analysis step, and preferably displays the same image data as the skin photo layer L110 shown in FIG. 4(b). The skin characteristic parameter layer L121 displays an analysis result obtained by deriving skin characteristic parameters based on the image data input to the skin photograph layer L110. As shown in (c) of FIG. 4, in one embodiment of the present invention, skin characteristic parameters such as sensitivity, oil content, dryness, pore size, pigmentation, etc. are derived and displayed, but as described above, a separate parameter set by the service manager A skin characteristic parameter of may be derived and displayed. The skin analysis result layer (L122) summarizes and displays the skin analysis result derived based on the skin characteristic parameter layer (L121).

5 schematically shows an image displayed on the user terminal 100 in the step of providing a skin analysis diary according to an embodiment of the present invention.

As shown in FIG. 5, the step of providing the skin analysis diary; displays a skin information layer (L200) by time displaying information summarizing the one or more skin characteristic parameters received by the user terminal 100 by time. Skin information layer (L200) display step; and displaying a skin information summary layer (L210) displaying a skin information summary layer (L210) displaying summary information of one or more skin analysis diaries received from the user terminal (100).

As described above, the service server 200 may generate a skin analysis diary by receiving image data for skin analysis from the user terminal 100 one or more times.

5 shows a screen on which a skin analysis diary is displayed in the user terminal 100 . The skin analysis diary provided to the user terminal 100 in the skin analysis diary providing step is preferably generated by basic information received in the user skin photo receiving step. The skin information layer by time (L200) displays skin analysis data reflecting changes in skin condition over time. In detail, the service server 200 may receive image data from the user terminal 100 every day or at regular intervals and provide a result of analyzing the user's skin over time. As described above, this is to perform accurate skin analysis by reflecting changes in skin conditions caused by external factors such as exercise and rest, drinking, and eating habits. The skin information summary layer L210 summarizes and displays the image data, skin characteristic parameters, and skin analysis results shown in FIG. 4(c). In addition, the user can select each component of the skin information summary layer L210 and check detailed information of the skin analysis result as shown in FIG. 4(c).

6 schematically illustrates an image displayed on the user terminal 100 in the step of providing a customized review according to an embodiment of the present invention.

As shown in FIG. 6, the customized review providing step includes a review relevance score calculation step of calculating a review relevance score based on a preset criterion for the previously stored cosmetics review information; and a cosmetic review providing step of providing the cosmetic review information and cosmetic product information to the user terminal 100 based on the review relevance score, wherein the predetermined criteria include age, gender, the number of reviewer followers, the number of reviews, A weight may be assigned to the interest type information received in the user response result receiving step, which is determined based on the similarity of the skin characteristic parameter.

6(a) shows a screen displaying cosmetic review information suitable for the user based on the information filtered by the user and the review relevance score derived from the service server 200. The interest type information filtering layer (L310) displays on one side of the user terminal 100 to filter the review information based on the interest type information having a high user interest among the review information stored in the DB of the service server 200. Specifically, the interest type information filtered by the interest type information filtering layer L310 may be determined by selecting one or more of the skin characteristic parameters derived in the user skin analysis step, such as skin dryness, oil content, and pores. The product type filtering layer (L311) is displayed on one side of the user terminal 100 to filter review information based on cosmetic product information selected by the user among review information stored in the DB of the service server 200. The selection summary layer L312 summarizes and displays the skin analysis result derived in the above-described process and information filtered by the user. Specifically, the selection summary layer (L312) can summarize and display the skin characteristic parameters derived from the user's skin analysis step, the information filtered by the interest type information filtering layer (L310) and the product type filtering layer (L311). The cosmetics review selection layer (L313) reflects the skin analysis result and user-filtered information among the review information stored in the DB of the service server 200 to display cosmetics review information most suitable for the user. Specifically, the cosmetic review selection layer L313 may display cosmetic review information in the order of review relevance scores among a plurality of cosmetic review information. Preferably, the cosmetics review information displayed in the cosmetics review selection layer (L313) is based on information filtered by the user, but the user and external information such as age and gender, skin analysis parameters, etc. are similar, and the number of reviewers, followers, and reviews are similar. Cosmetics review information of many reviewers can be displayed at the upper level. In addition, the user can select each component of the cosmetics review selection layer (L313) to pop up the cosmetics review information layer (L320).

(b) of FIG. 6 shows a cosmetic review information layer (L320) popped up when the user selects each component of the cosmetic review selection layer (L313). The cosmetics review information layer (L320) displays the reviewer's cosmetics review information previously stored in the DB of the service server 200, and may further include the number of reviewer followers, review evaluation scores, and the like.

6(c) is a screen displayed on the user terminal 100 when the user terminal 100 requests detailed product information from the service server 200. The cosmetics product information layer (L330) displays detailed information of products corresponding to the cosmetics review information layer (L320). Specifically, the user can request detailed product information from the service server 200 by selecting one side of the cosmetics review information layer (L320), and the corresponding information is displayed on the cosmetics product information layer (L330). Preferably, detailed product information displayed on the cosmetic product information layer (L330) may include all information that a general user can refer to in the process of selecting a cosmetic product, such as product name, cosmetic ingredient, rating, price, capacity, and product image. . In addition, additional information provided to the user terminal 100 is displayed on the recommendation information layer L331. Specifically, product information similar to the selected product or suitable for the user's skin characteristics may be displayed on the cosmetic product information layer (L330).

7 schematically shows images displayed on the reviewer terminal 300 and the user terminal 100 in the OEM cosmetics sales stage according to an embodiment of the present invention.

As shown in FIG. 7, the OEM cosmetics sales step includes an OEM cosmetics manufacturing examination step of reviewing the OEM cosmetics sales conditions based on the cosmetics review information of the reviewer; and an OEM cosmetics information receiving step of receiving an intention to manufacture the OEM cosmetics and basic information of the OEM cosmetics from the reviewer who satisfies the OEM cosmetics sales conditions, wherein the basic information of the OEM cosmetics includes a product name, cosmetic ingredients, and cosmetics. Case appearance information and similar product brands may be included.

As described above, the service server 200 may examine the reviewer's OEM cosmetic sales conditions based on the reviewer's cosmetics review information. Specifically, reviewers with high influence can be selected based on the number of followers, the number of reviews, the review evaluation score, etc. among reviewers who have provided cosmetic review information, and an intention to manufacture OEM cosmetics can be received from the reviewer.

7(a) is a screen displayed on the reviewer terminal 300 in order for the service server 200 to receive basic information on OEM cosmetics from the reviewer terminal 300. The OEM cosmetics image layer (L400) is an interface for inputting external information of OEM cosmetics as image data. The reviewer can upload image data of the OEM cosmetics or image data stored in the reviewer terminal 300 to the OEM cosmetics image layer L400 to provide the service server 200 with external information of the OEM cosmetics. The OEM cosmetics basic information layer (L410) is an interface for inputting information excluding external appearance information of OEM cosmetics. Specifically, the OEM cosmetics basic information layer (L410) may include an interface for inputting product names, major ingredients, brands, desired prices, and the like.

As described above, in the customized cosmetics review information providing method of the present invention, the user terminal 100 and the service server 200 communicate to provide an interface for payment and purchase. 7(b) is a screen displayed on the user terminal 100 for payment and purchase of products. The user can select one side of the cosmetics product information layer (L330) to pop up the skin analysis result layer (L420) and the OEM cosmetics sales layer (L430). The skin analysis result layer L420 may summarize and display data including the user's skin analysis result and external skin information. Alternatively, the same components as the skin information summary layer L210 may be displayed. The OEM cosmetics sales layer (L430) is an interface provided for product purchase and payment, and product information displayed on the OEM cosmetics sales layer (L430) may include conventional cosmetics product information and OEM cosmetics product information. Alternatively, conventional cosmetic product information and OEM cosmetic product information may be displayed in separate layers.

8 schematically shows an image displayed on a user terminal in an AR cosmetic testing step according to an embodiment of the present invention.

As shown in FIG. 8, the AR cosmetics testing step; includes a test information receiving step of receiving test product information and color data from the user terminal; a lip image selection step of selecting a lip image from the skin picture; and a lip color changing step of inputting the test product information and the color data received from the user terminal into the lip image.

The user terminal 100 may transmit test product information and color data along with skin photos to the service server 200 . Specifically, the test product information transmitted by the user terminal 100 is lipstick product information, and the color data is color data mainly used in conventional lipstick products. The service server 200 may perform an AR cosmetics test based on data received from the user terminal 100 . The learning model can select a lip image from a skin photo, generate image data expressing color data at a corresponding location, and the service server 200 can transmit the corresponding image data to the user terminal 100 . Specifically, the color data provided in the AR cosmetics test step may be generated based on color data of a conventional cosmetic product or selected based on color data that the user terminal 100 responds to.

In the AR cosmetics test step, the skin picture used for the AR cosmetics test may be image data received in the step of analyzing the user's skin and deriving skin characteristic parameters (S100). Alternatively, the service server 200 may perform the AR cosmetics test by receiving a skin picture from a separate interface for the AR cosmetics test step. Preferably, when the service server 200 includes a lip image in the skin picture received in the step of analyzing the user's skin and deriving the skin characteristic parameters (S100), an AR cosmetics test can be performed based on the corresponding image data If the lip image is not included, additional image data may be requested from the user terminal 100 .

As a result, according to one embodiment of the present invention, skin analysis information may be provided to the user by analyzing skin characteristics such as wrinkles, pores, acne, and oil of each user based on image data obtained by taking a picture of the user's skin.

According to an embodiment of the present invention, skin analysis may be performed by receiving daily skin photos from the user and reflecting changes in skin condition due to external factors such as exercise and rest, drinking, and eating habits.

According to an embodiment of the present invention, it is possible to selectively show cosmetic review information of reviewers similar to the user by assigning a high review relevance score to cosmetic review information of reviewers having similar skin characteristics to the user.

According to an embodiment of the present invention, reviews of reviewers with high influence may be displayed with priority in considering age, gender, the number of followers of the reviewer, the number of reviews, and the like, in the cosmetics review information displayed to the user.

According to an embodiment of the present invention, it is possible to selectively show products with high user preference by assigning weights to skin characteristic parameters of high user interest.

According to one embodiment of the present invention, it is possible to provide an interface for receiving OEM cosmetics manufacturing intention and basic information on OEM cosmetics to highly influential reviewers, and to display information on OEM cosmetics manufactured to general users. .

According to one embodiment of the present invention, the participation in the service can be improved by providing revenue generated from OEM cosmetics to reviewers who provide review information.

According to an embodiment of the present invention, a user may test a cosmetic product including a lipstick using augmented reality technology without directly visiting a store.

As described above, although the embodiments have been described with limited examples and drawings, those skilled in the art can make various modifications and variations from the above description. For example, the described techniques may be performed in an order different from the method described, and/or the components of the described system, structure, device, circuit, etc. may be combined or combined in a different form than the method described, or other components may be used. Or even if it is replaced or substituted by equivalents, appropriate results can be achieved. Therefore, other implementations, other embodiments, and equivalents of the claims are within the scope of the following claims.

Claims (7)

As a method of providing a customized cosmetics review that provides an AR lipstick function,
A user skin analysis step of receiving one or more skin photos from a user terminal and deriving a plurality of skin characteristic parameters using the received skin photos using a machine-learned analysis model;
Based on the diary creation request received from the user terminal, creating a skin analysis diary in which the plurality of skin characteristic parameters for the received plurality of skin photos are temporally aligned, and providing the skin analysis diary to the user terminal providing a skin analysis diary;
Receive interest type information and cosmetic type information of the skin characteristic parameter of interest from the user terminal, select the cosmetic review information corresponding to the cosmetic type information from among previously stored cosmetic review information, and reviewer's external skin information, skin a customized review providing step of arranging characteristic parameter information in a similar order to user information and providing the sorted cosmetics review information to the user terminal;
an OEM cosmetics sales step of receiving a request for production of OEM cosmetics from the reviewer terminal and providing basic information or a sales interface on the OEM cosmetics produced by the reviewer to other users; and
A method for providing customized cosmetics review information including; AR cosmetics testing step of performing a test using augmented reality technology on the skin picture received from the user terminal.
The method of claim 1,
The user skin analysis step,
a user response result receiving step of receiving, from the user terminal, a skin test survey result answered by the user and the interest type information having a high level of user interest;
A user skin picture receiving step of receiving the skin picture of the user from the user terminal; and
A skin characteristic parameter derivation step of deriving at least one skin characteristic parameter using the machine-learned analysis model from the skin picture of the user received in the user skin picture receiving step and transmitting a skin analysis result to the user terminal; Including, customized cosmetics review information providing method.
The method of claim 1,
The step of providing the skin analysis diary;
a timed skin information layer display step of displaying a timed skin information layer displaying information summarizing the one or more skin characteristic parameters received from the user terminal by time; and
A skin information summary layer display step of displaying a skin information summary layer displaying summary information of one or more skin analysis diaries received from the user terminal; including, customized cosmetics review information providing method.
The method of claim 1,
The customized review providing step; is,
a review relevance score calculation step of calculating a review relevance score based on a predetermined criterion for the previously stored cosmetics review information; and
A cosmetics review providing step of providing the cosmetic review information and cosmetic product information to the user terminal based on the review relevance score; and
The preset criterion is determined based on age, gender, number of reviewer followers, number of reviews, and skin characteristic parameter similarity, and weight is given to the interest type information received in the user response result receiving step; providing customized cosmetics review information. method.
The method of claim 1,
The OEM cosmetics sales step;
An OEM cosmetics production review step of reviewing the OEM cosmetics sales conditions based on the cosmetics review information of the reviewer; and
An OEM cosmetics information receiving step of receiving an intention to manufacture the OEM cosmetics and basic information of the OEM cosmetics from the reviewer who satisfies the OEM cosmetics sales conditions;
The basic information of the OEM cosmetics includes a product name, cosmetic ingredients, cosmetic case appearance information, and a similar product brand, customized cosmetics review information providing method.
The method of claim 1,
AR cosmetics test step; is,
a test information receiving step of receiving test product information and color data from the user terminal;
a lip image selection step of selecting a lip image from the skin picture;
and a lip color changing step of inputting the test product information and the color data received from the user terminal into the lip image.
As a customized cosmetics review providing system that provides AR lipstick function,
A user skin analysis step of receiving one or more skin photos from a user terminal and deriving a plurality of skin characteristic parameters using the received skin photos using a machine-learned analysis model;
Based on the diary creation request received from the user terminal, creating a skin analysis diary in which the plurality of skin characteristic parameters for the received plurality of skin photos are temporally aligned, and providing the skin analysis diary to the user terminal providing a skin analysis diary;
Receive interest type information and cosmetic type information of the skin characteristic parameter of interest from the user terminal, select the cosmetic review information corresponding to the cosmetic type information from among previously stored cosmetic review information, and reviewer's external skin information, skin a customized review providing step of arranging characteristic parameter information in a similar order to user information and providing the sorted cosmetics review information to the user terminal;
an OEM cosmetics sales step of receiving a request for production of OEM cosmetics from the reviewer terminal and providing basic information or a sales interface on the OEM cosmetics produced by the reviewer to other users; and
A customized cosmetics review information providing system that performs a; AR cosmetics test step of performing a test using augmented reality technology on the skin picture received from the user terminal.

Images