KR20230124195A - System and Method for providing customized complex service based on facial image - Google Patents

Abstract

The present invention determines the customer's health condition according to customer information including the customer's face image, and based on this, provides a customer-specific complex service including a customized beverage optimized for the customer based on the customer's face image It relates to a system and method for providing a customized complex service. To this end, the present invention provides a customer information acquisition step of receiving customer information including a customer's face image, bio information, and survey information from the outside; a facial feature extraction step of extracting facial features of the customer from the face image; a constitutional feature calculation step of calculating constitutional characteristics of the customer based on the facial features and the questionnaire information; a health state calculation step of calculating health state information of the customer based on the facial features and the bio information; In addition, a basic recipe calculation step of calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics; provides a method and system for providing a customer-customized composite service based on a facial image.

Description

System and method for providing customized complex service based on facial image

The present invention relates to a system and method for providing a customer-customized complex service, which includes a customer-customized complex service that determines a customer's health condition according to customer information including a customer's face image and, based on this, provides a customized beverage optimized for the customer. It relates to a system and method for providing a customer-customized composite service based on a face image capable of providing

In modern society, interest in health is increasing day by day. In addition to this interest of the times, as technology has rapidly developed, such as data analysis methods and tools by real-time data collection, it has become possible to monitor health conditions and receive personalized health care services.

Convenience and customization of health services and related systems are being strengthened due to the diversification of customer needs and the improvement of expectations according to the change in consumer consciousness.

In particular, as interest in quality of life and well-being increases with the improvement of living standards, there is an increasing demand for personalized health management such as prevention of lifestyle-related diseases or weight management based on personal health data.

Republic of Korea Patent Publication No. 10-2014-0108417 (published on September 11, 2014)

The problem to be solved by the present invention is to determine the customer's health condition according to customer information including the customer's face image, and based on this, to provide a customer-tailored complex service including customized beverages optimized for the customer's facial image. To provide a system and method for providing customer-customized complex services based on

The problem to be solved by the present invention is not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below. .

In order to solve the above problems, the present invention provides a customer information acquisition step of receiving customer information including a customer's face image, bio information, and survey information from the outside; a facial feature extraction step of extracting facial features of the customer from the face image; a constitutional feature calculation step of calculating constitutional characteristics of the customer based on the facial features and the questionnaire information; a health state calculation step of calculating health state information of the customer based on the facial features and the bio information; In addition, a basic recipe calculation step of calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics; provides a method for providing a customer-customized complex service based on a face image.

The customer-customized composite service providing method may further include a modified recipe calculation step of calculating a modified customized beverage modified recipe by reflecting the customer's additional request input from the outside.

The additional request may include at least one of a required sugar level for the customized beverage and flavoring information to be added to the customized beverage.

In addition, the additional request is at least one functional information among diet, skin beauty, and immunity enhancement, and the customized beverage modified recipe may include at least one additional material corresponding to the functional information.

The customer-customized composite service providing method may further include an additional service providing step of providing additional service information including at least one of beauty information and cosmetic information based on the facial features and constitutional features.

According to another embodiment of the present invention, the present invention provides a customer information receiver receiving customer information including a customer's face image, bio information, and survey information from the outside; a feature extraction unit extracting facial features of the customer from the face image and then calculating constitutional characteristics of the customer based on the facial features and the questionnaire information; a health state calculation unit that calculates health state information of the customer based on the facial features and the bio information; In addition, a customer-customized composite service providing system based on a face image including a recipe calculation unit for calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics is provided.

The recipe calculation unit may calculate a corrected customized beverage recipe by reflecting the customer's additional request input from the outside.

The customer-customized composite service providing system may further include an additional service provider providing additional service information including at least one of beauty information and cosmetics information based on the facial features and constitutional features.

A system and method for providing a customer-customized complex service based on a face image according to the present invention determines the health condition of a customer according to customer information including a face image, and based on this, provides a customized drink optimized for the customer. It has the advantage of being able to provide complex services.

In addition, the customer-customized complex service providing system according to the present invention considers the customer's health condition and constitution, and at the same time, various requirements of the customer, for example, diet, skin care, immunity increase, sugar content of the customized drink, flavor of the customized drink It has the advantage of being able to provide customized beverages that reflect customer needs.

In addition, the customer-customized composite service providing system according to the present invention includes an artificial intelligence learning module that learns based on data including the customer's health condition information, customized beverage basic recipe, and additional service information obtained from external experts when necessary. Having it equipped has the advantage of being able to provide more accurate and customized complex services to customers.

The effects of the present invention are not limited to the above effects, and should be understood to include all effects that can be inferred from the detailed description of the present invention or the configuration of the invention described in the claims.

1 is a block diagram showing the configuration of a customer-customized composite service providing system based on a face image according to the present invention.
2 is a diagram showing the flow of a method for providing a customer-customized composite service based on a face image according to the present invention.
FIG. 3 is a diagram showing a detailed flow of a state of health calculation step in the providing method of FIG. 2 .

Hereinafter, preferred embodiments of the present invention in which the above-described problem to be solved can be specifically realized will be described with reference to the accompanying drawings. In describing the present embodiments, the same names and the same reference numerals are used for the same components, and additional descriptions thereof are omitted below.

Throughout the specification, when a part is said to be “connected (connected, contacted, combined)” with another part, it is not only “directly connected”, but also “indirectly connected” with another member in between. ”Including cases where it is. In addition, when a certain component is said to "include", this means that it may further include other components without excluding other components unless otherwise stated.

Terms used in this specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “include” or “having” are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.

Referring to FIGS. 1 to 4 , a system and method for providing a customer-customized composite service based on a facial image according to an embodiment of the present invention will be described as follows.

The customer-customized composite service providing system according to the present embodiment may provide a customer-customized composite service including a service of providing a customized drink tailored to the customer based on the customer's face image through store or online sales. Here, the customized beverage may include herbal beverages, tea beverages, health functional beverages, and the like.

The customer-customized composite service providing system includes a customer information receiving unit 210, a feature extraction unit 220, a health condition calculation unit 230, a recipe calculation unit 240, a first data storage unit 260, and a second data storage unit. (270).

The customer information reception unit 210 receives customer information including the customer's face image 10, bio information 20, and survey information 30 from the external customer information input device 100. That is, a customer information acquisition step of obtaining customer information by the customer information receiving unit 210 is performed (S100).

The customer information input device 100 includes a smart phone, and a customized service application for receiving a customized complex service may be installed on the customer's smart phone.

The customer's face image 10 is generated by the camera provided in the smart phone and then transmitted to the customer information receiving unit 210. It is preferable that the customer's face image is an image of the front of the customer's face.

The customer's bio information 20 may be the customer's body information, for example, pulse rate. Specifically, the pulse rate may be the customer's pulse rate for 1 minute. The customer's bio information 20 may be measured by a bio-signal measurer provided in a smart watch linked with a smart phone, and then transmitted from the smart phone to the customer information receiving unit 210 .

Of course, when a customer inputs bio information measured by a separate bio-signal measuring device into an application of a smart phone, the corresponding bio information may be transmitted to the customer information receiving unit 210 .

The customer's survey information 30 may include survey contents for determining the Sasang constitution. For example, the survey information 30 may include the customer's physical characteristics including height, weight, body type, etc., physiological characteristics, voice, habit, personality, temperament, and the like of the customer.

The survey information 30 may be provided in a form in which a customer checks a checklist given to the customer. For example, survey information input by a customer on a customized service application installed in a smart phone may be transmitted to the customer information receiving unit 210 .

As a result, when a customer inputs customer information into a customized service application of a smart phone, the corresponding customer information may be transmitted to the customer information receiving unit 210 .

Of course, customer information may be transmitted to the customer information receiving unit 210 through the customer information input device installed in the store even when the customized service application is not installed on the customer's smart phone. The customer information input device 100 installed in the store may include an image capture unit, a survey information input unit, and a biosignal measurement unit.

The feature extractor 220 may extract facial features of the customer from the face image. That is, the facial feature extraction step may be performed by the feature extractor 220 (S200).

Specifically, the feature extraction unit 220 may extract facial features of the face image based on skin conditions (skin tone, wrinkles, melasma, freckles, pore conditions, wounds, etc.) appearing in the face image. For example, the feature extractor 220 may generate color coordinate information for a specific region of the face image. Here, the specific area may mean a position related to the health state of a human organ in the face image.

In addition, the feature extraction unit 220 may calculate the constitutional characteristics of the customer based on the extracted facial features and questionnaire information. That is, the constitutional feature extraction step may be performed by the feature extractor 220 (S300). Here, the customer's constitutional characteristics may mean the Sasang constitution according to Sasang medicine.

Specifically, the feature extraction unit 220 may calculate the Sasang constitution closest to the customer's constitution by comparing the reference facial features and standard questionnaire information according to the Sasang constitution with the acquired facial characteristics and questionnaire information. In addition, the feature extraction unit 220 may calculate the constitutional characteristics of the customer through artificial intelligence learning.

The customer-customized composite service providing system according to the present embodiment may further include an image correction unit (not shown) that receives the face image stored in the customer information receiving unit 210 and corrects it to meet a preset reference image condition.

The image compensator may correct the size, resolution, etc. of the acquired face image so that it becomes a reference image condition. In addition, the image correction unit may perform artifact removal and color modulation correction by reflected light on the input face image.

Meanwhile, the health state calculation unit 230 may calculate health state information of the customer based on customer characteristic information including facial features and bio information. That is, the health state calculation step may be performed by the health state calculation unit 230 (S400).

The health state calculation unit 230 includes a first artificial intelligence learning module (not shown), and the first artificial intelligence learning module may calculate health state information of the customer based on customer characteristic information through artificial intelligence learning. .

Specifically, as shown in FIG. 3, the first artificial intelligence learning module compares the obtained customer characteristic information with the judgment standard information previously stored in the first data storage unit 260 to compare the customer characteristic information and the judgment standard. Comparative similarity of information can be calculated (S410).

The first artificial intelligence learning module compares the calculated comparative similarity with a pre-set standard similarity, and if the comparative similarity is greater than or equal to the standard similarity, outputs health status information matched with the corresponding criterion information as health status information of the customer (S420). , S440).

Here, the first data storage unit 260 stores judgment standard information and health status information matching the judgment standard information.

If the comparative similarity is smaller than the reference similarity, the first artificial intelligence learning module acquires health status information about the customer through an expert access server (not shown) and then outputs the health status information of the customer (S420, S430, S440).

Specifically, the first artificial intelligence learning module transmits customer information including the customer's face image 10, bio information 20, and survey information 30 to the expert access server when the comparative similarity is smaller than the reference similarity, , When the expert's answer is completed, the customer's health condition information is received from the expert access server and printed out.

Here, the expert is limited to those who are permitted to access the expert access server, and the expert can input health condition information of the customer into the corresponding expert access server based on the customer information transmitted to the expert.

The health status information of the customer transmitted from the expert access server and the customer characteristic information of the corresponding customer are transmitted to and stored in the first data storage unit 260, and the first artificial intelligence learning module is stored in the first data storage unit 260. You can learn based on updated data.

The recipe calculation unit 240 may calculate a basic recipe for customized drinks based on the customer's health state information and constitutional characteristics. That is, a basic recipe calculation step may be performed by the recipe calculation unit 240 (S500).

Specifically, the recipe calculation unit includes a second artificial intelligence learning module (not shown), and the second artificial intelligence learning module calculates a basic recipe for a customized beverage based on the customer's health status information and constitutional characteristics through artificial intelligence learning. can

The second artificial intelligence learning module may calculate a customized beverage basic recipe through substantially the same process as the first artificial intelligence learning module. Here, in the second data storage unit 270, the customer's health condition information and a basic recipe for customized beverages according to constitutional characteristics are stored in advance.

In addition, the recipe calculation unit 240 may reflect the customer's additional request 40 input from the outside to calculate a corrected customized beverage modified recipe (S600).

The additional request 40 may include at least one of the required sugar level for the customized beverage and the spice information to be added to the customized beverage. Here, the customized beverage modified recipe may include at least one type of additional material corresponding to the required sugar level and flavor.

In addition, the additional request 40 may include at least one function information among diet, skin care, and immunity enhancement. Here, the customized beverage modified recipe may include at least one type of additional material corresponding to the functional information.

The additional request 40 is included in customer information, and may be transmitted together when the customer's face image 10, survey information 30, and bio information 20 are transmitted to the customer information receiving unit 210.

Meanwhile, the customer-customized complex service providing system according to the present invention may further include a third data storage unit 280 and an additional service providing unit 250.

The additional service providing unit 250 may provide additional service information including at least one of beauty information and cosmetic information based on the customer's facial and constitutional characteristics. That is, an additional service providing step may be performed by the additional service providing unit 250 (S700).

Specifically, the additional service provider 250 includes a third artificial intelligence learning module (not shown), and the third artificial intelligence learning module provides beauty information, beauty information, and Additional service information including cosmetic information may be provided.

Similarly, the third artificial intelligence learning module may provide additional service information through substantially the same process as the first artificial intelligence learning module. Here, in the third data storage unit 280, beauty information, cosmetics information, etc. according to the customer's facial characteristics and constitutional characteristics are stored in advance.

The additional service providing unit 250 transmits beauty information and cosmetics information according to the customer's facial and constitutional characteristics to the customer's smart phone, thereby executing the additional service.

As a result, the customer-customized complex service providing system according to the present invention determines the customer's health condition according to customer information including the customer's face image, and provides customized beverages optimized for the customer's health condition and constitution based on this. be able to

In addition, the customer-customized complex service providing system according to the present invention considers the customer's health condition and constitution, and at the same time, various requirements of the customer, for example, diet, skin care, immunity increase, sugar content of the customized drink, flavor of the customized drink It has the advantage of being able to provide customized beverages that reflect customer needs.

In addition, the customer-customized composite service providing system according to the present invention includes an artificial intelligence learning module that learns based on data including the customer's health condition information, customized beverage basic recipe, and additional service information obtained from external experts when necessary. Having it equipped has the advantage of being able to provide more accurate and customized complex services to customers.

On the other hand, the customer-customized composite service providing system according to the present invention may further include a manufacturing platform 290 having a platform control unit 291 for manufacturing a customized beverage.

The manufacturing platform 290 is provided with materials for manufacturing customized beverages. Here, each of the materials may be stored and stored in a concentrated liquefied state. For example, herbal medicines used in the case of providing an herbal beverage as a customized beverage may be stored and stored in a concentrated liquefied state.

When the platform control unit 291 receives the customized beverage basic recipe or customized beverage modified recipe calculated by the recipe calculation unit 240, the customized beverage manufacturing platform 290 allows the customized beverage to be manufactured according to the order and amount of the recipe. to control the components of

For example, when the manufacturer presses the start button provided on the manufacturing platform 290, the first lamp interlocking with the first valve through which the basic beverage is discharged blinks, and when the manufacturer opens the first valve, the basic beverage A set amount of can be discharged. Thereafter, when the first lamp is turned off, the second lamp associated with the second valve through which the first material is discharged blinks, and when the manufacturer opens the second valve, the set amount of the first material may be discharged.

Here, the platform control unit 291 may control the lighting sequence of lamps, types of basic beverages and ingredients, and set amounts based on the recipe. Of course, the present invention is not limited thereto, and the manufacturer may manufacture a customized beverage while manually manipulating the manufacturing platform based on the corresponding recipe.

As described above, the present invention is not limited to the specific preferred embodiments described above, and various modifications can be made by those skilled in the art to which the present invention belongs without departing from the gist of the present invention claimed in the claims. is possible and such variations are within the scope of the present invention.

100: customer information input device 210: customer information receiver
220: feature extraction unit 230: health condition calculation unit
240: recipe calculation unit 250: additional service provision unit
260: first data storage unit 270: second data storage unit
280: third data storage unit 290: manufacturing platform

Claims (8)

A customer information acquisition step of receiving customer information including a customer's face image, bio information, and survey information from the outside;
a facial feature extraction step of extracting facial features of the customer from the face image;
a constitutional feature calculation step of calculating constitutional characteristics of the customer based on the facial features and the questionnaire information;
a health state calculation step of calculating health state information of the customer based on the facial features and the bio information; and,
A basic recipe calculation step of calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics; According to claim 1,
A method for providing a customer-customized composite service based on a face image, further comprising a modified recipe calculation step of calculating a modified customized drink modified recipe by reflecting the additional request of the customer input from the outside. According to claim 2,
Wherein the additional request includes at least one of a required sugar level for the customized beverage and flavoring information to be added to the customized beverage. According to claim 2,
The additional request is at least one functional information among diet, skin care, and immunity enhancement, and the customized beverage modified recipe includes at least one type of additional material corresponding to the functional information. Based on the face image, How to provide customer-tailored complex services According to claim 1,
A method for providing a customer-customized composite service based on a face image, further comprising providing additional service information including at least one of beauty information and cosmetics information based on the facial features and constitutional features. a customer information receiver receiving customer information including a customer's face image, bio information, and survey information from the outside;
a feature extraction unit extracting facial features of the customer from the face image and then calculating constitutional characteristics of the customer based on the facial features and the questionnaire information;
a health state calculation unit that calculates health state information of the customer based on the facial features and the bio information; and,
A system for providing a customer-customized complex service based on a face image including a recipe calculation unit for calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics. According to claim 6,
The recipe calculation unit is a customer-customized complex service providing system, characterized in that for calculating a corrected customized beverage modified recipe by reflecting the additional request of the customer input from the outside. According to claim 6,
and an additional service provider providing additional service information including at least one of beauty information and cosmetic information based on the facial features and constitutional features.