WO2023158103A1 - System and method for providing customer-tailored complex services based on face image - Google Patents

System and method for providing customer-tailored complex services based on face image Download PDF

Info

Publication number
WO2023158103A1
WO2023158103A1 PCT/KR2023/000379 KR2023000379W WO2023158103A1 WO 2023158103 A1 WO2023158103 A1 WO 2023158103A1 KR 2023000379 W KR2023000379 W KR 2023000379W WO 2023158103 A1 WO2023158103 A1 WO 2023158103A1
Authority
WO
WIPO (PCT)
Prior art keywords
customer
information
customized
face image
recipe
Prior art date
Application number
PCT/KR2023/000379
Other languages
French (fr)
Korean (ko)
Inventor
박성재
Original Assignee
박성재
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 박성재 filed Critical 박성재
Publication of WO2023158103A1 publication Critical patent/WO2023158103A1/en

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/20—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for electronic clinical trials or questionnaires
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/60—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for patient-specific data, e.g. for electronic patient records
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/30—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for calculating health indices; for individual health risk assessment

Definitions

  • the present invention relates to a system and method for providing a customer-customized complex service, which includes a customer-customized complex service that determines a customer's health condition according to customer information including a customer's face image and, based on this, provides a customized beverage optimized for the customer. It relates to a system and method for providing a customer-customized composite service based on a face image capable of providing
  • the problem to be solved by the present invention is to determine the customer's health condition according to customer information including the customer's face image, and based on this, to provide a customer-tailored complex service including customized beverages optimized for the customer's facial image.
  • the present invention provides a customer information acquisition step of receiving customer information including a customer's face image, bio information, and survey information from the outside; a facial feature extraction step of extracting facial features of the customer from the face image; a constitutional feature calculation step of calculating constitutional characteristics of the customer based on the facial features and the questionnaire information; a health state calculation step of calculating health state information of the customer based on the facial features and the bio information;
  • a basic recipe calculation step of calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics provides a method for providing a customer-customized complex service based on a face image.
  • the customer-customized composite service providing method may further include a modified recipe calculation step of calculating a modified customized beverage modified recipe by reflecting the customer's additional request input from the outside.
  • the additional request may include at least one of a required sugar level for the customized beverage and flavoring information to be added to the customized beverage.
  • the additional request is at least one functional information among diet, skin beauty, and immunity enhancement
  • the customized beverage modified recipe may include at least one additional material corresponding to the functional information.
  • the customer-customized composite service providing method may further include an additional service providing step of providing additional service information including at least one of beauty information and cosmetic information based on the facial features and constitutional features.
  • the present invention provides a customer information receiver receiving customer information including a customer's face image, bio information, and survey information from the outside; a feature extraction unit extracting facial features of the customer from the face image and then calculating constitutional characteristics of the customer based on the facial features and the questionnaire information; a health state calculation unit that calculates health state information of the customer based on the facial features and the bio information;
  • a customer-customized composite service providing system based on a face image including a recipe calculation unit for calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics is provided.
  • the recipe calculation unit may calculate a corrected customized beverage recipe by reflecting the customer's additional request input from the outside.
  • the customer-customized composite service providing system may further include an additional service provider providing additional service information including at least one of beauty information and cosmetics information based on the facial features and constitutional features.
  • a system and method for providing a customer-customized complex service based on a face image determines the health condition of a customer according to customer information including a face image, and based on this, provides a customized drink optimized for the customer. It has the advantage of being able to provide complex services.
  • the customer-customized complex service providing system considers the customer's health condition and constitution, and at the same time, various requirements of the customer, for example, diet, skin care, immunity increase, sugar content of the customized drink, flavor of the customized drink It has the advantage of being able to provide customized beverages that reflect customer needs.
  • the customer-customized composite service providing system includes an artificial intelligence learning module that learns based on data including the customer's health condition information, customized beverage basic recipe, and additional service information obtained from external experts when necessary. Having it equipped has the advantage of being able to provide more accurate and customized complex services to customers.
  • FIG. 1 is a block diagram showing the configuration of a customer-customized composite service providing system based on a face image according to the present invention.
  • FIG. 2 is a diagram showing the flow of a method for providing a customer-customized composite service based on a face image according to the present invention.
  • FIG. 3 is a diagram showing a detailed flow of a state of health calculation step in the providing method of FIG. 2 .
  • customer information input device 210 customer information receiver
  • recipe calculation unit 250 additional service provision unit
  • first data storage unit 270 second data storage unit
  • third data storage unit 290 manufacturing platform
  • FIGS. 1 to 4 a system and method for providing a customer-customized composite service based on a facial image according to an embodiment of the present invention will be described as follows.
  • the customer-customized composite service providing system may provide a customer-customized composite service including a service of providing a customized drink tailored to the customer based on the customer's face image through store or online sales.
  • the customized beverage may include herbal beverages, tea beverages, health functional beverages, and the like.
  • the customer-customized composite service providing system includes a customer information receiving unit 210, a feature extraction unit 220, a health condition calculation unit 230, a recipe calculation unit 240, a first data storage unit 260, and a second data storage unit. (270).
  • the customer information reception unit 210 receives customer information including the customer's face image 10, bio information 20, and survey information 30 from the external customer information input device 100. That is, a customer information acquisition step of obtaining customer information by the customer information receiving unit 210 is performed (S100).
  • the customer information input device 100 includes a smart phone, and a customized service application for receiving a customized complex service may be installed on the customer's smart phone.
  • the customer's face image 10 is generated by the camera provided in the smart phone and then transmitted to the customer information receiving unit 210. It is preferable that the customer's face image is an image of the front of the customer's face.
  • the customer's bio information 20 may be the customer's body information, for example, pulse rate. Specifically, the pulse rate may be the customer's pulse rate for 1 minute.
  • the customer's bio information 20 may be measured by a bio-signal measurer provided in a smart watch linked with a smart phone, and then transmitted from the smart phone to the customer information receiving unit 210 .
  • the corresponding bio information may be transmitted to the customer information receiving unit 210 .
  • the customer's survey information 30 may include survey contents for determining the Sasang constitution.
  • the survey information 30 may include the customer's physical characteristics including height, weight, body type, etc., physiological characteristics, voice, habit, personality, temperament, and the like of the customer.
  • the survey information 30 may be provided in a form in which a customer checks a checklist given to the customer. For example, survey information input by a customer on a customized service application installed in a smart phone may be transmitted to the customer information receiving unit 210 .
  • the corresponding customer information may be transmitted to the customer information receiving unit 210 .
  • customer information may be transmitted to the customer information receiving unit 210 through the customer information input device installed in the store even when the customized service application is not installed on the customer's smart phone.
  • the customer information input device 100 installed in the store may include an image capture unit, a survey information input unit, and a biosignal measurement unit.
  • the feature extractor 220 may extract facial features of the customer from the face image. That is, the facial feature extraction step may be performed by the feature extractor 220 (S200).
  • the feature extraction unit 220 may extract facial features of the face image based on skin conditions (skin tone, wrinkles, melasma, freckles, pore conditions, wounds, etc.) appearing in the face image.
  • the feature extractor 220 may generate color coordinate information for a specific region of the face image.
  • the specific area may mean a position related to the health state of a human organ in the face image.
  • the feature extraction unit 220 may calculate the constitutional characteristics of the customer based on the extracted facial features and questionnaire information. That is, the constitutional feature extraction step may be performed by the feature extractor 220 (S300).
  • the customer's constitutional characteristics may mean the Sasang constitution according to Sasang medicine.
  • the feature extraction unit 220 may calculate the Sasang constitution closest to the customer's constitution by comparing the reference facial features and standard questionnaire information according to the Sasang constitution with the acquired facial characteristics and questionnaire information. In addition, the feature extraction unit 220 may calculate the constitutional characteristics of the customer through artificial intelligence learning.
  • the customer-customized composite service providing system may further include an image correction unit (not shown) that receives the face image stored in the customer information receiving unit 210 and corrects it to meet a preset reference image condition.
  • an image correction unit (not shown) that receives the face image stored in the customer information receiving unit 210 and corrects it to meet a preset reference image condition.
  • the image compensator may correct the size, resolution, etc. of the acquired face image so that it becomes a reference image condition.
  • the image correction unit may perform artifact removal and color modulation correction by reflected light on the input face image.
  • the health state calculation unit 230 may calculate health state information of the customer based on customer characteristic information including facial features and bio information. That is, the health state calculation step may be performed by the health state calculation unit 230 (S400).
  • the health state calculation unit 230 includes a first artificial intelligence learning module (not shown), and the first artificial intelligence learning module may calculate health state information of the customer based on customer characteristic information through artificial intelligence learning. .
  • the first artificial intelligence learning module compares the obtained customer characteristic information with the judgment standard information previously stored in the first data storage unit 260 to compare the customer characteristic information and the judgment standard. Comparative similarity of information can be calculated (S410).
  • the first artificial intelligence learning module compares the calculated comparative similarity with a pre-set standard similarity, and if the comparative similarity is greater than or equal to the standard similarity, outputs health status information matched with the corresponding criterion information as health status information of the customer (S420). , S440).
  • the first data storage unit 260 stores judgment standard information and health status information matching the judgment standard information.
  • the first artificial intelligence learning module acquires health status information about the customer through an expert access server (not shown) and then outputs the health status information of the customer (S420, S430, S440).
  • the first artificial intelligence learning module transmits customer information including the customer's face image 10, bio information 20, and survey information 30 to the expert access server when the comparative similarity is smaller than the reference similarity, , When the expert's answer is completed, the customer's health condition information is received from the expert access server and printed out.
  • the expert is limited to those who are permitted to access the expert access server, and the expert can input health condition information of the customer into the corresponding expert access server based on the customer information transmitted to the expert.
  • the health status information of the customer transmitted from the expert access server and the customer characteristic information of the corresponding customer are transmitted to and stored in the first data storage unit 260, and the first artificial intelligence learning module is stored in the first data storage unit 260. You can learn based on updated data.
  • the recipe calculation unit 240 may calculate a basic recipe for customized drinks based on the customer's health state information and constitutional characteristics. That is, a basic recipe calculation step may be performed by the recipe calculation unit 240 (S500).
  • the recipe calculation unit includes a second artificial intelligence learning module (not shown), and the second artificial intelligence learning module calculates a basic recipe for a customized beverage based on the customer's health status information and constitutional characteristics through artificial intelligence learning.
  • the second artificial intelligence learning module may calculate a customized beverage basic recipe through substantially the same process as the first artificial intelligence learning module.
  • the customer's health condition information and a basic recipe for customized beverages according to constitutional characteristics are stored in advance.
  • the recipe calculation unit 240 may reflect the customer's additional request 40 input from the outside to calculate a corrected customized beverage modified recipe (S600).
  • the additional request 40 may include at least one of the required sugar level for the customized beverage and the spice information to be added to the customized beverage.
  • the customized beverage modified recipe may include at least one type of additional material corresponding to the required sugar level and flavor.
  • the additional request 40 may include at least one function information among diet, skin care, and immunity enhancement.
  • the customized beverage modified recipe may include at least one type of additional material corresponding to the functional information.
  • the additional request 40 is included in customer information, and may be transmitted together when the customer's face image 10, survey information 30, and bio information 20 are transmitted to the customer information receiving unit 210.
  • the customer-customized complex service providing system may further include a third data storage unit 280 and an additional service providing unit 250.
  • the additional service providing unit 250 may provide additional service information including at least one of beauty information and cosmetic information based on the customer's facial and constitutional characteristics. That is, an additional service providing step may be performed by the additional service providing unit 250 (S700).
  • the additional service provider 250 includes a third artificial intelligence learning module (not shown), and the third artificial intelligence learning module provides beauty information, beauty information, and Additional service information including cosmetic information may be provided.
  • the third artificial intelligence learning module may provide additional service information through substantially the same process as the first artificial intelligence learning module.
  • beauty information, cosmetics information, etc. according to the customer's facial characteristics and constitutional characteristics are stored in advance.
  • the additional service providing unit 250 transmits beauty information and cosmetics information according to the customer's facial and constitutional characteristics to the customer's smart phone, thereby executing the additional service.
  • the customer-customized complex service providing system determines the customer's health condition according to customer information including the customer's face image, and provides customized beverages optimized for the customer's health condition and constitution based on this. be able to
  • the customer-customized complex service providing system considers the customer's health condition and constitution, and at the same time, various requirements of the customer, for example, diet, skin care, immunity increase, sugar content of the customized drink, flavor of the customized drink It has the advantage of being able to provide customized beverages that reflect customer needs.
  • the customer-customized composite service providing system includes an artificial intelligence learning module that learns based on data including the customer's health condition information, customized beverage basic recipe, and additional service information obtained from external experts when necessary. Having it equipped has the advantage of being able to provide more accurate and customized complex services to customers.
  • the customer-customized composite service providing system may further include a manufacturing platform 290 having a platform control unit 291 for manufacturing a customized beverage.
  • the manufacturing platform 290 is provided with materials for manufacturing customized beverages.
  • each of the materials may be stored and stored in a concentrated liquefied state.
  • herbal medicines used in the case of providing an herbal beverage as a customized beverage may be stored and stored in a concentrated liquefied state.
  • the customized beverage manufacturing platform 290 allows the customized beverage to be manufactured according to the order and amount of the recipe. to control the components of
  • the first lamp interlocking with the first valve through which the basic beverage is discharged blinks, and when the manufacturer opens the first valve, the basic beverage A set amount of can be discharged. Thereafter, when the first lamp is turned off, the second lamp associated with the second valve through which the first material is discharged blinks, and when the manufacturer opens the second valve, the set amount of the first material may be discharged.
  • the platform control unit 291 may control the lighting sequence of lamps, types of basic beverages and ingredients, and set amounts based on the recipe.
  • the present invention is not limited thereto, and the manufacturer may manufacture a customized beverage while manually manipulating the manufacturing platform based on the corresponding recipe.
  • the present invention determines the customer's health condition according to customer information including the customer's face image, and based on this, provides a customer-specific complex service including a customized beverage optimized for the customer based on the customer's face image It can be used industrially in the field of customized composite service provision system technology.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Primary Health Care (AREA)
  • Epidemiology (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Pathology (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • Data Mining & Analysis (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Tourism & Hospitality (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Databases & Information Systems (AREA)
  • Veterinary Medicine (AREA)
  • Economics (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Animal Behavior & Ethology (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Biophysics (AREA)
  • Dentistry (AREA)
  • Medical Treatment And Welfare Office Work (AREA)

Abstract

The present invention relates to a system and method for providing customer-tailored complex services based on a face image, capable of determining a customer's health status on the basis of customer information, including the customer's face image, and providing customer-tailored complex services including a customized beverage optimized for the customer, on the basis of the health status. To this end, the present invention provides a system and method for providing customer-tailored complex services based on a face image, the method comprising: a customer information acquisition step for receiving customer information including a customer's face image, bio-information, and survey information from an external source; a facial feature extraction step for extracting facial features of the customer from the face image; a physiological constitution feature derivation step for deriving physiological constitution features of the customer on the basis of the facial features and the survey information; a health status derivation step for deriving health status information of the customer on the basis of the facial features and the bio-information; and a basic recipe derivation step for deriving a basic recipe for a customized beverage on the basis of the health status information and the physiological constitution features.

Description

얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템 및 방법System and method for providing customer-customized complex services based on facial images
본 발명은 고객 맞춤형 복합 서비스 제공 시스템 및 방법에 관한 것으로서, 고객의 얼굴 이미지를 포함하는 고객정보에 따라 고객의 건강상태를 판단하고, 이를 바탕으로 고객에게 최적화된 맞춤음료를 포함하는 고객 맞춤형 복합 서비스를 제공할 수 있는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템 및 방법에 관한 것이다.The present invention relates to a system and method for providing a customer-customized complex service, which includes a customer-customized complex service that determines a customer's health condition according to customer information including a customer's face image and, based on this, provides a customized beverage optimized for the customer. It relates to a system and method for providing a customer-customized composite service based on a face image capable of providing
현대 사회에서는 건강에 대한 관심이 나날이 증가하고 있다. 이러한 시대적인 관심과 더불어, 실시간 데이터 수집에 의한 데이터 분석 방식 및 툴(tool)이 고도화되는 등 기술이 비약적으로 발전함에 따라서, 건강 상태를 모니터링하고 개인화된 건강관리 서비스를 제공받는 것이 가능하게 되었다.In modern society, interest in health is increasing day by day. In addition to this interest of the times, as technology has rapidly developed, such as data analysis methods and tools by real-time data collection, it has become possible to monitor health conditions and receive personalized health care services.
소비자의 의식 변화에 따른 고객 요구의 다양화와 기대수준의 향상으로 건강 서비스 및 관련 시스템 이용의 편리성 및 맞춤화가 강화되고 있는 추세이다.Convenience and customization of health services and related systems are being strengthened due to the diversification of customer needs and the improvement of expectations according to the change in consumer consciousness.
특히, 생활수준의 향상과 함께 삶의 질과 웰빙에 대한 관심이 증대하면서 개인의 건강 데이터를 바탕으로 생활 습관병 예방이나 체중관리 등의 개인화 건강관리에 대한 요구가 증가하고 있다.In particular, as interest in quality of life and well-being increases with the improvement of living standards, there is an increasing demand for personalized health management such as prevention of lifestyle-related diseases or weight management based on personal health data.
본 발명의 해결하고자 하는 과제는 고객의 얼굴 이미지를 포함하는 고객정보에 따라 고객의 건강상태를 판단하고, 이를 바탕으로 고객에게 최적화된 맞춤음료를 포함하는 고객 맞춤형 복합 서비스를 제공할 수 있는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템 및 방법을 제공하는 것이다.The problem to be solved by the present invention is to determine the customer's health condition according to customer information including the customer's face image, and based on this, to provide a customer-tailored complex service including customized beverages optimized for the customer's facial image. To provide a system and method for providing customer-customized complex services based on
본 발명이 해결하고자 하는 과제는 이상에서 언급한 과제로 제한되지 않으며, 언급되지 않은 또 다른 과제들은 아래의 기재로부터 본 발명이 속하는 기술 분야에서 통상의 지식을 가진 자에게 명확하게 이해될 수 있을 것이다.The problem to be solved by the present invention is not limited to the problems mentioned above, and other problems not mentioned will be clearly understood by those skilled in the art from the description below. .
상술한 과제를 해결하기 위하여, 본 발명은 고객의 얼굴 이미지, 바이오정보 및 설문정보를 포함하는 고객정보를 외부로부터 전달받는 고객정보 획득단계; 상기 얼굴 이미지로부터 상기 고객의 안면특징을 추출하는 안면특징 추출단계; 상기 안면특징과 상기 설문정보를 바탕으로 상기 고객의 체질특징을 산출하는 체질특징 산출단계; 상기 안면특징 및 상기 바이오정보를 바탕으로 상기 고객의 건강상태정보를 산출하는 건강상태 산출단계; 그리고, 상기 건강상태정보 및 상기 체질특징을 바탕으로 하는 맞춤음료 기본 레시피를 산출하는 기본 레시피 산출단계;를 포함하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공방법을 제공한다.In order to solve the above problems, the present invention provides a customer information acquisition step of receiving customer information including a customer's face image, bio information, and survey information from the outside; a facial feature extraction step of extracting facial features of the customer from the face image; a constitutional feature calculation step of calculating constitutional characteristics of the customer based on the facial features and the questionnaire information; a health state calculation step of calculating health state information of the customer based on the facial features and the bio information; In addition, a basic recipe calculation step of calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics; provides a method for providing a customer-customized complex service based on a face image.
상기 고객 맞춤형 복합 서비스 제공방법은 외부로부터 입력된 상기 고객의 추가 요청사항을 반영하여 보정된 맞춤음료 수정 레시피를 산출하는 수정 레시피 산출단계를 더 포함할 수 있다.The customer-customized composite service providing method may further include a modified recipe calculation step of calculating a modified customized beverage modified recipe by reflecting the customer's additional request input from the outside.
상기 추가 요청사항은 상기 맞춤음료에 대한 요구당도, 상기 맞춤음료에 추가되어야 할 향료정보 중 적어도 하나를 포함할 수 있다.The additional request may include at least one of a required sugar level for the customized beverage and flavoring information to be added to the customized beverage.
또한, 상기 추가 요청사항은 다이어트, 피부미용, 면역력 증강 중 적어도 하나의 기능성 정보이며, 상기 맞춤음료 수정 레시피는 상기 기능성 정보에 대응되는 적어도 한 종류의 추가재료를 포함할 수 있다.In addition, the additional request is at least one functional information among diet, skin beauty, and immunity enhancement, and the customized beverage modified recipe may include at least one additional material corresponding to the functional information.
상기 고객 맞춤형 복합 서비스 제공방법은 상기 안면특징 및 상기 체질특징을 바탕으로 하는 미용정보, 화장품 정보 중 적어도 하나를 포함하는 추가 서비스정보를 제공하는 추가 서비스 제공단계를 더 포함할 수 있다.The customer-customized composite service providing method may further include an additional service providing step of providing additional service information including at least one of beauty information and cosmetic information based on the facial features and constitutional features.
본 발명의 다른 실시 형태에 따르면, 본 발명은 고객의 얼굴 이미지, 바이오정보 및 설문정보를 포함하는 고객정보를 외부로부터 전달받는 고객정보 수신부; 상기 얼굴 이미지로부터 상기 고객의 안면특징을 추출한 후 상기 안면특징과 상기 설문정보를 바탕으로 상기 고객의 체질특징을 산출하는 특징 추출부; 상기 안면특징 및 상기 바이오정보를 바탕으로 상기 고객의 건강상태정보를 산출하는 건강상태 산출부; 그리고, 상기 건강상태정보 및 상기 체질특징을 바탕으로 하는 맞춤음료 기본 레시피를 산출하는 레시피 산출부를 포함하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템을 제공한다.According to another embodiment of the present invention, the present invention provides a customer information receiver receiving customer information including a customer's face image, bio information, and survey information from the outside; a feature extraction unit extracting facial features of the customer from the face image and then calculating constitutional characteristics of the customer based on the facial features and the questionnaire information; a health state calculation unit that calculates health state information of the customer based on the facial features and the bio information; In addition, a customer-customized composite service providing system based on a face image including a recipe calculation unit for calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics is provided.
상기 레시피 산출부는 외부로부터 입력된 상기 고객의 추가 요청사항을 반영하여 보정된 맞춤음료 수정 레시피를 산출할 수 있다.The recipe calculation unit may calculate a corrected customized beverage recipe by reflecting the customer's additional request input from the outside.
상기 고객 맞춤형 복합 서비스 제공시스템은 상기 안면특징 및 체질특징을 바탕으로 하는 미용정보, 화장품 정보 중 적어도 하나를 포함하는 추가 서비스정보를 제공하는 추가 서비스 제공부를 더 포함할 수 있다.The customer-customized composite service providing system may further include an additional service provider providing additional service information including at least one of beauty information and cosmetics information based on the facial features and constitutional features.
본 발명에 따른 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템 및 방법은 얼굴 이미지를 포함하는 고객정보에 따라 고객의 건강상태를 판단하고, 이를 바탕으로 고객에게 최적화된 맞춤음료를 포함하는 고객 맞춤형 복합 서비스를 제공할 수 있는 장점을 가진다.A system and method for providing a customer-customized complex service based on a face image according to the present invention determines the health condition of a customer according to customer information including a face image, and based on this, provides a customized drink optimized for the customer. It has the advantage of being able to provide complex services.
또한, 본 발명에 따른 고객 맞춤형 복합 서비스 제공 시스템은 고객의 건상상태와 체질을 고려함과 동시에 고객의 다양한 요구사항, 예를 들면, 다이어트, 피부미용, 면역력 증가, 맞춤음료의 당도, 맞춤음료의 향 등을 반영한 고객 맞춤형 맞춤음료를 제공할 수 있는 장점을 가진다.In addition, the customer-customized complex service providing system according to the present invention considers the customer's health condition and constitution, and at the same time, various requirements of the customer, for example, diet, skin care, immunity increase, sugar content of the customized drink, flavor of the customized drink It has the advantage of being able to provide customized beverages that reflect customer needs.
뿐만 아니라, 본 발명에 따른 고객 맞춤형 복합 서비스 제공 시스템은 필요한 경우에 외부 전문가로부터 획득된 고객의 건상상태정보, 맞춤음료 기본 레시피, 추가 서비스정보를 포함하는 데이터를 바탕으로 학습하는 인공지능 학습모듈을 구비함으로써 고객에게 보다 정확한 맞춤형 복합서비스를 제공할 수 있는 장점을 가진다.In addition, the customer-customized composite service providing system according to the present invention includes an artificial intelligence learning module that learns based on data including the customer's health condition information, customized beverage basic recipe, and additional service information obtained from external experts when necessary. Having it equipped has the advantage of being able to provide more accurate and customized complex services to customers.
본 발명의 효과는 상기한 효과로 한정되는 것은 아니며, 본 발명의 상세한 설명 또는 청구범위에 기재된 발명의 구성으로부터 추론 가능한 모든 효과를 포함하는 것으로 이해되어야 한다.The effects of the present invention are not limited to the above effects, and should be understood to include all effects that can be inferred from the detailed description of the present invention or the configuration of the invention described in the claims.
도 1은 본 발명에 따른 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템의 구성을 나타낸 블럭도이다.1 is a block diagram showing the configuration of a customer-customized composite service providing system based on a face image according to the present invention.
도 2는 본 발명에 따른 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 방법의 흐름을 나타낸 도면이다.2 is a diagram showing the flow of a method for providing a customer-customized composite service based on a face image according to the present invention.
도 3은 도 2의 제공방법 중 건상상태 산출단계에 대한 세부 흐름을 나타내는 도면이다.FIG. 3 is a diagram showing a detailed flow of a state of health calculation step in the providing method of FIG. 2 .
<도면의 주요 부분에 대한 부호의 설명><Description of symbols for main parts of drawings>
100: 고객정보 입력장치 210: 고객정보 수신부100: customer information input device 210: customer information receiver
220: 특징 추출부 230: 건강상태 산출부220: feature extraction unit 230: health condition calculation unit
240: 레시피 산출부 250: 추가 서비스 제공부240: recipe calculation unit 250: additional service provision unit
260: 제1 데이터 저장부 270: 제2 데이터 저장부260: first data storage unit 270: second data storage unit
280: 제3 데이터 저장부 290: 제조 플랫폼280: third data storage unit 290: manufacturing platform
이하, 상술한 해결하고자 하는 과제가 구체적으로 실현될 수 있는 본 발명의 바람직한 실시 예들이 첨부된 도면을 참조하여 설명된다. 본 실시 예들을 설명함에 있어서, 동일 구성에 대해서는 동일 명칭 및 동일 부호가 사용되며 이에 따른 부가적인 설명은 하기에서 생략된다.Hereinafter, preferred embodiments of the present invention in which the above-described problem to be solved can be specifically realized will be described with reference to the accompanying drawings. In describing the present embodiments, the same names and the same reference numerals are used for the same components, and additional descriptions thereof are omitted below.
명세서 전체에서, 어떤 부분이 다른 부분과 “연결(접속, 접촉, 결합)”되어 있다고 할 때, 이는 “직접적으로 연결”되어 있는 경우뿐 아니라, 그 중간에 다른 부재를 사이에 두고 “간접적으로 연결”되어 있는 경우도 포함한다. 또한 어떤 부분이 어떤 구성요소를 “포함”한다고 할 때, 이는 특별히 반대되는 기재가 없는 한 다른 구성요소를 제외하는 것이 아니라 다른 구성요소를 더 구비할 수 있다는 것을 의미한다.Throughout the specification, when a part is said to be “connected (connected, contacted, combined)” with another part, it is not only “directly connected”, but also “indirectly connected” with another member in between. ”Including cases where it is. In addition, when a certain component is said to "include", this means that it may further include other components without excluding other components unless otherwise stated.
본 명세서에서 사용한 용어는 단지 특정한 실시예를 설명하기 위해 사용된 것으로, 본 발명을 한정하려는 의도가 아니다. 단수의 표현은 문맥상 명백하게 다르게 뜻하지 않는 한, 복수의 표현을 포함한다. 본 명세서에서, “포함하다”또는 “가지다”등의 용어는 명세서상에 기재된 특징, 숫자, 단계, 동작, 구성요소, 부품 또는 이들을 조합한 것이 존재함을 지정하려는 것이지, 하나 또는 그 이상의 다른 특징들이나 숫자, 단계, 동작, 구성요소, 부품 또는 이들을 조합한 것들의 존재 또는 부가 가능성을 미리 배제하지 않는 것으로 이해되어야 한다.Terms used in this specification are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this specification, terms such as “include” or “having” are intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, but one or more other features It should be understood that the presence or addition of numbers, steps, operations, components, parts, or combinations thereof is not precluded.
도 1 내지 도 4를 참조하여, 본 발명의 일 실시예에 따른 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템 및 방법을 설명하면 다음과 같다.Referring to FIGS. 1 to 4 , a system and method for providing a customer-customized composite service based on a facial image according to an embodiment of the present invention will be described as follows.
본 실시 예에 따른 고객 맞춤형 복합 서비스 제공시스템은 고객의 얼굴 이미지를 바탕으로 고객에 맞는 맞춤음료를 제공하는 서비스를 포함하는 고객 맞춤형 복합 서비스를 매장 또는 온라인 판매를 통하여 제공할 수 있다. 여기서, 맞춤음료는 한방음료, 차음료, 건강 기능성음료 등을 포함할 수 있다.The customer-customized composite service providing system according to the present embodiment may provide a customer-customized composite service including a service of providing a customized drink tailored to the customer based on the customer's face image through store or online sales. Here, the customized beverage may include herbal beverages, tea beverages, health functional beverages, and the like.
고객 맞춤형 복합 서비스 제공시스템은 고객정보 수신부(210), 특징 추출부(220), 건강상태 산출부(230), 레시피 산출부(240), 제1 데이터 저장부(260) 및 제2 데이터 저장부(270)를 포함할 수 있다.The customer-customized composite service providing system includes a customer information receiving unit 210, a feature extraction unit 220, a health condition calculation unit 230, a recipe calculation unit 240, a first data storage unit 260, and a second data storage unit. (270).
고객정보 수신부(210)는 고객의 얼굴 이미지(10), 바이오 정보(20) 및 설문정보(30)를 포함하는 고객정보를 외부의 고객정보 입력장치(100)로부터 전달받게 된다. 즉, 고객정보 수신부(210)에 의하여 고객정보를 획득하는 고객정보 획득단계가 수행된다(S100).The customer information reception unit 210 receives customer information including the customer's face image 10, bio information 20, and survey information 30 from the external customer information input device 100. That is, a customer information acquisition step of obtaining customer information by the customer information receiving unit 210 is performed (S100).
고객정보 입력장치(100)는 스마트 폰을 포함하며, 고객의 스마트 폰에는 고객 맞춤형 복합 서비스를 제공받기 위한 맞춤형 서비스 어플리케이션이 설치될 수 있다.The customer information input device 100 includes a smart phone, and a customized service application for receiving a customized complex service may be installed on the customer's smart phone.
고객의 얼굴 이미지(10)는 스마트 폰에 구비된 카메라에 의하여 생성된 후 고객정보 수신부(210)로 전송된다. 고객의 얼굴 이미지는 얼굴의 전면을 촬영한 이미지인 것이 바람직하다.The customer's face image 10 is generated by the camera provided in the smart phone and then transmitted to the customer information receiving unit 210. It is preferable that the customer's face image is an image of the front of the customer's face.
고객의 바이오 정보(20)는 고객의 신체 정보, 예를 들면 맥박수일 수 있다. 구체적으로, 맥박수는 1분 동안의 고객의 맥박수일 수 있다. 고객의 바이오 정보(20)는 스마트 폰과 연동되는 스마트 와치(watch)에 구비된 생체신호 측정기에 의하여 측정된 후 스마트 폰에서 고객정보 수신부(210)로 전송될 수 있다. The customer's bio information 20 may be the customer's body information, for example, pulse rate. Specifically, the pulse rate may be the customer's pulse rate for 1 minute. The customer's bio information 20 may be measured by a bio-signal measurer provided in a smart watch linked with a smart phone, and then transmitted from the smart phone to the customer information receiving unit 210 .
물론, 고객이 별도의 생체신호 측정장치에서 측정된 바이오 정보를 스마트 폰의 애플리케이션에 입력함으로써 해당 바이오정보가 고객정보 수신부(210)로 전송될 수도 있을 것이다.Of course, when a customer inputs bio information measured by a separate bio-signal measuring device into an application of a smart phone, the corresponding bio information may be transmitted to the customer information receiving unit 210 .
고객의 설문정보(30)는 사상체질을 판단하기 위한 설문내용을 포함할 수 있다. 예를 들면, 설문정보(30)는 고객의 키, 몸무게, 체형 등을 포함하는 신체적 특징, 생리적 특징, 고객의 음성, 습관, 성격, 기질 등을 포함할 수 있다.The customer's survey information 30 may include survey contents for determining the Sasang constitution. For example, the survey information 30 may include the customer's physical characteristics including height, weight, body type, etc., physiological characteristics, voice, habit, personality, temperament, and the like of the customer.
설문정보(30)는 고객에게 주어진 체크리스트에서 고객이 체크하는 형태로 주어질 수 있다. 일례로, 스마트 폰에 설치된 맞춤형 서비스 어플리케이션 상에서 고객에 의하여 입력된 설문정보가 고객정보 수신부(210)로 전송될 수 있다.The survey information 30 may be provided in a form in which a customer checks a checklist given to the customer. For example, survey information input by a customer on a customized service application installed in a smart phone may be transmitted to the customer information receiving unit 210 .
결과적으로, 고객이 스마트 폰의 맞춤형 서비스 어플리케이션에 고객정보를 입력하면 해당 고객정보는 고객정보 수신부(210)로 전송될 수 있다. As a result, when a customer inputs customer information into a customized service application of a smart phone, the corresponding customer information may be transmitted to the customer information receiving unit 210 .
물론, 고객의 스마트 폰에 맞춤형 서비스 어플리케이션이 설치되어 있지 않는 경우에도 매장에 설치된 고객정보 입력장치를 통하여 고객정보가 고객정보 수신부(210)로 전송될 수 있다. 매장에 설치된 고객정보 입력장치(100)는 영상 촬영유닛, 설문정보 입력유닛, 생체신호 측정유닛을 포함할 수 있다.Of course, customer information may be transmitted to the customer information receiving unit 210 through the customer information input device installed in the store even when the customized service application is not installed on the customer's smart phone. The customer information input device 100 installed in the store may include an image capture unit, a survey information input unit, and a biosignal measurement unit.
특징 추출부(220)는 얼굴 이미지로부터 고객의 안면특징을 추출할 수 있다. 즉, 특징 추출부(220)에 의하여 안면특징 추출단계가 수행될 수 있다(S200).The feature extractor 220 may extract facial features of the customer from the face image. That is, the facial feature extraction step may be performed by the feature extractor 220 (S200).
구체적으로, 특징 추출부(220)는 얼굴 이미지에 나타난 피부상태(피부톤, 주름, 기미, 주근깨, 모공상태, 상처 등)를 바탕으로 얼굴 이미지의 안면특징을 추출할 수 있다. 예를 들면, 특징 추출부(220)는 얼굴 이미지 중 특정 영역에 대한 색좌표 정보를 생성할 수 있다. 여기서, 특정 영역은 얼굴 이미지 중에서 인체 장기의 건강 상태와 관련된 위치를 의미할 수 있다.Specifically, the feature extraction unit 220 may extract facial features of the face image based on skin conditions (skin tone, wrinkles, melasma, freckles, pore conditions, wounds, etc.) appearing in the face image. For example, the feature extractor 220 may generate color coordinate information for a specific region of the face image. Here, the specific area may mean a position related to the health state of a human organ in the face image.
또한, 특징 추출부(220)는 추출된 안면특징과 설문정보를 바탕으로 고객의 체질특징을 산출할 수 있다. 즉, 특징 추출부(220)에 의하여 체질특징 추출단계가 수행될 수 있다(S300). 여기서, 고객의 체질특징은 사상의학에 따른 사상체질을 의미할 수 있다.In addition, the feature extraction unit 220 may calculate the constitutional characteristics of the customer based on the extracted facial features and questionnaire information. That is, the constitutional feature extraction step may be performed by the feature extractor 220 (S300). Here, the customer's constitutional characteristics may mean the Sasang constitution according to Sasang medicine.
구체적으로, 특징 추출부(220)는 사상체질에 따른 기준 안면특징 및 기준 설문정보와, 획득된 안면특징 및 설문정보를 비교하여 고객의 체질에 가장 가까운 사상체질을 산출할 수 있다. 또한, 특징 추출부(220)는 인공지능 학습을 통하여 고객의 체질특징을 산출할 수 있다. Specifically, the feature extraction unit 220 may calculate the Sasang constitution closest to the customer's constitution by comparing the reference facial features and standard questionnaire information according to the Sasang constitution with the acquired facial characteristics and questionnaire information. In addition, the feature extraction unit 220 may calculate the constitutional characteristics of the customer through artificial intelligence learning.
본 실시 예에 따른 고객 맞춤형 복합 서비스 제공시스템은 고객정보 수신부(210)에 저장된 얼굴 이미지를 전달 받아 미리 설정된 기준 이미지 조건에 맞도록 보정하는 이미지 보정부(미도시)를 더 포함할 수 있다.The customer-customized composite service providing system according to the present embodiment may further include an image correction unit (not shown) that receives the face image stored in the customer information receiving unit 210 and corrects it to meet a preset reference image condition.
이미지 보정부는 획득된 얼굴 이미지에 대하여 기준 이미지 조건이 되도록 이미지의 크기, 해상도 등을 보정할 수 있다. 뿐만 아니라, 이미지 보정부는 입력된 얼굴 이미지에 대하여 아티팩트(artifact) 제거, 반사광에 의한 색 변조 보정을 수행할 수 있다.The image compensator may correct the size, resolution, etc. of the acquired face image so that it becomes a reference image condition. In addition, the image correction unit may perform artifact removal and color modulation correction by reflected light on the input face image.
한편, 건강상태 산출부(230)는 안면특징 및 바이오정보를 포함하는 고객특징정보를 바탕으로 고객의 건강상태정보를 산출할 수 있다. 즉, 건강상태 산출부(230)에 의하여 건강상태 산출단계가 수행될 수 있다(S400).Meanwhile, the health state calculation unit 230 may calculate health state information of the customer based on customer characteristic information including facial features and bio information. That is, the health state calculation step may be performed by the health state calculation unit 230 (S400).
건강상태 산출부(230)는 제1 인공지능 학습모듈(미도시)을 포함하고, 제1 인공지능 학습모듈은 인공지능 학습을 통하여 고객특징정보를 바탕으로 고객의 건강상태정보를 산출할 수 있다. The health state calculation unit 230 includes a first artificial intelligence learning module (not shown), and the first artificial intelligence learning module may calculate health state information of the customer based on customer characteristic information through artificial intelligence learning. .
구체적으로, 제1 인공지능 학습모듈은, 도 3에 도시된 바와 같이, 획득된 고객특징정보와 제1 데이터 저장부(260)에 미리 저장되어 있는 판단기준정보를 비교하여 고객특징정보와 판단기준정보의 비교유사도를 산출할 수 있다(S410).Specifically, as shown in FIG. 3, the first artificial intelligence learning module compares the obtained customer characteristic information with the judgment standard information previously stored in the first data storage unit 260 to compare the customer characteristic information and the judgment standard. Comparative similarity of information can be calculated (S410).
제1 인공지능 학습모듈은 산출된 비교유사도와 미리 설정된 기준유사도를 비교하고, 비교유사도가 기준유사도 보다 크거나 같으면 해당 판단기준정보와 매칭되는 건강상태정보를 고객의 건강상태정보로 출력한다(S420, S440).The first artificial intelligence learning module compares the calculated comparative similarity with a pre-set standard similarity, and if the comparative similarity is greater than or equal to the standard similarity, outputs health status information matched with the corresponding criterion information as health status information of the customer (S420). , S440).
여기서, 제1 데이터 저장부(260)에는 판단기준정보와, 판단기준정보와 매칭되는 건강상상태정보가 저장되어 있다.Here, the first data storage unit 260 stores judgment standard information and health status information matching the judgment standard information.
만약, 비교유사도가 기준유사도 보다 작으면, 제1 인공지능 학습모듈은 전문가 접근서버(미도시)를 통하여 고객에 대한 건강상태정보를 획득한 후 고객의 건강상태정보를 출력한다(S420, S430, S440).If the comparative similarity is smaller than the reference similarity, the first artificial intelligence learning module acquires health status information about the customer through an expert access server (not shown) and then outputs the health status information of the customer (S420, S430, S440).
구체적으로, 제1 인공지능 학습모듈은 비교유사도가 기준유사도 보다 작은 경우에 고객의 얼굴 이미지(10), 바이오 정보(20) 및 설문정보(30)를 포함하는 고객정보를 전문가 접근서버로 전송하고, 전문가의 답변이 완료되면 전문가 접근서버로부터 고객의 건강상태정보를 전달받아 출력하게 된다.Specifically, the first artificial intelligence learning module transmits customer information including the customer's face image 10, bio information 20, and survey information 30 to the expert access server when the comparative similarity is smaller than the reference similarity, , When the expert's answer is completed, the customer's health condition information is received from the expert access server and printed out.
여기서, 전문가는 전문가 접근서버에 접속이 허락된 자에 한하며, 전문가는 본인에게 전달된 고객정보를 바탕으로 고객의 건강상태정보를 해당 전문가 접근서버에 입력할 수 있다.Here, the expert is limited to those who are permitted to access the expert access server, and the expert can input health condition information of the customer into the corresponding expert access server based on the customer information transmitted to the expert.
전문가 접근서버로부터 전달된 고객의 건강상태정보와, 해당 고객의 고객특징정보는 제1 데이터 저장부(260)로 전송되어 저장되고, 제1 인공지능 학습모듈은제1 데이터 저장부(260)의 업데이트된 데이터들을 바탕으로 학습할 수 있다.The health status information of the customer transmitted from the expert access server and the customer characteristic information of the corresponding customer are transmitted to and stored in the first data storage unit 260, and the first artificial intelligence learning module is stored in the first data storage unit 260. You can learn based on updated data.
레시피 산출부(240)는 고객의 건강상태정보와 체질특징을 바탕으로 하는 맞춤음료 기본 레시피를 산출할 수 있다. 즉, 레시피 산출부(240)에 의하여 기본 레시피 산출단계가 수행될 수 있다(S500).The recipe calculation unit 240 may calculate a basic recipe for customized drinks based on the customer's health state information and constitutional characteristics. That is, a basic recipe calculation step may be performed by the recipe calculation unit 240 (S500).
구체적으로, 레시피 산출부는 제2 인공지능 학습모듈(미도시)을 포함하고, 제2 인공지능 학습모듈은 인공지능 학습을 통하여 고객의 건강상태정보와 체질특징을 바탕으로 맞춤음료 기본 레시피를 산출할 수 있다. Specifically, the recipe calculation unit includes a second artificial intelligence learning module (not shown), and the second artificial intelligence learning module calculates a basic recipe for a customized beverage based on the customer's health status information and constitutional characteristics through artificial intelligence learning. can
제2 인공지능 학습모듈은 제1 인공지능 학습모듈과 실질적으로 동일한 프로세스를 거치면서 맞춤음료 기본 레시피를 산출할 수 있다. 여기서, 제2 데이터 저장부(270)에는 고객의 건강상태정보 및 체질특징에 따른 맞춤음료 기본 레시피가 미리 저장되어 있다.The second artificial intelligence learning module may calculate a customized beverage basic recipe through substantially the same process as the first artificial intelligence learning module. Here, in the second data storage unit 270, the customer's health condition information and a basic recipe for customized beverages according to constitutional characteristics are stored in advance.
또한, 레시피 산출부(240)는 외부로부터 입력된 고객의 추가 요청사항(40)을 반영하여 보정된 맞춤음료 수정 레시피를 산출할 수 있다(S600).In addition, the recipe calculation unit 240 may reflect the customer's additional request 40 input from the outside to calculate a corrected customized beverage modified recipe (S600).
추가 요청사항(40)은 맞춤음료에 대한 요구당도, 맞춤음료에 추가되어야 할 향료정보 중 적어도 하나를 포함할 수 있다. 여기서, 상기 맞춤음료 수정 레시피는 상기 요구당도 및 향료에 대응되는 적어도 한 종류의 추가재료를 포함할 수 있다.The additional request 40 may include at least one of the required sugar level for the customized beverage and the spice information to be added to the customized beverage. Here, the customized beverage modified recipe may include at least one type of additional material corresponding to the required sugar level and flavor.
또한, 추가 요청사항(40)은 다이어트, 피부미용, 면역력 증강 중 적어도 하나의 기능성 정보를 포함할 수 있다. 여기서, 상기 맞춤음료 수정 레시피는 상기 기능성 정보에 대응되는 적어도 한 종류의 추가재료를 포함할 수 있다.In addition, the additional request 40 may include at least one function information among diet, skin care, and immunity enhancement. Here, the customized beverage modified recipe may include at least one type of additional material corresponding to the functional information.
추가 요청사항(40)은 고객정보에 포함되며, 고객의 얼굴 이미지(10), 설문정보(30) 및 바이오 정보(20)가 고객정보 수신부(210)로 전송될 때 함께 전송될 수 있다.The additional request 40 is included in customer information, and may be transmitted together when the customer's face image 10, survey information 30, and bio information 20 are transmitted to the customer information receiving unit 210.
한편, 본 발명에 따른 고객 맞춤형 복합 서비스 제공시스템은 제3 데이터 저장부(280) 및 추가 서비스 제공부(250)를 더 포함할 수 있다. Meanwhile, the customer-customized complex service providing system according to the present invention may further include a third data storage unit 280 and an additional service providing unit 250.
추가 서비스 제공부(250)는 고객의 안면특징 및 체질특징을 바탕으로 하는 미용정보, 화장품 정보 중 적어도 하나를 포함하는 추가 서비스정보를 제공할 수 있다. 즉, 추가 서비스 제공부(250)에 의하여 추가 서비스 제공단계가 수행될 수 있다(S700)The additional service providing unit 250 may provide additional service information including at least one of beauty information and cosmetic information based on the customer's facial and constitutional characteristics. That is, an additional service providing step may be performed by the additional service providing unit 250 (S700).
구체적으로, 추가 서비스 제공부(250)는 제3 인공지능 학습모듈(미도시)을 포함하고, 제3 인공지능 학습모듈은 인공지능 학습을 통하여 고객의 안면특징 및 체질특징을 바탕으로 미용정보, 화장품 정보를 포함하는 추가서비스 정보를 제공할 수 있다.Specifically, the additional service provider 250 includes a third artificial intelligence learning module (not shown), and the third artificial intelligence learning module provides beauty information, beauty information, and Additional service information including cosmetic information may be provided.
마찬가지로, 제3 인공지능 학습모듈은 제1 인공지능 학습모듈과 실질적으로 동일한 프로세스를 거치면서 추가서비스 정보를 제공할 수 있다. 여기서, 제3 데이터 저장부(280)에는 고객의 안면특징 및 체질특징에 따른 미용정보, 화장품 정보 등이 미리 저장되어 있다.Similarly, the third artificial intelligence learning module may provide additional service information through substantially the same process as the first artificial intelligence learning module. Here, in the third data storage unit 280, beauty information, cosmetics information, etc. according to the customer's facial characteristics and constitutional characteristics are stored in advance.
추가 서비스 제공부(250)는 고객의 안면특징 및 체질특징에 따른 미용정보 및 화장품 정보를 고객의 스마트 폰으로 전송함으로써 추가 서비스를 실행하게 된다.The additional service providing unit 250 transmits beauty information and cosmetics information according to the customer's facial and constitutional characteristics to the customer's smart phone, thereby executing the additional service.
결과적으로, 본 발명에 따른 고객 맞춤형 복합 서비스 제공 시스템은 고객의 얼굴 이미지를 포함하는 고객정보에 따라 고객의 건강상태를 판단하고, 이를 바탕으로 고객의 건상상태와 체질에 최적화된 맞춤음료를 제공할 수 있게 된다.As a result, the customer-customized complex service providing system according to the present invention determines the customer's health condition according to customer information including the customer's face image, and provides customized beverages optimized for the customer's health condition and constitution based on this. be able to
또한, 본 발명에 따른 고객 맞춤형 복합 서비스 제공 시스템은 고객의 건상상태와 체질을 고려함과 동시에 고객의 다양한 요구사항, 예를 들면, 다이어트, 피부미용, 면역력 증가, 맞춤음료의 당도, 맞춤음료의 향 등을 반영한 고객 맞춤형 맞춤음료를 제공할 수 있는 장점을 가진다.In addition, the customer-customized complex service providing system according to the present invention considers the customer's health condition and constitution, and at the same time, various requirements of the customer, for example, diet, skin care, immunity increase, sugar content of the customized drink, flavor of the customized drink It has the advantage of being able to provide customized beverages that reflect customer needs.
뿐만 아니라, 본 발명에 따른 고객 맞춤형 복합 서비스 제공 시스템은 필요한 경우에 외부 전문가로부터 획득된 고객의 건상상태정보, 맞춤음료 기본 레시피, 추가 서비스정보를 포함하는 데이터를 바탕으로 학습하는 인공지능 학습모듈을 구비함으로써 고객에게 보다 정확한 맞춤형 복합서비스를 제공할 수 있는 장점을 가진다.In addition, the customer-customized composite service providing system according to the present invention includes an artificial intelligence learning module that learns based on data including the customer's health condition information, customized beverage basic recipe, and additional service information obtained from external experts when necessary. Having it equipped has the advantage of being able to provide more accurate and customized complex services to customers.
한편, 본 발명에 따른 고객 맞춤형 복합 서비스 제공시스템은 맞춤음료를 제조하기 위한 플랫폼 제어부(291)를 갖는 제조 플랫폼(290)을 더 포함할 수 있다.On the other hand, the customer-customized composite service providing system according to the present invention may further include a manufacturing platform 290 having a platform control unit 291 for manufacturing a customized beverage.
제조 플랫폼(290)에는 맞춤음료 제조를 위한 재료들이 구비되어 있다. 여기서, 재료 각각은 농축액화 된 상태로 저장되어 보관될 수 있다. 예를 들면, 맞춤음료로 한방음료를 제공하는 경우에 사용되는 한약재들은 각각 농축액화된 상태로 저정되어 보관될 수 있다.The manufacturing platform 290 is provided with materials for manufacturing customized beverages. Here, each of the materials may be stored and stored in a concentrated liquefied state. For example, herbal medicines used in the case of providing an herbal beverage as a customized beverage may be stored and stored in a concentrated liquefied state.
플랫폼 제어부(291)는 레시피 산출부(240)에서 산출되는 맞춤음료 기본 레시피 또는 맞춤음료 수정 레시피를 전달 받으면, 해당 레시피의 순서 및 양에 따라 맞춤음료가 제조될 수 있도록 맞춤음료 제조 플랫폼(290)의 구성부품들을 제어하게 된다. When the platform control unit 291 receives the customized beverage basic recipe or customized beverage modified recipe calculated by the recipe calculation unit 240, the customized beverage manufacturing platform 290 allows the customized beverage to be manufactured according to the order and amount of the recipe. to control the components of
예를 들면, 제조자가 제조 플랫폼(290)에 구비된 시작버튼을 누르게 되면, 먼저 기본음료가 배출되는 제1 밸브와 연동되는 제1 램프가 깜박이게 되고, 제조자가 제1 밸브를 개방시키면 기본음료의 설정량이 배출될 수 있다. 이후에, 제1 램프가 소등되면 제1 재료가 배출되는 제2 밸브와 연동되는 제2 램프가 깜박이게 되고, 제조자가 제2 밸브를 개방시키면 제1 재료의 설정량이 배출될 수 있다. For example, when the manufacturer presses the start button provided on the manufacturing platform 290, the first lamp interlocking with the first valve through which the basic beverage is discharged blinks, and when the manufacturer opens the first valve, the basic beverage A set amount of can be discharged. Thereafter, when the first lamp is turned off, the second lamp associated with the second valve through which the first material is discharged blinks, and when the manufacturer opens the second valve, the set amount of the first material may be discharged.
여기서, 플랫폼 제어부(291)는 해당 레시피를 바탕으로 램프의 점등순서, 기본음료 및 재료의 종류, 설정량 등을 제어할 수 있다. 물론, 본 발명은 이에 한정되지 않고, 제조자가 해당 레시피를 바탕으로 제조 플랫폼을 수동으로 직접 조작하면서 맞춤음료를 제조할 수도 있을 것이다.Here, the platform control unit 291 may control the lighting sequence of lamps, types of basic beverages and ingredients, and set amounts based on the recipe. Of course, the present invention is not limited thereto, and the manufacturer may manufacture a customized beverage while manually manipulating the manufacturing platform based on the corresponding recipe.
이상 설명한 바와 같이, 본 발명은 상술한 특정한 바람직한 실시 예에 한정되지 아니하며, 청구범위에서 청구하는 본 발명의 요지를 벗어남 없이 당해 발명이 속하는 기술분야에서 통상의 지식을 가진 자에 의해 다양한 변형의 실시가 가능하고 이러한 변형은 본 발명의 범위에 속한다.As described above, the present invention is not limited to the specific preferred embodiments described above, and various modifications can be made by those skilled in the art to which the present invention belongs without departing from the gist of the present invention claimed in the claims. is possible and such variations are within the scope of the present invention.
본 발명은 고객의 얼굴 이미지를 포함하는 고객정보에 따라 고객의 건강상태를 판단하고, 이를 바탕으로 고객에게 최적화된 맞춤음료를 포함하는 고객 맞춤형 복합 서비스를 제공할 수 있는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템 기술 분야에 산업상 이용 가능하다.The present invention determines the customer's health condition according to customer information including the customer's face image, and based on this, provides a customer-specific complex service including a customized beverage optimized for the customer based on the customer's face image It can be used industrially in the field of customized composite service provision system technology.

Claims (8)

  1. 고객의 얼굴 이미지, 바이오정보 및 설문정보를 포함하는 고객정보를 외부로부터 전달받는 고객정보 획득단계;A customer information acquisition step of receiving customer information including a customer's face image, bio information, and survey information from the outside;
    상기 얼굴 이미지로부터 상기 고객의 안면특징을 추출하는 안면특징 추출단계;a facial feature extraction step of extracting facial features of the customer from the face image;
    상기 안면특징과 상기 설문정보를 바탕으로 상기 고객의 체질특징을 산출하는 체질특징 산출단계;a constitutional feature calculation step of calculating constitutional characteristics of the customer based on the facial features and the questionnaire information;
    상기 안면특징 및 상기 바이오정보를 바탕으로 상기 고객의 건강상태정보를 산출하는 건강상태 산출단계; 그리고,a health state calculation step of calculating health state information of the customer based on the facial features and the bio information; and,
    상기 건강상태정보 및 상기 체질특징을 바탕으로 하는 맞춤음료 기본 레시피를 산출하는 기본 레시피 산출단계;를 포함하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공방법.A basic recipe calculation step of calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics;
  2. 제1항에 있어서,According to claim 1,
    외부로부터 입력된 상기 고객의 추가 요청사항을 반영하여 보정된 맞춤음료 수정 레시피를 산출하는 수정 레시피 산출단계를 더 포함하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공방법.A method for providing a customer-customized composite service based on a face image, further comprising a modified recipe calculation step of calculating a modified customized drink modified recipe by reflecting the additional request of the customer input from the outside.
  3. 제2항에 있어서,According to claim 2,
    상기 추가 요청사항은 상기 맞춤음료에 대한 요구당도, 상기 맞춤음료에 추가되어야 할 향료정보 중 적어도 하나를 포함하는 것을 특징으로 하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공방법.Wherein the additional request includes at least one of a required sugar level for the customized beverage and flavoring information to be added to the customized beverage.
  4. 제2항에 있어서,According to claim 2,
    상기 추가 요청사항은 다이어트, 피부미용, 면역력 증강 중 적어도 하나의 기능성 정보이며, 상기 맞춤음료 수정 레시피는 상기 기능성 정보에 대응되는 적어도 한 종류의 추가재료를 포함하는 것을 특징으로 하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공방법.The additional request is at least one functional information of diet, skin care, and immunity enhancement, and the customized beverage modified recipe includes at least one type of additional material corresponding to the functional information. Based on the face image, How to provide customer-tailored complex services
  5. 제1항에 있어서,According to claim 1,
    상기 안면특징 및 상기 체질특징을 바탕으로 하는 미용정보, 화장품 정보 중 적어도 하나를 포함하는 추가 서비스정보를 제공하는 추가 서비스 제공단계를 더 포함하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공방법.A method for providing a customer-customized composite service based on a face image, further comprising providing additional service information including at least one of beauty information and cosmetics information based on the facial features and constitutional features.
  6. 고객의 얼굴 이미지, 바이오정보 및 설문정보를 포함하는 고객정보를 외부로부터 전달받는 고객정보 수신부;a customer information receiver receiving customer information including a customer's face image, bio information, and survey information from the outside;
    상기 얼굴 이미지로부터 상기 고객의 안면특징을 추출한 후 상기 안면특징과 상기 설문정보를 바탕으로 상기 고객의 체질특징을 산출하는 특징 추출부;a feature extraction unit extracting facial features of the customer from the face image and then calculating constitutional characteristics of the customer based on the facial features and the questionnaire information;
    상기 안면특징 및 상기 바이오정보를 바탕으로 상기 고객의 건강상태정보를 산출하는 건강상태 산출부; 그리고,a health state calculation unit that calculates health state information of the customer based on the facial features and the bio information; and,
    상기 건강상태정보 및 상기 체질특징을 바탕으로 하는 맞춤음료 기본 레시피를 산출하는 레시피 산출부를 포함하는 얼굴 이미지를 바탕으로 하는 고객 맞춤형 복합 서비스 제공 시스템.A system for providing a customer-customized complex service based on a face image including a recipe calculation unit for calculating a basic recipe for a customized beverage based on the health state information and the constitutional characteristics.
  7. 제6항에 있어서,According to claim 6,
    상기 레시피 산출부는 외부로부터 입력된 상기 고객의 추가 요청사항을 반영하여 보정된 맞춤음료 수정 레시피를 산출하는 것을 특징으로 하는 고객 맞춤형 복합 서비스 제공 시스템.The recipe calculation unit is a customer-customized complex service providing system, characterized in that for calculating a corrected customized beverage modified recipe by reflecting the customer's additional request input from the outside.
  8. 제6항에 있어서,According to claim 6,
    상기 안면특징 및 체질특징을 바탕으로 하는 미용정보, 화장품 정보 중 적어도 하나를 포함하는 추가 서비스정보를 제공하는 추가 서비스 제공부를 더 포함하는 것을 특징으로 하는 고객 맞춤형 복합 서비스 제공 시스템.and an additional service provider providing additional service information including at least one of beauty information and cosmetic information based on the facial features and constitutional features.
PCT/KR2023/000379 2022-02-18 2023-01-09 System and method for providing customer-tailored complex services based on face image WO2023158103A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2022-0021199 2022-02-18
KR1020220021199A KR20230124195A (en) 2022-02-18 2022-02-18 System and Method for providing customized complex service based on facial image

Publications (1)

Publication Number Publication Date
WO2023158103A1 true WO2023158103A1 (en) 2023-08-24

Family

ID=87578800

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2023/000379 WO2023158103A1 (en) 2022-02-18 2023-01-09 System and method for providing customer-tailored complex services based on face image

Country Status (2)

Country Link
KR (1) KR20230124195A (en)
WO (1) WO2023158103A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002279073A (en) * 2001-01-12 2002-09-27 Instem:Kk System for deciding physical constitution
JP2004517385A (en) * 2000-09-25 2004-06-10 パク ドン−オク Tea beverage vending apparatus and method
KR20180114612A (en) * 2017-04-11 2018-10-19 (주)디자인엑스투 individual custimixed recommanded beverage supply system and method
JP2021079182A (en) * 2021-02-25 2021-05-27 ポーラ化成工業株式会社 Skin condition support system
KR20220006837A (en) * 2020-07-09 2022-01-18 주식회사 비타메이트 Method and apparatus for recommending indivudual beverage based on face recognition

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20140108417A (en) 2013-02-27 2014-09-11 김민준 Health diagnosis system using image information

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004517385A (en) * 2000-09-25 2004-06-10 パク ドン−オク Tea beverage vending apparatus and method
JP2002279073A (en) * 2001-01-12 2002-09-27 Instem:Kk System for deciding physical constitution
KR20180114612A (en) * 2017-04-11 2018-10-19 (주)디자인엑스투 individual custimixed recommanded beverage supply system and method
KR20220006837A (en) * 2020-07-09 2022-01-18 주식회사 비타메이트 Method and apparatus for recommending indivudual beverage based on face recognition
JP2021079182A (en) * 2021-02-25 2021-05-27 ポーラ化成工業株式会社 Skin condition support system

Also Published As

Publication number Publication date
KR20230124195A (en) 2023-08-25

Similar Documents

Publication Publication Date Title
Culley A critique of multiculturalism in health care: The challenge for nurse education
WO2014035182A1 (en) Method and apparatus for personal medical treatment using mobile terminal
CN111599456A (en) Intelligent infectious disease pre-inspection diagnosis machine and pre-inspection method thereof
US20090240115A1 (en) Community based managed health kiosk system for soliciting medical testing and health study participants
CN109285605A (en) A kind of medical diagnosis system and diagnostic method based on artificial intelligence
US11356554B2 (en) Devices, system and methods for determining a priority level and/or conversation duration of a call
CN102354186A (en) Medical intelligent comprehensive control system of patient bedside information
WO2020138718A1 (en) System and method for analyzing and providing personalized cosmetic information
CN108245176A (en) Based on the interactive contactless psychology detection therapeutic device of Internet of Things, system and method
CN112398927B (en) Cloud platform network call processing system and method
US20220338757A1 (en) System and method for non-face-to-face health status measurement through camera-based vital sign data extraction and electronic questionnaire
CN111276263A (en) Basic doctor intelligent business-performing cloud platform supporting physical fitness
CN103841175B (en) A kind of image feature information transmission method, apparatus and system
CN205870552U (en) Domestic health care robot of intelligence
WO2019172563A1 (en) System for providing treatment experience at hospital on basis of vr or ar
CN116504373A (en) Comprehensive management information platform for digital intelligent ward
WO2023158103A1 (en) System and method for providing customer-tailored complex services based on face image
CN110619956A (en) Traditional chinese medical science intelligent robot
US20080175472A1 (en) Method of providing contents using color marker and system for performing the same
CN107115100A (en) A kind of Intelligent mirror device detected for medical treatment ＆ health and its detection method
WO2011155680A1 (en) Communication processing system in which compatibility is improved to process a complex biosignal
CN104732051A (en) Electronic health mirror application service system
CN212724738U (en) National health guarantee management system
WO2018170668A1 (en) Method for constructing electronic virtual human application system
WO2022035087A1 (en) Artificial intelligence-based system and method for providing medical tourism service

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23756516

Country of ref document: EP

Kind code of ref document: A1