KR20240000827A - System for providing of skin improvement solutions using artificial intelligence and big data technology and method thereof - Google Patents

Abstract

As an example, a skin solution providing system using artificial intelligence and big data technology includes a user smart device that photographs the skin area required for skin condition analysis, extracts only the skin area to be analyzed, and measures data required for skin condition analysis; And a recommendation AI server that analyzes the skin condition in conjunction with the smart device, transmits the analyzed results, and recommends customized cosmetics according to the analyzed skin condition results. The user's smart device is used to analyze the skin condition. A photographing unit that captures the necessary skin area, a measuring unit that measures the data required for skin condition analysis, an extraction unit that extracts only the skin area to be analyzed for skin condition from the captured image, and a matching unit that combines and matches the extracted captured images with the measured data values. A matching unit, a display unit that displays analysis information on the skin condition diagnosed and analyzed and evaluated by the recommendation AI server, and cosmetic ingredients and product recommendation information recommended according to the analyzed skin condition, and the photographing unit, measurement unit, extraction unit, and matching unit. A storage unit for storing extracted images and data, analysis information, and recommendation information, captured and measured in conjunction with the display unit, wherein the user smart device can record and store the user's habit information and the user's health information. The stored personal information of the user is transmitted to the recommendation AI server to be used for skin analysis and evaluation, or the stored personal information is evaluated directly on the smart device by further including a health/habit evaluation AI engine. , The evaluated information is transmitted to the recommendation AI server to be used for skin analysis and evaluation, and the recommendation AI server includes an SR engine that improves image quality, image data received from the SR engine, and measurement data received from the user's smart device, It includes a skin evaluation AI engine that analyzes and evaluates skin condition based on health/habit evaluation information, and a recommendation AI engine that recommends customized cosmetics according to the skin condition analysis and evaluation results derived from the skin evaluation AI engine.

Description

System and method for providing skin solutions using artificial intelligence and big data technology {SYSTEM FOR PROVIDING OF SKIN IMPROVEMENT SOLUTIONS USING ARTIFICIAL INTELLIGENCE AND BIG DATA TECHNOLOGY AND METHOD THEREOF}

The present invention relates to a system and method for providing skin solutions using artificial intelligence and big data technology. More specifically, the present invention relates to a system and method for providing skin solutions using skin images taken by users, and based on this, areas to be improved or areas to be improved. It relates to a skin solution provision system and method using artificial intelligence and big data technology that individually selects parts and provides customized cosmetic solutions suitable for the user's skin condition.

Recently, with the development of the beauty industry, various types of cosmetics have been released. Cosmetics are manufactured using a variety of ingredients, and much research and development is being conducted on the efficacy of these ingredients. For example, cosmetics with various colors manufactured to be suitable for use according to skin color, functional cosmetics for whitening, moisturizing, wrinkle improvement and UV protection, cosmetics for dry skin, normal skin and oily skin according to skin type, etc. There is.

Since these products are applied directly to the skin, all ingredients are required by law to be labeled, so users can choose according to their skin condition or purpose.

However, even though there are many different types of cosmetics, it is very difficult for individual users to accurately diagnose their skin condition, and there are limitations in selecting cosmetics suitable for each user. Therefore, when purchasing cosmetics, there is a tendency to make choices based on the cosmetic brand image, advertisement, or recommendations from sales staff.

This method of selecting cosmetics may have a negative effect on the skin, considering that each user has different skin characteristics and conditions, the cosmetic ingredients and contents required depending on the skin condition, and each individual's concerns about the skin are different. may occur.

Therefore, it is necessary to provide information about cosmetics that are not only suitable for each user's skin but also contain ingredients that can improve skin condition.

Publication Patent No. 10-2012-0051342, Emotional makeup recommendation system and method based on user color (publication date: May 22, 2012)

The present invention is intended to solve the above problems, by analyzing the skin condition using skin images taken by the user and individually selecting the area to be improved or improved based on this, a customized cosmetics solution suitable for the user's skin condition. We provide a skin solution provision system using artificial intelligence and big data technology.

As an example, a skin solution providing system using artificial intelligence and big data technology includes a user smart device that photographs the skin area required for skin condition analysis, extracts only the skin area to be analyzed, and measures data required for skin condition analysis; And a recommendation AI server that analyzes the skin condition in conjunction with the smart device, transmits the analyzed results, and recommends customized cosmetics according to the analyzed skin condition results. The user's smart device is used to analyze the skin condition. A photographing unit that captures the necessary skin area, a measuring unit that measures the data required for skin condition analysis, an extraction unit that extracts only the skin area to be analyzed for skin condition from the captured image, and a matching unit that combines and matches the extracted captured images with the measured data values. A matching unit, a display unit that displays analysis information on the skin condition diagnosed and analyzed and evaluated by the recommendation AI server, and cosmetic ingredients and product recommendation information recommended according to the analyzed skin condition, and the photographing unit, measurement unit, extraction unit, and matching unit. A storage unit for storing extracted images and data, analysis information, and recommendation information, captured and measured in conjunction with the display unit, wherein the user smart device can record and store the user's habit information and the user's health information. The stored personal information of the user is transmitted to the recommendation AI server to be used for skin analysis and evaluation, or the stored personal information is evaluated directly on the smart device by further including a health/habit evaluation AI engine. , The evaluated information is transmitted to the recommendation AI server to be used for skin analysis and evaluation, and the recommendation AI server includes an SR engine that improves image quality, image data received from the SR engine, and measurement data received from the user's smart device, It includes a skin evaluation AI engine that analyzes and evaluates skin condition based on health/habit evaluation information, and a recommendation AI engine that recommends customized cosmetics according to the skin condition analysis and evaluation results derived from the skin evaluation AI engine.

The SR engine of the skin solution provision system using artificial intelligence and big data technology receives information stored in the smart device and improves the resolution of the image to SR (SuperResolution) for the extracted image and improves the image quality. The image is transmitted to the skin evaluation AI engine, and the skin evaluation AI engine receives images with improved image quality received from the SR engine, data necessary for skin condition analysis received from the storage unit of the smart device, and the user's personal information. Personal habit information, health information, or evaluated information thereof are collected to analyze and evaluate skin condition based on an artificial intelligence algorithm, and the evaluated skin condition result is transmitted to the recommendation AI engine. By matching skin condition diagnosis results analyzed and evaluated by the recommendation AI server with cosmetic product data and cosmetic ingredient data, customized cosmetics suitable for the user's skin condition are recommended and transmitted to the user's smart device.

The skin solution provision system using artificial intelligence and big data technology further includes a big data server, and the big data server includes cosmetic types, cosmetic product data, and cosmetic ingredients. This is a database that collects information on data, the effectiveness of cosmetic ingredients, and the effect data of cosmetic ingredients on the skin.

As an example, a method of providing a skin solution using artificial intelligence and big data technology includes photographing the skin area required for skin condition analysis, extracting only the skin area to be analyzed, and measuring skin image data necessary for skin condition analysis. Data measurement step (S1); The image quality of the captured and extracted image is improved in the SR engine (310), and the image with improved image quality, transmitted measurement data, and health/habit information evaluation are collected and subjected to primary skin condition analysis and evaluation in the skin evaluation AI engine (320). The first skin condition analysis step (S2); An improvement part suggestion and selection step (S3) in which the server suggests areas to be improved from the first analysis and evaluation skin condition data or the user individually selects areas to be improved and then transmits the areas to the recommendation AI server 300; A matching step (S4) of ingredients and products necessary for skin improvement, which matches the proposed or selected skin condition analysis and evaluation results with information on cosmetic ingredients and recommended products necessary for skin improvement; and a recommendation step (S5) in which cosmetic ingredients necessary for improving the user's skin and customized cosmetics suitable for the skin condition are recommended based on the matched information and provided to the user's smart device 100.

The skin solution providing system using artificial intelligence and big data technology according to the present invention has the effect of providing a customized cosmetic solution suitable for the user's skin condition using skin images simply taken by the user with a smartphone, etc.

In addition, the present invention provides a customized cosmetic solution suitable for the user's skin condition, so the user can easily achieve a skin improvement effect for the skin that the user wishes to improve or needs to improve.

Figure 1 is a diagram showing a skin solution providing system using artificial intelligence and big data technology according to an embodiment of the present invention.
Figure 2 is a block diagram showing the components of a skin solution providing system using artificial intelligence and big data technology according to an embodiment of the present invention.
Figure 3 illustrates the skin condition analysis/evaluation and recommendation process performed on the skin solution provision system using artificial intelligence and big data technology according to an embodiment of the present invention, divided into a plurality of API (Application Program Interface) means. This is a drawing for
Figure 4 is a diagram showing a method of providing a skin solution using artificial intelligence and big data technology according to an embodiment of the present invention.

The present invention described below can be modified in various ways and can have various embodiments. Specific embodiments will be illustrated in the drawings and described in detail in the detailed description.

However, this is not intended to limit the present invention to specific embodiments, and should be understood to include all transformations, equivalents, and substitutes included in the spirit and technical scope of the present invention. In describing the present invention, if it is determined that a detailed description of related known technologies may obscure the gist of the present invention, the detailed description will be omitted.

The terms used in this application are only used to describe specific embodiments and are not intended to limit the invention. Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as “comprise” or “have” are intended to designate the presence of features, numbers, steps, operations, components, parts, or combinations thereof described in the specification, but are not intended to indicate the presence of one or more other features. It should be understood that this does not exclude in advance the possibility of the existence or addition of elements, numbers, steps, operations, components, parts, or combinations thereof.

Additionally, terms such as first and second may be used to separately describe various components, but the components should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another.

In addition, when at least two different embodiments are described in the present application, all or part of the components of each embodiment can be merged and used interchangeably without departing from the technical spirit of the present invention. .

Figure 1 is a diagram showing a skin solution providing system using artificial intelligence and big data technology according to an embodiment of the present invention, and Figure 2 is a diagram showing a skin solution providing system using artificial intelligence and big data technology according to an embodiment of the present invention. It is a block diagram showing the components.

The skin solution providing system using artificial intelligence and big data technology in FIG. 1 may include a user smart device 100, a network 200, a recommendation AI server 300, and a big data server 400.

Here, the user smart device 100 photographs the skin area required for skin condition analysis, extracts only the skin area to be analyzed, and measures the data required for skin condition analysis, including an imaging unit 110 and a measuring unit 120. , may be configured to include an extraction unit 130, a matching unit 140, a display unit 150, and a storage unit 160.

The imaging unit 110 can photograph skin areas necessary for skin condition analysis, such as the user's face, neck, back of the hands, or limbs.

The measuring unit 120 measures data necessary for skin condition analysis and can measure skin color, skin tone, skin moisture content, skin oil content, skin wrinkles, dead skin cells, and reflected light reflected from the skin area. At this time, the measuring unit can measure the focal length of the photo, exposure time, shooting date and time, brightness of the surrounding environment, indoor/outdoor status, weather information, etc., as well as the luminous dimension value of the light.

The extraction unit 130 extracts only the skin area to be analyzed for skin condition from the captured image.

The matching unit 140 combines and matches the extracted captured images and measured data values, and the matched data is transmitted to the recommendation AI server 300 in a matched state or independently before each matching.

The display unit 150 can display skin condition analysis information diagnosed and analyzed by the recommendation AI server 300, and cosmetic ingredients and cosmetic product recommendation information recommended according to the analyzed skin condition.

The storage unit 160 is linked with the photographing unit 110, the measuring unit 120, the extracting unit 130, the matching unit 140, and the display unit 150, and stores the captured, measured, and extracted images and data. This allows tagging with pre-set tags or the user directly adding keywords or tags and saving them to be classified. The tags set in this way serve as metadata that can be used for each skin area, surrounding environment and weather, lighting brightness, photo shooting date and focal length, and situation.

In addition, the storage unit 160 may store skin condition analysis information diagnosed and analyzed by the recommendation AI server 300 and cosmetic ingredient and cosmetic product recommendation information recommended according to the analyzed skin condition.

Additionally, the user smart device 100 can record and store the user's personal information, such as habit information and the user's health information. Here, the user's habit information may include wake-up time, bedtime, main activity time, eating habits, step count statistics, etc., and the user's health information may include heart rate, height, weight, blood pressure information, anemia level, liver level, etc. It may be included, but is not limited to this.

The user's personal information stored in this way is transmitted to the recommendation AI server 300 to be used for skin analysis and evaluation, or the smart device is further equipped with a health/habit evaluation AI engine 170 to prevent leakage of personal information. Therefore, the stored personal information can be evaluated directly on the smart device, and then the evaluated information can be transmitted to the recommendation AI server 300 to be used for skin analysis and evaluation. At this time, of course, the health/habit evaluation AI engine 170 may be provided in the recommendation AI server 300.

The network 200 is a communication network that is a high-speed backbone network of a large communication network capable of high-capacity, long-distance voice and data services, and may be a next-generation wired or wireless network for providing the Internet or high-speed multimedia services. The network 200 refers to a connection structure that allows information exchange by mutually transferring signals and data between the user smart device 100, recommendation AI server 300, big data server 400, and other systems. Networks include RF, 3rd Generation Partnership Project (3GPP) network, Long Term Evolution (LTE) network, 5th Generation Partnership Project (5GPP) network, World Interoperability for Microwave Access (WTMAX) network, Internet, and Local LAN (LAN). Area Network), Wireless LAN (Wireless Local Area Network), WAN (Wide Area Network), PAN (Personal Area Network), Bluetooth network, NFC network, satellite broadcasting network, analog broadcasting network, DMB (Digital Multimedia Broadcasting) Networks, etc. may be included. Of course, it is not limited to these network types.

The recommendation AI server 300 is linked with each smart device 100 and the big data server 400 to analyze the skin condition, transmit the analyzed results, and recommend customized cosmetics according to the analyzed skin condition results. It is a server that provides a base recommendation service web page, app page, program, or application, and as shown in Figure 2, it includes an SR engine 310, a skin evaluation AI engine 320, and a recommendation AI engine 330. It can be.

The SR engine 310 receives the information stored in the smart device 100, improves the resolution of the image to SR (Super Resolution) and improves the image quality for the extracted image, and the image with improved image quality is used by the skin evaluation AI engine ( 320).

The skin evaluation AI engine 320 analyzes and evaluates the image to be analyzed based on an artificial intelligence algorithm, and uses image data with improved image quality received from the SR engine 310 and the storage unit 160 of the smart device 100. Measurement data required for skin condition analysis received from the company, such as skin color or skin tone, skin moisture content, skin oil content, skin wrinkles, dead skin cells, reflected light reflected from the skin area, focal length of the captured image, exposure time, and shooting date. , the brightness of the surrounding environment, whether indoors or outdoors, weather information, etc., the luminous dimension value of the light, etc., the user's personal habit information, the user's health information, or the evaluated information thereof are collected to analyze the skin condition based on an artificial intelligence algorithm. Evaluate. The evaluated skin condition analysis results are sent to the recommendation AI engine (330).

Here, the skin condition may include skin color, amount of moisture in the skin, amount of oil in the skin, skin elasticity, skin wrinkles, skin stains, pore size, degree of UV exposure, sebum, dead skin cells, skin texture, skin type, skin stress, etc. You can.

The recommendation AI engine 330 matches the skin condition diagnosis results analyzed and evaluated by the recommendation AI server 300 with the cosmetic product data and cosmetic ingredient data received from the big data server 400 to recommend customized cosmetics suitable for the user's skin condition. Transmitted to the user smart device 100.

The big data server 400 may be a DB that collects various information such as cosmetic types, cosmetic product data and cosmetic ingredient data, efficacy of cosmetic ingredients, and effect data of cosmetic ingredients on the skin.

Figure 3 shows the skin condition analysis/evaluation and recommendation process performed on the skin solution provision system using artificial intelligence and big data technology according to an embodiment of the present invention through a plurality of APIs (Application Program Interface) forming the recommendation AI server 300. It is a drawing for explanation divided by means, and Figure 4 is a drawing showing a method of providing a skin solution using artificial intelligence and big data technology.

Hereinafter, with reference to FIGS. 3 and 4, we will look in detail at the components of the user smart device 100 and the recommendation AI server 300 and the analysis evaluation and recommendation process.

(S1) Skin image taking and data measurement stage

The capturing unit 110 of the smart device 100 photographs the skin area required for skin condition analysis, such as the user's face, neck, back of the hands, or limbs, and the extraction unit 130 captures the skin area to be analyzed for skin condition in the captured image. extract only

In addition, the measuring unit 120 measures the user's skin color or skin tone, skin moisture content, skin oil content, skin wrinkles, dead skin cells, reflected light reflected from the skin area, focal length of the photograph, exposure time, shooting date and time, and surrounding environment. Measures data necessary for skin condition analysis, such as brightness, whether indoors or outdoors, weather information, and luminous dimension values of lights.

(S2) First analysis step of skin condition

The captured and extracted images are sent to the SR engine 310 of the recommendation AI server 300 to improve image quality, and the images with improved image quality, measurement data, and health/habit information evaluation are collected and based on the collected data. The skin evaluation AI engine 320 performs a primary skin condition analysis and provides the skin condition analysis data to the user smart device 100 to be displayed on the display unit.

(S3) Proposal and selection stage for improvement areas

The server suggests areas that need to be improved from the initially analyzed skin condition data, or the user individually selects areas that need to be improved and transmits them to the recommendation AI server (300).

(S4) Matching step of ingredients and products necessary for skin improvement

Match the proposed or selected final skin condition analysis result with information on cosmetic ingredients and recommended products necessary for skin improvement from the big data server 400.

(S5) Recommendation stage

Based on the matched information, cosmetic ingredients needed to improve the user's skin and customized cosmetics suitable for the skin condition are recommended and provided to the user's smart device 100 to be displayed on the display.

(S6) Purchase stage

When user-tailored cosmetics are recommended, information about the shopping mall server that has sales information for the product is also provided so that the user can easily purchase it.

The present invention can also be implemented as computer-readable code on a computer-readable recording medium. Computer-readable recording media include all types of recording devices that store data that can be read by a computer system.

Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, and optical data storage devices, and are also implemented in the form of a carrier wave (e.g., transmission via the Internet). It also includes

Additionally, computer-readable recording media can be distributed across computer systems connected to a network, so that computer-readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for implementing the present invention can be easily deduced by programmers in the technical field to which the present invention belongs.

As explained in detail above, the skin solution providing system using artificial intelligence and big data technology according to the present invention provides a customized cosmetic solution suitable for the user's skin condition by simply using skin images taken by the user with a smartphone, etc. It has the effect of providing

In addition, the present invention provides a customized cosmetic solution suitable for the user's skin condition, so the user can easily achieve a skin improvement effect for the skin that the user wishes to improve or needs to improve.

Meanwhile, the embodiments disclosed in these drawings are merely provided as specific examples to aid understanding, and are not intended to limit the scope of the present invention. It is obvious to those skilled in the art that in addition to the embodiments disclosed herein, other modifications based on the technical idea of the present invention can be implemented.

100...smart device 110...photography department
120...measuring part 130...extraction part
140...matching part 150...display part
160...storage unit 170...health/habit evaluation AI engine
200...Network 300...Recommended AI server
310...SR Engine 320...Skin Evaluation AI Engine
330...Recommended AI engine 400...Big data server

Claims (4)

A user smart device that photographs the skin area required for skin condition analysis, extracts only the skin area to be analyzed, and measures the data required for skin condition analysis; and
It includes a recommendation AI server that analyzes the skin condition in conjunction with the smart device, transmits the analyzed results, and recommends customized cosmetics according to the analyzed skin condition results,
The user smart device includes a photographing unit for photographing the skin area required for skin condition analysis, a measuring unit for measuring data required for skin condition analysis, an extraction unit for extracting only the skin area for skin condition analysis from the captured image, and the extracted captured image. A matching unit that combines and matches the measured data values, a display unit that displays analysis information on the skin condition diagnosed and analyzed from the recommendation AI server, and recommended cosmetic ingredients and product recommendation information according to the analyzed skin condition, and the photographing unit. It includes a storage unit that stores the extracted images and data, analysis information, and recommendation information that are photographed and measured in conjunction with the unit, measurement unit, extraction unit, matching unit, and display unit;
The user smart device can record and store the user's habit information and the user's health information, and transmit the stored user's personal information to the recommendation AI server to be used for skin analysis and evaluation, or a health/habit evaluation AI engine. Further including, after evaluating the stored personal information directly on the smart device, the evaluated information is transmitted to the recommendation AI server to be used for skin analysis and evaluation,
The recommendation AI server is an SR engine that improves image quality, a skin evaluation AI engine that analyzes and evaluates skin condition based on image data received from the SR engine, measurement data received from the user's smart device, and health/habit evaluation information, and the skin Recommendation AI engine that recommends customized cosmetics based on skin condition analysis and evaluation results derived from the evaluation AI engine
A skin solution providing system using artificial intelligence and big data technology, including Jin; According to paragraph 1,
The SR engine receives information stored in the smart device, improves the resolution of the image for the extracted image to SR (SuperResolution), improves the image quality, and transmits the image with improved image quality to the skin evaluation AI engine,
The skin evaluation AI engine includes images with improved image quality received from the SR engine, data necessary for skin condition analysis received from the storage unit of the smart device, and habit information or health information, which is the user's personal information, or the evaluation of these. The information is collected, the skin condition is analyzed and evaluated based on an artificial intelligence algorithm, and the evaluated skin condition results are sent to the recommendation AI engine.
The recommendation AI engine matches the skin condition diagnosis results analyzed and evaluated by the recommendation AI server with cosmetic product data and cosmetic ingredient data, recommends customized cosmetics suitable for the user's skin condition, and transmits artificial intelligence and big data to the user's smart device. A skin solution provision system using technology. According to paragraph 1,
The skin solution providing system using artificial intelligence and big data technology further includes a big data server,
The big data server is a skin solution providing system using artificial intelligence and big data technology, which is a database that collects information on cosmetic types, cosmetic product data and cosmetic ingredient data, efficacy of cosmetic ingredients, and effect data on the skin of cosmetic ingredients. A skin image capturing and data measurement step (S1) of photographing the skin area required for skin condition analysis, extracting only the skin area to be analyzed, and measuring data required for skin condition analysis;
The image quality of the captured and extracted image is improved in the SR engine (310), and the image with improved image quality, transmitted measurement data, and health/habit information evaluation are collected and subjected to primary skin condition analysis and evaluation in the skin evaluation AI engine (320). The first skin condition analysis step (S2);
An improvement part suggestion and selection step (S3) in which the server suggests areas to be improved from the first analysis and evaluation skin condition data or the user individually selects areas to be improved and then transmits the areas to the recommendation AI server 300;
A matching step (S4) of ingredients and products necessary for skin improvement, which matches the proposed or selected skin condition analysis and evaluation results with information on cosmetic ingredients and recommended products necessary for skin improvement; and
Based on the matched information, cosmetic ingredients needed to improve the user's skin and customized cosmetics suitable for the skin condition are recommended and provided to the user's smart device 100, a recommendation step (S5) using artificial intelligence and big data technology, including How to provide skin solutions.