KR102151562B1 - Method for suggesting patch based on skin analysing result - Google Patents

Abstract

In an embodiment, obtaining a first skin image using a skin measuring device; Analyzing the primary skin image; And transmitting the analysis result of the primary skin image to the user terminal, wherein the transmitting to the user terminal includes information on the microneedle patch determined to be suitable for skin improvement together with the analysis result of the skin image. A method for proposing a patch based on the result of skin analysis transmitted together is disclosed.

Description

How to propose a patch based on skin analysis results {METHOD FOR SUGGESTING PATCH BASED ON SKIN ANALYSING RESULT}

The embodiment relates to a method for proposing a patch based on a result of skin analysis.

The skin is the largest organ of the integument system, including the skin accessory tissues such as hair, nails, hair and sweat glands. The skin contains multiple layers of epithelial tissue that protects the underlying muscles and organs. Since the skin is constantly attacked by a number of external and internal factors, the skin can be infected with numerous diseases. Therefore, measuring the condition of the skin is important from a health perspective and a beauty perspective.

There are many methods of measuring the condition of the skin, but most of the methods require access to a dermatologist or a dedicated device provided in the dermatologist. However, access to such a doctor or dedicated device is accompanied by difficulties, inconvenience, and excessive expenditure.

Therefore, there is a need for a simpler solution that allows general users to easily grasp the condition of the skin without having to face a dermatologist or a dedicated device provided in the dermatologist.

The embodiment provides a method for proposing a patch based on a result of skin analysis.

The problems to be solved in the embodiments are not limited thereto, and the objectives and effects that can be grasped from the solutions or embodiments of the problems described below are also included.

According to an embodiment of the present invention, a method for proposing a patch based on a result of skin analysis includes: obtaining a first skin image using a skin measuring device; Analyzing the primary skin image; And transmitting the analysis result of the first skin image to a user terminal, wherein the transmitting to the user terminal includes selecting a patch matching the analysis result of the skin image, and the analysis result of the skin image Together, information about the patch is transmitted together.

The patch may be a microneedle patch.

After the step of transmitting to the user terminal, it may include detecting whether the patch is used.

In the detecting whether the patch is used, the user may recognize that the patch is used when the tagging information of the patch is received from the user terminal.

The step of detecting whether the patch is used may include obtaining attribute information of a patch matching the tagging information, generating a use end timer of the patch based on the attribute information, and when the timer expires, a user through a user terminal It can be alarmed to end the use of the patch.

Acquiring a second skin image after detecting whether the patch is used, re-analyzing the second skin image; And transmitting the analysis result of the secondary skin image to the user terminal, and transmitting the analysis result of the secondary skin image to the user terminal, determining the degree of skin improvement and reusing the currently used patch You can decide whether or not.

When the skin improvement degree is less than or equal to a preset reference value, the use of other types of patches may be suggested.

Analyzing the primary skin image may include obtaining a plurality of skin images photographed in different directions from the skin measuring device to generate a three-dimensional image, and analyzing the skin condition using the three-dimensional image.

According to an embodiment of the present invention, it is possible to obtain a rapid skin improvement effect by proposing an optimal microneedle patch that can improve skin according to a skin analysis result.

Various and beneficial advantages and effects of the present invention are not limited to the above-described contents, and may be more easily understood in the course of describing specific embodiments of the present invention.

1 is a conceptual diagram of a microneedle patch according to an embodiment of the present invention,
2 is a diagram showing the microstructure of FIG. 1,
3 is a first modified example of the microstructure of FIG. 1,
FIG. 4 is a diagram showing a route through which a drug is injected into the skin by the microstructure of FIG. 3,
5 is a second modified example of the microstructure of FIG. 1,
6 is a perspective view of a microneedle patch according to an embodiment of the present invention,
7 is a view in which the microneedle patch of FIG. 6 is attached to the skin,
8A to 8E are views showing a method of manufacturing a microneedle patch according to an embodiment of the present invention,
9 is a conceptual diagram of a skin measurement device according to a first embodiment of the present invention,
10 is a block diagram of a skin measuring device according to a first embodiment of the present invention,
11 is a front view of a skin measurement device according to a first embodiment of the present invention,
12 is a side view of a skin measurement device according to a first embodiment of the present invention,
13 is a conceptual diagram of a skin measurement device according to a second embodiment of the present invention,
14 is a block diagram of a skin measurement device according to a second embodiment of the present invention,
15 is a diagram showing a process of acquiring a distant image using a skin measurement device,
16 is a diagram showing a process of acquiring a proximity image using a skin measurement device,
17 is a diagram showing a process of generating a three-dimensional image by synthesizing a front image and a side image acquired using a skin measuring device,
18 is a conceptual diagram of a skin measurement device according to a third embodiment of the present invention,
19 is a diagram showing a process of acquiring a three-dimensional image using a skin measuring device,
20 is a conceptual diagram of a skin measurement device according to a fourth embodiment of the present invention,
21 is a diagram showing a skin analysis and patch proposal system according to an embodiment of the present invention,
22 is a flowchart illustrating a method of proposing a patch based on a result of skin analysis according to an embodiment of the present invention.
23 is an example of a screen displayed on a user terminal according to an embodiment of the present invention,
24 is a modified example of FIG. 22,
25 is a configuration diagram of a skin condition evaluation apparatus according to an embodiment of the present invention,
26 is a diagram for describing a method of generating a skin recognizer according to an embodiment of the present invention.
27 is a diagram for explaining a method of determining a skin grade using a skin recognizer according to an embodiment of the present invention;
28 is a diagram for explaining a method of generating a first vector,
29 is a flowchart illustrating a method of evaluating a skin condition performed by the apparatus for evaluating a skin condition according to an embodiment of the present invention.

The present invention is intended to illustrate and describe specific embodiments in the drawings, as various changes may be made and various embodiments may be provided. However, this is not intended to limit the present invention to a specific embodiment, it is to be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers, such as second and first, may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component. For example, without departing from the scope of the present invention, a second element may be referred to as a first element, and similarly, a first element may be referred to as a second element. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

When a component is referred to as being "connected" or "connected" to another component, it is understood that it may be directly connected or connected to the other component, but other components may exist in the middle. Should be. On the other hand, when a component is referred to as being "directly connected" or "directly connected" to another component, it should be understood that there is no other component in the middle.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. Singular expressions include plural expressions unless the context clearly indicates otherwise. In the present application, terms such as "comprise" or "have" are intended to designate the presence of features, numbers, steps, actions, components, parts, or combinations thereof described in the specification, but one or more other features. It is to be understood that the presence or addition of elements or numbers, steps, actions, components, parts, or combinations thereof, does not preclude in advance.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this application. Does not.

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings, but the same reference numerals are assigned to the same or corresponding components regardless of the reference numerals, and redundant descriptions thereof will be omitted.

<micro You guys Patch>

1 is a conceptual diagram of a microneedle patch according to an embodiment of the present invention, and FIG. 2 is a view showing the microstructure of FIG. 1.

1 and 2, the microneedle patch 100 according to the embodiment may include a base layer 110 and a needle array 120 disposed on the base layer 110.

The base layer 110 may provide mechanical strength to the needle array 120 and may have flexibility. The material of the base layer 110 is not particularly limited.

Exemplarily, the base layer 110 is hydrocolloid, urethane, polyethylene, polypropylene, polyvinyl chloride resin, polyethylene terephthalate (PET), nylon, epoxy, polyimide, polyester, urethane, acrylic, polycarbonate, urea, Melanin, chlorinated rubber, polyvinyl alcohol, polyvinyl ester, vinylidene fluoride-hexafluoropropylene copolymer (PVDF-co-HFP), polyvinylidenefluoride (PVDF), polyacrylonitrile , Polymethylmethacrylate, polytetrafluoroethylene (PTFE), styrene butadiene rubber (SBR), or resin-based materials such as ethylene-propylene-diene copolymer (EPDM) Can be

The needle array 120 may include a matrix 122 and a plurality of microstructures 121 disposed on the matrix 122. The matrix 122 and the plurality of microstructures 121 may be integrally formed. The plurality of microstructures 121 may be formed finely to penetrate the stratum corneum layer and enter the epidermis layer. Thus, it can pass through the stratum corneum without stimulating pain receptors.

The plurality of microstructures 121 may have various needle shapes. Exemplarily, the plurality of microstructures 121 may have at least one shape of a cone, a triangular pyramid, a square pyramid, and a polygonal pyramid.

Exemplarily, the plurality of microstructures 121 may have a triangular pyramid shape. The triangular pyramid may have a triangular-shaped bottom surface 121d and three triangular-shaped side surfaces 121a, 121b, and 121c. In this case, a ratio (aspect ratio) of one side surface W1 and the height W2 of the bottom surface of the triangular pyramid may be 1:0.8 to 1:1.2. For example, the width of one side surface W1 of the bottom side of the plurality of microstructures 121 may be 200 μm, and the height W2 may be 200 μm. Thus, the aspect ratio may be 1:1. According to this configuration, it is possible to densely form irregularities in the master using a dicing blade. Accordingly, the density of the plurality of microstructures 121 can be increased. The density of the plurality of microstructures 121 according to the embodiment may be 400 or more per 1 cm ^2, but is not limited thereto.

FIG. 3 is a first modified example of the microstructure of FIG. 1, FIG. 4 is a view showing a path through which a drug is injected into the skin by the microstructure of FIG. 3, and FIG. 5 is a second modified example of the microstructure of FIG. 1 to be.

Referring to FIG. 3, the plurality of microstructures 121 may include a plurality of first microstructures 121-1 and a plurality of second microstructures 121-2. In this case, the height h1 of the first microstructure 121-1 may be higher than the height h2 of the second microstructure 121-2. The first microstructure 121-1 and the second microstructure 121-2 may be randomly or regularly arranged.

The height h2 of the second microstructure 121-2 may be 30% to 70% of the height h1 of the first microstructure 121-1. For example, when the height of the first microstructure 121-1 is 200 μm, the height of the second microstructure 121-2 may be 60 μm to 140 μm.

4, when attached to the skin, the first microstructure 121-1 is inserted deeply into the skin to inject the drug, whereas the second microstructure 121-2 is relatively inserted only near the epidermis to inject the drug. can do. Accordingly, the first microstructure 121-1 and the second microstructure 121-2 may have different skin layers in which drugs are injected. Therefore, it is possible to inject the drug evenly into several skin layers, so that the efficacy can be excellent.

Exemplarily, the first microstructure 121-1 is inserted into the dermal layer S2 to inject drugs, and the second microstructure 121-2 is inserted into the epidermal layer S1 to inject drugs, but the drug is injected. The skin layer to be performed is not particularly limited. For example, both the first microstructure 121-1 and the second microstructure 121-2 may be inserted into the epidermal layer S1 to inject a drug. In addition, third microstructures 121 having different heights may be additionally disposed.

Referring to FIG. 5, the second microstructure 121-2 may be disposed between two adjacent first microstructures 121-1. A first separation part 123a is formed between the second microstructure 121-2 and the first microstructure 121-1a disposed on the left side, and between the first microstructure 121-1b disposed on the right side A second separation part 123b may be formed in the.

In this case, the thickness of the first separation portion 123a may be thicker than the thickness of the second separation portion 123b. That is, in the microneedle patch 100 according to the embodiment, the thickness of the matrix 122 may be non-uniform.

The microstructure 121 according to the embodiment may be manufactured by forming a mold using a master having irregularities formed thereon, and applying an active solution to the mold as described later. In the process of forming the irregularities in the master, the height of the irregularities can be adjusted by adjusting the height of the dicing blade. In this process, since the dicing blade cuts the master relatively deeply in order to form the irregularities low, the thickness may become uneven.

Referring back to FIG. 1, an adhesive layer 170 and a protective film 160 may be disposed on the base layer 110. Therefore, the user may remove the protective film 160 and adhere the adhesive layer 170 to the skin when using the pad.

The adhesive layer 170 may include various adhesives capable of adhering without causing damage to the skin such as a hydrophobic adhesive, a silicone adhesive, an acrylic adhesive, and a hydrophilic adhesive.

A printing layer 130 and a temperature sensitive layer 140 may be disposed under the base layer 110. In addition, a release film 150 may be disposed on the lower surface of the temperature sensitive layer 140.

The printing layer 130 may be a layer on which various shapes, patterns, logos, and texts are printed. The printing layer 130 may be formed by screen printing on the back side of the base layer 110.

The temperature sensitive layer 140 may be a layer having a predetermined color in normal times, but may be changed to be transparent when the temperature exceeds a predetermined temperature. For example, the temperature sensitive layer 140 may include Zion ink, but is not limited thereto.

Referring to FIG. 6, the printed layer 130 does not appear before the patch is used. However, when the patch is attached to the skin as shown in FIG. 7, the temperature sensitive layer 140 is transparently changed by body temperature, so that the printed layer 130 is formed. A logo 141 may appear. Thus, the user can confirm that the patch is attached to the skin.

In addition, a text indicating the attachment time of the corresponding patch may be displayed on the printing layer 130. For example, the phrase "15 minutes" may be printed on the printing layer 130. Also, in the case of a high-capacity patch, the phrase "30 minutes" may be printed. That is, there is an effect that the user can easily recognize the attachment time of the corresponding patch by printing and displaying the attachment time according to the capacity of the corresponding patch.

8A to 8E are diagrams illustrating a method of manufacturing a microneedle patch according to an embodiment of the present invention.

8A to 8E, a method of manufacturing a microneedle patch 100 according to an embodiment includes the steps of manufacturing a master 10; Manufacturing a mold 20 using the master 10; Applying an active solution to the mold 20; Drying the active solution to prepare a needle array 120; And manufacturing a patch using the manufactured needle array 120.

Referring to FIG. 8A, in the manufacturing of the master 10, the fine irregularities 11 may be formed on the mold plate 12 using the dicing blade 5 rotating at high speed. The dicing blade 5 may have a circular disk shape, but is not limited thereto. Specifically, fine irregularities may be formed by the inclined surface 5a of the dicing blade.

Referring to FIG. 8B, in the step of manufacturing the mold 20 using the master 10, the mold 20 may be manufactured by filling the mold 20 on the master 10 and then curing it. Referring to FIG. 8C, a groove 21 corresponding to the unevenness of the master may be formed in the mold 20. The material of the mold 20 is not particularly limited.

Referring to FIG. 8D, an active solution may be applied to the mold 20. The active solution can be prepared by mixing a biodegradable polymer, a surfactant mixture, and an active ingredient mixture in a solvent. The solvent may be distilled water.

Biodegradable polymers include Hyaluronic Acid (HA), Poly(lactic acid) (PLA), (PCL), Polyhydroxyalkanoate (PHA), Polyesteramide (PEA), polyethylene glycol (PEG), poly(p-dioxanone) (PPDO), poly (lactic-co-glycolic acid) (PLGA), Polyglycolic acid (PGA), Polyvinyl alcohol (PVA), and may be selected from the group consisting of a mixture thereof, but is not limited thereto.

The surfactant mixture may include sugars such as trehalose.

In addition, the active ingredient mixture may contain various active substances. The active substance may include chitosan, collagen, gelatin, salicylic acid, vitamin C, peptides, proteins, caffeine, stem cells, drug or cosmetic ingredients, and various herbal extracts such as gold and silver flowers.

Among herbal extracts, Lonecera Flower (金銀花) belongs to Caprifoliaceae. It is a medicinal material that cools the heat of the wind and removes poison from the blood in oriental medicine. It is used as an antipyretic and antidote. Due to its action, it is applied to various inflammatory diseases, fever caused by colds, and surgeries. As such, the microneedle patch containing gold and silver components can exhibit very good effects on the skin.

Thereafter, the needle array 120 may be manufactured by drying the active solution. The needle array 120 may include 85 to 99 parts by weight of hyaluronic acid, 0.5 to 1.5 parts by weight of surfactant, 0.5 to 2.5 parts by weight of collagen, and 0.1 to 15 parts by weight of the active ingredient complex when 100 parts by weight of the total active material is used. have. The active ingredient complex may contain gold and silver coins.

In this case, the hyaluronic acid may include high molecular weight hyaluronic acid and low molecular weight hyaluronic acid. In this case, the high molecular weight hyaluronic acid may have a molecular weight greater than 10,000da and less than 25,000da, and the low molecular weight hyaluronic acid may have a molecular weight greater than 100da and less than 10,000da.

According to the embodiment, since it is prepared by mixing high molecular weight hyaluronic acid and low molecular weight hyaluronic acid, when inserted into the skin, low molecular weight hyaluronic acid is first dissolved and the active substance is rapidly injected, and high molecular hyaluronic acid is relatively slowly dissolved, so that the medicinal effect can be sustained. .

Referring to FIG. 8E, a patch may be manufactured using the manufactured needle array 120. In the embodiment, a patch using the needle array 120 is illustrated, but the application of the needle array 120 is not necessarily limited thereto. For example, the needle array 120 may be applied to various cosmetic products such as a mask sheet. It can also be applied to pharmaceutical products depending on the ingredients it contains.

<Skin measurement device>

9 is a conceptual diagram of a skin measurement apparatus according to a first embodiment of the present invention, and FIG. 10 is a block diagram of a skin measurement apparatus according to the first embodiment of the present invention.

In the present invention,'skin' is a tissue of the human body that makes up the surface of the human body, and may be an object for which an attribute value or grade is desired. In this case, the skin may be the skin of the face or the skin of various parts of the human body. However, in the following description, for convenience of explanation, it is assumed that the skin is the skin of the face.

9 and 10, the skin measurement device according to the embodiment is disposed on a body 210, an image sensor 221 that is disposed on the body 210 to photograph the user's skin, and is disposed on the body 210 A temperature sensor 222 measuring a temperature, a distance adjusting device 223 disposed on the body 210 to adjust an appropriate distance from the image sensor 221; And a controller 230 communicating with the image sensor 221 and the temperature sensor 222.

The body 210 may be made of a plastic material and/or a metal material. The body 210 may be formed in a water droplet or egg shape to improve a user's grip. However, the shape of the body 210 is not limited thereto, and various shapes may be applied.

The image sensor 221 may acquire a skin image image of the user. The image sensor 221 may be a concept including a camera module, but is not limited thereto.

The temperature sensor 222 may measure the user's skin temperature. As an example, the temperature sensor 222 may be an infrared sensor, but the present invention is not limited thereto, and various sensors capable of sensing temperature may be selected.

When the temperature of the user detected by the temperature sensor 222 exceeds a preset threshold, the controller 230 may operate the alarm unit 224 to warn the user. For example, when the temperature of the object to be measured is higher than 38 degrees, red light may be output. Therefore, the user can easily recognize that the heat of the measurement object is high.

The alarm unit 224 may be an LED disposed inside the body 210. The memory 226 may store preset threshold information. Also, a user's usage record may be stored.

The controller 230 may include all kinds of devices capable of processing data, such as a processor. Here, the'processor' may refer to a data processing device embedded in hardware having a circuit physically structured to perform a function represented by a code or instruction included in a program.

As an example of such a data processing device built into the hardware, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, and an ASIC (Application-Specific Integrated) Circuit) and processing devices such as a Field Programmable Gate Array (FPGA) may be covered, but the scope of the present invention is not limited thereto.

The user may adjust an appropriate distance to the skin measuring device by using the distance adjusting device 223. For example, the distance adjusting device 223 may be a distance sensor or a mirror. The user can extend his arm and separate the skin measurement device to a position where all of his or her face is visible in the mirror. Accordingly, the separation distance between the user and the skin measurement device may be adjusted according to the size of the mirror.

When the power switch 215 is turned on, the controller 230 operates in a wake-up mode to check each sensor, and drives the image sensor 221 when a skin image measurement signal is received from the client through the communication unit 225 To obtain a skin image. The acquired image may be transmitted to the client through the communication unit 225. The client may be a user terminal, but is not limited thereto, and various devices capable of communicating with the skin measurement device may be included.

11 is a front view of a skin measurement device according to a first embodiment of the present invention, and FIG. 12 is a side view of a skin measurement device according to the first embodiment of the present invention.

11 and 12, the body 210 may have a convex shape in a direction perpendicular to the length direction (width direction). That is, the body 210 may include a first region 211 whose cross-sectional area increases in the longitudinal direction and a second region 212 whose cross-sectional area decreases in the longitudinal direction. The first region 211 may be disposed above the second region 212. The height of the first region 211 may be greater than the height of the second region 212. In addition, the width of the front side of FIG. 11 may be smaller than the width of the side of FIG. 12. This shape can improve the user's grip.

The first region 211 may have a concave surface 213 formed by cutting-out a partial region. The concave surface 213 may have a curvature. The image sensor 221, the temperature sensor 222, and the distance adjusting device 223 may be disposed on the concave surface 213.

The concave surface 213 may include a third region 213a that widens in the length direction and a fourth region 213b that narrows in the length direction. The distance adjusting device 223 may be disposed at the top of the concave surface 213. In this case, the area of the concave surface 213 and the area of the distance control device 223 may satisfy 1:0.2 to 1:0.6. When the area is smaller than 1:0.2, the area of the distance adjusting device 223 is small, so that the entire face of the user may be difficult to be illuminated. In addition, when the area is larger than 1:0.6, the area occupied by the distance adjusting device 223 may increase, so that the mounting space for other sensors may be narrowed.

13 is a conceptual diagram of a skin measurement apparatus according to a second embodiment of the present invention, FIG. 14 is a block diagram of a skin measurement apparatus according to a second embodiment of the present invention, and FIG. 15 is a front image using the skin measurement apparatus Fig. 16 is a diagram showing a process of acquiring a side image using a skin measuring device, and Fig. 17 is a three-dimensional image by synthesizing a front image and a side image acquired using a skin measuring device. It is a diagram showing the process of creating.

13 and 14, the skin measurement apparatus according to the embodiment includes a control unit 230, an image sensor 221, a temperature sensor 222, a first light source 241, a second light source 247, and an alarm. A unit 224, an illuminance sensor 246, a communication unit 225, a distance adjustment device 244 (hereinafter referred to as a distance sensor), and a power supply unit 227 may be included.

The image sensor 221 may acquire a skin image image of the user. The image sensor 221 may be a camera module, but is not limited thereto.

The temperature sensor 222 may measure the user's skin temperature. As an example, the temperature sensor 222 may be an infrared sensor, but the present invention is not limited thereto, and various sensors capable of sensing temperature may be selected.

The illuminance sensor 246 may measure external illuminance. Accordingly, the controller 230 may control the first light source 241 and the second light source 247 to provide only the necessary illuminance after calculating the required illuminance using the external illuminance information.

The first light source 241 may irradiate light toward the front of the user so that the image sensor 221 can obtain a front image of the user. Accordingly, the first light source 241 may be disposed closer to the image sensor 221 than the second light source 247. Referring to FIG. 15, a user may acquire a front image using the image sensor 221 while irradiating the first light source 241. In this case, the front image may be a distant image captured at a predetermined distance.

When the user selects the long-distance photographing mode, the controller 230 may detect a distance to the user using the distance sensor 244 and may alarm through the alarm unit 224 when the separation distance exceeds a predetermined distance. For example, a red light can be alarmed when out of the distance, and a green light can be alarmed when within the distance.

When the user adjusts the distance and determines that the proper distance to the user is maintained from the distance information of the distance control device 223, the controller 230 drives the first light source 241 and the image sensor 221 to generate a distant image. Can be obtained.

Referring to FIG. 16, the second light source 247 may be used when a user obtains a proximity image (or an inclined image). In this case, the optical axis of the second light source 247 may be disposed to cross the optical axis of the first light source 241 at a predetermined angle θ1. When the light emitted from the first light source 241 is defined as parallel light, the light emitted from the second light source 247 may be inclined light. Accordingly, the user may acquire a close-up image by placing the skin measuring device close to the face and photographing it.

When the user selects the short-range photographing mode, the controller 230 may detect a distance to the user using the distance sensor 244 and may alarm through the alarm unit 224 when the separation distance is outside a predetermined distance.

Thereafter, when the user adjusts the distance and determines that it is located within an appropriate distance, the controller 230 may obtain a proximity image by driving the second light source 247 and the image sensor 221.

In this case, the controller 230 may generate a three-dimensional image as shown in (c) of FIG. 17 by synthesizing the front image and the inclined image as shown in (b) of FIG. 17 as shown in (a) of FIG. 17. Such a three-dimensional image of the skin can be used as data to determine the roughness of the skin.

When the user selects the stereoscopic image capturing mode, the control unit 230 detects the distance to the user using the distance sensor 244, and when the separation distance is outside the first predetermined distance, an alarm is generated through the alarm unit 224. I can.

Thereafter, when the user adjusts the distance and enters the first distance, the controller 230 may obtain a front skin image by driving the first light source 241 and the image sensor 221.

Thereafter, the controller 230 may detect the distance to the user again by using the distance sensor 244 and may alarm through the alarm unit 224 when the separation distance deviates from the second predetermined distance.

Thereafter, when it is determined that the second distance is maintained by the user adjusting the distance, the controller 230 may obtain the skin image at an inclined angle by driving the second light source 247 and the image sensor 221. At this time, when it is determined that the first distance and the second distance are maintained, the control unit 230 may output a control signal to the alarm unit 224 to alarm the user.

Thereafter, the controller 230 may transmit two skin images captured from different angles to the server. However, the present invention is not limited thereto, and the controller 230 of the skin measurement device may generate a three-dimensional image by synthesizing two skin images.

18 is a conceptual diagram of a skin measurement device according to a third embodiment of the present invention, and FIG. 19 is a diagram illustrating a process of acquiring a three-dimensional image using the skin measurement device.

Referring to FIG. 18, the skin measurement apparatus according to the embodiment includes a first image sensor 251, a temperature sensor 222, a light source 253, an illuminance sensor 246, and a second image sensor 252, and an alarm. It may include a part 248. The first image sensor 251 and the second image sensor 252 may serve as a dual camera. At this time, the first image sensor 251 and the second image sensor 252 need to be spaced apart at appropriate intervals.

The first image sensor 251 may acquire a first skin image, and the second image sensor 252 may acquire a second skin image. Therefore, it is possible to form a three-dimensional effect by synthesizing two skin images.

20 is a conceptual diagram of a skin measurement apparatus according to a fourth embodiment of the present invention.

Referring to FIG. 20, the skin measurement apparatus according to the embodiment includes an image sensor 221, a plurality of filters 263, 264, 265, 266 disposed on the image sensor 221, and a rotating part 261 that rotates the plurality of filters. ) Can be included.

The plurality of filters may include a first filter 263 in which a general lens is disposed, a second filter 264 in which a convex lens is disposed, an infrared filter 265, and a filter 266 for a wood lamp.

The first filter 263 may function as a lens for a long distance because a general lens is disposed. Accordingly, when the user wants to capture a distant image, the first filter may be disposed on the top of the image sensor 221.

The second filter 264 may function as a near-field lens by having a convex lens disposed thereon. Accordingly, the user may place the second filter on the top of the image sensor 221 when he/she wants to take a short-range image.

The third filter 265 may be provided with an infrared filter to serve as a temperature sensor 222. Accordingly, when the user wants to measure the temperature, the third filter may be disposed on the top of the image sensor 221.

The fourth filter 266 is provided with a wood lamp filter to measure moisture in the skin. Wood lamp is a lamp that can measure skin condition with reflected light by irradiating UV rays of 365nm or more to the skin. The wood lamp filter may be a band pass filter that transmits ultraviolet rays of 365 nm or more. If necessary, more UV-A UV LEDs can be arranged.

The rotating part 261 may be connected to the first to fourth filters 263, 264, 265, and 266. Accordingly, a desired filter may be disposed on the image sensor 221 by rotating the rotating part 261. Although the rotation unit 261 is illustrated as a manual type in which the user directly rotates, it may be implemented fully automatically to select a desired filter.

<Skin analysis and patch suggestion system>

21 is a diagram illustrating a skin analysis and patch proposal system according to an embodiment of the present invention.

In the present invention,'patch' may be a term encompassing all types of beauty products that can be attached to the user's skin. For example, the patch may be a concept including all of a mask pack, various pads attached to the skin, beauty products, massage packs, microneedle patches, and the like. In addition, it may be a concept including both beauty products and medical products. Hereinafter, for convenience of description, a microneedle patch will be described as an example.

In the present invention, the'attribute of skin' may refer to various factors that are the basis for evaluating the skin. For example, the property of the skin may mean any one of a degree of redness of the skin, a degree of wrinkles of the skin, and a flatness of the skin.

In this case, the degree of redness of the skin means the degree of redness of the skin, and the redness of the skin may be of a higher degree of redness. The degree of redness of the skin may have a meaning as an element that determines the color of the skin.

The degree of wrinkles on the skin may mean the degree to which the skin is finely folded due to the decrease in elasticity of the skin. In this case, the high degree of wrinkles on the skin may mean a case in which the area where the skin is finely folded or the degree of finely folded is large.

On the other hand, the flatness of the skin may mean the degree to which the skin is uneven due to other factors excluding the curvature caused by the wrinkles of the skin. For example, the flatness of the skin may mean the degree to which the skin is uneven due to pores, or it can mean the degree to which the skin is uneven due to a wound, spot, or scar in a specific area.

However, the above-described properties of the skin are illustrative, and the spirit of the present invention is not limited thereto, and it is obvious that the properties of the skin of the present invention can be used as long as it can represent the condition of the skin.

In the present invention, the'level of skin' may be a numerical value determined according to the necessity of skin care based on the aforementioned properties of the skin. The grade is, for example, four grades, and may include a grade 0 that does not require special management, a first grade that requires general management, a second grade that requires professional management, and a third grade that requires treatment. However, the classification of such grades is exemplary, and skin may be classified into more or fewer grades. At this time, the grade of the skin may be calculated by considering the above-described properties of the skin in various ways.

In the present invention, the user terminal 400 may refer to various devices capable of receiving an attribute value for skin or a grade of skin from the server 300. The user terminal 400 may be a portable terminal or a personal computer.

The user terminal 400 may include a display means for displaying content and the like, and an input means for acquiring a user's input for such content. In this case, the input means and the display means may be configured in various ways. For example, the input means may include a keyboard, a mouse, a trackball, a microphone, a button, and a touch panel, but are not limited thereto.

The user terminal 400 may transmit tagging information of the microneedle patch 100 (hereinafter referred to as a patch) to the server 300. The patch 100 may be equipped with a wireless communication chip 101 such as NFC to perform short-range communication with the user terminal 400.

The server 300 may receive an image of a skin for which an attribute value or a grade is to be known from the skin measurement device 200 and determine the attribute value or grade of the corresponding skin.

The skin measurement device 200 may acquire the user's skin image and transmit it to the server 300. The skin measurement apparatus 200 may be interlocked with the user terminal 400 to transmit a skin image acquired by the skin measurement apparatus 200 to the user terminal 40 and/or the server 300 in real time.

22 is a flowchart illustrating a method of proposing a patch based on a skin analysis result according to an embodiment of the present invention.

Referring to FIG. 22, a method for proposing a patch based on a skin analysis result according to an embodiment includes obtaining and transmitting a primary skin image using the skin measuring apparatus 200 (S101), analyzing the primary skin image. Step S102 and transmitting the analysis result of the first skin image to the user terminal 400 (S103).

In the step S101 of acquiring and transmitting the primary skin image using the skin measuring device, all methods of acquiring a skin image using the skin measuring device 200 described with reference to FIGS. 9 to 20 may be applied. The skin image may be at least one of a distant image, a front image, a near image, an inclined image, or a three-dimensional image.

In the step S102 of analyzing the primary skin image, the server 300 may analyze the skin condition by using the skin image received from the skin measuring device 200. A specific method of analyzing the skin condition will be described later.

In the step of transmitting to the user terminal 400 (S103), information on the patch 100 determined to be suitable for skin improvement may be transmitted together with the result of analysis by the server 300.

As a result of analyzing the condition of the skin, the server 300 may select the patch 100 determined to be most suitable for skin improvement. Specifically, the server 300 may table and store a list of available patches 100 according to the degree of damage to the skin. Accordingly, when the skin level and properties are determined, the patch 100 that most matches the skin level and properties may be selected.

Referring to FIG. 23, the server 300 may propose information 740 of a usable patch together with a result of analyzing the user's skin. The user may receive information on his/her skin condition and available patches by using the information output on the user terminal 400.

In addition, additional information 750 may be provided in addition to the patch 100 information. For example, you can recommend cosmetic information or a dermatologist.

Referring back to FIG. 22, the user may measure the skin condition again after using the guided patch 100. In the same manner as in the previously measured method, at least one of a distant image, a front image, a near image, an inclined image, or a three-dimensional image may be obtained by using the skin measurement device 200. The skin measurement device 200 may transmit the acquired secondary skin image to the server 300 (S104).

The server 300 may analyze the secondary skin image (S105). The server 300 may evaluate the degree of improvement of the secondary skin image. That is, if it is determined that the analysis result of the second skin image is improved based on the analysis result of the first skin image, it may be determined that the patch 100 currently being used is effective. Therefore, it can be suggested to use the patch regularly while outputting the improved skin analysis result.

However, if the skin analysis result does not improve or worsens even after the patch 100 is used, the server 300 may propose the next sub-priority patch 100 from the list. Alternatively, if there is a user of the same pattern as a result of learning, the user may suggest a patch with improved skin using the user.

24 is a modified example of FIG. 22.

Referring to FIG. 24, until the server 300 analyzes the primary skin image and recommends the patch 100 to the user terminal 400, the process may be the same as described above.

When the user uses the recommended patch 100, when the patch 100 is tagged on the user terminal 400, the user terminal 400 may transmit tagging information to the server 300 (S204). As described above, the patch 100 may communicate with the user terminal 400 by attaching NFC.

The server 300 may extract information such as a manufacturing date, usage capacity, and usage time of the patch 100 currently being used from the database by using the tagging information and generate a timer (S205). The timer may be set as long as the use time of the corresponding patch 100.

When it is determined that the timer has expired, the server 300 may output a use termination alarm to the user terminal 400 to remove the patch 100 (S207). Thus, the user can attach the patch 100 for an accurate time.

Thereafter, the user may measure the skin condition by using the skin measuring device again after a predetermined time elapses. The server 300 may evaluate the degree of improvement of the secondary skin image (S209). That is, if it is determined that the analysis result of the second skin image is improved based on the analysis result of the first skin image, it may be determined that the patch 100 currently being used is effective. Therefore, it may be suggested to use the patch regularly while outputting the improved skin analysis result (S210).

25 is a block diagram of a skin condition evaluation apparatus according to an embodiment of the present invention, and FIG. 26 is a diagram illustrating a method of generating a skin recognizer by the skin condition evaluation apparatus according to an embodiment of the present invention.

Referring to FIG. 25, the server 300 may include a skin condition evaluation device 301. However, the present invention is not limited thereto, and the skin condition evaluation apparatus 301 may be a configuration included in the skin measurement device 200 or may be a configuration included in the user terminal 400. Hereinafter, it will be described that the skin condition evaluation apparatus of the server analyzes the skin image to determine the skin condition.

The skin condition evaluation apparatus 301 may include a communication unit 303, a control unit 304, and a memory 302. Also, although not shown in the drawings, the skin condition evaluation apparatus 301 according to an embodiment of the present invention may further include an input/output unit, a program storage unit, and the like.

Referring to FIG. 26, the control unit 304 of the apparatus 301 for evaluating a skin condition according to an embodiment of the present invention includes at least one training skin for generating the first skin recognizer 331 and the second skin recognizer 332. The image 310 may be acquired from the user terminal 400 and/or the skin measurement device 200.

In this case, an attribute value for at least one attribute and a skin level may be marked on the training skin image 310. In other words, the training skin image 310 is an image of skin that already has its attribute value and grade, and may be information used for generating and/or training a skin recognizer.

For example, in the case of the first training skin image 311, an attribute value 312 including a degree of flushing, a degree of wrinkle, and a flatness of the skin image 311 and a grade 313 of the skin may be labeled. At this time, the degree of flushing, the degree of wrinkles, and the flatness may be values representing the strength for each attribute, such as 0.1 and 0.8. In addition, the grade of the skin may be a'first grade' or a'third grade' and any one of the above four grades.

Meanwhile, the attribute value 312 is an attribute value for skin age (eg, 30 years old), gender (eg male), race (eg Asian), disease status (eg, chronic dermatitis), in addition to the attribute values for the above three attributes. It may further include. However, this is merely an example and the spirit of the present invention is not limited thereto.

The control unit 304 according to an embodiment of the present invention may obtain such a training skin image 310 from the skin measurement apparatus 200 or from the memory 302 of the skin condition evaluation apparatus 301 have. For example, the control unit 304 may acquire the training skin image 310 from the medical history stored in the server of a specific dermatology department. At this time, the treatment history stored in the dermatology server may be created by a specialist (eg, a dermatologist). In other words, the training skin image 310 may be based on data evaluated by an expert. In addition, the control unit 304 may obtain the training skin image 310 from a history of determining attribute values or grades of other skin images in the past.

The controller 304 according to an embodiment of the present invention may generate a first feature vector from each of the training skin images 310 obtained by the above-described process. For example, the controller 304 may generate a first feature vector 321 from the first training skin image 311. In this case, the controller 304 may generate the first feature vector 321 based on image analysis of the skin image 311.

For example, the controller 304 may recognize a face area from the skin image 311 for more accurate evaluation of the skin condition, and will be described with reference to FIG. 28. The controller 304 may determine a face area in the image 510 by using a feature recognition technique and an outline recognition technique.

The controller 304 may generate the first feature vector 520 based on the image 511 corresponding to the recognized face area. In other words, the control unit 304 may generate the first feature vector 520 only from the image 511 that is the subject of the condition evaluation, excluding a region of the skin image 510 that is not subject to condition evaluation. Accordingly, the present invention can exclude an element of inaccuracy in evaluating a skin condition according to an image acquisition state or method.

Meanwhile, in generating the first feature vector, the controller 304 may generate the first feature vector by further considering at least one physical quantity of skin or a physical quantity of an environment in which the skin is exposed.

In the case of images, only visual information is involved. Therefore, it may be difficult to obtain information other than visual information about the skin from the image (for example, the elasticity of the skin, the degree of moisture in the skin, the keratin thickness of the skin, the thickness of the makeup applied to the skin, etc.). In generating the first feature vector, the control unit 304 according to an embodiment of the present invention may generate the first feature vector by further considering at least one physical quantity of the skin. Exemplarily, moisture information of the skin may be obtained from the skin measuring device according to the embodiment.

In addition, the result of the image may be different depending on the acquisition environment. For example, when an image is acquired under lighting conditions of a specific color, the color of the skin on the image may be different from the color of the original skin. In generating the first feature vector, the controller 304 according to an embodiment of the present invention may generate the first feature vector by further considering a physical quantity for an environment in which the skin is exposed.

Meanwhile, one or more physical quantities for the skin or physical quantities for the environment in which the skin is exposed may be obtained and transmitted by the aforementioned skin measurement apparatus 200 and/or the user terminal 400.

Accordingly, the present invention can more accurately evaluate the condition of the skin in consideration of various environmental factors.

Referring back to FIG. 26, the control unit 304 according to an embodiment of the present invention includes an attribute value for at least one attribute of the first feature vector 321 and the training skin image 311 generated by the above-described process. The first skin recognizer 331 may be updated based on 312. In this case, the attribute value 312 for at least one attribute of the skin may be in the form of a second feature vector 322. In other words, a second feature vector 322 corresponding to an attribute value 312 for at least one attribute of the skin may be marked on the training skin image 311. The second feature vector 322 may be generated through a separate conversion process for the attribute value 312 for at least one attribute of the skin.

As described above, the first skin recognizer 331 includes a first feature vector corresponding to each of a plurality of skin images generated by a machine learning technique and one or more attribute values of each of the plurality of skins. It may be a correlation between the second feature vectors, that is, mapping information of both.

The control unit 304 according to an embodiment of the present invention includes the first feature vector 321 generated by the above-described process and the attribute value 312 for at least one attribute of the skin (that is, the second feature vector 322). The first skin recognizer 331 may be updated by updating the data set of the first skin recognizer 331 so that) can be mapped to each other. For example, when the data set of the first skin recognizer 331 is composed of a plurality of coefficients as shown in FIG. 26, the control unit 304 includes a first feature vector 321 and a second feature vector 322 Based on, coefficients constituting the first skin recognizer 331 may be adjusted.

The control unit 304 repeatedly generates a first feature vector from a plurality of training skin images, repeatedly acquires an attribute value (ie, a second feature vector) for at least one attribute of the skin, and repetitively obtains coefficients based thereon. By updating to, a first skin recognizer 331 that provides a skin attribute value with improved accuracy may be obtained.

Subsequently, the control unit 304 according to an embodiment of the present invention updates the second skin recognizer 332 based on the second feature vector 322 and the skin level 313 included in the training skin image information. can do. In this case, the skin level 313 may be in the form of a third feature vector 323. In other words, the training skin image 311 may be labeled with a third feature vector 323 corresponding to the grade of the skin. The third feature vector 323 may also be generated through a separate conversion process for the skin grade 313.

As described above, the second skin recognizer 332 also has a second feature vector corresponding to one or more attribute values of each of a plurality of skins generated by a machine learning technique, and a second feature vector corresponding to the grade of each of the plurality of skins. It may be correlation between 3 feature vectors, that is, mapping information between both.

The control unit 304 according to an embodiment of the present invention is configured to match (map) the second feature vector 322 and the skin grade 313 (that is, the third feature vector 323) to each other. The second skin recognizer 332 may be updated by updating the data set of the recognizer 332. For example, when the data set of the second skin recognizer 332 is composed of a plurality of coefficients as shown in FIG. 26, the control unit 304 includes a second feature vector 322 and a third feature vector 323 Coefficients constituting the second skin recognizer 332 may be adjusted based on.

The control unit 304 may acquire the second skin recognizer 332 that provides a grade of skin with improved accuracy by repeatedly acquiring the second and third feature vectors and repeatedly updating coefficients based thereon. .

Accordingly, the present invention can obtain a first skin recognizer 331 that provides an attribute value with high accuracy and a second skin recognizer 332 that provides a grade with high accuracy.

<How to determine the skin attribute value and skin grade>

In the above, the method of generating the skin recognizers 331 and 332 by the skin condition evaluation apparatus 301 has been described with reference to FIG. 26. Hereinafter, a method of determining the attribute value and grade of the skin to be evaluated by the skin condition evaluation apparatus 301 generated by the above-described process will be described with reference to FIG. 27.

Hereinafter, it is assumed that the skin recognizers 331 and 332 are generated by the skin condition evaluation apparatus 301 by the above-described process.

FIG. 27 illustrates a method in which the skin condition evaluation apparatus 301 according to an embodiment of the present invention determines attribute values and grades of the skin to be evaluated using the skin recognizers 331 and 332.

Referring to FIG. 27, the controller 304 of the apparatus 301 for evaluating a skin condition according to an embodiment of the present invention may receive a skin image 411 of the skin to be evaluated.

In this case, the controller 304 may receive the skin image 411 from the user terminal 400 or may receive the skin image 411 from the skin measurement device 200.

The controller 304 according to an embodiment of the present invention may generate the first feature vector 421 for the skin image 411. As described in FIG. 26, the controller 304 may generate a first feature vector based on image analysis of the skin image 411. For example, the controller 304 may recognize a face area from the skin image 411 for more accurate evaluation of the skin condition, and will be described with reference to FIG. 28. The controller 304 may determine a face area in the image 510 by using a feature recognition technique and an outline recognition technique. The controller 304 may generate the first feature vector 520 based on the image 511 corresponding to the recognized face area. In other words, the control unit 304 may generate the first feature vector 520 only from the image 511 that is the subject of the condition evaluation, excluding a region of the skin image 510 that is not subject to condition evaluation. Accordingly, the present invention can exclude an element of inaccuracy in evaluating a skin condition according to an image acquisition state or method.

Meanwhile, in generating the first feature vector, the controller 304 may generate the first feature vector by further considering at least one physical quantity of skin or a physical quantity of an environment in which the skin is exposed.

In the case of images, only visual information is involved. Therefore, it may be difficult to obtain information other than visual information about the skin from the image (for example, the elasticity of the skin, the degree of moisture in the skin, the keratin thickness of the skin, the thickness of the makeup applied to the skin, etc.). In generating the first feature vector, the control unit 304 according to an embodiment of the present invention may generate the first feature vector by further considering at least one physical quantity of the skin.

In addition, the result of the image may be different depending on the acquisition environment. For example, when an image is acquired under lighting conditions of a specific color, the color of the skin on the image may be different from the color of the original skin. In generating the first feature vector, the controller 304 according to an embodiment of the present invention may generate the first feature vector by further considering a physical quantity for an environment in which the skin is exposed.

Meanwhile, one or more physical quantities for the skin or physical quantities for the environment in which the skin is exposed may be obtained and transmitted by the aforementioned skin measurement apparatus 200 and/or the user terminal 400.

Accordingly, the present invention can more accurately evaluate the condition of the skin in consideration of various environmental factors.

Based on the first feature vector 421 and the first skin recognizer 331, the control unit 304 according to an embodiment of the present invention includes a second feature vector 422 corresponding to an attribute value for at least one attribute of the skin. ) Can be determined.

As described above, the first skin recognizer 331 includes a first feature vector corresponding to each of a plurality of skin images generated by a machine learning technique and one or more attribute values of each of the plurality of skins. It may be a correlation between the second feature vectors, that is, mapping information of both.

Accordingly, the control unit 304 according to an embodiment of the present invention inputs the first feature vector 421 generated from the skin image 411 into the first skin recognizer 331 and outputs the second feature vector 422 as an output result. Can be obtained. In this case, the second feature vector 422 may include a vector component corresponding to each of at least one attribute of the skin. For example, the second feature vector 422 may include two vector components corresponding to the degree of redness of the skin, six vector components corresponding to the degree of wrinkles of the skin, and three vector components corresponding to the flatness of the skin. have.

Accordingly, the present invention may obtain attribute values for one or more attributes of the skin from the skin image 411. In this case, the attribute value itself may have a meaning as an index indicating the condition of the skin, as well as a meaning as a basis for determining the grade of the skin.

Subsequently, the control unit 304 according to an embodiment of the present invention may determine the level of the skin based on the second feature vector 422 and the second skin recognizer 332.

As described above, the second skin recognizer 332 includes a second feature vector corresponding to one or more attribute values of each of a plurality of skins generated by a machine learning technique and a second feature vector corresponding to the grade of each of the plurality of skins. It may be correlation between 3 feature vectors, that is, mapping information between both.

Therefore, the control unit 304 according to an embodiment of the present invention inputs the second feature vector 422 obtained by the above-described process to the second skin recognizer 332 and uses the third feature vector 431 as an output result. Can be obtained. In this case, the third feature vector 431 may have a meaning as a vector indicating the grade of the skin. Of course, the third feature vector 431 may include a vector component corresponding to the grade of the skin.

Accordingly, in the present invention, the attribute value for each attribute of the skin can be checked, and an objective grade of the skin can be determined based on this.

The control unit 304 according to an embodiment of the present invention may provide at least some of information corresponding to each of the second feature vector and the third feature vector determined by the above-described process to the user terminal 400. In this case, the information corresponding to the second feature vector may be an attribute value for each attribute of the skin. Also, the information corresponding to the third feature vector may be an evaluation grade of the skin.

In an optional embodiment, the controller 304 may provide at least some of information corresponding to each of the second feature vector and the third feature vector determined by the above-described process to the skin measurement apparatus 200.

At this time, the information corresponding to the third feature vector, that is, the evaluation grade of the skin, can have meaning as the overall condition of the skin, and the information corresponding to the second feature vector, that is, the attribute value for each attribute of the skin, is It can have meaning as individual information indicating which areas need improvement in a specific treatment.

In addition, the control unit 304 according to an embodiment of the present invention determines a recommended management product (microneedle patch) based on the above-described attribute value for each attribute of the skin and the skin grade, and adds this to the user terminal 400. Can provide. Accordingly, the present invention can provide an integrated solution based on each condition in addition to analyzing the condition of the skin.

Meanwhile, the controller 304 receives the user's selection information for the recommended management product provided to the user terminal 400 by the above-described process, and based on the user's selection information, the attribute value and skin The grade can be transmitted to a third server (not shown). In this case, the third server (not shown) may be a server of the operating entity of the recommended management product.

29 is a flowchart illustrating a method of evaluating a skin condition performed by the apparatus 301 for evaluating a skin condition according to an embodiment of the present invention.

Hereinafter, it is assumed that the skin recognizers 331 and 332 are generated by the skin condition evaluation apparatus 301 by the above-described process. In other words, it is assumed that the first skin recognizer 331 and the second skin recognizer 332 are trained by the skin condition evaluation apparatus 301 according to S61 and S62.

The skin condition evaluation apparatus 301 according to an embodiment of the present invention may receive a skin image of the skin to be evaluated (S63).

Referring again to FIG. 27, the skin condition evaluation device 301 may receive a skin image 411 from the user terminal 400 or a skin image 411 from the skin measurement device 200. have.

The skin condition evaluation apparatus 301 according to an embodiment of the present invention may generate a first feature vector 421 for the skin image 411. As described with reference to FIG. 26, the skin condition evaluation apparatus 301 may generate a first feature vector based on image analysis of the skin image 411.

Meanwhile, in generating the first feature vector, the skin condition evaluation apparatus 301 may generate the first feature vector by further considering at least one physical quantity of skin or a physical quantity of an environment in which the skin is exposed.

In the case of images, only visual information is involved. Therefore, it may be difficult to obtain information other than visual information about the skin from the image (for example, the elasticity of the skin, the degree of moisture in the skin, the keratin thickness of the skin, the thickness of the makeup applied to the skin, etc.). The skin condition evaluation apparatus 301 according to an embodiment of the present invention may generate the first feature vector by further considering at least one physical quantity of the skin in generating the first feature vector.

In addition, the result of the image may be different depending on the acquisition environment. For example, when an image is acquired under lighting conditions of a specific color, the color of the skin on the image may be different from the color of the original skin. In generating the first feature vector, the skin condition evaluation apparatus 301 according to an embodiment of the present invention may generate the first feature vector by further considering a physical quantity for an environment in which the skin is exposed.

Meanwhile, one or more physical quantities for the skin or physical quantities for the environment in which the skin is exposed may be obtained and transmitted by the aforementioned skin measurement apparatus 200 and/or the user terminal 400.

Accordingly, the present invention can more accurately evaluate the condition of the skin in consideration of various environmental factors.

Subsequently, the skin condition evaluation apparatus 301 according to an embodiment of the present invention uses a second feature vector 421 and a second skin recognizer 331 corresponding to an attribute value for at least one attribute of the skin based on the first feature vector 421 and the first skin recognizer 331. The feature vector 422 may be determined (S65).

As described above, the first skin recognizer 331 includes a first feature vector corresponding to each of a plurality of skin images generated by a machine learning technique and one or more attribute values of each of the plurality of skins. It may be a correlation between the second feature vectors, that is, mapping information of both.

Accordingly, the skin condition evaluation apparatus 301 according to an embodiment of the present invention inputs the first feature vector 421 generated from the skin image 411 to the first skin recognizer 331 and outputs the second feature vector as an output result. (422) can be obtained. In this case, the second feature vector 422 may include a vector component corresponding to each of at least one attribute of the skin. For example, the second feature vector 422 may include two vector components corresponding to the degree of redness of the skin, six vector components corresponding to the degree of wrinkles of the skin, and three vector components corresponding to the flatness of the skin. have. Accordingly, the present invention can obtain attribute values for one or more attributes of the skin from the skin image. At this time, the attribute value itself may have a meaning as an index indicating the condition of the skin, as well as a meaning as a basis for determining the grade of the skin.

Subsequently, the skin condition evaluation apparatus 301 according to an embodiment of the present invention may determine a skin level based on the second feature vector 422 and the second skin recognizer 332 (S66).

As described above, the second skin recognizer 332 includes a second feature vector corresponding to one or more attribute values of each of a plurality of skins generated by a machine learning technique and a second feature vector corresponding to the grade of each of the plurality of skins. It may be correlation between 3 feature vectors, that is, mapping information between both.

Therefore, the skin condition evaluation apparatus 301 according to an embodiment of the present invention inputs the second feature vector 422 obtained by the above-described process to the second skin recognizer 332 and outputs the third feature vector ( 431) can be obtained. In this case, the third feature vector 431 may have a meaning as a vector indicating the grade of the skin. Of course, the third feature vector 431 may include a vector component corresponding to the grade of the skin.

Accordingly, the present invention checks the attribute values for each attribute of the skin, and determines an objective grade of the skin based on this, so that appropriate measures can be taken for the corresponding skin.

The skin condition evaluation apparatus 301 according to an embodiment of the present invention may provide at least some of information corresponding to each of the second feature vector and the third feature vector determined by the above-described process to the user terminal 400. (S67) In this case, the information corresponding to the second feature vector may be an attribute value for each attribute of the skin. Also, the information corresponding to the third feature vector may be an evaluation grade of the skin.

In an optional embodiment, the skin condition evaluation apparatus 301 may provide at least some of the information corresponding to each of the second feature vector and the third feature vector determined by the above-described process to the skin measurement apparatus 200.

At this time, the information corresponding to the third feature vector, that is, the evaluation grade of the skin, can have meaning as the overall condition of the skin, and the information corresponding to the second feature vector, that is, the attribute value for each attribute of the skin, is It can have meaning as individual information indicating which areas need improvement in a specific treatment.

In addition, the skin condition evaluation apparatus 110 according to an embodiment of the present invention determines a recommended management product based on the above-described attribute value and skin grade for each attribute of the skin, and further provides this to the user terminal 200. I can. In this case, the recommended management product may include at least one of a treatment service for skin management, a product for skin management, and educational content for skin management. In other words, it is also possible to provide general treatment service information in addition to the microneedle patch.

Accordingly, the present invention can provide an integrated solution based on each condition in addition to analyzing the condition of the skin.

Meanwhile, the skin condition evaluation device 110 receives the user's selection information for the recommended management product provided to the user terminal 200 through the above-described process, and attributes for each attribute of the skin based on the user's selection information. The value and skin level may be transmitted to a third server (not shown). In this case, the third server (not shown) may be a server of the operating entity of the recommended management product.

For example, in the case of receiving selection information on the'treatment service for skin management' from the user terminal 200, the skin condition evaluation device 110 is a server of a medical institution providing the treatment service, and attribute values for each attribute of the skin And the skin grade can be transmitted. In this case, the skin condition evaluation device 110 may transmit the skin image together. The transmitted information can be used in a series of procedures for treatment of the skin (eg, the assignment of a specialist).

In addition, in the case of receiving selection information on'product or content for skin management' from the user terminal 200, the skin condition evaluation device 110 is a server that provides the product or content and provides attribute values for each attribute of the skin. And the skin grade can be transmitted.

Accordingly, the present invention not only enables accurate skin diagnosis from an image of the skin, but also provides an appropriate treatment method according to the skin condition in connection with a subsequent procedure.

The embodiment according to the present invention described above may be implemented in the form of a computer program that can be executed through various components on a computer, and such a computer program may be recorded in a computer-readable medium. In this case, the medium may store a program executable by a computer. Examples of media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magnetic-optical media such as floptical disks, and And a ROM, RAM, flash memory, and the like, and may be configured to store program instructions.

Meanwhile, the computer program may be specially designed and configured for the present invention, or may be known and usable to those skilled in the computer software field. Examples of the computer program may include not only machine language codes produced by a compiler but also high-level language codes that can be executed by a computer using an interpreter or the like.

The specific implementations described in the present invention are examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings exemplarily represent functional connections and/or physical or circuit connections, and in an actual device, various functional connections that can be replaced or additionally It may be referred to as a connection, or circuit connections. In addition, if there is no specific mention such as “essential” or “importantly”, it may not be an essential component for the application of the present invention.

Accordingly, the spirit of the present invention is limited to the above-described embodiments and should not be defined, and all ranges equivalent to or equivalently changed from the claims to be described later as well as the claims to be described later are the scope of the spirit of the present invention. It will be said to belong to.

Claims (12)

Obtaining a first skin image using a skin measuring device;
Analyzing the primary skin image;
Transmitting the analysis result of the primary skin image to a user terminal; And
Including the step of detecting whether the patch is used after the step of transmitting to the user terminal,
The step of transmitting to the user terminal,
Selecting a patch that matches the analysis result of the skin image,
Transmit information about the patch together with the analysis result of the skin image,
The step of detecting whether the patch is used,
When the tagging information of the microneedle patch is received from the user terminal, attribute information of the microneedle patch matching the tagging information is obtained,
Generates a use end timer of the microneedle patch based on the used capacity among the attribute information, and when the timer expires, an alarm to the user to end the use of the microneedle patch through a user terminal,
The skin meter,
Body;
An image sensor disposed on the body to photograph the user's skin;
A temperature sensor disposed on the body to measure a user's temperature;
A distance adjusting device disposed on the body and capable of adjusting an appropriate distance to the image sensor;
A first light source disposed on the body to irradiate light toward a user;
A second light source disposed on the body to irradiate light toward a user; And
Including a control unit in communication with the image sensor and the temperature sensor,
The control unit drives the first light source and the image sensor to obtain a first skin image, and drives the second light source and the image sensor to obtain a second skin image.
The method of claim 1,
After the step of detecting whether the patch is used
Obtaining a second skin image,
Re-analyzing the secondary skin image; And
Including the step of transmitting the analysis result of the secondary skin image to the user terminal,
In the step of transmitting the analysis result of the secondary skin image to the user terminal, a method for proposing a patch based on a skin analysis result determines whether or not to reuse a currently used patch by determining a degree of skin improvement.
The method of claim 2,
A patch proposal method based on a skin analysis result suggesting the use of a different type of patch when the skin improvement degree is less than a preset reference value.
The method of claim 1,
Analyzing the primary skin image,
Generating a first characteristic vector from the primary skin image;
Determining a second feature vector corresponding to an attribute value of at least one attribute of the skin based on the first feature vector and a first skin recognizer; And
Determining a grade of the skin based on the second feature vector and a second skin recognizer; Including,
The first skin recognizer
A data set expressing a correlation between a first feature vector corresponding to each of a plurality of skin images and a second feature vector corresponding to one or more attribute values of each of the plurality of skins,
The second skin recognizer
A method for proposing a patch based on a skin analysis result, which is a data set expressing a correlation between a second feature vector corresponding to one or more attribute values of each of a plurality of skins and a third feature vector corresponding to each grade of the plurality of skins.
The method of claim 4,
The above properties are
Including the degree of redness of the skin, the degree of wrinkles of the skin, and the flatness of the skin,
The second feature vector is
A method for proposing a patch based on a skin analysis result comprising at least one vector component corresponding to each of the flushing degree, the wrinkle degree, and the flatness.
The method of claim 1,
Analyzing the primary skin image,
A method for proposing a patch based on a skin analysis result of obtaining a plurality of skin images photographed in different directions from the skin measuring device, generating a three-dimensional image, and analyzing a skin condition using the three-dimensional image.
The method of claim 1,
The skin meter,
The body has a convex shape in a direction perpendicular to the longitudinal direction,
The body includes a first area whose cross-sectional area increases in the longitudinal direction, and a second area whose cross-sectional area decreases in the longitudinal direction,
The first region has a concave surface formed by cutting-out a partial region,
The image sensor, the temperature sensor, and the distance control device are a method of proposing a patch based on a skin analysis result disposed on the concave.
The method of claim 1,
The microneedle patch
Base layer;
Including a needle array disposed on the base layer,
The needle array
matrix;
Including a plurality of microstructures disposed on the matrix,
The plurality of microstructures have a triangular pyramid shape,
The microstructure is a method for proposing a patch based on the result of skin analysis including a gold and silver flower (Lonecera Flower). delete delete delete delete

Images