KR20210069495A - Electronic apparatus and controlling method thereof - Google Patents

Abstract

The present disclosure provides an electronic device and a controlling method thereof. The electronic device of the present disclosure comprises: a camera; a communication unit; and a processor that obtains information on a user's skin condition included in an image based on the image obtained through a camera, identifies a skin care course based on a device specification of a skin care device communicatively connected to the electronic device through the communication unit, and transmits information on the identified skin care course to the skin care device.

Description

ELECTRONIC APPARATUS AND CONTROLLING METHOD THEREOF

The present disclosure relates to an electronic device and a control method thereof, and more particularly, to an electronic device communicating with a skin care device and a control method thereof.

BACKGROUND ART With the development of electronic technology, various types of electronic devices are being developed and distributed. In particular, recently, a skin care device that can be easily used at home has been developed and disseminated.

In general, a skin care device uses a light source, such as an LED mask, a galvanic device, to care for or manage a user's skin.

However, in the case of the existing skin care device, the user checks his or her skin condition (eg, acne, pores, etc.) and subjectively judges it, and selects one of the limited care courses provided by the skin care device for his/her own skin. It is difficult to systematically manage the user's skin in that it cares for or manages the skin.

Accordingly, there is a need for a method for more accurately analyzing a skin condition and providing a skin care course optimized for the analyzed skin condition.

The present disclosure has been made in response to the above needs, and an object of the present disclosure is to provide an electronic device that communicates with a skin care device to perform a skin care course, and a method for controlling the same.

To achieve the above object, an electronic device according to an embodiment of the present disclosure obtains information on a user's skin condition included in an image based on an image obtained through a camera, a communication unit, and a camera, and includes a plurality of skin The skin care course is identified based on the skin condition acquired during the care course and the device specification of the skin care device communicatively connected to the electronic device through the communication unit, and the communication unit is controlled to transmit information on the identified skin care course to the skin care device. includes a processor that

Here, the electronic device further includes a memory for storing information on a plurality of skin care courses matching a skin condition and a device specification, and the processor is configured to store a plurality of skin conditions corresponding to the acquired skin conditions from among the plurality of stored skin care courses. A care course may be identified, and a skin care course corresponding to a device specification of the skin care apparatus may be identified from among the plurality of identified skin care courses.

Here, the information on the skin condition may include information on at least one of pores, wrinkles, pigmentation, and troubles of the skin.

Meanwhile, the information on the identified skin care course may include information on at least one of a type of an LED driven according to an identified skin condition among a plurality of LEDs included in the skin care device and a driving time of the LED.

Here, the plurality of skin care courses may be different from each other in at least one of a type of an LED driven by the skin care device and a driving time of the LED.

Here, the device specification includes at least one of a number of a plurality of LEDs and a type of each of the plurality of LEDs included in the skin care device, and the processor is based on at least one of the number of the plurality of LEDs and each type of the plurality of LEDs. Accordingly, it is possible to identify a skin care course corresponding to the device specification of the skin care apparatus from among the plurality of skin care courses.

On the other hand, the camera includes a light source unit for irradiating light of a wavelength corresponding to the skin condition and a detection unit for detecting reflected light corresponding to the irradiated light, and the processor irradiates light to the user's skin using the light source unit, and irradiates the light The reflected light may be detected through the detector in response to the detected light, and information on the skin condition included in the image may be obtained based on the image obtained according to the detected reflected light.

Meanwhile, the skin care apparatus may drive at least one LED included in the skin care apparatus based on the information on the skin care course received from the electronic device.

Here, the electronic device may further include a memory, and the processor may store information on the skin condition or result information in which the skin care apparatus is driven according to the information on the skin care course as history information about the user.

Meanwhile, the processor may receive a device specification of the skin care apparatus communicatively connected to the electronic device through the communication unit from the server or the skin care apparatus.

A method of controlling an electronic device according to an embodiment of the present disclosure includes acquiring information on a skin condition of a user included in an image based on an image acquired through a camera of the electronic device, and information on the acquired skin condition identifying a skin care course corresponding to a device specification of a skin care apparatus communicatively connected to an electronic device from among a plurality of skin care courses corresponding to , and transmitting information on the identified skin care course to the skin care apparatus. .

Here, the step of identifying the skin care course may include identifying a plurality of skin care courses corresponding to the skin condition obtained from information about a plurality of skin care courses matching a skin condition and device specification stored in a memory of the electronic device, and , a skin care course corresponding to a device specification of the skin care apparatus may be identified from among the plurality of identified skin care.

Here, the information on the skin condition may include information on at least one of pores, wrinkles, pigmentation, and troubles of the skin.

Meanwhile, the information on the identified skin care course may include information on at least one of a type of an LED driven according to an identified skin condition among a plurality of LEDs included in the skin care device and a driving time of the LED.

Here, the plurality of skin care courses may be different from each other in at least one of a type of an LED driven by the skin care device and a driving time of the LED.

Here, the device specification includes at least one of the number of the plurality of LEDs included in the skin care apparatus and the type of each of the plurality of LEDs, and the step of identifying the skin care course includes the number of the plurality of LEDs and each of the plurality of LEDs. A skin care course corresponding to a device specification of the skin care apparatus among a plurality of skin care courses may be identified based on at least one of the types.

Meanwhile, the step of acquiring information on the skin condition includes irradiating light to the user's skin using a light source unit of the electronic device, detecting reflected light through a detecting unit of the electronic device in response to the irradiated light, and according to the detected reflected light Information on the skin condition included in the image may be acquired based on the acquired image.

Meanwhile, the skin care apparatus may drive at least one LED included in the skin care apparatus based on the information on the skin care course received from the electronic device.

Here, the control method may further include storing information on the skin condition or result information driven by the skin care apparatus according to the information on the skin care course as history information about the user.

Meanwhile, the control method may further include receiving a device specification of the skin care apparatus communicatively connected to the electronic device from a server or the skin care apparatus.

According to various embodiments of the present disclosure as described above, it is possible to provide an electronic device communicating with a skin care device to perform a skin care course and a method for controlling the same.

The electronic device according to an embodiment of the present disclosure may control the skin care device to perform an optimized skin care course based on the user's skin condition. Also, the electronic device may control the skin care apparatus to perform an optimized skin care course based on device specifications of the skin care apparatus.

1 is a view for explaining a skin care system according to an embodiment of the present disclosure.
2A is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure.
2B is a block diagram illustrating an additional configuration of an electronic device according to an embodiment of the present disclosure.
3 is a block diagram illustrating a configuration of a skin care device according to an embodiment of the present disclosure.
4 is a view for explaining a correlation between a skin condition and a wavelength of light according to an embodiment of the present disclosure.
5 is a view for explaining a skin care course according to an embodiment of the present disclosure.
6 is a view for explaining a skin care course according to an embodiment of the present disclosure.
7 is a view for explaining a method of identifying a skin care course for each area according to an embodiment of the present disclosure.
8 is a view for explaining a method of identifying a skin care course for each user according to an embodiment of the present disclosure.
9 is a diagram for explaining a screen displayed on an electronic device according to an embodiment of the present disclosure.
10 is a diagram for explaining a flowchart according to an embodiment of the present disclosure.

In describing the present disclosure, if it is determined that a detailed description of a related known function or configuration may unnecessarily obscure the subject matter of the present disclosure, a detailed description thereof will be omitted. In addition, the following examples may be modified in various other forms, and the scope of the technical spirit of the present disclosure is not limited to the following examples. Rather, these embodiments are provided to more fully and complete the present disclosure, and to fully convey the technical spirit of the present disclosure to those skilled in the art.

It is to be understood that the techniques described in the present disclosure are not intended to be limited to specific embodiments, and include various modifications, equivalents, and/or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, like reference numerals may be used for like components.

As used in the present disclosure, expressions such as "first," "second," "first," or "second," may modify various elements, regardless of order and/or importance, and refer to one element. It is used only to distinguish it from other components, and does not limit the above components.

In this disclosure, expressions such as “A or B,” “at least one of A and/and B,” or “one or more of A or/and B” may include all possible combinations of the items listed together. . For example, "A or B," "at least one of A and B," or "at least one of A or B" means (1) includes at least one A, (2) includes at least one B; Or (3) it may refer to all cases including both at least one A and at least one B.

In this disclosure, the singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as "comprises" or "consisting of" are intended to designate that the features, numbers, steps, operations, components, parts, or combinations thereof described in the specification exist, and are intended to indicate that one or more other It is to be understood that this does not preclude the possibility of addition or presence of features or numbers, steps, operations, components, parts, or combinations thereof.

A component (eg, a first component) is "coupled with/to (operatively or communicatively)" to another component (eg, a second component) When referring to "connected to", it will be understood that the certain element may be directly connected to the other element or may be connected through another element (eg, a third element). On the other hand, when it is said that a component (eg, a first component) is "directly connected" or "directly connected" to another component (eg, a second component), the component and the It may be understood that other components (eg, a third component) do not exist between other components.

The expression "configured to (or configured to)" as used in this disclosure depends on the context, for example, "suitable for," "having the capacity to" ," "designed to," "adapted to," "made to," or "capable of." The term “configured (or configured to)” may not necessarily mean only “specifically designed to” in hardware. Instead, in some circumstances, the expression “a device configured to” may mean that the device is “capable of” with other devices or parts. For example, the phrase “a processor configured (or configured to perform) A, B, and C” refers to a dedicated processor (eg, an embedded processor) for performing the above operations, or by executing one or more software programs stored in a memory device. , may mean a generic-purpose processor (eg, a CPU or an application processor) capable of performing the above operations.

An electronic device according to various embodiments of the present disclosure, for example, a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, desktop personal computer, laptop personal computer, netbook computer, workstation, server, personal digital assistant, PMP (portable multimedia player), MP3 player, mobile medical It may include at least one of a device, a camera, and a wearable device. According to various embodiments, the wearable device is an accessory type (eg, a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted-device (HMD)), a fabric or an integrated clothing ( It may include at least one of: electronic clothing), body attachable (eg skin pad or tattoo), or bioimplantable (eg implantable circuit).

Also, in some embodiments, the electronic device may be a home appliance. Home appliances are, for example, televisions, digital video disk (DVD) players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwave ovens, washing machines, air purifiers, set-top boxes, home automation controls. Panel (home automation control panel), security control panel (security control panel), TV box (e.g. Samsung HomeSync??, Apple TV??, or Google TV??), game console (e.g. Xbox??, PlayStation? ?), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame.

In another embodiment, the electronic device may include various medical devices (eg, various portable medical devices (eg, a blood glucose monitor, a heart rate monitor, a blood pressure monitor, or a body temperature monitor), magnetic resonance angiography (MRA), magnetic resonance imaging (MRI), Computed tomography (CT), imager, or ultrasound machine, etc.), navigation devices, global navigation satellite system (GNSS), event data recorder (EDR), flight data recorder (FDR), automotive infotainment ) devices, ship electronic equipment (e.g. ship navigation systems, gyro compasses, etc.), avionics, security devices, vehicle head units, industrial or domestic robots, and automatic teller's machines (ATMs) in financial institutions. , point of sales (POS) in stores, or internet of things (e.g. light bulbs, sensors, electricity or gas meters, sprinkler devices, smoke alarms, thermostats, street lights, toasters) , exercise equipment, hot water tank, heater, boiler, etc.) may include at least one.

According to another embodiment, the electronic device is a piece of furniture or a building/structure, an electronic board, an electronic signature receiving device, a projector, or various measuring devices (eg, : water, electricity, gas, or radio wave measuring device). In various embodiments, the electronic device may be a combination of one or more of the various devices described above. The electronic device according to an embodiment may be a flexible electronic device. In addition, the electronic device according to the embodiment of the present document is not limited to the above-described devices, and may include a new electronic device according to technological development.

1 is a view for explaining a skin care system according to an embodiment of the present disclosure.

Referring to FIG. 1 , a skin care system 1000 according to an embodiment of the present disclosure may include an electronic device 100 and a skin care device 200 .

The electronic device 100 may be implemented as a smart mirror as shown in FIG. 1 . Here, the smart mirror may perform a function of reflecting light incident from the outside or displaying information visually. That is, the smart mirror may display an image or text on at least one area of the display while showing an external object (eg, a user) through a display (not shown). However, this is only an example, and the electronic device 100 may be implemented as a user terminal device such as a smartphone, and the electronic device 100 may include the aforementioned tablet, wearable device, PC, smart TV, smart speaker, and artificial intelligence (AI). It may be implemented as various electronic devices capable of communicating with the skin care device 200 such as a speaker, an air conditioner, a refrigerator, and the like.

The electronic device 100 may determine the user's skin condition and control the skin care apparatus 200 to provide a skin care service according to the user's skin condition. Specifically, the electronic device 100 may determine (or identify) the user's skin condition. For example, the electronic device 100 may analyze a photographed image of the user's skin to determine (or identify) skin conditions such as pores, wrinkles, pigmentation, and troubles. In addition, the electronic device 100 may control the skin care device 200 to perform a skin care course according to the user's skin condition. To this end, the electronic device 100 may transmit and receive various information by performing wired or wireless communication according to various communication methods with the skin care apparatus 200 .

Here, the skin is a tissue surrounding the internal organs of the body and serves to protect the internal organs. Specifically, the skin may refer to the largest tissue in the integumentary system, consisting of a plurality of epithelial tissues that protect muscles and organs in the body. The skin according to an embodiment of the present disclosure may be skin corresponding to the user's face (face), but is not limited thereto and may be skin corresponding to various body parts such as the user's neck, arms, and legs. Meanwhile, hereinafter, for convenience of description, skin corresponding to body parts such as the face and neck will be referred to as the skin of the face and the skin of the neck.

Here, the skin condition may refer to a condition for various characteristics of the skin that appear visually, and may be used as a factor for determining (determining) a skin care course. Here, each skin characteristic may be various items for visually evaluating the skin, such as pores, wrinkles, pigmentation, troubles, etc. of the skin, and the state is quantitative as one of various indicators such as level, percentile, score, etc. can be expressed as a value.

Here, the pores are pores in which hairs can grow in the epidermal layer of the skin, and the pores may be enlarged due to various causes, such as the accumulation of sebum or wastes secreted by the sebaceous glands in the pores or the decrease in skin elasticity due to aging. On the other hand, wrinkles may refer to a point where the skin is partially folded (or depressed), and when the elasticity of the skin decreases or the moisture of the skin decreases due to various causes such as subcutaneous muscle movement, ultraviolet rays, and aging. Wrinkles may form. On the other hand, pigmentation may refer to a case in which the color of a part of the skin is not uniform with the color of other parts, and when the amount of melanin or hemoglobin in the skin is different (non-uniform) for each area. Pigmentation may occur. Here, the greater the amount of melanin, the darker the skin color (brown or black) may be accompanied by spots and freckles, and the greater the amount of hemoglobin, the redder the skin color, which may be accompanied by erythema, etc. can On the other hand, trouble is a concept including acne, inflammation, tumor, etc. occurring on the skin, and may be caused by various causes such as sleep, stress, hormones, and sebum secretion.

The information on the skin condition is information quantitatively indicating the state of various skin characteristics analyzed based on images taken of the skin, and may include information on at least one of pores, wrinkles, pigmentation, and troubles of the skin. .

The skin care apparatus 200 may be driven to perform an operation according to a skin care course in order to improve the skin conditions of various users. For example, the skin care apparatus 200 may irradiate light to the user's skin according to the user's manipulation or control of the electronic device 100 through communication. Accordingly, by using the principle that light promotes biochemical reactions in the skin, it can improve various skin conditions such as reducing the size of pores, reducing the amount of sebum, increasing the elasticity of the skin, reducing the size or depth of wrinkles, whitening effect, and improving trouble. can

For example, the skin care device 200 may be implemented as a photo mask device (LED mask device) having a mask shape that can be worn on the user's face as shown in FIG. 1 , and the skin care device 200 may be implemented by the user It is possible to improve the skin condition of the face by irradiating light on the skin of the face. However, this is only an example, and the skin care device 200 may be implemented as various electronic devices capable of caring for the user's skin. For example, the skin care device 200 uses various methods such as light, ultrasound, low frequency, high frequency, and microcurrent (eg, galvanic, etc.) to treat the skin of various users' bodies, such as facial skin, neck skin, and scalp. It may be implemented as an electronic device capable of taking care (eg, a photomask device, a neck care device, a scalp care device, a heating device, a galvanic device, a massage device, an ultrasound device, etc.).

Here, the skin care course is one operation or a plurality of operations performed by the skin care device 200 to improve (or care for) skin conditions (or skin characteristics) such as pores, wrinkles, pigmentation, and troubles. Represents a set of actions. That is, the skin care course may indicate that the operation of the skin care apparatus 200 for improving skin characteristics is set. For example, in the first skin care course, the Red LED of the skin care device 200 is set to irradiate visible red light to the facial skin for 10 minutes in order to improve the condition of wrinkles, and the second skin care course In order to improve the condition, the blue LED of the skin care device 200 may be set to irradiate blue visible light to the skin of the face for 1 minute.

The electronic device 100 according to an embodiment of the present disclosure identifies (or determines) a skin care course based on a user's skin condition and a device specification of the skin care apparatus 200, and provides information on the skin care course to the skin. may be transmitted to the care device 200 .

Here, the device specification may refer to indicating the specification of a corresponding device (device). Specifically, the device specification may include information on hardware or software constituting the corresponding device.

In this case, the skin care apparatus 200 may perform an operation according to the skin care course included in the received information. That is, the skin care apparatus 200 may perform an operation according to a skin care course that varies according to a user's skin condition and device specifications of the skin care apparatus 200 .

According to various embodiments of the present disclosure as described above, the electronic device 100 may control the skin care device 200 to perform an optimized skin care course based on the user's skin condition. Also, the electronic device 100 may control the skin care apparatus 200 to perform an optimized skin care course based on the device specification of the skin care apparatus 200 . Accordingly, it is possible to provide an optimized skin care service to the user.

Hereinafter, an electronic device of the present disclosure will be described in detail with reference to the accompanying drawings.

2A is a block diagram illustrating a configuration of an electronic device according to an embodiment of the present disclosure. 2B is a block diagram illustrating an additional configuration of an electronic device according to an embodiment of the present disclosure.

First, referring to FIG. 2A , the electronic device 100 according to an embodiment of the present disclosure may include a camera 110 , a communication unit 120 , and a processor 130 .

The camera 110 may acquire an image including an object. Specifically, the camera 110 may detect light reflected from a subject (eg, a user) to obtain an image including an object (eg, a 2D or 3D object) corresponding to the shape of the subject.

To this end, the camera 110 may be implemented with various cameras, such as an RGB camera, an IR camera, a UV camera, a depth camera, and a hyperspectral camera. The RGB camera, IR camera, and UV camera can acquire image information in two-dimensional space by detecting visible light, infrared light, and ultraviolet light, respectively. On the other hand, the Depth camera represents image information (eg, gradation value or color value) and depth information (eg, perspective) for each pixel in a two-dimensional space (eg, XY plane), depth information on the Z axis perpendicular to the XY plane, etc. ) can be acquired together to acquire three-dimensional data, and it can also be implemented in combination with RGB, IR, UV cameras, etc. Here, the depth information may be obtained according to various methods such as stereo-type, time-of-flight (ToF), structured pattern, and the like. Meanwhile, a hyperspectral camera may acquire three-dimensional data by simultaneously acquiring image information in a two-dimensional space and wavelength information of each pixel.

Referring to FIG. 2B , the camera 110 according to an embodiment of the present disclosure may include a light source unit 111 and a detection unit 112 .

The light source unit 111 may irradiate light to the user's skin. For example, when a user command for acquiring an image is received, the light source unit 111 may irradiate light to the user's skin. In this case, when light is irradiated from the light source unit 111 to the user's skin, the detection unit 112 may detect the light reflected from the user's skin to obtain an image including an object corresponding to the user's skin.

Here, the light source unit 111 may irradiate light of a wavelength corresponding to the skin condition. Here, the irradiated light may be at least one of infrared rays (eg, near-infrared, mid-infrared, far-infrared, etc.) classified according to wavelength (or color), visible light, and ultraviolet (eg, near-ultraviolet, mid-ultraviolet, far-ultraviolet, etc.). Further, the irradiated light may be polarized light. In addition, the light corresponding to the skin condition may be a light set to detect (or analyze) various user's skin conditions (eg, pores, wrinkles, pigmentation, troubles, etc.). For example, light for detecting pores or wrinkles may be set to visible light, light for detecting troubles may be set to ultraviolet light, and light for detecting pigmentation may be set to polarized light. However, this is only an example, and it is also possible that the light corresponding to the skin condition is set differently according to various algorithms for detecting the skin condition.

Specifically, referring to FIG. 4 , the light source unit 111 may include a light emitting device 111a. For example, the light emitting device 111a may be implemented with various devices such as a Light Emitting Diode (LED), etc., and the light emitting device 111a uses infrared rays (eg, near infrared rays, mid infrared rays, far infrared rays, etc.), visible light on the skin of the user. It may be implemented as an LED type capable of emitting at least one of light rays and ultraviolet rays (eg, near ultraviolet rays, mid ultraviolet rays, far ultraviolet rays, etc.). In addition, the light emitting device 111a may be disposed so that the light irradiation direction faces the user's skin. In this case, the light source unit 111 may irradiate at least one of infrared rays, visible rays, and ultraviolet rays to the user's skin by the light emitting element 111a.

For example, the light source unit 111 may include a light emitting device 111a that emits light of a specific wavelength in consideration of absorption or reflectance according to wavelength for a skin condition. Here, when the light emitting element 111a is implemented as a plurality of types (ie, when a plurality of types of LEDs are included in the light source unit 111 ), the processor 130 performs a specific skin condition in order to identify a specific skin condition. By driving the light source element 111a of a type corresponding to , light may be irradiated to the user's skin.

Also, referring to FIG. 4 , the light source unit 111 may include a polarization filter 111b, and the polarization filter 111b is on a path in which the light emitted from the light emitting device 111a proceeds toward the user's skin. can be placed. In this case, the light source unit 111 may irradiate the polarized light converted through the polarization filter 111b to the user's skin. Here, the polarization filter 111b may be implemented as a horizontal polarization filter that horizontally polarizes light, a vertical polarization filter that vertically polarizes light, and the like. Meanwhile, unlike FIG. 4 , the polarization filter 111b may be modified to be disposed inside the light emitting device 111a.

The detector 112 may detect reflected light corresponding to the irradiated light. To this end, referring to FIG. 4 , the detection unit 112 may include a detection element 112a. The detection element 112a may include a lens, an image sensor, and an image processor. The lens collects or diverges the light reflected from the subject by an image sensor composed of a pixel array (a set of pixels) in a two-dimensional space, and the image sensor detects the light transmitted from the lens in units of pixels and detects the amount of light ( or wavelength), and the image processor may acquire an image including a plurality of pixels having grayscales corresponding to the electrical signal. In this case, the acquired image may include an object corresponding to the subject. Here, the image sensor may be implemented as a complementary metal-oxide semiconductor (COMS) or a charge coupled device (CCD).

Meanwhile, referring to FIG. 4 , the detection unit 112 may include a filter 112b, and the filter 112b may be disposed on a path through which light received by the detection element 112a travels. In this case, when the light reflected from the skin is received by the filter 112b, the filter 112b may block some of the received light and pass the remaining unblocked light. In this case, the detection element 112a may acquire an image by detecting the light passing through the filter 112b. Here, the filter 112b is an RGB color filter that transmits visible light having an optical wavelength band of Red/Green/Blue, a hyperspectral filter that divides (decomposes) a spectrum region of light into a plurality of spectral channels (wavelength bands), horizontal or vertical It may be implemented as a polarizing filter that transmits light vibrating in the direction. Meanwhile, unlike FIG. 4 , the filter 112b may be modified to be disposed inside the detection element 112a.

According to an embodiment of the present disclosure as described above, by using the polarizing filter 111b or the filter 112b, it is possible to solve the problem that the gradation difference is not revealed because the image is displayed too brightly in the image due to sebum, etc. on the user's skin. . That is, it is possible to reduce the overall brightness in the skin region of the image, thereby making the difference in gradation clear.

Meanwhile, in the above-described embodiment, it has been described that the light source unit 111 is included in the camera 110 , but it is also possible that the light source unit 111 is separated from the camera 110 and implemented as an independent device.

The communication unit 120 may transmit/receive various types of data to and from various types of external devices (eg, the skin care device 200, a server, etc.) according to various wired or wireless communication methods. In this case, the communication unit 120 may perform direct communication with an external device or may communicate with an external device via (or relay) other external devices through various communication networks. To this end, the communication unit 120 may include circuitry according to each communication method, and may further include an antenna or the like in the case of a wireless communication method.

The communication unit 120 may receive information from an external device and transmit the received information to the processor 130 . For example, the communication unit 120 may receive a device specification of the skin care apparatus 200 from the skin care apparatus 200 . Alternatively, the communication unit 120 may receive the device specification of the skin care apparatus 200 from the server. Thereafter, the communication unit 120 may transmit (or transmit) the device specification received from the skin care apparatus 200 or the server to the processor 130 .

Also, the communication unit 120 may transmit information to an external device under the control of the processor 130 . For example, the communication unit 120 may transmit information about the skin care course to the skin care apparatus 200 under the control of the processor 130 .

Referring to FIG. 2B , the communication unit 120 may communicate with various types of external devices (eg, the skin care device 200 , a server, etc.) according to various types of communication methods, and may communicate with various communication-connected devices. It can send and receive tangible data. The communication unit 120 includes a WiFi chip 121 using a WiFi (Wi-Fi) communication method, a Bluetooth chip 122 using a Bluetooth communication method, and an NFC chip using a near field communication (NFC) communication method. (123), wireless communication using a mobile communication method (eg, long-term evolution (LTE), LTE Advance (LTE-A), 5th generation (5G), code division multiple access (CDMA), wideband CDMA (WCDMA)) It may include at least one of the chip 124 and an infrared communication chip (not shown) using an infrared communication method. Furthermore, the communication unit 120 may include at least one of an Ethernet module (not shown) and a USB module (not shown) for performing wired communication. Here, the communication unit 110 may include a network interface or a network chip according to a wired/wireless communication method. On the other hand, the communication method of the communication unit 110 is not limited to the above-described example, and may include a communication method that appears newly according to the development of technology.

The processor 130 may control the overall operation of the electronic device 100 . To this end, the processor 130 may be electrically connected to each component of the electronic device 100 . Specifically, the processor 130 may read and interpret at least one instruction to determine a sequence for data processing, and transmit a control signal for controlling operations of other components. In this case, the at least one instruction may be stored in a memory (not shown) provided in the processor 130 or may be stored in a memory 140 (refer to FIG. 3 ) provided in the electronic device 100 . Accordingly, each component of the electronic device 100 may operate under the control of the processor 130 .

Meanwhile, the processor 130 may include one or a plurality of processors, and the processor 130 is a general-purpose processor such as a central processing unit (CPU), an application processor (AP), a graphic processing unit (GPU), and a vision (VPU). It may be implemented with a graphics-only processor, such as a processing unit, or an artificial intelligence-only processor, such as a neural processing unit (NPU). Meanwhile, the GPU may be implemented as a device separate from the processor 130 . In addition, the CPU and the GPU may perform the operations of the present disclosure in conjunction. At this time, the GPU is implemented as a structure with hundreds or thousands of cores specialized for a parallel processing method that processes data such as multiple commands or images simultaneously, and the CPU is a number specialized for a serial processing method that processes commands or data in the order in which they are input. It may be implemented as a structure having four cores.

The processor 130 may acquire information on the user's skin condition included in the image based on the image acquired through the camera 110 . Here, the information on the skin condition may include information on at least one of pores, wrinkles, pigmentation, and troubles of the skin.

Specifically, when a user command for measuring a user's skin condition is received, the processor 130 may control the camera 110 to acquire an image. For example, when a user command (eg, a user's touch input, a voice input, etc.) for measuring (or identifying) the user's skin condition is received, the processor 130 performs a photographing operation (image acquisition operation). ) may be transmitted to the camera 110 . In this case, the camera 110 may acquire an image according to the received control signal.

In this case, the image acquired through the camera 110 may include the user's skin. For example, the image obtained through the camera 110 may be an image obtained as light irradiated to the user's skin is reflected and detected.

To this end, the processor 130 may determine the light corresponding to the skin condition according to a user command for detecting the skin condition. In addition, the processor 130 may control the light source unit 111 to irradiate the light corresponding to the skin condition to the skin, and may obtain an image by detecting the light reflected from the user's skin through the detection unit 112 .

For example, the processor 130 controls the light source unit 111 to irradiate ultraviolet (or blue visible light) to the user's skin when a user command for detecting a skin condition for trouble is received, and reflects from the user's skin. The detected light may be detected through the detector 112 to obtain an image. As such, when a user command for detecting pores or wrinkles is received, the processor 130 may control the light source unit 111 to irradiate visible light to the skin, and may acquire an image through the detection unit 112 . Also, when a user command for detecting pigmentation is received, the processor 130 may control the light source unit 111 to irradiate polarized light to the skin, and acquire an image through the detection unit 112 .

In this case, the processor 130 may analyze the image obtained through the camera 110 to obtain information on the user's skin condition included in the image. For example, the processor 130 may analyze the image through various skin condition analysis algorithms, and obtain information on the user's skin condition as a result of the image analysis. At this time, the skin condition analysis algorithm is the area corresponding to the skin condition in the image obtained through the reflected light in that the wavelength with high light absorption (or reflectance) is different for each skin condition (eg, pores, wrinkles, pigmentation, trouble, etc.) The condition of the skin included in the image can be analyzed using the optical characteristics of erythema (e.g., red color due to high reflectance of 620 nm to 780 nm wavelength in the case of erythema during pigmentation). In addition, the skin condition analysis algorithm uses the shape characteristics of the corresponding area in the skin condition in the image for each skin condition (eg, a feature having a round shape in the case of pores and a line shape in the case of wrinkles) of the skin condition included in the image. Various modified embodiments are possible, such as analyzing

Here, the information on the skin condition may include information on at least one of pores, wrinkles, pigmentation, and troubles of the skin. Specifically, the information on the pores quantitatively indicates the state of the pores, and may include at least one of the size (or area) of the pores for each location (or each area), the depth of the pores, and the level of the pores. Information on wrinkles is a quantitative representation of the state of wrinkles, and may include at least one of the size (or length) of wrinkles for each location (or each region), the depth of wrinkles, and the level of wrinkles. Information on pigmentation is a quantitative representation of the state of pigmentation, and may include at least one of the size (or area) of pigmentation for each location (or each region), the color of pigmentation, and the level of pigmentation. have. The information on the trouble quantitatively indicates the state of the trouble, and may include at least one of the size (or area) of the trouble for each location (or each area) and the level of the trouble.

According to an embodiment of the present disclosure, the processor 130 may obtain information on the skin condition for each skin region (or location). That is, the processor 130 may divide the user's skin included in the image acquired through the camera 110 into a plurality of skin regions, and obtain information on the skin state of each skin region.

In this case, the information on the user's skin condition may include information on at least one of pores, wrinkles, pigmentation, and troubles in each skin area (or location), and indicates the skin condition matched to each skin area. It may be implemented in the form of a map (hereinafter, a skin map) or a table. This is to improve the efficiency of skin care by allowing the skin care apparatus 200 to perform a different skin care course in an area corresponding to each skin area according to a different skin condition for each skin area.

Meanwhile, according to an embodiment of the present disclosure, in order to more accurately identify the skin region included in the image, the processor 130 may generate a message (or image) for inducing the front of the user's specific body part to face the camera 110 . ) may be displayed on the display 150 and the camera 110 may be controlled to acquire an image. In addition, in some cases, the processor 130 displays a message (or image) inducing the front as well as the side (up, down, left, right, etc.) of a specific body part (eg, face, etc.) to face the camera 110 on the display 150 . It is also possible to control the camera 110 to display the image on the . Accordingly, the image acquired through the camera 110 may include a front image of a specific body part of the user, a side image of the user's body part, and the like.

Meanwhile, according to another embodiment of the present disclosure, the processor 130 may control the communication unit 120 to transmit the image acquired through the camera 110 to the server. The server may perform skin analysis on the user's skin region included in the image received from the electronic device 100 , and transmit information about the user's skin condition to the electronic device 100 as a result obtained through the skin analysis. have. In this case, the processor 130 may receive information on the user's skin condition from the server through the communication unit 120 to obtain information on the user's skin condition. To this end, the server communicates with the electronic device 100 through a network and functions to perform skin analysis on the image. For example, the server may be implemented as a cloud server, but is not limited thereto, and a general electronic device It can be implemented in various forms, such as an embedded server in which a user terminal device (eg, a user terminal device) performs a server function.

As described above, the processor 130 according to an embodiment of the present disclosure determines the light irradiated to the skin in consideration of the wavelength absorption or reflectance of various skin characteristics such as pores, wrinkles, troubles, and pigmentation, and determines the skin condition. By using a light more suitable for detection, it is possible to more accurately identify the user's skin condition.

The processor 130 may identify the skin care course based on the skin condition obtained from among the plurality of skin care courses and the device specification of the skin care apparatus 200 communicatively connected to the electronic apparatus 100 through the communication unit 120 . can

Here, the skin care course may refer to scheduling one operation or a series of operations to be performed by the skin care apparatus 200 in order to improve the user's skin condition. Here, in the plurality of skin care courses, at least one of a type of an LED driven by the skin care apparatus 200 and a driving time of the LED may be different from each other.

More specifically, in the skin care course, the type of LED and the driving time of the LED may be set in consideration of the wavelength (or color) and intensity of light effective for each skin condition. In addition, the skin care course may be set by matching the driving time of the LEDs in consideration of the device specifications (the number of LEDs, the types of LEDs, the output intensity of LEDs, etc.) of the skin care apparatus 200 . Such a skin care course may be set or changed by a manufacturer or a user, and a skin condition and device specification may be matched to each skin care course.

That is, in order to obtain the effect of skin care for improving each skin condition, it may be required to irradiate the skin with light of a specific wavelength or more corresponding to the skin condition, and the method for calculating the appropriate wavelength and amount of light for each skin condition can be obtained experimentally. In this case, the wavelength for the skin condition is related to the type of LED, and the amount of light for the skin condition is related to the driving time of the LED.

Here, the amount of light may be determined by using each of the number of LEDs, the output of the LEDs, and the driving time of the LEDs as one element, and the amount of light irradiated to the skin by adjusting at least one of the number of LEDs, the output of the LEDs, and the driving time of the LEDs can be adjusted. The type of LED may refer to a type of light emitted by the LED classified according to wavelength or color. For example, in the case of an LED that emits NIR, the LED type may be a NIR or NIR LED.

In this case, the method of adjusting the output of the LED to adjust the amount of light irradiated to the skin is to increase the current (or voltage) of the skin care device 200 , and the overcurrent (or overvoltage) to the skin care device 200 worn by the user. ), etc. may cause a problem of harm to the human body, so the output of the LED should be limited to the extent that it is not harmful to the human body. In addition, the method of adjusting the number of LEDs to control the amount of light irradiated to the skin is difficult in reality except for the modular method to change the number of LEDs after the skin care device 200 is manufactured. Therefore, in order to adjust the amount of light irradiated to the skin, a plurality of skin care courses may be set to adjust the driving time of the LED. However, this is only an example, and it is not limited thereto and may be changed to various embodiments.

According to an embodiment of the present disclosure, the processor 130 may identify a skin care course corresponding to an acquired skin condition from among a plurality of skin care courses. Here, the information on the identified skin care course may include information on at least one of a type of an LED driven according to an identified skin condition among a plurality of LEDs included in the skin care device 200 and a driving time of the LED. have.

For example, if it is assumed that the processor 130 determines that the user's skin condition included in the image acquired through the camera 110 is pore level 1, the processor 130 performs pore level 1 among a plurality of skin care courses. It is possible to identify a skin care course corresponding to .

Here, the identified skin care course does not consider device specifications, and for convenience of description, it will be referred to as a default skin care course. In this case, the default skin care course for the skin condition (eg, pore level 1, etc.) is that the type of LED and the driving time of the LED are preset in order to improve the pore condition for the skin condition (eg, pore level 1, etc.) can Here, the driving time set in the default skin care course may be a time set according to the preset number (eg, 50, 100, etc.) of LEDs belonging to the same area (or the same area).

For example, the default skin care course for pore level 1 may have a preset LED type of NIR LED and an LED driving time of 6 minutes, and the default skin care course for pore level 2 may have an LED type of NIR. It is an LED, and the driving time of the LED may be preset to 8 minutes.

In this case, the processor 130 may identify a skin care course corresponding to the device specification of the skin care apparatus 200 communicatively connected to the electronic device 100 through the communication unit 120 from among the plurality of skin care courses.

Here, the device specification (or device specification) may refer to indicating the specification of a corresponding device (device), and the device specification is one of the number of LEDs included in the skin care apparatus 200 and each type of the plurality of LEDs. It may include at least one. In this case, the number of the plurality of LEDs included in the skin care device 200 is, for example, the total number of LEDs included in the skin care device 200 , and the skin care device 200 is divided into a plurality of regions (or groups). If divided, it may be the number of LEDs for each area (or for each group). In addition, each type of the plurality of LEDs included in the skin care device 200 is, for example, an NIR LED (LED that emits near-infrared light with a wavelength of 800 to 900 nm), a Red LED (a visible color of red with a wavelength of 600 to 650 nm). LED that emits light), Yellow LED (LED that emits yellow visible light with a wavelength of 545 to 600 nm), Green LED (LED that emits visible light with green color with a wavelength of 475 to 545 nm), Blue LED (with a wavelength of 390) It may be an item classified according to the wavelength or color of the light emitted by the LED, such as an LED that emits visible light of blue color of ~470 nm). However, this is only one embodiment, and various modified embodiments may be possible.

To this end, the electronic device 100 may be network-connected to the skin care device 200 through the communication unit 120 . For example, the electronic device 100 and the skin care device 200 may be connected through various communication methods such as wired communication such as USB (Universal Serial Bus) type, Ethernet type, or wireless communication such as Bluetooth or Wi-Fi. have.

In this case, the processor 130 may identify the device specification of the skin care apparatus 200 connected to the network through the communication unit 120 .

For example, the processor 130 may receive the device specification information from the skin care apparatus 200 through the communication unit 120 to identify the device specification of the skin care apparatus 200 .

For another example, the processor 130 captures a code (eg, barcode, QR code, etc.) displayed on the body (or housing) of the skin care device 200 through the camera 110 to obtain an image, The device specification of the skin care apparatus 200 may be identified by accessing a webpage assigned to a code included in , or receiving information on the device specification through the communication unit 120 through an Internet search service. On the other hand, when the skin care apparatus 200 is provided with a display, the processor 130 may also photograph the code displayed on the display of the skin care apparatus 200 through the camera 110 to identify the device specifications.

For another example, the processor 130 may receive information about a unique identifier (eg, device name, device model name, device serial number, network address, etc.) of the skin care apparatus 200 from the skin care apparatus 200 . can

In this case, the processor 130 may identify a device specification matching the unique identifier of the skin care apparatus 200 in the database. In this case, the database is stored by matching device specifications to each of the unique identifiers of the plurality of skin care apparatuses, and the database is stored inside the electronic device 100 (eg, the memory 140 of the electronic device 100) or the electronic device. It may be stored in an external device (eg, a server, etc.) that is communicatively connected to the 100 .

That is, the processor 130 may identify a device specification corresponding to the unique identifier of the skin care apparatus 200 from the database stored in the memory 140 . Alternatively, the processor 130 transmits the unique identifier of the skin care apparatus 200 to the server in which the database is stored, receives the device specification corresponding to the unique identifier of the skin care apparatus 200 from the server, and receives the skin care apparatus Device specifications of 200 may be identified. In this case, the server may refer to an electronic device implemented as a server of various types, such as an Internet service provider (ISP), a search engine server, as well as a cloud server.

As such, the processor 130 may identify the type of LED, the number of LEDs, etc. included in the skin care apparatus 200 through the device specification of the skin care apparatus 200 .

The processor 130 may identify a skin care course corresponding to the device specification of the skin care apparatus 200 from among the plurality of skin care courses based on at least one of the number of the plurality of LEDs and the type of each of the plurality of LEDs.

For example, it is assumed that the processor 130 determines that the skin condition of the user included in the image acquired through the camera 110 is pore level 1. In this case, as described above, as the default skin care course for pore level 1, the processor 130 selects a skin care course corresponding to pore level 1 among a plurality of skin care courses (eg, NIR LED is driven for 6 minutes). can be identified. In addition, the processor 130 configures the default skin care course for pore level 1 among the plurality of skin care courses and device specifications of the skin care apparatus 200 (eg, the type of LED and the number of LEDs of the skin care apparatus 200 ). It is possible to identify a skin care course corresponding to .

In this case, the processor 130 may determine whether the type of LED included in the device specification matches the type of LED included in the default skin care course (eg, NIR LED).

And, as an embodiment, when the type of the LED of the device specification (eg, NIR LED) and the type of the LED of the default skin care course (eg, NIR LED) match (ie, the skin care device ( 200) is provided with an LED having a wavelength corresponding to the user's skin condition), the number of LEDs included in the device specification and the number of LEDs included in the default skin care course may be compared.

At this time, as an example, the processor 130 determines that the number of LEDs included in the device specification (eg, 200 NIR LEDs) is greater than the number of LEDs included in the default skin care course (eg, 100 NIR LEDs). case, it is possible to identify a skin care course having a driving time (eg, NIR LED driving time of 3 minutes) smaller than the driving time of the LED set in the default skin care course (eg, the driving time of the NIR LED is 6 minutes). .

As another example, when the number of LEDs included in the device specification (eg, 50 NIR LEDs) is smaller than the number of LEDs included in the default skin care course (eg, 100 NIR LEDs) , it is possible to identify a skin care course having a driving time (eg, a driving time of the NIR LED of 12 minutes) greater than the driving time of the LED (eg, the driving time of the NIR LED is 6 minutes) set in the default skin care course.

In addition, as another example, the processor 130 determines the number of LEDs included in the device specification (eg, 50 NIR LEDs) and the number of LEDs included in the default skin care course (eg, 50 NIR LEDs) and In the same case, a default skin care course may be identified.

On the other hand, as another embodiment, when the type of the LED of the device specification (eg, NIR LED) and the type of the LED of the default skin care course (eg, NIR LED) do not match (ie, skin care) When the device 200 does not include an LED having a wavelength corresponding to the user's skin condition), notification information for notifying that the skin care course corresponding to the user's skin condition cannot be performed is provided in the form of text or images The display 150 may be controlled to display.

According to an embodiment of the present disclosure as described above, considering that the number of LEDs and types of LEDs included in the skin care apparatus 200 may vary according to device specifications of the skin care apparatus 200 , the skin The effect of skin care may be maximized by controlling the operation of the skin care apparatus 200 by adjusting the skin care course according to the device specification of the care apparatus 200 .

Meanwhile, according to an embodiment of the present disclosure, when the electronic device 100 further includes a memory 140 (refer to FIG. 2B ), the memory 140 contains a plurality of skin care courses matched to a plurality of skin conditions, respectively. information about may be stored.

In this case, the processor 130 identifies a plurality of skin care courses corresponding to the acquired skin condition from among the plurality of stored skin care courses, and corresponds to the device specification of the skin care apparatus 200 from among the identified plurality of skin care courses. You can identify the skin care course that is being used.

According to an embodiment of the present disclosure as described above, the electronic device 100 may identify a skin care course in an on-device method. Accordingly, in that the electronic device 100 can independently perform operations without the aid of an external device through network communication, speed and stability of information processing, security of personal information, and the like can be promoted.

Meanwhile, according to another embodiment of the present disclosure, information on a plurality of skin care courses may be stored in an external device (eg, a server, etc.) connected to the electronic device 100 in communication.

In this case, the processor 130 controls the communication unit 120 to transmit the information on the skin condition and the device specification of the skin care apparatus 200 to an external device, and sends the skin care course from the external device through the communication unit 120 . By receiving information about the skin care course, it is possible to identify the skin care course.

In addition, the processor 130 may control the communication unit 110 to transmit information on the identified skin care course to the skin care apparatus 200 .

In this case, the skin care apparatus 200 may drive at least one LED included in the skin care apparatus 200 based on the information on the skin care course received from the electronic device 100 .

According to an embodiment of the present disclosure as described above, the electronic device 100 functions as a relay device and may identify a skin care course through an external device (or a system method). Accordingly, the load due to information processing of the electronic device 100 may be reduced and resource efficiency may be promoted.

Meanwhile, in the above-described embodiment, the processor 130 primarily identifies a default skin care course according to a skin condition from among a plurality of skin care courses, and secondarily identifies a default skin care course and a skin care course according to the device specification. Although it has been described that the skin care course is identified step by step as described above, this is only an example, and the processor 130 performs a single step, such as identifying a skin care course corresponding to a skin condition and device specification from among a plurality of skin care courses. It is also possible to perform an action to identify a skin care course.

Specifically, according to an embodiment of the present disclosure, a plurality of skin care courses may be stored in the form of a lookup table. In this case, the lookup table may be stored in the same form as row data (or column data) by matching skin conditions and device specifications for each of a plurality of skin care courses.

In this case, if the processor 130 inputs the skin condition and device specification into the lookup table, the processor 130 may identify the skin care course as an output of the lookup table. Specific details of the skin care course will be described later with reference to FIGS. 5 and 6 .

On the other hand, according to an embodiment of the present disclosure, when the electronic device 100 further includes the memory 140 , the processor 130 provides information on the skin condition or the skin care device to the information on the skin care course. The result information driven accordingly may be stored as history information about the user.

For example, when the information on the skin condition of the user included in the image is obtained, the processor 130 may determine the time (eg, year/day/hour/minute/second, etc.) at which the information on the skin condition of the user was obtained. Together, information on the user's skin condition may be stored in the memory 140 as history information about the user.

In addition, the processor 130 transmits information on the skin care course to the skin care device 200 through the communication unit 120 , and then transmits result information driven according to the information on the skin care course to the skin care device 200 . When receiving through the communication unit 120 from the memory 140 as history information about the user, the result information driven according to the information on the skin care course together with the time (eg) driven according to the information on the skin care course) ) can be stored in

In this case, when a preset event occurs, the processor 130 may control the display 150 of the electronic device 100 to display history information about the user. Here, the preset event is an event in which a user command for checking the history is received, a preset time (eg, a specific time every day, a user such as 8 hours after driving the electronic device 100 or the skin care device 200 ) or It may be one of various events, such as an event in which the time set by the manufacturer) has arrived, an event in which information on skin condition is acquired, and an event in which result information driven according to information on a skin care course is received.

According to an embodiment of the present disclosure as described above, as the user's skin condition according to the date or time or the improvement effect of the skin condition according to the skin care service is provided to the user, the user's skin can be managed more systematically, It can induce users to use it.

Meanwhile, according to an embodiment of the present disclosure, the processor 130 may obtain information on the size of the user's skin (eg, the size of the face) included in the image. For example, the processor 130 may obtain information on the size of the skin through various size (length) measurement algorithms such as augmented reality (AR).

In this case, the processor 130 is configured to belong to a non-wearing area of the skin care apparatus 200 among a plurality of LEDs included in the skin care apparatus 200 based on the user's skin size and the size of the skin care apparatus 200 . LEDs can be identified. In this case, the size of the skin care apparatus 200 may be included in the device specification of the skin care apparatus 200 .

Here, the skin care apparatus 200 may be divided into a wearing area and a non-wearing area. In this case, the wearing area of the skin care apparatus 200 is an area where the skin care apparatus 200 is worn on the user's skin, and the non-wearing area of the skin care apparatus 200 is the size of the user's skin care apparatus 200 . It may refer to an area not worn on the user's skin, which is larger than the size of .

In addition, the processor 130 may control the communication unit 120 to transmit information on the LED belonging to the non-wearing area to the skin care apparatus 200 together with the information on the skin care course.

In this case, the skin care apparatus 200 may control the LED belonging to the area corresponding to the size of the skin to emit light according to the skin care course, based on the received information.

According to an embodiment of the present disclosure as described above, the electronic device 100 considers the size of the user's skin (eg, facial skin), the number of LEDs driven in the skin care device 200, the position range of the LEDs, etc. can be controlled, thereby improving the energy efficiency of the skin care device 200 so that electric power is not wasted, and at the same time solving the heat problem.

Meanwhile, referring to FIG. 2B , the electronic device 100 according to an embodiment of the present disclosure includes a memory 140 , a display 150 , and a speaker 160 in addition to the camera 110 , the communication unit 120 , and the processor 130 . ) and an input interface 170 .

The memory 140 may refer to hardware that temporarily or permanently stores data or information. For example, the memory 140 may be implemented as at least one hardware selected from among non-volatile memory, volatile memory, flash memory, hard disk drive (HDD) or solid state drive (SSD), RAM, ROM, etc. have.

At least one instruction, program, or data required for the operation of the electronic device 100 or the processor 130 may be stored in the memory 140 . Here, the instruction is a code unit for instructing the operation of the electronic device 100 or the processor 130 and may be written in machine language, which is a language that a computer can understand. A program may be a set of instructions that perform a specific task in a unit of work. The data may be status information in units of bits or bytes that can represent characters, numbers, images, and the like.

In addition, various information such as an image acquired by the camera 110 , information on skin conditions, device specifications of the skin care apparatus 200 , and a plurality of skin care courses may be stored in the memory 140 . Information stored in the memory 140 may be accessed by the processor 130 , and for example, reading/writing/modifying/deleting/updating instructions, programs, or data may be performed by the processor 130 . have.

The display 150 is a device for visually outputting information or data. The display 150 may display the image frame on all or part of the display area. The display area may refer to the entire area of a pixel unit in which information or data is visually displayed. At least a portion of the display 150 may be coupled to at least one of a front area, a side area, and a rear area of the electronic device 100 in the form of a flexible display. The flexible display may be characterized by being able to bend, bend, or roll without damage through a thin and flexible substrate like paper.

The speaker 160 may directly output various notification sounds or voice messages as well as various audio data on which various processing operations such as decoding, amplification, and noise filtering have been performed by the audio processing unit (not shown), and the electronic device ( 100) or may be implemented as a separate external device. Here, the speaker 160 may be implemented as a directional speaker that transmits sound only to a specific location or area.

The input interface 170 may receive various user inputs and transmit them to the processor 140 . The input interface 170 may include, for example, at least one of a touch panel (not shown), a pen sensor (not shown), a key (not shown), and a microphone (not shown). The touch panel may use, for example, at least one of a capacitive type, a pressure-sensitive type, an infrared type, and an ultrasonic type, and for this, the touch panel may include a control circuit. The touch panel may further include a tactile layer to provide a tactile response to the user. The pen sensor may be, for example, a part of the touch panel or may include a separate recognition sheet. The key may include, for example, a physical button, an optical key, or a keypad. The microphone may directly receive the user's voice, and digitally convert the user's voice, which is an analog signal, by a digital converter (not shown) to obtain an audio signal. Such an input interface 170 may be embedded in the electronic device 100 or implemented as a separate external device (not shown) such as a keyboard, mouse, external microphone, remote control, or the like.

3 is a block diagram illustrating a configuration of a skin care device according to an embodiment of the present disclosure.

Referring to FIG. 3 , the skin care apparatus 200 may include a light source unit 210 , a communication unit 220 , and a processor 230 .

The light source unit 210 may irradiate light to the user's skin. To this end, the light source unit 210 may include one or a plurality of light emitting devices. For example, the light source unit 210 may be disposed on one surface worn by the user in the housing (or body) of the skin care apparatus 200 to irradiate light toward the user's skin. Here, the light emitting device (light source) may be a Light-Emitting Diode (LED), but is not limited thereto and may be implemented as various types of light sources suitable for skin care.

Assuming that the light source of the light source unit 210 is an LED, LED pairs of different types or colors may be adjacent to each other and disposed on one surface of the housing of the skin care device 200 . Specifically, one surface of the housing of the skin care device 200 may be divided into a plurality of regions (or a plurality of groups) (eg, a left cheek region, a right cheek region, a forehead region, a nose region, a chin region, etc.) of the face. and at least two or more LEDs may be disposed adjacent to each other in each region (or each group). In this case, the at least two LEDs disposed adjacently may be implemented as one of an IR LED, a Red LED, a Blue LED, a Green LED, or a Yellow LED. Here, at least two LEDs included in each region (or each group) may be LEDs of different types (or colors) from each other, and the types of each LED have a ratio of 1:1 or M:N (M and N are natural numbers). ) may be arranged in a ratio of For example, when a plurality of LEDs disposed in the same area are configured with an M:N ratio of an IR LED and a Red LED, the processor 230 controls to emit only the IR LED or only the Red LED according to the skin care course. can do. Furthermore, it is also possible to implement three or more types of LEDs belonging to each region (or each group).

In this case, the device specifications of the skin care apparatus 200 include the number of the plurality of LEDs, the number of LEDs for each area, the LED type (or number of types) of each of the plurality of LEDs, and the type (or type) of each LED in each area. of ) may include information on at least one of the

The processor 230 may control the overall operation of the skin care apparatus 200 . The processor 230 may include one or a plurality of processors. For example, the processor 230 may control the skin care apparatus 200 according to various embodiments of the present disclosure to drive a specific operation by executing at least one instruction stored in a memory (not shown).

According to an embodiment, the processor 230 may include a digital signal processor (DSP), a microprocessor (microprocessor), a graphics processing unit (GPU), an artificial intelligence (AI) processor, a neural network (NPU) for processing a digital image signal. Processing Unit), TCON (Time controller), but is not limited thereto, Central processing unit (CPU), MCU (Micro Controller Unit), MPU (micro processing unit), controller (controller), application processor (application processor (AP)), communication processor (communication processor (CP)), may include one or more of an ARM processor, or may be defined by the term. Also, the processor 230 may be implemented as a system on chip (SoC) or large scale integration (LSI) with a built-in processing algorithm, or may be implemented in the form of an application specific integrated circuit (ASIC) or field programmable gate array (FPGA).

According to an embodiment of the present disclosure, when information on a skin care course is received from the electronic device 100 through the communication unit 220 , the processor 230 controls the light source unit 210 to be driven according to the skin care course. can

Specifically, the processor 130 may adjust the supply time of the driving current (or driving voltage) supplied to the light emitting device (eg, LED) of the light source unit 210 corresponding to the skin care course. That is, the processor 130 may adjust (maintain or change) the supply time of the driving current (or driving voltage) through a pulse width modulation (PWM) method. In this case, as the driving current (or driving voltage) of which the supply time is adjusted is supplied to the light emitting device of the light source unit 210 , the output (intensity or intensity of light) of the light source unit 210 may be controlled. Here, the pulse width modulation (PWM) is to adjust a duty ratio (%), which is a ratio of on and off of the light source, which is a dimming value (or dimming signal) input from the processor 130 to the light source unit 210 . can be determined according to However, this is only an example, and the processor 130 may control the output (intensity or intensity of light) of the light source unit 210 by adjusting the intensity of the driving current (or driving voltage) supplied to the LED itself.

Meanwhile, the skin care course may include information on at least one of a driving type (hereinafter, a driving type) of a plurality of LEDs included in the skin care apparatus 200 and a driving time of the LED. Here, the driving type of the LED may be infrared light, red visible light, blue visible light, green visible light, yellow visible light, or the like.

According to an embodiment of the present disclosure, the light source unit 210 of the skin care apparatus 200 may be driven by a local driving method to independently emit light for each region (or for each group). In this case, the device specification of the skin care apparatus 200 may include information for identifying that the driving method of the skin care apparatus 200 is a local driving method.

In this case, the skin care course determined according to the device specification may include information on the driving position (or region, group) of the LED as well as the driving type of the LED. For example, when the skin condition of the left cheek among the user's facial skin is identified as the trouble level 3, the processor 230 determines the driving position (eg, left cheek region) and driving type of the LED included in the received skin care course. According to (eg, blue visible light) and driving time (eg, 2 minutes), it is possible to control the blue LED belonging to the left cheek region among the plurality of LEDs of the light source unit 210 to emit light for 2 minutes. Accordingly, the user's left cheek may be irradiated with blue visible light for 2 minutes.

Through the local driving method according to an embodiment of the present disclosure as described above, it is possible to provide a skin care service having an optimal effect for each skin part of the user even when the user has a different skin condition for each skin part. In addition, in this case, the lifespan of the skin care device 200 can be improved, and since different types of LEDs can be driven for each part, the time for providing a skin care service can be shortened, and user convenience can also be improved. .

Meanwhile, the skin care apparatus 200 may further include a proximity sensor.

Here, the proximity sensor may detect the presence of a nearby object. Specifically, the proximity sensor may be provided in one area of the housing (or main body) of the skin care apparatus 200 , and may detect a distance between the proximity sensor and the user. To this end, the proximity sensor may be implemented as at least one of a high frequency oscillation type proximity sensor, an optical fiber proximity sensor, an electromagnetic proximity sensor, a capacitive proximity sensor, an optical proximity sensor, and an ultrasonic proximity sensor.

Here, the processor 230 may detect whether the skin care apparatus 200 is worn on the user's skin (eg, facial skin, neck skin, etc.) based on the distance value detected by the proximity sensor.

As an embodiment of the present disclosure, according to an embodiment of the present disclosure, when information on a skin care course is received from the electronic device 100 through the communication unit 220 , the processor 230 detects the distance detected by the proximity sensor. Based on the value, it may be determined whether the skin care apparatus 200 is worn on the user's skin (eg, facial skin, neck skin, etc.). For example, if the distance value detected by the proximity sensor is less than a preset value, the processor 230 determines that the skin care device 200 is worn on the user's skin, and the distance value detected by the proximity sensor is a preset value. If the value is exceeded, it may be determined that the skin care apparatus 200 is not worn on the user's skin.

In addition, when the processor 230 determines that the skin care apparatus 200 is worn on the user's skin based on the distance value detected by the proximity sensor, the processor 230 performs skin care based on the received skin care course information. You can perform actions according to the course. That is, the processor 230 may control the light source 210 to be driven according to the received skin care course.

Meanwhile, as an embodiment, when determining that the skin care device 200 is not worn on the user's skin based on the distance value sensed by the proximity sensor, the processor 230 determines the state not worn on the user's skin. The display or speaker provided in the skin care apparatus 200 may be controlled to output information for notification in the form of text, image, voice, or the like.

Meanwhile, as another embodiment, when determining that the skin care device 200 is not worn on the user's skin based on the distance value detected by the proximity sensor, the processor 230 may not be worn on the user's skin. The communication unit 220 may be controlled to transmit information indicating the state (hereinafter, not-worn state information) to the electronic device 200 . In this case, the electronic device 100 provides information (eg, “The LED mask is not worn on the face” for notifying the user of the state not to be worn on the user's skin based on the non-wear state information received from the skin care device 200 ). The display 150 or the speaker 160 may be controlled to output "etc." in the form of text, image, voice, or the like.

By using the proximity sensor according to an embodiment of the present disclosure as described above, it is possible to identify whether the user wears the skin care device 200 , and when the user wears the skin care device 200 , a special user User convenience may be improved in that the skin care apparatus 200 starts an operation without manipulation. Also, it is possible to prevent the skin care apparatus 200 from malfunctioning when the user does not wear the skin care apparatus 200 .

4 is a view for explaining a correlation between a skin condition and a wavelength of light according to an embodiment of the present disclosure.

Referring to FIG. 4 , it is possible to know the depth at which light can penetrate into the skin 400 according to the wavelength of the light, and an electronic device for identifying a skin condition based on the depth at which light can penetrate into the skin 400 . The wavelength of the light of the light source unit 111 of 100 may be set, or the LED type of the skin care course corresponding to the skin condition may be set.

Here, the user's skin 400 may be composed of an epidermal layer 420 , a dermal layer 430 , a subcutaneous tissue layer 440 , and the like in a depth direction from the surface 410 of the skin 400 . The epidermal layer 420 is the thinnest layer in the skin 400 , and is composed of melanocytes 421 and various cells such as keratinocytes, Langerhans cells, and Merkel cells as a continuously newly generated skin structure. The dermal layer 430 has a thickness of about 15 to 40 times that of the epidermal layer 420, and includes blood vessels 431 that control heat loss through contraction and expansion, as well as connective tissue and matrix composed of collagen (collagen) and elastic fibers. It is composed of (ground substance), sweat-producing eccrine sweat glands, sebaceous glands, nerves and lymphatic circulation. The subcutaneous fat layer 440 is the deepest layer in the skin 400 and protects the body by protecting against heat damage and absorbing shock, and functions as a nutrient storage, fat cells separated into lobules by the septum of the fibrous connective tissue; It is composed of blood vessels, lymph vessels, and nerves located in the septum.

Specifically, related to the LED type of the skin care course, for example, as shown in FIG. 4 , blue visible light (390-470 nm) is helpful for sensitive skin and oily skin, and in particular, P.ACNE proliferation that causes acne may help to curb In addition, green visible light (475~545nm) has the effect of improving skin tone and wrinkles, especially by removing toxins from the skin to revitalize the skin, and it can be helpful for the skin tone effect. In addition, yellow visible light (545~600nm) is effective in suppressing melanin production and improving spots/freckles, and in particular, it can help with facial redness by improving lymph and blood circulation. In addition, red visible light (600 ~ 650 nm) is a light that penetrates to the dermal layer 430 of the skin 400 and promotes the production of elastin and collagen, which can help skin elasticity and regeneration. In addition, near-infrared (NIR) (wavelength 800-900 nm) can prevent skin pigmentation and promote skin regeneration. However, irradiating near infrared (NIR) rays for a long time as heat rays may be avoided.

Here, red pigmentation among skin conditions may be related to the amount of hemoglobin present in the blood vessels 431 of the dermal layer 430 . In this case, the LED type of the skin care course corresponding to the red pigmentation may exclude ultraviolet light having a wavelength of 150-380 nm or blue visible light of 390-470 nm that does not reach the dermal layer 430 .

As an embodiment, the processor 130 may obtain information on pigmentation.

Referring to FIG. 4 , the processor 130 may control the light emitting element 111a of the light source unit 111 to irradiate visible light to the user's skin 400 . In this case, the visible light emitted from the light emitting element 111a of the light source unit 111 passes through the polarization filter 111b and is converted into polarized light (that is, only light in which the electromagnetic field vibrates in a specific direction is transmitted) and the user's skin 400 ) can be investigated. And, the polarized light irradiated to the user's skin 400 is partially absorbed by melanin 421 of the epidermal layer 420 and moglobin in the blood vessels 431 of the dermal layer 430 and a part is reflected to filter the filter 112b. through the detection element 112a. In this case, the processor 130 may acquire an image including the user's skin based on the result detected by the detection element 112a. That is, the image acquired through the camera 110 may be an image acquired using polarization.

In this case, the processor 130 may analyze the image through the skin condition analysis algorithm to obtain information on the pigmentation.

Specifically, the processor 130 may identify a pixel region (hereinafter, referred to as a skin region) corresponding to the skin included in the image acquired through the camera 110 . That is, the processor 130 may identify (distinguish) the skin region and the background region in the image using various algorithms based on the color of the human skin.

For example, assuming that the skin region included in the image is the face region for the face, the processor 130 detects the human face region from the image acquired through the camera 110 by using various face region detection algorithms. can be identified. Here, the algorithm for identifying the face region is a Haar like feature, Local Binary Pattern (LBP), Modified that uses the fact that the human eye has dark contrast and the human nose has bright contrast. It may be an algorithm such as Census Transform. However, this is only one embodiment, and various modified embodiments are possible.

In this case, the processor 130 may identify a pigmentation region in the skin region of the image, and obtain information on pigmentation based on the pigmentation region. Here, the information on the pigmentation is a quantitative representation of the state of the pigmentation, and it may include at least one of the size (or area) of pigmentation for each location (or each region), the color of pigmentation, and the level of pigmentation. can

Specifically, the processor 130 uses an independent component analysis (ICA) algorithm for the image acquired through the camera 110 to obtain a hemoglobin image expressed as a red component and a melanin image corresponding to a brown component. can be decomposed (or extracted). At this time, the color of the skin is determined by the components of hemoglobin and melanin 431 in the blood vessel 431 , the distribution of hemoglobin and melanin in the skin region is independent of each other, and the amount of hemoglobin and melanin in the skin image and the amount of melanin is optical density (optical density) ) may have linearity in the region.

Also, the processor 130 may identify a pixel region having a color difference (grayscale value difference) between a color (grayscale value) of a peripheral region and a color difference (grayscale value difference) greater than or equal to a preset value as a pigmentation region for each of the hemoglobin image and the melanin image. Then, the processor 130 identifies the size (or area) of the pigmentation of the skin according to the size (or area) of the pigmentation region, and selects the color of the pigmentation of the skin according to the color (grayscale value) of the pigmentation region. can be identified.

For example, the processor 130 compares the average gradation value of the entire skin region (or the surrounding region) and the size (or color) difference of the pigmentation region with a preset value, so that the difference in size (or color) is determined as the first phase difference. If it is less than the set value, it is determined as the pigmentation level 1, if the size (or color) difference is greater than or equal to the first preset value and less than the second preset value, it is determined as the pigmentation level 2, and the size (or color) difference is the second When it is equal to or greater than the preset value, it may be determined as the pigmentation level 3 . In this case, the first preset value (eg, the grayscale value of 10) may be smaller than the second preset value (eg, the grayscale value of 30). That is, the processor 130 may determine the pigmentation level for each individual pigmentation.

However, this is only an example, and the processor 130 may determine a pigmentation level for each skin region. For example, the processor 130 divides the skin region into a plurality of regions (or a plurality of groups), and determines the ratio of the size (or area) of each region (or group) to the size (or area) of the pigmentation region. It is possible to determine the level of pigmentation for each region (or group) accordingly.

The above description may also be applied to the case of identifying other skin conditions. Hereinafter, overlapping content will be omitted and described.

As an embodiment, the processor 130 may identify a pore region in the skin region of the image, and obtain information on the pore based on the pore region. Here, the information on the pores quantitatively indicates the state of the pores, and may include at least one of the size (or area) of the pores for each location (or each area), the depth of the pores, and the level of the pores.

Specifically, the processor 130 may identify a pixel area represented by a circle (or ellipse) of a darker color (smaller grayscale value) than the color (grayscale value) of the surrounding area in the skin area of the image as the pore area. In addition, the processor 130 may identify the size (or area) of the skin pores according to the size (or area) of the pore area, and identify the depth of the skin pores according to the color (grayscale value) of the pore area. (The darker the color of the pore area, the larger the pore depth can be identified).

For example, the processor 130 compares the size (or depth) of the pore region with a preset value and determines the pore level as 1 when the size of the pore region is less than the first preset value, When the size of the region is equal to or greater than the first preset value and less than the second preset value, the pore level 2 may be determined, and when the size of the pore region is greater than or equal to the second preset value, the pore level 3 may be determined. In this case, the first preset value (eg, 0.03 mm in diameter) may be smaller than the second preset value (eg, 0.04 mm in diameter). That is, the processor 130 may determine the pore level for individual pores.

However, this is only an example, and the processor 130 may determine the pore level for each skin region. For example, the processor 130 divides the skin region into a plurality of regions (or a plurality of groups), and sets the size (or depth) of pores having a size (or depth) greater than or equal to a preset value among a plurality of pores belonging to each region (or group). Depending on the number, you can determine the pore level for each area (or group).

As an embodiment, the processor 130 may identify a wrinkle region in the skin region of the image, and obtain information about the wrinkle based on the wrinkle region. Here, the information on the wrinkles is a quantitative representation of the state of the wrinkles, and may include at least one of the size (or length) of the wrinkles for each location (or each region), the depth of the wrinkles, and the level of the wrinkles.

Specifically, the processor 130 may identify, as a wrinkle area, a pixel area represented by a line of a darker grayscale (smaller grayscale value) than the color (grayscale value) of the surrounding area in the skin area of the image. In addition, the processor 130 may identify the size of the skin wrinkle according to the size of the wrinkle region, and identify the depth of the skin wrinkle according to the color (grayscale value) of the wrinkle region (the color of the wrinkle region is dark). The deeper the wrinkle, the greater the wrinkle depth).

For example, the processor 130 compares a preset value with the average grayscale value of the wrinkle region, and determines that the wrinkle level is 3 when the average grayscale value of the wrinkle region is less than the first preset value, and the average grayscale value of the wrinkle region When the wrinkle level is greater than or equal to the first preset value and less than the second preset value, the wrinkle level 2 may be determined, and when the average grayscale value of the wrinkle region is greater than the second preset value, the wrinkle level 1 may be determined. In this case, the first preset value (eg, grayscale value 20) may be smaller than the second preset value (eg, grayscale value 40). That is, the processor 130 may determine the wrinkle level for each individual wrinkle.

However, this is only an example, and the processor 130 may determine a wrinkle level for each skin region. For example, the processor 130 divides the skin region into a plurality of regions (or a plurality of groups), and among a plurality of wrinkles belonging to each region (or group), a plurality of wrinkles having a size (or depth) greater than or equal to a preset value. Depending on the number, you can determine the wrinkle level for each area (or group).

As an embodiment, the processor 130 may identify a trouble area in the skin area of the image, and obtain information about the trouble based on the trouble area. Here, the information on the trouble quantitatively indicates the state of the trouble, and may include at least one of the size (or area) of the trouble for each location (or each area) and the level of the trouble.

Specifically, the processor 130 converts the image acquired through the camera 110 into a gray-scale image and an HSV color image, and a grayscale value of the grayscale image and a V value (brightness value) of the HSV color image. ), a pixel area having a difference equal to or greater than a preset value may be identified as a trouble area. At this time, HSV color is a color space most similar to the human visual system, and can represent color with hue, saturation, and value, and HSV color value and RGB color value can be converted to each other. Since this is a well-known technique, it will be omitted.

Here, the image acquired through the camera 110 may be, for example, an image acquired using ultraviolet light (or blue visible light). For example, in the image acquired through the camera 110 , the light of the ultraviolet light emitted from the light source unit 111 of the camera 110 is irradiated to the subject, and the light reflected from the subject is the detection unit 112 of the camera 110 . It may be an image detected and acquired through . In this case, the processor 130 may identify the trouble area based on the color in the image acquired through the camera 110 using ultraviolet rays. For example, in the skin area, a normal area may be blue (or purple, etc.), and a trouble area may be dark brown (or white, etc.).

In addition, the processor 130 may identify the skin trouble size according to the size of the trouble area, and identify the skin trouble level according to the color (grayscale value) of the trouble area.

For example, the processor 130 compares a preset value and the size (or color) of the trouble area, and if the size of the trouble area is less than the first preset value, determines the trouble level 1, and the size of the trouble area is the second. When it is equal to or greater than 1 preset value and less than a second preset value, it may be determined as trouble level 2, and when the size of the trouble area is greater than or equal to a second preset value, it may be determined as trouble level 3. In this case, the first preset value (eg, grayscale value 20) may be smaller than the second preset value (eg, grayscale value 40). That is, the processor 130 may determine a trouble level for each trouble.

However, this is only an example, and the processor 130 may determine a trouble level for each skin region. For example, the processor 130 divides the trouble area into a plurality of areas (or a plurality of groups), and the number of troubles having a size (or color) equal to or greater than a preset value among a plurality of troubles belonging to each area (or group). According to this, the trouble level for each area (or group) can be determined.

5 and 6 are diagrams for explaining a skin care course according to an embodiment of the present disclosure.

5 and 6 , a plurality of skin care courses may be stored in the form of lookup tables 500 and 600 . For example, in the lookup table 500 of FIG. 5 , a skin condition and a skin care course may be matched and stored in each column of a specific row. Also, in the lookup table 600 of FIG. 6 , a skin condition, a device specification, and a skin care course may be matched and stored in each column of a specific row. That is, the lookup table 500 of FIG. 5 does not consider the device specification, and when the device specification cannot be identified, a skin care course according to the skin condition may be used as a default value. The lookup table 600 of FIG. 6 considers device specifications, and for example, the lookup table 600 may indicate matching device specifications for each of the pore states 510 of FIG. 5 . However, this is only one embodiment, and various modified embodiments may be possible.

Specifically, the skin care course may include at least one sequence, and each sequence may represent an operation unit divided according to the type of the LED or the driving time of the LED. For example, when the first sequence and the second sequence are included in the skin care course, the skin care apparatus 200 drives the LED corresponding to the LED type set in the first sequence for a time set in the first sequence, After the time set in the first sequence has elapsed, the LED corresponding to the LED type set in the second sequence may be driven for the time set in the second sequence. That is, the first sequence and the second sequence may indicate that operations performed by the skin care apparatus 200 are divided as an order.

In addition, the plurality of skin conditions may include a pore state 510 , a wrinkle state 520 , a pigmentation state 530 , a trouble state 540 , and the like according to skin characteristics. Here, the pore state 510 , the wrinkle state 520 , the pigmentation state 530 , and the trouble state 540 may represent a state for each skin characteristic as one of a plurality of levels. For example, in the case of level 1, the corresponding skin characteristic indicates the degree of good condition, in the case of level 2, the corresponding skin characteristic indicates the degree of normal condition, and in the case of level 3, the corresponding skin characteristic indicates the degree of poor condition. can

According to an embodiment of the present disclosure, as shown in FIG. 5 , the lookup table 500 displays a skin condition (eg, pore level 1, pore level 2, pore level 3, wrinkle level 1, ...) in each of a plurality of skin care courses. may be pre-matched and stored in the form of row data (or column data). This may indicate a case in which the device specification is not considered, that is, a case in which the device specification is set as a default value.

In particular, when the processor 130 does not identify the device specification of the skin care apparatus 200 , the lookup table 500 may be used. In this case, the processor 130 may identify a skin care course corresponding to the user's skin condition from among the plurality of skin care courses of the lookup table 500 . That is, when a skin condition is input to the lookup table 500 , the processor 130 may identify a skin care course as an output of the lookup table.

Meanwhile, this is only an example, and even when device specifications are not identified, the lookup table 600 may be used. For example, the processor 130 may identify the skin care course as an output of the lookup table 600 by inputting only the skin condition into the lookup table 600 or by inputting a null value into the device specification.

Meanwhile, according to an embodiment of the present disclosure, as shown in FIG. 6 , the lookup table 600 displays skin conditions (eg, pore level 1, pore level 2, pore level 3, wrinkle level 1, ... etc.) and device specifications (eg, 50 LEDs, 100 LEDs, 150 LEDs, ..., etc.) may be pre-matched and stored in the form of row data (or column data).

In particular, when the processor 130 identifies the device specification of the skin care apparatus 200 , the lookup table 600 may be used.

In this case, the processor 130 may identify a skin care course corresponding to the user's skin condition and device specification from among the plurality of skin care courses of the lookup table 500 . That is, when the processor 130 inputs the skin condition and device specification into the lookup table 600 , the processor 130 may identify the skin care course as an output of the lookup table.

7 is a view for explaining a method of identifying a skin care course for each area according to an embodiment of the present disclosure.

Referring to FIG. 7 , the processor 130 may identify a skin care course for each area of the facial skin.

As a specific example, the processor 130 may capture the user's face through the camera 110 to obtain an image 710 including the user's face skin. In this case, while photographing the user's face, the light source unit 111 may irradiate the user's face with a type of light set for each skin characteristic included in the skin condition under the control of the processor 130 . That is, the image 710 is an image obtained by irradiating visible light to the user's skin, an image obtained by irradiating ultraviolet light to the user's skin, an image obtained by irradiating infrared light to the user's skin, and polarized light to the user's skin. It may be at least one of images obtained by irradiation.

Then, the processor 130 uses an algorithm based on the skin color and the shape of the face to classify the background region and the facial skin regions 711 to 715 in the image 710, and the facial skin regions 711 to 715 . A plurality of divided skin regions 711 to 715, such as a forehead skin region 711, a right cheek skin region 712, a left cheek skin region 713, a nose skin region 714, a chin skin region 715, etc. can be identified.

In this case, the processor 130 includes a plurality of skin regions included in the image 710 (forehead skin region 711 , right cheek skin region 712 , left cheek skin region 713 , nose skin region 714 , Based on a pixel value included in each of the chin skin regions 715), a skin state for each of the plurality of regions may be identified through a skin state analysis algorithm.

For example, the identified skin conditions are: forehead skin region 711 is pore level 2, right cheek skin region 712 and left cheek skin region 713 are pore level 3, nose skin region 714 and chin skin region (715) is assumed to be pore level 1.

In addition, the processor 130 may identify at least one of the number and type of LEDs in each of the plurality of areas 721 to 725 of the skin care apparatus 720 based on the device specification of the skin care apparatus 720 . have.

Here, the plurality of regions 721 to 725 may be divided into a forehead region 721 , a right cheek region 722 , a left cheek region 723 , a nose region 724 , a chin region 725 , etc. The region 721 , the right cheek region 722 , the left cheek region 723 , the nose region 724 , and the chin region 725 may be regions on which the skin of the user is worn in the skin care device 720 . That is, the forehead region 721 , the right cheek region 722 , the left cheek region 723 , the nose region 724 , and the chin region 725 of the skin care device 720 include a forehead included in the image 710 . It may correspond to the skin area 711 , the right cheek skin area 712 , the left cheek skin area 713 , the nose skin area 714 , and the chin skin area 715 .

For example, in the skin care device 720 , the forehead region 721 has 150 NIR LEDs and 150 RED LEDs, the right cheek region 722 includes 100 NIR LEDs and 100 RED LEDs, and the left cheek region 723 has 100 NIR LEDs and 100 RED LEDs. ) is 100 NIR LEDs, 100 RED LEDs, nose region 724 has 50 NIR LEDs, 50 RED LEDs, and chin region 725 has device specifications with 50 NIR LEDs and 50 RED LEDs. do.

In this case, the processor 130 may identify a skin care course corresponding to the skin condition and device specification for each skin region from among the plurality of skin care courses.

For example, the processor 130 may identify a skin care course corresponding to a skin condition and device specification from among a plurality of skin care courses included in the lookup table 600 shown in FIG. 6 . In the case of the forehead skin region 711 , the processor 130 determines the skin state (pore level 2) for the forehead skin region 711 and the device specification (NIR LED) of the forehead region 721 corresponding to the forehead skin region 711 . If 150 RED LEDs (150 RED LEDs) are input to the lookup table 600 , the skin care course matched to the same row as the skin condition and device specification may be identified as an output of the lookup table 600 . In this case, the identified skin care course may be a skin care course including a first sequence of driving an NIR type LED for 3 minutes and a second sequence of driving a RED type LED for 2 minutes.

A skin care course may be identified by applying the same method to other skin regions.

In this case, the processor 130 may control the communication unit 120 to transmit information on the skin care course identified for each area to the skin care device 720 . In addition, the skin care apparatus 720 may perform an optimized skin care course for each of the plurality of areas 721 to 725 based on the received information.

According to an embodiment of the present disclosure as described above, it is possible to simultaneously perform a skin care course optimized for each skin region, thereby improving the efficiency of a skin care service, and preventing unnecessary skin care courses from being performed, so that the skin care device ( 200) can also be improved.

8 is a view for explaining a method of identifying a skin care course for each user according to an embodiment of the present disclosure.

Referring to FIG. 8 , it may be assumed that a plurality of users 911 to 913 use the electronic device 100 or the skin care device 200 in common.

For such a case, the processor 130 is driven according to the information on the skin condition of each user 911 to 913 or the skin care device 200 for each user 911 to 913 according to the information on the skin care course. The obtained result information may be stored in the memory 140 as history information for each user 911 to 913 .

Meanwhile, in the case of blue visible light or ultraviolet light, the electronic device 100 or the skin care device 200 may irradiate the user's skin with blue visible light or ultraviolet light for a specific time (eg, once a day, etc.). . That is, the use of blue visible light or ultraviolet light may be limited to a range that is not harmful to the human body.

For example, the processor 130 transmits result information driven according to the skin care course 921 in which the first user 911 drives the BLUE LED on the day A for 4 minutes from the skin care device 200 to the communication unit 120 ), history information for the first user 911 may be stored in the memory 140 . In addition, the processor 130 transmits the result information driven according to the skin care course 922 in which the second user 912 drives the RED LED on the day A for 8 minutes to the communication unit 120 from the skin care device 200 . If received through the , history information about the second user 912 may be stored in the memory 140 .

In this case, the processor 130 receives a user command for selecting a skin care course 921 in which the first user 911 drives the BLUE LED for 4 minutes on the same date A, the first user 911 stored in the memory 140 Based on the history of the user 911 , the display 150 may be controlled to display notification information that the skin care course 921 is limited on the A date.

In addition, the processor 130 receives a user command for selecting a skin care course 921 in which the second user 912 drives the BLUE LED for 4 minutes on the same date A, the second user stored in the memory 140 . Based on the history of 912 , the communication unit 120 may be controlled to transmit information about the skin care course 921 to the skin care apparatus 200 . In this case, the skin care apparatus 200 may perform the skin care course 921 according to the received information.

Meanwhile, in order to use the history information for each user as described above, a registration procedure and an authentication procedure may be first performed for each user.

Specifically, the electronic device 100 may perform an initial registration procedure for the user, and then perform an authentication procedure for identifying whether the user is one of the registered users. In the case of the registration procedure, the user enters, for example, unique registration information such as a password (eg, a text input method, a pattern input method, etc.) or registration information on the user's fingerprint, iris, face, vein, etc. input through the input interface 170 or the camera 110 of the In this case, the processor 130 may encrypt the input user's registration information and store it in the memory 140 or transmit it to an external server (eg, a server for authentication). In the case of the authentication procedure, various authentication algorithms may be used. For example, the processor 130 performs the input interface 170 or the camera 110 of the electronic device 100 in the same manner as the user's registration information is registered. ), when the user's authentication information (eg, password, fingerprint, iris, face, vein, etc.) is input, based on the user's registration information stored in the memory 140 or an external server, it corresponds to the inputted user's authentication information The user can be identified. That is, the electronic device 100 may operate according to the description of FIG. 8 by identifying one user among the plurality of users.

9 is a diagram for explaining a screen displayed on an electronic device according to an embodiment of the present disclosure.

Referring to FIG. 9 , the electronic device 100 according to an embodiment of the present disclosure may further include a display 150 . 9 is an example of a UI 1100 displayed on the display 150 .

The UI 1100 displayed on the display 150 includes an area 1110 in which a face image of a user is displayed, an area 1120 in which information about the user is displayed, an area 1130 in which detailed information of a skin condition is displayed, and skin. At least one of an area 1140 in which a list of the care device 200 is displayed and areas 1150 and 1160 in which a recommended product or a recommended service is displayed may be included.

An image acquired through the camera 110 may be displayed in the area 1110 in which the user's face image is displayed. In this case, the image may include the user's face.

In the area 1120 where information about the user is displayed, the user's ID (eg, name or nickname, etc.), gender, age, skin tone (overall skin color), skin type (eg, dry, oily, combination, normal, etc.) , information on characteristics of interest of the skin, etc. may be displayed. Here, the user's gender, age, skin tone, skin type, etc. may be input by the user or may be determined through a result of analyzing the user's face image.

In the area 1130 in which detailed information of the skin condition is displayed, information on the skin condition may be displayed as a result of analyzing the user's skin included in the image obtained through the camera 110 . For example, information about the skin condition expressed through various indicators such as level, percentage, and score that quantitatively evaluates various skin characteristics such as moisture, oil, pores, temperature, skin tone, wrinkles, pigmentation, and troubles will be displayed. can

A list of skin care apparatuses 200 connected through network communication through the communication unit 120 may be displayed in the area 1140 where the list of skin care apparatuses 200 is displayed. Here, the processor 130 transmits information on the skin care course to the selected skin care apparatus 200 when a user command for selecting a specific skin care apparatus 200 in the list of the skin care apparatus 200 is received. The communication unit 120 may be controlled. In this case, the selected skin care apparatus 200 may perform a skin care course based on the received information.

In areas 1150 and 1160 in which recommended products or recommended services are displayed, recommended products or recommended services based on the user's skin condition may be displayed. In this case, the recommended product or recommended service may refer to a product or service effective for improving a user's skin condition. To this end, the processor 130 controls the communication unit 120 to transmit the user's skin condition to an external device (eg, a server, etc.), and a recommended product or recommended service corresponding to the user's skin condition is transmitted from the external device to the communication unit ( When received through 120 , the display 150 may be controlled to display the received recommended product or recommended service in the corresponding areas 1150 and 1160 . In addition, a recommended product or a recommended service may be provided by collecting a skin interest set according to a user command or a usage history of the user's electronic device 100 or user terminal device (if there is user consent).

10 is a diagram for explaining a flowchart according to an embodiment of the present disclosure.

Referring to FIG. 10 , in the method of controlling the electronic device 100 according to an embodiment of the present disclosure, first, based on an image acquired through the camera 110 of the electronic device 100 , the image of a user included in the image is displayed. Information on the skin condition may be obtained (S1210).

Here, each of the plurality of skin conditions may include at least one of a pore state, a wrinkle state, a pigmentation state, and a trouble state of the user's skin.

Meanwhile, the step of acquiring information on the skin condition includes irradiating light to the user's skin using the light source unit 111 of the electronic device 100 , and the detecting unit 112 of the electronic device 100 in response to the irradiated light. may detect reflected light through , and information on the skin condition included in the image may be obtained based on an image obtained according to the detected reflected light.

Thereafter, from among a plurality of skin care courses corresponding to the acquired skin condition information, a skin care course corresponding to a device specification of the skin care apparatus 200 communicatively connected to the electronic device 100 may be identified ( S1220 ).

Here, in the plurality of skin care courses, at least one of a type of an LED driven by the skin care apparatus 200 and a driving time of the LED may be different from each other.

Here, the step of identifying the skin care course includes a plurality of skin conditions corresponding to the skin conditions obtained from information on a plurality of skin care courses matching each of the plurality of skin conditions stored in the memory 140 of the electronic device 100 . A skin care course may be identified, and a skin care course corresponding to a device specification of the skin care apparatus 200 may be identified from among a plurality of identified skin care.

Here, the device specification may include at least one of the number of the plurality of LEDs included in the skin care apparatus 200 and the type of each of the plurality of LEDs.

In this case, the step of identifying the skin care course may include a skin care course corresponding to the device specification of the skin care apparatus 200 among the plurality of skin care courses based on at least one of the number of the plurality of LEDs and the types of each of the plurality of LEDs. can be identified.

Meanwhile, the control method according to an embodiment of the present disclosure may further include receiving a device specification of the skin care apparatus 200 communicatively connected to the electronic apparatus 100 from the server 300 or the skin care apparatus 200 . can

Thereafter, information on the identified skin care course may be transmitted to the skin care apparatus 200 ( S1230 ).

Meanwhile, the information on the identified skin care course may include information on at least one of a type of an LED driven according to an identified skin condition among a plurality of LEDs included in the skin care device 200 and a driving time of the LED. have.

In this case, the skin care apparatus may drive at least one LED included in the skin care apparatus based on the information on the skin care course received from the electronic device.

Meanwhile, the control method according to an embodiment of the present disclosure further includes the step of storing information on the skin condition or result information driven by the skin care apparatus 200 according to the information on the skin care course as history information for the user. may include

Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium readable by a machine (eg, a computer). The device calls the stored instructions from the storage medium. and an electronic device (eg, the electronic device 100) according to the disclosed embodiments as a device capable of operating according to the called command. When the command is executed by the processor, the processor directly or the The function described in the instruction may be performed using other components under the control of the processor. The instruction may include code generated or executed by a compiler or an interpreter. A machine-readable storage medium is a non-transitory It may be provided in the form of a (non-transitory) storage medium, where 'non-transitory' means that the storage medium does not include a signal and is tangible, but data is semi-permanent or temporary in the storage medium It does not distinguish that it is stored as

The method according to various embodiments may be provided by being included in a computer program product. Computer program products may be traded between sellers and buyers as commodities. The computer program product may be distributed in the form of a machine-readable storage medium (eg, compact disc read only memory (CD-ROM)) or online through an application store (eg, Play Store™). In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily created in a storage medium such as a memory of a server of a manufacturer, a server of an application store, or a relay server.

Each of the components (eg, a module or a program) according to various embodiments may be composed of a singular or a plurality of entities, and some sub-components of the above-described sub-components may be omitted, or other sub-components may be various It may be further included in the embodiment. Alternatively or additionally, some components (eg, a module or a program) may be integrated into a single entity to perform the same or similar functions performed by each of the components before being integrated. According to various embodiments, operations performed by a module, program, or other component may be sequentially, parallel, repetitively or heuristically executed, or at least some operations may be executed in a different order, omitted, or other operations may be added. can

100: electronic device
200: skin care device

Claims (20)

In an electronic device,
camera;
communication department; and
Acquire information on the skin condition of the user included in the image based on the image acquired through the camera,
Identify a skin care course from among a plurality of skin care courses based on the acquired skin condition and a device specification of a skin care device communicatively connected to the electronic device through the communication unit,
and a processor controlling the communication unit to transmit information on the identified skin care course to the skin care device. According to claim 1,
A memory for storing information about a plurality of skin care courses matching the skin condition and device specifications; further comprising,
The processor is
identifying a plurality of skin care courses corresponding to the acquired skin condition from among the plurality of stored skin care courses, and identifying a skin care course corresponding to a device specification of the skin care apparatus from among the plurality of identified skin care courses electronic device. 3. The method of claim 2,
Information on the skin condition,
An electronic device including information on at least one of pores, wrinkles, pigmentation, and troubles of the skin. According to claim 1,
Information about the identified skin care course,
An electronic device including information on at least one of a type of an LED driven according to the identified skin condition among a plurality of LEDs included in the skin care device and a driving time of the LED. 5. The method of claim 4,
The plurality of skin care courses,
At least one of a type of an LED driven in the skin care device and a driving time of the LED are different from each other. 6. The method of claim 5,
The device specifications are:
Containing at least one of the number of the plurality of LEDs included in the skin care device and each type of the plurality of LEDs,
The processor is
An electronic device for identifying a skin care course corresponding to a device specification of the skin care apparatus from among the plurality of skin care courses based on at least one of the number of the plurality of LEDs and the type of each of the plurality of LEDs. According to claim 1,
The camera includes a light source unit for irradiating light of a wavelength corresponding to the skin condition and a detection unit for detecting reflected light corresponding to the irradiated light,
The processor is
Using the light source unit to irradiate light to the user's skin, detect reflected light through the detection unit in response to the irradiated light, and based on the image obtained according to the detected reflected light, the skin condition included in the image An electronic device for obtaining information about. According to claim 1,
The skin care device,
The electronic device drives at least one LED included in the skin care device based on the information on the skin care course received from the electronic device. 9. The method of claim 8,
memory; further comprising
The processor is
and storing the information on the skin condition or result information driven by the skin care device according to the information on the skin care course as history information about the user. According to claim 1,
The processor is
An electronic device that receives, from a server or the skin care device, a device specification of a skin care device communicatively connected to the electronic device through the communication unit. A method for controlling an electronic device, comprising:
acquiring information on a user's skin condition included in the image based on the image acquired through the camera of the electronic device;
identifying a skin care course corresponding to a device specification of a skin care device communicatively connected to the electronic device from among a plurality of skin care courses corresponding to the acquired skin condition information; and
and transmitting information on the identified skin care course to the skin care device. 12. The method of claim 11,
The step of identifying the skin care course,
Identifies a plurality of skin care courses corresponding to the acquired skin condition from among a plurality of skin care courses matching a skin condition and device specification stored in the memory of the electronic device, and takes care of the skin from among the identified plurality of skin care A control method for identifying a skin care course corresponding to a device specification of an apparatus. 13. The method of claim 12,
Information on the skin condition,
A control method comprising information on at least one of pores, wrinkles, pigmentation, and troubles of the skin. 12. The method of claim 11,
Information about the identified skin care course,
A control method comprising information on at least one of a type of an LED driven according to the identified skin condition among a plurality of LEDs included in the skin care device and a driving time of the LED. 15. The method of claim 14,
The plurality of skin care courses,
At least one of a type of an LED driven in the skin care device and a driving time of the LED are different from each other. 16. The method of claim 15,
The device specifications are:
Containing at least one of the number of the plurality of LEDs included in the skin care device and each type of the plurality of LEDs,
The step of identifying the skin care course,
A control method for identifying a skin care course corresponding to a device specification of the skin care apparatus from among the plurality of skin care courses based on at least one of the number of the plurality of LEDs and the type of each of the plurality of LEDs. 12. The method of claim 11,
The step of obtaining information about the skin condition includes:
Using the light source unit of the electronic device to irradiate light to the user's skin, detect reflected light through a detection unit of the electronic device in response to the irradiated light, and the image based on an image obtained according to the detected reflected light Obtaining information on the skin condition included in the control method. 12. The method of claim 11,
The skin care device,
A control method of driving at least one LED included in the skin care device based on the information on the skin care course received from the electronic device. 19. The method of claim 18,
Storing the information on the skin condition or result information driven by the skin care device according to the information on the skin care course as history information about the user; 12. The method of claim 11,
Receiving a device specification of the skin care apparatus communicatively connected to the electronic device from a server or the skin care apparatus; further comprising a control method.

Images