KR101701210B1 - Method for outputting an skin analysing result, apparatus and application therefor - Google Patents

Abstract

The present invention discloses a method and an apparatus for analyzing skin condition of a user and outputting analysis results. An apparatus according to the present invention includes: a first camera for receiving an image; A display unit for displaying information; And performing at least one skin analysis on at least one analysis item based on the user image acquired through the camera, and controlling at least one graphic object representative of each analysis item through the display unit, And a control unit for adjusting the size of each figure object based on the evaluation value of the item.

Description

FIELD OF THE INVENTION [0001] The present invention relates to a method and apparatus for outputting skin analysis results,

The present invention relates to a method for analyzing a skin condition of a user and outputting analysis results, and an apparatus and an application therefor.

With increasing interest in cosmetics, public interest in skin care is also increasing. Each individual is trying to maintain optimal skin condition, either by receiving medical treatment or using cosmetics to prevent skin aging or skin troubles.

However, in order for an individual to search for a dermatology or skin care center for skin care, it is necessary to involve a considerable expense and effort in receiving medical treatment. Various cosmetics for preventing skin aging are also available. There is a problem that it is difficult to find.

Accordingly, if the skin condition can be checked from the photographs taken through the camera included in the mobile terminal or personal computer, which are popularized in the past, each individual can check their skin condition regardless of time and place.

However, even if skin analysis is performed using a camera included in a mobile terminal, a personal computer, or the like, if the skin analysis result is represented by a simple numerical value, it is difficult for a user with poor skin condition to instill a sense of alarm. Accordingly, there is an increasing need to provide a user interface for notifying a user of a vulnerable item as well as an improvement method for a vulnerable item.

It is an object of the present invention to provide a skin analysis result output method and apparatus therefor.

Specifically, the present invention provides a skin analysis result output method and a device therefor that can emphasize a user's weak point when skin analysis of a user is performed.

It is another object of the present invention to provide a skin analysis result output method and an apparatus therefor that can collectively guide a method for improving a user's week point.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, unless further departing from the spirit and scope of the invention as defined by the appended claims. It will be possible.

According to an aspect of the present invention, there is provided an apparatus for analyzing skin comprising: a camera for inputting an image; A display unit for outputting information; And extracting, as an image for skin analysis, an Nth frame when at least N frames are continuously detected, and setting at least one analysis region in the extracted image, And a controller for performing analysis.

According to another aspect of the present invention, there is provided an apparatus for analyzing skin comprising: a camera for inputting an image; A display unit for outputting information; And a control unit for photographing a plurality of photographs through the camera when the user's face is recognized from the image input through the camera, selecting one of the plurality of photographs, and selecting at least one analysis area And then performing a skin analysis on the analysis area.

According to an aspect of the present invention, there is provided a skin analysis method including: receiving an image through a camera; Analyzing the image input through the camera and detecting a frame satisfying a predetermined condition; Selecting an Nth frame as an image for skin analysis if N frames are continuously detected that satisfy the predetermined condition; Setting at least one analysis region in the extracted image; And performing a skin analysis on the analysis area.

According to another aspect of the present invention, there is provided a skin analysis method comprising: recognizing a face of a user from an image input through a camera; Photographing a plurality of photographs with the camera when the face of the user is recognized; Selecting one of the plurality of photographs; Setting at least one analysis region in the face in the selected photo; And performing a skin analysis on the analysis area.

The technical solutions obtained by the present invention are not limited to the above-mentioned solutions, and other solutions not mentioned are clearly described to those skilled in the art from the following description. It can be understood.

The present invention has the effect of providing a skin analysis result output method and an apparatus therefor.

Specifically, the present invention has an effect of providing a skin analysis result output method and an apparatus therefor that can emphasize a user's weak point when skin analysis of a user is performed.

The present invention also provides an apparatus and method for outputting a skin analysis result that can collectively guide a method for improving a user's week point.

The effects obtained by the present invention are not limited to the above-mentioned effects, and other effects not mentioned can be clearly understood by those skilled in the art from the following description will be.

1 and 2 are views showing a dressing table to which a skin analysis method can be applied.
3 is a block diagram of an electronic part mounted on a dressing table.
4 is a view showing a skin analysis method applicable to the present invention.
FIG. 5 is a diagram illustrating an example of determining whether a user for each input image desires to use a dressing table.
6 is a diagram illustrating an example of extracting an image suitable for skin analysis from an image input by a camera.
7 is a diagram showing an example in which a plurality of analysis regions are set in the face of the user.
8 is a diagram illustrating a skin analysis result output method according to an embodiment of the present invention.
9 is a diagram showing an example in which an evaluation result for at least one analysis item is output.
Fig. 10 is a diagram showing an example in which the size of a figure and the color of a figure are determined based on evaluation values of the respective analysis items.
11 is a diagram showing an example in which a figure object moves freely.
12 to 14 are diagrams showing examples in which graphic objects are superimposed and displayed.
FIG. 15 is a diagram showing an example in which the detail analysis result is output as the graphic object is touched. FIG.
16 is a diagram showing an example in which a pointer is touched in an area where both objects overlap.
17 is a diagram illustrating an example of outputting a list of images describing the skin management method.
18 is a diagram showing an example in which recommended cosmetic information is output.
19 is a diagram showing an example in which a purchase window for purchasing a recommended cosmetic product is output.

Hereinafter, a skin analysis apparatus and a control method thereof according to the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role.

The skin analysis method described later can be applied to various terminals in which an application for skin analysis can be installed and executed. That is, the skin analysis method according to the present invention can be applied not only to a mobile terminal but also to a fixed terminal. The portable terminal may be a portable terminal carried by a user such as a mobile phone, a smart phone, a digital camera, a PDA, a laptop, MP3, and the like. The fixed terminal may be a portable terminal such as a television, a desktop, a kiosk, Which means that the terminal is usually used fixedly at one location. For convenience of explanation, a fixed terminal will be exemplified as a terminal to which a skin analysis method is applied in the following embodiments. Among the fixed terminals, a vanity unit on which electronic components are mounted will be described as an example.

1 and 2 are views showing a dressing table 10 to which a skin analysis method can be applied. Referring to the example shown in FIG. 1, the mirror 120 may be exposed on the front portion of the dressing table 10. At this time, at least a part of the mirror 120 can be utilized as the display unit 125 that outputs information. Accordingly, the user can check various information outputted through the display unit 125 while viewing his or her own image on the mirror 120.

The light source unit 140 may be installed on the dressing table 10. The light source 140 may be arranged to illuminate the user's face when the user is positioned in front of the dressing table 10. [ As the user's face brightens, the effect of the user's skin tone and makeup state on the mirror can be more apparent. 1 and 2, the light source unit 140 is located on the left and right edges of the dressing table 10, but the position of the light source unit 140 is not limited to the illustrated example.

On the rear surface of the mirror 120, a case 12 on which electronic parts can be mounted can be located. Electronic components such as the communication unit 110, the camera 130, the memory 150, and the control unit 170, which will be described later with reference to FIG. 3, may be mounted on the case 12. The camera 130 mounted on the case 12 can take a role of photographing the outside of the display unit. To this end, it is preferable that the back surface portion of the mirror 120 (that is, the surface abutting the case 12) is in a state capable of transmitting light.

The dressing table 10 according to the present invention may be combined with a cosmetic refrigerator 20 capable of storing cosmetics. At this time, a mirror may be attached to the door 190 of the cosmetic refrigerator 20, but this is not necessarily so. The cosmetic refrigerator 20 may include a temperature controller 170 for controlling the temperature of the refrigerating compartment (or the freezing compartment). The temperature control unit 170 can appropriately control the temperature of the refrigerating compartment (or the freezing compartment) to control the cosmetics to be stored at a proper temperature.

The illustrated dressing 10 may be designed for use on a wall. To this end, a groove may be formed on the back of the case 12 for fastening a pin attached to the wall.

With reference to Fig. 3, the dresser 10 shown in Figs. 1 and 2 will be described in more detail.

3 is a block diagram of an electronic part to be mounted on the dressing table 10. 3, the dressing table 10 according to the present invention includes a communication unit 110, a display unit 125, a camera 130, a light source 140, a memory 150, a sensing unit 160, (180) and a control unit (170).

The communication unit 110 receives data from the outside or transmits data to the outside. The dressing table 10 can communicate with an external server or an external terminal through the communication unit 110.

(E.g., Bluetooth, Zigbee or NFC (Near Field Communication)), mobile communication technology (e.g., Long Term Evolution (LTE), High Speed Downlink Packet Access (HSDPA) (Wireless Local Area Network), Wi-Fi (Wireless Fidelity), etc.) may be applied, or wired communication technology may be applied.

The display unit 125 outputs information under the control of the controller 170. At this time, the display unit 125 can be attached to at least a part of the mirror. In this case, the mirror 120 plays a role of illuminating the user by using the reflection of incident light, and at the same time, plays a role of outputting information through at least a part of the area (i.e., the area where the display unit 125 is combined) You can do it.

The display unit 125 may have a mutual layer structure with the touch sensor or may be integrally formed with the touch sensor so as to have a touch screen. When the display unit 125 is configured as a touch screen, the display unit 125 may function as an input device for providing an input interface to a user and an output device for outputting information.

The camera 130 can photograph the front surface of the mirror 120. For example, the camera 130 may capture a user looking at the mirror 120. The front side of the mirror 120 (i.e., the side facing the user) reflects the light, and the back side (i.e., the case 12 and the back side) Face) can have a translucent form that allows light to pass through. As the reflective surface reflecting the light is exposed to the outside, the user will be able to illuminate his / her appearance in the mirror. As the transmission surface through which the light passes is set to face the camera 130, the camera 130 will be able to shoot the outside of the vanity.

The image data collected through the camera 130 may be analyzed and processed with user control commands. In addition, the controller 170 analyzes the video signal input to the camera 130 to determine whether the user is located in front of the dresser 10 and whether the user in the video is a registered user.

The light source unit 140 may emit light. The light source unit 140 may include a light emitting unit such as an LED (Light Emitting Unit), an incandescent lamp, a fluorescent lamp, or the like. The lighting of the light source unit 140 may be controlled by the control unit 170 or may be controlled by a manual input operation of the switch for turning on / off the light source unit 140, for example. The user may be able to make makeup more easily by using the light illuminated from the light source unit 140. [

The memory 150 stores data supporting various functions of the terminal. The memory 150 may store a plurality of application programs, for example, an application for skin analysis, and various data driven by the mobile terminal. The program and data stored in the memory 150 can be operated by the control unit 170. [ In addition, information on a user who wants to use the dressing table 10 may be pre-registered in the memory 150.

The sensing unit 160 may sense the state of the terminal. In addition, the sensing unit 160 may sense a user approaching the dresser 10. The control unit 170 activates the camera 130 and analyzes the image input through the camera 130 so that a state in which a nearby user wants to use the dresser 10 Can be determined.

The temperature regulating unit 180 serves to regulate the temperature of the cosmetics receiving unit. The temperature controller 180 may adjust the temperature of the refrigerating chamber (or the freezer) under the control of the user or under the control of the controller 170.

The control unit 170 controls the overall operation of the dressing table 10. The control unit 170 may process or process signals, data, information, and the like input or output through the above-described components, or may drive or run an application program stored in the memory 150 to provide or process appropriate information or functions to the user .

Electronic components constituting the communication unit 110, the display unit 125, the camera 130, the memory 150, the sensing unit 160, the control unit 170, and the like shown in FIG. 3 are shown in FIGS. 1 and 2 Which can be mounted on a case. The electronic components constituting the temperature regulator 190 shown in Fig. 3 can be mounted on the cosmetic refrigerator 20 shown in Figs. 1 and 2.

In FIGS. 1 to 3, the display portion 125 is illustrated as being attached to a mirror. However, the display unit 125 does not necessarily have to be attached to the mirror 120. The display unit 125 may be exposed to the front surface of the dressing table 10 independently of the mirror 120.

The controller 170 may execute an application for skin analysis for skin analysis of the user. Further, when the skin analysis application is executed, the control unit 170 may communicate with the skin analysis server for storing skin analysis results.

When the user's skin is analyzed, the controller 180 may output the user's skin analysis result through the display unit 125 of the user. Before examining the output of the skin analysis result through the display unit 125, an example of the skin analysis method will be described.

4 is a view showing a skin analysis method applicable to the present invention. If the proximity of the user to the dressing table 10 is detected through the sensing unit 160 in step S401, the controller 170 activates the camera 130 in step S402, And may determine whether the user wishes to use the vanity unit 10 (S403). For example, when a face of a person is recognized from a video signal input through the camera 130, the controller 180 may determine that the user intends to use the vanity 10. [ At this time, in order to distinguish the case where the user simply passes the front of the dressing table 10 and the case where the user wants to use the dressing table 10, the controller 170 controls the main elements of the face The mouth, the eyebrows, etc.) are all detected, the user can judge that he wants to use the dresser 10.

In addition, in order to distinguish the case where the user simply passes the front of the dressing table 10 and the case where the user desires to use the dressing table 10, when the size of the face in the image is equal to or larger than a predetermined size, It can be determined that the user intends to use the vanity unit 10.

For example, FIG. 5 illustrates an example in which a user per each input image determines whether or not the user desires to use the dressing table 10. As in the example shown in Fig. 5A, if the face of the user is recognized, all the main elements of the face (e.g., both eyes, nose, mouth, etc.) are captured, The controller 170 may determine that the user wants to use the dresser 10.

Alternatively, as in the example shown in FIG. 5B, if the face of the user is recognized but some of the main elements of the face are not captured, the controller 170 determines whether the user uses the dresser 10 It can be judged that the state is not the desired state.

If all of the main elements of the user's face and face are captured and the user's face size is small as in the example shown in FIG. 5C, since the user is far away from the vanity 10, It can be determined that the user does not want to use the dresser 10.

Although the camera 130 is illustrated as being activated when the proximity of the user is sensed through the sensing unit 160, the camera 130 is always activated regardless of whether the sensing unit 160 is sensed or not State can be maintained.

If it is determined that the user wants to use the vanity unit 10 (S403), the control unit 170 can turn on the light source unit 140 (S404). That is, before the analysis of the skin, the light source unit 140 brightens the face of the user, so that an environment where the skin analysis of the user is easy can be made.

Then, the control unit 170 analyzes the image input through the camera 130 and extracts an image suitable for skin analysis from the input image (S405).

In detail, the controller 180 determines whether the image input through the camera 130 is an image input through the camera 130, considering the face size of the user in the image, the degree of inclination of the user's face, Images suitable for skin analysis can be extracted.

For example, FIG. 6 shows an example of extracting an image suitable for skin analysis from an image input by a camera.

The control unit 180 controls the brightness of the face of the user to be greater than or equal to a predetermined size, when the face of the user is determined not to be inclined by more than a predetermined angle, It can be judged that it is suitable for skin analysis.

Referring to FIG. 6, first, the controller 170 may determine whether the horizontal or vertical length of the user face in the frame input through the camera 130 is greater than or equal to a predetermined size (S601). For example, when the predetermined size is set to 1000 pixels (px), the control unit 170 may determine that the user's face is larger than a predetermined size when the vertical length of the user's face is 1000 px or more.

Then, the control unit 170 determines whether a line connecting the center of the nose of the user in the frame input through the camera and the center of the lip is deviated by a predetermined angle or more with respect to a virtual straight line connecting the center and the lower center of the upper end of the display unit 150 (S602). When the line connecting the center of the nose and the center of the lips is maintained at a predetermined angle (for example, 2 degrees or less) with the virtual line, the controller 170 can determine that the user's face is not tilted to one side.

The controller 170 then determines whether the difference between the brightness of the user's face in the image (i.e., the skin tone) and the brightness (i.e., skin tone) in the photograph of the user registered in the memory 150 is less than a predetermined value (S603). The control unit 180 may determine that the brightness of the user's face is maintained at an appropriate level when the brightness difference between the user's face in the image and the photograph of the user registered in the memory 150 is less than a predetermined value.

Thereafter, the controller 170 may determine the Nth frame as an image for skin analysis of the user (S605) when a frame satisfying the above listed conditions is detected N times in succession (S604).

If the frame satisfying the above conditions is not the Nth frame, the controller 170 may determine whether or not the next frame satisfies the above listed conditions. If the above conditions are not satisfied, the control unit 170 analyzes the image input through the camera 130, detects N consecutive frames satisfying the above-mentioned conditions, Can be determined as an image for the user.

FIG. 6 illustrates the face size of the user, the degree of tilting of the face, and the brightness of the face as conditions for judging whether the image is suitable for skin analysis. However, not all of the above listed conditions should be used to judge whether the image is suitable for skin analysis, and only a part of the listed conditions may be used to extract an appropriate image. In addition, the steps S601 to S603 shown in FIG. 6 may be irrelevant even if the order is reversed.

If the sharpness of the extracted image for skin analysis is lower than a predetermined value (S406), the controller 170 may extract the image for skin analysis again. If the user moves instantaneously and the sharpness of the user's face in the image is low, it is not possible to perform the skin analysis with the extracted image. Therefore, reliable skin analysis results can be obtained by re-extracting the image for skin analysis.

Thereafter, the control unit 170 determines the positions of the main elements (e.g., eyes, nose, mouth, and the like) of the face in the extracted image and sets a plurality of analysis regions on the face of the user (S407).

For example, FIG. 7 shows an example in which a plurality of analysis regions are set on the face of a user. The control unit 170 can confirm positions of both eyes, nose, and mouth from the face of the user in the extracted image. Once the locations of the main elements of the enumerated face are identified, the controller 170 may set a plurality of analysis areas on the face based on the locations of the identified key elements. 7, the forehead 710, the balls 720 and 730, the nose 740, and the jaw 750 are set as the analysis regions.

It is needless to say that a smaller number of analysis regions than the illustrated example may be set and a larger number of analysis regions than the illustrated examples may be set.

When the analysis area is set, the controller 170 may perform skin analysis for each analysis area (S408). Specifically, the controller 170 may analyze at least one of pores, melanin, oil index, moisture index, skin tone, wrinkles, dullness, and trouble for each analysis area.

The results of performing the skin analysis can be individually stored for each user using the vanity unit 10. [ Thus, a process of performing a user login may be added prior to performing skin analysis. The login process may be performed using an ID and a password, or may be performed through facial recognition or voice recognition (e.g., comparing a previously registered user photograph with a face recognized through a camera, Sign in with a user account that matches your face).

The above-described embodiments are merely illustrative of various skin analysis methods that can be applied to the dresser according to the present invention. Even if the skin analysis is performed by a method different from the above-described embodiment, the display method of the skin analysis result described below can be applied.

Hereinafter, a method of displaying skin analysis results after skin analysis is performed will be described.

8 is a diagram illustrating a skin analysis result output method according to an embodiment of the present invention. The controller may diagnose the skin condition of the user and, as a result, may quantify skin analysis results of at least one analysis item (S801). Specifically, the control unit can calculate the skin analysis results of at least one of pores, dullness, trouble, skin tone, and wrinkles as numerical values.

For example, when the skin condition is the best, it is represented by 100, and when the skin condition is the worst, 0, the analysis result of pore, dullness, trouble, It can be quantified.

In this case, the larger the size of the pore, the closer the value is to 0, and the smaller the size of the pore, the closer to 100 the result will be. The size analysis results show that the larger the size of the area occupied by the skin (for example, point or freckle) is, the closer the value is to 0, and the smaller the value occupied by the dullness is, The results of the trouble analysis show that the larger the number of skin troubles (e.g., frunks or wounds) or the size of the area occupied by the skin troubles, the closer the value to 0 and the more the number of skin troubles or the area occupied by skin troubles The smaller the size, the closer it will be to 100. The skin tone analysis results show that the darker the skin color, the closer to 0, and the brighter the skin color, the closer to 100 it will be. As the number of wrinkles or the size of the area occupied by wrinkles increases, the closer the value to zero, the closer to 100 the number of wrinkles or the area occupied by wrinkles will be.

Unlike the above description, the case where the skin condition is the best is represented by 0, the case where the skin condition is the worst is represented by 100, the analysis result of each analysis item may be numerically expressed to be.

When the evaluation value for at least one analysis item is calculated, the control unit can output the evaluation value for each analysis item through the display unit. At the same time, the control unit may output the graphic object representing each analysis item through the display unit (S802).

For example, FIG. 9 is a diagram showing an example of outputting an evaluation result for at least one analysis item. When the skin analysis is completed, the control unit can control the evaluation value for each analysis item to be output as in the example shown in Fig. In FIG. 9, evaluation values for five analysis items such as the pores 901, the troubles 903, the dullness 905, the skin tone 907, and the wrinkles 909 are illustrated as being output.

The control unit can output weather information 910, time information 920, and the like. Although not shown, the weather information may include UV index information and precipitation information along with weather and temperature information. In addition, the control unit may also output the information of the logged-in user (which is illustrated in FIG. 9 as a picture of the user being output) 930.

The control unit can control so that graphic object 941, 943, 945, 947, 949 representing each analysis item is additionally output. Each figure object may have the name of the analysis item mapped to the figure object.

At this time, based on the evaluation value of each analysis item, the control unit can determine the size of the graphic object representing the analysis item and the color of the graphic object.

For example, FIG. 10 shows an example in which the size of a graphic object and the color of a graphic object are determined based on the evaluation value of each analysis item.

In the case where the evaluation values are classified into a plurality of classes (illustrated as being classified into five classes in FIG. 10), the control unit controls the size or color of the figure object to be determined in accordance with the rating of the evaluation value of each analysis item .

In FIG. 10, it is illustrated that the higher the evaluation value, the lower the grade is assigned, and the lower the evaluation value, the higher the grade is assigned. In addition, it is illustrated that the size of the figure object becomes smaller as the evaluation value becomes higher (i.e., the lower the rating is), and the larger the evaluation value (i.e., the higher the rating), the larger the size of the figure object. It is also illustrated that different colors are assigned on the RGB color table for each evaluation level.

In FIG. 10, it is exemplified that the evaluation values can be classified into five grades in total. However, this is merely an example for convenience of explanation, and the present invention is not limited thereto. It goes without saying that there may be fewer or a greater number of rating classes than the examples shown.

In Fig. 10, the size of the figure object is smaller as the evaluation value is lowered, and the size of the figure object is larger as the evaluation value is higher. In this case, the graphic object of the analysis item corresponding to the high grade will attract the user around the graphic object of the analysis item corresponding to the low grade. Accordingly, the user can more easily recognize the analysis item having the low evaluation value (i.e., the analysis item having the high evaluation rating).

Contrary to the example shown in the drawing, it is also possible to set the size of the figure object to be larger as the evaluation value becomes lower, and the size of the figure object becomes smaller as the evaluation value becomes higher. In this case, the user will be able to more easily recognize an analysis item having a high evaluation value (i.e., an analysis item having a low evaluation rating).

When at least one graphic object is outputted, the control unit can control each graphic object to freely move along a preset locus or an arbitrary locus. At this time, the control unit can control so that the size of the figure object and the moving speed are in inverse proportion relation. That is, if the size of the graphic object is small, the graphic object can be set to move quickly, and if the size of the graphic object is large, the graphic object can be set to move slowly.

For example, FIG. 11 shows an example in which a figure object moves freely. For convenience of explanation, only two figure objects are illustrated on the display unit. At this time, it is assumed that a figure object having a larger size among the two figure objects moves along the first trajectory, while an object having a smaller size moves along the second trajectory.

The control unit can control so that the size of the figure object and the movement speed of the figure object are inversely proportional to each other. That is, the larger the figure object, the smaller the moving speed, and the smaller the figure object, the larger the moving speed.

Accordingly, the moving distance d1 of the large figure object moving along the first trajectory after the elapse of the predetermined time has a smaller value than the moving distance d2 of the small figure object moving along the second trajectory Will be.

By differentiating the moving speed of the graphic object, the user will be able to more easily touch the graphic object having a small moving speed. If the geometric object size becomes larger as the evaluation value becomes lower (i.e., the higher the evaluation level is), the user can see the shape object of the analysis item having the lower evaluation value (i.e., the shape object of the analysis item with the higher evaluation rating) It will be easy to touch.

Unlike the illustrated example, the control unit may control the size of the figure object and the moving speed of the figure object to be in proportion to each other. That is, the larger the figure object, the larger the moving speed, and the smaller the figure object, the smaller the moving speed.

In order to save the display space, the control unit can control the graphic objects to be superimposed and displayed. At this time, the control unit can determine which one to display on the basis of the arrangement order of the graphic object objects or the size of each graphic object object.

For example, FIGS. 12 to 14 show examples in which graphic objects are superimposed and displayed. The control unit can determine which one of the superimposed figure objects is to be displayed on the basis of the order of arrangement of the respective figure objects. For example, as in the example shown in Fig. 12, if the graphic object is placed in the horizontal direction, the control unit displays the graphic object disposed on the right side (or the graphic object disposed on the left side) The graphic object can be arranged so that it is positioned above the placed graphic object). In Fig. 12, a figure object disposed on the right side is illustrated as being disposed on a figure object disposed on the left side.

As another example, the control unit may be arranged such that a graphic object having a small size (or a graphic object having a large size) is placed on top of a graphic object having a large size (or a graphic object having a small size) depending on the size of the graphic object. In Fig. 13, a figure object with a small size is illustrated as being placed on a figure object having a large size. The larger the size of the graphic object, the more noticeable the user is, while the smaller the size of the graphic object, the less noticeable the user is. In consideration of this, if the graphic object having a small size is arranged on the graphic object having a large size as in the example shown in FIG. 13, the visibility of the graphic object having a small size can be expected to be increased.

The control unit may determine whether to apply the embodiment described with reference to FIG. 12 or the embodiment described with reference to FIG. 13, depending on the size of the graphic object. For example, the arrangement according to the size of each graphic object is applied first (FIG. 13), but when the size of the overlapping graphic objects is the same, arrangement according to the position of graphic object can be applied Yes).

The control unit may superimpose the graphic object on the graphic object, and may display that the graphic object is overlapped in the overlapped area of the graphic object. For example, when the graphic object of the first color and the graphic object of the second color are superimposed on each other as in the example shown in FIG. 14, the control unit displays the first color and the second color Can be controlled to be displayed.

When a user input touching any one of at least one graphic object output through the display unit is received (S803), the control unit may control the output of a detailed analysis result of the analysis item corresponding to the selected graphic object (S804) . The detailed analysis result includes at least one of the evaluation results accumulated for a predetermined period of time for the selected analysis item, the change trend for the selected analysis item, the average value of the user's peer group for the selected analysis item, and the skin age estimated based on the selected analysis item May be included.

FIG. 15 is a diagram showing an example in which the detail analysis result is output as the graphic object is touched. FIG. When any one of at least one graphic object moving freely on the display unit is touched, the control unit may output a detailed analysis result of the analysis item corresponding to the selected graphic object.

For example, in FIG. 15A and FIG. 15B, a figure object corresponding to the analysis item 'pore' is touched, and a detailed analysis result for the item 'pore' is output. 12 (b), the detailed analysis result shows that a period of 2 months from April 4, 2011 to April 4, 2014. 6, 10, (1510) < / RTI &

In FIG. 15 (b), the cumulative analysis result 1510 for a predetermined period of time for the item 'pore' is output in the form of a line graph. However, the cumulative analysis result is not necessarily output in the form of a line graph something to do. Cumulative analysis results may be output to other types of graphs (e.g., bar graphs) than the illustrated examples, and evaluation values for a predetermined period of time for the 'pore' item may be provided in tabular form.

In addition, the control unit may control the selected analysis item to output a result of comparing the current skin analysis result and the skin analysis result that was most recently performed before performing the current skin analysis (1520). In FIG. 15, it is illustrated that the evaluation value for the item 'pore' is increased by 7 points, and as a result, the evaluation grade is shown to be increased by two steps.

The detailed analysis result may include an average evaluation value 1530 for the selected analysis item in the same age range as the user. Thus, for the selected analysis item, the user can check whether the skin condition is good compared to his or her peers. The control unit receives the average evaluation value for the selected analysis item in the same age range as the user from the external server through the wireless communication unit, and can display the average evaluation value.

The detailed analysis result may include the skin age 1540 of the user, which is estimated based on the evaluation value of the selected analysis item (or all the analysis items). If the estimated skin age is higher than the actual age of the user, the controller outputs the skin age as the first color, and if the calculated skin age is less than the actual age of the user, the controller outputs the skin age as the second color .

When the area in which the graphic object objects are displayed in a superimposed manner is touched, the control unit can output the skin analysis result for the analysis item corresponding to any one of graphic object objects displayed in a superimposed manner.

For example, FIG. 16 shows an example in which a pointer is touched in an area where both objects overlap. For convenience of explanation, it is assumed that a figure object corresponding to 'pore' and a figure object corresponding to 'unevenness' are superimposed and displayed. When the area where the two graphic objects overlap is touched while the two graphic object objects are overlapped and displayed, the control unit can control the output of the analysis result of the graphic object displayed above the two graphic object objects. In Fig. 16, since the graphic object indicating the 'noisy' is above the graphic object indicating the 'pore', the analysis result for the 'noisy' is output in response to the touch input of the user to the overlapping area It will be possible.

As another example, the control unit may control the output of the analysis result of the graphic object having the small size (or the graphic object having the large size) among the two graphic objects in response to the touch input of the user to the overlap area. In Fig. 16, since the size of the figure object corresponding to the " unevenness " is smaller than the size of the figure object corresponding to the " pore ", the analysis result for the " .

When a predetermined user input (e.g., a user input that touches the 'related care view' button shown in FIG. 15) is received during the output of the detailed analysis result (S805), the control unit displays a skin management method A list of images or recommended cosmetic information may be output (S806).

For example, FIG. 17 is a diagram illustrating a list of images describing the skin management method. The control unit may output a list of images including a title of each image and a preview image of each image, as in the example shown in FIG. At this time, the images included in the image list may be streaming reproducible from an external server, or may be stored in a memory and locally reproducible. The controller can arrange the images in order of the popular images to construct the image list.

If any one of the video lists is selected, the control unit will be able to reproduce the selected video.

18 is a diagram showing an example in which recommended cosmetic information is output. The control unit may output a list of recommended cosmetics, including the name of each recommended cosmetics, the efficacy of each recommended cosmetics, and an image of each recommended cosmetics, as in the example shown in FIG. Information about recommended cosmetics may be obtained from a database stored in memory or remotely from an external server. The control unit can arrange the recommended cosmetics list by arranging the recommended cosmetics in the popular cosmetics order (or in the order of high sales or high price (or low price)).

The control unit may further output cosmetic information suitable for the selected analysis item among the cosmetics stored in the cosmetic refrigerator. For example, if the list of recommended cosmetics for the analysis item 'pores' is being output, the control unit may control the cosmetic information stored in the cosmetics refrigerator to output cosmetic information suitable for 'pore care'.

In FIG. 18, a display window 1810 for outputting cosmetic information suitable for management of a selected analysis item 'pore' among the cosmetics stored in the cosmetic refrigerator is additionally output on the recommended cosmetic list.

The list of cosmetics stored in the cosmetics refrigerator may be updated on the basis of the cosmetics information input by the user before skin analysis (for example, cosmetics name, cosmetics price, cosmetics capacity, efficacy, etc.) Analysis and automatically updated. In order to photograph the interior of the refrigerator, a camera for photographing the interior of the refrigerator may be included in the refrigerator.

If any one of the recommended cosmetics lists is selected, the control unit can control the output of a purchase window for purchasing the selected cosmetics.

For example, FIG. 19 shows an example in which a purchase window for purchasing a recommended cosmetic product is output. As in the example shown in FIG. 19 (a), if any one of the recommended cosmetic products is selected, the control unit can obtain a purchase page for ordering the selected recommended cosmetic product as in the example shown in FIG. 19 (b) And the like. The user can purchase the recommended cosmetics selected through the purchase page.

According to an embodiment of the present invention, the above-described methods (operation flow diagrams) can be implemented as code readable by a processor on a medium on which the program is recorded. Examples of the medium that can be read by the processor include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage, etc., and may be implemented in the form of a carrier wave (e.g., transmission over the Internet) .

The above-described dresser 10 is not limited to the configuration and the method of the embodiments described above, but the embodiments may be modified so that all or some of the embodiments are selectively combined .

10: Dressing table
20: Cosmetics Refrigerator
110:
120: Mirror
125:
130: camera
140: Light source
150: Memory
160: sensing part
170:
180: Temperature control unit

Claims (36)

A first camera for receiving an image;
A display unit for displaying information; And
Performing skin analysis on at least one analysis item based on the user image acquired through the camera,
Wherein at least one graphic object representative of each analysis item is output through the display unit,
A control unit for adjusting the size of each graphic object based on the evaluation value of each analysis item,
/ RTI >
Wherein the controller controls to output information on cosmetics related to the selected analysis item among the cosmetics possessed by the user when any one of the at least one analysis items is selected. The method according to claim 1,
And the size of the figure object increases as the evaluation value of the analysis item becomes smaller. The method according to claim 1,
Wherein each figure object moves along a predetermined trajectory or an arbitrary trajectory. The method of claim 3,
Wherein the moving speed of each figure object is inversely proportional to the size of each figure object. The method according to claim 1,
Wherein the controller adjusts the colors of the graphic object based on evaluation values of the analysis items. The method according to claim 1,
And each figure object is superimposed and displayed with another figure object. The method according to claim 6,
Wherein the control unit determines a figure object to be placed on top of the superimposed figure objects according to the arrangement order of the figure object. The method according to claim 6,
Wherein the controller determines a figure object to be placed on top of the overlapping figure objects according to the size of each figure object. The method according to claim 1,
Wherein the control unit controls the detailed evaluation information on the analysis items corresponding to the selected graphic object to be output when any one of the at least one graphic object is selected. 10. The method of claim 9,
And the detailed evaluation information includes an evaluation result accumulated for a predetermined period with respect to the analysis item. 11. The method of claim 10,
Wherein the detailed evaluation information includes information on an increase / decrease width of a current evaluation value with respect to the latest evaluation value for the analysis item. 10. The method of claim 9,
Wherein the detailed evaluation information includes a skin age of the user calculated based on an evaluation value for the analysis item. The method according to claim 1,
Wherein the control unit controls to output a moving image list composed of images describing the skin management method related to the selected analysis item when any one of the at least one analysis items is selected. The method according to claim 1,
Wherein the control unit controls to output a list of recommended cosmetics related to the selected analytical item when any one of the at least one analytical items is selected. 15. The method of claim 14,
Wherein the control unit controls to output a purchase page for purchasing the selected recommended cosmetics when any one of the recommended cosmetics lists is selected. delete The method according to claim 1,
Characterized in that the device further comprises a cosmetic refrigerator for storing the cosmetic product. 18. The method of claim 17,
Wherein the cosmetics refrigerator further comprises a second camera for acquiring an image of the cosmetics refrigerator,
Wherein the control unit recognizes the cosmetic held by the user based on the image obtained from the second camera. The method according to claim 1,
The apparatus further comprises a mirror for illuminating the user,
Wherein the display is formed in at least a portion of the mirror. 20. The method of claim 19,
Wherein one surface of the mirror is a reflecting surface for reflecting light to form an image, and the other surface is a transmitting surface for transmitting light. 21. The method of claim 20,
Wherein the reflective surface of the mirror is exposed to the outside and the transmissive surface of the mirror is in contact with the camera. Receiving an image through a first camera;
Performing skin analysis on at least one analysis item based on a user image acquired through the first camera;
Outputting at least one graphic object representative of each analysis item when the skin analysis is completed; And
Outputting a video list composed of videos describing a skin management method related to the selected analysis item when any one of the at least one analysis items is selected;
, ≪ / RTI &
Wherein the size of each figure object is determined based on an evaluation value of each of the analysis items. 23. The method of claim 22,
Wherein the size of the figure object increases as the evaluation value of the analysis item becomes smaller. 23. The method of claim 22,
Wherein each figure object moves along a predetermined trajectory or an arbitrary trajectory in the display unit. 25. The method of claim 24,
Wherein the moving speed of each figure object is inversely proportional to the size of each figure object. 23. The method of claim 22,
Wherein the color of each figure object is determined based on an evaluation value of each of the analysis items. 23. The method of claim 22,
And outputting detailed evaluation information on an analysis item corresponding to the selected graphic object when any one of the at least one graphic object is selected. 28. The method of claim 27,
And the detailed evaluation information includes an evaluation result accumulated for a predetermined period with respect to the analysis item. 29. The method of claim 28,
Wherein the detailed evaluation information includes information on an increase / decrease width of a current evaluation value with respect to a latest evaluation value of the analysis item. 29. The method of claim 28,
Wherein the detailed evaluation information includes a skin age of the user calculated based on an evaluation value for the analysis item. delete 23. The method of claim 22,
Further comprising the step of outputting a list of recommended cosmetics related to the selected analytical item when any one of the at least one analytical items is selected. 33. The method of claim 32,
Further comprising the step of outputting a purchase page for purchasing the selected recommended cosmetics when any one of the recommended cosmetics lists is selected. 23. The method of claim 22,
Further comprising the step of outputting cosmetic information related to the selected analytical item among the cosmetic products held by the user when any one of the at least one analytical items is selected. 35. The method of claim 34,
Wherein the cosmetic product possessed by the user is obtained by analyzing an image obtained from a second camera that photographs the interior of the refrigerator. A function of receiving an image through a first camera;
Performing a skin analysis on at least one analysis item based on a user image acquired through the first camera; And
And outputting at least one graphic object representative of each analysis item when the skin analysis is completed,
The size of each figure object is determined based on the evaluation value of each analysis item,
And controlling the output of information on a cosmetic article related to the selected analytical item or a moving image list composed of images describing the skin management method related to the selected analytical item when any one of the at least one analytical item is selected, Application.

Images