KR20190063524A - portable skin condition measuring device comprising polarizing film, and the diagnosis and managing system using thereof - Google Patents

Abstract

The present invention relates to a portable skin condition measurement device and a skin condition diagnosis and management system using the same. According to the present invention, the skin condition measurement device is a portable type to be easily carried, and reduces reflection of light which can be generated in imaging a face of a user, thereby effectively obtaining the whole facial image.

Description

A portable skin condition measuring apparatus including a polarizing film, and a skin condition diagnosis and management system,

The present invention relates to a portable skin condition measuring apparatus including a polarizing film, and a skin condition diagnosis and management system using the same.

More particularly, the present invention relates to a portable device capable of reducing light reflection that may occur during a user's face photographing and technically improving the difficulty of acquiring a face image due to light reflection, And a skin condition diagnosis and management system using the same.

In recent years, interest in beauty has increased and interest in the beauty of the user's face has been increasing. Particularly, a portable skin condition measuring device for photographing a user's face skin and analyzing various skin troubles (e.g., wrinkles, pores, acne, etc.) on the user's face is being developed.

Conventionally, a skin condition measuring device for skin analysis is a device for measuring a user's face based on predetermined photographing parameters (e.g., intensity, direction, aperture value or shutter speed, etc.) . That is, the conventional skin condition measuring device for skin analysis cuts off the external light and takes the entire face of the user through the illumination in the skin condition measuring device.

On the other hand, polarized images are images in which light reflection on the skin surface is eliminated by illumination, and it is necessary to analyze the accurate skin condition. In order to acquire such a polarized image, a conventional facial skin measurement device acquires a polarized image in a state where the external illumination is blocked in the form of a device for wrapping the entire face.

However, such a skin measuring device is inconvenient to carry and possess, and the price is difficult to be purchased by a general owner.

The present invention relates to a skin condition measuring apparatus capable of effectively obtaining a whole image of a face by reducing light reflection which may occur when a user takes a face, while being portable and portable.

The present invention also relates to a system for diagnosing and managing a skin condition using the skin condition measuring apparatus.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-mentioned problems, and has as its object the provision of a camera for capturing a user's face having a first polarizing film having a first polarizing axis attached thereto; A light source unit having a second polarizing film having a second polarizing axis at a predetermined relative angle with the first polarizing axis of the first polarizing film; And a plurality of user face images obtained based on the plurality of photographing parameters set for extracting a specific area of the user's face or a single user face image for skin condition measurement obtained by the user's face photographing camera, And a processor for extracting a specific area of the user's face and synthesizing a specific area of the extracted user's face to form an entire user's face image for skin condition measurement.

In one example, the predetermined relative angle of the first and second polarization axes may be in the range of 45 to 135 degrees.

In one example, the processor may analyze the brightness of a plurality of user face images obtained based on a plurality of preliminary photographing parameters, and set one or more of the plurality of preliminary photographing parameters to a plurality of photographing parameters.

In one example, the processor is configured to set a first preliminary imaging parameter to have a brightness value of a predetermined range for a first area of a user face image to a first imaging parameter, It is possible to set the second preliminary photographing parameter to have the brightness value in the predetermined range as the second photographing parameter.

In one example, the processor extracts a first face region from a first user face image obtained by the first imaging parameter, and extracts a second face region from a second user face image obtained by the second imaging parameter, And the first face region and the second face region may be combined to form an entire user's face image for skin condition measurement.

In one example, the processor may correct and synthesize the first face region and the second face region according to motion information of the sensed portable skin condition measuring apparatus.

In one example, the processor determines a brightness difference value between the first face area and the second face area in the vicinity of the first face area and the second face area boundary, and based on the brightness difference value, The composite weight for at least one of the first face region and the second face region is determined and the brightness of at least one of the first face region and the second face region is adjusted based on the composite weight value have.

In one example, the photographing parameter may include at least one of an intensity of the light source portion, a direction of the light source portion, a shutter speed, and an aperture value.

The portable skin condition measuring apparatus according to the present invention may further include an output unit for suggesting movement of a photographing place when the light reflectance of the user face image obtained by the user's face photographing camera is equal to or larger than a predetermined value . In this case, the processor can control the suggestion of moving the photographing place of the output unit.

The portable skin condition measuring apparatus according to the present invention may further include a communication unit for transmitting the single user face image or the entire user face image to an external user terminal, for example. In this case, the processor can control the communication unit to transmit data for the single user face image or the entire user face to the user terminal.

The present invention also relates to a skin condition diagnosis and management system. Wherein the skin condition diagnosis and management system includes the portable skin condition measurement device and the user terminal, wherein the user terminal analyzes the single user face image transmitted from the portable skin condition measurement device, Extracts a specific area of the user's face from each of the plurality of user's face images transmitted from the portable skin condition measuring device, synthesizes a specific area of the extracted user's face, An application for recommending a product for improving the skin condition of the user based on the diagnosis result of the skin condition by analyzing the entire image of the user's face after forming the image to provide a diagnosis result of the skin condition.

INDUSTRIAL APPLICABILITY The portable skin condition measuring apparatus according to the present invention can easily measure the skin condition in a desired place by carrying and carrying.

In addition, the portable skin condition measuring apparatus according to the present invention can reduce the light reflection that may occur at the time of user's face photographing, thereby effectively obtaining the entire face image.

Furthermore, the portable skin condition measuring apparatus according to the present invention can improve the accuracy of the facial skin analysis result by acquiring the facial image having the uniform brightness distribution over the entire area of the user's face.

Further, the portable skin condition measuring apparatus according to the present invention can perform diagnosis of a skin condition and recommendation of a customized product in cooperation with a user terminal.

Of course, the scope of the present invention is not limited by these effects.

1 shows a structure of a portable skin condition measuring apparatus according to the present invention.
2 is a view for explaining the relative angles of the first and second polarization axes of the first and second polarizing films according to the present invention.
3 is a block diagram briefly showing a configuration of a portable skin condition measuring apparatus according to the present invention.
FIG. 4 is a block diagram showing a detailed configuration of a portable skin condition measuring apparatus according to the present invention.
5A to 7E are diagrams for explaining a skin condition diagnosis and management system according to the present invention.
8A and 8B are flowcharts of a skin condition diagnosis and management system according to the present invention.
9A and 9B are block diagrams for explaining a skin condition diagnosis and management system implemented by the skin condition measuring apparatus according to the present invention.

Hereinafter, the present invention will be described in more detail with reference to drawings and examples.

In this specification, the singular forms "a", "an" and "the" include plural referents unless the context clearly dictates otherwise.

As used herein, the term " general term " is used to refer to functions of the present invention. However, the present invention is not limited to the intention or the precedent of the present invention. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

Embodiments of the present invention are capable of various transformations and may have various embodiments, and specific embodiments are illustrated in the drawings and described in detail in the description. It should be understood, however, that it is not intended to limit the scope to any particular embodiment, but is intended to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS In the following description of the embodiments of the present invention,

The terms first, second, etc. in this specification may be used to describe various elements, but the elements should not be limited by these terms. The terms are used only for the purpose of distinguishing one component from another.

In this specification, the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise.

As used herein, the terms "comprise", "comprising" and / or "comprising" are intended to specify the presence of stated features, integers, steps, operations, elements, components or combinations thereof, But do not preclude the presence or addition of features, numbers, steps, operations, components, parts, or combinations thereof.

In the present specification, a "module" or a "sub" performs at least one function or operation, and may be implemented in hardware or software, or a combination of hardware and software. In addition, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module except for 'module' or 'module' which need to be implemented by specific hardware, and implemented by at least one processor (not shown) .

Hereinafter, a portable skin condition measuring apparatus according to the present invention and a method for diagnosing and managing the skin condition using the same will be described in detail with reference to the accompanying drawings.

The present invention relates to a portable skin condition measuring apparatus. The skin condition measuring apparatus according to the present invention is a portable apparatus.

As used herein, the term " portable " means that the measuring apparatus is movable, and that the apparatus is a portable apparatus capable of being photographed at a desired position and place.

The existing skin condition measuring apparatuses are portable and non-portable. In the case of the non-portable skin condition measuring apparatus, since the apparatus is large and expensive, it is difficult to easily measure the condition of the user's skin at a desired place there was. On the other hand, in the case of the portable skin condition measuring apparatus, there is a technical difficulty in accurately acquiring a face image for allowing the user to grasp the skin condition. In particular, the user's face image is not obtained as desired .

Thus, the present inventors have found that by attaching the polarizing film so that the polarization axis of the polarizing film attached to the camera and the light source portion of the portable skin condition measuring device forms a predetermined relative angle, a clear face image in which the light reflection on the face skin surface is removed, A skin condition measuring device that can be obtained is developed.

In order to overcome the difficulty of acquiring a facial image due to the reflection of light from the surface of the facial skin due to external illumination, the present inventor measured the degree of light reflection from the real-time facial image acquired by the camera, A configuration for suggesting the user to move the photographing place and a processor for controlling the configuration are introduced to the skin condition measuring device. Therefore, the skin condition measuring apparatus according to the present invention can acquire a clear face image for skin condition analysis even in the presence of external light, not in a dark room.

1 shows a structure of a portable skin condition measuring apparatus according to the present invention. As shown in FIG. 1, the portable skin condition measuring apparatus 100 according to the present invention includes a user's face photographing camera 110 and light sources 120a and 120b. The first and second polarizing films 111 and 112 are attached to the user's face photographing camera 110 and the light source units 120a and 120b, respectively. The first and second polarizing films 111 and 112 have a first polarizing axis and a second polarizing axis, respectively, and the first and second polarizing axes have a predetermined relative angle.

As used herein, the term " relative angle between the first and second polarization axes " refers to a relative angle between the first polarizing film 111 and the second polarizing film 112 And the angle formed by the first and second polarization axes when the other polarizing film is placed on the same plane.

The first and second polarizing films 111 and 112 are respectively attached to the user's face photographing camera 110 and the light source units 120a and 120b so that the polarization axes thereof have a predetermined relative angle, It is possible to reduce the light reflection on the face surface. In FIG. 1, the light source units 120a and 120b are limited to two at the top and bottom of the user's face photographing camera. However, this is only an example, and the position of the light source unit of the portable skin condition measuring apparatus according to the present invention And the number is not particularly limited.

The user's face photographing camera 110 and the light source unit 120 are attached with first and second polarizing films 111 and 112, respectively.

The first and second polarizing films 111 and 112 may be absorptive, reflective, or semi-transmissive polarizing films, but are not limited thereto. Any commercially available polarizing film having a polarizing function may be employed without limitation .

The first and second polarization axes included in the first and second polarizing films 111 and 112 have a predetermined relative angle.

In one example, the predetermined relative angle of the first and second polarization axes may be in the range of 45 to 135 degrees.

In another example, the predetermined relative angle of the first and second polarization axes may be in the range of 65 ° to 125 ° or 75 ° to 115 °.

In another example, the relative angles of the first and second polarization axes may be substantially perpendicular. In the above, the term " substantially vertical " may mean that the relative angles of the first and second polarization axes of the first and second polarizing films 111 and 112 are in the range of 90 占 1 占. More specifically, as shown in Fig. 2, the relative angle between the first and second polarization axes of the first polarizing film 111 and the second polarizing film 112 is substantially perpendicular to the first polarizing film 111 111 and the second polarizing film 112 are positioned on the same plane, the first and second polarizing axes may exist at an angle of 90 ° ± 1 °. In addition, as described above, when it is assumed that the predetermined relative angle of the first and second polarization axes is also on the same plane as the first polarizing film 111 and the second polarizing film 112, it means.

As described above, when the first and second polarizing films are attached to the user's face photographing camera 110 and the light source unit 120 of the portable skin condition measuring device so that the polarization axes thereof have a predetermined relative angle, reflection of the skin surface is reduced It is possible to acquire a more accurate face image of a user and to combine with a technique of extracting / synthesizing a face area, which will be described later, and a technique of suggesting a movement of a place to be photographed according to measurement of light reflection degree.

The user's face photographing camera 110 according to the present invention photographs a face of a user.

Specifically, the camera 110 may acquire a user's face image by photographing a user's face based on an arbitrary photographing parameter.

The user face image acquired by the camera 110 may be, for example, a user face image for the formation of a single user face image described later, or a plurality of user face images for the formation of an entire user face image .

As used herein, the term " single-user face image " refers to a single image acquired by the camera 110 for skin condition analysis and formed by the processor 130, For the sake of differentiating the user's entire face image formed through a specific region extraction and synthesis technique of a plurality of user face images, the term is used herein.

In the present specification, the term " entire user face image " is formed through a technique of extracting a specific face area from each of a plurality of user face images obtained based on a plurality of photographing parameters and synthesizing them, The face image of the user.

In one example, the camera 110 may capture a user's face based on any imaging parameters to obtain a user's face image. In this case, the user face image may be formed by the processor 130 as a single user face image.

In another example, the camera 110 may acquire a plurality of images by photographing a user's face based on a plurality of photographing parameters.

More specifically, the camera may acquire a plurality of images by photographing the user's face a plurality of times based on different photographing parameters (intensity of the light source unit, shutter speed value, aperture value, etc.).

The light source unit according to the present invention includes at least one light source, and the light source provides light toward the user's face. In this case, the light source may be designed to emit at least one of red light, green light, and blue light, for example, and emit white light in the light source portion. Meanwhile, the light source unit may provide different intensities according to the control of a processor to be described later.

The portable skin condition measuring apparatus according to the present invention includes a processor for controlling the overall operation of the apparatus.

3 and 4 show a block diagram of a portable skin condition measuring apparatus according to the present invention. As shown in FIG. 3 and FIG. 4, each individual configuration of the portable skin condition measuring apparatus according to the present invention And is controlled and operated by the processor 130. In particular, the processor 130 may control the overall operation of the portable skin condition measuring apparatus 100 using various programs stored in the memory 170, which will be described later.

The processor 130 establishes, among other various control operations, the acquisition of a single user face image, or the acquisition of an entire user face image.

That is, the processor 130 forms a single user face image for the skin condition measurement obtained by the user's face photographing camera, or obtains a face image obtained based on a plurality of photographing parameters set for extracting a specific area of the user face A specific area of the user's face is extracted from each of the plurality of user's face images and a specific area of the extracted user's face is synthesized to form an entire user's face image for skin condition measurement.

A photographing parameter for analyzing the skin of the user's face is set by the processor 130. The photographing parameters may include, for example, at least one of the intensity of the light source unit, the direction of the light source unit, the shutter speed, and the aperture value provided in the portable skin condition measuring apparatus, and may be set differently for each user.

In one example, the processor 130 may analyze the brightness of the user face image obtained based on the preliminary imaging parameters, and set the preliminary imaging parameters as imaging parameters. At this time, the preliminary photographing parameter may be determined according to the external illumination environment. In this case, the processor 130 may acquire a user face image based on imaging parameters set on the basis of the preliminary imaging parameters, and set the user face image as a single user face image for skin condition measurement.

Hereinafter, the control operation of the processor 130 for extracting a specific area of a user's face based on a plurality of preliminary photographing parameters and composing them to form an entire user's face image for skin condition measurement will be described in more detail.

The processor 130 may analyze the brightness of a plurality of user face images obtained based on the plurality of preliminary photographing parameters and set one or more of the plurality of preliminary photographing parameters as a plurality of photographing parameters.

In one example, when an image photographed based on the first preliminary photographing parameter among a plurality of preliminary photographing parameters has a predetermined range of brightness values for a first area (e.g., a face center area) of the user's face, The processor 130 may set the first preliminary imaging parameter to the first imaging parameter corresponding to the first area of the user's face. Further, when the image photographed based on the second preliminary photographing parameter among the plurality of preliminary photographing parameters has a predetermined brightness value for a second area (e.g., a face outer area) of the user's face, the processor 130 May set the second preliminary photographing parameter to the second photographing parameter corresponding to the second area of the user's face.

That is, the processor 130 sets a first preliminary photographing parameter to have a brightness value of a predetermined range for the first area of the user's face image as a first photographing parameter, It is possible to set the second preliminary photographing parameter to have the brightness value in the set range as the second photographing parameter.

After the plurality of photographing parameters are set, the processor 130 extracts a specific area of the user face from each of the plurality of user face images obtained based on the set plurality of photographing parameters.

In one example, the processor 130 acquires a first user face image by capturing a user face based on the first imaging parameter, captures a user face based on the second imaging parameter, and acquires a second user face image can do. The processor 130 may extract a user face region corresponding to each of the plurality of images from the plurality of images, and may synthesize the extracted user face regions to obtain the entire face image.

That is, the processor 130 extracts a first face area from the first user face image obtained by the first photographing parameter, and extracts a second face area from the second user face image obtained by the second photographing parameter, Can be extracted. In addition, the processor 130 may combine the first face region and the second face region to form an entire user's face image for skin condition measurement.

At this time, the processor 130 may correct the first face region and the second face region according to the sensed movement information of the portable skin diagnostic apparatus. That is, when the movement of the portable skin condition measuring apparatus 100 is detected during the photographing of the second user face image, the processor 130 may correct the second face region according to the motion of the detected apparatus. According to another embodiment, the processor 130 may correct the second user face image before extracting the second face area according to the movement of the portable skin condition measuring apparatus 100. [ The detection of the motion as described above can be performed, for example, by the sensor unit 160 described later.

In addition, when combining the first face region and the second face region, the processor 130 may perform brightness correction to combine the first face region and the second face region.

Specifically, the processor 130 may determine a brightness difference value between the first face region and the second face region in the vicinity of the boundary between the first face region and the second face region. The processor 130 may determine a composite weight for at least one of the first face region and the second face region based on the brightness difference value. In this case, the composite weight may be a weight for adjusting the brightness. The processor 130 may adjust the brightness of at least one of the first face area and the second face area based on the composite weight.

The apparatus for measuring the portable skin condition according to the present invention may further include an output unit 150 for suggesting movement of a photographing location. The output unit 150 may suggest moving the photographing location when the light reflectance of the user facial image obtained by the user facial photographing camera is equal to or greater than a predetermined value. At this time, the processor 130 can control the suggestion of moving the photographing place of the output unit 150 as shown in FIG.

In general, when a polarizing film is included, the light reflection on the skin surface is reduced. However, if the external light is strong, the reflection of light by the external light may not be reduced by the polarizing film.

However, the portable skin condition measuring apparatus according to the present invention is a portable skin condition measuring apparatus that measures the light reflectance of the skin surface of a face from a real-time streaming image through a camera, determines whether the light reflectance is equal to or greater than a preset value, The above-described problems can be prevented in advance through the configuration of the output unit 130 and the output unit 150 that proposes the same.

In one example, the output unit 150 may include a display 151 and an audio output unit 153, and the suggestion of moving the photographing place May be performed by the display 151 and / or the audio output unit 153.

The display 151 of the output unit 150 can perform, for example, a suggestion of moving a photographing place. Also, the display 151 may display various image data and UI besides the suggestion of moving the photographing place.

The audio output unit 153 of the output unit 150 can perform, for example, a suggestion to move the photographing place by voice. The audio output unit 153 may output various kinds of notifications and voice messages in addition to suggestion of moving the photographing place.

In another example, the suggestion of moving the photographing place of the output unit 120 may be performed by an arrow representing an orientation of a desired photographing place or an LED implementing a specific color.

Meanwhile, the portable skin condition measuring apparatus according to the present invention can analyze a single user face image formed by the processor 130 or an entire user face image by itself.

After transmitting the single user face image or the entire user face image formed by the processor 130 to the user terminal 200, the single user face image or the entire user face image is analyzed through the user terminal 200 . In this case, the portable skin condition measuring apparatus may further include a communication unit 140.

That is, the portable skin condition measuring apparatus according to the present invention may further include a communication unit 140 for transmitting a single user face image or an entire user face image to an external user terminal. In this case, the processor 130 may control the communication unit 140 to transmit data for the single user face image or the entire user face image to the user terminal 200. [

The communication unit 140 may receive a request to take a user's face from, for example, an external user terminal 200 and may also send a single user face image or an entire user face image to the external user terminal 200 have. At this time, the communication unit 140 may be implemented as a Bluetooth module, but it may be realized by various communication modules such as a stationary communication module, a Wi-Fi communication module, or an NFC communication module.

Meanwhile, in the above-described embodiment, the portable skin condition measuring apparatus transmits the single user face image or the entire user face image to the external user terminal 200, but this is merely an example, May transmit a plurality of user face images obtained with the external user terminal 200 to the external user terminal 200. At this time, the user terminal 200 can analyze a skin condition of a user's face by extracting and synthesizing a specific face region in the same manner as that performed by the processor 130 described above.

In addition, the processor 130 directly analyzes the single user face image or the entire user face image to obtain skin condition information on at least one of pigmentation, acne, sebum, pores, and wrinkles on the user's face, And output the status information through the output unit 150. [

The portable skin condition measuring apparatus 100 according to the present invention may further include a sensor unit 160. The sensor unit 160 senses the external light and detects intensity and direction of the light source unit. And a shutter speed, an aperture value, an exposure value, and the like of the camera, and can detect motion information of the skin condition measuring device as described above.

In addition, the sensor unit 160 measures the light reflectance of the user's facial image, and controls the processor 130 in accordance with the result of the measurement, in cooperation with the sensing module of the memory 170, It is possible to perform the proposal of moving the photographing place by the photographing apparatus 150.

The sensor unit 160 may include a motion sensor (for example, an acceleration sensor, a gyro sensor, an electromagnetic sensor, etc.) and a portable skin condition measurement device And an illuminance sensor for sensing the illumination environment around the illuminating device 100. [

The portable skin condition measuring apparatus according to the present invention may further include a memory 170. [ The memory 170 may store various modules for driving the portable skin condition measuring apparatus 100.

For example, the memory 170 may store software including a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module. In this case, the base module is a basic module that processes signals transmitted from respective hardware included in the portable skin condition measuring device 100 and transfers the processed signals to an upper layer module. The sensing module is a module for collecting information from various sensors and analyzing and managing the collected information, and may include a face recognition module, a light reflectance measurement module, a voice recognition module, and a motion recognition module. The presentation module is a module for constructing a display screen, and may include a multimedia module for reproducing and outputting multimedia contents, a UI, and a UI rendering module for performing graphics processing. The communication module is a module for performing communication with the outside. A web browser module refers to a module that accesses a web server by performing web browsing. A service module is a module including various applications for providing various services.

As described above, the memory 170 may include various program modules, but it is needless to say that the various program modules may be partially omitted, modified or added depending on the type and characteristics of the portable skin condition measuring apparatus 100.

In addition, the memory 170 may store a plurality of photographing parameters for each user.

The memory 170 may be implemented as a nonvolatile memory, a volatile memory, a flash memory, a hard disk drive (HDD), or a solid state drive (SSD). Memory 170 is accessed by processor 130 and read / write / modify / delete / update of data by processor 130 may be performed.

The portable skin condition measuring apparatus according to the present invention may further include an input unit 180. The input unit 180 may input a user command to operate the portable skin condition measuring apparatus 100 and transmit information on the user command to the processor 130. [ Particularly, the input unit 180 may be a button (for example, a button for photographing) provided in the portable skin condition measuring apparatus 100, but it may be implemented by another input apparatus .

In one embodiment of the present disclosure, the input unit 180 may be implemented by a touch panel or a (digital) pen sensor for sensing a user's touch. The touch panel may use at least one of electrostatic, pressure sensitive, infrared, and ultrasonic methods, for example. Further, the touch panel may further include a control circuit. However, the input unit 180 may be implemented as a touch panel, a pen sensor, or the like, and may be implemented as a microphone or a pointing device for inputting a user's utterance.

The present invention also relates to a skin condition diagnosis and management system using the portable skin condition measuring apparatus.

The skin condition diagnosis and management system includes a portable skin condition measurement apparatus 100 and a user terminal 200.

The portable skin condition measuring apparatus 100 includes a camera 110, a light source 120, and a processor 130, as described above. The portable skin condition measuring apparatus 100 may include the communication unit 140, the output unit 150, the sensor unit 160, the memory 170, and the input unit 180 described above.

The user terminal 200 may analyze the single user face image transmitted from the portable skin condition measuring device, analyze the whole user's face image transmitted from the portable skin condition measuring device, Extracting a specific area of the user's face from each of a plurality of received user face images, composing a specific area of the extracted user face to form an entire user face image, (Hereinafter referred to as " skin analysis application ") that recommends a product for improving the user's skin condition based on the skin condition diagnosis result.

The skin condition diagnosis and management system according to the present invention includes a portable skin condition measurement apparatus (100). In addition, the portable skin condition measuring apparatus 100 includes a processor 130. The processor 130 provides information on the skin condition of the user's face in cooperation with the external user terminal 200, with reference to FIGS. 5A through 7E.

FIG. 5A shows a start screen of the skin analysis application included in the user terminal 200. FIG. The start screen of the skin analysis application may include a UI for user login. The skin analysis application is executed in response to a user's command, and when a user login is performed, the user terminal 200 can search for an external portable skin condition measurement device 100 that can communicate with the user. At this time, as shown in FIG. 4B, the user terminal 200 may display a screen for guiding the search of the external portable skin condition measuring apparatus 100.

When the external portable skin condition measuring apparatus 100 is searched, the user terminal 200 can perform communication with the external portable skin condition measuring apparatus 100. At this time, the user terminal 200 can communicate with the portable skin condition measuring apparatus 100 using Bluetooth or Wifi communication. When communication is established between the user terminal 200 and the portable skin condition measuring apparatus 100, the user terminal 200 may transmit information about the logged-in user to the portable skin condition measuring apparatus 100.

The processor 130 of the portable skin condition measuring apparatus 100 may determine whether or not the photographing parameter for the logged-in user is set in advance. When the photographing parameter corresponding to the logged-in user is not previously set, the processor 130 can analyze the brightness of the user's face image obtained based on the preliminary photographing parameter, and set the preliminary photographing parameter as the photographing parameter.

The processor 130 can acquire a user's face image by photographing the user's face based on the photographing parameter through the user's face photographing camera 110. [ The user face image may be transmitted to the user terminal through the communication unit 140 of the portable skin condition measuring apparatus and used as a single user face image for skin condition analysis.

Hereinafter, a specific area of the user's face is extracted from each of a plurality of user's face images obtained based on the plurality of preliminary photographing parameters and photographing parameters, and a specific area of the user's face is obtained by synthesizing the specific area.

The processor 130 of the portable skin condition measuring apparatus 100 can judge whether or not a plurality of photographing parameters for the logged-in user are preset. When a plurality of photographing parameters corresponding to the logged-in user are not pre-set, the processor 130 analyzes the brightness of a plurality of user face images obtained based on the plurality of preliminary photographing parameters, Any one or more of them can be set to a plurality of photographing parameters.

The processor 130 may acquire a plurality of images by photographing the user's face based on the plurality of preliminary photographing parameters through the user's face photographing camera 110. [

For example, the processor 130 may acquire the first through n-th images by taking a user's face based on the first through n-th pre-shooting parameters. At this time, the preliminary photographing parameters include intensity and direction of the light source unit 120; And the shutter speed, the aperture value, and the exposure value of the camera 110, and the values may be determined according to the external illumination sensed by the sensor unit 160.

If the image photographed based on the first preliminary photographing parameter among the plurality of preliminary photographing parameters has a brightness value of a predetermined range with respect to the central area of the user's face, the processor 130 sets the first preliminary photographing parameter It is possible to set the first photographing parameter corresponding to the center area. If the image photographed based on the second preliminary photographing parameter among the plurality of preliminary photographing parameters has a brightness value in a predetermined range with respect to the outer area of the user's face, the processor 130 sets the second preliminarily- The second photographing parameter corresponding to the outer area of the photographing area. That is, the processor 130 can set the preliminary imaging parameters having the optimum brightness values in the central area and the outer area of the user's face as the imaging parameters corresponding to the respective areas.

In the above-described embodiment, the user face is divided into two regions (for example, a center region and an outer region). However, the user face is divided into three or more regions, Can be set.

The processor 130 may acquire a plurality of images by photographing the user's face based on a plurality of predetermined imaging parameters through the user's face photographing camera 110. [ For example, the processor 130 may acquire a second user facial image photographed using the first user facial image and the second photographing parameter photographed using the first photographing parameter. At this time, the first user face image may include a center area 510-1 having a brightness value of the first range and an outer area 520-1 having brightness values of the second range as shown in FIG. 6A , And the second user face image includes a center area 510-2 having a brightness value in the third range and an outer area 520-2 having a brightness value in the fourth range as shown in FIG. 6B . At this time, the first range and the fourth range may overlap each other. That is, the first range and the fourth range may have the same or similar brightness values.

The processor 130 may extract corresponding user face regions from the plurality of user face images, and may synthesize the extracted regions to generate an entire user face image.

Specifically, the processor 130 extracts the center area 510-1 from the first user face image, extracts the outer area 520-2 from the second user face image, as shown in Fig. 6C, The center area 510-1 and the outer area 520-2 may be combined to generate the entire user's face image 530. [ At this time, the entire user's face image 530 may have a uniform brightness value as shown in FIG. 6C.

The processor 130 may control the communication unit 140 to transmit a single user face image for skin condition measurement or an entire user face image to the external user terminal 200. [

The application of the user terminal 200 can display the received whole face image of the user as shown in Fig. 7A.

The application of the user terminal 200 can display the received single user face image or the entire user face image, as shown in Fig. 7A.

The application of the user terminal 200 may provide a skin condition diagnosis result for a user face based on a single user face image or an entire user face image.

In one embodiment of the present invention, the application of the user terminal 200 may separate a single user face image or a whole user face image into a melanin image and a hemoglobin image using a dye separation technique. In addition, the application can acquire information on the degree of tingling and skin tone by analyzing the melanin image, and analyze the hemoglobin image to acquire information on the erythema existing on the user's face.

In another embodiment of the present invention, the application of the user terminal 200 may analyze the RGB of a single user face image or an entire user face image to obtain information on the acne existing on the user's face (for example, The probability of occurrence of acne, etc.).

Further, in another embodiment of the present invention, the application of the user terminal 200 may obtain information on sebum present in the user's face from UV images of a single user face image or an entire user face image.

In addition, in another embodiment of the present invention, the application of the user terminal 200 analyzes RGB of a single user face image or an entire user's face image to determine information (e.g., presence or absence of pores, The depth of the pores, etc.) can be obtained.

In another embodiment of the present invention, the application of the user terminal 200 may analyze the RGB of a single user face image or an entire user face image to obtain information on the wrinkles existing on the user's face (e.g., The depth of wrinkles, etc.) can be obtained.

Then, the application of the user terminal 200 can output information on the acquired skin condition of the user's face. For example, the application of the user terminal 200 is shown in FIG. 7B. A UI that visually provides information on the skin condition can be displayed.

In addition, the application of the user terminal 200 may display a UI including history information on the analyzed skin condition, as shown in FIG. 7C.

In addition, as shown in FIG. 7D, the application of the user terminal 200 may display a UI for providing information on skin trouble prevention information and recommendation cosmetics.

That is, the application recommends a product for improving the user's skin condition based on the skin condition diagnosis result.

In addition, the application of the user terminal 200 can provide a chat service with the skin consultant, as shown in FIG. 7E.

8A and 8B are sequence diagrams of a skin condition diagnosis and management system using the skin condition measuring apparatus according to the present invention.

FIG. 8A is a sequence diagram for a system for forming a single user face image and diagnosing and managing the skin condition based thereon, FIG. 8B is a system for forming a whole face image of a user and diagnosing and managing the skin condition based thereon ≪ / RTI >

Specifically, the portable skin condition measuring apparatus 100 sets a photographing parameter or a plurality of photographing parameters (S710). At this time, the portable skin condition measuring apparatus 100 may set the plurality of preliminary imaging parameters, which can acquire an image having an optimal brightness value for each area of the user's face among a plurality of preliminary imaging parameters, as a plurality of imaging parameters.

Then, the portable skin condition measuring apparatus 100 and the user terminal 200 can perform communication (S720). In another embodiment of the present invention, step S710 may be performed after step S720.

The portable skin condition measuring apparatus 100 may acquire a user's face image or a plurality of images by photographing the user's face based on the photographing parameters or the plurality of photographing parameters (S730).

Then, the portable skin condition measuring apparatus 100 may generate a single user face image or an entire user face image (S740). Specifically, the portable skin condition measuring apparatus 100 can form a user face image obtained based on the set photographing parameters into a single user face image, or can make a correspondence for each of a plurality of images obtained by a plurality of photographing parameters And extracts the user face regions, and synthesizes the extracted user face regions to generate an entire user face image.

Then, the portable skin condition measuring apparatus 100 may transmit a single user face image or an entire user face image to the user terminal 200 (S750).

Then, the user terminal 200 may analyze the single user face image or the entire user face image (S760). In particular, the user terminal 200 may obtain information (e.g., acne, hue, wrinkles, etc.) about the skin condition of the user's face by analyzing the entire user's face image.

Then, the user terminal 200 can provide information on the skin condition of the user's face and product recommendation for skin condition improvement (S770).

On the other hand, a user face movement proposal (B) controlled by the processor (130) according to the present invention and implemented by the output unit (120) A real-time review (A) of the process 130 may be performed before the scam step S710 and before the S730.

Meanwhile, the skin condition measuring apparatus can perform the above-described skin condition diagnosis and information providing function, and will be described in detail below.

9A and 9B are block diagrams illustrating a skin condition diagnosis and management system according to the present invention implemented by a skin condition measurement apparatus.

The steps S910 to S930 shown in Figs. 9A and 9B are the same as those described in the above-described skin condition diagnosis and management system, and a detailed description thereof will be omitted.

The portable skin condition measuring apparatus 100 may determine the skin condition of the user's face by analyzing the single user face image or the synthesized user's entire face image (S940). Specifically, the portable skin condition measuring apparatus 100 analyzes a single user's face image or a synthesized user's entire face image to detect skin troubles (e.g., acne, pore, wrinkles, etc.) Information about the state can be obtained.

Then, the portable skin condition measuring apparatus 100 can provide information on the determined skin condition (S950). At this time, the portable skin condition measuring apparatus 100 can visually provide information and a service about the skin condition through various UIs as shown in FIG. 7, but this is merely an embodiment, Information about the state can be provided.

The above-described methods may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like. The above hardware devices may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

According to various embodiments of the present invention as described above, it is possible to enhance the accuracy of the facial skin analysis result by acquiring a facial image having an even brightness distribution over the entire area of the user's face without light reflection. In addition, since the user's face need not be inserted into the skin condition measuring device, convenience of carrying and holding can be improved.

Although the present disclosure has been described with reference to certain embodiments and drawings, it is to be understood that the present disclosure is not limited to the above-described embodiments, and that various modifications and changes may be made thereto by those skilled in the art. This is possible. Therefore, the scope of the present disclosure should not be construed as being limited to the embodiments described, but should be determined by the appended claims, as well as the appended claims.

100: Portable skin condition measuring device
110: User's Face Camera
111: first polarizing film
120: Light source
121: second polarizing film
130: Processor
140:
150:
151: Display
152: Audio output section
160:
170: memory
180: input
200: user terminal

Claims (11)

A user's face photographing camera to which a first polarizing film having a first polarizing axis is attached;
A light source unit having a second polarizing film having a second polarizing axis at a predetermined relative angle with the first polarizing axis of the first polarizing film; And
The method comprising the steps of: forming a single user face image for skin condition measurement obtained by the user's face photographing camera, or creating a single user face image for each of a plurality of user face images acquired based on a plurality of shooting parameters set for extracting a specific area of the user face And a processor for extracting a specific region of the face and synthesizing a specific region of the extracted user face to form an entire user's face image for skin condition measurement. The method according to claim 1,
Wherein the predetermined relative angle of the first and second polarization axes is in a range of 45 to 135 degrees. The method according to claim 1,
The processor comprising:
Wherein a brightness of a plurality of user face images obtained based on a plurality of preliminary photographing parameters is analyzed and at least one of the plurality of preliminary photographing parameters is set to a plurality of photographing parameters. The method of claim 3,
The processor comprising:
Setting a first preliminary photographing parameter to have a brightness value in a predetermined range for a first area of the user's face image as a first photographing parameter,
And sets a second preliminary photographing parameter to have a brightness value in a predetermined range for a second area of the user's face image as a second photographing parameter. 5. The method of claim 4,
The processor comprising:
Extracting a first face region from a first user face image obtained by the first photographing parameter, extracting a second face region from a second user face image obtained by the second photographing parameter, Area and the second face area to form a whole image of the user's face for skin condition measurement. 6. The method of claim 5,
The processor comprising:
And corrects and synthesizes the first face area and the second face area according to the motion information of the sensed portable skin condition measuring device. 6. The method of claim 5,
The processor comprising:
Determining a brightness difference value between the first face area and the second face area in the vicinity of the first face area and the second face area boundary, and based on the brightness difference value, And synthesizing weight of at least one of the first face region and the second face region based on the composite weight. The method according to claim 1,
Wherein the photographing parameter includes:
A light source unit, an intensity of the light source unit, a direction of the light source unit, a shutter speed, and an aperture value. The method according to claim 1,
Further comprising an output unit for suggesting movement of a photographing place when the light reflectance of the user's face image obtained by the user's face photographing camera is equal to or greater than a predetermined value,
Wherein the processor controls the suggestion of moving the photographing place of the output unit. The method according to claim 1,
Further comprising a communication unit for transmitting the single user face image or the entire user face image to an external user terminal,
Wherein the processor controls the communication unit to transmit data for the single user face image or the entire user face to the user terminal. A portable skin condition measuring device according to any one of claims 1 to 10. And a user terminal,
The user terminal analyzes the single user face image transmitted from the portable skin condition measuring device, analyzes the entire user's face image transmitted from the portable skin condition measuring device, Extracting a specific area of the user's face from each of the user's face images, composing a specific area of the extracted user's face to form an entire user's face image, analyzing the entire user's face image to provide a skin condition diagnosis result, And an application for recommending a product for improving a user's skin condition based on the diagnosis result of the skin condition.

Images