KR102052722B1 - portable skin condition measuring device comprising polarizing film, and the diagnosis and managing system using thereof - Google Patents

Abstract

The present invention relates to a portable skin condition measuring apparatus and a skin condition diagnosis and management system using the same.
The skin condition measuring apparatus according to the present invention is a portable form that is easy to carry, and reduces the light reflection that may occur when photographing the user's face, thereby effectively obtaining the entire face image.

Description

Portable skin condition measuring device comprising polarizing film, and the diagnosis and managing system using

The present invention relates to a portable skin condition measuring apparatus including a polarizing film, and a skin condition diagnosis and management system using the same.

More specifically, the present invention reduces the light reflection that may occur when photographing a user's face, and technically improves the difficulty of acquiring a face image due to the light reflection, thereby enabling a user to effectively acquire and analyze a face image of the user. Skin condition measuring device and a skin condition diagnosis and management system using the same.

Recently, as interest in beauty increases, interest in skin care of a user's face is increasing. In particular, a portable skin condition measuring apparatus for photographing the skin of a user's face and analyzing various skin problems (for example, wrinkles, pores, and acne) on the user's face has been developed.

Conventional skin condition measuring apparatus for skin analysis is based on the user's face is placed in the skin condition measuring device based on the preset shooting parameters (for example, the intensity, direction, aperture value, shutter speed, etc. of the light source) Photographed. That is, the conventional skin condition measuring device for skin analysis blocks the external light and photographs the entire face of the user through the light in the skin condition measuring device.

On the other hand, the polarized image is an image from which the light reflection of the skin surface by illumination is removed, which is necessary to analyze the accurate skin condition. In order to acquire such a polarized image, a conventional front face skin measuring device obtains a polarized image in a situation in which external lighting is cut off in the form of a device covering the entire face.

However, such a skin measuring device was inconvenient to carry and possess, and the price was also difficult for ordinary holders to purchase.

Republic of Korea Patent Publication No. 2014-0007125

The present invention relates to a portable condition measuring device that is portable and easy to carry and reduces the light reflection that may occur when photographing a user's face, thereby effectively obtaining the entire face image.

The present invention also relates to a system for diagnosing and managing a skin condition using the skin condition measuring apparatus.

The present invention has been made in order to solve the above problems, a camera for photographing the user's face with a first polarizing film having a first polarization axis; A light source unit with a second polarizing film having a second polarizing axis forming a predetermined relative angle with the first polarizing axis of the first polarizing film; And forming a single user face image for skin condition measurement obtained by the user face photographing camera, or from each of the plurality of user face images obtained based on a plurality of shooting parameters set to extract a specific area of the user face. The present invention relates to a portable skin condition measuring apparatus including a processor for extracting a specific region of a user face and synthesizing the extracted specific region of the user face to form an entire image of the user face for skin condition measurement.

In one example, the predetermined relative angles of the first and second polarization axes may be in the range of 45 ° to 135 °.

In one example, the processor may analyze the brightness of the plurality of user face images acquired based on the plurality of preliminary shooting parameters, and set any one or more of the plurality of preliminary shooting parameters as the plurality of shooting parameters.

In one example, the processor sets the first preliminary shooting parameter to have the brightness value of the preset range for the first area of the user face image as the first shooting parameter and for the second area of the user face image. The second preliminary shooting parameter to have the brightness value in the preset range may be set as the second shooting parameter.

In one example, the processor extracts a first face region from the first user face image obtained by the first imaging parameter, and a second face region from the second user face image obtained by the second imaging parameter. Extracting and synthesizing the first face region and the second face region to form an entire image of the user's face for skin condition measurement.

In one example, the processor may correct and synthesize the first face region and the second face region according to the detected motion information of the portable skin condition measuring apparatus.

In one example, the processor determines a brightness difference value between the first face area and the second face area near a boundary between the first face area and the second face area, and based on the brightness difference value, The composite weight of at least one of the first face region and the second face region may be determined and synthesized by adjusting the brightness of at least one of the first face region and the second face region based on the composite weight. have.

In one example, the photographing parameter may include at least one of an intensity of the light source unit, a direction of the light source unit, a shutter speed, and an aperture value.

The portable skin condition measuring apparatus according to the present invention may further include, for example, an output unit for suggesting a photographing location movement when the light reflectance of the user face image acquired by the user face photographing camera is equal to or greater than a preset value. . In this case, the processor may control a proposal to move a photographing place of the output unit.

The portable skin condition measuring apparatus according to the present invention may further include, for example, a communication unit transmitting the single user face image or the entire user face image to an external user terminal. In this case, the processor may control the communication unit to transmit data about the single user face image or the entire user face image to the user terminal.

The invention also relates to a skin condition diagnosis and management system. The skin condition diagnosis and management system includes the portable skin condition measuring device and a user terminal, wherein the user terminal analyzes a single user face image transmitted from the portable skin condition measuring device or from the portable skin condition measuring device. Analyze the entire image of the received user's face or extract a specific area of the user's face from each of the plurality of user's face images received from the portable skin condition measuring device, and synthesize the specific area of the extracted user's face to synthesize the entire user's face After the image is formed, the entire face image of the user is analyzed to provide a skin condition diagnosis result, and an application for recommending a product for improving the skin condition of the user based on the skin condition diagnosis result.

The portable skin condition measuring apparatus according to the present invention can be easily carried and carried so that the skin condition can be easily measured at a desired place.

In addition, the portable skin condition measuring apparatus according to the present invention can effectively obtain the entire face image by reducing the light reflection that may occur when shooting the user's face.

Furthermore, the portable skin condition measuring apparatus according to the present invention can increase the accuracy of the facial skin analysis result by acquiring a face image having a uniform brightness distribution over the entire area of the user's face.

Furthermore, the portable skin condition measuring apparatus according to the present invention may be linked with the user terminal to perform diagnosis of the skin condition and recommendation of a customized product.

Of course, the scope of the present invention is not limited by these effects.

1 illustrates a structure of a portable skin condition measuring apparatus according to the present invention.
It is a figure for demonstrating the relative angle of the 1st and 2nd polarization axis of the 1st and 2nd polarizing film which concerns on this invention.
3 is a block diagram briefly illustrating a configuration of a portable skin condition measuring apparatus according to the present invention.
Figure 4 is a block diagram showing in detail the configuration of the portable skin condition measuring apparatus according to the present invention.
5A to 7E are exemplary views for explaining a skin condition diagnosis and management system according to the present invention.
8a and b is a flow chart for the skin condition diagnosis and management system according to the present invention.
9A and 9B are block diagrams illustrating a skin condition diagnosis and management system implemented by a skin condition measuring apparatus according to the present invention.

Hereinafter, the present invention will be described in more detail with reference to the drawings and examples.

In this specification, the singular forms “a”, “an” and “the” include plural forms unless the context clearly dictates otherwise.

The terminology used herein is to select general terms that are currently widely used as possible in consideration of the functions in the present invention, but may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies, and the like. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

Embodiments of the present invention may add various transformations and have various embodiments, and specific embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the scope to the specific embodiment, it should be understood to include all transformations, equivalents, and substitutes included in the spirit and technical scope of the invention. In describing the embodiments, when it is determined that the detailed description of the related known technology may obscure the gist, the detailed description thereof will be omitted.

The terms first, second, etc. may be used herein to describe various components, but the components should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another.

In this specification, the singular encompasses the plural unless the context clearly indicates otherwise.

In this specification, terms such as "comprise" or "consist" are intended to indicate that there is a feature, number, step, action, component, part, or combination thereof described on the specification, one or more other It is to be understood that the present invention does not exclude the possibility of the presence or the addition of features, numbers, steps, operations, components, parts, or a combination thereof.

In the present specification, the 'module' or 'unit' performs at least one function or operation, and may be implemented by hardware or software or a combination of hardware and software. In addition, the plurality of modules or the plurality of units may be integrated into at least one module except for the modules or units that need to be implemented with specific hardware, and are implemented as at least one processor (not shown). Can be.

Hereinafter, a portable skin condition measuring apparatus and a method for diagnosing and managing a skin condition using the same will be described in detail with reference to the accompanying drawings.

The present invention relates to a portable skin condition measuring device. The skin condition measuring device according to the present invention is a portable device.

As used herein, the term "portable" means a mobile device capable of moving the measuring device and photographing at a desired location and location.

Conventional skin condition measuring device has a portable and non-portable type, and the non-portable skin condition measuring device has a large size and a high price, making it difficult to easily measure a user's skin condition at a desired location. there was. On the other hand, in the case of the portable skin condition measuring device, there is a technical difficulty in accurately acquiring a face image for identifying the skin condition, and in particular, the face image of the user is not acquired as desired by light reflection by external light. There was a problem.

Accordingly, the present inventors attach the polarizing film such that the polarization axis of the polarizing film attached to the camera and the light source of the portable skin condition measuring device forms a predetermined relative angle, thereby providing a clear face image that is portable but has no light reflection on the face skin surface. An apparatus for measuring skin condition that can be obtained has been developed.

In addition, the present inventors measure the degree of light reflection from the real-time face image obtained by the camera to compare with a predetermined value in order to overcome the difficulty of obtaining a face image as the light reflection of the face skin surface is induced by external lighting, etc. A configuration for suggesting a movement of a photographing place to a user and a processor for controlling the same are introduced into a skin condition measuring apparatus. Therefore, the apparatus for measuring skin condition according to the present invention can obtain a clear face image for analyzing the skin condition even in the presence of external lighting rather than a dark room.

1 illustrates one structure of a portable skin condition measuring apparatus according to the present invention. As shown in FIG. 1, the portable skin condition measuring apparatus 100 according to the present invention includes a user face photographing camera 110 and light sources 120a and b. First and second polarizing films 111 and 112 are attached to the user face photographing camera 110 and the light source units 120a and b, respectively. The first and second polarization films 111 and 112 have a first polarization axis and a second polarization axis, respectively, and the first and second polarization axes form a predetermined relative angle.

As used herein, the term “relative angle between the first and second polarization axes” is based on the polarizing film of any one of the first polarizing film 111 and the second polarizing film 112, as shown in FIG. 2. When another polarizing film is located on the same plane, it means the angle which a 1st and 2nd polarizing axis make.

The first and second polarizing films 111 and 112 may be attached to the user's face photographing camera 110 and the light source units 120a and b so that the polarization axes form a predetermined relative angle, respectively, so that the first and second polarizing films 111 and 112 may be derived from the illumination from the light source unit and the external light. It can reduce the light reflection on the face surface. Meanwhile, in FIG. 1, two light sources 120a and b are positioned at the upper and lower portions of the camera for photographing a user's face. However, the light source units 120a and b are only two examples, and the light source units 120a and b are merely examples. And the number is not particularly limited.

First and second polarizing films 111 and 112 are attached to the camera 110 for photographing the user's face and the light source 120, respectively.

In the above, the first and second polarizing films 111 and 112 may be absorbing, reflective or transflective polarizing films, but are not limited thereto. Any polarizing film having a commercially available polarizing function may be used without limitation. .

The first and second polarization axes included in the first and second polarization films 111 and 112 form a predetermined relative angle.

In one example, the predetermined relative angles of the first and second polarization axes may be in the range of 45 ° to 135 °.

In another example, the predetermined relative angle of the first and second polarization axes may be in the range of 65 ° to 125 ° or 75 ° to 115 °.

In another example, the relative angles of the first and second polarization axes may be substantially perpendicular. As used herein, the term “substantially vertical” may mean that the relative angles of the first and second polarization axes of the first and second polarization films 111 and 112 are in the range of 90 ° ± 1 °. More specifically, as shown in FIG. 2, the relative angles of the first and second polarization axes of the first polarizing film 111 and the second polarizing film 112 are substantially perpendicular to each other. Assuming that 111 and the second polarizing film 112 are positioned on the same plane, it may mean that the first and second polarization axes exist at an angle of 90 ° ± 1 °. In addition, as described above, when the predetermined relative angles of the first and second polarization axes are also assumed to be located on the same plane as the first polarizing film 111 and the second polarizing film 112, it means.

As described above, when the first and second polarizing films are attached to each of the user face photographing camera 110 and the light source unit 120 of the portable skin condition measuring apparatus so that the polarization axis has a predetermined relative angle, the skin surface reflection is reduced. A more accurate user face image can be obtained, and combined with a face region extraction / synthesis technique described below and a photographing place movement suggestion technique based on a degree of light reflection measurement, a user's skin state can be more clearly identified.

The user face photographing camera 110 according to the present invention captures a user's face.

In detail, the camera 110 may acquire a user face image by photographing a user face based on an arbitrary photographing parameter.

The user face image acquired by the camera 110 may be, for example, a user face image for forming a single user face image to be described later, or a plurality of user face images for forming a whole user face image. .

As used herein, the term “single user face image” means a single image obtained by the camera 110 for skin condition analysis and formed by the processor 130, and obtained based on a plurality of photographing parameters. The term is used herein for differentiation from the entire user face image formed through a specific region extraction and synthesis technique of a plurality of user face images.

In the present specification, the term “whole face image” is formed through a technique of extracting a specific face region from each of a plurality of user face images obtained based on a plurality of shooting parameters, and synthesizing the same, and used for measuring skin conditions. Means a user's face image.

In one example, the camera 110 may acquire a user face image by photographing a user face based on an arbitrary shooting parameter. In this case, the user face image may be formed as a single user face image by the processor 130.

In another example, the camera 110 may acquire a plurality of images by photographing a user face based on a plurality of photographing parameters.

More specifically, the camera may acquire a plurality of images by photographing the user's face a plurality of times based on different photographing parameters (such as the intensity of the light source, the shutter speed value or the aperture value).

The light source unit according to the present invention includes at least one light source, and the light source provides light toward the face of the user. In this case, the light source may be designed to emit white light from the light source unit by emitting light of at least one of red light, green light, and blue light, for example. The light source unit may provide different intensities under the control of a processor, which will be described later.

The portable skin condition measuring apparatus according to the present invention includes a processor for controlling the overall operation of the apparatus.

3 and 4 are block diagrams of the portable skin condition measuring apparatus according to the present invention. As shown in FIGS. 3 and 4, respective individual components of the portable skin condition measuring apparatus according to the present invention are described. It is controlled and operated by the processor 130. In particular, the processor 130 may control the overall operation of the portable skin condition measuring apparatus 100 using various programs stored in the memory 170 to be described later.

The processor 130 sets acquisition of a single user face image or sets acquisition of a whole user face, among other control operations.

That is, the processor 130 forms a single user face image for skin condition measurement obtained by the user face photographing camera, or is obtained based on a plurality of shooting parameters set to extract a specific area of the user face. A specific region of the user face is extracted from each of the plurality of user face images, and the specific region of the extracted user face is synthesized to form an entire image of the user face for skin condition measurement.

Imaging parameters for analyzing the skin of the user's face are set by the processor 130. For example, the photographing parameter may include at least one of an intensity of a light source unit, a direction of a light source unit, a shutter speed, and an aperture value included in the portable skin condition measuring apparatus, and may be differently set for each user.

In one example, the processor 130 may analyze the brightness of the user face image acquired based on the preliminary shooting parameter, and set the preliminary shooting parameter as the shooting parameter. In this case, the preliminary shooting parameter may be determined according to an external lighting environment. In this case, the processor 130 may acquire a user face image based on the shooting parameter set based on the preliminary shooting parameter, and set the user face image as a single user face image for skin condition measurement.

Hereinafter, a control operation of the processor 130 for extracting a specific region of the user face based on the plurality of preliminary photographing parameters, synthesizing the same, and forming a whole image of the user face for skin condition measurement will be described in detail.

The processor 130 may analyze the brightness of the plurality of user face images acquired based on the plurality of preliminary photographing parameters and set one or more of the plurality of preliminary photographing parameters as the plurality of photographing parameters.

In an example, when the image photographed based on the first preliminary photographing parameter among the plurality of preliminary photographing parameters has a brightness value of a preset range for the first region (eg, the face center region) of the user's face, The processor 130 may set the first preliminary photographing parameter as the first photographing parameter corresponding to the first area of the user's face. In addition, when the image photographed based on the second preliminary photographing parameter among the plurality of preliminary photographing parameters has a brightness value within a preset range with respect to the second region (eg, the outer region of the face) of the user's face, the processor 130 ) May set the second preliminary shooting parameter as the second shooting parameter corresponding to the second area of the user's face.

That is, the processor 130 sets the first preliminary shooting parameter to have the brightness value of the preset range for the first area of the user face image as the first shooting parameter, and sets the first preliminary shooting parameter for the second area of the user face image. The second preliminary shooting parameter to have the set brightness value can be set as the second shooting parameter.

After the plurality of photographing parameters are set, the processor 130 extracts a specific area of the user face from each of the plurality of user face images obtained based on the set photographing parameters.

In one example, the processor 130 acquires a first user face image by photographing a user face based on the first photographing parameter, and acquires a second user face image by photographing the user face based on the second photographing parameter. can do. In addition, the processor 130 may extract a user face region corresponding to each of the plurality of images from the plurality of images, and acquire the entire face image by synthesizing the extracted user face regions.

That is, the processor 130 extracts a first face area from the first user face image obtained by the first shooting parameter, and a second face area from the second user face image obtained by the second shooting parameter. Can be extracted. In addition, the processor 130 may synthesize the first face region and the second face region to form an entire image of the user's face for skin condition measurement.

In this case, the processor 130 may correct and synthesize the first face region and the second face region according to the detected motion information of the portable skin diagnosis apparatus. That is, when the movement of the portable skin condition measuring device 100 is detected while capturing the second user face image, the processor 130 may correct the second face area according to the movement of the detected device. According to another embodiment, the processor 130 may correct the second user face image before extracting the second face area according to the movement of the portable skin condition measuring apparatus 100. The above-described detection of the movement may be performed, for example, in the sensor unit 160 described later.

In addition, when composing the first face area and the second face area, the processor 130 may synthesize the first face area and the second face area by performing brightness correction.

In detail, the processor 130 may determine a brightness difference value between the first face area and the second face area near a boundary between the first face area and the second face area. The processor 130 may determine the composite weight of at least one of the first face region and the second face region based on the brightness difference value. In this case, the composite weight may be a weight for adjusting the brightness. In addition, the processor 130 may adjust the brightness of at least one of the first face region and the second face region based on the composition weight.

The portable skin condition measuring apparatus according to the present invention may further include an output unit 150 for suggesting a photographing location movement. The output unit 150 may suggest a movement of the photographing place when the light reflectance of the user face image acquired by the user face photographing camera is equal to or greater than a preset value. In this case, as shown in FIG. 3, the processor 130 may control a photographing place movement suggestion of the output unit 150.

In general, when the polarizing film is included, the light reflection on the surface of the skin is reduced, but when the external lighting is strong, the light reflection by the external lighting may not be reduced by the polarizing film.

However, the portable skin condition measuring apparatus according to the present invention is a processor for measuring the light reflectance of the surface of the face skin from the real-time streaming image through the camera and determines whether the light reflectivity is greater than or equal to a preset value to control the movement of the shooting location to the user The above-described problem can be prevented in advance through the configuration of the 130 and the output unit 150 suggesting the same.

The output unit 150 may suggest a photographing place movement. In one example, the output unit 150 may include a display 151 and an audio output unit 153. May be performed by the display 151 and / or the audio output unit 153.

The display 151 of the output unit 150 may, for example, perform a photographing place movement proposal. In addition, the display 151 may display various image data and UI in addition to the photographing place movement proposal.

The audio output unit 153 of the output unit 150 may, for example, perform a photographing place movement suggestion by voice. The audio output unit 153 may output various notification sounds or voice messages in addition to the photographing place movement proposal.

In another example, the photographing place movement suggestion of the output unit 120 may be performed by an arrow indicating a direction of a photographing place or an LED implementing a specific color.

Meanwhile, the portable skin condition measuring apparatus according to the present invention may analyze a single user face image or the entire user face image formed by the processor 130 by itself.

In addition, after the single user face image or the entire user face image formed by the processor 130 is transmitted to the user terminal 200, the single user face image or the whole user face image is analyzed through the user terminal 200. May be In this case, the portable skin condition measuring apparatus may further include a communication unit 140.

That is, the portable skin condition measuring apparatus according to the present invention may further include a communication unit 140 for transmitting the single user face image or the entire user face image to the external user terminal. In this case, the processor 130 may control the communication unit 140 to transmit data about the single user face image or the entire user face image to the user terminal 200.

For example, the communication unit 140 may receive a request to photograph a user face from the external user terminal 200, and may transmit a single user face image or a whole user face image to the external user terminal 200. have. In this case, the communication unit 140 may be implemented as a Bluetooth module, but this is only an embodiment, and may be implemented as various communication modules such as a direct communication module, a Wi-Fi communication module, or an NFC communication module.

Meanwhile, in the above-described embodiment, the portable skin condition measuring apparatus transmits the single user face image or the entire user face image to the external user terminal 200. However, this is only an example and is based on a plurality of photographing parameters. The plurality of user face images obtained may be transmitted to the external user terminal 200. In this case, the user terminal 200 may analyze the skin condition of the user face by extracting and synthesizing a specific face region in the same manner as the processor 130 performs the plurality of user face images.

In addition, the processor 130 directly analyzes the single user face image or the entire face image of the user to obtain skin condition information on at least one of pigmentation, acne, sebum, pores and wrinkles on the user's face. Status information may be output through the output unit 150.

The portable skin condition measuring apparatus 100 according to the present invention may further include a sensor unit 160. The sensor unit 160, the intensity and direction of the light source unit by detecting external illumination; And preliminary photographing parameters including a shutter speed, an aperture value, an exposure value, and the like of the camera, and as described above, motion information of the skin condition measuring apparatus may be detected.

In addition, the sensor unit 160 measures light reflectance of the user's face image, and controls and outputs a photographing place movement proposal by the processor 130 in connection with a sensing module of the memory 170 which will be described later. It is possible to perform the photographing place movement proposal by 150.

The sensor unit 160 may include, for example, a motion sensor (for example, an acceleration sensor, a gyro sensor, an electromagnetic sensor, etc.) and a portable skin condition measuring device for detecting a movement of the portable skin condition measuring device 100 ( 100) may include an illumination sensor for sensing an ambient lighting environment.

The portable skin condition measuring apparatus according to the present invention may further include a memory 170. The memory 170 may store various modules for driving the portable skin condition measuring apparatus 100.

For example, the memory 170 may store software including a base module, a sensing module, a communication module, a presentation module, a web browser module, and a service module. In this case, the base module is a basic module that processes a signal transmitted from each hardware included in the portable skin condition measuring apparatus 100 and transmits the signal to the upper layer module. The sensing module collects information from various sensors and analyzes and manages the collected information. The sensing module may include a face recognition module, a light reflectivity measuring module, a voice recognition module, a motion recognition module, and the like. The presentation module is a module for constructing a display screen, and may include a multimedia module for reproducing and outputting multimedia content, and a UI rendering module for performing UI and graphic processing. The communication module is a module for performing communication with the outside. The web browser module refers to a module that performs web browsing to access a web server. The service module is a module including various applications for providing various services.

As described above, the memory 170 may include various program modules, but various program modules may be partially omitted, modified, or added according to the type and characteristics of the portable skin condition measuring apparatus 100.

In addition, the memory 170 may store a plurality of shooting parameters for each user.

The memory 170 may be implemented as a nonvolatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), or a solid state drive (SSD). The memory 170 is accessed by the processor 130 and read / write / modify / delete / update of data by the processor 130.

The portable skin condition measuring apparatus according to the present invention may further include an input unit 180. The input unit 180 may input a user command for operating the portable skin condition measuring apparatus 100 to transmit information about the user command to the processor 130. In particular, the input unit 180 may be a button (for example, a button for taking a picture) provided in the portable skin condition measuring apparatus 100, but this is only an example and implemented as another input device. Can be.

In one embodiment of the present disclosure, the input unit 180 may be implemented as a touch panel or a (digital) pen sensor for sensing a user touch. For example, the touch panel may use at least one of capacitive, resistive, infrared, or ultrasonic methods. In addition, the touch panel may further include a control circuit. However, the input unit 180 may be implemented as a touch panel or a pen sensor, but only an embodiment, and may be implemented as a microphone or a pointing device for receiving user speech.

The present invention also relates to a skin condition diagnosis and management system using the portable skin condition measuring apparatus.

The skin condition diagnosis and management system includes a portable skin condition measuring apparatus 100 and a user terminal 200.

As described above, the portable skin condition measuring apparatus 100 includes a camera 110, a light source unit 120, and a processor 130. In addition, the portable skin condition measuring apparatus 100 may include the communication unit 140, the output unit 150, the sensor unit 160, the memory 170, and the input unit 180.

The user terminal 200 analyzes a single user face image transmitted from the portable skin condition measuring apparatus, analyzes an entire user face image received from the portable skin condition measuring apparatus, or transmits the image from the portable skin condition measuring apparatus. After extracting a specific region of the user's face from each of the received plurality of user's face images, synthesizing the specific region of the extracted user's face to form the entire user's face, and analyzing the entire user's face to analyze the skin condition And an application for recommending a product for improving the skin condition of the user based on the skin condition diagnosis result (hereinafter referred to as a "skin analysis application").

Skin condition diagnosis and management system according to the present invention includes a portable skin condition measuring device (100). In addition, the portable skin condition measuring apparatus 100 includes a processor 130. The processor 130 interworking with the external user terminal 200 to provide information on the skin condition of the user's face will be described in detail with reference to FIGS. 5A to 7E.

5A illustrates a start screen of a skin analysis application included in the user terminal 200. The start screen of the skin analysis application may include a UI for user login. The skin analysis application is executed in response to a user's command, and when a user login is performed, the user terminal 200 may search for an external portable skin condition measuring apparatus 100 that can communicate. In this case, as illustrated in FIG. 4B, the user terminal 200 may display a screen for guiding a search of the external portable skin condition measuring apparatus 100.

When the external portable skin condition measuring apparatus 100 is found, the user terminal 200 may communicate with the external portable skin condition measuring apparatus 100. In this case, the user terminal 200 may communicate with the portable skin condition measuring apparatus 100 using Bluetooth or Wifi communication. When communication is connected to the user terminal 200 and the portable skin condition measuring apparatus 100, the user terminal 200 may transmit information about the logged-in user to the portable skin condition measuring apparatus 100.

The processor 130 of the portable skin condition measuring apparatus 100 may determine whether a photographing parameter for a logged-in user is preset. When the photographing parameter corresponding to the logged-in user is not previously set, the processor 130 may analyze the brightness of the user face image obtained based on the preliminary photographing parameter and set the preliminary photographing parameter as the photographing parameter.

The processor 130 may acquire a user face image by photographing the user face based on the photographing parameter through the user face photographing camera 110. The user face image may be transmitted to the user terminal through the communication unit 140 of the portable skin condition measuring apparatus and used as a single user face image for skin condition analysis.

Hereinafter, a specific region of the user's face is extracted from the plurality of user's face images obtained based on the plurality of preliminary photographing parameters and the photographing parameters, and synthesized to obtain the entire user's face image.

The processor 130 of the portable skin condition measuring apparatus 100 may determine whether a plurality of photographing parameters for a logged-in user are preset. When a plurality of shooting parameters corresponding to the logged-in user are not preset, the processor 130 analyzes the brightness of the plurality of user face images acquired based on the plurality of preliminary shooting parameters, and among the plurality of preliminary shooting parameters. Any one or more can be set to a plurality of shooting parameters.

The processor 130 may acquire a plurality of images by capturing the user's face based on the plurality of preliminary photographing parameters through the user's face photographing camera 110.

For example, the processor 130 may acquire the first to nth images by photographing the user's face based on the first to n preliminary photographing parameters. In this case, the preliminary photographing parameter may include an intensity and a direction of the light source unit 120; And a shutter speed, an aperture value, and an exposure value of the camera 110, and the values may be determined according to external lighting detected by the sensor unit 160.

When the image photographed based on the first preliminary photographing parameter among the plurality of preliminary photographing parameters has a brightness value within a preset range with respect to the center area of the user's face, the processor 130 may set the first preliminary photographing parameter to the user's face. The first photographing parameter corresponding to the center area may be set. In addition, when the image photographed based on the second preliminary photographing parameter among the plurality of preliminary photographing parameters has a brightness value within a preset range for the outer region of the user face, the processor 130 may set the second preliminary photographing parameter to the user face. It may be set as the second shooting parameter corresponding to the outer region of the. That is, the processor 130 may set preliminary photographing parameters having optimal brightness values in the center region and the outer region of the user's face as photographing parameters corresponding to the respective regions.

Meanwhile, in the above-described embodiment, the user's face is divided into two regions (for example, a center region and an outer region). However, this is only an example, and the user's face is divided into three or more regions. Can be set to the shooting parameters corresponding to.

The processor 130 may acquire a plurality of images by photographing the user's face based on a plurality of preset shooting parameters through the user's face photographing camera 110. For example, the processor 130 may obtain a first user face image photographed using the first photographing parameter and a second user face image photographed using the second photographing parameter. In this case, as illustrated in FIG. 6A, the first user face image may include a center area 510-1 having a brightness value of the first range and an outer area 520-1 having a brightness value of the second range. The second user face image may include a center area 510-2 having a brightness value of the third range and an outer area 520-2 having a brightness value of the fourth range, as shown in FIG. 6B. Can be. In this case, an overlapping section may exist between the first range and the fourth range. That is, the first range and the fourth range may have the same or similar brightness value.

The processor 130 may extract corresponding user face regions from the plurality of user face images, and synthesize the extracted regions to generate the entire user face image.

Specifically, as shown in FIG. 6C, the processor 130 extracts the center region 510-1 from the first user face image, extracts the outer region 520-2 from the second user face image, The entire user face image 530 may be generated by combining the center area 510-1 and the outer area 520-2. In this case, the entire user face image 530 may have a uniform brightness value as shown in FIG. 6C.

The processor 130 may control the communicator 140 to transmit the single user face image or the entire user face image for skin condition measurement to the external user terminal 200.

The application of the user terminal 200 may display the entire received user's face image, as shown in FIG. 7A.

The application of the user terminal 200 may display the received single user face image or the entire user face image, as shown in FIG. 7A.

In addition, the application of the user terminal 200 may provide a result of diagnosing skin condition on the user's face based on the single user's face image or the entire user's face image.

In an embodiment of the present invention, an application of the user terminal 200 may separate a single user face image or an entire user face image into a melamine image and a hemoglobin image using a pigment separation technique. In addition, the application may analyze the melamine image to obtain information on the degree of blemishes and skin tone, and may analyze the hemoglobin image to obtain information on the erythema present in the user's face.

Further, in another embodiment of the present invention, the application of the user terminal 200 analyzes the RGB of a single user face image or the entire user face image information on the acne (for example, whether acne occurs, Chances of acne outbreaks, etc.).

In another embodiment of the present invention, the application of the user terminal 200 may obtain information about sebum present in the user face from the UV image of the single user face image or the entire user face image.

Further, in another embodiment of the present invention, the application of the user terminal 200 analyzes the RGB of a single user face image or the entire user face image information about the pores present in the user face (for example, whether there is a pore, Depth of pores, etc.).

In addition, in another embodiment of the present invention, the application of the user terminal 200 analyzes the RGB of the single user face image or the entire user face image information (for example, whether wrinkles exist, Depth of wrinkles, etc.) can be obtained.

In addition, the application of the user terminal 200 may output information about the obtained skin condition of the user's face. For example, the application of the user terminal 200 is as shown in Figure 7b. A UI that visually provides information about the skin condition may be displayed.

In addition, the application of the user terminal 200 may display a UI including history information on the analyzed skin condition, as shown in FIG. 7C.

In addition, the application of the user terminal 200 may display a UI that provides information on skin trouble prevention information and recommended cosmetics, as illustrated in FIG. 7D.

That is, the application recommends a product for improving the skin condition of the user based on the skin condition diagnosis result.

In addition, the application of the user terminal 200 may provide a chat service with the skin counselor, as shown in Figure 7e.

8A and 8B are sequence diagrams of a skin condition diagnosis and management system using a skin condition measuring apparatus according to the present invention.

FIG. 8A is a sequence diagram of a system for forming a single user face image and diagnosing and managing a skin condition based thereon, and FIG. 8B is a system for forming a whole user face image and diagnosing and managing a skin condition based thereon. There is also a sequence for.

In detail, the portable skin condition measuring apparatus 100 sets an imaging parameter or a plurality of imaging parameters (S710). In this case, the portable skin condition measuring apparatus 100 may set preliminary photographing parameters for obtaining an image having an optimal brightness value for each region of the user face among the plurality of preliminary photographing parameters as a plurality of photographing parameters.

In operation S720, the portable skin condition measuring apparatus 100 and the user terminal 200 may perform communication. Meanwhile, in another embodiment of the present invention, step S710 may be performed after step S720.

The portable skin condition measuring apparatus 100 may acquire a user face image or a plurality of images by photographing the user face based on the photographing parameter or the plurality of photographing parameters (S730).

In operation S740, the portable skin condition measuring apparatus 100 may generate a single user face image or an entire user face image. In detail, the portable skin condition measuring apparatus 100 may form the user face image acquired based on the set shooting parameter as a single user face image, or correspond to each of the plurality of images acquired by the plurality of shooting parameters. The user face region may be extracted and the extracted user face regions may be synthesized to generate an entire user face image.

The portable skin condition measuring apparatus 100 may transmit the single user face image or the entire user face image to the user terminal 200 (S750).

In operation S760, the user terminal 200 may analyze a single user face image or an entire user face image. In particular, the user terminal 200 may acquire information (eg, acne, color tone, wrinkles, etc.) about the skin condition of the user face by analyzing the entire user face image of the single user face image.

In addition, the user terminal 200 may provide information on skin condition of the user's face and a product recommendation for improving skin condition (S770).

Meanwhile, the user's face movement proposal (B) controlled by the processor 130 according to the present invention and implemented by the output unit 120 according to the user's face deviation or the user's face movement proposal (B) based on the distance measurement is applied. The real time review (A) of the process 130 may be performed before the fraud phase S710 and before S730.

Meanwhile, the skin condition measuring apparatus may also perform the aforementioned skin condition diagnosis and information providing function, which will be described in detail below.

9A and 9B are block diagrams illustrating the implementation of the skin condition measuring apparatus in the skin condition diagnosis and management system according to the present invention.

Since steps S910 to S930 illustrated in FIGS. 9A and B overlap with those described in the aforementioned skin condition diagnosis and management system, detailed descriptions thereof will be omitted.

The portable skin condition measuring apparatus 100 may determine the skin condition of the user face by analyzing a single user face image or the entire synthesized user face image (S940). In detail, the portable skin condition measuring apparatus 100 analyzes a single user face image or a synthesized whole image of the user face to analyze various skin such as skin tones (eg, acne, pores, wrinkles, etc.) as well as skin tones of the user's face. Information about the state can be obtained.

In operation S950, the portable skin condition measuring apparatus 100 may provide information on the determined skin condition. In this case, the portable skin condition measuring apparatus 100 may visually provide information and services on the skin condition through various UIs as shown in FIG. 7, but this is only an example, and the skin may be in an auditory form. It can provide information about the status.

The methods described above may be embodied in the form of program instructions that may be executed by various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the media may be those specially designed and constructed for the purposes of the present invention, or they may be of the kind well-known and available to those having skill in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical media such as CD-ROMs, DVDs, and magnetic disks such as floppy disks. Magneto-optical media, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

According to various embodiments of the present invention as described above, by acquiring a face image having an even brightness distribution over the entire area of the user's face without light reflection, it is possible to increase the accuracy of the facial skin analysis results. In addition, since the user's face does not need to be inserted into the skin condition measuring device, the convenience of carrying and possession can be improved.

Although the present disclosure has been described with reference to the limited embodiments and the drawings, the present disclosure is not limited to the above embodiments, and those skilled in the art to which the present disclosure pertains various modifications and variations from such descriptions. This is possible. Therefore, the scope of the present disclosure should not be limited to the described embodiments, but should be determined not only by the claims below but also by the equivalents of the claims.

100: portable skin condition measuring device
110: user face shooting camera
111: first polarizing film
120: light source
121: second polarizing film
130: processor
140: communication unit
150: output unit
151: display
152: audio output unit
160: sensor unit
170: memory
180: input unit
200: user terminal

Claims (11)

A user face photographing camera to which a first polarizing film having a first polarization axis is attached;
A light source unit with a second polarizing film having a second polarizing axis forming a predetermined relative angle with the first polarizing axis of the first polarizing film; And
Extracting a specific region of the user face from each of a plurality of user face images obtained based on a plurality of shooting parameters set to extract a specific region of the user face and synthesized the specific region of the extracted user face for skin condition measurement A processor that forms an entire image of the user's face,
The processor,
A first preliminary shooting parameter for setting the first preliminary shooting parameter for the first area of the user's face image as the first shooting parameter and a second preliminary shooting parameter for the second area of the user's face image for the first area of the user's face image; 2 set the preliminary shooting parameter to the second shooting parameter,
Extracting a first face region from the first user face image obtained by the first imaging parameter, extracting a second face region from the second user face image obtained by the second imaging parameter, and extracting the first face A portable skin condition measuring apparatus for synthesizing the region and the second facial region to form an entire image of the user's face for skin condition measurement. The method of claim 1,
And said predetermined relative angle of said first and second polarization axes is in the range of 45 ° to 135 °. The method of claim 1,
The processor,
And a portable skin condition measuring device configured to correct and synthesize the first face area and the second face area according to the detected motion information of the portable skin condition measuring device. The method of claim 1,
The processor,
The brightness difference value between the first face area and the second face area is determined near the boundary between the first face area and the second face area, and the first face area and the second face area are determined based on the brightness difference value. A portable skin condition measuring apparatus for synthesizing the synthesized weight of at least one of the face areas by adjusting the brightness of at least one of the first face area and the second face area based on the synthesized weight. The method of claim 1,
The shooting parameter,
A portable skin condition measuring apparatus including at least one of an intensity of a light source unit, a direction of a light source unit, a shutter speed, and an aperture value. The method of claim 1,
When the light reflectance of the user face image obtained by the user face photographing camera is more than a predetermined value, further comprising an output unit for suggesting the movement of the shooting location
The processor is a portable skin condition measuring apparatus for controlling the proposal to move the shooting location of the output unit. The method of claim 1,
Further comprising a communication unit for transmitting the entire image of the user face to an external user terminal,
The processor is a portable skin condition measuring apparatus for controlling the communication unit to transmit the data for the entire user face image to the user terminal. Portable skin condition measuring device according to any one of claims 1 to 7; And a user terminal,
The user terminal analyzes the entire image of the user's face transmitted from the portable skin condition measuring device to provide a skin condition diagnosis result, and an application for recommending a product for improving the skin condition of the user based on the skin condition diagnosis result. Including skin condition diagnosis and management system. delete delete delete

Images