KR20170099153A - User skin condition monitoring and big data analysis system and method using smart phone - Google Patents

User skin condition monitoring and big data analysis system and method using smart phone Download PDF

Info

Publication number
KR20170099153A
KR20170099153A KR1020160021164A KR20160021164A KR20170099153A KR 20170099153 A KR20170099153 A KR 20170099153A KR 1020160021164 A KR1020160021164 A KR 1020160021164A KR 20160021164 A KR20160021164 A KR 20160021164A KR 20170099153 A KR20170099153 A KR 20170099153A
Authority
KR
South Korea
Prior art keywords
skin
user
smartphone
automatically
analysis
Prior art date
Application number
KR1020160021164A
Other languages
Korean (ko)
Inventor
송철수
양대진
Original Assignee
송철수
양대진
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 송철수, 양대진 filed Critical 송철수
Priority to KR1020160021164A priority Critical patent/KR20170099153A/en
Publication of KR20170099153A publication Critical patent/KR20170099153A/en

Links

Images

Classifications

    • G06F19/34—
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
    • A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
    • G06F17/30318—
    • G06F19/3418—
    • G06F19/345—
    • G06F19/3456—

Abstract

A skin condition monitoring and big data analysis system of a user using a smart phone and a method thereof are disclosed. A smart phone for generating a facial skin image by automatically photographing the user's facial skin using the built-in camera module and automatically transmitting the generated facial skin image; The method includes receiving and accumulating the facial skin image of the user, performing big data analysis through the cumulative stored facial skin image to generate analysis results, generating skin care advice according to the generated analysis results, The skin analysis server transmits the analysis result and the skin care device to the smartphone. According to the skin condition monitoring and big data analysis system and method of the user using the smart phone, the skin is automatically photographed when the skin is close to the smartphone using the smartphone application and is transmitted to the skin analysis server, The skin condition is automatically measured and analyzed automatically without having to measure the skin condition separately. Since the user does not have to hassle, continuous measurement and skin management are possible. Big data analysis of the user's skin condition is possible through cumulative data, and the user's skin can be systematically managed.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a skin condition monitoring system,

The present invention relates to monitoring and analyzing skin condition of a user, and more particularly, to a skin condition monitoring and big data analysis system and method of a user, and more specifically, Data analysis system and method.

Japanese Patent Application Laid-Open No. 10-1425203 discloses a configuration for measuring and checking the moisture state of a skin of a user through a skin measuring device attachable to a smart phone.

It is encouraging that users can easily check their skin condition without visiting a dermatologist or a cosmetics shop from the viewpoint of confirming the skin meter in connection with a smartphone.

However, the skin condition always changes with time in the day, and shows many changes over a long period of time. In addition, in order to measure skin, a skin meter should be combined with a smartphone, and an electrode of the skin meter should be brought into contact with the skin for measuring the moisture of the skin.

Although it is convenient to carry a skin meter, it is not easy to keep the skin meter clean, and it is very cumbersome and cumbersome to measure periodically without interrupting the moisture of the skin.

In addition, it is impossible to grasp the exact skin condition such as rash, acne, keratin, skin disease, allergy, reddish state, warts, wrinkles, burns, freckles, .

10-1425203

It is an object of the present invention to provide a system for monitoring skin condition of a user using a smartphone and a big data analysis system.

It is another object of the present invention to provide a method for monitoring a skin condition of a user using a smartphone and a big data analysis method.

According to an aspect of the present invention, there is provided a system for monitoring a skin condition of a user using a smartphone and a big data analysis system, the system comprising: A smartphone that transmits automatically; The method includes receiving the facial skin image of the user and accumulating and storing the facial skin image of the user, automatically analyzing the state of the facial skin in the received facial skin image, generating a skin care advice based on the automatic analysis and transmitting it to the smartphone, A skin data management method and a skin care device, the method comprising: performing a big data analysis through a skin image to generate analysis results; generating skin care advice according to the generated analysis results; A skin analysis server.

The smartphone is configured to automatically or manually photograph the facial skin periodically. The smartphone displays a pop-up button for manual photographing in the manual photographing on the display, displays the pop-up button on the display, And may be configured to display a guide contour line for specifying the position of the nose and mouth.

According to another aspect of the present invention, there is provided a method for monitoring a skin condition of a user and analyzing a big data using a smart phone, the method comprising: generating a face skin image by automatically photographing or manually photographing a user's face skin using a built- And automatically transmitting the generated facial skin image to a skin analysis server; Receiving the facial skin image from the smartphone and accumulating and storing the facial skin image; Converting the cumulative stored face skin image into a facial skin image of the same format by performing a preprocessing process according to the model of the smartphone; The skin analysis server automatically analyzes the state of the facial skin in the stored facial skin image, and performs analysis of big data from the facial skin image and the additional information to generate analysis results; The skin analysis server generates skin care advice according to the generated analysis result, and transmits the generated analysis result and skin care advice to the smartphone; And the skin analysis server may transmit the analysis result and the skin care advice to the predetermined dermatology terminal and the cosmetic company terminal.

 Here, in the step of the smartphone generating a facial skin image by automatically photographing or manually photographing the face skin of the user using the built-in camera module and automatically transmitting the generated facial skin image to the skin analysis server, The system according to claim 1, wherein when the skin is manually photographed, the smartphone is configured to periodically manually photograph the facial skin, a pop-up button for manually photographing at the time of manual photographing is displayed on the display, And may be configured to display a guide contour line for specifying the position of the eyes, nose, and mouth. Through this, a certain image can be obtained.

According to the skin condition monitoring and big data analysis system and method of the user using the smart phone, the skin is automatically photographed when the skin is close to the smartphone using the smartphone application and is transmitted to the skin analysis server, The skin condition is automatically measured and analyzed automatically without having to measure the skin condition separately. Since the user does not have to hassle, continuous measurement and skin management are possible. Big data analysis of the user's skin condition is possible through cumulative data, and the user's skin can be systematically managed.

In addition to the automatic analysis algorithm, it also provides expert analysis results of dermatologists and cosmetics companies, recommends skin care and recommends cosmetics accordingly, thereby enabling continuous professional skin care without user's separate efforts.

1 is a block diagram of a skin condition monitoring and big data analysis system using a smartphone according to an embodiment of the present invention.
FIG. 2 is a flowchart illustrating a skin condition monitoring and a big data analysis method of a user using a smartphone according to an embodiment of the present invention.

While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof are shown by way of example in the drawings and will herein be described in detail to the concrete inventive concept. It should be understood, however, that the invention is not intended to be limited to the particular embodiments, but includes all modifications, equivalents, and alternatives falling within the spirit and scope of the invention. Like reference numerals are used for like elements in describing each drawing.

The terms first, second, A, B, etc. may be used to describe various elements, but the elements should not be limited by the terms. The terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, the first component may be referred to as a second component, and similarly, the second component may also be referred to as a first component. And / or < / RTI > includes any combination of a plurality of related listed items or any of a plurality of related listed items.

It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, . On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.

The terminology used in this application is used only to describe a specific embodiment and is not intended to limit the invention. The singular expressions include plural expressions unless the context clearly dictates otherwise. In the present application, the terms "comprises" or "having" and the like are used to specify that there is a feature, a number, a step, an operation, an element, a component or a combination thereof described in the specification, But do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in commonly used dictionaries are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are to be interpreted as either ideal or overly formal in the sense of the present application Do not.

Hereinafter, preferred embodiments according to the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a skin condition monitoring and big data analysis system using a smartphone according to an embodiment of the present invention.

Referring to FIG. 1, a skin condition monitoring and big data analysis system (hereinafter, referred to as 'skin condition monitoring and big data analysis system') 100 using a smart phone according to an embodiment of the present invention, a smart phone 110 and a skin analysis server 120.

The skin condition monitoring and big data analysis system 100 photographs a user's face skin using an application of the smartphone 110 and a built-in camera module (not shown), and transmits the skin image to the skin analysis server 120 And to analyze the skin condition.

It is configured to measure the face of the user's face naturally in the user's daily life, so that it is not troublesome for the user to perform skin measurement separately, and there is no need to carry a separate skin meter or put it on the skin to measure it.

The user is automatically photographed at a time point when the user places the smartphone 110 on the face for a call or confirms a character.

Hereinafter, the detailed configuration will be described.

The smartphone 110 may be configured to automatically photograph a user's face skin using a built-in camera module (not shown) to generate a facial skin image.

Here, the application of the smart phone 110 may be configured to automatically photograph the skin of the user during daily life, without the user performing an application to measure his or her face skin and shooting the face skin.

The application is always active in the background mode and is automatically activated at various points of time, such as when the user places the smartphone 110 on the face for a call or when it looks at the smart 110 to verify a text message, Of the face of the user.

These views may be set by the user and may be points of time when the user looks at the display of the smartphone 110 or places it on the face.

Here, when the user does not operate the smartphone 110 for a long time, the user may be configured to automatically output a notification message for inviting the face skin photographing after a predetermined photographing time interval has elapsed.

As described above, it may be automatically photographed without any user's operation, or may be configured to manually photograph a user by pressing a pop-up button on the display.

When the user's face skin is manually photographed, the pop-up button may be displayed on the display at predetermined time intervals so that the smartphone 110 can periodically manually photograph the face skin.

Here, a guide contour line for designating the positions of the user's eyes, nose, and mouth may be displayed on the display.

In this case, the distance between the built-in camera module and the face of the user can be appropriately maintained so that the user can photograph the face, It is possible to take a picture of the entire area uniformly.

The smartphone 110 may be configured to automatically photograph and store the face of the user's face. At this time, the smartphone 110 may be configured to store the date and time of the shooting time together with the facial skin image. On the other hand, it is also possible to store the position of the photographer at the photographing time and the weather information of the position together. In the weather information, a variety of information such as humidity, ultraviolet ray amount, and temperature as well as cloudiness and cloudiness can be stored together.

Since it is difficult for the smartphone 110 to directly recognize whether or not the user is to make a makeup, the user may inquire whether or not to make up the makeup, and may store information about whether or not to make up the makeup.

In addition, it is preferable that information on the sex, age, and skin disease already possessed by the user is also stored and transmitted later.

And may be configured to perform automatic photographing with a time interval of at least about one hour. This is because too much facial skin can be produced throughout the day.

The smartphone 110 may be configured to automatically transmit the automatically generated facial skin image to the skin analysis server 120. [

At this time, the smartphone 110 may be configured to transmit information such as a face skin image, a photographing date and time of the face skin image, a weather, a humidity, an ultraviolet ray amount, and a temperature at the time point.

The smartphone 110 may transmit such facial skin images automatically in real time, or may be configured to transmit the facial skin images at intervals of one hour, such as fifteen times a day.

Meanwhile, the smartphone 110 may selectively send facial skin images selected by the user. This is because there may be a wrong face skin image. In addition, the smartphone 110 may be configured to transmit only the facial skin area by cutting out only the facial skin area except for the head part and the bust part in the face shape. There may be a problem with the transmission amount.

Although the smartphone 110 may transmit the member information of the user together, if the application is installed only without the member information, the smartphone 110 can transmit the smartphone number together to identify the user.

The skin analysis server 120 may receive the face skin image of the user from the smartphone 110 and accumulate the skin image for each user.

The skin analysis server 120 may be configured to automatically analyze the state of the facial skin in the facial skin image. The skin analysis server 120 may be configured to analyze in detail various diseases, such as disease, skin condition, degree of water, keratin, skin redness, skin tone, and the like .

The skin analysis server 120 may be configured to generate and automatically send skin care advice to the smartphone 110 according to automatic analysis. The skin analysis server 120 may automatically analyze the facial skin image every time it receives the facial skin image, and transmit the skin care advice to the smartphone 110 in real time.

The user can check his / her skin condition at any time and take appropriate measures. For example, if your face lacks moisture, you can get skin care advice such as cleansing, lotion, and moisturizing cream, and you can get the skin care you need at that point .

Meanwhile, the skin analysis server 120 may be configured to perform analysis of big data through cumulative stored facial skin images to generate analysis results.

The skin analysis server 120 may be configured to variously analyze the change in the state of the facial skin in the cumulative period such as the whole day, the week, the month, the year, and the like.

Since the moisture condition and skin condition of the skin change instantaneously during the day, the user's skin condition changes and user's skin care problems are carefully analyzed.

The skin analysis server 120 may be configured to analyze the change of the facial skin image according to the time and the period, and the analysis based on the weather, temperature, humidity, ultraviolet ray amount, sex, and age of each viewpoint and period.

For example, you can advise on hydration if moisture is reduced as the humidity is constantly exposed in low and high temperatures. This analysis and skin care advice can be analyzed in detail.

The skin analysis server 120 may be configured to generate skin care advice based on the analysis of the big data and transmit the advice to the smartphone 110.

Meanwhile, the skin analysis server 120 transmits the facial skin image to the dermatology terminal 10 or the cosmetic company terminal 20, receives the analysis result of the dermatologist or the analysis result of the skin expert of the cosmetic company, Lt; / RTI >

Here, dermatologists and cosmetics companies can provide analysis results for free, because they can obtain potential customers.

The skin analysis server 120 may receive and store only the mobile phone number of the customer of the dermatologist from the dermatologist in advance and search for the mobile phone number matching the number of the smartphone 110 and the mobile phone number of the dermatologist. Even if the skin analysis server 120 does not register through the application of the smartphone 110, it can be confirmed that the same is true if the mobile phone number of the smartphone 110 matches the mobile phone number of the dermatologist.

The skin analysis server 120 may be configured to provide the facial skin condition automatically analyzed by the skin analysis server 120 to the dermatologist of the user. The dermatologist will then be able to continuously remotely monitor the skin condition of existing customers.

The dermatologic terminal 20 can provide the user of the smartphone 110 with more specialized skin care advice.

FIG. 2 is a flowchart illustrating a skin condition monitoring and a big data analysis method of a user using a smartphone according to an embodiment of the present invention.

Referring to FIG. 2, the smartphone 110 automatically creates a facial skin image by automatically photographing or manually photographing the face skin of the user using the built-in camera module, and automatically transmits the facial skin image to the skin analysis server 120 (S101).

Here, when the user's face skin is manually photographed, the smartphone 110 may be configured to periodically manually photograph the face skin.

In the manual shooting mode, the smartphone 110 may be configured to display a pop-up button for direct manual shooting by the user on the display. In addition, the user can specify the position of the user's eyes, nose, And a guide contour line for the guide contour line. By positioning the eyes, nose, and mouth of the user according to the size of the guide line of eyes, nose, and mouth, the distance between the built-in camera module and the user's face can be properly maintained and each part of the face can be photographed as desired have.

Next, the skin analysis server 120 receives facial skin images from the smartphone 110 and accumulates them (S102).

Next, the skin analysis server 120 performs a preprocessing process according to the model of the smartphone 110 to convert the facial skin images accumulated and stored into facial skin images of the same format and store them (S103).

Next, the skin analysis server 120 automatically analyzes the state of the facial skin from the stored facial skin image, and performs analysis of the big data from the facial skin image and the corresponding additional information to generate analysis results (S104).

Here, the additional information may be configured to store the position of the photographer at the photographing time and weather information of the position together. The weather information may include humidity, ultraviolet ray amount, temperature as well as cloudiness or cloudiness, and the user's makeup may be included.

Next, the skin analysis server 120 generates a skin care advice according to the generated analysis result, and transmits the generated analysis result and skin care advice to the smartphone 110 (S105).

Next, the skin analysis server 120 transmits the analysis result and the skin care advice to the predetermined dermatology terminal 10 and the cosmetic company terminal 20 (S106).

It will be apparent to those skilled in the art that various modifications and variations can be made in the present invention without departing from the spirit or scope of the invention as defined in the following claims. There will be.

110: Smartphone
120: skin analysis server

Claims (4)

A smart phone for generating a facial skin image by automatically photographing the user's facial skin using the built-in camera module and automatically transmitting the generated facial skin image;
The method includes receiving the facial skin image of the user and accumulating and storing the facial skin image of the user, automatically analyzing the state of the facial skin in the received facial skin image, generating a skin care advice based on the automatic analysis and transmitting it to the smartphone, A skin data management method and a skin care device, the method comprising: performing a big data analysis through a skin image to generate analysis results; generating skin care advice according to the generated analysis results; Skin condition monitoring and big data analysis system using smart phone including skin analysis server. The smartphone according to claim 1,
A pop-up button for manually photographing the face skin on a display and for designating a position of the eyes, nose and mouth of the user on the displayed display, And displaying a guide contour line of the user's skin condition and the big data analysis system using the smart phone. Automatically generating a face skin image by automatically photographing or manually photographing a user's face skin using a built-in camera module and automatically transmitting the generated face skin image to a skin analysis server;
Receiving the facial skin image from the smartphone and accumulating and storing the facial skin image;
Converting the cumulative stored face skin image into a facial skin image of the same format by performing a preprocessing process according to the model of the smartphone;
The skin analysis server automatically analyzes the state of the facial skin in the stored facial skin image, and performs analysis of big data from the facial skin image and the additional information to generate analysis results;
The skin analysis server generates skin care advice according to the generated analysis result, and transmits the generated analysis result and skin care advice to the smartphone;
And transmitting the analysis result and the skin care advice to the predetermined dermatology terminal and the cosmetic company terminal, wherein the skin analysis server transmits the analysis result and the skin care advice to the predetermined dermatology terminal and the cosmetic company terminal. The method of claim 3, wherein the smartphone automatically generates a face skin image by automatically photographing or manually photographing the face skin of the user using the built-in camera module, and automatically transmits the generated face skin image to the skin analysis server,
Wherein the smartphone is configured to periodically manually photograph the face skin when the user's face skin is manually photographed, a pop-up button for manually photographing the manual face photographing is displayed on the display, And a guide contour line for designating a position of the user's eyes, nose, and mouth on the display screen of the user.
KR1020160021164A 2016-02-23 2016-02-23 User skin condition monitoring and big data analysis system and method using smart phone KR20170099153A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020160021164A KR20170099153A (en) 2016-02-23 2016-02-23 User skin condition monitoring and big data analysis system and method using smart phone

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020160021164A KR20170099153A (en) 2016-02-23 2016-02-23 User skin condition monitoring and big data analysis system and method using smart phone

Publications (1)

Publication Number Publication Date
KR20170099153A true KR20170099153A (en) 2017-08-31

Family

ID=59761247

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020160021164A KR20170099153A (en) 2016-02-23 2016-02-23 User skin condition monitoring and big data analysis system and method using smart phone

Country Status (1)

Country Link
KR (1) KR20170099153A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200000539A (en) 2018-06-25 2020-01-03 주식회사 슈가브릭스 A system and method for providing a result of a object state using a user terminal
KR102165487B1 (en) * 2020-01-31 2020-10-14 주식회사 에프앤디파트너스 Skin disease discrimination system based on skin image
WO2021201582A1 (en) * 2020-04-01 2021-10-07 주식회사 에이아이투유 Method and device for analyzing causes of skin lesion

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20200000539A (en) 2018-06-25 2020-01-03 주식회사 슈가브릭스 A system and method for providing a result of a object state using a user terminal
KR102165487B1 (en) * 2020-01-31 2020-10-14 주식회사 에프앤디파트너스 Skin disease discrimination system based on skin image
WO2021201582A1 (en) * 2020-04-01 2021-10-07 주식회사 에이아이투유 Method and device for analyzing causes of skin lesion

Similar Documents

Publication Publication Date Title
JP6450871B2 (en) Surface condition imaging display system
KR101002916B1 (en) Method of the skin analysis and the scalp/hair analysis
JP6404677B2 (en) System for judging skin condition of subject using image processing technology
CN110332995A (en) Contactless humanbody temp measuring method, device, system and storage medium
KR20170099153A (en) User skin condition monitoring and big data analysis system and method using smart phone
JP6289837B2 (en) Skin condition measurement analysis information management system and skin condition measurement analysis information management method
KR102123101B1 (en) Method for providing integrated service system for providing customized skin type and system for providing integrated service system thereof
CN112165895A (en) Unmanned analysis device for skin of face and back of hand
CN109512384A (en) Scalp detection device
KR101807233B1 (en) Skin Analysis Services system and method using a skin analyzer
KR20120069823A (en) Using smartphones skin diagnosis and management system
CN101645978A (en) Health prompting method and mobile terminal
JP2019008619A (en) Information provision system
KR20090131674A (en) Beauty aids selling management system using beauty shop
JP2018175909A (en) System for determining skin condition of subject using image processing technique
KR20180001739A (en) System and Method for the Integrated Skin Care and diagnosis on Mobile Device
KR20010110838A (en) Remote derma-diagnosis system and method thereof
JP6842119B2 (en) Business method using a system for determining the skin or scalp condition of a subject using image processing technology
KR101552853B1 (en) diagnosis method of total hybrid for skin and hair possible one-stop diagnosis and device thereof
JP2020111854A (en) Wig, information processor, head measurement method, information processing method, program
KR101741905B1 (en) System for providing razor through analyzing user's utilization pattern
KR20220013781A (en) Method for providing an information of self skin condition based on big data in non-facing environment
WO2022191269A1 (en) Skin condition measurement system
KR102502944B1 (en) Non-face-to-face consulting system for skin care and cosmetics use
KR102375175B1 (en) Method and system for providing an information of self skin oil condition based on big data in non-facing environment