KR102036043B1 - Diagnosis Device of optical skin disease based Smartphone - Google Patents

Abstract

The present invention relates to an optical skin disease diagnosis device capable of diagnosing skin diseases based on a smart device and, more specifically, to an optical skin disease diagnosis device capable of diagnosing skin diseases based on a smart device, which is capable of checking a base shape of a skin disease of a person to be diagnosed in a smart device by using light scattered through a contact light source when a skin of the person to be diagnosed is diagnosed by providing a hand-held type optical skin disease diagnosis device, checking an external shape of a skin disease in a smart device by using light reflected from a skin surface through a peripheral light source, and checking an inclined surface (side surface) shape of a skin disease part of a person to be diagnosed in a smart device by providing inclined light, thereby diagnosing any one or more diseases among skin pigment diseases, infectious diseases and skin cancer in a smart device. Also, three-dimensional shape information is obtained by using a photo metric, thereby providing a three-dimensional effect of a shape.

Description

Optical device for diagnosing skin diseases based on smart devices {Diagnosis Device of optical skin disease based Smartphone}

The present invention relates to an optical skin disease diagnosis apparatus capable of diagnosing skin diseases based on smart devices, and more particularly, to provide a handy type optical skin disease diagnosis apparatus, and to provide light scattered through a contact light source when diagnosing a skin of a diagnosis person. The basic shape of the skin disease of the examiner can be checked on the smart device, and the appearance of the skin disease on the smart device can be checked on the smart device by using the light reflected from the surface of the skin through the ambient light source. By checking the inclined plane shape of the smart device, at least one or more diseases of skin pigment disease, infectious disease and skin cancer can be diagnosed by the smart device. By acquiring, the smart device-based blood to provide a three-dimensional appearance of the shape It relates to the optical device, the skin disease diagnosis disease diagnosis possible.

Three-dimensional shape extraction technology is a digital technology for extracting three-dimensional shape of an object in the real world.In the case of a method of displaying three-dimensional shape of an object by hand based on conventional computer graphics, an experienced designer Since the 3D model is manufactured by hand, it takes a lot of time, and there are many disadvantages in quality depending on the skill of the designer. When modeling an object in the real world, a measurement process must be performed.

In order to solve such a problem, the three-dimensional shape extraction technique is already used in many applications.

The three-dimensional shape extraction technology of an object can be classified into a contact type and a non-contact type. In the case of a contact type three-dimensional shape extraction, a high-precision three-dimensional method is performed by measuring three-dimensional coordinates while the measuring sensor is in contact with a measuring part of a restoration object. Although measurement data can be obtained, measurement is not possible for objects whose shape changes when a pressure is applied or for high temperature objects. Therefore, a non-contact three-dimensional shape extraction technique has been proposed as an alternative.

Contactless three-dimensional shape extraction technology extracts three-dimensional shape by using light reflected or transmitted from an object. In many industries, the three-dimensional shape of the product itself or surface can be extracted in real time in a non-contact manner for product quality control. There is a constant demand for technology development for a possible system.

The photometric stereo technique applies a plurality of lights to a target object sequentially and extracts a three-dimensional shape of an object using at least three images obtained by a camera. The more the number of lights, the more reliable The three-dimensional shape of the object can be extracted.

Recently, three-dimensional image is obtained by applying photometric stereo technique to three images obtained by irradiating an object with three different wavelength bands of RGB camera and R (red), G (green), and B (blue) simultaneously. Techniques for extracting information have been developed.

On the other hand, as the interest in skin care has increased, many users have confirmed the condition of the skin through various paths such as skin care rooms, massage shops, dermatologists, and used the appropriate cosmetics or medicines to manage the skin.

People's skin conditions vary greatly depending on the season, and since individual variations vary, accurate diagnosis is of paramount importance for proper prescription.

For the diagnosis of skin conditions, dermatologists and clinics are equipped with specialized medical equipment, enabling diagnostic activities such as taking enlarged photographs of pores.

However, due to the increased interest in skin care, the user's level of knowledge about the skin has also increased, and users want to know more about the condition of their skin or the change of the condition of the skin.

Nevertheless, it is very cumbersome to simply visit the clinic on a regular basis to monitor the condition of the skin and to find out the changes in the use of beauty products.

Therefore, it is necessary to prepare a method for allowing users to easily check and diagnose their skin condition while carrying.

In addition, cameras, sensors, and the like, which provide comprehensive information about conventional skin, are simply photographed by the operator manually and obtain information.

In addition, when measuring the approximate condition of the facial skin has been obtained by analyzing a 2D image with a high-resolution camera, in order to obtain a comprehensive information about the facial skin contact local imaging sensor using a sensor other than a high-resolution camera The hassle has to be retaken.

In this case, there was an inconvenience in that a process of detaching the face from the apparatus after photographing the facial skin in front of the high resolution camera and then manually contacting the photographing local photographing camera was performed.

On the other hand, recent cosmetics shops, dermatology, and skin care centers to measure and diagnose their own skin condition to facilitate selection of cosmetic products that are suitable for their skin condition, or to discover problems in their skin condition and find solutions. There are many types of skin diagnostics available to help you find them.

Among these, skin diagnosis apparatuses using a diagnostic lamp for diagnosing a skin condition are commonly used, in particular, by irradiating light of a specific wavelength to the skin and analyzing a unique fluorescent color of the skin irradiated with the light.

What is mainly used as said diagnostic lamp is an ultraviolet lamp.

Conventional skin diagnosis apparatuses using ultraviolet lamps need to darken their surroundings when ultraviolet rays are irradiated so that ultraviolet rays can be efficiently irradiated to desired skin areas.

Accordingly, a device for diagnosing the skin condition of the face, which is commonly seen in cosmetics stores, etc., has a cylindrical black cloth in which a diagnostic lamp is mounted in a box having an open front surface and light is not easily transmitted along the outer circumferential surface of the open front side of the box. By attaching, the subject to be diagnosed with the skin condition wrapped the cloth around the head and brought the face closer to the box equipped with the diagnostic lamp, so that the surroundings were darkened to measure and diagnose the skin condition.

Such a conventional skin diagnosis device is not sure of darkening, so there is a fear that measurement and diagnosis cannot be made efficiently, and since the subject has to wrap the cloth around the head as described above, the shape of the hair may be broken, and the diagnosis itself is reluctant. Or you may think that process is cumbersome.

In addition, when the cloth is torn or dirty, there is a inconvenience to replace frequently.

On the other hand, recently, attempts have been made to check the condition of the skin by radiating light onto the skin and analyzing the light information, but what light is to be irradiated, what light is to be detected, and the detected light information. There is no established method of how to analyze the skin, and therefore urgent development of a method for diagnosing skin using this principle and its device is required.

In addition, in the conventional general 3D object surface photographing apparatus, since the appearance size is large and the price is expensive, general skin shops or individual users do not have the difficulty to check their skin condition at any time. The device also has a problem that can not provide a variety of illumination wavelength band, it is not possible to determine the various trouble state on the surface of the object.

Therefore, there is a need to provide a device that can more easily and precisely provide the surface state of the skin disease as an image image.

Meanwhile, in the United States, one person dies of skin cancer every hour due to skin cancer.

Each year, one in five people are diagnosed with skin cancer, and five million people are being treated for skin cancer, making skin cancer a very serious social problem.

It is important to check these skin cancers regularly because they have no symptoms.

As shown in FIG. 1, skin cancer is mainly examined with a naked eye or a microscope, and when a skin cancer is suspected, a biopsy is performed. In particular, a biopsy is a pain and wound to remove skin tissue, and a lot of cost and time. need.

Recently, a technique for diagnosing skin cancer using the spectral characteristics of the laser has been developed, but all of these methods have to visit a hospital.

In other words, it is difficult to go to the hospital every time to check periodically.

In addition, as shown in Figure 1, it is impossible for the general public to visually judge the point and skin cancer is similar in shape and size.

In the case of Figure 2, even if you go to the hospital to check the eye with a handy type diagnosis by the doctor to diagnose skin cancer, but the hit rate is less than 90%, more accurate diagnostic technology is required.

(Patent Document) Korean Patent Publication No. 10-2005-0083197

Therefore, the present invention has been proposed in view of the problems of the prior art as described above, and a first object of the present invention is to provide a handy type of optical skin disease diagnosis device to diagnose light scattered through a contact light source when diagnosing a skin of a diagnoser. The basic shape of the skin disease of the examiner can be checked on the smart device, and the appearance of the skin disease on the smart device can be checked on the smart device by using the light reflected from the surface of the skin through the ambient light source. By being able to check the inclined plane shape of the smart device, at least one of the skin pigment disease, infectious disease, skin cancer can be diagnosed by the smart device.

A second object of the present invention is to diagnose a skin disease, in particular skin cancer, by using a difference between an image of lighting a wavelength band absorbed by a skin disease and an image of lighting a wavelength band not absorbed by the skin disease.

A third object of the present invention is to have image information photographed through lighting control of a plurality of layers including a plurality of layers including at least one lighting group and a plurality of lighting groups into at least one section. Skin disease subjects can be classified by using different reaction characteristics, and by extracting the image information according to the optical path to obtain 3D information of the skin disease subjects, the fine surface shape and texture in the three-dimensional shape of the skin disease subjects can be obtained. To provide.

A fourth object of the present invention is to optically acquire an image for diagnosing a skin disease subject.

A fifth object of the present invention is to provide three-dimensional shape of a shape by acquiring three-dimensional shape information using a photo metric.

The sixth object of the present invention is to obtain skin disease image information through a cloud server capable of artificial intelligence learning, to learn the skin disease analysis through this to diagnose the skin disease using the learning results, thereby improving the accuracy of skin disease diagnosis To raise it further.

In order to achieve the problem to be solved by the present invention, an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention,

Body case 100 having a predetermined length and width that can be gripped by the user;

A camera unit 200 formed on an upper side of the main body case to capture a video image;

A first lighting group 300 arranged at a predetermined interval around the outside of the camera unit to provide illumination to the camera unit;

A cap 400 coupled to the front of the main body case to maintain a predetermined distance from the photographing object and in contact with the skin of the diagnoser;

Optical skin disease diagnosis apparatus 1000, comprising: a skin disease control unit 600 for lighting the lights by providing a light control signal to the lighting group with reference to the set light control information, to provide a photographing signal to the camera unit; )Wow,

It includes a smart device 2000 for outputting the skin disease image and the skin disease diagnosis results provided by the optical skin disease diagnosis apparatus 1000 on the screen.

An optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to the present invention,

By providing a handy type of optical skin disease diagnosis device, the underlying shape of the skin disease of the diagnoser can be checked on the smart device by using light scattered through the contact light source when diagnosing the skin of the diagnoser. By using light, the appearance of skin diseases can be checked on a smart device, and by providing an inclination light, the tilted surface (side) shape of the skin disease area of the diagnoser can be checked on the smart device, thereby causing skin pigment disease, infectious disease, and skin cancer. By allowing at least one or more of the diseases to be diagnosed by a smart device, anyone can easily photograph the surface of a skin disease object at a low price and increase the probability of skin cancer diagnosis in case of skin cancer. Will be effective.

In addition, by diagnosing skin diseases, in particular skin cancer, by using the difference between the image of the light of the wavelength band absorbed by the skin disease and the image of the light of the wavelength band that the skin disease does not absorb, further increases the probability of skin disease diagnosis. Better effect

In addition, the image information may be captured by controlling a plurality of layers including at least one lighting group and lighting control of a plurality of sections in which the plurality of lighting groups are divided into at least one section. The skin disease object may be classified using the method, and image information according to a light path may be extracted to obtain 3D information of the skin disease object, thereby providing a fine surface shape and texture within the 3D shape of the skin disease object.

For example, when the skin disease object is a skin surface that is expected to be skin cancer, a more precise skin disease state can be diagnosed with respect to a location where the camera is located, thereby preventing a skin diagnosis error that can be mistaken for a point. Will be.

In addition, the present invention is characterized by optically acquiring the image for diagnosing a skin disease subject, it is possible to obtain fine shape information of the skin disease when diagnosing the skin disease through various wavelength bands.

In addition, the side lighting may be configured on the cap to obtain a dark field image, thereby providing an effect of raising the skin disease area.

In addition, since it is possible to obtain a point light source image by providing illumination for the photo metric, it provides an effect of three-dimensionally identifying the skin disease site.

In addition, it acquires thousands of skin disease image information through cloud server that can learn artificial intelligence, and learns skin disease analysis through this, and diagnoses skin disease using the learning result, thereby increasing the accuracy of skin disease diagnosis further. to provide.

1 is an exemplary view showing the shape of a general point and skin cancer.
Figure 2 is an illustration of diagnosing skin cancer with a handy skin cancer diagnosis device in a hospital.
Figure 3 is a perspective view of an optical skin disease diagnostic apparatus capable of diagnosing skin diseases based on smart devices according to an embodiment of the present invention.
Figure 4 is a perspective view from another angle of the optical skin disease diagnosis apparatus according to an embodiment of the present invention.
5 is a perspective view showing a cap and lighting groups of an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention.
6 is an exemplary view illustrating an example of diagnosing a skin disease through scattered light, oblique light, and reflected light of an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention.
FIG. 7 shows that various image images can be obtained when an illumination group of an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention is configured at predetermined intervals with lights of different wavelengths. Exemplary diagram shown.
FIG. 8 is a collective lighting control for a group of multiple lights formed in a first lighting group 300, a second lighting group 500, and a third lighting group 700 of an optical skin disease diagnosis apparatus according to an exemplary embodiment of the present disclosure. Or exemplary view showing the lighting sequence control for each group.
9 is a diagram illustrating a section control of a plurality of lights formed in the first lighting group 300, the second lighting group 500, the third lighting group 700 of the optical skin disease diagnosis apparatus according to an embodiment of the present invention.
10 is a block diagram of the skin disease control unit 600 and the smart device 2000 of the optical skin disease diagnosis apparatus capable of diagnosing skin diseases based on smart devices according to an embodiment of the present invention.
FIG. 11 is a view showing an image image photographed by a first lighting group light source, a second lighting group light source, and a third lighting group light source of an optical skin disease diagnosis apparatus capable of diagnosing skin diseases based on a smart device according to an embodiment of the present invention; FIG. Graph comparing water absorption.
12 is a cloud server artificial intelligence learning example of an optical skin disease diagnosis apparatus capable of diagnosing skin diseases based on a smart device according to an embodiment of the present invention.

The following merely illustrates the principles of the invention. Therefore, those skilled in the art, although not explicitly described or illustrated herein, can embody the principles of the present invention and invent various devices that fall within the spirit and scope of the present invention.

In addition, all conditional terms and embodiments listed herein are in principle clearly intended to be understood only for the purpose of understanding the concept of the invention and are not to be limited to the specifically listed embodiments and states. do.

An optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention,

Body case 100 having a predetermined length and width that can be gripped by the user;

A camera unit 200 formed on an upper side of the main body case to capture a video image;

A first lighting group 300 arranged at a predetermined interval around the outside of the camera unit to provide illumination to the camera unit;

A cap 400 coupled to the front of the main body case to maintain a predetermined distance from the photographing object and in contact with the skin of the diagnoser;

Optical skin disease diagnosis apparatus 1000, comprising: a skin disease control unit 600 for lighting the lights by providing a light control signal to the lighting group with reference to the set light control information, to provide a photographing signal to the camera unit; )Wow,

It characterized in that it comprises a smart device (2000) for outputting the skin disease image and the skin disease diagnosis results provided by the optical skin disease diagnosis apparatus 1000 on the screen.

In addition, the optical skin disease diagnosis apparatus 1000,

It is formed on the lower side of the cap, the second illumination group 500 for providing illumination to the camera unit is arranged a plurality of predetermined intervals; characterized in that the configuration further comprises.

In addition, the optical skin disease diagnosis apparatus 1000,

Located on the upper side of the second lighting group 500 formed in the cap 400, the inclined surface (side surface) of the skin disease area of the diagnosed by providing oblique illumination to the camera by forming a plurality of obliquely spaced predetermined intervals And a third lighting group 700 for providing a shape.

At this time, any one of the optical skin disease diagnosis apparatus 1000, the smart device 2000,

At least one disease among skin pigment disease, infectious disease and skin cancer can be diagnosed.

At this time, the skin disease control unit 600,

After selecting one lighting group among the first lighting group 300, the second lighting group 500, the third lighting group 700, and lighting the light source of the wavelength band absorbed by the skin disease in the lighting group, Provides a shooting signal to the camera unit to obtain a video image,

After a certain period of time, after turning on a light source in a wavelength range that is not absorbed by the skin disease in the selected lighting group, and providing a photographing signal to the camera unit to obtain a video image, and the obtained two video image information to the smart device ( 2000), and

The smart device 2000,

It is characterized in that the absorption rate difference value of the obtained two image images are determined, and when the determined absorption rate difference value deviates from the set threshold difference value, it is diagnosed as a skin disease and displayed on the screen.

On the other hand, the skin disease control unit 600 according to another embodiment,

After selecting one lighting group among the first lighting group 300, the second lighting group 500, the third lighting group 700, and lighting the light source of the wavelength band absorbed by the skin disease in the lighting group, Provides a shooting signal to the camera unit to obtain a video image,

After a certain period of time, after turning on a light source in the wavelength band that is not absorbed by the skin disease in any one of the lighting group except the selected lighting group, and providing a photographing signal to the camera unit to obtain an image image, the acquisition Characterized in that to transmit the two video image information to the smart device (2000),

The smart device 2000,

It is characterized in that the absorption rate difference value of the obtained two image images are determined, and when the determined absorption rate difference value deviates from the set threshold difference value, it is diagnosed as a skin disease and displayed on the screen.

At this time, the first lighting group 300,

It provides the light reflected on the skin surface to the camera unit 200,

The second lighting group 500,

After the skin penetrates according to the skin contact of the diagnosis, it is characterized in that to provide the scattered light to the camera unit (200).

At this time, the camera unit 200,

By using light scattered through the contact light source of the second lighting group 500, it is possible to check the underlying shape of the skin disease,

The appearance of the skin disease may be confirmed by using light reflected from the surface of the skin through the ambient light source of the first lighting group 300.

In this case, the first lighting group 300, the second lighting group 500 and the third lighting group 700,

At least two or more light sources of a white light source, an infrared light source, a UV light source, a yellow light source, a red light source, a green light source, and a blue light source may be formed at a predetermined interval to form a group.

At this time, the first lighting group 300, the second lighting group 500 and the third lighting group 700 according to another embodiment,

The lights in the group are formed of lights irradiating the same wavelength band, and the groups are formed of lights irradiating different wavelength bands.

In addition, the skin disease control unit 600,

The collective lighting control of groups of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 or Sequential lighting control by group,

By setting a section of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 It is characterized by performing a lighting control.

In addition, the skin disease control unit 600,

The collective lighting control of groups of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 or A group lighting control module 610 for performing group lighting control sequentially;

For setting a section of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 Section setting module 620,

At least one module of the metric lighting control module 630 for acquiring the set lighting control information for each section or lighting control information for each group to provide a control signal to a plurality of lights existing in the corresponding section or group; The first lighting group 300, the second lighting group 500, or the first lighting group 300, the second lighting group 500, and the third lighting group 700 may be operated in different ways. It is characterized in that to control, and to simultaneously or sequentially obtain images from the camera.

On the other hand, the optical skin disease diagnosis device 1000,

It is characterized by providing a three-dimensional shape of the shape by acquiring three-dimensional shape information of the skin disease using the photometric.

Hereinafter, an embodiment of an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to the present invention will be described in detail.

3 is a perspective view of an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention.

Figure 4 is a perspective view from another angle of the optical skin disease diagnosis apparatus according to an embodiment of the present invention.

As shown in Figure 3 to 4, the optical device for diagnosing skin diseases based on the smart device of the present invention, the main body case 100, the camera unit 200, the first lighting group 300, the cap (400), the second lighting group (500), an optical skin disease diagnosis apparatus (1000) including a skin disease control unit (600), and the skin disease image and skin disease diagnosis provided by the optical skin disease diagnosis apparatus (1000). It is configured to include a smart device 2000 for outputting the result on the screen.

Specifically, the body case 100 of the optical skin disease diagnosis apparatus 1000 is to have a predetermined length and width that can be gripped by the user.

Preferably, the shooting button unit 110 is configured on one side.

For example, the shooting button unit is configured on any one of the lower side, the side, and the upper side of the main body case.

In other words, when the user grips, the installation is configured in a convenient place to press the button.

On the other hand, it is obvious that without the configuration of the photographing button unit, the lighting can be automatically turned on when power is supplied, and the photographing can be started by operating the camera unit.

In the example of the present invention has been described as operating when pressing the shooting button.

In addition, the camera unit 200 of the optical skin disease diagnosis apparatus 1000 is installed in the front of the main body case, so that the video image is captured when the shooting button unit is pressed.

The camera is configured to be installed inside the lights of the first lighting group 300 to take an image of the surface of the skin disease to be diagnosed, in a preferred embodiment, characterized in that formed in the center of the center, preferably One general camera may be installed and configured, but two or more may be installed and configured as needed. In another embodiment, the TOF camera may be installed and configured.

Meanwhile, when the TOF camera is installed and configured as a camera, three-dimensional information can be obtained. Specifically, three-dimensional distance information can be obtained.

The time of flight (TOF) has a color value of RGB and a distance value that is a T value, so that it is possible to replace a conventional stereo camera and provide cost reduction effects.

The lens unit may further include a lens unit at one side of the camera unit.

In addition, a plurality of predetermined intervals are arranged around the periphery of the camera unit of the optical skin disease diagnosis apparatus 1000 to install the first lighting group 300 for providing illumination to the camera unit.

Then, the cap 400 is coupled to the front of the main body case to maintain a predetermined distance from the skin disease site, which is the photographing subject, to be in contact with the skin of the diagnosis person.

That is, as shown in Figure 4, by coupling the cap to the front of the main body case, the light that is lit by the first lighting group is to provide light around the skin disease subject.

In addition, the second lighting group 500 is formed below the cap, but a plurality of predetermined intervals are arranged to provide illumination to the camera unit.

In addition, the skin disease control unit 600 of the optical skin disease diagnosis apparatus 1000 is installed and configured in the interior space of the main body case to obtain a shooting signal from the shooting button unit to refer to the lighting control information set to the lighting group The lighting control signal is provided to light the lights, and the photographing signal is provided to the camera unit.

FIG. 5 is a perspective view illustrating caps and lighting groups of an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention.

As shown in FIG. 5, the second lighting group is formed below the cap, that is, above the skin contact surface of the cap.

In this case, the material of the cap may be formed of a transparent material, and may be formed of an opaque material as necessary.

As described above, in the case of forming the opaque material, the third lighting group to be described below may be formed above the second lighting group.

6 is an exemplary view illustrating an example of diagnosing a skin disease through scattered light, oblique light, and reflected light of an optical skin disease diagnosis apparatus capable of diagnosing skin disease based on a smart device according to an embodiment of the present invention.

On the other hand, as shown in Figure 6, in accordance with an additional aspect of the present invention, is located on the upper side of the second lighting group 500 formed in the cap 400, a plurality of predetermined intervals are formed to be inclined, the camera unit The third lighting group 700 for providing the inclined illumination to provide the inclined surface (side) shape of the skin disease part of the diagnoser; characterized in that it further comprises.

That is, the third lighting group 700 is positioned on the upper side of the second lighting group, but is formed to be inclined at a plurality of predetermined intervals, thereby providing oblique illumination to the camera, so that the inclined surface (side) of the skin disease part of the diagnoser To provide a shape.

Through the above configuration, any one of the optical skin disease diagnosis apparatus 1000, the smart device 2000 of the present invention,

At least one disease among skin pigment disease, infectious disease and skin cancer can be diagnosed.

For example, a skin device may be diagnosed by acquiring an image image from a smart device, and the skin disease control unit 600 configured in the optical skin disease diagnosis apparatus may diagnose the skin disease.

Skin pigment disease means, for example, blemishes, freckles, and the like, and infectious disease means acne bacteria, molds, and the like.

In addition, the first lighting group 300 of the above configuration provides the light reflected on the surface of the skin to the camera unit 200, the second lighting group 500 is scattered after the skin penetrating according to the skin contact of the diagnosis Characterized by providing the light to the camera unit 200.

Therefore, the camera unit 200 may check the base shape of the skin disease by using light scattered through the contact light source of the second lighting group 500, and at the surface of the skin through the ambient light source of the first lighting group 300. It is characterized by the appearance of the skin disease using the reflected light.

As shown in FIG. 6, since the second lighting group 500 provides a contact light source on the surface of the skin, the basis shape of the skin disease may be confirmed using scattered light.

For example, it can be diagnosed that the skin basal size of skin cancer is 'A'.

In addition, the first lighting group 300 may check the appearance of the skin disease by using light reflected from the surface of the skin through the ambient light source.

For example, it is possible to diagnose that the size of skin cancer is 'B'.

In addition, the third lighting group 700 is formed by a plurality of predetermined intervals inclined at an upper side of the second lighting group, thereby providing oblique illumination to the camera portion to provide an inclined surface (side) shape of the skin disease area of the diagnoser. Done.

In other words, by providing the side lighting, it is possible to obtain a dark field image, thereby providing an effect of roughening the skin cancer site to provide a three-dimensional effect of the skin cancer site.

As described in the above embodiment, when the skin disease subject is a skin surface that is expected to be a skin cancer, for example, a more precise skin cancer condition can be diagnosed with respect to a site where the camera is located, thereby making the skin misunderstood as a point. Diagnostic errors can be prevented.

On the other hand, according to an additional aspect, the first lighting group 300, the second lighting group 500 and the third lighting group 700,

At least two or more light sources of a white light source, an infrared light source, a UV light source, a yellow light source, a red light source, a green light source, and a blue light source may be formed at a predetermined interval to form a group.

For example, white light sources are arranged at regular intervals, infrared light sources are arranged at one side of the white light source, and UV light sources are arranged at one side of the infrared light source.

As described above, when the illumination group is composed of lights of different wavelengths at regular intervals, various images can be obtained. As shown in FIG. 7, a general image of a skin disease part through a white light source and a skin disease through an infrared light source The IR image of the site can be obtained through the UV light source.

Thus, for example, in the case of skin cancer, it is possible to diagnose skin cancer by acquiring various images through illumination of various wavelength bands.

Meanwhile, according to another additional aspect, the first lighting group 300, the second lighting group 500 and the third lighting group 700,

The lights in the group are formed of lights irradiating the same wavelength band, and the groups are formed of lights irradiating different wavelength bands.

For example, the first lighting group 300 according to a wavelength for providing white light, the second lighting group 500 according to a wavelength for providing infrared light, the third lighting group 700 provides a wavelength band for providing UV light. It can also be formed.

That is, the desired wavelength band among IR, visible light, and UV is applied to each lighting group differently.

On the other hand, the skin disease control unit 600 of the present invention,

The collective lighting control of groups of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 or Sequential lighting control by group,

By setting a section of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 It is characterized by performing a lighting control.

Referring to FIG. 8, the lighting batch control for each group of lights is to collectively control the first lighting group 300, the second lighting group 500, and the third lighting group 700. For example, the lighting group is collectively controlled, such as turning on the first lighting group 300, turning on the second lighting group 500 after 0.5 seconds, turning on the third lighting group 700 after 0.5 seconds, and the like.

In addition, the lighting sequential control of the groups of the illumination is the white light on the first light group 300, IR light on after 0.5 seconds, UV light on after 0.5 seconds, yellow light on after 0.5 seconds, red light on after 0.5 seconds, 0.5 seconds It is to control the lighting groups sequentially, such as after blue light on, and after 0.5 seconds of green light on.

Alternatively, the white light temperature of the first lighting group 300 / the second lighting group 500 / the third lighting group 700, 0.5 seconds later, the first lighting group 300 / the second lighting group 500 / the third lighting IR light on of group 700, UV light on of first lighting group 300 / second lighting group 500 / third lighting group 700 after 0.5 second, first lighting group 300 after 0.5 second Yellow light on of the second lighting group 500 / the third lighting group 700, 0.5 seconds later, the red light of the first lighting group 300 / the second lighting group 500 / the third lighting group 700 On, after 0.5 seconds

The lighting groups are sequentially controlled, such as the blue light on of the first lighting group 300, the second lighting group 500, and the third lighting group 700, the green light on after 0.5 seconds, and the like.

In this case, by providing illumination for the photo metric, it is possible to obtain a point light source image, thereby providing an effect of three-dimensionally identifying the skin disease site.

In addition, the skin disease control unit 600 of the present invention,

By setting a section of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 It is characterized by performing a lighting control.

Referring to FIG. 9, the lighting of the lighting groups existing in the section such as the first A section on, 0.5 seconds later, A, B section on, and the like is controlled.

As described above, when the light control is performed for each section, the light path is changed, and thus, when different image information according to the light path is extracted, three-dimensional information of the object can be obtained.

10 is a block diagram of the skin disease control unit 600 of the optical skin disease diagnosis apparatus according to an embodiment of the present invention.

As shown in Figure 10, the skin disease control unit 600,

The collective lighting control of groups of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 or A group lighting control module 610 for performing group lighting control sequentially;

For setting a section of a plurality of lights formed in the first lighting group 300, the second lighting group 500 or the first lighting group 300, the second lighting group 500, the third lighting group 700 Section setting module 620,

At least one module of the metric lighting control module 630 for acquiring the set lighting control information for each section or lighting control information for each group to provide a control signal to a plurality of lights existing in the corresponding section or group; The first lighting group 300, the second lighting group 500, or the first lighting group 300, the second lighting group 500, and the third lighting group 700 may be operated in different ways. It is characterized in that to control, and to simultaneously or sequentially obtain images from the camera.

The group lighting control module 610 may be applied to the first lighting group 300, the second lighting group 500, or the first lighting group 300, the second lighting group 500, and the third lighting group 700. The collective lighting control or group lighting sequence control of the formed multiple lights is performed.

For example, if the first lighting group 300 on, 0.5 seconds after the second lighting group 500 on, all the lights forming the first lighting group 300 is turned on, 0.5 seconds later All of the lights forming the second lighting group 500 is turned on.

The section setting module 620 may include a plurality of sections formed in the first lighting group 300, the second lighting group 500, or the first lighting group 300, the second lighting group 500, and the third lighting group 700. To set up a section of lights.

Referring to Figure 9, it is set to the sections A ~ D, in the case of the A section A11 ~ A13 lighting of the first lighting group, A21 ~ A24 lighting of the third lighting group, A31 ~ A35 of the second lighting group It will include lighting.

This is defined as section-specific lighting control.

In addition, the metric lighting control module 630 acquires lighting control information for each section or lighting control information for each group and provides a control signal to a plurality of lights existing in the corresponding section or group.

In addition, lighting control may be performed by dividing into specific sections of a specific group.

For example, in the A section of the first lighting group, only A11 to A13 lighting is turned on.

Therefore, the light paths of the first and second lighting groups can be controlled to operate differently, so that images can be acquired simultaneously or sequentially from the camera.

Meanwhile, the section setting module 620 may set a section and may set an illumination group existing in the section.

That is, the section setting and the group setting can be performed simultaneously, such as only the first lighting group of the first section A is turned on, only the second lighting group of the section A is turned on after 0.5 seconds, and only the third lighting group of the section A is turned on after 0.5 seconds. It can also be configured to do so.

Therefore, a simultaneous lighting signal can be sent to a plurality of lights existing in all groups, and the lighting signal can be sent by dividing into groups, by sections, or by dividing into specific sections of a specific group, and can also send lighting signals sequentially. .

Through this, images of various wavelength bands can be obtained, and various optical paths can be obtained at the same time, so that the surface of the skin disease site can be classified by using the characteristic that the surface of the skin disease site reacts differently according to the wavelength band. By extracting the image information to obtain three-dimensional information of the skin disease site, it is possible to provide a fine surface shape and texture in the three-dimensional shape of the skin disease site.

On the other hand, the control information for each lighting group can be set through a smart device, for this purpose to provide a setting page to the smart device, it may be provided by providing the control information set on the setting page to the skin disease control unit 600. .

On the other hand, according to another additional aspect, the skin disease control unit 600,

And a memory module 640 configured to store the set section-specific lighting control information or group-specific lighting control information and shape information of the photographed skin disease region.

At this time, the smart device 2000,

It may be configured to include an image processor 2100 for receiving the image information of the skin disease region stored in the memory module 640 to process in a three-dimensional shape.

For example, if the subject is a skin cancer site, the skin cancer may be analyzed by scanning a specific wavelength band that fluoresces the skin cancer.

In addition, when the image information according to the optical path is extracted, three-dimensional information of skin cancer can be obtained.

In this case, the image processing unit 2100 further includes a three-dimensional shape generating module, a surface shape generating module, and a three-dimensional surface matching module to obtain three-dimensional information.

Specifically, the three-dimensional shape generating module is to generate a three-dimensional shape by obtaining a 3D value when the camera is a TOF camera, the surface shape generating module is to generate a surface shape based on the photometric image information. .

At this time, the surface shape information is matched to the three-dimensional shape information generated from the three-dimensional shape generating module and the surface shape generating module by the three-dimensional shape surface matching module.

In other words, when matched, it is possible to provide a fine shape and texture of the skin cancer surface.

On the other hand, according to another additional aspect of the present invention, the skin disease control unit 600,

And a wireless communication module 650 for transmitting shape information of the skin disease target surface stored in the memory module 640 to the smart device 2000 through wireless communication.

Therefore, the shape information of the skin disease target surface stored in the memory module 640 is transmitted to the smart device 2000 through wireless communication.

As described above, when configured, it is possible to check in real time the image information of the skin disease target surface being photographed through the screen of the smart device (2000).

In addition, by providing the matched three-dimensional stereoscopic image to the cloud server 3000 configured remotely, the cloud server to generate the surface diagnosis information on the skin disease.

As described above, when the user is configured to access the cloud server anytime and anywhere through the smart device 2000 having the corresponding skin disease surface diagnosis information, the surface diagnosis information is obtained.

To this end, the diagnostic app will be mounted on the smart device.

In other words, by being able to diagnose a more precise skin condition, it is possible to prevent skin diagnosis errors.

On the other hand, the smart device 2000,

The absorption rate of each image image information is extracted by extracting the image image information obtained by the lighting of the first lighting group, the image image information obtained by the lighting of the second lighting group, and the image image information obtained by the lighting of the third lighting group. It is configured to include a skin disease diagnosis unit 2200 for diagnosing a skin disease when the difference in absorption rate is higher than the threshold difference value calculated.

More specifically, the skin disease diagnosis unit 2200,

After selecting one lighting group among the first lighting group 300, the second lighting group 500, the third lighting group 700, and lighting the light source of the wavelength band absorbed by the skin disease in the lighting group, Provides a shooting signal to the camera unit to obtain a video image,

After a certain period of time, the light source of the wavelength band that is not absorbed by the skin disease in the selected lighting group is turned on, and a photographing signal is provided to the camera unit to acquire a video image.

The absorption rate difference value of the obtained two image images may be determined, and when the determined absorption rate difference value deviates from a set threshold difference value, the skin disease may be diagnosed.

For example, the first lighting group 300 is selected, the red light source, which is a light source of a wavelength band absorbed by the skin disease in the lighting group, is turned on, and a photographing signal is provided to the camera unit to acquire an image image.

Thereafter, after a predetermined time, the green light source, which is a light source of a wavelength band that is not absorbed by the skin disease in the selected first lighting group, is turned on, and a photographing signal is provided to the camera unit to acquire an image image.

Subsequently, the absorbance difference values of the obtained two image images are determined, and when the determined absorption difference values deviate from a predetermined threshold difference value, the skin disease is diagnosed.

More specifically, referring to FIG. 11, as a result of analyzing the first image image obtained when the first lighting group red light source is turned on, the absorption rate is calculated, and the absorption rate is 55% and the first lighting group green light source is As a result of analyzing the acquired second image image when it is turned on and calculating the absorption rate, when the absorption rate is 10%, the threshold difference value is set to 40%.

In this case, since the difference between the first image image absorption rate of 55% and the second image image absorption rate of 10% is 45% and exceeds the threshold difference value of 40%, this is analyzed (diagnostic) as a skin disease (for example, skin cancer). will be.

In the case of the above absorption rate calculation, in general, if the light emission is 100% and the light reception is 45%, the absorption rate will be 55% because it means that the skin disease (for example, skin cancer) has been absorbed.

Since the technique of calculating the absorption rate through the video image is known to those skilled in the art of processing the video image, a detailed description thereof will be omitted.

On the other hand, as another lighting group lighting example, the skin disease diagnosis unit 2200,

After selecting one lighting group among the first lighting group 300, the second lighting group 500, the third lighting group 700, and lighting the light source of the wavelength band absorbed by the skin disease in the lighting group, Provides a shooting signal to the camera unit to obtain a video image,

After a certain period of time, after turning on the light source of the wavelength band that is not absorbed by the skin disease in any one of the lighting group except the selected lighting group, and providing a photographing signal to the camera unit to obtain a video image,

The absorption rate difference value of the obtained two image images may be determined, and when the determined absorption rate difference value deviates from a set threshold difference value, the skin disease may be diagnosed.

For example, the first lighting group 300 is selected, the red light source, which is a light source of a wavelength band absorbed by the skin disease in the first lighting group, is turned on, and a photographing signal is provided to the camera unit to acquire an image image. do.

Thereafter, after a predetermined time, the green light source, which is a light source of a wavelength band not absorbed by the skin disease in the second lighting group except the selected first lighting group and the second lighting group, is turned on, and then the camera unit is turned on. The imaging signal is provided to acquire a video image.

Subsequently, the absorbance difference values of the obtained two image images are determined, and when the determined absorption difference values deviate from a predetermined threshold difference value, the skin disease is diagnosed.

More specifically, referring to FIG. 11, as a result of analyzing the first image image obtained when the first light group red light source is turned on, the absorption rate is calculated, and the absorption rate is 55% and the second light group green light source is As a result of analyzing the acquired second image image when it is turned on and calculating the absorption rate, when the absorption rate is 10%, the threshold difference value is set to 40%.

In this case, since the difference between the first image image absorption rate of 55% and the second image image absorption rate of 10% is 45% and exceeds the threshold difference value of 40%, this is analyzed (diagnostic) as a skin disease (for example, skin cancer). will be.

Thereafter, the smart device 2000,

The result of diagnosis of skin disease is displayed on the screen.

On the other hand, in the case of a general point, as shown in the graph on the right side of FIG.

In the case of dots, since the probability of absorbing light is significantly lower than that of skin cancer, the difference in absorption rate is not large when analyzing image images taken after lighting by the first lighting group light source, the second lighting group light source and the third lighting group light sources. .

On the other hand, the absorption threshold difference value is collected by configuring the machine learning skin disease learning unit for learning and setting the set number of skin diseases (for example, skin cancer) using a machine learning method, by configuring the cloud server 3000, By learning the absorption rate in the skin disease image, the optimal absorption threshold difference value is set to increase the accuracy of skin disease diagnosis.

In other words, through the machine learning skin disease learning unit is to increase the accuracy of skin disease diagnosis.

At this time, the smart device 2000,

Real-time learning result update unit 2300 for acquiring the absorption difference threshold value learned from the cloud server 3000 in real time to the skin disease diagnosis unit; may be configured to further include.

Through this, by acquiring the absorption difference threshold value learned from the cloud server 3000 in real time and providing it to the skin disease diagnosis unit, it is used as a reference value when diagnosing a skin disease, thereby providing a better effect of increasing the accuracy of skin diagnosis.

The cloud server acquires thousands of skin disease image information through the machine learning skin disease learning unit, and analyzes the absorption rate according to the wavelength band of skin diseases, in particular, skin cancer, and sets the threshold difference value through this, and sets the threshold difference value. By providing a smart device, if the difference in absorption rate determined in the smart device is out of the set threshold difference value is to be diagnosed as skin cancer.

In addition, as shown in FIG. 12, according to an additional aspect, the cloud server may further include an expert diagnosis result acquisition unit for providing skin cancer image information obtained by a pseudo terminal to request a visual diagnosis result of skin cancer.

That is, the diagnosis result of skin cancer can be obtained through visual inspection information of doctors, thereby further increasing the accuracy of diagnosis of skin cancer.

Through this, 23 people with melanoma occur every year and 55,000 people die due to the early diagnosis. Therefore, it is possible to contribute to lower mortality by providing the above diagnostic technology.

According to the present invention, by providing a handy type of optical skin disease diagnosis device for diagnosing the skin of the diagnosis, the basis shape of the skin disease of the diagnosis can be confirmed in a smart device using light scattered through the contact light source, and through the ambient light source The appearance of the skin disease can be checked on the smart device using the light reflected from the skin surface, and by providing the inclined illumination, the inclined surface (side) shape of the skin disease area of the diagnoser can be confirmed on the smart device, thereby causing skin pigment disease. By allowing at least one of infectious diseases and skin cancers to be diagnosed by a smart device, anyone can easily photograph the surface of a skin disease object at a low price and check the surface condition in a three-dimensional shape and skin cancers. This will increase the probability of skin cancer diagnosis.

In addition, although the preferred embodiment of the present invention has been shown and described above, the present invention is not limited to the above-described specific embodiment, the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Of course, various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

1000: Optical Skin Disease Diagnosis Device
2000: smart devices
3000: Cloud Server

Claims (8)

In the optical device for diagnosing skin diseases based on smart devices,
Body case 100 having a predetermined length and width that can be gripped by the user;
A camera unit 200 formed on an upper side of the main body case to capture a video image;
A first lighting group 300 arranged at a predetermined interval around the outside of the camera unit to provide illumination to the camera unit;
A cap 400 coupled to the front of the main body case to maintain a predetermined distance from the photographing object and in contact with the skin of the diagnoser;
A second lighting group 500 formed below the cap and arranged in a plurality of intervals to provide illumination to the camera unit;
Optical skin disease diagnosis apparatus 1000, comprising: a skin disease control unit 600 for lighting the lights by providing a light control signal to the lighting group with reference to the set light control information, to provide a photographing signal to the camera unit; )Wow,
It comprises a smart device (2000) for outputting the skin disease image and skin disease diagnosis results provided by the optical skin disease diagnosis apparatus 1000 on the screen,

The first lighting group 300,
It provides the light reflected on the skin surface to the camera unit 200,
The second lighting group 500,
After penetrating the skin according to the skin contact of the diagnosis, it is characterized in that to provide a scattered light to the camera unit 200,
The camera unit 200,
By using light scattered through the contact light source of the second lighting group 500, it is possible to check the underlying shape of the skin disease,
Optical device for diagnosing skin diseases based on smart devices, characterized in that the appearance of skin diseases can be identified using light reflected from the skin surface through the ambient light of the first lighting group 300.
delete The method of claim 1,
The optical skin disease diagnosis device 1000,
Located on the upper side of the second lighting group 500 formed in the cap 400, the inclined surface (side surface) of the skin disease area of the diagnosed by providing oblique illumination to the camera by forming a plurality of obliquely spaced predetermined intervals Optical device for diagnosing skin diseases based on the smart device, characterized in that it comprises a; further comprises a third lighting group 700 for providing a shape.
The method of claim 1,
The optical skin disease diagnosis apparatus 1000, any one of the smart device 2000,
An optical skin disease diagnosis apparatus capable of diagnosing skin diseases based on smart devices, which can diagnose at least one or more diseases of skin pigment disease, infectious disease and skin cancer.
The method of claim 1,
The skin disease control unit 600,
By selecting one of the lighting group of the first lighting group 300, the second lighting group 500, and lighting the light source of the wavelength band absorbed by the skin disease in the selected lighting group, and providing a photographing signal to the camera unit Acquire a video image,
After a certain period of time, after turning on a light source in a wavelength range that is not absorbed by the skin disease in the selected lighting group, and providing a photographing signal to the camera unit to obtain a video image, and the obtained two video image information to the smart device ( 2000), and
The smart device 2000,
It is possible to diagnose the skin disease based on the smart device, characterized in that it determines the difference in the absorption rate of the acquired two image images, and if the determined difference in the difference is outside the set threshold difference value and diagnosed as a skin disease and output to the screen Optical skin disease diagnosis device.
The method of claim 1,
The skin disease control unit 600,
By selecting one of the lighting group of the first lighting group 300, the second lighting group 500, and lighting the light source of the wavelength band absorbed by the skin disease in the selected lighting group, and providing a photographing signal to the camera unit Acquire a video image,
After a certain period of time, after turning on a light source in a wavelength range that is not absorbed by the skin disease in the lighting group except the selected lighting group, a photographing signal is provided to the camera unit to acquire a video image, and the obtained two video image information. Characterized in that the transmission to the smart device (2000),
The smart device 2000,
It is possible to diagnose the skin disease based on the smart device, characterized in that it determines the difference in the absorption rate of the acquired two image images, and if the determined difference in the difference is outside the set threshold difference value and diagnosed as a skin disease and output to the screen Optical skin disease diagnosis device.
delete The method of claim 1,
The first lighting group 300 and the second lighting group 500,
Optical device capable of diagnosing skin diseases based on smart devices, characterized in that a plurality of light sources of at least two of white light source, infrared light source, UV light source, yellow light source, red light source, green light source, and blue light source are formed at regular intervals to form a group. Disease diagnosis device.

Images