KR102417229B1 - Body map providing device for classification by skin area - Google Patents

Abstract

The present invention relates to a body map providing device for classification by skin area and more specifically, to a body map providing device for classification by skin area that solves the problem of not being able to identify an exact skin area and provides a body map to accurately select a disease area, thereby allowing a doctor or photographer to accurately photograph the disease area of a patient and store and manage it.

Description

Body map providing device for classification by skin area

The present invention relates to an apparatus for providing a body map for classification by skin area, and more particularly, by improving the problem of not being able to identify an accurate skin area, and providing a body map so that a diseased area can be accurately selected, a doctor or a photographer can It relates to an apparatus for providing a body map for classification by skin area in order to accurately photograph and store and manage the diseased area of a patient.

In recent clinical trials, the importance of using image data to evaluate the efficacy of new drugs is increasingly emphasized.

In particular, as the development of targeted anticancer drugs and immunotherapeutic agents is accelerated, drug efficacy evaluation using functional and molecular imaging biomarkers in addition to the existing drug efficacy evaluation based on tumor size has become very useful and important.

In addition, as the number of these imaging biomarkers increases and the amount of imaging data increases, the need for clinical trial medical image management in clinical trials or preclinical trials is increasing.

As described above, although the importance of image data in clinical trials is increasing, it is not possible to provide a system capable of integrating and managing image data and numerical data during clinical data processing.

Therefore, conventionally, video data is uploaded to a separate web page of the server or delivered by courier using CD/DVD. There were problems in that it was difficult to transmit and manage image data, and the possibility of loss and loss of image data was high.

In addition, there is a problem in that it is possible to read images (central review) only at a designated time and place, and there is a problem in that it is difficult to store image data obtained in a clinical trial.

That is, the traditional clinical method for skin diagnosis has a procedure in which a doctor reads a dermascope picture of a skin lesion site taken by a nurse, and if the skin lesion area is widely spread or has multiple skin diseases, the nurse There was a problem in that it was difficult to specify the lesion site for dermascope photography, so the diagnosis process was inefficiently lengthened.

Therefore, it is necessary to develop a technology to shorten the time taken for skin diagnosis, reduce unnecessary labor of nurses and doctors, and provide prompt and intelligent medical services to patients.

In particular, since the traditional clinical method for skin diagnosis is a procedure in which a doctor reads a dermoscopy picture of a skin lesion taken by a nurse, the clinical picture is used as a reference to record the location of the skin lesion, etc. was only used as

However, when the skin lesion site is widely spread or has multiple skin diseases, it is difficult for the nurse to specify the lesion site for dermoscopy, so the diagnosis process becomes inefficiently long.

Therefore, it is necessary to develop a technology for reducing the time required for skin diagnosis, reducing unnecessary labor of nurses and doctors, and providing prompt and intelligent medical services to patients.

On the other hand, as shown in FIG. 1 , in the conventional imaging method, a lesion site is marked with dots on a 2D image paper, and a photographer or a doctor acquires the 2D image paper and rechecks the location to determine whether to shoot. method was adopted.

Therefore, it could not be confirmed even if there was a disease in the heel, and it was difficult to confirm in the case of the side area.

That is, there is the inconvenience of having to visually reconfirm the location of the affected area by looking at the 2D image paper.

Therefore, there is a need for a new style of shooting technology that allows the doctor to check the location in real time without the procedure of reconfirming it with the naked eye.

Republic of Korea Patent Publication No. 10-2019-0118358

Therefore, the present invention has been proposed in view of the problems of the prior art as described above, and a first object of the present invention is to provide a body map by improving the conventional problem of not being able to identify an accurate skin region, so that a diseased region can be accurately selected. By doing so, a doctor or photographer can accurately photograph the diseased area of the patient and store and manage it.

A second object of the present invention is to simplify the skin diagnosis process in which the conventional reading and imaging are separated, and to establish big data for each patient and efficiently manage the history of big data according to the automatic transmission of skin medical images through digitization of skin images. is to do it

In order to achieve the problem to be solved by the present invention, an apparatus for providing a body map for classification by skin region according to an embodiment of the present invention,

Acquire body map information from the body map server, display the body map on the screen using the acquired body map information, and information on the lesion location for the lesion site checked in the 3D object image of the human body displayed on the screen through the body map An auxiliary terminal 100 for providing 180 as a body map server;

Body map server ( 200) and

In the case of obtaining lesion location information from the body map server, a photographing terminal 300 for photographing a patient's skin image corresponding to the lesion location information and providing the photographed skin image information to the body map server is included.

The present invention provides a body map to accurately select a diseased region by improving the conventional problem of not being able to identify an accurate skin region through the device for providing a body map for classification by skin region, so that a doctor or photographer can accurately select a diseased region. It provides the effect of accurately photographing the area and storing and managing it, thereby exhibiting the effect of preventing diagnosis errors.

In addition, it simplifies the skin diagnosis process in which the conventional reading and imaging are separated, and the automatic transmission of skin medical images through digitization of skin images enables the establishment of big data for each patient and the efficient history management of big data. .

1 is a paper example for checking a conventional two-dimensional photographing position.
2 is a conceptual block diagram of an apparatus for providing a body map for classification by skin region according to an embodiment of the present invention.
3 is a block diagram of a body map server 200 of an apparatus for providing a body map for classification by skin region according to an embodiment of the present invention.
4 to 11 are exemplary body map views of an apparatus for providing a body map for classification by skin region according to an embodiment of the present invention.
12 is an exemplary view of a pax page provided by the apparatus for providing a body map for classification by skin region according to an embodiment of the present invention.

The following is merely illustrative of the principles of the invention. Therefore, those skilled in the art will be able to devise various devices that, although not explicitly described or shown herein, embody the principles of the present invention and are included within the spirit and scope of the present invention.

In addition, all conditional terms and examples listed herein are, in principle, expressly intended only for the purpose of understanding the concept of the present invention, and it should be understood that they are not limited to the specifically enumerated embodiments and states as such. do.

Hereinafter, an embodiment of the apparatus for providing a body map for classification by skin region according to the present invention will be described in detail with reference to the drawings.

2 is a conceptual block diagram of an apparatus for providing a body map for classification by skin region according to an embodiment of the present invention.

As shown in Fig. 2, the present invention provides an apparatus for providing a body map for classification by skin region,

Acquire body map information from the body map server, display the body map on the screen using the acquired body map information, and set the lesion area on the 3D object image of the human body displayed on the screen through the body map to determine the lesion area. Auxiliary terminal 100 for providing lesion location information 180 to the body map server;

Body map server ( 200) and

When the lesion location information is obtained from the body map server, the skin image of the patient corresponding to the lesion location information is photographed, and the photographing terminal 300 is configured to include the photographing terminal 300 for providing the captured skin image information to the body map server. characterized.

The auxiliary terminal 100 obtains body map information from the body map server, displays the body map on the screen using the obtained body map information, and shows the lesion site on the 3D object image of the human body displayed on the screen through the body map. By setting , the function of providing the lesion location information 180 for the lesion site to the body map server is performed.

For example, the body map as shown in FIG. 4 is displayed on the screen using body map information provided by the body map server, and the 3D object image of the human body displayed on the screen through the body map is displayed by the practitioner. The lesion site will be established. Thereafter, the lesion location information 180 on the lesion site set in the 3D object image of the human body is provided to the body map server so that it can be stored and managed.

A body map as shown in FIG. 4 is displayed on the screen using the body map information obtained from the body map server. The user (doctor) uses the body map displayed on the screen to display a 3D object image of the human body on the screen for treatment.

Specifically, the body map displayed on the screen using body map information is shown in FIG. 4 ,

a front body hot key layer 151 for displaying a front 3D object image of a human body among 3D object images of a human body when selected;

a rear body hotkey layer 152 for displaying a rear 3D object image of the human body among the 3D object images of the human body when selected;

a left body hotkey layer 153 for displaying a left 3D object image of a human body among 3D object images of a human body when selected;

a right body hotkey layer 154 for displaying a right 3D object image of a human body among 3D object images of a human body when selected;

a face hot key layer 155 for displaying a face 3D object image of a human body among 3D object images of a human body when selected;

a hand hot key layer 156 for displaying a 3D object image of a human hand from among the 3D object images of the human body when selected;

a foot hot key layer 157 for displaying a 3D object image of a human foot from among the 3D object images of the human body when selected;

and an image display layer 158 on which a 3D object image of a human body is displayed according to the selection of the hot key layer.

When the user selects the front body hotkey layer 151 , as shown in FIG. 4 , the front body hotkey layer 151 performs a function of displaying the front 3D object image of the human body among the 3D object images of the human body. That is, when the corresponding button on the front body hotkey layer 151 is clicked, an image of the front 3D object of the human body is displayed.

When the user selects the rear body hotkey layer 152, as shown in FIG. 5 , the rear body hotkey layer 152 performs a function of displaying the rear 3D object image of the human body among the 3D object images of the human body. That is, when the corresponding button in the rear body hot key layer 152 is clicked, the rear 3D object image of the human body is displayed.

When the user selects the left body hotkey layer 153, as shown in FIG. 6 , the left body hotkey layer 153 performs a function of displaying the left 3D object image of the human body among the 3D object images of the human body. That is, when the corresponding button in the left body hotkey layer 153 is clicked, the left 3D object image of the human body is displayed.

When the user selects the right body hot key layer 154, as shown in FIG. 7 , the right body hotkey layer 154 performs a function of displaying the right 3D object image of the human body among the 3D object images of the human body. That is, when the corresponding button in the left body hotkey layer 154 is clicked, the right 3D object image of the human body is displayed.

When a user selects the face hot key layer 155 , as shown in FIG. 8 , the face hot key layer 155 performs a function of displaying a face 3D object image of a human body among 3D object images of the human body. That is, when a corresponding button in the face hot key layer 155 is clicked, a 3D image of a human face is displayed.

When the user selects the hand hot key layer 156, as shown in FIG. 9 , the hand hot key layer 156 performs a function of displaying a 3D object image of a hand of a human body among 3D object images of a human body. That is, when a corresponding button in the hand hot key layer 151 is clicked, a 3D image of a human hand is displayed.

When the corresponding button is clicked, the hand map image is displayed. In the case of the hand, the selection buttons of L BACK, L PALM, R BACK, and R PALM are displayed, and when any one of them is selected, it is displayed on the screen.

When the user selects the foot hot key layer 157, as shown in FIG. 10 , the foot hot key layer 157 performs a function of displaying a three-dimensional object image of a human foot among the three-dimensional object images of the human body. That is, when a corresponding button in the foot hot key layer 157 is clicked, a 3D object image of a human foot is displayed.

When the corresponding button is clicked, the foot map image is displayed. In the case of the foot, the selection buttons of L TOP, L BOTTOM, R TOP, and R BOTTOM are displayed, and when any one of these is selected, it is displayed on the screen.

The image display layer 158 performs a function of displaying a 3D object image of the human body according to the selection of each hot key layer. That is, the 3D object image of the human body as shown in FIGS. 4 to 10 is displayed on the image display layer 158 according to the selection of each hot key layer.

As described above, by providing the hotkey button on the body map, it is possible to quickly select a desired location in the human body to be photographed.

In addition, the lesion location information 180 for the lesion site checked in the 3D object image 158 of the human body displayed on the screen through the body map is,

Position information 181 of a point clicked on any one of the three-dimensional object image of the human body displayed on the screen;

Including information 182 of the body part area around the clicked point,

The clicked point and the region of the body part around the clicked point have different color information so that the location of the skin disease can be intuitively identified.

As shown in FIG. 8 , the user (doctor) clicks on the lesion site to be treated on the 3D object image of the human body displayed on the screen (a face image is exemplified in FIG. 8).

The location information of the clicked point functions as location information on the lesion site.

In addition, information 182 of the body part area around the clicked point is generated. For example, when a specific lesion position among the left cheekbones of the face is clicked, the area around the left cheekbone is generated as information 182 on the body part area around the clicked point.

In particular, the clicked point and the region of the body part around the clicked point have different color information, so that the location of the skin disease can be intuitively identified.

For example, as shown in FIG. 8 , the region of the body part around the clicked point is displayed in light blue and the clicked point is displayed in red, so that the location of the skin disease can be intuitively identified.

The body map server 200 stores body map information, stores lesion location information 180 provided from an auxiliary terminal, provides the stored lesion location information to a photographing terminal, and provides a patient's skin image provided by the photographing terminal A function to save is provided.

For example, lesion location information on the abdomen provided by the auxiliary terminal and skin image information on the abdomen provided by the imaging terminal are matched to the corresponding patient information field and stored.

In general, in the case of dermatology, the skin surface is checked using a skin imaging means, for example, a magnifying glass. are suffering

In order to solve this problem, the problem of conventional misdiagnosis can be solved by establishing a photographing process, obtaining consistent information through this, and storing and managing it.

Hereinafter, the body map server 200 will be described in detail with reference to the drawings.

3 is a block diagram of a body map server 200 of an apparatus for providing a body map for classification by skin region according to an embodiment of the present invention.

As shown in FIG. 3 , the body map server 200 includes a body map information DB 210 , a body map information provider 220 , an image information acquisition unit 230 , a skin image information storage processing unit 240 , and a patient It will be configured to include a skin image information storage unit (250).

Specifically, the body map server 200,

a body map information DB 210 that stores body map information;

a body map information providing unit 220 for providing the body map information stored in the body map information DB to an auxiliary terminal;

an image information acquisition unit 230 for acquiring lesion location information provided from the auxiliary terminal 100 and skin image information provided from the imaging terminal 300;

a skin image information storage processing unit 240 for matching the lesion location information and the skin image information obtained in the image information acquisition unit to the corresponding patient information field, and storing and processing the lesion position information and the skin image information in the patient skin image information storage unit;

and a patient skin image information storage unit 250 that stores lesion location information and skin image information for each patient information field.

The body map information DB 210 stores body map information, and the body map information providing unit 220 performs a function to provide the body map information stored in the body map information DB to an auxiliary terminal.

The body map information is information in which a code value for each body part and a body part name are mapped, and it is characterized in that it is information that enables a 3D object image of a human body to be displayed on a screen of an auxiliary terminal.

For example, as shown in FIG. 11 , in the case of the hand, the left hand and the right hand exist, and the back of the hand and the palm exist. In this case, a code value is mapped for each part, and the name of a body part is mapped here.

Accordingly, the classified objects are synthesized to complete one body map, and if a specific part is clicked on the auxiliary terminal, the detailed location is displayed as an area and a point (point).

In this case, the part selected by the diagnostician includes a predefined code value and a name, and when the OK button is pressed, the doctor or the photographer will photograph the corresponding part.

On the other hand, the above-described code value, as shown in FIG. 5 , when the left hip is selected, the code value '231' mapped here to the lower side is expressed.

Accordingly, since the code value and the name are mapped and provided to the photographing terminal, the problem that the doctor or the photographer must reconfirm the location with the naked eye is solved.

That is, as shown in FIG. 4 , the body map is provided to the auxiliary terminal so that the diagnostician checks the suspected lesion area on the body map displayed on the screen of the auxiliary terminal.

For example, in the case of an X-ray that is generally used in departments other than dermatology, the location of the lesion is not necessarily indicated.

Because most of the shots are taken in a large area, a specialist can immediately determine whether it is the hand, leg, body, or head of the human body.

However, since the photographed image used in dermatology uses a skin image enlarged through a magnifying glass, the location of the photographing must be provided so that a specialist can see it and identify it immediately. In order to confirm the location, the specialist calls the photographer or receives a separate message from the photographer and then goes through the process of checking.

Therefore, in the case of a large dermatology clinic, the waiting time for treatment was long, which made patients reluctant to go to the dermatology clinic.

In addition, the image information acquisition unit 230 performs a function for acquiring the lesion location information provided from the auxiliary terminal 100 and the skin image information provided from the imaging terminal 300 .

For example, lesion location information on a lesion located in the abdomen and skin image information on the abdomen including the lesion are acquired.

Then, the skin image information storage processing unit 240 matches the lesion location information and the skin image information obtained in the image information acquisition unit to the corresponding patient information field, and stores the information in the patient skin image information storage unit.

For example, patient detailed information including patient unique identification information is stored for each patient. The detailed patient information includes not only patient ID, but also patient name, date of birth, gender, and the like.

And, the photographed skin image information and photographing date information, unique identification information of the photographing terminal, unique identification information of the treating doctor, doctor opinion information, photographed lesion location information, and lighting information applied at the time of photographing the lesion. .

Information such as #id_01#kimsun#800112#female#abc-jpeg#202103031000#camera_id_01#doctor_id_01#opinion-txt#face#uv will be saved.

In this case, the patient skin image information storage unit 250 stores lesion location information and skin image information for each patient information field.

Meanwhile, according to an additional aspect, the body map server 200 may be configured to further include a fax page providing unit.

That is, the fax page providing unit performs a function of providing the skin image information for each point of the patient and the fax page 4510 for registering or modifying the patient and searching for a specific patient to the diagnostic terminal.

That is, as shown in FIG. 12 , the fax page 4510 is

a patient information retrieval layer 4510A for displaying a retrieval button for retrieving patient information;

a patient information display layer 4510B for displaying the retrieved patient information;

a patient information update layer 4510C for displaying a patient addition or patient modification button;

a history image information layer 4510D for displaying the searched history image information of the patient;

a body map location information layer 4510E for displaying body map lesion location information corresponding to the searched history image of the patient;

and a skin image information layer 4510F for displaying skin image information of the expressed body map point.

Specifically, the patient information search layer 4510A displays a search button for searching patient information, and when a patient name is written on the layer and the search button is selected, the patient information corresponding to the patient name is retrieved. Gathering will provide it to the screen.

That is, the retrieved patient information is displayed through the patient information display layer 4510B.

The patient information update layer 4510C is a layer for expressing a patient add or patient edit button. If patient information does not exist, patient information is added, and when patient information exists but detailed patient information is changed, patient information will be able to edit.

The history image information layer 4510D is a layer for displaying the searched history image information of the patient, and provides history image information that the patient has treated so far so that the diagnostician can refer to it.

The body map location information layer 4510E is a layer for displaying body map lesion location information corresponding to the searched history image of the patient, and the location on the body map for a specific lesion (point) currently photographed by the diagnostician can be intuitively identified. This is to ensure that a comprehensive judgment is possible.

The skin image information layer 4510F is a layer for expressing skin image information of the body map point. For example, it provides image information on a clicked point among the abdominal region on the body map, and thus comprehensive judgment is to make this possible.

Accordingly, when performing a dermatology treatment, the diagnosis can be made while comprehensively checking the position of the body map, the skin image, and the like.

On the other hand, the body map server 200 is at least one of PACS (Picture Archiving and Communication System), EMR (Electronic Medical Record), PHR (Personal Health Record), RIS (Radiology Information System), CRM (Customer Relationship Management) It is characterized in that it is a cloud server that can be connected to this or that.

Through this, the specialists can access the body map server and check the patient's medical history information in the past.

When the photographing terminal 300 obtains the lesion location information from the body map server, it takes a skin image of the patient corresponding to the lesion location information, and provides the photographed skin image information to the body map server.

For example, as shown in FIG. 4 , the left lower abdomen area corresponding to the acquired lesion location information 180 is photographed, and the captured skin image is matched with the patient information and provided to the body map server for storage management. to make it possible

According to the present invention, it is possible to improve the conventional problem of not being able to identify an accurate skin region and provide a body map so that a diseased region can be accurately selected, so that a doctor or photographer can accurately photograph and store and manage the diseased region of a patient. By providing an effect, the effect of preventing diagnosis errors will be exhibited.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and it is common in the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims. Various modifications may be made by those having the knowledge of, of course, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: auxiliary terminal
200: body map server
300: shooting terminal

Claims (6)

In the apparatus for providing a body map for classification by skin region,
Acquire body map information from the body map server, display the body map on the screen using the acquired body map information, and set the lesion area in the 3D object image of the human body displayed on the screen through the body map to determine the lesion area. Auxiliary terminal 100 for providing lesion location information 180 to the body map server;
Body map server ( 200) and
When the lesion location information is obtained from the body map server, the skin image of the patient corresponding to the lesion location information is photographed, and the photographing terminal 300 is configured to provide the photographed skin image information to the body map server,

The lesion location information 180,
Including location information 181 of a point clicked on any one point of the 3D object image of the human body displayed on the screen and information 182 of a body part area around the clicked point,
The apparatus for providing a body map for classification by skin part, characterized in that the clicked point and the region of the body part around the clicked point have different color information so that the location of the skin disease can be intuitively identified.
The method of claim 1,
The body map displayed on the screen of the auxiliary terminal 100 is,
a front body hot key layer 151 for displaying a front 3D object image of a human body among 3D object images of a human body when selected;
a rear body hotkey layer 152 for displaying a rear 3D object image of the human body among the 3D object images of the human body when selected;
a left body hotkey layer 153 for displaying a left 3D object image of a human body among 3D object images of a human body when selected;
a right body hotkey layer 154 for displaying a right 3D object image of a human body among 3D object images of a human body when selected;
a face hot key layer 155 for displaying a face 3D object image of a human body among 3D object images of a human body when selected;
a hand hot key layer 156 for displaying a 3D object image of a human hand from among the 3D object images of the human body when selected;
a foot hot key layer 157 for displaying a 3D object image of a human foot from among the 3D object images of the human body when selected;
An apparatus for providing a body map for classification by skin part, characterized in that it includes an image display layer (158) on which a three-dimensional object image of a human body is displayed according to the selection of the hot key layer.
delete The method of claim 1,
The body map server 200,
a body map information DB 210 that stores body map information;
a body map information providing unit 220 for providing the body map information stored in the body map information DB to an auxiliary terminal;
an image information acquisition unit 230 for acquiring lesion location information provided from the auxiliary terminal 100 and skin image information provided from the imaging terminal 300;
a skin image information storage processing unit 240 for matching the lesion location information and skin image information obtained in the image information acquisition unit to the corresponding patient information field, and storing and processing the lesion location information and skin image information in the patient skin image information storage unit;
The apparatus for providing a body map for classification by skin region, comprising: a patient skin image information storage unit 250 that stores lesion location information and skin image information for each patient information field.
5. The method of claim 4,
The body map information stored in the body map information DB 210 is,
A body map providing apparatus for classification by skin part, characterized in that it is information in which code values for each part of the body and names of parts of the body are mapped, so that a 3D object image of the human body can be displayed on the screen of an auxiliary terminal.
The method of claim 1,
The body map server 200,
At least one of PACS (Picture Archiving and Communication System), EMR (Electronic Medical Record), PHR (Personal Health Record), RIS (Radiology Information System), CRM (Customer Relationship Management), or characterized in that it is a cloud server that can be connected thereto A body map providing device for classification by skin area.

Images