KR20230149018A - Method, Computer program and System for Providing Customized Treatment Guide using Lymphedema Diagnosis Data - Google Patents

Abstract

The present invention relates to a method, computer program, and system for providing a customized treatment guide using lymphedema diagnostic data. More specifically, the present invention relates to ICG (Indocyanine green) injected into the subject's body by at least one processor. An image acquisition step in which a near-infrared image and a visible light image in which the subject's body appearance is captured are obtained, and a lymphatic form including lymphatic bodies and lymphatic patterns in the subject's body is derived from the near-infrared image by the at least one processor. Shape derivation step, the visible light image is converted into a three-dimensional image by the at least one processor, and circumference information is measured for each section in which the subject's body appearance is divided along the vertical or horizontal axis from the three-dimensional image. A step of generating a raw development diagram of the customized compression garment based on the circumference information by the at least one processor, and matching the lymph shape to the original development diagram by the at least one processor. A method of providing a customized treatment guide using lymphedema diagnosis data, including a step of generating a final development diagram in which the original development diagram in which the lymph shape is matched according to a preset value is modified by the at least one processor and a final development diagram is generated. , relates to computer programs and systems.

Description

Method, computer program and system for providing customized treatment guide using lymphedema diagnosis data {Method, Computer program and System for Providing Customized Treatment Guide using Lymphedema Diagnosis Data}

The present invention relates to a method, computer program, and system for providing a customized treatment guide using lymphedema diagnosis data. More specifically, a customized treatment that can apply pressure according to the lymphatic type of the subject's lymphedema using near-infrared images and visible light images. This relates to a method, computer program, and system for providing a customized treatment guide using lymphedema diagnosis data that provides guidance.

The lymphatic system consists of lymph vessels that carry lymph fluid along with a number of tissues and organs containing lymphoid tissue, a specialized form of reticular connective tissue containing large numbers of lymphocytes. Although the thymic component of various lymphoid organs is composed of epithelial reticular tissue, the stroma and outer structure of lymphoid tissue are generally composed of a complex network of reticular fibers (desmoplastic cells) and reticular cells (anchoring macrophages). It moves interstitial fluid from the interstitium of tissues between tissues and blood vessels and plays important functions in maintaining homeostasis, metabolism, and immune function. In particular, lymphatic vessels are known to play an important role in the pathophysiological mechanisms of malignant tumors, lymphedema, and inflammatory diseases.

Lymphatic vessels are similar in structure to blood vessels, but have thin walls and are joined to large lymph vessels (lymphatic vessels) with many plates and contain lymph capillaries that contain lymph nodes at various locations throughout the body. The areas with the highest concentration of lymph nodes are found in the face and neck, armpits, chest cavity, intestines and groin, and elbows and knees. In general, superficial lymphatic vessels of the epidermis extend along veins, while deep lymphatic vessels extend along arteries. Lymphatic vessels supply lymph throughout the body and return proteins to the cardiovascular system when they leak from the capillaries. Additionally, lymphatic vessels transport fat from the stomach into the blood. In cancer patients, lymphatic tissue has the function of monitoring and defending against foreign cells, bacteria, and cancer cells. Some lymphocytes (T cells) release substances that directly or indirectly destroy these invaders. Other lymphocytes (B cells) differentiate into plasma cells that secrete antibodies against foreign substances to help remove them. Lymph nodes act as filters for foreign substances carried by lymph by their reticular fibrous tissue. And macrophages destroy foreign substances through phagocytosis. Additionally, lymph nodes produce lymphocytes, some of which are transported in the lymph to other parts of the body as part of the immune defense system. The spleen, thymus, and tonsils are lymphoid organs that produce B-cells, T-cells, and lymphocytes, along with antibodies, respectively, to complete the immune defense line of the lymphatic system.

In this way, lymphatic vessels, which play a role in draining tissue fluid from the interstitium of tissues, play an important role in immunological defense mechanisms, and the pathophysiological mechanisms of malignant tumors, lymphedema, and inflammatory diseases are known to play an important role in disorders of lymphatic vessel production. . Among the dysfunctions of lymphatic vessels, lymphedema is a condition in which lymphatic fluid is stored under the skin due to lymphatic vessel blockage and abnormal protein accumulation occurs due to damage or blockage of lymphatic vessels. It is a degenerative product of apoptosis. This is the result of obstruction of lymphatic drainage from the lymphoid tissue area. Infiltration of this obstructive tissue by macrophages leads to the elimination of lymphatic flow through proteolysis of the obstruction protein over a considerable period of time. In this way, when lymphatic vessels malfunction, problems arise in the movement of extracellular fluid and macromolecular substances, which ultimately leads to tissue edema, immune dysfunction, and fibrosis of interstitial tissue. Lymphedema occurs due to hereditary or secondary causes, and lymphedema caused by secondary causes often occurs after treatment of malignant tumors, including surgery and radiation therapy. Acquired edema is reported to occur in more than 45% of patients with breast cancer, the most common cancer in women, and in more than 10% of all cancer patients.

In order to solve diseases such as lymphedema, there have been attempts to solve them from a physical and pharmaceutical perspective. Related document 1 relates to a massage device and method that provides a massage that helps lymph circulation in consideration of the edema state. Biometric information is acquired through at least part of the user's body, and a massage pattern is determined according to the edema state to treat the edema portion. Massages can be provided. Related Document 2 relates to a composition for treating, preventing, or improving edema, and may provide a pharmaceutical composition containing an extract or fractionated extract of Butea monosperma as an active ingredient. However, the physical method cannot be a fundamental and efficient treatment method because it intermittently provides massage to the edematous area, and the pharmaceutical method is more objective and quantifiable in that it is administered to the subject through the doctor's subjective confirmation rather than quantified numbers. There is still a need in the art for methods to be developed.

Therefore, in order to solve the above-mentioned problems, the present inventors need to develop a method to quantitatively and visually identify lymphatic diseases such as lymphedema and provide customized treatment guides.

Republic of Korea Patent Registration No. 10-2134973 Republic of Korea Patent Publication No. 10-2017-0140791

The present invention is intended to solve the above problems, and the subject can constantly relieve lymphedema by wearing customized compression garments manufactured in the final development diagram, and is optimized for the lymphatic type of the subject's lymphedema to provide relief effect. In order to improve the condition, we provide a customized treatment guide using lymphedema diagnosis data that generates a customized compression garment development diagram for the subject using near-infrared images of ICG injected into the subject's body and visible light images of the subject's body appearance. The purpose is to obtain methods, computer programs, and systems.

In addition, the purpose of the present invention is to allow the subject to additionally perform lymphatic edema massage, etc. on the relevant area on his or her own, and to enable medical staff such as physical therapists and doctors to follow up on the subject's lymphedema and confirm the prognosis by referring to it during physical therapy and edema diagnosis. It provides a method, computer program, and system for providing a customized treatment guide using lymphedema diagnosis data that creates a final development diagram of customized compression garments with lymphatic morphology that can quantitatively and visually identify the shape, size, and location of lymphedema. .

The technical problems to be achieved by the present invention are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by those skilled in the art from the description of the present invention.

In order to achieve the above object, the method of providing a customized treatment guide using lymphedema diagnostic data of the present invention includes a near-infrared image of ICG (Indocyanine green) injected into the subject's body by at least one processor. An image acquisition step in which a visible light image of the subject's body appearance is obtained; A lymph shape derivation step of deriving a lymph shape including a lymphatic body and a lymph pattern in the subject's body from the near-infrared image by the at least one processor; A circumference information measurement step in which the visible light image is converted into a three-dimensional image by the at least one processor, and circumferential information is measured for each section in which the subject's body appearance is divided along the vertical or horizontal axis from the three-dimensional image; A raw development drawing step of generating a raw development drawing of the customized compression garment based on the circumference information by the at least one processor; A developed view matching step of matching the limp shape to the original developed view by the at least one processor; and a final development drawing step in which, by the at least one processor, the original development drawing in which the limp shape is matched according to a preset value is modified and a final development drawing is generated.

In order to achieve the above object, the computer program for providing a customized treatment guide using lymphedema diagnosis data of the present invention is stored in a computer-readable recording medium to execute the method for providing a customized treatment guide using lymphedema diagnosis data.

In order to achieve the above purpose, the system for providing a customized treatment guide using lymphedema diagnostic data of the present invention photographs ICG (Indocyanine green) injected into the subject's body through a near-infrared camera and uses a visible light camera. A photographing device that photographs the external appearance of the subject's body; and at least one processor that obtains a near-infrared image and a visible light image from the imaging device and then provides a customized treatment guide suitable for the location and size of the subject's edema.

And the at least one processor acquires a near-infrared image of ICG (Indocyanine green) injected into the subject's body and a visible light image of the subject's body appearance, and obtains a near-infrared image of the subject's body from the near-infrared image. Deriving a lymphatic form including lymphatic bodies and lymphatic patterns, converting the visible light image into a three-dimensional image, and measuring circumference information for each section dividing the subject's body appearance along the vertical or horizontal axis from the three-dimensional image, Generating a raw development diagram of the customized compression garment based on the circumference information, matching the lymph shape to the original development drawing, modifying the raw development drawing with the lymph shape matched according to a preset value, and generating a final development drawing. It is characterized by

As described above, according to the present invention, the subject's customized compression clothing development diagram is created using the near-infrared image of the ICG injected into the subject's body and the visible light image of the subject's body appearance, so that the subject produces the final development diagram. Lymphedema can be alleviated on a regular basis by wearing customized compression clothing, and the relief effect can be improved because compression can be optimized for the lymphatic type of the subject's lymphedema.

In addition, by creating a final development diagram showing the lymphatic type, the subject can quantitatively and visually identify the shape, size, and location of his or her lymphedema and can additionally perform lymphatic edema massage, etc., on the relevant area. In addition, medical staff such as physical therapists and doctors can refer to it during physical therapy and edema diagnosis, and it has a significant effect in tracking the subject's lymphedema and confirming the prognosis.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the detailed description and claims.

Figure 1 is a flowchart of a method for providing a customized treatment guide using lymphedema diagnosis data of the present invention.
Figure 2 is a diagram showing a near-infrared image (a) and a visible light image (b) according to an embodiment of the present invention.
Figure 3 is a diagram showing the geometric relationship on two image planes from the epipolar geometry technique.
Figure 4 is a diagram showing deriving the size of a lymphatic body through a distance sensor according to an embodiment of the present invention.
Figure 5 is a diagram showing a template matching technique according to an embodiment of the present invention.
Figure 6 is a diagram showing a near-infrared image (a), an image displaying a lymph shape (b), and an image (c) in which a visible light image and a lymph shape are matched according to an embodiment of the present invention.
Figure 7 is a diagram showing a visible light image (a), a three-dimensional image (b), and a raw development diagram (c) according to an embodiment of the present invention.
Figure 8 is a diagram showing a modified developed view (a) without the lymphatic shape displayed and a modified developed view (b) with the lymphatic shape displayed according to an embodiment of the present invention.

The terms used in this specification are general terms that are currently widely used as much as possible while considering the function in the present invention, but this may vary depending on the intention or precedent of a person skilled in the art, the emergence of new technology, etc. In addition, in certain cases, there are terms arbitrarily selected by the applicant, and in this case, the meaning will be described in detail in the description of the relevant invention. Therefore, the terms used in the present invention should be defined based on the meaning of the term and the overall content of the present invention, rather than simply the name of the term.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as generally understood by a person of ordinary skill in the technical field to which the present invention pertains. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless clearly defined in the present application, should not be interpreted in an ideal or excessively formal sense. No.

Method of providing customized treatment guide using lymphedema diagnosis data

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. Figure 1 is a flowchart of a method for providing a customized treatment guide using lymphedema diagnosis data of the present invention. Figure 2 is a diagram showing a visible light image (a) and a near-infrared image (b) according to an embodiment of the present invention. Figure 3 is a diagram showing the geometric relationship on two image planes from the epipolar geometry technique. Figure 4 is a diagram showing deriving the size of a lymphatic body through the distance sensor 111 according to an embodiment of the present invention. Figure 5 is a diagram showing a template matching technique according to an embodiment of the present invention. Figure 6 is a diagram showing a near-infrared image (a), an image displaying a lymph shape (b), and an image (c) in which a visible light image and a lymph shape are matched according to an embodiment of the present invention. Figure 7 is a diagram showing a visible light image (a), a three-dimensional image (b), and a raw development diagram (c) according to an embodiment of the present invention. Figure 8 is a diagram showing a modified development diagram (a) without the lymph shape displayed and a modified development diagram (b) with the lymph shape displayed according to an embodiment of the present invention.

First, looking at Figure 1, the system for providing a customized treatment guide using lymphedema diagnostic data of the present invention includes an image acquisition step (S100), a lymphatic shape derivation step (S200), a circumferential information measurement step (S300), and a raw development map generation step (S400). ), a development plan matching step (S500), and a final development plan generation step (S600).

More specifically, the image acquisition step (S100) includes a near-infrared image in which ICG (Indocyanine green) injected into the subject's body is captured by at least one processor 200 and the subject's body appearance is captured in the image acquisition step (S100). Visible light images are acquired.

First of all, the term “subject” used in the present invention generally refers to a person receiving a test, and the subject to which the present invention is applied is a person who is suspected or diagnosed with lymphedema and wants to manufacture customized compression clothing suitable for the affected area. It means people.

The term “ICG” used in the present invention is a dark green fluorescent dye (reagent) that binds to albumin, a water-soluble protein. The ICG can be injected at a concentration of 0.02 to 0.05 nM. By injecting the ICG into the subject's body, the pattern and location of the subject's skin reflux can be clearly confirmed, and changes in the internal lymphatic system due to the development of lymphedema due to lymphatic system abnormalities can be visually confirmed.

Referring to (a) of FIG. 2, the near-infrared ray image is obtained by irradiating near-infrared rays to the body of the subject injected with the ICG, and at this time, infrared rays that are reflected and emitted in reaction with the ICG are captured by the imaging device 100. This is an image taken using my near-infrared camera (110). Referring to (b) of FIG. 2, the visible light image is an RGB-based image in which the appearance of the ICG-injected area in the subject's body is captured through the visible light camera 120 in the imaging device 100. The near-infrared image and the visible light image can be simultaneously captured by the photographing device 100 and acquired through the at least one processor 200.

Next, in the lymph shape derivation step (S200), a lymph shape including the lymphatic body and lymph pattern in the subject's body is derived from the near-infrared image by the at least one processor 200.

The lymphatic body refers to a swollen part of the subject's body where waste has accumulated in any lymphatic area and cannot be communicated. And the lymphatic pattern refers to a shape in which lymphatic bodies captured from the near-infrared image are repeatedly visible.

According to one embodiment of the present invention for deriving the size of the lymphatic body in the subject's body, in the image acquisition step (S100), a plurality of two-dimensional images may be acquired from the near-infrared camera 110. In order to infer the size of the lymphatic body, the lymph shape derivation step (S200) may use an epipolar geometry technique. Referring to Figure 3, the epipolar geometry technique shows that if there are two different planes 'A' and 'B', points P located on the line segment OP of the 'A' plane can be represented as P' points on the 'B' plane. there is. And point O on the ‘A’ plane, point O on the ‘B’ plane, and point P located on the line segment OP each form a triangle. This means that if the geometric relationship on the two image planes is given and the matching pair P, P’ on the two image planes is given, the three-dimensional spatial coordinates can be determined from these.

And in order to improve the accuracy of the 3D spatial coordinates determined through the epipolar geometry technique, the limp shape derivation step (S200) uses the RANSAC (RANdom Sample Consensus) algorithm to derive spatial coordinates from a plurality of 2D images. By rearranging them, spatial coordinates with improved reliability and accuracy can be obtained. In other words, in the lymph shape derivation step (S200), the size of the lymphatic body in the subject's body can be derived using the conjugate geometry technique and the RANSAC algorithm.

According to another embodiment of the present invention for deriving the size of the lymphatic body in the subject's body, the image acquisition step (S100) is performed by obtaining ICG fluorescence information detected from the distance sensor 111 in the near-infrared camera 110. It can be. At this time, the imaging device 100 may most preferably be of a shape that can rotate 360 degrees around a part of the subject's body to capture images, and the near-infrared camera 110 and the distance sensor 111 may be rotated. . The ICG fluorescence expression information refers to the fluorescence intensity of the ICG injected into the subject's body reflected by the lymphatic body and returned to the distance sensor 111. As the distance between the distance sensor 111 and the lymphatic body increases, the ICG fluorescence expression information decreases.

Referring to FIG. 4, the surface distance (P _n -A), which is the distance between the distance sensor 111 and the outline of the lymphatic body, can be derived as a part of the subject's body rotates as the center from the distance sensor 111. And the surface distance can be used to calculate the internal distance (A'), which is the distance between the center and the outline of the lymphatic body. As the distance sensor 111 rotates, numerous internal distances (A') are calculated, and the size of the lymphatic body can be derived using this.

However, parts of the subject's body are made of curved surfaces, and curved surfaces have very complex mechanisms in terms of optical properties of light, including reflection, scattering, and absorption, compared to flat surfaces. Therefore, in order to derive the exact size of the lymphatic body, it is necessary to confirm the mechanism through which light acts on the curved surface of a part of the body. Therefore, the lymph shape derivation step (S200) is a curved surface mechanism that can calculate at least one of the intensity, radiation plus, and incident angle of the light reflected from the curved surface of a part of the subject's body and incident again on the distance sensor 111. It is characterized by reflection.

Additionally, in the lymphatic pattern derivation step (S200), the lymphatic pattern can be derived by classifying the pattern of the lymphatic body using a template matching technique. Referring to Figures 5 (a) and (b), the template matching technique is a technique that moves up, down, left, and right on the near-infrared image to find an area similar to a previously stored patch image. A plurality of the patch images may be pre-stored in the at least one processor 200 depending on the level of ICG fluorescence. At this time, as shown in (c) of FIG. 5, the near-infrared image is divided into an It can be.

Meanwhile, the lymph shape derivation step (S200) is obtained from a color temperature display step (S210) in which the lymphatic body is displayed in different colors according to the lymph pattern, and the near-infrared image displayed with the color temperature and the image acquisition step (S100). It may include an image matching step (S220) in which one visible light image is matched.

For example, Figure 6(a) is the near-infrared image without color temperature displayed. Figure 6(b) is the near-infrared image in which the color temperature for each lymph pattern is displayed through the color temperature display step (S210). In the color temperature display step (S210), the color temperature previously stored for each lymphatic pattern may be displayed absolutely, or the color temperature may be displayed relatively according to the degree of ICG fluorescence expression between the lymphatic patterns derived from the near-infrared image. For example, the lymphatic pattern with low ICG fluorescence due to a significant lymphatic volume may be displayed in red, the lymphatic pattern with the next lowest ICG fluorescence may be displayed in yellow, and the lymphatic pattern with the next lowest ICG fluorescence may be displayed in blue.

Figure 6 (c) is an image in which the color temperature is displayed in the visible light image in which the subject's body appearance is captured through the image matching step (S220). The image matching step (S220) can be performed through matching between coordinates using an XY coordinate system. Therefore, through the color temperature display step (S210) and the image matching step (S220) of the present invention, the location of the lymphedema and the most severe part on the subject's body appearance can be visually confirmed, and the There is a significant effect of being reflected in the original development view in the development view matching step (S500) and the final development view generation step (S600) to create a final development view of customized compression clothing to accurately compress the subject's lymphedema area.

Next, in the circumference information measuring step (S300), the visible light image is converted into a 3D image by the at least one processor 200, and the subject's body appearance is divided into a vertical or horizontal axis from the 3D image. Circumferential information for each section is measured. Here, the circumference information may include the circumference length of the body exterior, two-dimensional coordinates, and three-dimensional coordinates.

For example, Figure 7(a) is a visible light image of the subject's body appearance. The imaging device 100 may most preferably be of a shape that can rotate 360 degrees around a part of the subject's body to capture images. Therefore, multiple visible light images taken at different angles can be combined and converted into the three-dimensional image as shown in (b) of FIG. 7.

And looking at (b) of FIG. 7, in the circumference information measuring step (S300), the subject's body appearance in the 3D image can be divided along the longitudinal axis and a plurality of sections can be created. At this time, the standard for selecting the vertical or horizontal axis is the direction of pressure that should be applied to the subject's body. In other words, the circumference information measurement step (S300) is used to create a more elaborate development diagram because the body does not form a specific shape such as a cylinder or cone, but an irregular shape, and the pressure value to be applied to each section may be different. am.

Next, in the original development plan generation step (S400), the original development plan of the customized compression garment is generated by the at least one processor 200 based on the circumference information. The original development diagram can be created in two dimensions as shown in (c) of FIG. 7 solely based on the perimeter information for each section.

Next, in the developed view matching step (S500), the limp shape is matched to the original developed view by the at least one processor 200. Most preferably, in the developed view matching step (S500), the raw developed view may be matched while the visible light image is matched to the near-infrared image whose color temperature is displayed from the image matching step (S220). Therefore, the lymphatic form can be identified on the primitive development diagram or the modified primitive development diagram.

In the matching method, in the image acquisition step (S100), the near-infrared camera 110 and the visible light camera 120 are calibrated before the near-infrared image and the visible light image are captured, so that the zero point can be adjusted. there is. In addition, the primitive development diagram can be XY-coordinated because it is generated by the circumferential information, and the lymph shape can also be XY-coordinated because it is derived from the near-infrared image captured in two dimensions from various directions. Therefore, most preferably, the developed view matching step (S500) can be matched based on the XY coordinates of the original developed view and the lymphatic shape.

Next, in the final development drawing step (S600), the original development drawing in which the limp shape is matched according to a preset value is modified by the at least one processor 200 and a final development drawing is generated.

According to one embodiment, when the original development diagram in which the lymphatic shape is matched is modified using a preset value, the final development diagram generation step (S600) reflects the preset target pressure value for each section and the lymphatic shape is matched. It may include a target pressure value reflection step (S610) in which the original development diagram is modified.

The preset target input value for each section may be different depending on the lymph shape derived from the lymph shape derivation step (S200) and the body part of the examinee. For example, looking at (a) to (b) of Figure 8, the subject's body parts are the part of the calf below the knee, the knee, and part of the thigh above the knee, and the part with the color temperature displayed in red according to the lymphatic pattern is above the knee. If it is the thigh area, a previously stored correlation between pressure and circumference information can be used to create a modified development diagram with part of the original development diagram cut off so that the section corresponding to the region can be pressurized to a preset target pressure value. The modified development diagram may or may not display the lymphatic form.

According to another embodiment, when the original development diagram in which the lymph shape is matched is modified using a preset value, the final development diagram creation step (S600) reflects material information including the elongation rate and pattern reduction rate of the customized compression garment. It may include a material information reflection step (S620) in which the original development diagram to which the lymphatic shape is matched is modified.

Here, the elongation rate of the material is a numerical expression of the degree to which the material is stretched as a percentage of the ratio between the initial length and the length at breakage. And the pattern reduction rate is the ratio of manufacturing clothes by shrinking them in consideration of the elongation rate, and is a variable dependent on the elongation rate of the material.

In the case of manufacturing the customized compression clothing with a material that stretches well, even if the original development is modified to be cut through the target pressure value reflection step (S610), the preset target pressure value may not be applied to the area to be pressed. , even if the subject wears customized compression garments, the effect of alleviating edema may be significantly reduced. On the other hand, when the customized compression clothing is made of a material that does not stretch well, the area to be pressed may be pressed beyond the preset target pressure value, and the subject may feel considerable discomfort while wearing the customized compression clothing. there is. In addition, compared to materials with a low elongation rate, materials with a high elongation rate must increase the pattern reduction rate to increase the pressure on the subject's body when worn. Conversely, for materials with a low elongation rate compared to materials with a high elongation rate, the pattern reduction rate must be lowered to reduce the pressure applied to the subject's body when worn.

Therefore, in the material information reflection step (S620), material information including the elongation rate and pattern reduction rate of the material of the customized compression clothing is reflected in order to pressurize according to the target pressure value for each section, thereby reflecting the original development or the target pressure value. From (S610), the revised development drawing can be additionally cut or the already cut portion can be filled. The revised and final developed views may or may not display the lymphatic form.

Meanwhile, in the final development drawing creation step (S600), the limp form to be pressed can be simulated with a modified development drawing modified one or more times according to a preset value. In other words, the limp shape may be modified through at least one of the length of each section reduced from the target pressure value reflection step (S610) and the length of each section corrected from the material information reflection step (S620). In the final development drawing step (S600), the modified limp shape may be simulated and displayed on at least one of the revised development drawing and the final development drawing.

Next, in the method of providing a customized treatment guide using lymphedema diagnostic data of the present invention, the final development diagram generated from the final development generation step (S600) so that the customized compression clothing can be produced by the output device 300. An output step (S700) may be further included.

Computer program that provides customized treatment guidance using lymphedema diagnosis data

Next, the computer program for providing a customized treatment guide using lymphedema diagnosis data of the present invention is stored in a computer-readable recording medium to execute the method for providing a customized treatment guide using lymphedema diagnosis data described above.

System to provide customized treatment guide using lymphedema diagnosis data

Hereinafter, embodiments according to the present invention will be described in detail with reference to the accompanying drawings. The system for providing a customized treatment guide using lymphedema diagnosis data of the present invention includes an imaging device 100 and at least one processor 200.

The imaging device 100 photographs ICG (Indocyanine green) injected into the subject's body through a near-infrared camera 110 and photographs the external appearance of the subject's body through a visible light camera 120. In addition, the at least one processor 200 acquires a near-infrared image and a visible light image from the imaging device 100 and then provides a customized treatment guide suitable for the location and size of the subject's edema.

The term “subject” used in the present invention generally refers to a person receiving a test, and the subject to which the present invention is applied is a person who is suspected or diagnosed with lymphedema and wants to manufacture customized compression garments suitable for the affected area. it means.

The term “ICG” used in the present invention is a dark green fluorescent dye (reagent) that binds to albumin, a water-soluble protein. The ICG can be injected at a concentration of 0.02 to 0.05 nM. By injecting the ICG into the subject's body, the pattern and location of the subject's skin reflux can be clearly confirmed, and changes in the internal lymphatic system due to the development of lymphedema due to lymphatic system abnormalities can be visually confirmed.

Referring to (a) of FIG. 2, the near-infrared image is irradiated with near-infrared rays to the body of the subject injected with the ICG, and at this time, the infrared rays reflected and emitted in response to the ICG are captured by the near-infrared camera 110. ) This is an image taken through. Referring to (b) of FIG. 2, the visible light image is an RGB-based image in which the appearance of the ICG-injected area in the subject's body is captured through the visible light camera 120. The near-infrared image and the visible light image may be simultaneously captured by the photographing device 100, and the at least one processor 200 may capture the near-infrared image and the visible light through a wired or wireless communication method with the photographing device 100. Images can be obtained.

On the other hand, the imaging device 100 may most preferably be in a shape of a shape that can rotate 360 degrees around a part of the subject's body to capture images, and the near-infrared camera 110 and the near-infrared camera 110 are provided on one side. The distance sensor 111 and the visible light camera 120 may rotate simultaneously.

Next, the at least one processor 200 may acquire a near-infrared image of ICG (Indocyanine green) injected into the subject's body and a visible light image of the external appearance of the subject's body.

Next, the at least one processor 200 may derive a lymphatic shape including the lymphatic body and movement pattern in the subject's body from the near-infrared image. The lymphatic body refers to a swollen part of the subject's body where waste has accumulated in any lymphatic area and cannot be communicated. And the lymphatic pattern refers to a shape in which lymphatic bodies captured from the near-infrared image are repeatedly visible.

According to one embodiment of the present invention for deriving the size of a lymphatic body in a subject's body, the at least one processor 200 may acquire a plurality of two-dimensional near-infrared images from the near-infrared camera 110. To infer the size of the lymphatic body, the at least one processor 200 may use an epipolar geometry technique. Referring to Figure 3, the epipolar geometry technique shows that if there are two different planes 'A' and 'B', points P located on the line segment OP of the 'A' plane can be represented as P' points on the 'B' plane. there is. And point O on the ‘A’ plane, point O on the ‘B’ plane, and point P located on the line segment OP each form a triangle. This means that if the geometric relationship on the two image planes is given and the matching pair P, P’ on the two image planes is given, the three-dimensional spatial coordinates can be determined from these.

In addition, in order to improve the accuracy of the three-dimensional spatial coordinates determined through the epipolar geometry technique, the at least one processor 200 uses the RANSAC (RANdom Sample Consensus) algorithm to calculate spatial coordinates derived from a plurality of two-dimensional images. By rearranging them, spatial coordinates with improved reliability and accuracy can be obtained. In other words, the at least one processor 200 may derive the size of the lymphatic body in the subject's body using the conjugate geometry technique and the RANSAC algorithm.

According to another embodiment of the present invention for deriving the size of the lymphatic body in the subject's body, the distance sensor 111 in the near-infrared camera 110 can detect and then obtain ICG fluorescence information. At this time, the imaging device 100 may most preferably be of a shape that can rotate 360 degrees around a part of the subject's body to capture images, and the near-infrared camera 110 and the distance sensor 111 may be rotated. . The ICG fluorescence expression information refers to the fluorescence intensity of the ICG injected into the subject's body reflected by the lymphatic body and returned to the distance sensor 111. As the distance between the distance sensor 111 and the lymphatic body increases, the ICG fluorescence expression information decreases.

Referring to FIG. 4, the distance sensor 111 can detect the surface distance (P _n -A), which is the distance between the distance sensor 111 and the outline of the lymphatic body, while rotating around a part of the subject's body. In addition, the at least one processor 200 may use the surface distance to calculate an internal distance (A'), which is the distance between the center and the outline of the lymphatic body. The distance sensor 111 detects the surface distance (P _n -A) at different angles as it rotates, and the at least one processor 200 uses this to calculate countless internal distances (A'). Then, using this, the size of the lymphatic body can be derived.

However, parts of the subject's body are made of curved surfaces, and curved surfaces have very complex mechanisms in terms of optical properties of light, including reflection, scattering, and absorption, compared to flat surfaces. Therefore, in order to derive the exact size of the lymphatic body, it is necessary to determine the mechanism through which light acts on the curved surface of a part of the body. Therefore, the at least one processor 200 includes a curved surface mechanism capable of calculating at least one of the intensity, radiation plus, and incident angle of light reflected from the curved surface of a part of the subject's body and incident again on the distance sensor 111. It is characterized by reflection.

Additionally, the at least one processor 200 may derive the lymphatic pattern by classifying the pattern of the lymphatic body using a template matching technique. Referring to Figures 5 (a) and (b), the template matching technique is a technique that moves up, down, left, and right on the near-infrared image to find an area similar to a previously stored patch image. The at least one processor 200 may store a plurality of the patch images according to the level of ICG fluorescence expression. At this time, as shown in (c) of FIG. 5, the near-infrared image is divided into an It can be.

Meanwhile, the at least one processor 200 displays the lymphatic body in different colors according to the lymphatic pattern, and displays the near-infrared image with the color temperature and the visible light image captured by the visible light camera 120. It is characterized by matching.

For example, Figure 6(a) is the near-infrared image without color temperature displayed. Figure 6 (b) is the near-infrared image in which the color temperature for each lymph pattern is displayed from the at least one processor 200. The at least one processor 200 may absolutely display the pre-stored color temperature for each lymphatic pattern, or may relatively display the color temperature according to the degree of ICG fluorescence expression between the lymphatic patterns derived from the near-infrared image. For example, the lymphatic pattern with low ICG fluorescence due to a significant lymphatic volume may be displayed in red, the lymphatic pattern with the next lowest ICG fluorescence may be displayed in yellow, and the lymphatic pattern with the next lowest ICG fluorescence may be displayed in blue.

Figure 6 (c) is an image in which color temperature is displayed in the visible light image in which the appearance of the subject's body is captured by the at least one processor 200. The at least one processor 200 may perform registration through matching between coordinates using the XY coordinate system. Therefore, the present invention can visually confirm the location of the lymphedema and the most severe part of the subject's body appearance, and in the next process, the color temperature is reflected in the hyperopic development diagram to accurately apply pressure to the subject's lymphedema area. It has a remarkable effect in creating the final development of compression garments.

Next, the at least one processor 200 may convert the visible light image into a 3D image and measure circumferential information for each section by dividing the subject's body appearance along the vertical or horizontal axis from the 3D image. Here, the circumference information may include the circumference length of the body exterior, two-dimensional coordinates, and three-dimensional coordinates.

For example, Figure 7(a) is a visible light image of the subject's body appearance. The imaging device 100 may most preferably be of a shape that can rotate 360 degrees around a part of the subject's body to capture images. Accordingly, the at least one processor 200 can combine multiple visible light images taken at different angles and convert them into the three-dimensional image as shown in (b) of FIG. 7.

And, looking at (b) of FIG. 7, the at least one processor 200 can segment the subject's body appearance in the 3D image along the longitudinal axis and create a plurality of sections. At this time, the standard for selecting the vertical or horizontal axis is the direction of pressure that should be applied to the subject's body. This is to create a more elaborate development diagram because the body does not have a specific shape such as a cylinder or cone, but an irregular shape, and the pressure value that must be applied to each section may be different.

Next, the at least one processor 200 generates a raw development diagram of the customized compression garment based on the circumference information. The original development diagram can be created in two dimensions as shown in (c) of FIG. 7 solely based on the perimeter information for each section.

Next, the at least one processor 200 matches the limp shape to the original development diagram. Most preferably, the at least one processor 200 may match the raw development diagram in a state in which the visible light image is matched to the near infrared image in which the color temperature is displayed. Therefore, the lymphatic shape can be identified on the primitive development diagram or the modified primitive development diagram.

Before the near-infrared image and the visible light image are captured, the near-infrared camera 110 and the visible light camera 120 can each be calibrated to adjust their zero points. In addition, the primitive development diagram can be XY-coordinated because it is generated by the circumferential information, and the lymph shape can also be XY-coordinated because it is derived from the near-infrared image captured in two dimensions from various directions. Therefore, most preferably, the at least one processor 200 can match the original development diagram and the limp form based on the XY coordinates.

Next, the at least one processor 200 modifies the original development diagram in which the limp shape is matched according to a preset value and generates a final development diagram.

According to one embodiment, when modifying the raw development diagram in which the limping shape is matched using a preset value, the at least one processor 200 reflects the preset target pressure value for each section to match the limping shape. The original development diagram can be modified.

The preset target input value for each section may be different depending on the lymph type and body part of the examinee. For example, looking at (a) to (b) of Figure 8, the subject's body parts are the part of the calf below the knee, the knee, and part of the thigh above the knee, and the part with the color temperature displayed in red according to the lymphatic pattern is above the knee. If it is the thigh area, a modified development diagram with part of the original development diagram cut off can be generated using the correlation between the previously stored pressure and circumference information so that the section corresponding to the region can be pressurized to a preset target pressure value. The modified development diagram may or may not display the lymphatic form.

According to another embodiment, when modifying the primitive development diagram in which the lymph shape is matched using a preset value, the at least one processor 200 reflects material information including an elongation rate and a pattern reduction rate of the customized compression garment. Thus, the primitive development diagram in which the lymphatic shape is matched can be modified.

Here, the elongation rate of the material is a numerical expression of the degree to which the material is stretched as a percentage of the ratio between the initial length and the length at breakage. And the pattern reduction rate is the ratio of manufacturing clothes by shrinking them in consideration of the elongation rate, and is a variable dependent on the elongation rate of the material.

In the case of manufacturing the customized compression clothing using an easily stretchable material, even if the raw development diagram is cut off, the preset target pressure value may not be applied to the area to be pressed, and even if the subject wears the customized compression clothing, edema may occur. The alleviating effect may be significantly reduced. On the other hand, when the customized compression clothing is made of a material that does not stretch well, the area to be pressed may be pressed beyond the preset target pressure value, and the subject may feel considerable discomfort while wearing the customized compression clothing. there is. In addition, compared to materials with a low elongation rate, materials with a high elongation rate must increase the pattern reduction rate to increase the pressure on the subject's body when worn. Conversely, for materials with a low elongation rate compared to materials with a high elongation rate, the pattern reduction rate must be lowered to reduce the pressure applied to the subject's body when worn.

Accordingly, the at least one processor 200 reflects material information including the elongation rate and pattern reduction rate of the material of the customized compression garment in order to pressurize according to the target pressure value for each section, thereby reflecting the original development or the target pressure value. You can additionally cut the modified development drawing or perform corrections to fill in the parts that have already been cut. The revised and final developed views may or may not display the lymphatic form.

Meanwhile, the at least one processor 200 may simulate the limp shape to be pressed with a modified development diagram modified one or more times according to a preset value. In other words, the limp shape may be modified through at least one of the length of each section reduced by reflecting the target pressure value and the length of each section modified by reflecting the material information. The at least one processor 200 may simulate the modified limp shape and display it on at least one of the modified development view and the final development view.

Next, the system for providing a customized treatment guide using lymphedema diagnosis data of the present invention may further include an output device 300 that outputs the final development of the customized compression garment generated by the at least one processor 200. The at least one processor 200 and the output device 300 can transmit and receive the final development diagram through wired or wireless communication methods.

Therefore, according to the present invention, there is a significant effect in that at least one of the subject, medical staff, and clothing manufacturer can request the production or directly produce the customized compression clothing that can significantly alleviate the subject's lymphedema through the final development diagram.

In addition, the subject can constantly relieve lymphedema by wearing customized compression clothing made according to the final development diagram. And since compression can be optimized for the lymphatic type of the subject's lymphedema, the relief effect can be improved.

In addition, by using the final development diagram showing the lymphatic type, the subject can intuitively understand the shape, size, and location of his/her lymphedema and can additionally perform lymphatic edema massage on the relevant area. In addition, medical staff such as physical therapists and doctors can refer to it during physical therapy and edema diagnosis, and it has a significant effect in tracking the subject's lymphedema and confirming the prognosis.

Embodiments may be implemented by hardware, software, firmware, middleware, microcode, hardware description language, or any combination thereof. When implemented as software, firmware, middleware, or microcode, program code or code segments that perform necessary tasks may be stored in a computer-readable storage medium and executed by one or more processors.

And aspects of the subject matter described herein may be described in the general context of computer-executable instructions, such as program modules or components that are executed by a computer. Typically, program modules or components include routines, programs, objects, and data structures that perform specific tasks or implement specific data types. Aspects of the subject matter described herein may be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media, including memory storage devices.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in an order different from the described method, and/or the components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or in a different configuration. Appropriate results may be achieved by substitution or substitution of elements or equivalents.

Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

100.. Filming device
110.. Near-infrared camera
111.. Distance sensor
120.. Visible light camera
200.. At least one processor
300.. Output device

Claims (8)

An image acquisition step in which a near-infrared image of ICG (Indocyanine green) injected into the subject's body and a visible light image of the external appearance of the subject's body are acquired by at least one processor;
A lymph shape derivation step of deriving a lymph shape including a lymphatic body and a lymph pattern in the subject's body from the near-infrared image by the at least one processor;
A circumference information measurement step in which the visible light image is converted into a three-dimensional image by the at least one processor, and circumferential information is measured for each section in which the subject's body appearance is divided along the vertical or horizontal axis from the three-dimensional image;
A raw development drawing step of generating a raw development drawing of the customized compression garment based on the circumference information by the at least one processor;
A developed view matching step of matching the limp shape to the original developed view by the at least one processor; and
A method of providing a customized treatment guide using lymphedema diagnosis data, comprising: a final development diagram generating step in which the original development diagram in which the lymphatic shape is matched according to a preset value is modified by the at least one processor and a final development diagram is generated. According to clause 1,
The final development diagram creation step is,
A method of providing a customized treatment guide using lymphedema diagnosis data, comprising a target pressure value reflection step in which the raw development diagram in which the lymph shape is matched is modified by reflecting the preset target pressure value for each section. According to claim 1,
The final development diagram creation step is,
A material information reflection step in which material information including the elongation rate and pattern reduction rate of the customized compression garment is reflected and the primitive development map in which the lymph shape is matched is modified. A customized treatment guide using lymphedema diagnosis data, comprising a. How to provide. According to clause 1,
The lymph shape derivation step is,
A color temperature display step in which the lymphatic body is displayed in different colors according to the lymphatic pattern; and
An image matching step in which the near-infrared image displaying the color temperature is matched with the visible light image obtained from the image acquisition step. A method of providing a customized treatment guide using lymphedema diagnosis data, comprising: According to clause 1,
A method of providing a customized treatment guide using lymphedema diagnosis data, further comprising an output step of outputting the final development diagram generated from the final development diagram generation step so that the customized compression clothing can be produced by an output device. . A computer program stored in a computer-readable recording medium for executing the method of providing a customized treatment guide using the lymphedema diagnosis data of any one of claims 1 to 5. An imaging device that photographs ICG (Indocyanine green) injected into the subject's body through a near-infrared camera and photographs the appearance of the subject's body through a visible light camera; and
At least one processor that acquires a near-infrared image and a visible light image from the imaging device and then provides a customized treatment guide suitable for the location and size of the subject's edema;
The at least one processor,
Obtain a near-infrared image of ICG (Indocyanine green) injected into the subject's body and a visible light image of the subject's body appearance,
From the near-infrared image, a lymphatic pattern including lymphatic volume and lymphatic pattern in the subject's body is derived,
Converting the visible light image into a three-dimensional image, measuring the circumference information for each section dividing the subject's body appearance along the vertical or horizontal axis from the three-dimensional image,
Based on the circumference information, a raw development diagram of the customized compression garment is generated,
Matching the lymph shape to the primitive development diagram,
A system for providing a customized treatment guide using lymphedema diagnosis data, characterized in that the original development diagram in which the lymph shape is matched according to a preset value is modified and a final development diagram is generated. According to clause 7,
A system for providing a customized treatment guide using lymphedema diagnosis data, further comprising an output device that outputs a final development diagram of the customized compression garment generated by the at least one processor.