KR102024598B1 - Method and apparatus for generating 3d model data for manufacturing of implant - Google Patents

Abstract

According to the present invention, there is provided a method of generating a 3D model for prosthesis, including extracting an image of a defective part of a subject's face from a medical image, reconstructing the extracted image of the defective part into a missing 3D image, and Acquiring a 3D scan image of a face, extracting a normal 3D image of a normal region symmetrical to the defect region from the obtained 3D scan image, and mirroring between the normal 3D image and the missing 3D image The method may include generating a 3D model for fabricating a prosthesis for the defective portion of the subject's face.

Description

3D model generation method and apparatus therefor for creating a prosthesis {METHOD AND APPARATUS FOR GENERATING 3D MODEL DATA FOR MANUFACTURING OF IMPLANT}

The present invention relates to an image processing technique for fabricating facial defects of a face, and more particularly, to generate a 3D model for fabricating a implant using medical image data and 3D scan data of a subject (patient) face. The present invention relates to a 3D model generation method and apparatus therefor.

As is well known, craniofacial implants or facial prostheses or the like are implants that are inserted or fixed in the defect site to mask congenital or acquired facial malformations or facial defects.

In general, a defect prosthesis is mainly produced by a professional by hand. At this time, the patient's face is photographed and measured to create a patient-specific prosthesis, and to color the skin and eyebrows so as not to be different from the surrounding skin color. do. Therefore, this work requires sophisticated hand techniques.

However, in the case of the conventional defect prosthesis produced by hand, the error between the defect site and the prosthesis is large, the volume consistency is relatively bad, and also has a disadvantage in that a lot of time and cost are consumed.

Therefore, recently, a method of producing a prosthesis is obtained by modeling a prosthesis using computer-aided design (CAD) software by obtaining three-dimensional face surface data from a computed tomography (CT) or the like.

In this case, when mirroring a portion corresponding to the symmetric region of the defective portion, the defective portion may be modeled relatively easily.

However, the conventional method using the CAD software is not only expensive to install the CAD software, but also the user manually creates or edits the defective prosthetic model for creating a symmetry plane and matching mirrored data with the missing part. There is a problem that it is very difficult and complicated to handle because it must.

Korean Patent Publication No. 10-2010-0102753 (published: 2010. 09. 24.)

An object of the present invention is to provide a method and apparatus for generating a 3D model for a prosthesis that can generate a 3D model for manufacturing a prosthesis using a medical image of a patient's face and a 3D face scan image of a patient.

The present invention also provides a computer-readable method for a processor to perform a method of generating a 3D model for a prosthesis that can generate a 3D model for manufacturing a prosthesis using a medical image of a patient's face and a 3D face scan image of a patient. It is intended to provide a computer program stored on a recording medium if possible.

The problem to be solved by the present invention is not limited to the above-mentioned, another problem to be solved is not mentioned can be clearly understood by those skilled in the art from the following description. will be.

According to an aspect of the present invention, there is provided a method of extracting an image of a defect portion of a subject's face from a medical image, reconstructing the extracted image of the defect portion into a defect 3D image, and a 3D scan image of the subject's face. Acquiring a normal 3D image of a normal region symmetrical to the defective region from the obtained 3D scan image, and mirroring between the normal 3D image and the missing 3D image; It can provide a method for generating a 3D model for the production of the prosthesis, including generating a 3D model for the production of the prosthesis.

The present invention may further comprise the step of transmitting the 3D model generated for the production of the implant for the defect site to the 3D printer.

The present invention may further include the step of manufacturing the implant through the 3D printer.

In the manufacturing step of the present invention, the implant may be manufactured by directly irradiating the foamed silicon on the base substrate.

The implant of the present invention may be a hollow silicone implant.

The medical image of the present invention may be either a CT image or an MRI image.

The 3D scan image of the present invention may be obtained from a 3D scanner.

delete

According to another aspect, the present invention can provide a computer program stored in a computer-readable recording medium so that the processor can perform the method for generating a 3D model for producing a prosthesis according to any one of claims 1 to 6. have.

According to another aspect of the present invention, there is provided a medical image storage unit for storing a medical image of a subject's face, an image extracting unit for extracting an image of a defect portion of the subject's face from the medical image, and the extracted defect region. An image reconstruction unit for reconstructing an image into a missing 3D image, a scan image storage unit storing a 3D scan image of the subject's face, and extracting a normal 3D image of a normal region symmetric to the defective region from the stored 3D scan image 3D model generation device including the image extraction unit, and an image modeling unit for generating a 3D model for producing the implant for the defective portion of the subject's face by performing a mirroring between the normal 3D image and the missing 3D image Can be provided.

The present invention may further include an image transmission unit for transmitting the 3D model generated for the production of the prosthesis for the defective portion to a 3D printer.

The medical image of the present invention may be either a CT image or an MRI image.

The scan image storage unit of the present invention may obtain and store the 3D scan image from a 3D scanner.

delete

According to an embodiment of the present invention, by generating a 3D model for the production of the implant through a simplified process using a medical image of the patient's face and the patient's 3D face scan image, the 3D model can be easily and easily generated. In addition, time and cost can be effectively reduced.

1 is a block diagram of an apparatus for generating a 3D model for manufacturing a prosthesis according to an embodiment of the present invention.
2 is an exemplary configuration diagram showing a structure in which a 3D model generating apparatus according to an embodiment of the present invention is associated with a medical device, a 3D scanner, and a 3D printer.
3A to 3E are examples of manufacturing a mold for manufacturing a prosthesis based on 3D modeling data generated using a mirroring technique according to an embodiment of the present invention.
4 is a flowchart illustrating a main process of generating 3D modeling data required for fabricating a prosthesis using a mirroring technique according to an embodiment of the present invention.
5A to 5D are examples illustrating a printing technique using a 3D model generated according to an embodiment of the present invention and a process of manufacturing a prosthesis using expanded silicone.

Advantages and features of the present invention, and methods for achieving them will be apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. As those skilled in the art would realize, the described embodiments may be modified in various ways, all without departing from the spirit or scope of the present invention. It is provided to fully inform the scope of the invention, and the scope of the invention is defined only by the claims.

In describing the embodiments of the present invention, a detailed description of a known function or configuration will be omitted unless it is actually necessary in describing the embodiments of the present invention. Terms to be described below are terms defined in consideration of functions in the embodiments of the present invention, and may vary according to intentions or customs of users or operators. Therefore, the definition should be made based on the contents throughout the specification.

Hereinafter, with reference to the accompanying drawings will be described in detail a preferred embodiment of the present invention.

FIG. 1 is a block diagram of an apparatus for generating a 3D model for manufacturing a prosthesis according to an embodiment of the present invention, which may include an image processing module 110 and an information DB 120 when largely classified.

Referring to FIG. 1, the image processing module 110 according to the present exemplary embodiment may include an image acquirer 111, an image extractor 112, an image reconstructor 113, an image extractor 114, and an image modeler ( 115), an image transmitter 116, and the like, and the information DB 120 may include a medical image storage unit 122 and a scan image storage unit 124.

First, the image acquisition unit 111 may provide a function of acquiring medical images of subject faces (patient faces) and storing them in the medical image storage unit 122 in the information DB 120. Medical images of the subject's face stored in the image storage unit 122 may be, for example, a CT image or an MRI image provided from the medical apparatus 220 of FIG. 2 to the 3D model generating apparatus 210 of the present invention.

FIG. 2 is a diagram illustrating a structure in which the 3D model generating device 210 is connected to the medical device 220, the 3D scanner 230, and the 3D printer 240 according to an embodiment of the present invention. The 220 may be, for example, a computed tomography (CT) device or a magnetic resonance imaging (MRI) device.

In addition, the image acquisition unit 111 acquires a 3D scan image of the subject face (patient face) provided from the 3D scanner 230 of FIG. 2, and stores the 3D scan image in the scan image storage unit 124 in the information DB 120. It can provide the function of.

That is, the medical image storage unit 122 may store medical images of a plurality of subject faces, and the scan image storage unit 124 may store 3D scan images of a plurality of subject faces.

In addition, the image extracting unit 112 may be configured to remove a defect (eg, eyes, forehead, cheeks, ears, etc.) of the subject's face from the medical image stored in the medical image storage unit 122 according to a user interface using an input unit (not shown). ), And transfer the extracted image of the missing portion (2D image) to the image reconstruction unit 113 and the image extraction unit 114, and the like.

In addition, the image reconstructor 113 reconstructs the image of the missing portion provided from the image extractor 112, that is, the 2D image into the missing 3D image, and transfers the reconstructed missing 3D image to the image modeling unit 115. And the like can be provided. Here, reconstructing (converting) the 2D image into the 3D image may include, for example, extracting a skin region and a mandible and reconstructing the 3D model using a service rendering algorithm.

Next, the image extracting unit 114 may be a normal region (eg, right eye region) that is symmetrical to a defective region (eg, left eye region) from the 3D scan image of the subject's face stored in the scan image storage unit 124. A normal 3D image may be extracted, and the extracted normal 3D image may be delivered to the image modeling unit 115.

In addition, the image modeling unit 115 may include a missing 3D image (image of a defective portion) provided from the image reconstructing unit 113 and a normal 3D image (image of a normal portion symmetric to the defective portion) provided from the image extractor 114. By performing the mirroring between), it is possible to provide a function such as generating a 3D model for forming a prosthesis for the defective part of the subject's face. Here, the 3D model may be defined as, for example, a implant model.

In addition, the image transmission unit 116 may be configured to generate 3D model data (prosthesis model data) for producing the prosthesis generated through the image modeling unit 115 to produce the prosthesis for the missing portion. It can provide a function such as sending). Here, the 3D model data may be transmitted by a wired transmission method or by a short range wireless transmission method using Wi-Fi, Bluetooth, and the like.

Accordingly, the 3D printer 240 may manufacture (generate) a mold (3D printing output) having a predetermined thickness (for example, 0.3 mm) having an injection hole and a bubble hole based on the mounted mold manufacturing related software. Prosthesis may be manufactured using the manufactured mold.

For example, by filling a material such as silicon through the inlet of the mold to cure for a predetermined time and then crushing the mold, it is possible to produce a implant (silicone model) for the defect site of the subject's face.

That is, according to an embodiment of the present invention, as an example, as shown in Figures 3a to 3e, it is possible to manufacture a mold for the production of the prosthesis.

FIG. 3A shows an example of a medical image, FIG. 3B shows an example of an image mirroring the opposite eye, FIG. 3C shows an example of a 3D eye design, FIG. 3D shows an example of a 3D mold design, and FIG. 3E uses a 3D printer. The example of the 3D printing output (3D metal mold | die) manufactured by the above is shown, respectively.

On the other hand, unlike the above, according to the present embodiment, it is also possible to manufacture the implant by a method of directly irradiating (spraying) the implant material, such as expanded silicone to the base substrate through a 3D printer.

On the other hand, in the embodiment of the present invention, as shown in FIG. 2 as an example, the 3D model generating apparatus has been described as a separate structure separate from the 3D scanner and the 3D printer, but this is presented as an example for convenience of description. The present invention is not necessarily limited thereto, and the 3D model generating apparatus of the present invention may be integrated with a 3D scanner and a 3D printer.

Next, a series of processes for generating 3D model data required for fabricating a prosthesis according to an embodiment of the present invention using the 3D model generating device of the present embodiment having the above-described configuration will be described in detail.

4 is a flowchart illustrating a main process of generating 3D modeling data required for fabricating a prosthesis using a mirroring technique according to an embodiment of the present invention.

Referring to FIG. 4, the image acquirer 111 acquires a medical image (eg, a CT image or an MRI image) of the subject face (patient face) from the medical apparatus 220 and from the 3D scanner 230. A 3D scan image of the provided subject face (patient face) is obtained and stored in the medical image storage unit 122 and the scan image storage unit 124 in the information DB 120 (step 402).

Next, the image extractor 112 extracts an image of a defective part (eg, eyes, forehead, cheek, ear, etc.) of the subject's face from the medical image stored in the medical image storage 122 according to the user interface. (Step 404).

The image reconstruction unit 113 then reconstructs the image (2D image) of the missing portion provided from the image extraction unit 112 into a missing 3D image through image processing using, for example, a service rendering algorithm (step 406).

In addition, the image extraction unit 114 of the normal region (for example, the right eye region) that is symmetrical to the defect (for example, the left eye region) from the 3D scan image of the subject's face stored in the scan image storage unit 124. The normal 3D image is extracted (step 408).

Subsequently, in the image modeling unit 115, a missing 3D image (an image of the missing portion) provided from the image reconstructing unit 113 and a normal 3D image (an image of a normal region symmetrical to the missing portion) provided from the image extractor 114 are provided. By performing the mirroring between the 3D models, a 3D model for manufacturing a prosthesis for the defective portion of the subject's face is generated (step 410).

Thereafter, the image transmission unit 116 transmits the generated 3D model data for manufacturing the implant to the 3D printer 240 (eg, wired transmission or short-range wireless transmission) so that the implant for the defective portion may be manufactured. Method of operation) (step 412).

As a result, the 3D printer 240 executes mold making software using the mounted 3D model data, thereby producing (creating) a mold (3D printed output) having a predetermined thickness (eg, 0.3 mm) having an injection hole and a bubble hole. (Step 414).

Therefore, a user may manufacture a prosthesis (prosthesis that is inserted or fixed to a defective part of the patient's face) by using a mold manufactured through the 3D printer 240 as described above, for example, by filling a material such as silicon through an injection hole of the mold. After hardening for a predetermined time, a mold (silicon model) for a defect portion of the face of the subject may be manufactured by crushing the mold. Here, the implant manufactured by using a mold may be, for example, a hollow silicone implant.

On the other hand, according to the present embodiment, by executing the prosthesis manufacturing software mounted in the 3D printer, the prosthesis can be directly produced without a mold by, for example, finely irradiating (ejecting) a prosthesis material such as foamed silicon onto the base substrate. Here, the implant produced by the foamed silicone irradiation technique may be, for example, a silicone implant in the hollow form.

As an example, assuming a medical image having a defect site as shown in FIG. 5A, a 3D model (3D design) having a shape as shown in FIG. 5B may be generated according to an embodiment of the present invention. A mold having a shape as shown in FIG. 5C may be manufactured through 3D printing using a 3D model, and a prosthesis as shown in FIG. 5D may be manufactured by injecting foamed silicone into the mold and curing the mold. will be.

In addition, in the exemplary embodiment of the present invention, the 3D medical image (eg, CT image) and the 3D scan image are combined to generate a 3D model for manufacturing a prosthesis, but the present invention is not necessarily limited thereto. Of course, a 3D model for prosthetic fabrication may be generated using only a 3D scan image without requiring an image.

On the other hand, combinations of each block in the accompanying block diagram and each step in the flowchart may be performed by computer program instructions. These computer program instructions may be mounted on a processor of a general purpose computer, special purpose computer, or other programmable data processing equipment such that instructions executed through the processor of the computer or other programmable data processing equipment may not be included in each block or flowchart of the block diagram. It will create means for performing the functions described in each step.

These computer program instructions may be stored in a computer usable or computer readable memory that can be directed to a computer or other programmable data processing equipment to implement the functions in a particular manner, and thus the computer usable or computer readable memory. It is also possible for the instructions stored in to produce an article of manufacture containing instruction means for performing the functions described in each block or flowchart of each step of the block diagram.

In addition, computer program instructions may be mounted on a computer or other programmable data processing equipment, such that a series of operating steps may be performed on the computer or other programmable data processing equipment to create a computer-implemented process to generate a computer or other program. Instructions for performing possible data processing equipment may also provide steps for performing the functions described in each block of the block diagram and in each step of the flowchart.

In addition, each block or step may represent a portion of a module, segment, or code that includes at least one or more executable instructions for executing a specified logical function (s). It should also be noted that in some alternative embodiments, the functions noted in the blocks or steps may occur out of order. For example, the two blocks or steps shown in succession may in fact be executed substantially concurrently or the blocks or steps may sometimes be performed in the reverse order, depending on the functionality involved.

The above description is merely illustrative of the technical spirit of the present invention, and those skilled in the art to which the present invention pertains have various substitutions, modifications, changes, etc. without departing from the essential characteristics of the present invention. You will easily see this possible. That is, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments.

Therefore, the protection scope of the present invention should be interpreted by the claims to be described later, and all technical ideas within the equivalent scope will be construed as being included in the scope of the present invention.

The above description is merely illustrative of the technical spirit of the present invention, and those skilled in the art to which the present invention pertains have various substitutions, modifications, changes, etc. without departing from the essential characteristics of the present invention. You will easily see this possible. That is, the embodiments disclosed in the present invention are not intended to limit the technical idea of the present invention but to describe the present invention, and the scope of the technical idea of the present invention is not limited by these embodiments.

Therefore, the protection scope of the present invention should be interpreted by the claims to be described later, and all technical ideas within the equivalent scope will be construed as being included in the scope of the present invention.

110: image processing module 111: image acquisition unit
112: image extraction unit 113: image reconstruction unit
114: image extraction unit 115: image modeling unit
116: video transmission unit 120: information DB
122: medical image storage unit 124: scan image storage unit

Claims (14)

Extracting an image of a defect portion of the subject's face from the medical image;
Reconstructing a missing 3D image including three-dimensional data of the defective part by using the extracted image of the defective part;
Acquiring a 3D scan image of the appearance of the subject face based on the scanning of the subject face;
Extracting a normal 3D image of a normal region symmetrical to the defect region from the obtained 3D scan image;
Generating a 3D model for fabricating a prosthesis for the defective portion of the subject's face based on mirroring the normal 3D image with respect to the missing 3D image;
And transmitting the 3D model generated for the production of the prosthesis for the defective portion to a 3D printer to produce the prosthesis through the 3D printer,
The manufacturing step,
Manufacturing a mold having a predetermined thickness having an injection hole and a bubble hole by using the 3D printer;
The implant is a hollow silicone implant manufactured based on filling the silicon through the inlet of the mold to cure for a predetermined period and then destroying the mold.
How to create 3D models for creating prostheses.
delete delete delete delete The method of claim 1,
The medical image,
Either CT or MRI
How to create 3D models for creating prostheses.
The method of claim 1,
The 3D scan image,
Obtained from a 3D scanner
How to create 3D models for creating prostheses.
delete A computer program stored in a computer-readable recording medium for allowing a processor to perform the method for generating a 3D model for producing a prosthesis according to any one of claims 1, 6 and 7.
A medical image storage unit for storing a medical image of a subject's face;
An image extracting unit extracting an image of a defective part of the subject's face from the medical image;
An image reconstruction unit configured to reconstruct a missing 3D image including three-dimensional data of the defective portion by using the extracted image of the defective portion;
A scan image storage unit for storing a 3D scan image of an appearance of the subject face based on scanning of the subject face;
An image extracting unit extracting a normal 3D image of a normal region symmetrical to the defect region from the stored 3D scan image;
An image modeling unit generating a 3D model for manufacturing a prosthesis for the defective portion of the subject's face based on mirroring the normal 3D image with respect to the missing 3D image;
The apparatus may further include an image transmission unit configured to transmit the 3D model generated for manufacturing the implant for the defective portion to a 3D printer.
The 3D printer,
By using the 3D model to manufacture a mold having a predetermined thickness having an injection hole and a bubble sphere,
The implant,
The hollow silicone implant is manufactured based on filling the silicon through the injection hole of the mold to cure for a predetermined period and then destroying the mold.
3D model generating device for prostheses.
delete The method of claim 10,
The medical image,
Either CT or MRI
3D model generating device for prostheses.
The method of claim 10,
The scan image storage unit,
Obtaining and storing the 3D scan image from a 3D scanner
3D model generating device for prostheses.
delete

Images