JPWO2018212248A1 - Image processing apparatus and image processing method - Google Patents

Abstract

An image processing apparatus according to the present disclosure is an imaging unit capable of capturing an image of a heart from a body surface, an acquisition unit that acquires outer diameter information of a tubular member inserted into the heart, and the acquisition unit that acquires the acquisition unit. An image processing unit that corrects an outline of the tubular member in the image based on outer diameter information.

Description

  The present disclosure relates to an image processing device and an image processing method.

  2. Description of the Related Art Conventionally, it has been known that a medical instrument is inserted into a blood vessel, a heart, or the like, and diagnosis or treatment is performed while detecting the position of the medical instrument in a body using an extracorporeal three-dimensional ultrasonic diagnostic apparatus. . Patent Literature 1 describes a medical system that performs this type of diagnosis.

  The medical system described in Patent Literature 1 includes a medical device that includes a needle that is inserted into a target body to remove a lesion in the target body and a vibration applying unit that applies vibration to the needle. The medical system described in Patent Literature 1 includes an ultrasonic data acquisition unit that transmits an ultrasonic signal to a target object, receives an ultrasonic echo signal reflected from the target object, and obtains ultrasonic data. Further, the medical system described in Patent Literature 1 is connected to a medical instrument and an ultrasound data acquisition unit, forms a plurality of ultrasound images using the ultrasound data, and performs motion tracking on each of the plurality of ultrasound images. To detect the position of the needle and perform image processing on the plurality of ultrasonic images based on the detected position of the needle to improve the image quality of the ultrasonic image.

JP 2012-105948 A JP 2001-297756 A

  Ultrasound images can be obtained in real time, but in the case of ultrasonic images, it is difficult to clearly identify the position and contour of medical devices such as needles due to the attenuation of ultrasonic waves. It is difficult to operate a medical instrument to perform diagnosis or treatment while checking the sound wave image. On the other hand, in the medical system described in Patent Document 1, motion tracking is performed to detect the position of the needle, and image processing for improving the image quality of the ultrasonic image is performed based on the detected position of the needle. ing. However, there is still room for improvement in the accuracy of contour correction of a medical instrument in an ultrasonic image and an image on which the ultrasonic image is based.

  An object of the present disclosure is to provide an image processing apparatus and an image processing method capable of improving the accuracy of contour correction of a tubular member as a medical device in an image.

  An image processing apparatus according to a first aspect of the present disclosure includes an imaging unit that can capture an image of a heart from a body surface, an acquisition unit that acquires outer diameter information of a tubular member inserted into the heart, An image processing unit that corrects the contour of the tubular member in the image based on the outer diameter information acquired by the unit.

  As one embodiment of the present disclosure, the image processing unit corrects a contour of the tubular member in the image based on the outer diameter information and scale information of the image.

  As one embodiment of the present disclosure, the imaging unit is an ultrasonic transmission unit that transmits an ultrasonic wave, an ultrasonic reception unit that receives an ultrasonic wave, and the image from the measurement information received by the ultrasonic reception unit. And an image forming unit to be formed.

  As one embodiment of the present disclosure, the imaging unit captures the image at predetermined time intervals.

  An image processing device as one embodiment of the present disclosure includes a display unit that can display the image corrected by the image processing unit.

  An image processing device as one embodiment of the present disclosure includes an input unit that inputs the outer diameter information to the acquisition unit.

  An image processing apparatus as one embodiment of the present disclosure includes an operation unit that receives an operation by a user, and the input unit inputs the outer diameter information received by the operation unit to the acquisition unit.

  An image processing apparatus as one embodiment of the present disclosure includes a storage unit that stores the outer diameter information, and the input unit inputs the outer diameter information stored in the storage unit to the acquisition unit.

  An image processing apparatus according to a second aspect of the present disclosure includes an acquisition unit that acquires outer diameter information of a tubular member inserted into a heart, and a body surface based on the outer diameter information acquired by the acquisition unit. An image processing unit that corrects the contour of the tubular member in the captured heart image.

  An image processing method according to a third aspect of the present disclosure includes an imaging step of capturing an image of a heart from a body surface, an acquiring step of acquiring outer diameter information of a tubular member inserted into the heart, and an outer diameter of the outer diameter. An image processing step of correcting a contour of the tubular member in the image based on the information.

  According to the present disclosure, it is possible to provide an image processing apparatus and an image processing method capable of improving the accuracy of contour correction of a tubular member as a medical instrument in an image.

1 is a block diagram illustrating an image processing device according to an embodiment of the present disclosure. FIG. 2 is a schematic diagram illustrating an outline of a treatment performed using the image processing apparatus of FIG. 1. FIG. 2 is a diagram illustrating an example of a three-dimensional image of a heart captured by an imaging unit of the image processing device in FIG. 1. 3 is a flowchart illustrating an image processing method executed by the image processing apparatus illustrated in FIG. 1. 1 is a block diagram illustrating an image processing device set according to an embodiment of the present disclosure. FIG. 6 is a schematic diagram illustrating an outline of a treatment performed using the image processing apparatus set illustrated in FIG. 5. FIG. 6 is a diagram illustrating an example of a three-dimensional image of a heart captured by an imaging unit of the image processing device in the image processing device set of FIG. 5. 6 is a flowchart illustrating an image processing method executed by the image processing device in the image processing device set of FIG. 5.

  Hereinafter, embodiments of an image processing device and an image processing method according to the present disclosure will be described with reference to the drawings. In the drawings, common members / parts are denoted by the same reference numerals.

  FIG. 1 is a block diagram illustrating an image processing apparatus 1 as one embodiment of an image processing apparatus according to the present disclosure. FIG. 2 is a schematic diagram showing an outline of a treatment performed using the image processing apparatus 1.

  As shown in FIG. 2, the image processing apparatus 1 according to the present embodiment delivers a medical device into a heart through a blood vessel and performs a predetermined diagnosis or treatment in the heart. This is a monitoring device that can monitor the state inside the heart. The monitoring device as the image processing device 1 monitors, for example, the position and contour in the left ventricle LV of the catheter as the tubular member 31 inserted into the left ventricle LV from the femoral artery FA through the aorta AO and the aortic valve AV. Display as possible. A medical worker such as a doctor relies on the position and contour of the tubular member 31 in the left ventricle LV displayed on the monitoring device as the image processing device 1, and various types of medicine delivered into the left ventricle LV through the tubular member 31. An operation such as a predetermined diagnosis or treatment is performed using a medical instrument.

  The predetermined treatment performed in the left ventricle LV includes, for example, a treatment in which various therapeutic substances are administered into the myocardium for treating a heart disease or the like. Examples of various therapeutic substances include substances that can provide therapeutic effects such as cell replenishment, induction of angiogenesis, reinforcement of the heart wall, scaffolding materials, or tissue repair or regeneration by preventing apoptosis / necrosis. Or a polymer or the like. Cells as a therapeutic substance are administered into the myocardium in the form of a cell suspension dispersed in a liquid such as physiological saline.

  Cells as therapeutics include, for example, adherent cells (adherent cells). Adherent cells include, for example, adherent somatic cells (eg, cardiomyocytes, fibroblasts, epithelial cells, endothelial cells, hepatocytes, pancreatic cells, kidney cells, adrenal cells, periodontal ligament cells, gingival cells, periosteal cells, skin Cells, synovial cells, chondrocytes, etc.) and stem cells (eg, tissue stem cells such as myoblasts, cardiac stem cells, embryonic stem cells, pluripotent stem cells such as iPS (induced pluripotent stem) cells, mesenchymal stem cells, etc.) Including. The somatic cells may be stem cells, particularly cells differentiated from iPS cells. Non-limiting examples of cells as therapeutic agents include, for example, myoblasts (eg, skeletal myoblasts), mesenchymal stem cells (eg, bone marrow, adipose tissue, peripheral blood, skin, hair root, muscle tissue, uterus Intima, placenta, cord blood-derived cells), cardiomyocytes, fibroblasts, cardiac stem cells, embryonic stem cells, iPS cells, synovial cells, chondrocytes, epithelial cells (eg, oral mucosal epithelial cells, retinal pigment epithelium) Cells, nasal mucosal epithelial cells, etc.), endothelial cells (eg, vascular endothelial cells, etc.), hepatocytes (eg, liver parenchymal cells, etc.), pancreatic cells (eg, pancreatic islet cells, etc.), renal cells, adrenal cells, periodontal ligament cells Gingival cells, periosteal cells, skin cells and the like.

  Drugs as therapeutic agents include, for example, proteins, plasmids, genes, growth factors, chemoattractants, synthetic polypeptides, various pharmaceutical compositions, and the like, and other therapeutically beneficial substances alone, Alternatively, it can be included in any combination.

  Polymers as therapeutic substances include injectable, biocompatible single or multi-component materials, polymer-based beads, polymer hydrogels, fibrin adhesives, synthetic polymeric materials such as collagen, alginate, polyethylene glycol, and the like, and Chitosan and the like.

  In the present embodiment, as shown in FIG. 2, a treatment in which a therapeutic substance is administered from the inside of the left ventricle LV to or near the infarct site X of the myocardium of the left ventricle LV is monitored by the monitoring device as the image processing device 1. An example of performing the treatment while monitoring is performed by the monitoring device as the image processing device 1. The treatment to be performed is not limited to the administration of a predetermined therapeutic substance, and is, for example, a treatment for diagnosing the infarction state of the myocardium of the left ventricle LV. And so on. The infarct site X of the myocardium in the left ventricle LV is obtained by acquiring a tomographic image of the heart from outside the body using a magnetic resonance imaging device (hereinafter, referred to as an MRI device) or an X-ray computed tomography device (hereinafter, referred to as an X-ray CT device). Can be specified in advance from the acquired tomographic image.

  Further, the monitoring device as the image processing device 1 of the present embodiment is not limited to the device capable of monitoring the operation in the left ventricle LV, and is executed inside any of the right ventricle, the left atrium, and the right atrium. It is good also as a device which can monitor the operation from outside the body. As described later, the image processing apparatus 1 of the present embodiment is a three-dimensional ultrasonic diagnostic apparatus. Therefore, a tomographic image in a different cross section can be acquired in any of the left ventricle LV, the right ventricle, the left atrium, and the right atrium, and monitoring can be performed by using these tomographic images.

  Hereinafter, details of the image processing apparatus 1 of the present embodiment will be described.

  As shown in FIG. 1, the image processing apparatus 1 includes an imaging unit 2, an acquisition unit 3, an image processing unit 4, a display unit 5, an input unit 6, an operation unit 7, a storage unit 8, a control unit Unit 9.

  The imaging unit 2 can capture a tomographic image of the heart as a heart image and a three-dimensional image of the heart from the body surface.

  Specifically, the imaging unit 2 includes an ultrasonic transmitting unit 11 that transmits an ultrasonic wave, an ultrasonic receiving unit 12 that receives an ultrasonic wave, and an ultrasonic wave as measurement information of the ultrasonic wave received by the ultrasonic receiving unit 12. And an image forming unit 13 that forms a tomographic image from the sound wave data. The ultrasonic wave receiving unit 12 receives the ultrasonic waves transmitted from the ultrasonic wave transmitting unit 11 and reflected from each part of the heart.

  More specifically, the monitoring device as the image processing device 1 of the present embodiment is a three-dimensional ultrasonic diagnostic device. “Three-dimensional ultrasonic diagnostic apparatus” means an ultrasonic diagnostic apparatus capable of capturing a three-dimensional image. The three-dimensional ultrasonic diagnostic apparatus as the image processing apparatus 1 according to the present embodiment includes a three-dimensional ultrasonic probe 1a to be brought into contact with the body surface, and a device capable of communicating with the three-dimensional ultrasonic probe 1a by wire or wirelessly. And a main body 1b. The three-dimensional ultrasonic probe 1a includes an ultrasonic transmitting unit 11 and an ultrasonic receiving unit 12 of the imaging unit 2. The apparatus main body 1b includes an image forming unit 13 of the imaging unit 2. The image forming unit 13 includes a processor such as a CPU and an MPU.

  As shown in FIG. 2, the three-dimensional ultrasonic probe 1a is arranged on the skin near the ribs on the front of the body so that the ultrasonic waves can be transmitted and received between the ribs. In that state, an ultrasonic diagnosis is performed using the ultrasonic transmitting unit 11 and the ultrasonic receiving unit 12.

  The apparatus main body 1b acquires ultrasonic measurement information from the three-dimensional ultrasonic probe 1a. Next, the image forming unit 13 of the apparatus main body 1b forms a tomographic image of the heart based on the acquired ultrasonic measurement information.

  Thus, the imaging unit 2 can capture tomographic images at various cross sections of the heart. That is, the image forming unit 13 of the imaging unit 2 forms a tomographic image of the predetermined one plane based on the measurement information of the predetermined one plane received by the ultrasonic receiving unit 12. Further, the imaging unit 2 performs rendering by performing a process of stacking a plurality of tomographic images of the captured heart and a process of three-dimensional data serving as a basis of each tomographic image collected at the time of scanning for capturing a plurality of tomographic images. And a three-dimensional image of the heart can be taken. Specifically, the image forming unit 13 of the imaging unit 2 combines the plurality of tomographic images or processes the three-dimensional data collected when capturing each tomographic image, thereby forming a three-dimensional model of the heart. And an arbitrary three-dimensional image of the heart can be formed based on the three-dimensional model.

  FIG. 3 is a diagram illustrating an example of a three-dimensional image of the heart captured by the imaging unit 2. More specifically, FIG. 3 shows a state in which a cross-sectional image of the left ventricle LV of a three-dimensional model of the heart formed by the imaging unit 2 is displayed on the display unit 5. More specifically, FIG. 3 intersects a line segment connecting the aortic valve AV (see FIG. 2) and the apex Y of the left ventricle LV (see FIG. 2) at a predetermined angle (in the present embodiment, substantially orthogonal). 3) A cross-sectional image of a cross section, which is an image of the apex Y seen from the aortic valve AV side. When the three-dimensional model of the heart is formed by the imaging unit 2 as described above, not only the cross section shown in FIG. 3 but also a desired cross section of the heart can be displayed on the display unit 5 described later. In the present embodiment, as shown in FIG. 3, the operation is performed with a cross section intersecting a line segment connecting the aortic valve AV (see FIG. 2) and the apex Y of the left ventricle LV displayed on a display unit 5 described later. The monitoring may be performed. The monitoring of the operation may be performed based on a cross-sectional image of a cross section substantially parallel to a line connecting the aortic valve AV and the apex Y of the left ventricle LV.

  Further, the imaging unit 2 captures an image at predetermined time intervals. Specifically, the imaging unit 2 can capture a tomographic image at the same position every predetermined time and display the moving image on the display unit 5 over time. Further, the imaging unit 2 may capture a three-dimensional image of the heart (including a cross-sectional image formed from a three-dimensional model) from the same viewpoint at predetermined time intervals, and display the captured image on the display unit 5 over time as a moving image. it can. The imaging interval of the three-dimensional image (in this embodiment, substantially equal to the three-dimensional model formation interval) is set to, for example, 1 second, and the tomographic image, the three-dimensional image, and the like are displayed as a moving image on the display unit 5 at the same interval over time. By doing so, a tomographic image of the heart, a three-dimensional image, and the like can be monitored in real time. In other words, an image of the heart can be displayed on the display unit 5. However, FIG. 3 shows, as an example, only a cross-sectional image as a three-dimensional image of the heart formed from a three-dimensional model.

  The imaging interval of the three-dimensional image is not limited to one second and can be set as appropriate. It is preferable to perform imaging at the following intervals. Further, the time interval at which the tomographic image or the three-dimensional image displayed on the display unit 5 is switched over time may be the same as the imaging interval of the three-dimensional image, or may be a different interval. For example, when displaying only the tomographic image on the display unit 5 in real time, the imaging interval for capturing the tomographic image at the same position is set to 200 msec or the like, and the display on the display unit 5 is switched at the same interval as the imaging interval. The display may be switched at a time interval different from the imaging interval. As an example in which the display unit 5 is switched at a time interval different from the imaging interval, for example, a tomographic image displayed on the display unit 5 and a tomographic image not displayed on the display unit 5 are alternately captured at predetermined time intervals. Configuration. When only the three-dimensional image is displayed on the display unit 5 in real time, the imaging interval for imaging the three-dimensional image at the same position is set to 1 second or the like, and the display unit 5 displays the image at the same interval as the imaging interval. The display may be switched, or the display may be switched at a time interval different from the imaging interval. As an example in which the display unit 5 is switched at a time interval different from the imaging interval, for example, a three-dimensional image displayed on the display unit 5 and a three-dimensional image not displayed on the display unit 5 are alternately displayed at predetermined time intervals. There is a configuration for imaging.

  As described above, the monitoring device as the image processing device 1 according to the present embodiment displays a video image of the heart in real time and performs a treatment for administering a predetermined therapeutic substance by relying on the video image. Therefore, during this treatment, the three-dimensional ultrasonic probe 1a is fixed at a predetermined position on the body surface described above. The fixation of the three-dimensional ultrasonic probe 1a on the body surface can be realized by sticking to the body surface with an adhesive or the like.

  The acquisition unit 3 acquires outer diameter information of a tubular member 31 as a medical device inserted into the heart. Specifically, the acquisition unit 3 acquires the outer diameter information of the catheter as the tubular member 31 input by the input unit 6 described later. The outer diameter information of the tubular member 31 may be information that can specify the outer diameter of the tubular member 31, and is not limited to the outer diameter dimension. For example, information that can indirectly specify the outer diameter, such as the circumference, may be used. The acquisition unit 3 of the present embodiment is provided in the apparatus main body 1b, but may be provided in the three-dimensional ultrasonic probe 1a. The image processing apparatus 1 includes a processor 20 (see FIG. 1) including a CPU and an MPU. The processor 20 forms an acquisition unit 3 together with an image processing unit 4 described later.

  The image processing unit 4 corrects the contour of the tubular member 31 in the tomographic image of the heart or the three-dimensional heart image captured by the imaging unit 2 based on the outer diameter information of the tubular member 31 acquired by the acquiring unit 3. If the outer diameter information of the tubular member 31 can be acquired in advance, the contour of the tubular member 31 displayed in the tomographic image can be easily corrected. Further, if the outer diameter information of the tubular member 31 can be acquired in advance, the contour of the tubular member 31 displayed in the three-dimensional image of the heart can be easily corrected. More specifically, the image processing unit 4 according to the present embodiment performs a tubular process on an image based on outer diameter information of the tubular member 31 and scale information of an image such as a tomographic image or a three-dimensional image captured by the imaging unit 2. The contour of the member 31 is corrected. The scale information of the image captured by the imaging unit 2 includes, for example, ratio information between the actual distance and the image distance in the image between two predetermined points in the image. If the scale information of the image is obtained in this manner, the contour of the tubular member 31 displayed in the image can be corrected more clearly. The scale information of the image may be information acquired by a user operation of the operation unit 7 described later, or may be information stored in the storage unit 8 described later. The acquiring unit 3 acquires such scale information of the image by being input by the input unit 6 described later.

  The contour correction of the tubular member 31 in the tomographic image of the heart or the three-dimensional image of the heart should be executed based on other information in addition to the above outer diameter information and scale information from the viewpoint of improving the correction accuracy. Is preferred. As other information, for example, inner diameter information and wall thickness information of the tubular member 31 are given. Further, as described above, the image processing unit 4 can be configured by the processor 20 (see FIG. 1) configured by the CPU and the MPU.

  The display unit 5 can display a tomographic image in which the contour of the tubular member 31 has been corrected by the image processing unit 4. The display unit 5 can display a cross-sectional image of the heart formed from a three-dimensional model of the heart as a three-dimensional image of the heart, in which the contour of the tubular member 31 has been corrected by the image processing unit 4. The display unit 5 can be composed of, for example, a liquid crystal display or the like. The display unit 5 is provided on the apparatus main body 1b of the image processing apparatus 1, but may be provided on the three-dimensional ultrasonic probe 1a in addition to the apparatus main body 1b. Although the display unit 5 shown in FIG. 3 shows an example in which only a cross-sectional image of the heart formed from the three-dimensional model of the heart is displayed, a tomographic image of the heart and a three-dimensional image other than the cross-sectional image are simultaneously displayed. You can also.

  As described above, in the treatment exemplified here, the position and size of the infarct site X of the myocardium of the left ventricle LV have been acquired in advance using an MRI apparatus or an X-ray CT apparatus. Then, the tomographic image captured by the imaging unit 2 is displayed on the display unit 5, and a display indicating the position and size of the infarct site X is superimposed or combined on the displayed tomographic image. That is, in a real-time tomographic image that is switched to the latest state as needed, the position and size of the infarct site X to be treated or the vicinity thereof can be shown. Therefore, the actual treatment can be performed while confirming the position and size of the infarct site X, which is the target site of the treatment for administering the therapeutic substance, and the vicinity thereof in the tomographic image in real time.

  Further, in addition to the above-described tomographic image, a three-dimensional image of the heart captured by the imaging unit 2 can be displayed on the display unit 5 as shown in FIG. The display indicating the position and size of X is superimposed or combined (see FIG. 3).

  Further, when the therapeutic substance is administered to or near the infarct site X displayed in the above-mentioned tomographic image and three-dimensional image, the therapeutic substance is administered, for example, by displaying a predetermined mark at the administration position. The display which makes the position which can be identified be displayed on the display unit 5. This makes it easy for a medical worker such as a doctor to grasp the progress of the treatment while checking the image processing apparatus 1.

  The input unit 6 inputs the outer diameter information of the tubular member 31 to the acquisition unit 3. Specifically, the input unit 6 inputs the outer diameter information of the tubular member 31 received by the operation unit 7 described later to the acquisition unit 3. Further, the input unit 6 inputs the outer diameter information of the tubular member 31 stored in the storage unit 8 described later to the acquisition unit 3. As described above, the input unit 6 can input the outer diameter information of the tubular member 31 to the acquisition unit 3 from the operation unit 7 and the storage unit 8. The input unit 6 is also configured by the processor 20 (see FIG. 1), like the acquisition unit 3 and the image processing unit 4 described above.

  The operation unit 7 is a part that receives an operation by a user. The operation unit 7 can be configured by, for example, various user interfaces such as switches and a liquid crystal touch panel provided on an outer wall of the apparatus main body 1b of the image processing apparatus 1.

  The storage unit 8 is a unit that stores outer diameter information of the tubular member. The storage unit 8 can be configured by a memory such as a ROM (abbreviation of Read Only Memory) or a RAM (abbreviation of Random Access Memory).

  The control unit 9 performs the above-described operation at a predetermined timing with respect to each of the above-described imaging unit 2, acquisition unit 3, image processing unit 4, display unit 5, input unit 6, operation unit 7, and storage unit 8. Tell them to do it. The control unit 9 reads, for example, an image processing program stored in the storage unit 8 and causes the image processing unit 4 to execute image processing. The control unit 9 includes a processor 20 (see FIG. 1) such as an MPU or a CPU, similarly to the acquisition unit 3, the image processing unit 4, and the input unit 6 described above. The acquisition unit 3, the image processing unit 4, the input unit 6, and the control unit 9 are configured by a single processor 20, but may be configured by a plurality of processors.

  As described above, according to the image processing apparatus 1 described above, the image processing method shown in the flowchart in FIG. 4 is executed. Specifically, the image processing method performed by the image processing apparatus 1 includes an imaging step S1 of capturing an image of the heart from the body surface, an acquisition step S2 of acquiring the outer diameter information of the tubular member 31 inserted into the heart, An image processing step S3 of correcting the contour of the tubular member 31 in the image captured in the imaging step S1 based on the outer diameter information of the member 31. Since the processing in each of the steps S1 to S3 is as described above, the description is omitted here.

  The image processing device and the image processing method according to the present disclosure are not limited to the specific configurations and processes described in the above embodiments, and various changes and modifications can be made without departing from the scope of the claims. For example, the contour of the tubular member 31 in the image may be corrected using various information such as outer diameter information and shape information of the puncture member as a medical device delivered into the heart through the tubular member 31. The puncture member is punctured into the myocardium and is used when injecting a therapeutic substance into the myocardium. Therefore, the puncture member is reflected together with the tubular member 31 in the cross-sectional image of the heart (see FIG. 3). Therefore, various types of information on the puncturing member may be acquired and used for correcting the contour of the tubular member 31. The various information of the puncture member is acquired by the acquisition unit 3, for example, like the outer shape information of the tubular member 31.

  Further, in the above-described embodiment, a cross section substantially orthogonal to a straight line segment connecting the aortic valve AV (see FIG. 2) and the apex Y (see FIG. 2) of the left ventricle LV (see FIGS. 2 and 3). In the cross-sectional image (see FIG. 3), the contour of the tubular member 31 is corrected. However, in a tomographic image of the heart or a cross-sectional image of the heart at a position different from that in FIG. May be corrected. Furthermore, in the above-described embodiment, the contour of the tubular member 31 in the ultrasonic image is corrected, but a similar method may be applied to the contour correction of the tubular member 31 in an image other than the ultrasonic image. However, in realizing real-time monitoring, it is preferable to use the ultrasonic image shown in the above-described embodiment.

  In the above-described embodiment, the image processing apparatus 1 is configured to include the imaging unit 2. However, the image processing apparatus 1 does not include the imaging unit 2, and acquires an image of the heart captured by an external imaging device and executes image processing. The image processing apparatus may be an image processing apparatus. In such a case, the acquisition unit 3 of the image processing device 1 may acquire heart image data from an external imaging device.

  Hereinafter, an image processing apparatus and an image processing method different from the image processing apparatus and the image processing method described above will be described as examples.

  There is a case where a medical instrument is inserted into a blood vessel, a heart, or the like, and diagnosis or treatment is performed while detecting the position of the medical instrument inside the body using an extracorporeal three-dimensional ultrasonic diagnostic apparatus. Patent Document 2 discloses an ultrasonic diagnostic apparatus used for this type of diagnosis.

  The ultrasonic diagnostic apparatus described in Patent Literature 2 includes an ultrasonic generating unit that generates an ultrasonic wave near a distal end, and transmits and receives ultrasonic waves to and from a catheter or a small-diameter probe inserted into the subject. An ultrasonic probe in which a plurality of ultrasonic transducers that wave are arranged two-dimensionally. Further, the ultrasonic diagnostic apparatus described in Patent Document 2 includes a first transmission driving unit that generates a driving signal so that an ultrasonic probe performs ultrasonic transmission for generating an ultrasonic image, and an ultrasonic generation unit. Second transmission driving means for generating a drive signal so as to perform ultrasonic transmission for position detection a plurality of times, an ultrasonic reception signal based on a plurality of ultrasonic waves for position detection are added, and based on the reception signal after the addition, Position calculating means for obtaining position information of the catheter or the small diameter probe. Further, the ultrasonic diagnostic apparatus described in Patent Literature 2 includes an ultrasonic image generating unit that generates an ultrasonic image based on an ultrasonic reception signal corresponding to ultrasonic transmission for generating an ultrasonic image, and a catheter or a thin film. Display means for displaying the position of the catheter or the small diameter probe together with the ultrasonic image based on the position information of the diameter probe.

  In the ultrasonic diagnostic apparatus described in Patent Literature 2, an insertion unit such as a catheter or a small-diameter probe inserted into a lumen such as a blood vessel or a bile duct includes an ultrasonic generation unit that generates an ultrasonic wave near a distal end. When performing the diagnosis or treatment by inserting the insertion means, the ultrasonic waves emitted from the insertion means can be used. Therefore, according to the ultrasonic diagnostic apparatus described in Patent Document 2, the position of the insertion means in the body can be more accurately determined. Can be identified. However, when the insertion means in the heart is displayed on an image such as an ultrasonic image in real time, and diagnosis or treatment in the heart is performed while monitoring the image, not only the position of the insertion means in the heart, It is desirable to clearly display the contour of the insertion means in the heart, and it is difficult to correct the contour of the insertion means in an image with the ultrasonic diagnostic apparatus described in Patent Document 2.

  According to the image processing apparatus and the image processing method described below, it is easy to realize the contour correction of the insertion member in the captured heart image.

  FIG. 5 is a block diagram illustrating an image processing device set 1100 as one embodiment of the image processing device set according to the present disclosure. The image processing device set 1100 illustrated in FIG. 5 includes an image processing device 1001 as one embodiment of the image processing device according to the present disclosure, and an insertion member 1031 that is inserted into a heart. FIG. 6 is a schematic diagram illustrating an outline of a treatment performed using the image processing apparatus set 1100.

  As shown in FIG. 6, the image processing apparatus 1001 of the present embodiment delivers a medical device into a heart through a blood vessel and performs a predetermined diagnosis or treatment in the heart. This is a monitoring device that can monitor the state inside the heart. The monitoring device as the image processing device 1001 monitors, for example, the position and contour in the left ventricle LV of the catheter as the insertion member 1031 inserted from the femoral artery FA into the left ventricle LV through the aorta AO and the aortic valve AV. Display as possible. A medical worker such as a doctor relies on the position and contour of the insertion member 1031 in the left ventricle LV displayed on the monitoring device as the image processing device 1001, and various types of medicine delivered into the left ventricle LV through the insertion member 1031. An operation such as a predetermined diagnosis or treatment is performed using a medical instrument.

  The predetermined treatment performed in the left ventricle LV includes, for example, a treatment in which various therapeutic substances are administered into the myocardium for treating a heart disease or the like. Examples of various therapeutic substances include substances that can provide therapeutic effects such as cell replenishment, induction of angiogenesis, reinforcement of the heart wall, scaffolding materials, or tissue repair or regeneration by preventing apoptosis / necrosis. Or a polymer or the like. Cells as a therapeutic substance are administered into the myocardium in the form of a cell suspension dispersed in a liquid such as physiological saline.

  Cells as therapeutics include, for example, adherent cells (adherent cells). Adherent cells include, for example, adherent somatic cells (eg, cardiomyocytes, fibroblasts, epithelial cells, endothelial cells, hepatocytes, pancreatic cells, kidney cells, adrenal cells, periodontal ligament cells, gingival cells, periosteal cells, skin Cells, synovial cells, chondrocytes, etc.) and stem cells (eg, tissue stem cells such as myoblasts, cardiac stem cells, embryonic stem cells, pluripotent stem cells such as iPS (induced pluripotent stem) cells, mesenchymal stem cells, etc.) Including. The somatic cells may be stem cells, particularly cells differentiated from iPS cells. Non-limiting examples of cells as therapeutic agents include, for example, myoblasts (eg, skeletal myoblasts), mesenchymal stem cells (eg, bone marrow, adipose tissue, peripheral blood, skin, hair root, muscle tissue, uterus Intima, placenta, cord blood-derived cells), cardiomyocytes, fibroblasts, cardiac stem cells, embryonic stem cells, iPS cells, synovial cells, chondrocytes, epithelial cells (eg, oral mucosal epithelial cells, retinal pigment epithelium) Cells, nasal mucosal epithelial cells, etc.), endothelial cells (eg, vascular endothelial cells, etc.), hepatocytes (eg, liver parenchymal cells, etc.), pancreatic cells (eg, pancreatic islet cells, etc.), renal cells, adrenal cells, periodontal ligament cells Gingival cells, periosteal cells, skin cells and the like.

  Drugs as therapeutic agents include, for example, proteins, plasmids, genes, growth factors, chemoattractants, synthetic polypeptides, various pharmaceutical compositions, and the like, and other therapeutically beneficial substances alone, Alternatively, it can be included in any combination.

  Polymers as therapeutic substances include injectable, biocompatible single or multi-component materials, polymer-based beads, polymer hydrogels, fibrin adhesives, synthetic polymeric materials such as collagen, alginate, polyethylene glycol, and the like, and Chitosan and the like.

  In the present embodiment, as shown in FIG. 6, a treatment in which a therapeutic substance is administered from the inside of the left ventricle LV to or near the infarct site X of the myocardium of the left ventricle LV is monitored by the monitoring device as the image processing device 1001. An example of performing the treatment while monitoring is performed by a monitoring device as the image processing device 1001. The treatment performed while monitoring is not limited to the administration of a predetermined therapeutic substance. For example, a treatment for diagnosing an infarction state of the myocardium of the left ventricle LV. And so on. The infarct site X of the myocardium in the left ventricle LV is obtained by acquiring a tomographic image of the heart from outside the body using a magnetic resonance imaging device (hereinafter, referred to as an MRI device) or an X-ray computed tomography device (hereinafter, referred to as an X-ray CT device). Can be specified in advance from the acquired tomographic image.

  Further, the monitoring device as the image processing device 1001 of the present embodiment is not limited to the device that enables monitoring of the treatment in the left ventricle LV (see FIG. 6), and may be any one of the right ventricle, the left atrium, and the right atrium. It is good also as a device which can monitor the treatment performed inside the body from outside the body. As described later, the image processing apparatus 1001 of the present embodiment is a three-dimensional ultrasonic diagnostic apparatus. Therefore, a tomographic image in a different cross section can be acquired in any of the left ventricle LV, the right ventricle, the left atrium, and the right atrium, and monitoring can be performed by using these tomographic images.

  Hereinafter, details of the image processing apparatus 1001 of the present embodiment will be described.

  As shown in FIG. 5, the image processing device 1001 includes an imaging unit 1002, an image processing unit 1003, a display unit 1004, an operation unit 1005, a storage unit 1006, and a control unit 1007.

  The imaging unit 1002 can capture a tomographic image of the heart as a heart image and a three-dimensional image of the heart from the body surface.

  Specifically, the imaging unit 1002 includes an ultrasonic transmitting unit 1011 that transmits an ultrasonic wave, an ultrasonic receiving unit 1012 that receives an ultrasonic wave, and an ultrasonic wave as measurement information of the ultrasonic wave received by the ultrasonic receiving unit 1012. And an image forming unit 1013 that forms a tomographic image from the sound wave data. The ultrasonic wave receiving unit 1012 receives the ultrasonic wave transmitted from the ultrasonic wave transmitting unit 1011 and reflected from each part of the heart.

  More specifically, the monitoring device as the image processing device 1001 of the present embodiment is a three-dimensional ultrasonic diagnostic device. “Three-dimensional ultrasonic diagnostic apparatus” means an ultrasonic diagnostic apparatus capable of capturing a three-dimensional image. The three-dimensional ultrasonic diagnostic apparatus as the image processing apparatus 1001 according to the present embodiment includes a three-dimensional ultrasonic probe 1001a to be brought into contact with the body surface, and a device capable of communicating with the three-dimensional ultrasonic probe 1001a by wire or wirelessly. And a main body 1001b. The three-dimensional ultrasonic probe 1001a includes an ultrasonic transmitting unit 1011 and an ultrasonic receiving unit 1012 of the imaging unit 1002. The apparatus main body 1001b includes an image forming unit 1013 of the imaging unit 1002. The image forming unit 1013 includes a processor such as a CPU and an MPU.

  As shown in FIG. 6, the three-dimensional ultrasonic probe 1001a is arranged on the skin near the ribs on the front surface of the body so that the ultrasonic waves can be transmitted and received between the ribs. In that state, an ultrasonic diagnosis is performed using the ultrasonic transmitting unit 1011 and the ultrasonic receiving unit 1012.

  The apparatus main body 1001b acquires ultrasonic measurement information from the three-dimensional ultrasonic probe 1001a. Next, the image forming unit 1013 of the apparatus main body 1001b forms a tomographic image of the heart based on the acquired ultrasonic measurement information.

  The imaging unit 1002 can thus capture tomographic images at various cross sections of the heart. That is, the image forming unit 1013 of the imaging unit 1002 forms a tomographic image of the predetermined one plane based on the measurement information of the predetermined one plane received by the ultrasonic receiving unit 1012. Further, the imaging unit 1002 performs rendering by stacking a plurality of tomographic images of the captured heart and by processing three-dimensional data that is the basis of each tomographic image collected at the time of scanning to capture a plurality of tomographic images. And a three-dimensional image of the heart can be taken. Specifically, the image forming unit 1013 of the imaging unit 1002 combines the plurality of tomographic images or processes the three-dimensional data collected when capturing each tomographic image, thereby forming a three-dimensional model of the heart. And an arbitrary three-dimensional image of the heart can be formed based on the three-dimensional model.

  FIG. 7 is a diagram illustrating an example of a three-dimensional image of the heart captured by the imaging unit 1002. More specifically, FIG. 7 illustrates a state in which a cross-sectional image of the left ventricle LV of the three-dimensional model of the heart formed by the imaging unit 1002 is displayed on the display unit 1004. More specifically, FIG. 7 intersects a line segment connecting the aortic valve AV (see FIG. 6) and the apex Y of the left ventricle LV (see FIG. 6) at a predetermined angle (in the present embodiment, substantially orthogonal). 3) A cross-sectional image of a cross section, which is an image of the apex Y seen from the aortic valve AV side. As described above, if the three-dimensional model of the heart is formed by the imaging unit 1002, not only the cross section shown in FIG. 7 but also a desired cross section of the heart can be displayed on the display unit 1004 described later. In the present embodiment, as shown in FIG. 7, the operation is performed in a state in which a cross section that intersects with a line connecting the aortic valve AV (see FIG. 6) and the apex Y of the left ventricle LV is displayed on a display unit 1004 described later. The monitoring may be performed. The monitoring of the operation may be performed based on a cross-sectional image of a cross section substantially parallel to a line connecting the aortic valve AV and the apex Y of the left ventricle LV.

  Further, the imaging unit 1002 captures an image every predetermined time. Specifically, the imaging unit 1002 can capture a tomographic image at the same position every predetermined time and display the tomographic image on the display unit 1004 with time as a moving image. Further, the imaging unit 1002 can capture a three-dimensional image of the heart (including a cross-sectional image formed from a three-dimensional model) from the same viewpoint at predetermined time intervals, and display it as a moving image on the display unit 1004 over time. it can. The imaging interval of the three-dimensional image (substantially equal to the three-dimensional model formation interval in the present embodiment) is set to, for example, 1 second, and the tomographic image, the three-dimensional image, and the like are displayed as a moving image on the display unit 1004 at the same interval over time. By doing so, a tomographic image of the heart, a three-dimensional image, and the like can be monitored in real time. In other words, an image of the heart can be displayed on the display unit 1004. However, FIG. 7 shows only a cross-sectional image as a three-dimensional image of the heart formed from a three-dimensional model as an example.

  The imaging interval of the three-dimensional image is not limited to one second and can be set as appropriate. It is preferable to perform imaging at the following intervals. The time interval at which the tomographic image or the three-dimensional image displayed on the display unit 1004 is changed over time may be the same as the imaging interval of the three-dimensional image, or may be different. For example, when only a tomographic image is displayed on the display unit 1004 in real time, the imaging interval for capturing the tomographic image at the same position is set to 200 msec or the like, and the display of the display unit 1004 is switched at the same interval as the imaging interval. The display may be switched at a time interval different from the imaging interval. As an example in which the display unit 1004 is switched at a time interval different from the imaging interval, for example, a tomographic image displayed on the display unit 1004 and a tomographic image not displayed on the display unit 1004 are alternately captured at predetermined time intervals. Configuration. When only the three-dimensional image is displayed on the display unit 1004 in real time, the imaging interval for imaging the three-dimensional image at the same position is set to 1 second, and the display unit 1004 is displayed at the same interval as the imaging interval. The display may be switched, or the display may be switched at a time interval different from the imaging interval. As an example in which the display unit 1004 is switched at a time interval different from the imaging interval, for example, a three-dimensional image to be displayed on the display unit 1004 and a three-dimensional image not to be displayed on the display unit 1004 are alternately arranged at predetermined time intervals. There is a configuration for imaging.

  As described above, the monitoring apparatus serving as the image processing apparatus 1001 of the present embodiment displays an image of the heart in real time and performs a treatment for administering a predetermined therapeutic substance by relying on the image. Therefore, during this treatment, the three-dimensional ultrasonic probe 1001a is fixed at the above-described predetermined position on the body surface. The fixation of the three-dimensional ultrasonic probe 1001a on the body surface can be realized by sticking to the body surface with an adhesive or the like.

  The imaging unit 1002 includes a receiving device 1002a. The receiving device 1002a receives a plurality of pieces of position information transmitted from the insertion member 1031 as described later. The plurality of pieces of position information transmitted from the insertion member 1031 of the present embodiment are ultrasonic signals as described later. Therefore, the receiving device 1002a of the present embodiment is an ultrasonic receiving device that receives an ultrasonic signal transmitted from the insertion member 1031. And the ultrasonic receiving apparatus as the receiving apparatus 1002a of this embodiment is provided in the three-dimensional ultrasonic probe 1001a. More specifically, the ultrasonic receiving device as the receiving device 1002a of the present embodiment configures the ultrasonic receiving unit 1012. In other words, the ultrasonic receiving device as the receiving device 1002a of the present embodiment transmits the ultrasonic wave from the ultrasonic receiving unit 1012 that receives the ultrasonic measurement information when capturing a tomographic image and the insertion member 1031 that is located in the heart. And a receiving unit for receiving location information.

  The image processing unit 1003 corrects the contour of the insertion member 1031 inserted into the heart in the image of the heart captured by the imaging unit 1002. Specifically, the image processing unit 1003 corrects the contour of the insertion member 1031 in the image based on a plurality of pieces of position information of the insertion member 1031 received by the receiving device 1002a. More specifically, the image processing unit 1003 corrects the contour of the insertion member 1031 in the image based on a difference between reception timings of a plurality of pieces of position information received by the receiving device 1002a. Here, the “plurality of position information” of the insertion member 1031 is position information indicating a different position of the insertion member 1031 at an arbitrary timing. If the positional relationship between different parts of the insertion member 1031 can be specified, the contour of the insertion member 1031 in the image can be corrected so as to match the positional relationship. As described above, by using the difference in the reception timing, it is possible to specify the positional relationship between different parts set in advance. A specific example of the “plurality of position information” will be described later.

  The image processing unit 1003 of the present embodiment, based on a plurality of pieces of position information of the above-described insertion member 1031 and scale information of an image such as a tomographic image or a three-dimensional image captured by the imaging unit 1002, inserts the insertion member 1031 in the image. To correct the outline. The scale information of the image captured by the imaging unit 1002 includes, for example, ratio information between the actual distance and the image distance in the image between two predetermined points in the image. If the scale information of the image is obtained in this way, the contour of the insertion member 1031 displayed in the image can be corrected more clearly. The scale information of the image may be information acquired by a user operation of the operation unit 1005 described later, or may be information stored in a storage unit 1006 described later.

  The contour correction of the insertion member 1031 in the tomographic image of the heart or the three-dimensional image of the heart is executed based on other information in addition to the above-described plurality of position information and scale information from the viewpoint of improving the correction accuracy. Is preferred. As other information, for example, length information of the insertion member 1031 may be mentioned.

  The image processing unit 1003 can be configured by a processor 1020 (see FIG. 5) configured by a CPU or an MPU.

  The display unit 1004 can display a tomographic image in which the contour of the insertion member 1031 has been corrected by the image processing unit 1003. The display unit 1004 can display a cross-sectional image of the heart formed from a three-dimensional model of the heart as a three-dimensional image of the heart in which the contour of the insertion member 1031 has been corrected by the image processing unit 1003. The display unit 1004 can be configured with, for example, a liquid crystal display or the like. The display unit 1004 is provided on the apparatus main body 1001b of the image processing apparatus 1001, but may be provided on the three-dimensional ultrasonic probe 1001a in addition to the apparatus main body 1001b. Although the display unit 1004 illustrated in FIG. 7 illustrates an example in which only a cross-sectional image of the heart formed from the three-dimensional model of the heart is displayed, a tomographic image of the heart and a three-dimensional image other than the cross-sectional image are simultaneously displayed. You can also.

  As described above, in the treatment exemplified here, the position and size of the infarct site X of the myocardium of the left ventricle LV (see FIG. 6 and the like) are acquired in advance using an MRI apparatus or an X-ray CT apparatus. . Then, the tomographic image captured by the imaging unit 1002 is displayed on the display unit 1004, and a display indicating the position and size of the infarct site X is superimposed or synthesized on the displayed tomographic image. That is, in a real-time tomographic image that is switched to the latest state as needed, the position and size of the infarct site X to be treated or the vicinity thereof can be shown. Therefore, the actual treatment can be performed while confirming the position and size of the infarct site X, which is the target site of the treatment for administering the therapeutic substance, and the vicinity thereof in the tomographic image in real time.

  Further, in addition to the above-described tomographic image, the display unit 1004 can display a three-dimensional image of the heart captured by the imaging unit 1002 as shown in FIG. The display indicating the position and size of X is superimposed or combined (see FIG. 7).

  Further, when the therapeutic substance is administered to or near the infarct site X displayed in the above-mentioned tomographic image and three-dimensional image, the therapeutic substance is administered, for example, by displaying a predetermined mark at the administration position. The display unit 1004 causes the display unit 1004 to display a display that allows the position to be identified. This makes it easy for a medical worker such as a doctor to grasp the progress of the treatment while checking the image processing apparatus 1001.

  The operation unit 1005 is a part that receives an operation by a user. The operation unit 1005 can be configured by, for example, various user interfaces such as a switch and a liquid crystal touch panel provided on the outer wall of the apparatus main body 1001b of the image processing apparatus 1001.

  The storage unit 1006 is a part that stores the positional relationship between different parts of the insertion member 1031 set in advance and the contour shape of the insertion member 1031 corresponding to the positional relationship in association with each other. The storage unit 1006 can be configured by a memory such as a ROM (abbreviation of Read Only Memory) or a RAM (abbreviation of Random Access Memory).

  The control unit 1007 instructs the above-described imaging unit 1002, image processing unit 1003, display unit 1004, operation unit 1005, and storage unit 1006 to execute the above-described operation at a predetermined timing. The control unit 1007 reads, for example, an image processing program stored in the storage unit 1006, and causes the image processing unit 1003 to execute image processing. The control unit 1007 includes a processor 1020 (see FIG. 5) such as an MPU or a CPU, similarly to the image processing unit 1003 described above. The image processing unit 1003 and the control unit 1007 may be configured by a single processor 1020 or may be configured by a plurality of processors.

  Next, the insertion member 1031 of the image processing apparatus set 1100 will be described.

  The insertion member 1031 is a member inserted into the heart. The insertion member 1031 of this embodiment includes a transmitting device 1031a that transmits a plurality of pieces of position information. More specifically, the insertion member 1031 of the present embodiment includes a tubular member 1031b inserted into the heart, and the above-described transmitting device 1031a is attached to the outer peripheral surface of the tubular member 1031b. Further, in the present embodiment, a plurality of transmitting devices 1031a are attached to different positions in the circumferential direction of the tubular member 1031b. The plurality of pieces of position information of the insertion member 1031 are respectively transmitted from the plurality of transmitting devices 1031a attached at different positions. Therefore, the outer diameter information of the tubular member 1031b can be acquired from the position information transmitted from each of the plurality of transmitting devices 1031a. The outer diameter information of the tubular member 1031b may be any information that can specify the outer diameter of the tubular member 1031b, and is not limited to the outer diameter dimension. For example, information that can indirectly specify the outer diameter, such as the circumference, may be used. By using this outer diameter information, the contour of the tubular member 1031b in the image can be corrected. The transmitting device 1031a according to the present embodiment is capable of transmitting an ultrasonic signal, and transmits an ultrasonic signal as position information.

  In the present embodiment, as the “plurality of position information” of the insertion member 1031, the outer diameter information of the insertion member 1031 is acquired by using the position information of different positions in the circumferential direction of the tubular member 1031 b. The information of the insertion member 1031 that can be used for correcting the contour of the member 1031 is not limited to the outer diameter information.

  Although the insertion member 1031 of the present embodiment includes the tubular member 1031b, the insertion member 1031 is not limited to the configuration including the tubular member 1031b. For example, another insertion device such as a treatment device delivered to a target site through a tubular member such as a catheter. It may be a medical device.

  As described above, according to the above-described image processing apparatus 1001, the image processing method illustrated by the flowchart in FIG. 8 is executed. Specifically, the image processing method by the image processing apparatus 1001 includes a receiving step S1 for receiving a plurality of pieces of position information transmitted from the insertion member 1031 inserted into the heart, and an imaging step for capturing an image of the heart from the body surface. S2 and an image processing step S3 of correcting the contour of the insertion member 1031 in the heart in the image based on a plurality of pieces of position information transmitted from the insertion member 1031. Since the processing in each of the steps S1 to S3 is as described above, the description is omitted here.

  The image processing apparatus 1001, the image processing apparatus set 1100, and the image processing method that can be executed by the image processing apparatus 1001 are not limited to the specific configurations and processes described above, and various changes and modifications are possible. For example, in addition to a plurality of pieces of positional information of a tubular device (for example, a catheter) as the insertion member 1031, outer diameter information and shape of a puncture member as a medical device delivered into the heart through the tubular device as the insertion member 1031 The outline of the insertion member 1031 in the image may be corrected using various information such as information. The puncture member is punctured into the myocardium and is used when injecting a therapeutic substance into the myocardium, and is used by projecting from a distal end opening of a tubular device as the insertion member 1031. Therefore, the puncture member appears in the cross-sectional image of the heart (see FIG. 7) together with the tubular device as the insertion member 1031. Therefore, various types of information on the puncture member may be obtained and used for contour correction of the insertion member 1031. The various information of the puncturing member may be input from the operation unit 1005 or may be stored in the storage unit 1006, for example.

  Further, in the above-described embodiment, a cross-sectional image of a cross section substantially orthogonal to a line segment connecting the aortic valve AV (see FIG. 6) and the apex Y (see FIG. 6) of the left ventricle LV (see FIGS. 6 and 7). 7 (see FIG. 7), the contour of the insertion member 1031 is corrected. In a tomographic image of the heart or a cross-sectional image of the heart at a position different from that in FIG. It may be corrected.

As described above, the image processing apparatus 1001 described above
(1): an image pickup unit 1002 capable of picking up an image of the heart from the body surface, and an image processing unit 1003 for correcting the contour of the insertion member 1031 inserted into the heart in the image, The imaging unit 1002 includes a receiving device 1002a that receives a plurality of pieces of position information transmitted from the insertion member 1031. The image processing unit 1003 performs, based on the plurality of pieces of position information received by the receiving device 1002a, The contour of the insertion member 1031 in the image is corrected.

(2): In the image processing device 1001 according to (1), the image processing unit 1003 performs the insertion in the image based on a difference between reception timings of the plurality of pieces of position information received by the reception device 1002a. The contour of the member 1031 is corrected.

(3): In the image processing apparatus 1001 according to (1) or (2), the imaging unit 1002 includes an ultrasonic transmission unit 1011 that transmits ultrasonic waves and an ultrasonic reception unit 1012 that receives ultrasonic waves. And an image forming unit 1013 that forms the image from the measurement information received by the ultrasonic receiving unit 1012.

(4): In the image processing device 1001 according to (3), the plurality of pieces of position information is an ultrasonic signal, the receiving device 1002a is an ultrasonic receiving device that receives the ultrasonic signal, An ultrasonic receiving device constitutes the ultrasonic receiving unit 1012.

(5): In the image processing device 1001 according to any one of (1) to (4), the imaging unit 1002 captures the image at predetermined time intervals.

(6) The image processing device 1001 according to any one of (1) to (5), further including a display unit 1004 capable of displaying the image corrected by the image processing unit 1003.

Further, the image processing apparatus set 1100 described above includes:
(7): The image processing device 1001 according to (1) to (6), and the insertion member 1031 that includes the transmission device 1031a that transmits the plurality of pieces of position information and is inserted into the heart. Prepare.

(8): In the image processing device set 1100 according to (7), the insertion member 1031 includes a tubular member 1031b inserted into the heart, and the transmission device 1031a includes an outer peripheral surface of the tubular member 1031b. Attached to.

(9): In the image processing device set 1100 according to (8), a plurality of the transmitting devices 1031a are attached to different positions in a circumferential direction of the tubular member 1031b, and the plurality of position information is It is transmitted from a plurality of transmitting devices 1031a.

Further, the above-described image processing apparatus 1001 executes the following image processing method (10).
(10): a receiving step S1 for receiving a plurality of pieces of positional information transmitted from the insertion member 1031 inserted into the heart, an imaging step S2 for capturing an image of the heart from a body surface, and the inside of the heart in the image. An image processing step S3 of correcting the contour of the insertion member 1031 based on the plurality of pieces of position information.

  Further, another image processing device may be configured by appropriately combining the components of the image processing device 1 described above and the components of the image processing device 1001 described above. Further, the components of the image processing device 1 may have the functions of the components of the image processing device 1001. For example, the image processing unit 4 of the image processing apparatus 1 may be configured to have the function of the image processing unit 1003 of the image processing apparatus 1001. Therefore, for example, the components of the image processing device 1 and the image processing device 1001 described above are combined, and the functions of a plurality of components are combined into one component as needed, and the above-described image processing device 1 And an image processing apparatus having both functions of the image processing apparatus 1001.

  The present disclosure relates to an image processing device and an image processing method.

1: image processing apparatus 1a: three-dimensional ultrasonic probe 1b: apparatus main body 2: imaging section 3: acquisition section 4: image processing section 5: display section 6: input section 7: operation section 8: storage section 9: control section 11 : Ultrasound transmitting unit 12: Ultrasonic receiving unit 13: Image forming unit 20: Processor 31: Tubular member 1001: Image processing device 1001 a: Three-dimensional ultrasonic probe 1001 b: Device main body 1002: Imaging unit 1002 a: Receiving device 1003: Image Processing unit 1004: display unit 1005: operation unit 1006: storage unit 1007: control unit 1011: ultrasonic transmission unit 1012: ultrasonic reception unit 1013: image forming unit 1020: processor 1031: insertion member 1031a: transmission device 1031b: tubular member 1100: Image processing device set AO: aorta AV: aortic valve FA: femoral artery LV: left ventricle X: infarct site Y: apex

Claims (10)

An imaging unit that can capture an image of the heart from the body surface,
An acquisition unit for acquiring outer diameter information of a tubular member inserted into the heart,
An image processing apparatus comprising: an image processing unit that corrects an outline of the tubular member in the image based on the outer diameter information acquired by the acquisition unit.   The image processing device according to claim 1, wherein the image processing unit corrects an outline of the tubular member in the image based on the outer diameter information and scale information of the image. The imaging unit,
An ultrasonic transmitter for transmitting ultrasonic waves,
An ultrasonic receiving unit that receives ultrasonic waves,
The image processing apparatus according to claim 1, further comprising: an image forming unit configured to form the image based on the measurement information received by the ultrasonic receiving unit.   The image processing device according to claim 1, wherein the imaging unit captures the image at predetermined time intervals.   The image processing apparatus according to claim 1, further comprising a display unit that can display the image corrected by the image processing unit.   The image processing apparatus according to claim 1, further comprising an input unit configured to input the outer diameter information to the acquisition unit. An operation unit that accepts user operations is provided,
The image processing device according to claim 6, wherein the input unit inputs the outer diameter information received by the operation unit to the acquisition unit. A storage unit for storing the outer diameter information,
The image processing device according to claim 6, wherein the input unit inputs the outer diameter information stored in the storage unit to the acquisition unit. An acquisition unit that acquires outer diameter information of a tubular member inserted into the heart,
An image processing apparatus comprising: an image processing unit that corrects a contour of the tubular member in an image of a heart captured from a body surface based on the outer diameter information acquired by the acquisition unit. An imaging step of capturing an image of the heart from the body surface,
An acquisition step of acquiring outer diameter information of a tubular member inserted into the heart,
An image processing step of correcting a contour of the tubular member in the image based on the outer diameter information.

Images