WO2018212248A1

WO2018212248A1 - Image processing device and image processing method

Info

Publication number: WO2018212248A1
Application number: PCT/JP2018/018975
Authority: WO
Inventors: 康之本間; 直矢嶋田
Original assignee: テルモ株式会社
Priority date: 2017-05-16
Filing date: 2018-05-16
Publication date: 2018-11-22
Also published as: JPWO2018212248A1

Abstract

This image processing device is provided with an imaging unit which can capture an image of the heart from the body surface, an acquisition unit which acquires external diameter information of a tubular member inserted into the heart, and an image processing unit which, on the basis of the external diameter information acquired by the acquisition unit, corrects the contour of the tubular member in the image.

Description

Image processing apparatus and image processing method

The present disclosure relates to an image processing apparatus and an image processing method.

Conventionally, it is known that a medical instrument is inserted into a blood vessel, a heart, or the like, and a diagnosis or treatment is performed while detecting the position of the medical instrument in the body using an external three-dimensional ultrasonic diagnostic apparatus. . Patent Document 1 describes a medical system that performs this type of diagnosis.

The medical system described in Patent Document 1 includes a medical instrument including a needle that is inserted into a target body and removes a lesion in the target body, and a vibration application unit that applies vibration to the needle. The medical system described in Patent Literature 1 includes an ultrasonic data acquisition unit that transmits an ultrasonic signal to a target body, receives an ultrasonic echo signal reflected from the target body, and acquires ultrasonic data. Furthermore, the medical system described in Patent Document 1 is connected to a medical instrument and an ultrasonic data acquisition unit, forms a plurality of ultrasonic images using the ultrasonic data, and performs motion tracking on each of the plurality of ultrasonic images. To detect the position of the needle and to perform image processing for improving the image quality of the ultrasonic image based on the detected position of the needle on a plurality of ultrasonic images.

JP 2012-105948 A JP 2001-299756 A

Ultrasound images can be obtained in real time, but in the case of ultrasound images, it is difficult to clearly identify the position and contour of a medical device such as a needle due to attenuation of the ultrasound. It is difficult to perform a diagnosis or treatment by operating a medical instrument while confirming a sound image. On the other hand, in the medical system described in Patent Document 1, motion tracking is performed to detect the position of the needle, and image processing is performed to improve the image quality of the ultrasound image based on the detected position of the needle. ing. However, there is still room for improvement in the accuracy of the contour correction of the medical device in the ultrasound image and the image that is the basis thereof.

This disclosure is intended to provide an image processing apparatus and an image processing method capable of improving the accuracy of contour correction of a tubular member as a medical instrument in an image.

An image processing apparatus as a first aspect of the present disclosure includes an imaging unit capable of capturing an image of a heart from a body surface, an acquisition unit that acquires outer diameter information of a tubular member inserted into the heart, and the acquisition An image processing unit that corrects an outline of the tubular member in the image based on the outer diameter information acquired by the unit.

As one embodiment of the present disclosure, the image processing unit corrects the contour of the tubular member in the image based on the outer diameter information and the scale information of the image.

As one embodiment of the present disclosure, the imaging unit includes an ultrasonic wave transmission unit that transmits ultrasonic waves, an ultrasonic wave reception unit that receives ultrasonic waves, and the measurement information received by the ultrasonic wave reception unit. An image forming unit to be formed.

As one embodiment of the present disclosure, the imaging unit captures the image every predetermined time.

An image processing apparatus as an embodiment of the present disclosure includes a display unit that can display the image corrected by the image processing unit.

An image processing apparatus as an embodiment of the present disclosure includes an input unit that inputs the outer diameter information to the acquisition unit.

An image processing apparatus as an embodiment of the present disclosure includes an operation unit that receives an operation by a user, and the input unit inputs the outer diameter information received by the operation unit to the acquisition unit.

An image processing apparatus as one embodiment of the present disclosure includes a storage unit that stores the outer diameter information, and the input unit inputs the outer diameter information stored in the storage unit to the acquisition unit.

An image processing apparatus as a second aspect of the present disclosure includes an acquisition unit that acquires outer diameter information of a tubular member inserted into a heart, and a body surface based on the outer diameter information acquired by the acquisition unit. An image processing unit that corrects the contour of the tubular member in the captured image of the heart.

An image processing method as a third aspect of the present disclosure includes an imaging step of capturing a heart image from a body surface, an acquisition step of acquiring outer diameter information of a tubular member inserted into the heart, and the outer diameter And an image processing step of correcting a contour of the tubular member in the image based on the information.

According to the present disclosure, it is possible to provide an image processing apparatus and an image processing method capable of improving the accuracy of contour correction of a tubular member as a medical instrument in an image.

It is a block diagram showing an image processing device as one embodiment of this indication. It is a schematic diagram which shows the outline | summary of the treatment performed using the image processing apparatus of FIG. It is a figure which shows an example of the three-dimensional image of the heart imaged by the imaging part of the image processing apparatus of FIG. It is a flowchart which shows the image processing method performed by the image processing apparatus shown in FIG. It is a block diagram showing an image processing device set as one embodiment of this indication. It is a schematic diagram which shows the outline | summary of the treatment performed using the image processing apparatus set shown in FIG. It is a figure which shows an example of the three-dimensional image of the heart imaged by the imaging part of the image processing apparatus in the image processing apparatus set of FIG. It is a flowchart which shows the image processing method performed by the image processing apparatus in the image processing apparatus set of FIG.

Hereinafter, embodiments of an image processing apparatus and an image processing method according to the present disclosure will be described with reference to the drawings. In each figure, the same code | symbol is attached | subjected to the common member and site | part.

FIG. 1 is a block diagram illustrating an image processing apparatus 1 as one embodiment of an image processing apparatus according to the present disclosure. FIG. 2 is a schematic diagram showing an outline of a procedure performed using the image processing apparatus 1.

As shown in FIG. 2, the image processing apparatus 1 according to the present embodiment delivers a medical instrument into the heart through blood vessels, and performs a predetermined diagnosis or treatment in the heart. This is a monitoring device that can monitor the state in the heart. The monitoring apparatus as the image processing apparatus 1 monitors, for example, the position and contour of the catheter in the left ventricle LV as the tubular member 31 inserted into the left ventricle LV from the femoral artery FA through the aorta AO and the aortic valve AV from outside the body. Display as you can. A medical worker such as a doctor depends on the position and contour of the tubular member 31 in the left ventricle LV displayed on the monitoring device as the image processing apparatus 1, and various kinds of deliveries delivered into the left ventricle LV through the tubular member 31. A predetermined diagnosis or treatment is performed using a medical instrument.

As the predetermined treatment performed in the left ventricle LV, for example, treatment in which various therapeutic substances are administered into the myocardium in order to treat heart disease or the like can be mentioned. Examples of various therapeutic substances include cells that can provide therapeutic effects such as cell replacement, angiogenesis induction, heart wall reinforcement, scaffolding materials, or tissue repair or regeneration by prevention of apoptosis / necrosis. Or a polymer etc. Cells as a therapeutic substance are administered into the myocardium in the state of a cell suspension dispersed in a liquid such as physiological saline.

Cells as therapeutic substances include, for example, adherent cells (adherent cells). Adherent cells include, for example, adherent somatic cells (eg, cardiomyocytes, fibroblasts, epithelial cells, endothelial cells, hepatocytes, pancreatic cells, kidney cells, adrenal cells, periodontal cells, gingival cells, periosteum cells, skin Cells, synovial cells, chondrocytes, etc.) and stem cells (eg, tissue stem cells such as myoblasts, cardiac stem cells, embryonic stem cells, pluripotent stem cells such as induced pluripotent cells (iPS) cells, mesenchymal stem cells, etc.) Etc. Somatic cells may be stem cells, especially cells differentiated from iPS cells. Non-limiting examples of cells as therapeutic substances include, for example, myoblasts (eg, skeletal myoblasts), mesenchymal stem cells (eg, bone marrow, adipose tissue, peripheral blood, skin, hair root, muscle tissue, uterus) Endometrium, placenta, cord blood-derived cells, etc.), cardiomyocytes, fibroblasts, cardiac stem cells, embryonic stem cells, iPS cells, synovial cells, chondrocytes, epithelial cells (eg, oral mucosal epithelial cells, retinal pigment epithelium) Cells, nasal mucosal epithelial cells, etc.), endothelial cells (eg, vascular endothelial cells, etc.), hepatocytes (eg, liver parenchymal cells, etc.), pancreatic cells (eg, islet cells, etc.), kidney cells, adrenal cells, periodontal ligament cells Gingival cells, periosteum cells, skin cells and the like.

Drugs as therapeutic substances include, for example, proteins, plasmids, genes, growth factors, chemoattractants, synthetic polypeptides, various pharmaceutical compositions, and other therapeutically beneficial substances alone, Or they can be included in any combination.

Polymers as therapeutic agents include injectable biocompatible single-component or multi-component materials, polymer-based beads, polymer hydrogels, fibrin adhesives, synthetic polymeric materials such as collagen, alginate, polyethylene glycol, and Chitosan etc. are mentioned.

In the present embodiment, as shown in FIG. 2, the monitoring device as the image processing apparatus 1 monitors the treatment for administering the therapeutic substance from the left ventricle LV to or near the infarct site X of the myocardium of the left ventricle LV. However, the operation performed while monitoring by the monitoring device as the image processing apparatus 1 is not limited to the administration of a predetermined therapeutic substance, for example, a procedure for diagnosing the infarct state of the myocardium of the left ventricle LV Etc. For the infarct region X of the myocardium of the left ventricle LV, a tomographic image of the heart is acquired from outside the body using a magnetic resonance imaging apparatus (hereinafter referred to as an MRI apparatus) or an X-ray computed tomography apparatus (hereinafter referred to as an X-ray CT apparatus). It can be specified in advance from the acquired tomographic image.

Further, the monitoring device as the image processing device 1 of the present embodiment is not limited to the device that enables monitoring of the treatment in the left ventricle LV described above, and is executed inside any of the right ventricle, the left atrium, and the right atrium. It is good also as a device which can monitor the treatment to be performed from outside the body. As will be described later, the image processing apparatus 1 of the present embodiment is a three-dimensional ultrasonic diagnostic apparatus. Therefore, it is possible to acquire tomographic images at different cross sections even in any of the left ventricle LV, right ventricle, left atrium, and right atrium, and monitoring can be performed by using these tomographic images.

Hereinafter, details of the image processing apparatus 1 of the present embodiment will be described.

As shown in FIG. 1, the image processing apparatus 1 includes an imaging unit 2, an acquisition unit 3, an image processing unit 4, a display unit 5, an input unit 6, an operation unit 7, a storage unit 8, and a control. Part 9.

The imaging unit 2 can capture a tomographic image of the heart as a heart image and a three-dimensional image of the heart from the body surface.

Specifically, the imaging unit 2 includes an ultrasonic wave transmission unit 11 that transmits ultrasonic waves, an ultrasonic wave reception unit 12 that receives ultrasonic waves, and an ultrasonic wave as ultrasonic measurement information received by the ultrasonic wave reception unit 12. And an image forming unit 13 that forms a tomographic image from the sound wave data. The ultrasonic receiving unit 12 receives ultrasonic waves transmitted from the ultrasonic transmission unit 11 and reflected from each part of the heart.

More specifically, the monitoring device as the image processing device 1 of the present embodiment is a three-dimensional ultrasonic diagnostic device. The “three-dimensional ultrasonic diagnostic apparatus” means an ultrasonic diagnostic apparatus that can capture a three-dimensional image. The three-dimensional ultrasonic diagnostic apparatus as the image processing apparatus 1 according to this embodiment includes a three-dimensional ultrasonic probe 1a that is brought into contact with the body surface, and an apparatus that can communicate with the three-dimensional ultrasonic probe 1a by wire or wirelessly. A main body 1b. The three-dimensional ultrasonic probe 1 a includes an ultrasonic transmission unit 11 and an ultrasonic reception unit 12 of the imaging unit 2. The apparatus main body 1 b includes an image forming unit 13 of the imaging unit 2. The image forming unit 13 includes a processor such as a CPU or MPU.

As shown in FIG. 2, the three-dimensional ultrasonic probe 1a is arranged on the skin near the rib on the front surface of the body so that the ultrasonic wave can be transmitted and received between the ribs. In this state, an ultrasonic diagnosis is executed using the ultrasonic transmitter 11 and the ultrasonic receiver 12.

The apparatus main body 1b acquires ultrasonic measurement information from the three-dimensional ultrasonic probe 1a. Next, the image forming unit 13 of the apparatus main body 1b forms a tomographic image of the heart based on the acquired ultrasonic measurement information.

In this way, the imaging unit 2 can capture tomographic images at various cross sections of the heart. That is, the image forming unit 13 of the imaging unit 2 forms a tomographic image for the predetermined plane based on the measurement information of the predetermined plane received by the ultrasonic receiver 12. Furthermore, the imaging unit 2 performs rendering by processing of stacking a plurality of tomographic images of the captured heart and processing of three-dimensional data serving as a basis of each tomographic image collected at the time of scanning for capturing a plurality of tomographic images. Run and take a 3D image of the heart. Specifically, the image forming unit 13 of the imaging unit 2 combines a plurality of tomographic images, or processes three-dimensional data collected when each tomographic image is captured, thereby processing a three-dimensional model of the heart. And any three-dimensional image of the heart can be formed based on this three-dimensional model.

FIG. 3 is a diagram illustrating an example of a three-dimensional image of the heart imaged by the imaging unit 2. More specifically, FIG. 3 shows a state where a cross-sectional image of the left ventricle LV of the three-dimensional model of the heart formed by the imaging unit 2 is displayed on the display unit 5. More specifically, FIG. 3 intersects a line segment connecting the aortic valve AV (see FIG. 2) and the apex Y of the left ventricle LV (see FIG. 2) at a predetermined angle (in the present embodiment, substantially orthogonal). ) A cross-sectional image of the cross section, which is an image of the apex Y side as viewed from the aortic valve AV side. Thus, if a three-dimensional model of the heart is formed by the imaging unit 2, not only the cross section shown in FIG. 3 but also a desired cross section of the heart can be displayed on the display unit 5 described later. In the present embodiment, as shown in FIG. 3, the treatment is performed in a state where a cross section intersecting with a line segment connecting the aortic valve AV (see FIG. 2) and the apex Y of the left ventricle LV is displayed on the display unit 5 described later. Although monitoring is performed, the operation may be monitored by a cross-sectional image of a cross section substantially parallel to a line segment connecting the aortic valve AV and the apex Y of the left ventricle LV.

Further, the imaging unit 2 captures an image every predetermined time. Specifically, the imaging unit 2 can capture tomographic images at the same position every predetermined time and can display them on the display unit 5 over time as a moving image. In addition, the imaging unit 2 can capture a three-dimensional image (including a cross-sectional image formed from a three-dimensional model) of the heart at the same viewpoint at predetermined time intervals and display it on the display unit 5 over time as a moving image. it can. The imaging interval of the three-dimensional image (in this embodiment, approximately equal to the three-dimensional model formation interval) is set to 1 second, for example, and the tomographic image, the three-dimensional image, etc. are displayed as moving images over time at the same interval. By doing so, a tomographic image of the heart, a three-dimensional image, etc. can be monitored in real time. In other words, an intra-cardiac image can be displayed on the display unit 5. However, in FIG. 3, as an example, only a cross-sectional image as a three-dimensional image of the heart formed from a three-dimensional model is shown.

The imaging interval of the 3D image is not limited to 1 second and can be set as appropriate. However, in order to display the tomographic image of the heart during the operation, the 3D image, etc. in real time, the 3D image of the heart is at least 3 seconds. It is preferable to perform imaging at the following intervals. In addition, the time interval for switching the tomographic image and the three-dimensional image displayed on the display unit 5 with time may be the same as the imaging interval of the three-dimensional image, or may be a different interval. For example, when only the tomographic image is displayed on the display unit 5 in real time, the imaging interval for capturing the tomographic image at the same position is set to 200 msec, and the display of the display unit 5 is switched at the same interval as this imaging interval. Alternatively, the display may be switched at a time interval different from the imaging interval. As an example of executing switching of the display unit 5 at a time interval different from the imaging interval, for example, a tomographic image displayed on the display unit 5 and a tomographic image not displayed on the display unit 5 are alternately captured at predetermined time intervals. The structure to do is mentioned. In addition, when only a 3D image is displayed on the display unit 5 in real time, the imaging interval for capturing the 3D image at the same position is set to 1 second or the like, and the display unit 5 is displayed at the same interval as this imaging interval. The display may be switched, or the display may be switched at a time interval different from the imaging interval. As an example of executing the switching of the display unit 5 at a time interval different from the imaging interval, for example, a three-dimensional image displayed on the display unit 5 and a three-dimensional image not displayed on the display unit 5 are alternately displayed every predetermined time. A configuration for imaging is given.

As described above, in the monitoring apparatus as the image processing apparatus 1 according to the present embodiment, a treatment for administering a predetermined therapeutic substance is executed by using the image while displaying the image in the heart in real time. Therefore, during this treatment, the three-dimensional ultrasonic probe 1a is fixed at a predetermined position on the body surface described above. The fixation of the three-dimensional ultrasonic probe 1a on the body surface can be realized by sticking the body surface with an adhesive or the like.

The acquisition unit 3 acquires the outer diameter information of the tubular member 31 as a medical instrument inserted into the heart. Specifically, the acquisition unit 3 acquires the outer diameter information of the catheter as the tubular member 31 input by the input unit 6 described later. The outer diameter information of the tubular member 31 may be information that can specify the outer diameter of the tubular member 31, and is not limited to the outer diameter dimension. For example, it is good also as information which can specify an outer diameter indirectly, such as circumference. The acquisition unit 3 of the present embodiment is provided in the apparatus main body 1b, but may be provided in the three-dimensional ultrasonic probe 1a. The image processing apparatus 1 includes a processor 20 (see FIG. 1) configured by a CPU and an MPU. The processor 20 constitutes an acquisition unit 3 together with an image processing unit 4 described later.

The image processing unit 4 corrects the outline of the tubular member 31 in the tomographic image of the heart and the three-dimensional image of the heart captured by the imaging unit 2 based on the outer diameter information of the tubular member 31 acquired by the acquiring unit 3. If the outer diameter information of the tubular member 31 can be acquired in advance, the outline of the tubular member 31 displayed in the tomographic image can be easily corrected. Moreover, if the outer diameter information of the tubular member 31 can be acquired in advance, the outline of the tubular member 31 displayed in the three-dimensional image of the heart can be easily corrected. More specifically, the image processing unit 4 of the present embodiment is based on the outer diameter information of the tubular member 31 and the scale information of an image such as a tomographic image or a three-dimensional image captured by the imaging unit 2. The contour of the member 31 is corrected. Examples of the scale information of the image captured by the image capturing unit 2 include ratio information between the actual distance and the image distance in the image with respect to a predetermined two points in the image. Thus, if the scale information of an image is acquired, the outline of the tubular member 31 displayed in the image can be corrected more clearly. The image scale information may be information acquired by a user operation of the operation unit 7 described later, or may be information stored in the storage unit 8 described later. The acquisition unit 3 acquires such image scale information by being input by an input unit 6 described later.

The contour correction of the tubular member 31 in the tomographic image of the heart or the three-dimensional image of the heart is performed based on other information in addition to the above-described outer diameter information and scale information from the viewpoint of improving the correction accuracy. Is preferred. Other information includes, for example, inner diameter information and thickness information of the tubular member 31. Further, as described above, the image processing unit 4 can be configured by the processor 20 (see FIG. 1) configured by a CPU or MPU.

The display unit 5 can display a tomographic image in which the contour of the tubular member 31 is corrected by the image processing unit 4. The display unit 5 can display a cross-sectional image of the heart formed from a three-dimensional model of the heart as a three-dimensional image of the heart with the contour of the tubular member 31 corrected by the image processing unit 4. The display unit 5 can be configured with, for example, a liquid crystal display. The display unit 5 is provided in the apparatus main body 1b of the image processing apparatus 1, but may be configured to be provided in the three-dimensional ultrasonic probe 1a in addition to the apparatus main body 1b. The display unit 5 shown in FIG. 3 shows an example in which only a cross-sectional image of the heart formed from a three-dimensional model of the heart is displayed, but a tomographic image of the heart and a three-dimensional image other than the cross-sectional image are displayed simultaneously. You can also.

As described above, in the procedure illustrated here, the position and size of the infarct region X of the myocardium of the left ventricle LV are acquired in advance using an MRI apparatus or an X-ray CT apparatus. The tomographic image captured by the imaging unit 2 is displayed on the display unit 5, and a display indicating the position and size of the infarct site X is superimposed or synthesized on the displayed tomographic image. That is, in the real-time tomographic image that is switched to the latest state at any time, the position and size of the infarct site X to be treated or the vicinity thereof can be indicated. Therefore, the actual treatment can be executed while confirming the infarct site X, which is a target site of the treatment to which the therapeutic substance is administered, and the position and size in the vicinity thereof in the tomographic image in real time.

Further, in addition to the above-described tomographic image, the display unit 5 can display a three-dimensional image of the heart imaged by the imaging unit 2 as shown in FIG. A display indicating the position and size of X is superimposed or synthesized (see FIG. 3).

In addition, when a therapeutic substance is administered to the infarct region X displayed in the tomographic image and the three-dimensional image described above or in the vicinity thereof, the therapeutic substance is administered, for example, by displaying a predetermined mark at the administration position. The display unit 5 is caused to display a display that enables the identified position to be identified. In this way, it becomes easy for a medical worker such as a doctor to grasp the progress of the treatment while checking the image processing apparatus 1.

The input unit 6 inputs the outer diameter information of the tubular member 31 to the acquisition unit 3. Specifically, the input unit 6 inputs the outer diameter information of the tubular member 31 received by the operation unit 7 described later to the acquisition unit 3. Further, the input unit 6 inputs the outer diameter information of the tubular member 31 stored in the storage unit 8 described later to the acquisition unit 3. Thus, the input unit 6 can input the outer diameter information of the tubular member 31 from the operation unit 7 and the storage unit 8 to the acquisition unit 3. Similarly to the acquisition unit 3 and the image processing unit 4 described above, the input unit 6 also includes a processor 20 (see FIG. 1).

The operation unit 7 is a part that receives an operation by the user. The operation unit 7 can be configured by various user interfaces such as a switch and a liquid crystal touch panel provided on the outer wall of the apparatus main body 1b of the image processing apparatus 1, for example.

The storage unit 8 is a part that stores the outer diameter information of the tubular member. The storage unit 8 can be constituted by a memory such as a ROM (abbreviation of Read Only Memory) or a RAM (abbreviation of Random Access Memory), for example.

The control unit 9 performs the above-described operation at a predetermined timing on each of the imaging unit 2, the acquisition unit 3, the image processing unit 4, the display unit 5, the input unit 6, the operation unit 7, and the storage unit 8. Instruct to run. For example, the control unit 9 reads an image processing program stored in the storage unit 8 and causes the image processing unit 4 to execute image processing. The control unit 9 is configured by a processor 20 (see FIG. 1) such as an MPU or a CPU, like the acquisition unit 3, the image processing unit 4, and the input unit 6 described above. The acquisition unit 3, the image processing unit 4, the input unit 6, and the control unit 9 are configured from a single processor 20, but may be configured from a plurality of processors.

As described above, according to the image processing apparatus 1 described above, the image processing method shown in the flowchart of FIG. 4 is executed. Specifically, the image processing method by the image processing apparatus 1 includes an imaging step S1 for capturing a heart image from the body surface, an acquisition step S2 for acquiring outer diameter information of the tubular member 31 inserted into the heart, and a tubular shape. An image processing step S3 for correcting the contour of the tubular member 31 in the image captured in the imaging step S1 based on the outer diameter information of the member 31. Since the processing in each of the steps S1 to S3 is as described above, description thereof is omitted here.

The image processing apparatus and the image processing method according to the present disclosure are not limited to the specific configurations and processes shown in the above-described embodiments, and various changes and modifications can be made without departing from the scope of the claims. For example, the contour of the tubular member 31 in the image may be corrected using various information such as the outer diameter information and shape information of the puncture member as a medical instrument delivered into the heart through the tubular member 31. The puncture member is used when the myocardium is punctured and a therapeutic substance is injected into the myocardium, and is used by protruding from the distal end opening of the tubular member 31. Therefore, the puncture member is reflected together with the tubular member 31 in the cross-sectional image of the heart (see FIG. 3). Therefore, various types of information on the puncture member may be acquired and used for contour correction of the tubular member 31. Various types of information on the puncture member are acquired by the acquisition unit 3 as in the case of the outer shape information of the tubular member 31, for example.

In the above-described embodiment, a cross section that is substantially orthogonal to a straight line segment connecting the aortic valve AV (see FIG. 2) and the apex Y (see FIG. 2) of the left ventricle LV (see FIGS. 2 and 3). In the cross-sectional image of FIG. 3 (see FIG. 3), the contour of the tubular member 31 is corrected. However, in the cross-sectional image of the heart and the cross-sectional image of the heart at a position different from FIG. You may correct | amend the outline of. Furthermore, in the above-described embodiment, the contour of the tubular member 31 in the ultrasound image is corrected. However, a similar technique may be applied to the contour correction of the tubular member 31 in an image other than the ultrasound image. However, in order to realize real-time monitoring, it is preferable to use the ultrasonic image shown in the above-described embodiment.

In the above-described embodiment, the image processing device 1 includes the imaging unit 2. However, the image processing device 1 does not include the imaging unit 2, acquires a heart image captured by an external imaging device, and executes image processing. The image processing apparatus may be used. In such a case, the acquisition unit 3 of the image processing device 1 may acquire heart image data from an external imaging device.

Hereinafter, an image processing apparatus and an image processing method different from the above-described image processing apparatus and image processing method will be described as an example.

There are cases where a medical instrument is inserted into a blood vessel, a heart, or the like, and a diagnosis or treatment is performed while detecting the position of the medical instrument in the body using an external three-dimensional ultrasonic diagnostic apparatus. Patent Document 2 describes an ultrasonic diagnostic apparatus used for this type of diagnosis.

The ultrasonic diagnostic apparatus described in Patent Document 2 includes an ultrasonic wave generation unit that generates an ultrasonic wave in the vicinity of the tip, and transmits and receives an ultrasonic wave to and from a catheter or a small-diameter probe inserted into the subject. And an ultrasonic probe formed by two-dimensionally arranging a plurality of ultrasonic transducers that wave. In addition, the ultrasonic diagnostic apparatus described in Patent Document 2 includes a first transmission drive unit that generates a drive signal so that an ultrasonic probe performs ultrasonic transmission for generating an ultrasonic image, and an ultrasonic generation unit. Second transmission driving means for generating a drive signal so as to perform position detection ultrasonic wave transmission a plurality of times and an ultrasonic reception signal based on a plurality of position detection ultrasonic waves are added, and based on the received signal after addition Position calculating means for obtaining position information of the catheter or the small diameter probe. Furthermore, the ultrasonic diagnostic apparatus described in Patent Document 2 includes an ultrasonic image generation unit that generates an ultrasonic image based on an ultrasonic reception signal corresponding to an ultrasonic wave transmission for generating an ultrasonic image, and a catheter or a cell. Display means for displaying the position of the catheter or the small diameter probe together with the ultrasonic image based on the position information of the diameter probe.

In the ultrasonic diagnostic apparatus described in Patent Document 2, an insertion means such as a catheter or a small-diameter probe inserted into a lumen such as a blood vessel or a bile duct is provided with an ultrasonic wave generation means that generates an ultrasonic wave near the tip. Since ultrasonic waves emitted from the insertion means can be used when the insertion means is inserted to perform diagnosis or treatment, according to the ultrasonic diagnostic apparatus described in Patent Document 2, the position of the insertion means in the body can be more accurately determined. Can be identified. However, when the insertion means in the heart is displayed in real time on an image such as an ultrasonic image and the diagnosis or treatment in the heart is performed while monitoring the image, not only the position of the insertion means in the heart, It is desirable to clearly display the contour of the insertion means in the heart, and it is difficult for the ultrasonic diagnostic apparatus described in Patent Document 2 to correct the contour of the insertion means in the image.

According to the image processing apparatus and the image processing method described below as examples, it is easy to realize the contour correction of the insertion member in the captured heart image.

FIG. 5 is a block diagram showing an image processing device set 1100 as one embodiment of the image processing device set according to the present disclosure. An image processing device set 1100 illustrated in FIG. 5 includes an image processing device 1001 as one embodiment of the image processing device according to the present disclosure, and an insertion member 1031 to be inserted into the heart. FIG. 6 is a schematic diagram showing an outline of a procedure performed using the image processing apparatus set 1100.

As shown in FIG. 6, the image processing apparatus 1001 according to the present embodiment delivers a medical instrument into a heart through a blood vessel, and performs a predetermined diagnosis or treatment in the heart. This is a monitoring device that can monitor the state in the heart. The monitoring apparatus as the image processing apparatus 1001 monitors, for example, the position and contour of the catheter in the left ventricle LV as the insertion member 1031 inserted into the left ventricle LV from the femoral artery FA through the aorta AO and the aortic valve AV from outside the body. Display as you can. A medical worker such as a doctor, depending on the position and contour of the insertion member 1031 in the left ventricle LV displayed on the monitoring device as the image processing apparatus 1001, can deliver various types of deliveries into the left ventricle LV through the insertion member 1031. A predetermined diagnosis or treatment is performed using a medical instrument.

In the present embodiment, as shown in FIG. 6, a treatment that administers a therapeutic substance from the left ventricle LV to or near the infarct region X of the myocardium of the left ventricle LV is monitored by a monitoring device as the image processing device 1001. However, the operation performed while monitoring with the monitoring device as the image processing apparatus 1001 is not limited to the administration of a predetermined therapeutic substance, for example, a procedure for diagnosing the infarct state of the myocardium of the left ventricle LV Etc. For the infarct region X of the myocardium of the left ventricle LV, a tomographic image of the heart is acquired from outside the body using a magnetic resonance imaging apparatus (hereinafter referred to as an MRI apparatus) or an X-ray computed tomography apparatus (hereinafter referred to as an X-ray CT apparatus). It can be specified in advance from the acquired tomographic image.

In addition, the monitoring apparatus as the image processing apparatus 1001 of the present embodiment is not limited to an apparatus that can monitor the treatment in the left ventricle LV (see FIG. 6), and any one of the right ventricle, the left atrium, and the right atrium. It is good also as a device which can monitor the treatment performed inside the body from outside the body. As will be described later, the image processing apparatus 1001 of the present embodiment is a three-dimensional ultrasonic diagnostic apparatus. Therefore, it is possible to acquire tomographic images at different cross sections even in any of the left ventricle LV, right ventricle, left atrium, and right atrium, and monitoring can be performed by using these tomographic images.

Hereinafter, details of the image processing apparatus 1001 of the present embodiment will be described.

As illustrated in FIG. 5, the image processing apparatus 1001 includes an imaging unit 1002, an image processing unit 1003, a display unit 1004, an operation unit 1005, a storage unit 1006, and a control unit 1007.

The imaging unit 1002 can capture a tomographic image of the heart as a heart image and a three-dimensional image of the heart from the body surface.

Specifically, the imaging unit 1002 includes an ultrasonic transmission unit 1011 that transmits ultrasonic waves, an ultrasonic reception unit 1012 that receives ultrasonic waves, and ultrasonic measurement information received by the ultrasonic reception unit 1012 as ultrasonic measurement information. An image forming unit 1013 for forming a tomographic image from the sound wave data. The ultrasonic receiving unit 1012 receives ultrasonic waves transmitted from the ultrasonic transmitting unit 1011 and reflected from each part of the heart.

More specifically, the monitoring apparatus as the image processing apparatus 1001 of the present embodiment is a three-dimensional ultrasonic diagnostic apparatus. The “three-dimensional ultrasonic diagnostic apparatus” means an ultrasonic diagnostic apparatus that can capture a three-dimensional image. The three-dimensional ultrasonic diagnostic apparatus as the image processing apparatus 1001 of this embodiment includes a three-dimensional ultrasonic probe 1001a that is brought into contact with the body surface, and an apparatus that can communicate with the three-dimensional ultrasonic probe 1001a by wire or wirelessly. A main body 1001b. The three-dimensional ultrasonic probe 1001a includes an ultrasonic transmission unit 1011 and an ultrasonic reception unit 1012 of the imaging unit 1002. The apparatus main body 1001b includes an image forming unit 1013 of the imaging unit 1002. The image forming unit 1013 is configured by a processor such as a CPU or MPU.

As shown in FIG. 6, the three-dimensional ultrasonic probe 1001a is arranged on the skin near the rib on the front surface of the body so that ultrasonic waves can be transmitted and received from between the ribs. In this state, ultrasonic diagnosis is executed using the ultrasonic transmission unit 1011 and the ultrasonic reception unit 1012.

The apparatus main body 1001b acquires ultrasonic measurement information from the three-dimensional ultrasonic probe 1001a. Next, the image forming unit 1013 of the apparatus main body 1001b forms a tomographic image of the heart based on the acquired ultrasonic measurement information.

In this way, the imaging unit 1002 can capture tomographic images at various cross sections of the heart. That is, the image forming unit 1013 of the imaging unit 1002 forms a tomographic image for the predetermined plane based on the measurement information of the predetermined plane received by the ultrasonic receiver 1012. Furthermore, the imaging unit 1002 performs rendering by processing of stacking a plurality of tomographic images of the captured heart and processing of three-dimensional data that is the basis of each tomographic image collected at the time of scanning for capturing a plurality of tomographic images. Run and take a 3D image of the heart. Specifically, the image forming unit 1013 of the imaging unit 1002 combines a plurality of tomographic images, or processes three-dimensional data collected when each tomographic image is captured, thereby processing a three-dimensional model of the heart. And any three-dimensional image of the heart can be formed based on this three-dimensional model.

FIG. 7 is a diagram illustrating an example of a three-dimensional image of the heart imaged by the imaging unit 1002. More specifically, FIG. 7 shows a state where a cross-sectional image of the left ventricle LV of the three-dimensional model of the heart formed by the imaging unit 1002 is displayed on the display unit 1004. More specifically, FIG. 7 intersects a line segment connecting the aortic valve AV (see FIG. 6) and the apex Y of the left ventricle LV (see FIG. 6) at a predetermined angle (in the present embodiment, substantially orthogonal). ) A cross-sectional image of the cross-section, as viewed from the aortic valve AV side to the apex Y side. In this way, if a three-dimensional model of the heart is formed by the imaging unit 1002, the desired cross section of the heart can be displayed on the display unit 1004 described later, not only the cross section shown in FIG. In the present embodiment, as shown in FIG. 7, the operation is performed in a state where a cross section intersecting with a line segment connecting the aortic valve AV (see FIG. 6) and the apex Y of the left ventricle LV is displayed on the display unit 1004 described later. Although monitoring is performed, the operation may be monitored by a cross-sectional image of a cross section substantially parallel to a line segment connecting the aortic valve AV and the apex Y of the left ventricle LV.

Further, the imaging unit 1002 captures an image every predetermined time. Specifically, the imaging unit 1002 can capture tomographic images at the same position every predetermined time and can display them on the display unit 1004 over time as a moving image. In addition, the imaging unit 1002 captures a three-dimensional image of the heart (including a cross-sectional image formed from a three-dimensional model) at the same viewpoint at predetermined time intervals and displays it on the display unit 1004 over time as a moving image. it can. The imaging interval of the three-dimensional image (in this embodiment, approximately equal to the three-dimensional model formation interval) is set to 1 second, for example, and the tomographic image, the three-dimensional image, etc. are displayed as a moving image over time on the display unit 1004 at the same interval. By doing so, a tomographic image of the heart, a three-dimensional image, etc. can be monitored in real time. In other words, an intracardiac image can be displayed on the display unit 1004. However, in FIG. 7, only a cross-sectional image as a three-dimensional image of the heart formed from a three-dimensional model is shown as an example.

The imaging interval of the 3D image is not limited to 1 second and can be set as appropriate. However, in order to display the tomographic image of the heart during the operation, the 3D image, etc. in real time, the 3D image of the heart is at least 3 seconds. It is preferable to perform imaging at the following intervals. Further, the time interval for switching the tomographic image or the three-dimensional image displayed on the display unit 1004 with time may be the same as the imaging interval of the three-dimensional image or may be different. For example, when only the tomographic image is displayed on the display unit 1004 in real time, the imaging interval for capturing the tomographic image at the same position is set to 200 msec, and the display of the display unit 1004 is switched at the same interval as this imaging interval. Alternatively, the display may be switched at a time interval different from the imaging interval. As an example of switching the display unit 1004 at a time interval different from the imaging interval, for example, a tomographic image displayed on the display unit 1004 and a tomographic image not displayed on the display unit 1004 are alternately captured at predetermined time intervals. The structure to do is mentioned. In addition, when only a three-dimensional image is displayed on the display unit 1004 in real time, the imaging interval for capturing the three-dimensional image at the same position is set to 1 second, and the display unit 1004 is displayed at the same interval as this imaging interval. The display may be switched, or the display may be switched at a time interval different from the imaging interval. As an example of switching the display unit 1004 at a time interval different from the imaging interval, for example, a three-dimensional image displayed on the display unit 1004 and a three-dimensional image not displayed on the display unit 1004 are alternately displayed every predetermined time. A configuration for imaging is given.

As described above, in the monitoring apparatus as the image processing apparatus 1001 according to the present embodiment, the intra-cardiac image is displayed in real time, and a treatment for administering a predetermined therapeutic substance is executed using the image. Therefore, during this treatment, the three-dimensional ultrasonic probe 1001a is fixed at a predetermined position on the body surface described above. Fixation of the three-dimensional ultrasonic probe 1001a on the body surface can be realized by sticking the body surface with an adhesive or the like.

Further, the imaging unit 1002 includes a receiving device 1002a. As will be described later, the receiving device 1002a receives a plurality of pieces of position information transmitted from the insertion member 1031. The plurality of pieces of position information transmitted from the insertion member 1031 of the present embodiment are ultrasonic signals as will be described later. Therefore, the receiving device 1002a of the present embodiment is an ultrasonic receiving device that receives an ultrasonic signal transmitted from the insertion member 1031. And the ultrasonic receiving apparatus as the receiving apparatus 1002a of this embodiment is provided in the three-dimensional ultrasonic probe 1001a. More specifically, the ultrasonic receiving device as the receiving device 1002a of the present embodiment constitutes an ultrasonic receiving unit 1012. That is, the ultrasonic receiving device as the receiving device 1002a of the present embodiment is transmitted from the ultrasonic receiving unit 1012 that receives ultrasonic measurement information when capturing a tomographic image and the insertion member 1031 located in the heart. And a receiving unit that receives position information.

The image processing unit 1003 corrects the contour of the insertion member 1031 inserted in the heart in the heart image captured by the imaging unit 1002. Specifically, the image processing unit 1003 corrects the contour of the insertion member 1031 in the image based on the plurality of pieces of position information of the insertion member 1031 received by the reception device 1002a. More specifically, the image processing unit 1003 corrects the contour of the insertion member 1031 in the image based on a difference in reception timing of a plurality of pieces of position information received by the receiving device 1002a. Here, the “plurality of position information” of the insertion member 1031 is position information indicating different positions of the insertion member 1031 at an arbitrary timing. If the positional relationship between different parts of the insertion member 1031 can be specified, the contour of the insertion member 1031 in the image can be corrected so as to match the positional relationship. As described above, the positional relationship between different parts set in advance can be specified by using the difference in reception timing. A specific example of the “plurality of position information” will be described later.

The image processing unit 1003 according to the present embodiment is based on the plurality of pieces of position information of the insertion member 1031 described above and scale information of an image such as a tomographic image or a three-dimensional image captured by the imaging unit 1002. Correct the contour. Examples of the scale information of the image captured by the imaging unit 1002 include ratio information between the actual distance and the image distance in the image with respect to a predetermined two points in the image. Thus, if the scale information of an image is acquired, the outline of the insertion member 1031 displayed in the image can be corrected more clearly. The image scale information may be information acquired by a user operation of the operation unit 1005 described later, or may be information stored in the storage unit 1006 described later.

The contour correction of the insertion member 1031 in the tomographic image of the heart or the three-dimensional image of the heart is executed based on other information in addition to the plurality of position information and scale information described above from the viewpoint of improving the correction accuracy. It is preferable. Another information includes, for example, length information of the insertion member 1031.

The image processing unit 1003 can be configured by a processor 1020 (see FIG. 5) configured by a CPU or MPU.

The display unit 1004 can display a tomographic image in which the contour of the insertion member 1031 is corrected by the image processing unit 1003. The display unit 1004 can display a cross-sectional image of the heart formed from a three-dimensional model of the heart as a three-dimensional image of the heart, the contour of the insertion member 1031 being corrected by the image processing unit 1003. The display unit 1004 can be configured with, for example, a liquid crystal display. The display unit 1004 is provided in the apparatus main body 1001b of the image processing apparatus 1001, but may be provided in the three-dimensional ultrasonic probe 1001a in addition to the apparatus main body 1001b. The display unit 1004 shown in FIG. 7 shows an example in which only the cross-sectional image of the heart formed from the three-dimensional model of the heart is displayed. However, the tomographic image of the heart and the three-dimensional image other than the cross-sectional image are displayed simultaneously. You can also.

As described above, in the procedure illustrated here, the position and size of the infarcted portion X of the myocardium of the left ventricle LV (see FIG. 6 and the like) are acquired in advance using an MRI apparatus or an X-ray CT apparatus. . A tomographic image captured by the imaging unit 1002 is displayed on the display unit 1004, and a display indicating the position and size of the infarct site X is superimposed or synthesized on the displayed tomographic image. That is, in the real-time tomographic image that is switched to the latest state at any time, the position and size of the infarct site X to be treated or the vicinity thereof can be indicated. Therefore, the actual treatment can be executed while confirming the infarct site X, which is a target site of the treatment to which the therapeutic substance is administered, and the position and size in the vicinity thereof in the tomographic image in real time.

Further, in addition to the above-described tomographic image, the display unit 1004 can display a three-dimensional image of the heart imaged by the imaging unit 1002 as shown in FIG. A display indicating the position and size of X is superimposed or synthesized (see FIG. 7).

In addition, when a therapeutic substance is administered to the infarct region X displayed in the tomographic image and the three-dimensional image described above or in the vicinity thereof, the therapeutic substance is administered, for example, by displaying a predetermined mark at the administration position. The display unit 1004 displays a display that enables the identified position to be identified. In this way, it becomes easy for a medical worker such as a doctor to grasp the progress of the treatment while checking the image processing apparatus 1001.

The operation unit 1005 is a part that receives a user operation. The operation unit 1005 can be configured by various user interfaces such as a switch and a liquid crystal touch panel provided on the outer wall of the apparatus main body 1001b of the image processing apparatus 1001, for example.

The storage unit 1006 is a part that stores the positional relationship between different preset parts of the insertion member 1031 and the outline shape of the insertion member 1031 corresponding to the positional relation in association with each other. The storage unit 1006 can be configured by a memory such as a ROM (abbreviation of Read Only Memory) or a RAM (abbreviation of Random Access Memory), for example.

The control unit 1007 instructs each of the imaging unit 1002, the image processing unit 1003, the display unit 1004, the operation unit 1005, and the storage unit 1006 to execute the above-described operation at a predetermined timing. For example, the control unit 1007 reads an image processing program stored in the storage unit 1006 and causes the image processing unit 1003 to execute image processing. The control unit 1007 is configured by a processor 1020 (see FIG. 5) such as an MPU or a CPU, similar to the image processing unit 1003 described above. The image processing unit 1003 and the control unit 1007 may be configured from a single processor 1020 or a plurality of processors.

Next, the insertion member 1031 of the image processing apparatus set 1100 will be described.

The insertion member 1031 is a member inserted into the heart. The insertion member 1031 of this embodiment includes a transmission device 1031a that transmits a plurality of pieces of position information. More specifically, the insertion member 1031 of this embodiment includes a tubular member 1031b that is inserted into the heart, and the above-described transmission device 1031a is attached to the outer peripheral surface of the tubular member 1031b. Further, in the present embodiment, a plurality of transmitting devices 1031a are attached at different positions in the circumferential direction of the tubular member 1031b. The plurality of pieces of position information of the insertion member 1031 are transmitted from a plurality of transmission devices 1031a attached to different positions. Therefore, the outer diameter information of the tubular member 1031b can be acquired from the position information transmitted from each of the plurality of transmission devices 1031a. The outer diameter information of the tubular member 1031b may be information that can specify the outer diameter of the tubular member 1031b, and is not limited to the outer diameter dimension. For example, it is good also as information which can specify an outer diameter indirectly, such as circumference. By using this outer diameter information, the contour of the tubular member 1031b in the image can be corrected. The transmitting device 1031a of this embodiment can transmit an ultrasonic signal, and transmits an ultrasonic signal as position information.

In the present embodiment, as the “plurality of position information” of the insertion member 1031, position information of different positions in the circumferential direction of the tubular member 1031 b is used to acquire the outer diameter information of the insertion member 1031. Any information on the insertion member 1031 that can be used for correcting the contour of the member 1031 is not limited to the outer diameter information.

The insertion member 1031 of the present embodiment includes the tubular member 1031b. However, the insertion member 1031 is not limited to the configuration including the tubular member 1031b. For example, another insertion device such as a surgical device delivered to the target site through the tubular member such as a catheter can be used. It may be a medical instrument.

As described above, the image processing apparatus 1001 described above executes the image processing method shown in the flowchart of FIG. Specifically, the image processing method by the image processing apparatus 1001 includes a receiving step S1 for receiving a plurality of positional information transmitted from an insertion member 1031 inserted into the heart, and an imaging step for taking an image of the heart from the body surface. S2 and image processing process S3 which correct | amends the outline of the insertion member 1031 in the heart in an image based on the several positional information transmitted from the insertion member 1031. FIG. Since the processing in each of the steps S1 to S3 is as described above, description thereof is omitted here.

The image processing apparatus 1001, the image processing apparatus set 1100, and the image processing method that can be executed by the image processing apparatus 1001 are not limited to the specific configuration and process described above, and various changes and modifications are possible. For example, in addition to a plurality of position information of a tubular instrument (for example, a catheter) as the insertion member 1031, outer diameter information and shape of a puncture member as a medical instrument delivered into the heart through the tubular instrument as the insertion member 1031 The outline of the insertion member 1031 in the image may be corrected using various types of information such as information. The puncture member is used when the myocardium is punctured and a therapeutic substance is injected into the myocardium, and is used by projecting from the distal end opening of a tubular instrument as the insertion member 1031. Therefore, the puncture member is reflected together with the tubular instrument as the insertion member 1031 in the cross-sectional image of the heart (see FIG. 7). Therefore, various types of information on the puncture member may be acquired and used for contour correction of the insertion member 1031. Various types of information on the puncture member may be input from the operation unit 1005 or stored in the storage unit 1006, for example.

Further, in the above-described embodiment, a cross-sectional image of a cross section substantially orthogonal to a line segment connecting the aortic valve AV (see FIG. 6) and the apex Y (see FIG. 6) of the left ventricle LV (see FIGS. 6 and 7). 7 (see FIG. 7), the contour of the insertion member 1031 is corrected. However, the contour of the insertion member 1031 is obtained by a similar method in a tomographic image of the heart or a cross-sectional image of the heart at a position different from that in FIG. It may be corrected.

As described above, the image processing apparatus 1001 described above
(1): an imaging unit 1002 that can capture an image of the heart from the body surface, and an image processing unit 1003 that corrects an outline of the insertion member 1031 inserted in the heart in the image, The imaging unit 1002 includes a receiving device 1002a that receives a plurality of pieces of position information transmitted from the insertion member 1031. The image processing unit 1003 is based on the plurality of pieces of position information received by the receiving device 1002a. The contour of the insertion member 1031 in the image is corrected.

(2): In the image processing device 1001 according to (1), the image processing unit 1003 performs the insertion in the image based on a difference in reception timing of the plurality of position information received by the receiving device 1002a. The contour of the member 1031 is corrected.

(3): In the image processing apparatus 1001 described in (1) or (2) above, the imaging unit 1002 includes an ultrasonic transmission unit 1011 that transmits ultrasonic waves and an ultrasonic reception unit 1012 that receives ultrasonic waves. And an image forming unit 1013 for forming the image from the measurement information received by the ultrasonic wave receiving unit 1012.

(4): In the image processing apparatus 1001 according to (3), the plurality of pieces of position information are ultrasonic signals, and the receiving apparatus 1002a is an ultrasonic receiving apparatus that receives the ultrasonic signals, The ultrasonic receiving device constitutes the ultrasonic receiving unit 1012.

(5): In the image processing apparatus 1001 described in (1) to (4) above, the imaging unit 1002 captures the image every predetermined time.

(6): The image processing apparatus 1001 described in (1) to (5) above includes a display unit 1004 capable of displaying the image corrected by the image processing unit 1003.

The above-described image processing apparatus set 1100 includes:
(7): The image processing apparatus 1001 according to (1) to (6) above, and the insertion member 1031 inserted into the heart, the transmission apparatus 1031a transmitting the plurality of position information. Prepare.

(8): In the image processing apparatus set 1100 according to (7), the insertion member 1031 includes a tubular member 1031b to be inserted into the heart, and the transmitter 1031a is an outer peripheral surface of the tubular member 1031b. Is attached.

(9): In the image processing device set 1100 described in (8) above, a plurality of the transmitting devices 1031a are attached to different positions in the circumferential direction of the tubular member 1031b, and the plurality of pieces of positional information are It is transmitted from a plurality of transmission devices 1031a.

Further, the above-described image processing apparatus 1001 executes the following image processing method (10).
(10): receiving step S1 for receiving a plurality of positional information transmitted from the insertion member 1031 inserted into the heart, imaging step S2 for taking an image of the heart from the body surface, and intracardiac in the image And an image processing step S3 for correcting the contour of the insertion member 1031 based on the plurality of pieces of position information.

Furthermore, another image processing apparatus may be configured by appropriately combining the above-described constituent elements of the image processing apparatus 1 and the above-described constituent elements of the image processing apparatus 1001. Further, the constituent elements of the image processing apparatus 1 may have the functions of the constituent elements of the image processing apparatus 1001. For example, the image processing unit 4 of the image processing apparatus 1 may be configured to have both functions of the image processing unit 1003 of the image processing apparatus 1001. Therefore, for example, the above-described image processing apparatus 1 and the image processing apparatus 1001 are combined, and the functions of a plurality of constituent elements are combined into a single constituent element as necessary. And an image processing apparatus having both functions of the image processing apparatus 1001.

1: Image processing device 1a: 3D ultrasonic probe 1b: Device body 2: Imaging unit 3: Acquisition unit 4: Image processing unit 5: Display unit 6: Input unit 7: Operation unit 8: Storage unit 9: Control unit 11 : Ultrasonic transmitter 12: Ultrasonic receiver 13: Image forming unit 20: Processor 31: Tubular member 1001: Image processing apparatus 1001 a: Three-dimensional ultrasonic probe 1001 b: Main body 1002: Imaging unit 1002 a: Receiver 1003: Image Processing unit 1004: Display unit 1005: Operation unit 1006: Storage unit 1007: Control unit 1011: Ultrasonic transmission unit 1012: Ultrasonic reception unit 1013: Image forming unit 1020: Processor 1031: Insertion member 1031a: Transmission device 1031b: Tubular member 1100: Image processing device set AO: Aorta AV: Aortic valve FA: Femoral artery LV: Left ventricle X: Infarct region Y: Apex

Claims

An imaging unit capable of capturing an image of the heart from the body surface;
An acquisition unit for acquiring outer diameter information of a tubular member inserted into the heart;
An image processing apparatus comprising: an image processing unit that corrects an outline of the tubular member in the image based on the outer diameter information acquired by the acquisition unit.
The image processing apparatus according to claim 1, wherein the image processing unit corrects a contour of the tubular member in the image based on the outer diameter information and the scale information of the image.
The imaging unit
An ultrasonic transmitter that transmits ultrasonic waves;
An ultrasonic receiver for receiving ultrasonic waves;
The image processing apparatus according to claim 1, further comprising: an image forming unit that forms the image from measurement information received by the ultrasonic wave receiving unit.
The image processing apparatus according to any one of claims 1 to 3, wherein the imaging unit captures the image at predetermined time intervals.
5. The image processing apparatus according to claim 1, further comprising a display unit capable of displaying the image corrected by the image processing unit.
The image processing apparatus according to claim 1, further comprising an input unit that inputs the outer diameter information to the acquisition unit.
It has an operation unit that accepts user operations,
The image processing apparatus according to claim 6, wherein the input unit inputs the outer diameter information received by the operation unit to the acquisition unit.
A storage unit for storing the outer diameter information;
The image processing apparatus according to claim 6, wherein the input unit inputs the outer diameter information stored in the storage unit to the acquisition unit.
An acquisition unit for acquiring outer diameter information of a tubular member inserted into the heart;
An image processing apparatus comprising: an image processing unit that corrects a contour of the tubular member in a heart image captured from a body surface based on the outer diameter information acquired by the acquisition unit.
An imaging step of capturing an image of the heart from the body surface;
Obtaining an outer diameter information of the tubular member inserted into the heart; and
An image processing step of correcting an outline of the tubular member in the image based on the outer diameter information.